Not indexing all folders

Discussion related to "Everything" 1.5 Alpha.
Post Reply
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Not indexing all folders

Post by snommit »

It worked in previous versions, but now it's no longer indexing all folders. In the screenshot below it refuses to index EL, GB, Leica, O Drive, RA, etc. I'm having to add them individually as folders for it to index them. Is this a bug or am I doing something wrong?
findex.png
findex.png (62.79 KiB) Viewed 1569 times
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

I haven't been able to reproduce the issue my end.

What version are you using? (Help -> About)

Have you accidentally unchecked "index subfolders" for the main project_Archive folder?
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Re: Not indexing all folders

Post by snommit »

void wrote: Fri Apr 19, 2024 5:10 am I haven't been able to reproduce the issue my end.

What version are you using? (Help -> About)

Have you accidentally unchecked "index subfolders" for the main project_Archive folder?
Apologies for the late response. I'm using 1.5.0.1371a. Yes, I have 'Index Subfolders' enabled for the main folder.
Options.png
Options.png (28.62 KiB) Viewed 1486 times
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

Could you please send some debug output:
  • In Everything, from the Tools menu, under the Debug submenu, check Verbose.
  • From the Tools menu, under the Debug submenu, check Start Debug Logging.
  • From the Tools menu, click Options.
  • Click the Folders tab on the left.
  • Select the first \\server\Project_Archive folder.
  • Click Rescan Now.
    ---'Rescanning \\server\Project_Archive' will be shown at the top right of this window.
    ---Please wait one minute, or wait until this 'Rescanning \\server\Project_Archive' status disappears.
  • In Everything, from the Tools menu, under the Debug submenu, click Stop Debug Logging.
    ---The Everything Debug Log will open in Notepad.
  • Please save this file to the Desktop and upload here.
The logs will show why Everything is not scanning any subfolders.



Are you excluding any files/folders under Tools -> Options -> Exclude?
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Re: Not indexing all folders

Post by snommit »

Submitted! The rescanning would normally take a few hours since it's over 100 million items, so I let the debugger run for a few mins before stopping it. I'll run another one for the whole duration as well just in case you need that too. I have nothing excluded, and I actually disabled it, thinking it may be impacting something.
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

Thank you for the log.

The basic log shows Everything has started scanning your folder.
No errors are reported.

Unfortunately, Everything is not in verbose debug mode.
Rescan activity is only reported in verbose debug mode.



Could you please resend the verbose debug log:
  • Please wait for any existing rescan to complete.
  • In Everything, from the Tools menu, under the Debug submenu, check Verbose.
  • From the Tools menu, under the Debug submenu, check Start Debug Logging.
  • From the Tools menu, click Options.
  • Click the Folders tab on the left.
  • Select the first \\server\Project_Archive folder.
  • Click Rescan Now.
    ---'Rescanning \\server\Project_Archive' will be shown at the top right of this window.
    ---Please wait one minute, or wait until this 'Rescanning \\server\Project_Archive' status disappears.
  • In Everything, from the Tools menu, under the Debug submenu, click Stop Debug Logging.
    ---The Everything Debug Log will open in Notepad.
  • Please save this file to the Desktop and upload here.
The verbose debug logs will contain more information.
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Re: Not indexing all folders

Post by snommit »

So the log file ended up being over 9GB... :( Is there anything I can search for that might be of some help?
Screenshot 2024-05-06 084845.png
Screenshot 2024-05-06 084845.png (1.4 KiB) Viewed 1361 times
Screenshot 2024-05-06 084622.png
Screenshot 2024-05-06 084622.png (4.17 KiB) Viewed 1361 times
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

Thanks for running the log.

Was 'Rescanning \\server\Project_Archive' shown in the status bar?
How long was Everything logging?

It sounds like Everything was rescanning your folder.
There might be an issue with updating your index with this rescan.




Please try a shorter verbose debug log:
  • Please wait for any existing rescan to complete.
  • In Everything, from the Tools menu, under the Debug submenu, check Verbose.
  • From the Tools menu, under the Debug submenu, check Start Debug Logging.
  • From the Tools menu, click Options.
  • Click the Folders tab on the left.
  • Select the first \\server\Project_Archive folder.
  • Click Rescan Now.
    ---'Rescanning \\server\Project_Archive' will be shown at the top right of this window.
    ---Please wait one minute.
  • In Everything, from the Tools menu, under the Debug submenu, click Stop Debug Logging.
    ---The Everything Debug Log will open in Notepad.
  • Please save this file to the Desktop and upload here.
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Re: Not indexing all folders

Post by snommit »

Rescanning was finished. I let it run all weekend, but I made sure to disable any automatic rescans, so it wouldn't do it twice.

Just uploaded the new log.
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

Thank you for the log.

The log show Everything still scanning your remote share.
The performance looks fine (100+ folders a second)

Everything will not update your index until the full scan is complete.
The scan is likely being interrupted before it completes.

Maybe the scan is taking too long..
Is this PC being shutdown daily? Is the remote PC shutdown or disconnected?

I am guessing that a successful rescan has never completed if Everything is not showing any files for this folder.
Under Tools -> Debug -> Statistics -> Folder Index (for this network share) -> What is the Last rescan date, Last rescan successful, Last successful rescan date and Last successful rescan duration?
snommit
Posts: 7
Joined: Tue Apr 09, 2024 2:24 pm

Re: Not indexing all folders

Post by snommit »

Thanks for looking into it!

I have it installed on a spare server that never gets turned off. Let me do some more testing and see if I can reproduce the issue.

As for the statistics, see attached.
Last edited by void on Tue May 14, 2024 12:01 am, edited 1 time in total.
Reason: removed stats
void
Developer
Posts: 16698
Joined: Fri Oct 16, 2009 11:31 pm

Re: Not indexing all folders

Post by void »

Thank you for the stats.

The stats show the last scan was successful.



I think I have misunderstood.

You are finding some files/folders under \\server\share
However, there's a few folders that this doesn't want to scan.

I was assuming no files/folders were found.

Could you please confirm Tools -> Options -> Exclude -> Exclude hidden and system are unchecked.



Quick questions:

Is Everything listing \\tg-pzarchive\project_Archive\EL twice?
Please try searching for: \\tg-pzarchive\project_Archive\EL

If it's listed only once, it would confirm the folder is missing from the root scan.



Does a DIR listing find these folders:
From a command prompt, please run:

DIR \\tg-pzarchive\project_Archive /ad

Is the EL folder listed?
Post Reply