Index not updating?

Discussion related to "Everything" 1.5 Alpha.
Post Reply
defza
Posts: 30
Joined: Thu Apr 18, 2019 12:49 pm

Index not updating?

Post by defza »

Hi,

I been using voidtools for years, but I notice with the 1.5 that most times new files and deleted files don't reflect their changes in the index anymore?

Like I downloaded a file now to G:\ drive and it's not in the index, but the C:\ drive shortcut recent thing does show up.
It's not in the Index Journal either where the actions are listed.

Files I delete also stay in the index without disappearing.
I've had to delete the database every now and then to get it to rebuild.

Seems to happen mainly on my external hard drives.

What can I do to help you find the issue?

Cheers,


D
raccoon
Posts: 1017
Joined: Thu Oct 18, 2018 1:24 am

Re: Index not updating?

Post by raccoon »

FAT/FAT32/exFAT formatted drives do not have the robust Journaling that NTFS formatted drives have, which allows Everything to stay current on all file activities and changes to the volume. Everything does an OK job with monitoring for most changes on FAT disks, but it's imperfect.

If your external G:\ drive is formatted NTFS, then make sure it is being indexed under the NTFS section, not under the Folders section.

If it's formatted as FAT* then provide a bug report with exact step-by-step reproduction of the synchronization error so @void can attempt to identify a fix for monitoring those changes that get lost. It may just be necessary to rescan your FAT* formatted volumes frequently between making changes.
void
Developer
Posts: 16771
Joined: Fri Oct 16, 2009 11:31 pm

Re: Index not updating?

Post by void »

Thank you for the bug report defza,

When you notice Everything 1.5 is no longer updating, could you please:
  • In Everything 1.5, from the Tools menu, under the Debug submenu, click Start debug logging.
  • Create and delete a file on your external drive.
  • wait for 1 minute.
  • From the Tools menu, under the Debug submenu, click Stop debug logging.
    ---this will open your Everything Debug Log.txt file.
  • Could you please send this file to support@voidtools.com
defza
Posts: 30
Joined: Thu Apr 18, 2019 12:49 pm

Re: Index not updating?

Post by defza »

void wrote: Thu Nov 18, 2021 6:41 am Thank you for the bug report defza,

When you notice Everything 1.5 is no longer updating, could you please:
  • In Everything 1.5, from the Tools menu, under the Debug submenu, click Start debug logging.
  • Create and delete a file on your external drive.
  • wait for 1 minute.
  • From the Tools menu, under the Debug submenu, click Stop debug logging.
    ---this will open your Everything Debug Log.txt file.
  • Could you please send this file to support@voidtools.com
OK, it's happening again, so I've sent through the debug log via email.
Mrantala
Posts: 10
Joined: Sun Mar 03, 2019 5:12 pm

Re: Index not updating?

Post by Mrantala »

Hello - As luck would have it, only 4 days ago defza updated this topic saying that the index not updating issue was happening again. About 4 days ago is probably when I started noticing the very same issue. Changes to the files on a particular drive are not shown in Everything (I have the options to monitor changes turned on, etc. and haven't been changing those options for quite some time). Just today, adding 5 video files of significant size to a directory (on a network drive) do not show up in Everything. If I rebuild the index through the index menu, then they will show up. Also, and I don't have concrete evidence for this one, but a couple times, say after a reboot of my PC, and then starting everything and searching for a file that I know should be there, doesn't show up in my search, but it does if I go into Options->Index and force a rebuild-then it's there.

I was doing some checking of the ini file to see if I might have changed something by accident, which I didn't find. However, I did notice something might be a root cause of this indexing issue. I've changed drives, drive mappings, network drives, etc. quite a bit recently. Note that I have selected the options in everything to remove offline drives automatically. Yet, the ntfs volume, remote_volume, and even the fat_volume sections.. are.. well, kind of a mess. I will email you with the copied sections from my ini file. What's really worth noting I think is that the ini file has 3 FAT volumes listed, but that section in the Options Dialog - has nothing at all. Also, the drive above where I added the new video files to today and had to manually index to get them to show up...the V: drive - that's listed both in the NTFS and in the Remote Volume sections (monitoring changes on an NTFS volume is done differently than on a remote_volume is it not?). The Z: Drive is listed in all three sections (fat, ntfs, and remote).

Hope this helps. Maybe the mess in the ini file is some setting I have or haven't set ?
Thanks,
Mrantala
tuska
Posts: 1052
Joined: Thu Jul 13, 2017 9:14 am

Re: Index not updating?

Post by tuska »

2Mrantala
It would certainly be important for the author to know which version you are using.
The latest version is currently 1.5.0.1305a - 18.03.2022.

Your version number is?

(I'll probably never understand why users don't announce the version number) :roll: .
defza
Posts: 30
Joined: Thu Apr 18, 2019 12:49 pm

Re: Index not updating?

Post by defza »

Maybe some useful information for dev to check out your issue:

- the debug log as detailed above.


- And maybe send some statistics: In Everything, from the Tools menu, under the Debug submenu, click Statistics.
>> This will shown USN Journal information for each drive for further investigation.


- some debug information about your current volumes:
>> In Everything 1.5, from the Tools menu, under the Debug submenu, click Start Debug Logging....
>> From the Tools menu, click Options.
>>Click the NTFS tab on the left.
>> Close the Options window.
>> From the Tools menu, under the Debug submenu, click Stop Debug Logging....
--- this will open the Everything Debug Log.txt in notepad---


- From the Start menu, search for: cmd
>> Right click Command prompt and click Run as an administrator.
>> Copy and paste the following into the command prompt (right click to paste)
>> fsutil usn queryjournal f:
void
Developer
Posts: 16771
Joined: Fri Oct 16, 2009 11:31 pm

Re: Index not updating?

Post by void »

I am still looking into this issue.


The OS is throwing error 87 (invalid parameter) when trying to read changes from a volume.
Yet, all parameters are valid.
Everything Statistics and fsutil confirm the Journal ID is valid and the Next USN is valid.


To view Everything Statistics:
  • In Everything 1.5, from the Tools menu, under the Debug menu, click Statistics.
To view fsutil information:
  • From a command prompt running as an admin, run:
    fsutil usn queryjournal f:
    where f: is the drive to query.

A common theme to the issue is recently moving the volume to a new drive letter.


If anyone is experiencing this issue could you please send some debug output:
  • In Everything 1.5, from the Tools menu, under the Debug menu, click Start Debug Logging.
  • Wait 1 minute
    ---This should give enough time to log any monitoring errors as Everything will retry after 30 seconds.
  • From the Tools menu, under the Debug menu, click Stop Debug Logging.
    ---This will open your Everything Debug Log.txt in Notepad.
  • please send this file to support@voidtools.com


For now, to have Everything monitor this volume again, type in the following search and pressing ENTER:
/reindex f:
where F: is the drive to remonitor.
Post Reply