Files not being seen & wrong size

[therube]

Files not being seen & wrong size, & I'm not understanding why?



File size is wrong.
Date & time are correct.
Folder size is wrong.

No excludes.
NTFS; Include, Enable USN, Monitor
Max size: 51200, which is odd (higher), in comparison to my other drives.

Forced refresh made no change.

Everything 1.4.0.713b
XP SP3

?

Code: Select all

A disk check has been scheduled.
Windows will now check the disk.                         
Cleaning up 1738 unused index entries from index $SII of file 0x9.
Cleaning up 1738 unused index entries from index $SDH of file 0x9.
Cleaning up 1738 unused security descriptors.
CHKDSK is verifying Usn Journal...
Usn Journal verification completed.

   9438155 KB total disk space.
   8120944 KB in 24052 files.
     10360 KB in 4082 indexes.
         0 KB in bad sectors.
    136735 KB in use by the system.
     49248 KB occupied by the log file.
   1170116 KB available on disk.

      4096 bytes in each allocation unit.
   2359538 total allocation units on disk.
    292529 allocation units available on disk.

Windows has finished checking your disk.

Everything -unistall-service
Everthing -install-service

Then, with nothing \dumy\ except for Everything.exe (i.e., no Everything.ini)...

Code: Select all

everything.EXE  -instance dumy  -db  C:\Locate\dumy\dumy.db

Still not right.

?

Code: Select all

ntfs_volume_guids="\\\\?\\Volume{80b65e57-1ead-11dd-a4f0-806d6172696f}","\\\\?\\Volume{80b6...}"
ntfs_volume_paths="C:","E:","L:","M:","O:","W:","X:"
ntfs_volume_roots="","","","","","",""
ntfs_volume_includes=1,1,1,1,1,1,1
ntfs_volume_load_recent_changes=0,0,0,0,0,0,0
ntfs_volume_include_onlys="","","","","","",""
ntfs_volume_monitors=1,1,1,1,1,1,1

Code: Select all

search '\data_3' filter '' sort 0
SET SORT 0
found 0 folders, size 0, db search time taken: 0.004226 seconds
found 4 files, size 65540, db search time taken: 0.048512 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000237 seconds
update selection 0.000001 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000119 seconds
new results
WM_ACTIVATE 00000000 00000000, lastfocus 00130230, current focus 00130230

[void]

There might be an issue detecting the change to the file or reading the file size.

Try changing the attributes of the file (eg: attrib data_3 -a / attrib data_3 +a), does the size update correctly?

If not, don't force a rebuild below, could you please send the verbose debug output after changing the attributes again.

Does forcing a rebuild from Tools -> Options -> Indexes show the correct size?

[therube]

Does forcing a rebuild from Tools -> Options -> Indexes show the correct size?

No.
(Above I said "forced refresh", meant to say, "forced rebuild".)

And actually, I'd already run separate instances, & they show similar?
(I'll have to double check on that. I may have noticed differences between the two...?)


Others will have to wait till tomorrow... I'll update this post...

[void]

And actually, I'd already run separate instances, & they show similar?

I would expect the same behavior for all instances.

Please try running the following from a command prompt:

Code: Select all

fsutil file queryallocranges offset=0 length=999999999 c:\...\data_3

Where c:\...\data_3 is the full path and filename to your data_3 file.
What is displayed in the command prompt?

What is shown when you right click the file in Explorer and click Properties? (Size? size on disk? Compressed? Encrypted?)
Alternate stream maybe? (vista or later: dir data_3 /r) Everything only shows the size of the unnamed stream.

[therube]

Code: Select all

E:\Documents and Settings\RUBEN\Application Data\Intuit\TurboTax\TY14\Browser\Premier\ExternalCo
ntent\Cache> fsutil file queryallocranges offset=0 length=999999999 data_3

** Range : 0 **
Starting Offset : 0x0
Length in bytes : 0x402000

Code: Select all

Volume in drive E

 Directory of E:\Documents and Settings\RUBEN\Application Data\Intuit\TurboTax\TY14\Browser\Premier\ExternalContent\Cache

04/14/2015  12:04 PM    <DIR>          .
04/14/2015  12:04 PM    <DIR>          ..
04/14/2015  03:18 PM            45,056 data_0
04/14/2015  03:18 PM           270,336 data_1
04/14/2015  03:18 PM         1,056,768 data_2
04/14/2015  03:18 PM         4,202,496 data_3
04/14/2015  12:04 PM            19,389 f_000001
04/14/2015  12:04 PM            33,314 f_000002
04/14/2015  12:04 PM           248,977 f_000003
04/14/2015  12:04 PM            23,730 f_000004
04/14/2015  12:04 PM            22,878 f_000005
04/14/2015  12:04 PM            23,937 f_000006
04/14/2015  12:04 PM            23,941 f_000007
04/14/2015  12:04 PM           262,512 index
              12 File(s)      6,233,334 bytes
               2 Dir(s)   1,207,730,176 bytes free

[therube]

Try changing the attributes of the file (eg: attrib data_3 -a / attrib data_3 +a), does the size update correctly?

My first screenshot (above, first post, includes file manager) showing attribute to be A.
Removed the archive bit & ...



Now why is that?

(The 3 other data_3 files likewise are displaying incorrect sizes, & the directories thereof too.)

(As well as other files in that directory, except for, now, data_3.)

[void]

Thanks for the screen shots.

Now why is that?

Everything uses two different methods for determining the file size:
1) when indexing the file sizes is read from the MFT.
2) when the file changes the sizes in read from windows API calls.

always reading the size from the mft is on my TODO list.
The problem also lies with reading the size from the MFT.

Folder sizes are calculated from file sizes, so if the file size is wrong, the folder size will also be wrong.

I've modified the latest beta to show additional information about data_3 files.
What is the debug output from http://www.voidtools.com/Everything-1.4.0.718b.x86.zip after forcing a rebuild?

[therube]

Code: Select all

search 'E:\Documents and Settings\RUBEN\Application Data\Intuit\TurboTax\TY14\Br
owser\Premier\ExternalContent\Cache' filter '' sort 5
SET SORT 4
found 1 folders, size 65540, db search time taken: 0.015543 seconds
found 12 files, size 65540, db search time taken: 0.142859 seconds
total size 940934, calculated in 0.000002 seconds
set sort 5 1
SET SORT 3 5
finished sort, time taken 0.000236 seconds
update selection 0.000001 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000117 seconds
new results
no search history hwn
WM_ACTIVATE 00000000 00000000, lastfocus 001001fc, current focus 001001fc
WM_ACTIVATE 00000001 00000000, lastfocus 001001fc, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 001001fc, current focus 001001fc
WM_ACTIVATE 00000001 00000000, lastfocus 001001fc, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 001001fc, current focus 001001fc

Code: Select all

search '/data_3' filter '' sort 5
SET SORT 4
no search history hwn
found 0 folders, size 0, db search time taken: 0.006009 seconds
found 4 files, size 65540, db search time taken: 0.085055 seconds
total size 851968, calculated in 0.000001 seconds
set sort 5 1
SET SORT 3 5
finished sort, time taken 0.000242 seconds
update selection 0.000001 seconds

Code: Select all

search 'E:\Documents and Settings\RUBEN\Application Data\Intuit\TurboTax\TY15\Br
owser\Deluxe\ExternalContent\Cache' filter '' sort 5
SET SORT 4
found 1 folders, size 65540, db search time taken: 0.012835 seconds
found 17 files, size 65540, db search time taken: 0.149267 seconds
total size 957112, calculated in 0.000001 seconds
set sort 5 1
SET SORT 3 5
finished sort, time taken 0.000236 seconds
update selection 0.000001 seconds

Code: Select all

monitor wakeup timer 1000
update index E:
WAIT 1000, 6 waits
update icon data_3
waited 0
monitor wakeup timer 1000
WAIT 1000, 6 waits
updated E: in 0.000701 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000079 seconds
new results
waited 1031
WAIT 0, 7 waits

(Now I'm not sure at just what points these were of...?
I guess they were all after the Forced Rebuild.
First search for TY14 [dir], then /data_3, then TY15 [dir]
The last, pretty sure was after changing the file attribute.)

[therube]

data_3, original



data_3, final



After having change the file attribute, data_3 is now correct for both TY14 & TY15.

EH, HOLD TIGHT, I'M CONFUSING MYSELF.
DIDN'T REALIZE JUST HOW MANY "data_3's" I HAD & JUST WHERE THEY WERE.
LOOKS LIKE I NOW HAVE TWO (different) TY15's correct, but the TY14 IS STILL NOT ...

The two above were (different paths) both TY15.



This is now TY14, after having change the file attribute (from none) to Archive.

[therube]

Now this one is odd, cause it must have been before the Forced Rebuild, & at that point, TY14, does show the correct file size for data_3.
Note that the Archive bit is not set.



But after the Forced Rebuild, it was detecting an incorrect size.

[therube]

TY14, BEFORE Forced Rebuild.
(data_3) size is correct.



TY14, AFTER Forced Rebuild.
(data_3) size is incorrect.

[therube]

(All this was done, newly, after any of the above...)


Before, then after a Forced Rebuild.
And the log.

Code: Select all

search '!/recent E: /data_3' filter '' sort 5
FOLDER ROOT E: STARTWITH e:
SET SORT 4
found 0 folders, size 0, db search time taken: 0.007790 seconds
found 3 files, size 65540, db search time taken: 0.101581 seconds
total size 843776, calculated in 0.000001 seconds
set sort 5 1
SET SORT 3 5
finished sort, time taken 0.000150 seconds
update selection 0.000001 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000094 seconds
new results
when ready 11 0000002d 00000000
when ready 8 00000000 00000000
WM_ACTIVATE 00000001 001103e8, lastfocus 001001fc, current focus 001103e8
WM_ACTIVATE 00000000 00000000, lastfocus 001001fc, current focus 001001fc
WM_ACTIVATE 00000001 00000000, lastfocus 001001fc, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 001001fc, current focus 001001fc

At that point, the file size are back to being incorrect, & I'd have to change the file attributes in order for them to display correctly.

After the rebuild, Log shows (incorrectly), "total size 843776".

[therube]

And it doesn't end there...

So I close the debug window, which closes (I guess Quit's) Everything.
Then I reopen Everything & search:

> !/recent E: /data_3

And the file sizes show correctly!?

-------

Close debug window.
Everything Quits.
Open Everything & search:

Code: Select all

search '!/recent E: /data_3' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.006134 seconds
found 3 files, size 65540, db search time taken: 0.064625 seconds
total size 12607488, calculated in 0.000002 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000135 seconds
update selection 0.000001 seconds
DB_WAIT: _db_ready_proc waiting...
DB_WAIT: _db_ready_proc waited 0.000071 seconds
new results
WM_ACTIVATE 00000000 00000000, lastfocus 001501f6, current focus 001501f6
WM_ACTIVATE 00000001 00000000, lastfocus 001501f6, current focus 00000000
WM_ACTIVATE 00000000 00000000, lastfocus 001501f6, current focus 001501f6

File sizes are correct.


-------


Forced Rebuild:

Code: Select all

search '!/recent E: /data_3' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.006188 seconds
found 3 files, size 65540, db search time taken: 0.071972 seconds
total size 843776, calculated in 0.000001 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000206 seconds
update selection 0.000001 seconds

File sizes are incorrect?


-------


Close debug window.
Everything Quits.
Restart Everything & Search:

Code: Select all

search '!/recent E: /data_3' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.006089 seconds
found 3 files, size 65540, db search time taken: 0.072888 seconds
total size 12607488, calculated in 0.000001 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000184 seconds

Sizes are back to showing correctly.

[void]

Thanks for the debug logs.

I'm missing the debug output from the rebuild though, could you please send all the debug output after a forced rebuild?
The purple text is the important information, eg:

Code: Select all

found data_3 FRN 000000000001801a FILENAME
        allocated_size 0
        attributes 8224
        date_accessed 130834972039537759
        date_created 130834972039537759
        date_mft_modified 130834972039537759
        date_modified 130834972039537759
        file_size 0
        filename_length 6
        flags 3
        packed_ea_size 38654705664
        parent FRN 1125899907063226
END FILENAME
found data_3 FRN 000000000001801a DATA
        allocated_length 16785408
        compression_unit_size 0
        file_size 16785408
        highest_vcn 4097
        lowest_vcn 0
        mapping_pairs_offset 64
        total_allocated 2041446961
        valid_data_length 16781312
END DATA

The behavior you describe is expected.
Forcing a rebuild will show the incorrect size.
The issue lies with the initial indexing.

[therube]

Wasn't sure just what was needed, & didn't realize I could scroll back that far.
(And thought I'd have to use pastebin, but the board took it.)

Code: Select all

found data_3 FRN 000000000000754d FILENAME
        allocated_size 0
        attributes 32
        date_accessed 130735010902656250
        date_created 130735010902656250
        date_mft_modified 130735010902656250
        date_modified 130735010902656250
        file_size 0
        filename_length 6
        flags 3
        packed_ea_size 281474976710656
        parent FRN 23925373020435746
END FILENAME
found data_3 FRN 000000000000754d DATA
        allocated_length 4202496
        compression_unit_size 0
        file_size 4202496
        highest_vcn 1025
        lowest_vcn 0
        mapping_pairs_offset 64
        total_allocated 3053716018
        valid_data_length 229376
END DATA

[void]

Thanks for the debug output.

Everything was displaying the only the initialized size of these files.

Everything 1.4.0.719 should fix the issue:
http://www.voidtools.com/Everything-1.4.0.719b.x86.zip
http://www.voidtools.com/Everything-1.4.0.719b.x64.zip

[therube]

719b, Force Rebuild...

Code: Select all

Everything
Version 1.4.0.719b (x86)
Windows NT 5.1
Processors 2
IsAdmin 1
AppData 0
Service 1
...
search '/data_3 E: TY turbo' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.004825 seconds
found 3 files, size 65540, db search time taken: 0.051739 seconds
total size 12607488, calculated in 0.000001 seconds

Sizes show correctly.

But, then after a Quit & restart, it is again showing incorrectly:

Code: Select all

Everything
Version 1.4.0.719b (x86)
Windows NT 5.1
Processors 2
IsAdmin 1
AppData 0
Service 1
...
search '/data_3 ' filter '' sort 0
SET SORT 0
found 0 folders, size 0, db search time taken: 0.004770 seconds
found 18 files, size 65540, db search time taken: 0.058824 seconds
total size 1015273, calculated in 0.000001 seconds

(Feel free to truncate, again.)

[therube]

Seems I('ve had) a .713b stuck in memory as a Process.
Now that I've killed that, .719b looks to be doing correctly, I think.


(Dang! for having missed that!)


So after getting rid of that, it does look like 719b is detecting the file size correctly.


719b, Force Rebuild...

Code: Select all

Everything
Version 1.4.0.719b (x86)
Windows NT 5.1
Processors 2
IsAdmin 1
AppData 0
Service 2
...
search '/data_3 E: TY turbo' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.006016 seconds
found 3 files, size 65540, db search time taken: 0.053929 seconds
total size 12607488, calculated in 0.000001 seconds

Quit & restart, & still showing correctly :

Code: Select all

Everything
Version 1.4.0.719b (x86)
Windows NT 5.1
Processors 2
IsAdmin 1
AppData 0
Service 2
search '/' filter '' sort 0
SET SORT 0
...
search '/data_3' filter '' sort 0
SET SORT 0
no search history hwn
found 0 folders, size 0, db search time taken: 0.005189 seconds
found 16 files, size 65540, db search time taken: 0.053810 seconds
total size 12777790, calculated in 0.000002 seconds
...
search '/data_3 E: TY turbo' filter '' sort 0
FOLDER ROOT E: STARTWITH e:
SET SORT 0
found 0 folders, size 0, db search time taken: 0.005021 seconds
no search history hwn
found 3 files, size 65540, db search time taken: 0.052173 seconds
total size 12607488, calculated in 0.000002 seconds
set sort 0 1
already sorted
finished sort, time taken 0.000164 seconds
update selection 0.000000 seconds

[void]

Seems I('ve had) a .713b stuck in memory as a Process.
Now that I've killed that, .719b looks to be doing correctly, I think.

I was hoping it was something like this, good to know, thanks.