VERIFIED SOLUTION i

Vault databasecheck utility with multiple databases

Issue

According to the e2loaderd log, 7 files were indexed without any errors.
 
1 in index\hi\invlink.dri (2013073139167-villas.drd)
1 in index\dcco\invlink.dri (201309197-31-046235120186-frentedecobranza.drd) 
3 in index\defa\invlink.dri (2013092003-15-33929703035160-fact3noelec.drd, 2013092003-25-24929702766287-fact3noelec.drd, 2013092009-38-18408105780847-fact3.drd)
2 in index\dcfa\invlink.dri (2013092008-27-32017174742951-fact3.drd, 2013092009-55-34436008143742-fact3.drd)
 
However when they run databasecheck against the databases:
 
databasecheck.exe "C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\dcfa\invlink.dri" > ceckbasedcfa.txt
 
Document Data Files
 
    Total number of files: 7
 
Page Data Files
 
    Total number of files: 7
 
Journal Files
 
    Total number of files: 7
 
C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\dcfa\invlink.dri Index Entries
 
    Total number of index entries: 2
 
Report
 
    PDJ-    2013073139167-villas
    PDJ-    201309197-31-046235120186-frentedecobranza
    PDJ-    2013092003-15-33929703035160-fact3noelec
    PDJ-    2013092003-25-24929702766287-fact3noelec
    PDJ-    2013092009-38-18408105780847-fact3
 
    Total number of faults: 5
    
databasecheck.exe "C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\defa\invlink.dri" > ceckbasedefa.txt
 
 
Document Data Files
 
    Total number of files: 7
 
Page Data Files
 
    Total number of files: 7
 
Journal Files
 
    Total number of files: 7
 
C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\defa\invlink.dri Index Entries
 
    Total number of index entries: 3
 
Report
 
    PDJ-    2013073139167-villas
    PDJ-    201309197-31-046235120186-frentedecobranza
    PDJ-    2013092008-27-32017174742951-fact3
    PDJ-    2013092009-55-34436008143742-fact3
 
    Total number of faults: 4
 
 
databasecheck.exe "C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\dcco\invlink.dri" > ceckbasedcco.txt
 
 
databasecheck.exe "C:\Program Files (x86)\PBBI CCM\e2 Vault\server\index\hi\invlink.dri" > ceckbasehi.txt 
 
Each result shows "faults." The "faults appear to be documents that were indexed in another database. 
 
Is this the way it is supposed to work? That databasecheck would show files that were indexed in another database as a fault?
 

Cause

The problem is that Vault stores .drd and .drp files in a common, shared pool of files.
It doesn't have the internal notion of a job being associated with only 1 database.
 
So database check goes through the list of files in the common store and sees if they are referenced in the specified index.
So if a file is not used in the current database, it won't be in the selected index and databasecheck will report a missing 'I' error fault.
 

Resolution

UPDATED: June 20, 2017
Alternatives might be the .check flag file, e2util -z and indexcheck -validfile.
 
(1) For the .check flag file, e2loaderd basically goes through the steps of indexing to verify that all the index keys for the job are present.
 
You can create the flag file manually in the same manner as .index, etc.
 
Or you can use the vaultflag.bat file to help automate multiple flags:
 
E:\Demo\Exjourn\server>tools\vaultflag.bat check *
 
create .check flag files for *.drd files in docdata/storage
 
removing temporary file
scanning docdata
scanning storage
creating flag files
 
e2loaderd:
 
14:19:33 start checking [20011111-tryme-telco-statement]
14:19:33 ERROR 18011: key [32200271_2001/11/11_20011111-tryme-telco-statement_] not found in index [index\index\invlink.dri]
14:19:33 finished checking [20011111-tryme-telco-statement]
14:19:33 start checking [20011211-tryme-telco-statement]
14:19:33 finished checking [20011211-tryme-telco-statement]
14:19:33 start checking [20120411-tryme-telco-statement]
14:19:33 finished checking [20120411-tryme-telco-statement]
 
Here I manually deleted an invlink key for this document and ran e2util -ze on the job.
 
(2) Something similar can be done with e2util -ze which checks and reports on index errors:
 
E:\Demo\Exjourn\server>e2util -ze storage\2001\11\11\20011111-tryme-telco-statement.drd
14:13:20 Vault Utility 6.1M0p0108
14:13:20 (C) Copyright 1993-2012 Pitney Bowes Software Inc.
14:13:20 Vault Utility licenced to [Volley Systems Integration Team (INTERNAL USE ONLY)]
32200271 2001/11/11 612 724 3194 14 Minhazul Abraham 7711 Char Leen Ln 42106-1206 [1 ERRORS]
 
You can also use e2util -ze1 where the '1' tells it to check only the first document in the .drd file.
 
(3) And indexcheck -validfile will see if index entries reference jobs for which both .drd and .drp exist:
 
E:\Demo\Exjourn\server>indexcheck -validfile -noprint index\index\invlink.dri | more
 
Index Diagnostic 6.1M0p0103
 
Search [index\index\invlink.dri] for:
 
  []
 
Found:
 
  [00020347_2001/11/11_20011111-tryme-telco-statement_]
    ERROR 14117: missing compressed data file
  [00020347_2001/12/11_20011211-tryme-telco-statement_]
    ERROR 14117: missing compressed data file
  [00039829_2001/11/11_20011111-tryme-telco-statement_]
    ERROR 14117: missing compressed data file
  [00039829_2001/12/11_20011211-tryme-telco-statement_]
    ERROR 14117: missing compressed data file
  [00140255_2001/11/11_20011111-tryme-telco-statement_]
    ERROR 14117: missing compressed data file
  [00140255_2001/12/11_20011211-tryme-telco-statement_]
 
Environment Details
Vault 6.x, all platforms