Monday, May 30, 2011

Lotus Domino Indexing / Search

In addition to maintaining view indexes, the indexer is responsible for maintaining database (full text) indexes.
Indexer consists of three components :
Update task  --> runs in the background at all times so view indexes are kept current & DB FT searches set for immediate upts
Updall task
Notes Indexing Facility (NIF) Subsystem

Every view must be indexed before it can be accessed.

The update task works continuously from a queue called $UpdateQueue. The $UpdateQueue is a hard-coded queue that has a maximum capacity of 500 requests.
Update checks the queue every 5 seconds for any new requests but it does not refresh views at the same interval.
Instead,it uses an Update suppression Time., Update waits (5 minutes by default)

To override default suppression time use notes.ini parameter
    Update_Suppression_Time=minutes

The indexer is the most CPU intensive Domino Server task
On a server with multiple processor , enable max of one update task per processor in notes.ini.

    Updaters = #number of desired update task


Updall is similar to Update, but it does not run continually or work from a queue. By default it is run at 2:00 AM
To save disk space, Updall also purges deletion stubs from database and discards view indexes for views that have been unused for 45 days.

The majority of the requests handled by the NIF are made when users navigate views.When user opens a view, the NIF checks to see whether the view is up to date.If the view is not current, the NIF forces an update of view collection.

You must have Designer access in the Database ACL to create create FT index.

By default , only documents of 6MB in size (or less, including attachments) are indexed. To change this limit notes.ini parameter
    FTG_INDEX_LIMIT=X  (in bytes)

Updall switches, Update and NIF - Notes indexing basics
http://www-1.ibm.com/support/docview.wss?uid=swg21085954

Notes R5 used a search engine called GTR or Global Text Retrieval.Previous versions of Notes used the Verity search engine.

Domino supported syntax for Full Text searching
http://www-1.ibm.com/support/docview.wss?uid=swg27003210

Searching  Domino Domains


The database catalog provides a central list of the dbs on a Domino server. All dbs, except for mail dbs, are included in the catalog by default when the catalog server task runs.

To eliminate policy documents from the database catalog , use –P parameter.
 
         ServerTaskAt1=catalog –p
         load catalog –p

Domain cataloging and indexing require significant amounts of server resources. For example, it is not unusual for the first build of a Domino Index to take more than a week.

The central Domain index eliminates the overhead associated with maintaining and distributing smaller private indexes scattered across servers in a network and allows users to create a single query that searches a variety of DBs and  file systems. The Domain indexer task domidx build a central Domain index on the Domain catalog server that all Domain search queries use(by default the index is created in domino\data\FTDOMAIN.DI directory).
The domain indexer runs according to the schedule you specify in the server document.

What is the Domino Domain index and how is it created ?
http://www-1.ibm.com/support/docview.wss?rs=0&uid=swg21093770

Domino R5 Domain Search
http://www-1.ibm.com/support/docview.wss?rs=899&uid=swg27002855

How does the R5 Domain Index handle DB replicas?
http://www-1.ibm.com/support/docview.wss?uid=swg21102757

Article Domino R5 Domain Search by Susan Florio
http://www.ibm.com/developerworks/lotus/library/ls-Domain_Search/index.html

No comments: