make search faster for large indexes
Currently document informations is retrieved for all documents. This is not scalable, if a term matches most documents in the index. Potential way around:
- store document magnitude with postings, so extra document information is not needed for all documents, but only for the top 25 documents;
- make multiple tiers based on relevance (page rank or something), and serve first from top most tier, and so on.
Edited by Bernard van Gastel