Indexing the Net - A Review of Indexing Tools

Abstract

This paper briefly reviews research into automated indexing in the last thirty years. This research has provided the technological underpinning for the indexes which are currently use to index the internet. Background is provided on the evaluation techniques use to measure index performance. A brief history of the deployment of these techniques in WAIS and gopher indexes leading up to web robots completes this section.

A literature review of the main services which index the world wide web is provided and their principal conclusions are presented in tabular form providing a comparison and evaluation. A summary of issues drawn from this literature review is made leading to some speculation for the future.

The paper ends with a conclusion that current systems are a long way from providing a natural language interface. A detailed annotated bibliography of the source material is presented.

Keywords

Keywords: Automated indexing, Indexing, Search engines

Pointers to Full Paper and Conference Presentation
Full Paper	Conference Presentation	Interactive Version	Papers & posters in this theme	All Papers & posters	AusWeb96 Home Page

AusWeb96 Second Australian WorldWideWeb Conference, Southern Cross University, PO Box 157, Lismore NSW 2480, Australia Email: "ausweb96@scu.edu.au"