Zeeker: A topic-based search engine

Magnus Sigurdsson, Søren Christian Halling

AbstractThe rapid growth and massive quantities of data on the Internet have increased the importance and complexity of Information Retrieval. The amount and diversity of data introduce shortcomings in the way search engines rank their results. As a result, Search Engine Optimization companies flourish by exploiting the search engine weaknesses in order to manipulate the search results. Furthermore, many search engines present several million results to queries and more often or not these results are biased toward blogs and on-line stores. This bias is due to the link analysis used to rank the search results. Internet link structure is the strength but at the same time the Achilles’ heel of these ranking algorithms.

In this work it is proposed to push search engine behavior in a new direction, away from link analysis and toward actual content and topic analysis of web pages. With the use of clustering algorithms and the vast amount of information in Wikipedia the idea is to create categories that are good enough to be used to filter search results. The prospect of letting the user filter the search results by the push of a button would improve the relevance of the search results for a particular query. Categories will give the user fewer yet more relevant results.

The well-defined categories and articles of Wikipedia are shown to be valuable as a training set when clustering Internet data. The implemented Zeeker Search Engine has precise categories which can become even better by taking advantage of additional information available in Wikipedia.

A user-survey conducted has revealed that Zeeker Search Engine has good relevance when retrieving information, is easy to use and has great potential as a search engine. This work has suggested innovative ideas and ways of using the information in Wikipedia to produce good categories and retrieve more relevant search results.
KeywordsSearch engine design, Information Retrieval, Natural Language Processing, Clustering, Wikipedia, Zeeker Search Engine
TypeMaster's thesis [Academic thesis]
PublisherInformatics and Mathematical Modelling, Technical University of Denmark, DTU
AddressRichard Petersens Plads, Building 321, DK-2800 Kgs. Lyngby
NoteSupervised by Prof. Lars Kai Hansen, IMM, DTU.
Electronic version(s)[pdf]
BibTeX data [bibtex]
IMM Group(s)Intelligent Signal Processing

Back  ::  IMM Publications