org.terrier.services.websitesearch

Class WebsiteSearch

java.lang.Object

org.terrier.services.websitesearch.WebsiteSearch

public class WebsiteSearch
extends Object

Represents a search engine that can search a specified website. It downloads all of the pages of the website, indexes them and then makes them available for search. This class auto-configures by overriding variables normally loaded from the terrier.properties file as follows:

• indexer.meta.forward.keys = title,URL,time,content
• indexer.meta.forward.keylens = 140,120,64,5000
• querying.postfilters.controls = decorate:org.terrier.querying.Decorate
• querying.postfilters.order = org.terrier.querying.Decorate
• metaindex.crop = true
• ignore.low.idf.terms = false
• querying.default.controls = start,end,decorate:on,summaries:content,emphasis:title;content
• trec.model = DirichletLM

Author:

Richard McCreadie

Nested Class Summary

Nested Classes

Modifier and Type	Class and Description
class	WebsiteSearch.WebsiteCrawlerThread This represents an instance that performs the crawling of a specified website.

Constructor Summary

Constructors

Constructor and Description
WebsiteSearch() Creates a new website search system

Method Summary

Methods

Modifier and Type	Method and Description
void	crawlWebsite(String website, int pageDepth) Crawls a specified website, following links to a maximum depth of pageDepth.
CollectionStatistics	getCollectionStatistics()
SearchRequest	search(String query, int rankingDepth)
void	writeIndex(String path, String prefix)

Methods inherited from class java.lang.Object

clone, equals, finalize, getClass, hashCode, notify, notifyAll, toString, wait, wait, wait

Constructor Detail

WebsiteSearch

public WebsiteSearch()

Creates a new website search system

Method Detail

getCollectionStatistics

public CollectionStatistics getCollectionStatistics()

writeIndex

public void writeIndex(String path,
              String prefix)

search

public SearchRequest search(String query,
                   int rankingDepth)

crawlWebsite

public void crawlWebsite(String website,
                int pageDepth)

Crawls a specified website, following links to a maximum depth of pageDepth.

Parameters:

website -

pageDepth -