 |
    |
MultiCrawler: A Pipelined Architecture for Crawling and Indexing Semantic Web Data
Andreas Harth, Jürgen Umbrich, and Stefan Decker
National University of Ireland, Galway, Digital Enterprise Research Institutefirstname.lastname@deri.org
Abstract. The goal of the work presented in this paper is to obtain large amounts of semistructured data from the web. Harvesting semistructured data is a prerequisite to enabling large-scale query answering over web sources. We contrast our approach to conventional web crawlers, and describe and evaluate a five-step pipelined architecture to crawl and index data from both the traditional and the Semantic Web.
LNCS 4273, p. 258 ff.
lncs@springer.com
© Springer-Verlag Berlin Heidelberg 2006