In the traditional information extraction settings, we are usually given a database schema, and a set of unstructured or semi-structured documents. The goal of the sys-tem is to automatically extract records from these documents, and fill in the values in the given database. These databases are then used for search, decision support and data mining. In recent years, there has been much work in developing sophisticated methods for performing information extraction over a closed collection of documents [35, 47]. Several different approaches have been proposed for different phases of in-formation extraction task, such as segmentation, classification, association and coref-erence. Most of these proposed approaches make extensive use of statistical machine learning algorithms, which have improved significantly over the years. However, only some of these methods remain computationally tractable as the size of the document corpus grows. In fact, very few systems are designed to scale over a corpus as large as, say, the Web [28, 97].
Early work on extracting information from the Web was conducted by Brin [12]
and Etzioni et al. [29]. Rennie and McCallum [73] built a web spider using Rein-forcement Learning, which served as a foundation for some of the ideas presented in Chapter 6. There are some large scale systems that extract information from the web. Among these are KnowItAll [28, 30], InfoSleuth [70] and Kylin [93]. The goal of the KnowItAll system is a related, but different task called, “Open Information Extraction.” In Open IE, the relations of interest are not known in advance, and the emphasis is on discovering new relations and new records through extensive web access. In contrast, in our task, what we are looking for is very specific and the corresponding schema is known. The emphasis is mostly on filling the missing fields in known records, using resource-bounded web querying. Hence, OpenIE and RBIE frameworks have very different application domains. InfoSleuth focuses on gathering information from given sources, and Kylin focuses only on Wikipedia articles. Among other systems that aim to extract entity names and relations from the web are, NELL [13], SOFIE [82], DBLife [21], Cyclex [14], xCrawl [79], Factzor [91], and WebSets [19]. These systems also do not aim to exploit the inherent dependency within the database for maximum utilization of resources, as we do in Chapter 5. Gatterbauer [31] provides interesting theoretical insights into exploiting redundancy on the Web for obtaining the required coverage of data.
Agichtein and Gravano [1] develop an automatic query-based technique to retrieve documents useful for the extraction of user-defined relations from large text databases and improve the efficiency of the extraction process by focusing only on promising documents. Similarly, Agrawal et al. [2] tackle “ad-hoc” entity extraction task, where entities of interest are constrained to be from a list of entities that is specific to the task. They propose an approach that uses an inverted index on the documents to only process relevant documents. Huang et al. [38] propose a prioritization approach where candidate pages from the corpus are ordered according to their expected contribution
to the extraction results and those with higher estimated potential are extracted earlier. The RBIE framework presented in this thesis provides a more general and adaptable approach, with not just document filtering and ranking, but a sequential decision making process for better resource utilization. Elliasi-Rad [26] explored the problem of building an information extraction agent, but did not address the problem of acquiring specific missing pieces of information on demand.
The Knowledge Base Population (KBP) Track, which is part of the Text Analy-sis Conference focuses on related tasks. The emphaAnaly-sis in these tasks is, however on filling slots in Wikipedia info boxes, and not general purpose, targeted information extraction tasks. The Information Retrieval community is rich with work in docu-ment relevance (TREC). However, traditional information retrieval solutions can not directly be used, since we first need to automate the query formulation for our task.
Also, most search engine APIs return full documents or text snippets, rather than specific values.
A family of methods closely related to RBIE is question answering systems [51].
These systems do retrieve a subset of relevant documents from the web, along with extracting a specific piece of information. However, they target a single piece of in-formation requested by the user, whereas we target multiple, interdependent fields of a relational database. They formulate queries by interpreting a natural language question, whereas we formulate and rank them based on the utility of the information within the database. They do not address the problem of selecting and prioritizing instances or a subset of fields to query. This is why, even though some of the compo-nents in our system may appear similar to that of QA systems, their functionalities differ. The semantic web community has also been working on similar problems, but the focus is not targeted information extraction. A few systems have been developed for extracting researcher information from the Web [84, 96, 52, 68, 66, 67], some of which use regular expressions, and others use more formal models like Conditional
Random Fields for extraction, but none of them focus on sequential decision making for resource optimization, as described in chapter 6.