CA2549536C - Method and apparatus for construction and use of concept knowledge base - Google Patents

Method and apparatus for construction and use of concept knowledge base Download PDF

Info

Publication number
CA2549536C
CA2549536C CA2549536A CA2549536A CA2549536C CA 2549536 C CA2549536 C CA 2549536C CA 2549536 A CA2549536 A CA 2549536A CA 2549536 A CA2549536 A CA 2549536A CA 2549536 C CA2549536 C CA 2549536C
Authority
CA
Canada
Prior art keywords
term
concept
data objects
data
data object
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Expired - Fee Related
Application number
CA2549536A
Other languages
French (fr)
Other versions
CA2549536A1 (en
Inventor
Orland Hoeber
Yiyu Yao
Xue Dong Yang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
University of Regina
Original Assignee
University of Regina
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=38791565&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=CA2549536(C) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by University of Regina filed Critical University of Regina
Priority to CA2549536A priority Critical patent/CA2549536C/en
Priority to CA2560159A priority patent/CA2560159C/en
Priority to US11/526,409 priority patent/US7809717B1/en
Publication of CA2549536A1 publication Critical patent/CA2549536A1/en
Application granted granted Critical
Publication of CA2549536C publication Critical patent/CA2549536C/en
Expired - Fee Related legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/33Querying
    • G06F16/338Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/951Indexing; Web crawling techniques

Abstract

A data structure, apparatuses and methods for expanding a search query to be used by a web search engine is provided. The search query is expanded by accessing a concept knowledge base data structure having concept data objects and term data objects with each term data object defining a term and associated with at least one of the concept data objects. Search terms making up the search query are matched to term data objects and a concept set is generated containing concept data objects associated with the term data objects. A second set of term data objects are generated by using the concept data objects to locate term data objects associated with the concept data objects. A user can then select one of the term data objects in the second set to expand the user's search query.

Description

2 METHOD AND APPARATUS FOR CONSTRUCTION AND USE OF CONCEPT
KNOWLEDGE BASE

This invention is in the field of search techniques used for search engines for the World Wide Web and more specifically methods and systems for refining search queries to be used to query the search engines.

BACKGROUND
The World Wide Web has given computer users on the Internet access to vast amounts of information in the form of billons of Web pages. Each of these pages can be accessed directly by a user typing the IP address or URL (universal resource locator) of a web page into a web browser on the user's computer, but often, a person is more likely to access a website by finding it with the use of a search engine. A search engine allows a user to input a search query made up of words or terms that a user thinks will be used in the web pages containing the information he or she is looking for. The search engine will attempt to match web pages to the terms in the search query and will then return the located web pages to the user. Typically, search engines return the results of the search as a list of the titles of the located Web pages, a short summary of each page, and the URL of the page.
A user can then select one of the titles to view the web page.
3 With the continued growth of web pages available on the Internet making the task of search engines more and more difficult, web search engines have greatly increased the size of their indexes and made significant advances in the algorithms used to match a user's query to these indexes. This has allowed these search engines to perform very well when high quality queries are provided by users. High quality queries are typically queries that are quite specific and made up of terms and phrases that are commonly used in the relevant documents. High quality search queries can often result in a user being provided with many highly relevant documents in-the first few pages of search results provided by the search engine.

to One of the difficulties in using web search engines is in creating a high quality query. If users do not craft the queries properly, either by not being specific enough or using phrases and/or terms that do not commonly occur in the relevant documents, the query may not adequately capture the intention of the user and result in the web search engine returning results that are not very relevant to what the user is looking for.
In some cases numerous matching documents may be returned, making it hard for a user to determine which of the many documents are relevant. In other cases, where too many keywords are used, few if any documents may be returned. Alternatively, a few relevant documents may be returned but they may be mixed with a relatively large number of non-relevant documents making finding these relevant documents time consuming or causing the user to give up his or her search before the relevant documents are found.
4 Most web search engines allow a user to refine his or her query by supporting interaction based on traditional information retrieval. Basically, most search engines provide an iterative method wherein a user can see what result were returned with an initial search query and then can try again by reformulating the query and having the web search engine return new results. The user can keep reformulating the query and going through the cycle over and over again, until the user either gets results that they are happy with or the user gives up and quits.

A number of tools have been developed that attempt to aid a user in performing better searches.

Attempts have been made at query expansion to allow a user to better refine a search query. Query expansion is the process of adding additional terms to the original query in order to improve the results retrieved by the search engine.

Some previous query expansion methods have used a thesaurus based approach. A
thesaurus is constructed based on similarity of terms. Words relationships such as synonym, hypernym/hyponym and meronym/holonym relationships are used to suggest similar terms to expand the query.

Other previous query expansion methods have used top ranked documents returned by the initial search query as the knowledge base for the query expansion. In these .-techniques, the co-occurrence of terms are calculated using only the passage that contained the query terms, rather than the whole document.

Information retrieval of web documents poses a number of problems for previous query
5 expansion techniques. Due to the extremely large volume of documents on the web, anlysis of the entire collection is not feasible. In addition, web queries are often very short, often consisting of only two or three words. Techniques that are somewhat successful with longer search queries do not often prove to be effective with short queries.

SUMMARY OF THE INVENTION

It is an object of the present invention to provide a system and method that overcomes problems in the prior art.

In accordance with the present disclosure, there is provided a computer implemented method of expanding a search query, the computer comprising at least one processor for executing computer readable instructions stored in a memory, the method comprising comprising: receiving at the computer a search query comprising at least one search term;
accessing a concept knowledge base data structure from a memory storage device, the concept knowledge base data structure comprising: a plurality of concept data objects each associated with a concept described by one or more computer readable documents; a plurality of term data objects, each term data object defining a term in the one or more computer readable documents; and a plurality of edge data objects, each edge data object indicating an association of each of the term data objects with the concept data objects, each edge data object containing a weight indicating a normalized frequency of
6 occurrence of the term of the term data object in the one or more computer readable documents describing the concept associated with the term; generating a first term set containing term data objects from the concept knowledge base data structure wherein each term data object in the first term set matches one or more of the at least one search term;
generating a concept set containing concept data objects from the concept knowledge base data structure wherein each concept data object in the concept set is associated with one or more of the term data objects in the first term set; generating a second term set containing term data objects from the concept knowledge base data structure wherein each term data object in the second term set is associated with one ore more of the concept data objects in the concept set; generating a visual representation for display on a display device by graphically representing the term data objects in the first term set and the term data objects in the second term set as term nodes and the concept data objects in the concept set as concept nodes connected by lines based upon the associated edge data object weight connecting the term nodes and the concept nodes and wherein one or more of the term data objects can be selected to add the term contained in the selected term data object to the at least one term of the search query by selecting the term node corresponding to the selected term data object; and receiving a selection of one of the term data objects in the second term set, adding the term contained in the selected term data object to the search query.

In accordance with the present disclosure, there is also provided a data processing system
7 for expanding a search query, the data processing system comprising: at least one processing unit; at least one memory storage device operatively coupled to the processing unit and containing a concept knowledge base data structure, the concept knowledge base data structure including: a plurality of concept data objects each associated with a concept described by one or more computer readable documents; and a plurality of term data objects, each term data object defining a term in the one or more computer readable documents; a plurality of edge data objects, each edge data object indicating an association of each of the term data objects with the concept data objects, each edge data object containing a weight indicating a normalized frequency of occurrence of the term of the term data object in the one or more computer readable documents describing the concept associated with the term; a program module stored in the at least one memory storage device operative for providing instructions to the at least one processing unit, the at least one processing unit responsive to the instructions of the program module, the program module operative for: receiving a query comprising at least one search term, generating a first term set containing term data objects from the concept knowledge base data structure wherein each term data object in the first term set matches one or more of the at least one search term; generating a concept set containing concept data objects from the concept knowledge base data structure wherein each concept data object in the concept set is associated with one or more of the term data objects in the first term set; generating a second term set containing term data objects from the concept knowledge base data structure wherein each term data object in the second term set is associated with one or
8 more of the concept data objects in the concept set; and receiving a selection of one of the term data objects in the second term set, adding the term contained in the selected term data object to the search query; a display device operatively coupled to the data processing system and the program module is operative to direct the processing unit to display a visual representation on the display device by graphically representing the term data objects in the first term set and the term data objects in the second term set as term nodes and the concept data objects in the concept set as concept nodes connected by lines based upon the associated edge data object weight connecting the term nodes and the concept nodes.

The present invention allows a user to refine a search query she or he is going to use to conduct a web search. A concept knowledge base is used to generate a query space that represents the query terms in relation to the concepts they describe and other terms that are related to these concepts. A visual representation of this query space allows the user to interpret the relationships between their query terms and the possible query terms
9 generated in the query space. Interactive query refinement within this visual representation takes advantage of the user's visual information process abilities, and allows the user to choose terms that accurately represent this information need. A
preview of the search results provides the user with the ability to take an active role in the information retrieval process, supporting the fundamental shift from information retrieval systems to information retrieval support systems.

In a first aspect a concept knowledge base data structure is provided. The concept knowledge base data structure contains a number of concept data objects and a number of term data objects. Each concept data object contains information that identifies a concept falling with an area of knowledge covered by the concept knowledge base, such as computer science, astronomy, etc. Each term data object contains information that identifies a term that describes one or more of the concepts represented by the concept data objects.

Each term data object is associated with one or more concept data objects. An edge data object is contained in the concept knowledge base data structure for each association between one of the term data objects and one of the concept data objects in the concept knowledge base data structure and identifies the associated term data object and concept data object. Additionally, each edge data object contains a weight, indicating the relevancy of the term contained in the term data object with the concept identified by the concept data object.

Although the concept knowledge data structure can be manually created in another aspect of the invention, a method and system is provided to automatically generate a concept knowledge base data structure from a number of computer readable documents.
The 5 computer readable documents will describe and area of knowledge that the concept knowledge base data structure will relate to. Each document will describe a concept falling within the area of knowledge. For each document, the concept the document describes is identified and if a concept data object has not already been created for that concept, a concept data object is created in the concept knowledge base.

to Next a number of terms in the document are selected and a term data object is created for each unique term and associated with the concept data object corresponding to the concept the document is describing. The selected terms can be specific terms in the document that meet specified criteria or could be all of the terms in the document, Typically, an edge data object is created in the concept knowledge base identifying an association between a term data object and a concept data object.

For each association between a term data object and a concept data object a weight is determined that indicates the relevancy of the term data object to the associated concept data object.

In a further aspect of the invention, a concept knowledge base data structure is used to generate a query space of additional terms that a user may want to use in his or her search query and are related to search terms in the search query by a common concept.
A user inputs a search query he or she would like to have a search engine conduct a web search.

The search query contains a number of search terms. The search terms are matched to terms contained in term data objects in the concept knowledge base data structure and a first term set is generated containing term data objects that match the query terms.

The term data objects in the first term set are then used to generate a concept set by adding concept data objects that are associated with one or more term data objects in the first term set to the concept set. In order to exclude concepts from the concept set that have a limited relevance to a term contained in a term data object in the first term set, typically, a first weight threshold is used to exclude concept data objects from the concept set that have limited relevance to the term in the term data object.

Additionally, a term ratio threshold is typically used to further exclude concept data objects from the concept set. If a concept data object is associated with one of the term data objects in the first term set with a weight greater than the first weight threshold, the concept data object is evaluated to determine the ratio of all of the term data objects in the first term set to which the concept data object is associated with a weight greater than the first weight threshold. If this ratio is less than the term ratio threshold, the concept data object is excluded from the concept set.

Next, the concept set is used to generate a second term set that will contain terms for the search space. The term data objects that are associated with one or more concept data objects in the concept set, that do not match one of the search terms, are selected for the second term set. Typically, a second weight threshold is used to exclude term data objects from the second term set that while associated with a concept data object in the concept set, are not strongly related to the concept data object. Term data objects associated with a concept data object in the concept set that have a weight of association that is less than the second weight threshold are excluded from the second term set.

The term data objects contained in the second term set, along with the concept set, form a query space and represent terms that a user may or may not wish to add to his or her original search query. Rather than this query space being generated on a general thesaurus based system where words or terms in the query space are related to one or more of the search terms in the original search query, (i.e. synonyms, homonyms.
antonyms, etc of one of the original search terms), the query space generated by the provided methods and systems results in generated terms that are related to an original search term via a concept. Rather than the generated terms in the second term set having a direct relationship with a search term in the original search query, the generated terms will have an implied relationship to one or more of the original search terms through a common concept. By providing a mapping between words and concepts to expand a query space, a more effective connection between the original search terms and the generated terms in the query space is created than using a thesaurus-based approach for generating terms for a query space.

In a further aspect of the present invention, the query space is visually represented to allow a user to see the relationship between a search terms, related concept and terms generated in the search space. Term data objects in the first term set are shown as selected term nodes in a visual representation of the search space. Term data objects in the second term set are shown as unselected term nodes and concept data objects are shown as concept nodes in the visual representations. Term nodes and concept notes that to are associated are illustrated with a line connecting the term node and concept node, with the distance between the term node and concept node representing the weight assigned to the association. In this manner, a user can quickly see how relevant a term is to a concept by the closeness of the term node and the concept node.

t5 A user can easily see the selected term nodes (the terms used in the search query) and how closely they are related to certain concepts. A user can also see how closely unelected term nodes (generated terms that may be added to the search query) are related to concepts, allowing a user to see a number of concepts they are trying to describe and then seeing the newly generated terms associated with the concept that the user may wish 20 to add to his or her search query.

In a further aspect, a preliminary search is conducted using the original search query and displayed along with the visual representation of the query space so that a user can see what results their search query will provide, along with the visual representation of the search query. This preview can allow the user to determine the outcome, on the search results, of adding or removing terms from the search query.

DESCRIPTION OF THE DRAWINGS

While the invention is claimed in the concluding portions hereof, preferred embodiments are provided in the accompanying detailed description which may be best understood in conjunction with the accompanying diagrams where like parts in each of the several diagrams are labeled with like numbers, and where:

Fig. I is a data processing system operable to implement the methods disclosed herein;

Fig. 2A is a schematic illustration of the data processing system configured for a user to directly interact with the data processing system;

Fig. 2B is a schematic illustration of the data processing system configured as a server and allowing a user to remotely connect to the data processing system using a remote device;

5 Fig. 3 is a data structure of a concept knowledge base, in accordance with the present invention;

Fig. 4 is a flowchart illustrating a method of automatically creating an instance of a concept knowledge base;

Fig. 5 is an overview software system for interactive query refinement;

Fig. 6 is a flowchart of a method of generating a query space using a concept knowledge database;

Fig. 7 is an exemplary illustration of a visual representation of a generated query space;

Fig. 8 is an exemplary illustration of a user interface; and Fig. 9 is an exemplary illustration of a visual representation of a generated query space wherein a concept is compacted.

DETAILED DESCRIPTION OF THE ILLUSTRATED EMBODIMENTS

Fig. 1 illustrates a data processing system I suitable for supporting the operation of methods in accordance with the present invention. The data processing system I
could be a personal computer, server, mobile computing device, cell phone, etc. The data processing system I typically comprises: at least one processing unit 3; a memory storage device 4; at least one input device 5; a display device 6 and a program module 8.

The processing unit 3 can be any processor that is typically known in the art with the capacity to run the program and is operatively coupled to the memory storage device 4 through a system bus. In some circumstances the data processing system I may contain more than one processing unit 3. The memory storage device 4 is operative to store data and can be any storage device that is known in the art, such as a local hard-disk, etc. and can include local memory employed during actual execution of the program code, bulk storage, and cache memories for providing temporary storage. Additionally, the memory storage device 4 can be a database that is external to the data processing system I but operatively coupled to the data processing system 1. The input device 5 can be any suitable device suitable for inputting data into the data processing system 1, such as a keyboard, mouse or data port such as a network connection and is operatively coupled to the processing unit 3 and operative to allow the processing unit 3 to receive information from the input device 5. The display device 6 is a CRT, LCD monitor, etc.
operatively coupled to the data processing system 1 and operative to display information.
The display device 6 could be a stand-alone screen or if the data processing system I is a mobile device, the display device 6 could be integrated into a casing containing the processing unit 3 and the memory storage device 4. The program module S is stored in the memory storage device 4 and operative to provide instructions to processing unit 3 and the processing unit 3 is responsive to the instructions from the program module S.
Although other internal components of the data processing system 1 are not illustrated, it will be understood by those of ordinary skill in the art that only the components of the data processing system I necessary for an understanding of the present invention are to illustrated and that many more components and interconnections between them are well known and can be used.

Fig. 2A illustrates a network configuration wherein the data processing system I is connected over a network 55 to a plurality of servers 50 operating as a search engine.
Fig. 2B illustrates a network configuration wherein the data processing system 1 is configured as a server and a remote device 60, such as another computer, a PDA, cell phone or other mobile device connected to the Internet, is used to access the data processing system 1. The data processing system I runs the majority of the software and methods, in accordance with the present invention, and accesses the a plurality of servers 50 operating as a search engine to conduct a web search. By having the data processing system I configured as a server, the remote client system 60 does not need to have the capacity necessary to contain all the necessary data structures and run all the methods.

Furthermore, the invention can take the form of a computer readable medium having recorded thereon statements and instructions for execution by a data processing system 1.
For the purposes of this description, a computer readable medium can be any apparatus that can contain, store, communicate, propagate, or transport the program for use by or in connection with the instruction execution system, apparatus, or device. The medium can be an electronic, magnetic, optical, electromagnetic, infrared, or semiconductor system (or apparatus or device) or a propagation medium. Examples of a computer-readable medium include a semiconductor or solid state memory, magnetic tape, a removable computer diskette, a random access memory (RAM), a read-only memory (ROM), a rigid magnetic disk and an optical disk. Current examples of optical disks include compact disk - read only memory (CD-ROM), compact disk - read/write (CD-R/W) and DVD.
CONCEPT KNOWLEDGE BASE

Fig. 3 illustrates an architectural schematic of a data structure for a concept knowledge base 10, in accordance with an aspect of the present invention. The data structure is stored on a memory and is accessible by an application program being executed by a data processing system, such as the data processing system I illustrated in Fig. 1.
The data structure contains information that is accessible by the application program-The concept knowledge base 10 contains information relating to a field of knowledge.
For example, the concept knowledge base 10 could contain information related to the field of science. The concept knowledge base 10 contains a number of concept data objects 12, a number of term data objects 14 and a number of edge data objects 16.

Each concept data object 12 contains a concept field 13 containing a concept that is s related to a specific concept falling within the field of knowledge of the concept knowledge base 10. The concept field 13 typically contains a text string identifying the concept. For example, if the concept knowledge base 10 is for computer science, there may be concept data objects 12 with the concept field 13 containing the text string of "computer graphics", another concept data object 12 with the concept field 13 containing the text string of "distributed computing", another concept data object 12 with the concept field 13 containing the text string "artificial intelligence", etc.

Each term data object 14 contains a term field 15 containing a text string.
The text string contains a word or phrase that describes a concept of one of the concept data objects 12.
IS

Each concept data object 12 is associated with one or more term data objects 14 and each term data object 14 is associated with one ore more concept data objects 12.
The association of a concept data object 12 and a term data object 14 is defined by an edge data object 16 which contains a weight field 18. A term data object 14 that is associated with a concept data object 12 contains a term in the term field 15 that describes the concept contained in the concept field 13 of the concept data object 12. The relevancy of the term in the term field 15 of the term data object 14 to the concept in the concept field 13 of an associated concept data object 12 is represented by a weight in the weight field 18 of the edge data object 16.

While it is possible to manually construct the data structure containing the concept 5 knowledge base 10, Fig. 4 illustrates a flowchart of a method of automatically creating a data structure containing a concept knowledge base in accordance with the present invention.

Method 100 comprises the steps of: determining a concept 110; selecting a document
10 describing the concept 120; determining terms in the document to be analyzed 130;
determining the frequency of the selected terms 140; checking if there are any remaining documents describing a concept 150; calculating a preliminary weight 160;
checking if there are any more concepts 170; and normalizing all of the weights 180.

15 The method takes a number of documents and/or descriptions in computer readable form that describe a number of different concepts in a knowledge area and uses the documents to automatically generate a data structure of a concept knowledge base 10, as shown in Fig. 3.

20 The method 100 begins with step 110. A concept falling within the concept knowledge base is determined and a concept data object is created with information identifying the concept contained in the concept field.

Each concept will be described by one or more documents or descriptions in computer readable format. Once a concept has been determined at step 110, one or more documents describing the concept are identified and at step 120 one of these documents is selected to be analyzed.

At step 130 the method 100 determines the terms to be analyzed in the document. For each term to be analyzed, method 100 creates a term data object for each selected term with the term field containing the term, if a term data object containing the term does not already exist. An edge data object indicating the association of the term data object and the concept data object is also created and after the method 100 is completed will contain a weight indicating the relation of the term data object with the associated concept data object containing the concept described by the document being analyzed.

The terms that are analyzed can include all of the words used in the document or only specific words in the documents. For example, common words that are basically non-descriptive, such as "the", "a", "this", etc. may be excluded from the selected terms that are selected for analysis at step 130.

At step 140 the frequency of each of the selected terms in the selected document is determined. The occurrence of each selected term in the document is determined. The occurrence of a selected term ti in the document being analyzed can easily be determined, via text matching, and is defined by the function:

f(d&,t;) Each of the teens appearing in the document are then averaged based on the number of occurrences of all of the terms in the documenL For example, the averaging could be done using the following equation:

r(d, t,)= f(dLt,t,) M
Y.1=if(d, ,taut where d, is the document being analyzed for the set of terms t = (ti,*, ..., t,,,,ir) with m being the number of terms in document dt. This equation simply divides the frequency or tally of a term being analyzed by the total number of terms being analyzed in document dk. By conducting this averaging, the eventual weight determined for each association between a term node and a concept node takes into account the number of occurrences of a term in the document and provides a potentially more relevant indicator of the relation between the term data object to the concept data object because words or terms that appear often relative to the total number of terms will be given more weight.

This preliminary averaging is used to try to prevent a single large document describing a concept from providing term weights that overshadow the weights provided by a number of smaller documents.

Next, at step 150, the method 100 checks to see if there are any more documents related to the concept that have not been analyzed. If there are more documents to be analyzed related to the concept, the method 100 returns to step 120, selects the next unanalyzed document and repeats steps 130, 140 and 150. As long as more documents related to the concept exist, step 150, causes the method 100 to analyze all of the documents. - When there are no more documents related to the concept to be analyzed, the method l0 continues on to step 160.

At step 160 the method 100 calculates a preliminary weight for each of the terms used in the documents related to a single concept For each term an interim weight wj*
is calculated taking into account the average term frequency of the documents related to the 1s concept.

=f * ids * t!
J:n wU *

Wherein there are 1 ... n documents.

This equation, in its entirety, is as follows:

n f(djk,tj) k=1 m I i =If(daE,tra1 wu ) *=
n This calculation is used to prevent concepts with a large numbers of documents from producing term weights that overshadow term weights from concepts with fewer documents describing the concept.

At step 170, the method 100 checks to see if there are any more concepts left to be evaluated. If there are concepts remaining that have not been analyzed, the method 100 returns to step 110 and the next concept is selected to be analyzed. The method 100 then 1o repeats steps 120, 130, 140, 150 and 160 determining a preliminary weight for each of the terms appearing in the documents describing the selected document. The method continues to analyze each concept repeating steps 110, 120, 130, 140, 150, 160 and 170 until all of the concepts have been analyzed, at which point, the method 100 continues on to step 180.

At step 180 the method 100 determines a normalized weight for each of the terms associated with the concepts. The preliminary weight wo* previously determined for each association between a term tj and a concept is divided by the sum of all of the weights determined for the term t; connected to r concepts. This equation is shown as follows:

W
Wq r k =1w (k) Wherein the index j'k) is given by ix), x = 1... r, representing the r concepts to which term i is connected to in the concept knowledge base.

The normalization of the weights is used to prevent common terms that are included in many of the documents for many concepts from having higher weight values than other less common terms. These terms are often of little value in describing a concept. By using normalization, the weights of common terms are significantly reduced.
Without 10 this normalization step, common terms that are included in many documents for many different concepts would have a very high weight, even though these terms are of little value in describing the concept. With this normalization step, the weights of these common terms are significantly reduced.

15 Additionally, rather than using the terms exactly as they appear in the documents or descriptions, in a further aspect of the invention, the stems of the roots of the terms are used to construct the knowledge base allowing terms to be matched based on their stems or roots rather than being based on exact text matches.

20 Additionally, in some circumstances it may not be necessary to analyze every term in a document. In a further aspect, the method 100 will focus on only specific terms in a document that are highlighted in a particular way, i.e. in an abstract.
Alternatively, there could be a list of terms that are not analyzed, such as common terms that are not descriptive of a concepts, for example terms such as the, and, etc. may be excluded from being selected.

At the conclusion of the method 100 a concept knowledge base as illustrated in Fig. 3 will have been automatically constructed by the method 100.

FRAMEWORK FOR VISUAL REFINEMENT SOFTWARE

Fig. 5 illustrates a software system of a visual query refinement method. The software system 300 comprises: a concept knowledge database 310; a current search query module 320; a query space generation module 330; a query visualization module 340; a search engine preview module 350; a search engine API module 360; a user interface module 370; and a search engine 380.

The search query will comprise one or more search terms. The software system 300 can be implemented on a data processing system, such as the data processing system 1 as shown in Fig. 2A. The data processing system I can be a client computer connected to the Internet with the software system 300 being executed completely an the user's client computer, with the exceptions of the search engine API 360 and the search engine 380, which would typically be implemented on one or more of the servers 50.
Alternatively, various modules could be implemented on the data processing system I
configured as a server 50, as shown in Fig 2B, with the user merely inputting the search query from a remote device 60, i.e. a PDA or mobile phone with an Internet connection, and the software system 300 is primarily implemented on the data processing system I
with the exception of the user interface module 370 which would be executed on the remote device 60.

The search query is entered into the system at the current search query module 320.
From the search query module 320 the search query is passed to the query space generation module 330, which accesses the concept knowledge database 310, to generate to a query space of terms a user may wish to add to his or her search query.
Typically, the concept knowledge database 310 contains a concept knowledge base data structure as shown in Fig. 3.

From the query space generation module 330 the generated query space is passed to the query visualization module 340 where a visual representation of the query space is generated. The visual representation of the query space is then passed to the user interface module 370.

Additionally, the current search query module 320 also passes the search query to a search engine preview module 350 that has a search engine API 360 conduct a preview of a web search using the search query and passes the results of preview of the web search to the use interface module 370.

The user interface module 370 displays the visual representation of the query space to a user along with the results of a preview search. The user can perform a number of operations using the user interface module 370, such as, submitting a new search query;

modify the search query by adding or removing terms; remove a concept; expand or collapse a concept; and sending the search query to the search engine.

QUERY SPACE GENERATION

The software system 300 begins with an initial search query being input to the current to search query module 320 which passes the search query to the query space generation module 330. The query space generation module 330 accesses a concept knowledge database 310 and uses the information in the concept knowledge database 310 to generate a query space from the search query.

Fig. 6 illustrates a flowchart of a method for query expansion that is implemented by the query space generation module 330 in Fig. 5, using the concept knowledge database 310.
When a search query is passed to the query space generation module 330, the method 400 uses the concept knowledge database 310 to generate a query space to expand the terms used in the search query using relationships to concepts to obtain additional terms that are relevant to the terms in the search query.

Method 400 comprises the steps of: matching terns in the search query to term data objects in the concept knowledge base to obtain a first term set 410;
obtaining a concept set of concept data objects associated with the first term set 420; obtaining a second term set of term data objects associated with the concepts objects in the concept set 430; and obtaining an edge set 450.

The method 400 begins with step 410 and the terms in the search query being matched to term data objects in the concept knowledge database 310. The concept knowledge database 310 is accessed and each of the terms making up the search query are matched with any term data objects that have a term in the term field matching the term in the search query. A first term set containing these selected term data objects is obtained.
After step 410 is completed, all of the term data objects in the concept knowledge database 310 that have a term in the term field that corresponds to one of the terms in the search query are identified and these term data objects are added to a first term set At step 420, the first term set is used to obtain a concept set containing concept data objects from the concept knowledge database 310 associated with one or more term data objects in the first term set. The teen data objects making up the first term set are used to obtain a number of concept data objects from the concept knowledge database 310.

Concept data objects associated with one or more term data objects in the first tern set are selected to farm the concept set.

Concept data objects that are not strongly associated with term data objects in the first terms set are excluded from the concept set using a first weight threshold and a term ratio threshold. The first weight threshold is used to exclude concept data objects that are not strongly associated with one of the term data objects in the first term set by comparing 5 the weight assigned to an association between a concept data object and a term data object and excluding the concept data object from the concept set if the weight determined for the association is less than the first weight threshold. By using this first weight threshold, the concept set is limited to only the more relevant concepts.
Additionally, a term ratio threshold is used to further exclude concept data objects from 1o the concept set. If a concept data object is associated with one of the term data objects in the first term set with a weight greater than the first weight threshold, the concept data object is evaluated to determine the ratio of all of the term data objects in the first tetra set to which the concept data object is associated with a weight greater than the first weight threshold. If this ratio is less than the term ratio threshold, the concept data object 15 is excluded from the concept set.

At step 430 a second term set is obtained. Each of the concept data objects in the concept set are evaluated to determine term data objects, in the concept knowledge base 110, associated with each of these concept data objects. Term data objects associated with the 20 concept data objects selected for the concept set are added to the second term set. A
second weight threshold is used to exclude term data objects from the second term set if they are associated with concept data objects in the concept sets by a weight that is less than the second weight threshold.

At step 450, an edge set containing edge data objects from the concept knowledge database 310 is obtained. The edge data object defining the association between the term data objects in the first term set and the concept data objects in the concept set along with the edge data objects defining the association between the concept data objects in the concept set and the term data objects in the second term set are placed in the edge set.

to At this point, the method 400 ends and there is: a first term set containing term data objects that correspond to terns in the search query; a concept set containing concept data objects associated with term data objects in the first term set, that represent concepts the terms in the search query could be describing; a second term set containing term data objects associated with one or more concept data objects in the concept set, that indicate further terms that may be used to describe the concepts the user may be trying to look for, and an edge set defining the associations between the term data objects and concept data objects in the different sets.

Through experiments, the first weight threshold, term ratio threshold and second weight threshold can be determined. For example, some initial studies found that a first weight threshold of 0.05, a term ratio threshold of 0.51 and a second weight threshold of 0.10 provided satisfactory results.

Referring again to Fig. 5, after the query space (a first term set, a concept set, a second term set and an edge set) is generated by the query space generation module 330, the query space contains: a first term set containing term nodes matching terms in the search query; a concept set, containing concept nodes associated with term nodes in the first term set; a second term set containing term nodes associated with concept nodes in the concept set; and an edge set containing edge data objects defining the association between term data objects and concept data objects. This query space is passed to the query visualization module 340 to generate a visualization representation of the query space.

VISUALIZATION OF THE QUERY SPACE

Referring again to Fig. 5, using the query space generated by the query space generation module 330, the query visualization module 340 generates a visual representation of the query space.

Fig. 7 illustrates an example of a visual representation of a generated query space. The visual representation 500 contains: a number of concept nodes 550; selected term nodes 560 and unselected term nodes 570. Concept nodes 550 have one or more connecting lines 580 joining the concept node 550 to either selected term nodes 560 or unselected term nodes 570 that are associated with the concept node 550.

The concept data objects contained in the concept set are used to create the concept nodes 550. Each concept data object in the concept node is used to create a concept node 550 in the visual representation 500 and the concept in the concept field of the concept data object is inserted as text on the concept node 550.

The term data objects contained in the first term set are used to create the selected term nodes 560. Each term data object in the first term set is used to create a single selected term node 560 in the visual representation 500 and the term in the term field of the concept is inserted as text on the term node 560.

The term data objects contained in the second term set are used to create the unselected term nodes 570 in the visual representation 500. An unelected term node 570 is created on the visual representation 500 for each term data object contained in the second term set with the term in the term field of each term data object used as text on the unelected term node.

The edge data objects in the edge set define the associations between the term data objects in the first and second term set and the concept data objects in concept set. Each edge data object in the edge set is used to draw the connecting lines 580 between associated concept nodes 550 and unelected term nodes 560 and unselected term nodes 570. The distance between a concept node 550 and an associated selected terns node 560 or associated unelected term node 570 joined by a connecting line 580 is a function of the weight of the association indicated in the edge concept. For example, if a weight of an association between a first unselected term nodes 570A and a concept node 550A is less than the weight of an association between the concept node 550A and a second unelected term nodes 570B, the first unselected term node 570A is positioned in the visual representation 500 further away from the concept node 550A than the second unelected term node 570B.

The concept nodes 550 are rendered in the visual representation 500 so that the concept nodes 550 can be visually distinguished from the selected term nodes 560 and The unselected term nodes 570. Typically, colors are used to make the concept nodes visually distinctive, i.e. the concept nodes 550 being rendered with a red background.

The selected term nodes 560 and unselected term nodes 570 are also rendered in the visual representation 500 to be visibly distinguishable from each other.
Typically, this is also done by rendering the selected nodes 560 and unselected term nodes 570 with different background colors from each other. For example, the selected term nodes 560 might be rendered with a yellow background or some other bright color and the unselected term node 570 can be rendered in some neutral color, such as grey.

The visual representation 500 allows users to properly interpret the underlying features of the query space. Users are able to visually distinguish between concept nodes 550, selected term nodes 560 and unelected term nodes 570; along with the relationship between these nodes. Terms the user used in their original search query are shown in the visual representation as selected term nodes 560, allowing a user to easily distinguish between terms in the visual representation 500 that the user used in his or her search query and new terms that were generated and that the user may wish to add to their 5 search query. Additionally, this allows a user to identify whether the teams they have used in their search query are actually appropriate for their information needs. If the concepts shown in the concept nodes 550 are unrelated to the to the information the user is seeldng, the search query may not be a proper search query and the user can try a completely new search query. The visual representation 500 can allow a user to 10 determine if the search query they have used have very general terms (i.e.
connect to numerous concept nodes) or very specific terms (i.e. connected to very few concepts).
SEARCH ENGINE PREVIEW

Referring again to Fig. 5, from the current search query module 320, the search query 15 terms are also passed to the search engine preview module 350 to conduct a preview search on the search engine using the search query. The search engine preview module 350 passes the search query to the search engine API 360 and the search engine returns the results of the search to the search engine preview module 350.
These preview results could be a the results of a full search or, alternatively, a subset of the information 20 located in the search such as number of documents returned by the query, the title of the documents and the URL of a set number of these documents.

For example, both GoogleT" and Yahoo!Tm offer API services that allows the system tp request a search preview.

The results of the search preview are passed from the search engine preview module 350 to the user interface module 370.

USER INTERFACE

A user interface module 370 is provided. If the user is using the data processing system 1 as shown in Fig. 2A, the user interface module 370 is executed on the data processing system 1 with a use interface displayed on the display device 6.
Alternatively, if the user is accessing the data processing system 1, as shown in Fig. 2B, through the remote client device 60, the user interface module 370 is typically executed on the remote device 60 with a user interface displayed on a screen of the remote device 60.

The user interface module 370 displays to a user a visual representation created by the query visualization module 340 using the query space generated by the query space generation module 330, along with a search preview obtained by the search engine preview module 350.

Fig. 8 illustrates an embodiment of a user interface 600 displayed to the user by the user interface module 370. the user interface 600 comprises: a visual representation 610; a search engine preview 620; a first text field 630 and a second text field 640.
The visual representation 610 and the search engine preview allow a user to see the success of his or her search.

The user interface 600 allows a user to: submit a new search query; modify the search query; remove a concept; expand or collapse a concept; and send the query to the search engine.

Subn ttina a new search qurY

When a user sees the visual representation 610 and the search engine preview 620, if the io results are much different than what the user wanted, the user can conduct a completely new search by entering a new search query in the first text field 630 and selecting a search button 635.

Referring again to Fig. 5, when a user enters a new search query, the new search query is passed from the user interface module 370 to the current search query module 320, where the system 300 again generates a new query space with the query space generation module 330, creates a visual representation of the query space with the query visualization module 340, and a search engine preview with the search engine preview module 350 using the new search query.

MModi ring the search query A user can also add terms to the search query by selecting unelected terms on the visual representation 610. To add a term a user selects an unselected term node in the visual representation 610 and the term in the term node is added to the terms of the search query.

Referring to Fig. 5, the term is added to the search query to form a new search query and the new search query is passed to the current search query module 320 and modules 330, 340, 350 and 360 to generate an updated visual representation 610 and search preview using the new search query .
to Additionally, a user can remove a term from the search query by selecting a selected term node in the visual representation 610. Referring to Fig. 5, the term is removed from the search query to form a new search query and the new search query is passed to the current search query module 320 and modules 330, 340, 350 and 360 to generate an updated visual representation 610 and search preview using the new search query-Remove a concept node from the visual representation Upon seeing the visual representation 610 a user may identify concept nodes illustrated in the visual representation that display concepts the user believes are not relevant to the information the user is trying to obtain in the search. To remove one of these concept nodes from the visual representation, a user selects the concept node in the visual representation 610.

Referring again to Fig. 5, when a user removes a concept node by selecting the concept node on the visual representation, the corresponding concept data object in the concept set is passed to the query visualization module 340 where a new visual representation of the query space is obtained with the concept data object and any teen data objects in the second term set that are only associated with the removed concept data object removed.
This new visual representation is then passed to the user interface 370.

Erna or cg M= ct a concept to A user can choose between an expanded and a compacted visual representation of a concept by selecting the node to be expanded or compacted. The user selects a concept node 550A on the visual representation 610 that the user either wishes to expand (if the concept node is compacted) or compact (if the concept node is currently expanded).

Referring to Fig. 5. the query space is passed back to the query visualization module 340 where a new visual representation of the query space is generated with the concept node compacted, such as the visual representation 700 shown in Fig. 9, if the concept node was expanded, or expanded, if the concept node was previously compacted.

Send the query to the search engine Finally, the user interface 370 allows a user to send the search query to a search engine to conduct a regular web search using the search query. A user selects the search button 645 and, referring to Fig. 5, the software system 300 transmits the search query to a search engine 380 to have the search engine conduct a search based on the search query.
The foregoing is considered as illustrative only of the principles of the invention.

5 Further, since numerous changes and modifications will readily occur to those skilled in the art, it is not desired to limit the invention to the exact construction and operation shown and described, and accordingly, all such suitable changes or modifications in structure or operation which may be resorted to are intended to fall within the scope of the claimed invention.

Claims (24)

What is claimed is:
1. A computer implemented method of expanding a search query, the computer comprising at least one processor for executing computer readable instructions stored in a memory, the method comprising comprising:

receiving at the computer a search query comprising at least one search term;

accessing a concept knowledge base data structure from a memory storage device, the concept knowledge base data structure comprising:

a plurality of concept data objects each associated with a concept described by one or more computer readable documents;

a plurality of term data objects, each term data object defining a term in the one or more computer readable documents; and a plurality of edge data objects, each edge data object indicating an association of each of the term data objects with the concept data objects, each edge data object containing a weight indicating a normalized frequency of occurrence of the term of the term data object in the one or more computer readable documents describing the concept associated with the term;

generating a first term set containing term data objects from the concept knowledge base data structure wherein each term data object in the first term set matches one or more of the at least one search term;

generating a concept set containing concept data objects from the concept knowledge base data structure wherein each concept data object in the concept set is associated with one or more of the term data objects in the first term set;

generating a second term set containing term data objects from the concept knowledge base data structure wherein each term data object in the second term set is associated with one ore more of the concept data objects in the concept set;

generating a visual representation for display on a display device by graphically representing the term data objects in the first term set and the term data objects in the second term set as term nodes and the concept data objects in the concept set as concept nodes connected by lines based upon the associated edge data object weight connecting the term nodes and the concept nodes and wherein one or more of the term data objects can be selected to add the term contained in the selected term data object to the at least one term of the search query by selecting the term node corresponding to the selected term data object; and receiving a selection of one of the term data objects in the second term set, adding the term contained in the selected term data object to the search query.
2. The method of claim 1 wherein each concept data object contained in the concept set is associated with at least one of the term data objects in the first term set by the weight in the associated edge data object greater than a predetermined weight threshold.
3. The method of claim 2 wherein the occurrence of the term is defined by a term ratio calculated by determining a ratio of all of the term data objects in the first term set and a number of term data objects in the first term set, that the concept data object has an association with, greater than the weight threshold, and wherein each concept data object contained in the concept set has a term ratio greater than a term ratio threshold.
4. The method of claim 1 wherein each concept data object contained in the concept set is associated with at least one of the term data objects in the first term set with a weight greater than a first weight threshold and each term data object in the second term set is associated with at least one of the concept data objects in the concept set by a weight greater than a second weight threshold.
5. The method of claim 4 wherein the weight assigned to the association is represented by a distance between the term node and the concept node.
6. The method of claim 1 further comprising, in response to a user selecting one of the concept nodes in the visual representation, removing the selected concept node and any term nodes representing term data objects associated only with a concept node represented by the selected concept node from the visual representation.
7. The method of claim 1 further comprising requesting search results from a search engine using the search query and displaying the search results to the on the display device in conjunction with the visual representation.
8. A data processing system for expanding a search query, the data processing system comprising:
at least one processing unit;

at least one memory storage device operatively coupled to the processing unit and containing a concept knowledge base data structure, the concept knowledge base data structure including:

a plurality of concept data objects each associated with a concept described by one or more computer readable documents; and a plurality of term data objects, each term data object defining a term in the one or more computer readable documents;

a plurality of edge data objects, each edge data object indicating an association of each of the term data objects with the concept data objects, each edge data object containing a weight indicating a normalized frequency of occurrence of the term of the term data object in the one or more computer readable documents describing the concept associated with the term;

a program module stored in the at least one memory storage device operative for providing instructions to the at least one processing unit, the at least one processing unit responsive to the instructions of the program module, the program module operative for:

receiving a query comprising at least one search term, generating a first term set containing term data objects from the concept knowledge base data structure wherein each term data object in the first term set matches one or more of the at least one search term;

generating a concept set containing concept data objects from the concept knowledge base data structure wherein each concept data object in the concept set is associated with one or more of the term data objects in the first term set;

generating a second term set containing term data objects from the concept knowledge base data structure wherein each term data object in the second term set is associated with one or more of the concept data objects in the concept set;
and receiving a selection of one of the term data objects in the second term set, adding the term contained in the selected term data object to the search query;

a display device operatively coupled to the data processing system and the program module is operative to direct the processing unit to display a visual representation on the display device by graphically representing the term data objects in the first term set and the term data objects in the second term set as term nodes and the concept data objects in the concept set as concept nodes connected by lines based upon the associated edge data object weight connecting the term nodes and the concept nodes.
9. The data processing system of claim 8 wherein each concept data object contained in the concept set is associated with at least one of the term data objects in the first term set by the weight in the associated edge data object greater than a predetermined weight threshold.
10. The data processing system of claim 9 wherein occurrence of the term is defined by a term ratio calculated by determining the ratio of all of the term data objects in the first term set and a number of term data objects in the first term set that the concept data object has an association with greater than the weight threshold, and wherein each concept data object contained in the concept set has a term ratio greater than a term ratio threshold .
11. The data processing system of claim 8 wherein each concept data objects contained in the concept set is associated with at least one of the term data objects in the first term set with a weight greater than a first weight threshold and each term data object in the second term set is associated with at least one of the concept data objects in the concept set by a weight greater than a second weight threshold.
12. The data processing system of claim 11 wherein the weight assigned to the association is represented by a distance between the term node and the concept node.
13. The data processing system of claim 12 wherein the term nodes corresponding to the term data objects in the first term set are visually distinctive from the term nodes corresponding to the term data objects in the second term set.
14. The data processing system of claim 13 wherein the term nodes corresponding to the term data objects in the first term set are displayed in a first color and the term nodes corresponding to the term data objects in the second term set are a second color.
15. The data processing system of claim 8 wherein the data processing system further comprises an input device and a term data object is selected by a user using the input device to indicate the term node corresponding to the term data object.
16. The data processing system of claim 8 wherein the program module is operative for, in response to a user selecting one of the concept nodes in the visual representation, removing the selected concept node and any term nodes representing term data objects associated only with a concept node represented by the selected concept node from the visual representation.
17. The data processing system of claim 8 wherein the input device is a computer mouse and the user uses the mouse to select the term node corresponding to the term data object.
18. The data processing system of claim 8 wherein the program modules is operative for:
requesting search results from a search engine and displaying the search results on the display device in conjunction with the visual representation.
19. The data processing system of claim 8 wherein the data processing system is operatively connectable to a remote device and wherein a user of the remote device inputs the search query to the data processing system and wherein the program module is operative to direct the processing unit to communicate with the remote device and display a visual representation on the remote device by graphically representing the term data objects in the first term set and the term data objects in the second term set as term nodes and the concept data objects in the concept set as concept nodes.
20. The data processing system of claim 19 wherein an association between a term data object and a concept data object is graphically represented on the visual representation by a line connecting the term node representing the term data object, and the concept node representing the concept data object.
21. The data processing system of claim 20 wherein the term nodes corresponding to the term data objects in the first term set are visually distinctive from the term nodes corresponding to the term data objects in the second term set.
22. The data processing system of claim 21 wherein the term nodes corresponding to the term data objects in the first term set are displayed in a first color and the term nodes corresponding to the term data objects in the second term set are a second color.
23. The data processing system of claim 19 wherein the program module is operative for, in response to a user selecting one of the concept nodes in the visual representation, removing the selected concept node and any term nodes representing term data objects associated only with a concept node represented by the selected concept node from the visual representation.
24. The data processing system of claim 19 wherein the program modules is operative for:
requesting search results from a search engine and displaying the search results on the remote device in conjunction with the visual representation.
CA2549536A 2006-06-06 2006-06-06 Method and apparatus for construction and use of concept knowledge base Expired - Fee Related CA2549536C (en)

Priority Applications (3)

Application Number Priority Date Filing Date Title
CA2549536A CA2549536C (en) 2006-06-06 2006-06-06 Method and apparatus for construction and use of concept knowledge base
CA2560159A CA2560159C (en) 2006-06-06 2006-09-19 Method and apparatus for concept-based visual presentation of search results
US11/526,409 US7809717B1 (en) 2006-06-06 2006-09-25 Method and apparatus for concept-based visual presentation of search results

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CA2549536A CA2549536C (en) 2006-06-06 2006-06-06 Method and apparatus for construction and use of concept knowledge base

Publications (2)

Publication Number Publication Date
CA2549536A1 CA2549536A1 (en) 2007-12-06
CA2549536C true CA2549536C (en) 2012-12-04

Family

ID=38791565

Family Applications (1)

Application Number Title Priority Date Filing Date
CA2549536A Expired - Fee Related CA2549536C (en) 2006-06-06 2006-06-06 Method and apparatus for construction and use of concept knowledge base

Country Status (2)

Country Link
US (1) US7809717B1 (en)
CA (1) CA2549536C (en)

Families Citing this family (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9275052B2 (en) 2005-01-19 2016-03-01 Amazon Technologies, Inc. Providing annotations of a digital work
US8131647B2 (en) 2005-01-19 2012-03-06 Amazon Technologies, Inc. Method and system for providing annotations of a digital work
US8352449B1 (en) 2006-03-29 2013-01-08 Amazon Technologies, Inc. Reader device content indexing
US8725565B1 (en) 2006-09-29 2014-05-13 Amazon Technologies, Inc. Expedited acquisition of a digital item following a sample presentation of the item
US9672533B1 (en) 2006-09-29 2017-06-06 Amazon Technologies, Inc. Acquisition of an item based on a catalog presentation of items
US20080114750A1 (en) * 2006-11-14 2008-05-15 Microsoft Corporation Retrieval and ranking of items utilizing similarity
US7865817B2 (en) 2006-12-29 2011-01-04 Amazon Technologies, Inc. Invariant referencing in digital works
US8024400B2 (en) 2007-09-26 2011-09-20 Oomble, Inc. Method and system for transferring content from the web to mobile devices
US7751807B2 (en) 2007-02-12 2010-07-06 Oomble, Inc. Method and system for a hosted mobile management service architecture
US7716224B2 (en) * 2007-03-29 2010-05-11 Amazon Technologies, Inc. Search and indexing on a user device
US9665529B1 (en) 2007-03-29 2017-05-30 Amazon Technologies, Inc. Relative progress and event indicators
US8700005B1 (en) 2007-05-21 2014-04-15 Amazon Technologies, Inc. Notification of a user device to perform an action
CN101359330B (en) * 2008-05-04 2015-05-06 索意互动(北京)信息技术有限公司 Content extending method and system
US8423889B1 (en) 2008-06-05 2013-04-16 Amazon Technologies, Inc. Device specific presentation control for electronic book reader devices
US8255192B2 (en) * 2008-06-27 2012-08-28 Microsoft Corporation Analytical map models
US8117145B2 (en) 2008-06-27 2012-02-14 Microsoft Corporation Analytical model solver framework
US8620635B2 (en) 2008-06-27 2013-12-31 Microsoft Corporation Composition of analytics models
US8411085B2 (en) 2008-06-27 2013-04-02 Microsoft Corporation Constructing view compositions for domain-specific environments
US8190406B2 (en) * 2008-11-26 2012-05-29 Microsoft Corporation Hybrid solver for data-driven analytics
US8103608B2 (en) * 2008-11-26 2012-01-24 Microsoft Corporation Reference model for data-driven analytics
US8155931B2 (en) * 2008-11-26 2012-04-10 Microsoft Corporation Use of taxonomized analytics reference model
US8145615B2 (en) * 2008-11-26 2012-03-27 Microsoft Corporation Search and exploration using analytics reference model
US8314793B2 (en) 2008-12-24 2012-11-20 Microsoft Corporation Implied analytical reasoning and computation
US9087032B1 (en) 2009-01-26 2015-07-21 Amazon Technologies, Inc. Aggregation of highlights
US8378979B2 (en) 2009-01-27 2013-02-19 Amazon Technologies, Inc. Electronic device with haptic feedback
US8832584B1 (en) 2009-03-31 2014-09-09 Amazon Technologies, Inc. Questions on highlighted passages
US9245243B2 (en) 2009-04-14 2016-01-26 Ureveal, Inc. Concept-based analysis of structured and unstructured data using concept inheritance
US8866818B2 (en) 2009-06-19 2014-10-21 Microsoft Corporation Composing shapes and data series in geometries
US8259134B2 (en) * 2009-06-19 2012-09-04 Microsoft Corporation Data-driven model implemented with spreadsheets
US8493406B2 (en) 2009-06-19 2013-07-23 Microsoft Corporation Creating new charts and data visualizations
US8788574B2 (en) 2009-06-19 2014-07-22 Microsoft Corporation Data-driven visualization of pseudo-infinite scenes
US8692826B2 (en) 2009-06-19 2014-04-08 Brian C. Beckman Solver-based visualization framework
US8531451B2 (en) 2009-06-19 2013-09-10 Microsoft Corporation Data-driven visualization transformation
US9330503B2 (en) 2009-06-19 2016-05-03 Microsoft Technology Licensing, Llc Presaging and surfacing interactivity within data visualizations
US8700646B2 (en) * 2009-08-12 2014-04-15 Apple Inc. Reference file for formatted views
US8352397B2 (en) 2009-09-10 2013-01-08 Microsoft Corporation Dependency graph in data-driven model
US8692763B1 (en) 2009-09-28 2014-04-08 John T. Kim Last screen rendering for electronic book reader
US8150859B2 (en) * 2010-02-05 2012-04-03 Microsoft Corporation Semantic table of contents for search results
US8983989B2 (en) 2010-02-05 2015-03-17 Microsoft Technology Licensing, Llc Contextual queries
US8260664B2 (en) * 2010-02-05 2012-09-04 Microsoft Corporation Semantic advertising selection from lateral concepts and topics
US8903794B2 (en) * 2010-02-05 2014-12-02 Microsoft Corporation Generating and presenting lateral concepts
US8434001B2 (en) 2010-06-03 2013-04-30 Rhonda Enterprises, Llc Systems and methods for presenting a content summary of a media item to a user based on a position within the media item
US9043296B2 (en) 2010-07-30 2015-05-26 Microsoft Technology Licensing, Llc System of providing suggestions based on accessible and contextual information
US9326116B2 (en) 2010-08-24 2016-04-26 Rhonda Enterprises, Llc Systems and methods for suggesting a pause position within electronic text
US9495322B1 (en) 2010-09-21 2016-11-15 Amazon Technologies, Inc. Cover display
US9002701B2 (en) * 2010-09-29 2015-04-07 Rhonda Enterprises, Llc Method, system, and computer readable medium for graphically displaying related text in an electronic document
JP6058554B2 (en) * 2011-01-07 2017-01-11 アイエックスリビール インコーポレイテッド Concept and link discovery system
US9158741B1 (en) 2011-10-28 2015-10-13 Amazon Technologies, Inc. Indicators for navigating digital works
US8990246B2 (en) * 2011-12-15 2015-03-24 Yahoo! Inc. Understanding and addressing complex information needs
US9104750B1 (en) * 2012-05-22 2015-08-11 Google Inc. Using concepts as contexts for query term substitutions
US9092740B2 (en) * 2012-11-08 2015-07-28 International Business Machines Corporation Concept noise reduction in deep question answering systems
US20140379364A1 (en) * 2013-06-20 2014-12-25 Koninklijke Philips N.V. Intelligent computer-guided structured reporting for efficiency and clinical decision support
US10474672B2 (en) * 2015-08-25 2019-11-12 Schlafender Hase GmbH Software & Communications Method for comparing text files with differently arranged text sections in documents
CN105138697B (en) * 2015-09-25 2018-11-13 百度在线网络技术(北京)有限公司 A kind of search result shows method, apparatus and system

Family Cites Families (43)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1995012173A2 (en) * 1993-10-28 1995-05-04 Teltech Resource Network Corporation Database search summary with user determined characteristics
US5600831A (en) 1994-02-28 1997-02-04 Lucent Technologies Inc. Apparatus and methods for retrieving information by modifying query plan based on description of information sources
US5768678A (en) * 1996-05-08 1998-06-16 Pyron Corporation Manganese sulfide composition and its method of production
US6070176A (en) 1997-01-30 2000-05-30 Intel Corporation Method and apparatus for graphically representing portions of the world wide web
US6038560A (en) * 1997-05-21 2000-03-14 Oracle Corporation Concept knowledge base search and retrieval system
GB9811874D0 (en) 1998-06-02 1998-07-29 Univ Brunel Information management system
US6742003B2 (en) 2001-04-30 2004-05-25 Microsoft Corporation Apparatus and accompanying methods for visualizing clusters of data and hierarchical cluster classifications
US6363377B1 (en) 1998-07-30 2002-03-26 Sarnoff Corporation Search data processor
WO2000046701A1 (en) * 1999-02-08 2000-08-10 Huntsman Ici Chemicals Llc Method for retrieving semantically distant analogies
US6711585B1 (en) * 1999-06-15 2004-03-23 Kanisa Inc. System and method for implementing a knowledge management system
US7181438B1 (en) * 1999-07-21 2007-02-20 Alberti Anemometer, Llc Database access system
US6665665B1 (en) * 1999-07-30 2003-12-16 Verizon Laboratories Inc. Compressed document surrogates
AU7339700A (en) * 1999-11-16 2001-05-30 Searchcraft Corporation Method for searching from a plurality of data sources
US6868525B1 (en) * 2000-02-01 2005-03-15 Alberti Anemometer Llc Computer graphic display visualization system and method
US20020073079A1 (en) 2000-04-04 2002-06-13 Merijn Terheggen Method and apparatus for searching a database and providing relevance feedback
AUPQ673100A0 (en) 2000-04-06 2000-05-04 Limberis, Jim System and method for creating and searching web sites
CA2411184C (en) * 2000-06-09 2015-02-24 Thanh Ngoc Nguyen Method and apparatus for data collection and knowledge management
US6675159B1 (en) * 2000-07-27 2004-01-06 Science Applic Int Corp Concept-based search and retrieval system
EP1182581B1 (en) * 2000-08-18 2005-01-26 Exalead Searching tool and process for unified search using categories and keywords
KR100426382B1 (en) * 2000-08-23 2004-04-08 학교법인 김포대학 Method for re-adjusting ranking document based cluster depending on entropy information and Bayesian SOM(Self Organizing feature Map)
US6895406B2 (en) 2000-08-25 2005-05-17 Seaseer R&D, Llc Dynamic personalization method of creating personalized user profiles for searching a database of information
US6795825B2 (en) * 2000-09-12 2004-09-21 Naphtali David Rishe Database querying system and method
US7860706B2 (en) * 2001-03-16 2010-12-28 Eli Abir Knowledge system method and appparatus
AU2002317119A1 (en) 2001-07-06 2003-01-21 Angoss Software Corporation A method and system for the visual presentation of data mining models
US6847966B1 (en) * 2002-04-24 2005-01-25 Engenium Corporation Method and system for optimally searching a document database using a representative semantic space
US8015143B2 (en) * 2002-05-22 2011-09-06 Estes Timothy W Knowledge discovery agent system and method
US7249117B2 (en) * 2002-05-22 2007-07-24 Estes Timothy W Knowledge discovery agent system and method
US20040006559A1 (en) * 2002-05-29 2004-01-08 Gange David M. System, apparatus, and method for user tunable and selectable searching of a database using a weigthted quantized feature vector
US7113960B2 (en) * 2002-08-22 2006-09-26 International Business Machines Corporation Search on and search for functions in applications with varying data types
US7152065B2 (en) * 2003-05-01 2006-12-19 Telcordia Technologies, Inc. Information retrieval and text mining using distributed latent semantic indexing
US7610306B2 (en) * 2003-06-30 2009-10-27 International Business Machines Corporation Multi-modal fusion in content-based retrieval
US7296021B2 (en) * 2004-05-21 2007-11-13 International Business Machines Corporation Method, system, and article to specify compound query, displaying visual indication includes a series of graphical bars specify weight relevance, ordered segments of unique colors where each segment length indicative of the extent of match of each object with one of search parameters
GB0414332D0 (en) * 2004-06-25 2004-07-28 British Telecomm Data storage and retrieval
US7590631B2 (en) * 2004-09-02 2009-09-15 Hewlett-Packard Development Company, L.P. System and method for guiding navigation through a hypertext system
US20060167930A1 (en) * 2004-10-08 2006-07-27 George Witwer Self-organized concept search and data storage method
US7451124B2 (en) * 2005-05-12 2008-11-11 Xerox Corporation Method of analyzing documents
US20060265388A1 (en) * 2005-05-20 2006-11-23 Woelfel Joseph K Information retrieval system and method for distinguishing misrecognized queries and unavailable documents
EP1941346A4 (en) * 2005-09-21 2010-10-27 Praxeon Inc Document processing
US20070073533A1 (en) * 2005-09-23 2007-03-29 Fuji Xerox Co., Ltd. Systems and methods for structural indexing of natural language text
US7716226B2 (en) * 2005-09-27 2010-05-11 Patentratings, Llc Method and system for probabilistically quantifying and visualizing relevance between two or more citationally or contextually related data objects
US7499586B2 (en) * 2005-10-04 2009-03-03 Microsoft Corporation Photographing big things
US7818315B2 (en) * 2006-03-13 2010-10-19 Microsoft Corporation Re-ranking search results based on query log
US20070244859A1 (en) * 2006-04-13 2007-10-18 American Chemical Society Method and system for displaying relationship between structured data and unstructured data

Also Published As

Publication number Publication date
US7809717B1 (en) 2010-10-05
CA2549536A1 (en) 2007-12-06
US20070282809A1 (en) 2007-12-06

Similar Documents

Publication Publication Date Title
CA2549536C (en) Method and apparatus for construction and use of concept knowledge base
US7752243B2 (en) Method and apparatus for construction and use of concept knowledge base
CN105493075B (en) Attribute value retrieval based on identified entities
US7788261B2 (en) Interactive web information retrieval using graphical word indicators
US20140115001A1 (en) Structured query generation
US20020161752A1 (en) Apparatus for and method of searching
US20180081880A1 (en) Method And Apparatus For Ranking Electronic Information By Similarity Association
US20140201198A1 (en) Automatically providing relevant search results based on user behavior
US20170315998A1 (en) Active Knowledge Guidance Based on Deep Document Analysis
JP2012501499A (en) System and method for supporting search request by vertical proposal
Strötgen et al. TimeTrails: a system for exploring spatio-temporal information in documents
Janecek et al. An evaluation of semantic fisheye views for opportunistic search in an annotated image collection
US10042934B2 (en) Query generation system for an information retrieval system
Aruleba et al. A full text retrieval system in a digital library environment
Kazai et al. The INEX evaluation initiative
JP2008243024A (en) Information acquisition device, program therefor and method
Li et al. Research on personal dataspace management
Cameron et al. Semantics-empowered text exploration for knowledge discovery
Chua A user interface guide for web search systems
An et al. Assessment for ontology-supported deep web search
Mohian et al. D2S2: Drag’n’Drop Mobile App Screen Search
Madaan et al. In-depth querying of web-based medical documents: beyond single page results
Huggett et al. Static reformulation: A user study of static hypertext for query-based reformulation
GB2360611A (en) Apparatus for and method of searching
Chevalier et al. Query assistant based on experience capitalization for information retrieval systems

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20140606