CA2571867A1 - Results based personalization of advertisements in a search engine - Google Patents

Results based personalization of advertisements in a search engine Download PDF

Info

Publication number
CA2571867A1
CA2571867A1 CA002571867A CA2571867A CA2571867A1 CA 2571867 A1 CA2571867 A1 CA 2571867A1 CA 002571867 A CA002571867 A CA 002571867A CA 2571867 A CA2571867 A CA 2571867A CA 2571867 A1 CA2571867 A1 CA 2571867A1
Authority
CA
Canada
Prior art keywords
user
search
profile
documents
search results
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
CA002571867A
Other languages
French (fr)
Inventor
Taher H. Haveliwala
Glen M. Jeh
Sepandar D. Kamvar
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Google LLC
Original Assignee
Google Inc.
Taher H. Haveliwala
Glen M. Jeh
Sepandar D. Kamvar
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Google Inc., Taher H. Haveliwala, Glen M. Jeh, Sepandar D. Kamvar filed Critical Google Inc.
Publication of CA2571867A1 publication Critical patent/CA2571867A1/en
Abandoned legal-status Critical Current

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9535Search customisation based on user profiles and personalisation
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9536Search customisation based on social or collaborative filtering
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/90Details of database functions independent of the retrieved data types
    • G06F16/95Retrieval from the web
    • G06F16/953Querying, e.g. by the use of web search engines
    • G06F16/9538Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising

Abstract

Personalized advertisements are provided to a user using a search engine to obtain documents relevant to a search query. The advertisements are personalized in response to a search profile that is derived from personalized search results. The search results are personalized based on a user profile of the user providing the query. The user profile describes interests of the user, and can be derived from a variety of sources, including prior search queries, prior search results, expressed interests, demographic, geographic, psychographic, and activity information.

Description

RESULTS BASED PERSONALIZATION
OF ADVERTISEMENTS IN A SEARCH ENGINE
INVENTORS: Taher Haveliwala, Glen Jeh, and Sepandar Kamvar CROSS REFERENCE TO RELATED APPLICATIONS

[0001] This application claims priority to U.S. Application Serial Number 10/877,775 entitled "Results Based Personalization Of Advertisements In A
Search Engine"
filed June 24, 2004. This application is a continuation in part of U.S.
Application Serial No.
10/676,711, entitled "PERSONALIZATION OF WEB SEARCH". This application is also related to U.S. Application Serial No. 10/314,427, entitled "METHOD AND
APPARATUS
FOR SERVING RELEVANT ADVERTISEMENTS" (herein, "Relevant Advertisements Application"), to U.S. Application Serial No. 10/676,571, entitled "METHOD AND
APPARATUS FOR CHARACTERIZING DOCUMENTS BASED ON CLUSTERS OF
RELATED WORDS," (herein, "Clusters of Related Words Application"), and to U.S.
Application Serial No. 10/646,331, entitled "IMPROVED METHODS FOR RANKING
NODES IN LARGE DIRECTED GRAPHS," (herein "Ranking Nodes Application"). All of the above-identified applications are commonly owned with the instant application, and are incorporated by reference herein.
FIELD OF INVENTION
[0002] This invention relates in general to providing advertisements to users of online search engines.
BACKGROUND OF INVENTION
[0003] The current state of the art in online search engines is highly advanced in its ability to retrieve documents that are responsive to the terms of a query. The ilifeasibility of charging users for each search has lead search engine providers to rely on revenue from advertisers in order to fund the search services. Advertisements have historically been placed on various parts of the search engine interface, including as banner ads, and paid inclusion links, and sidebar ads. These advertisements are typically selected in response to the particular terms of the user's query. The underlying assumption of this model is that the query terms reflect the user's interests, and thus selecting advertisements based on the query terms should yield advertisements for products or services the match these interests. Of course, advertisers generally desire to provide ads to those users who would be interested in their products or services. Thus, if the user's query is "MP3 players", then the assumption is that the user is interested in learning about, and potentially purchasing an MP3 player, and hence an advertisement for a particular MP3 player may result in the user's purchase. The current state of the art for such advertisements is the use of pay-for-performance advertisements, in which the advertiser pays the search engine provider for placement of the advertisement on the search results page only if the user selects (clicks on or activates) the advertisement.
[0004] The problem with query driven advertisements is in the underlying assumption that the current query best expresses the user's interests. This assumption is made because the query is the only information that the search engine has about the user, and thus the only basis on which to determine the user's interests. However, a query is only a very transient and unreliable indicator of a user's underlying interests. A
user may search for all manner of information, and much of the time this may be for business, technical, scientific or other information entirely unrelated to the user's actual personal interests, which the advertiser is typically trying to reach.
[0005] Thus, there is a need for a mechanism by which search engine providers can target advertisements on their search engines the personal interests of a user.
SUMMARY OF THE INVENTION
[0006] An advertisement serving system and methodology provides advertisements that are personalized to the interests of user in conjunction with the search results.
Generally, the methodology includes selecting a set of documents responsive to a user query and a user profile containing user interest information, and then selecting one or more advertisements in response to a search profile derived from the set of documents. Because the set of documents are response to both the user query and to the user profile, they are thus personalized to the user's interests. The advertisements that are selected are also personalized because they are selected in response to a search profile derived from these personalized documents.
[00071 More specifically, in one embodiment, a user provides a search query to the system to search for documents relevant to the query. The system obtains a profile of the user that expresses the interests of the user. The user's interests may be expressed as terms, categories, or links, or any combination thereof. The user profile information is derived from any of prior searches by the user, prior search results, user activities in interacting with prior search results, user demographic, geographic, or psychographic information, expressed topic or category preferences, and web-sites associated with the user. The system executes the search query to obtain a set of relevant documents, and then uses the user profile to personalize the documents by reranking the documents in a manner that reflects their relevance to the user's profile. The personalized search results are then analyzed to further determine a search profile, such as key words or topics that are descriptive of the documents therein. The search profile is used to select one or more advertisements, which advertisements will thus be relevant to the user's interests. The selected advertisements and the personalized search results are combined and provided to the user.
[0008] In one aspect, a system in accordance with the present invention includes a search engine that processes a user's query to provide the search results, a personalization server that personalizes the search results based on the user's profile, a content analysis module that analyses the personalized search results to derive a search profile, and an advertisement server that selects one or more advertisements in response to the search profile.
[0009] The invention also has embodiments in computer program products, systems, user interfaces, and computer implemented methods for facilitating the described functions and behaviors.
BRIEF DESCRIPTION OF THE DRAWINGS

[0010] FIG. 1 is a block diagram of system for providing results based personalized advertisements in accordance with one embodiment of the invention.
[0011] FIG. 2 illustrates multiple sources of user information and their relationship to a user profile.
[0012] FIG. 3 is an exemplary data structure that may be used for storing term-based profiles for a plurality of users.
[0013] FIG. 4A is an exemplary category map that may be used for classifying a user's past search experience.
[0014] FIG. 4B is an exemplary data structure that may be used for storing category-based profiles for a plurality of users.
[0015] FIG. 5 is an exemplary data structure that may be used for storing link-based profiles for a plurality of users.
[0016] FIG. 6 is a flowchart iflustrating paragraph sampling.
[0017] FIG. 7A is a flowchart illustrating context analysis.
[0018] FIG. 7B depicts a process of identifying important terms using context analysis.

[0019] FIG. 8 illustrates a plurality of exemplary data structures that may be used for storing information about documents after term-based, category-based and/or link-based analyses, respectively.
[0020] FIG. 9A is a flowchart illustrating a personalized web search process according to one embodiment.
[0021] FIG. 9B is a flowchart illustrating a personalized web search process according to another embodiment.
[0022] The figures depict various embodiments of the present invention for purposes of illustration only. One skill.ed in the art will readily recognize from the following discussion that alternative embodiments of the illustrated and described structures, methods, and functions may be employed without departing from the principles of the invention.

DETAILED DESCRIPTION

[0023] ~ystem Overview [0024] FIG. 1 illustrates a system 100 in accordance with one embodiment of the present invention. System 100 comprises a front-end server 102, a search engine 104 and associated content server 106, a personalization server 108 and associated user profile server 110, a content analysis module 112, an advertisement server 114 and associated advertisement database 116. During operation, a user accesses the system 100 via a conventional client 118 over a network (such as the Internet, not shown) operating on any type of client computing device, for example, executing a browser application.
While only a single client 118 is shown, the system 100 supports large number of concurrent sessions with many clients. The system 100 operates on high performance server class computers;
similarly the client device 118 can be any type of computing device. The details of the hardware aspects of server and client computers is well known to those of skill in the art and thus is not further described here.
[0025] The front-end server 102 is responsible for receiving a search query submitted by the client 119 along with some form of user ID that identifies either the user herself or the client device 118. The front-end server 102 provides the query to the search engine 104, which evaluates the query to retrieve a set of search results in accordance with the search query and returning the results to the front-end server 102. The search engine communicates with one or more content servers 106 and one or more user profile servers 108. A content server 106 stores a large number of indexed documents indexed (and/or retrieved) from different websites. Alternately, or in addition, the content server 106 stores an index of documents stored on various websites. "Documents" are understood here to be any form of indexable content, including textual documents in any text or graphics format, images, video, audio, multimedia, presentations, and so forth. In one embodiment, each indexed document is assigned a rank or score using a link-based scoring function that takes into account an attribute associated with one or more links to the document.
One example of a link-based scoring function is the page rank of a document. The page rank serves as a query independent measure of the document's importance. An exemplary form of page rank is described in U.S. Patent No. 6,285,999 which is incorporated by reference. The search engine 104 communicates with one or more of the content servers 106 to select a plurality of documents that are relevant to user's search query. The search engine 104 assigns a score to each document based on the document's page rank, the text associated with the document, and the search query.

[0026] The personalization server 108 receives the search results from the search engine 104, and the user ID from the front-end server 102, and personalizes the results based on a profile of the user. The personalization server 108 communicates with the user profile server 110, which stores a plurality of user profiles in a user profile database 110. Each user profile includes information that identifies a user as well as describes the user's interests which can be used to refine the search results in response to the search queries submitted by this user. A user profile can be derived from a variety of different sources, such as the user's previous search experience, personal information, web pages associated with the user, and so forth. One embodiment for constructing the user's profile and using it to personalize search results is further described in the next section.
[0027] More specifically, the user profile server 108 receives the user ID
from the front-end server 102, and returns the associated profile to the personalization server 108.
The personalization server 108 personalizes the search results by rescoring and/or reranking the documents included there according to the user profile. The personalization server 108 provides the personalized search results back to the front-end server 102.
[0028] The personalization server 108 also provides the personalized search results to the content analysis module 112. The content analysis module 112 analyzes the content of the documents included in the search results (or a subset thereof), and derives a search profile that is descriptive of the documents. For example, the search profile can comprise key terms in the documents, topics or categories that describe the documents, website information from which the documents were retrieved, and so forth. Because the search profile is derived from the personalized search results, it reflects the personalization of the results, and thus the descriptive information preserves this personalization aspect.
[0029] The content analysis module 112 provides the search profile to the advertisement server 114. The advertisement server 114 uses the search profile to select from the advertisement database 116 one or more advertisements for displaying in conjunction with the personalized search results. The selected personalized advertisements are provided to the front-end server 102.
[0030] The front-end server 102 receives the personalized search results and the personalized advertisements, and combines them (or a subset of each) to form a web page (results page) having some number of the documents from the search results and some number of the advertisements. This results page is returned to the client 118, where its rendered and displayed to the user, typically in the window of a browser or similar application (depending on client device). The personalized advertisements can be displayed next to the search result lists in a side panel, in a separate frame of the window, or in any other graphical format deemed appropriate.
[0031] The next sections describe the construction and use of user profiles to personalize search results, and the construction and use of the search profiles to personalize advertisement.
[0032] Creation and Maintenance of User Profiles [0033] A user profile describes the user's interests in a manner that can be used to personalize the results of any particular search query. The user profile can be derived from information that is explicitly provide by the user (e.g., designation of interests or topics in a directory), or information that is inferred from the user's behaviors and interactions with the search engine 104, or information that is inferred from the user's online relationships (e.g., websites or pages associated with the user's IP address).
[0034] With respect to information derived from the user's interaction with the search engine 104, prior search activities (both search queries themselves, and user access or non-access to the results) provide useful hints about the user's interests.
FIG. 2 provides an overview of various sources of information that are beneficial for user profile construction.
For example, previously submitted search queries 201 are very helpful in profiling a user's interests. If a user has submitted multiple search queries related to diabetes, it is more likely than not that this is a topic of interest to the user. If the user subsequently submits a query including the term "organic food", it can be reasonably inferred that he may be more interested in those organic foods that are helpful in fighting diabetes.
Similarly, the universal resource locators (URL) 203 associated with the search results in response to the previous search queries and their corresponding anchor texts 205, especially for search result items that have been selected or "visited" by the user (e.g., downloaded or otherwise viewed by the user), are helpful in determining the user's preferences. When a first page contains a link to a second page, and the ].iv.1k has text associated with it (e.g., text neighboring the link), the text associated with the link is called "anchor text" with respect to the second page.
Anchor text establishes a relationship between the text associated with a URL
link in a document and another document to which the URL link points. The advantages of anchor text include that it often provides an accurate description of the document to which the URL
7 link points, and it can be used to index documents that cannot be indexed by a text-based search engine, such as images or databases. In addition, a count may be maintained for each URL that is associated with the user's search results, and URLs receiving high counts are identified or otherwise analyzed in the user profile.
[0035] After receiving search results, the user may click on some of the URL
Iinks, thereby downloading the documents referenced by those links, so as to learn more details about those documents. Certain types of general information 207 can be associated with a set of user selected or use identified documents. For purposes of forming a user profile, the identified documents from which information is derived for inclusion in the user profile may include: documents identified by search results from the search engine, documents accessed (e.g., viewed or downloaded, for example using a browser application) by the user (including documents not identified in prior search results), documents linked to the documents identified by search results from the search engine, and documents linked to the documents accessed by the user, or any subset of such documents.
[0036] The general information 207 about the identified documents is also useful information about the user's preferences and interests. General information includes information such as the document format of accessed documents (e.g., HTML, plain text, portable document format (PDF), Microsoft Word), date information, creator information, and other metadata.
[0037] Activity information 209 describes the user's activities with respect to the user selected documents (sometimes herein called the identified documents).
This information describes factors such as how long the user spent viewing the document, the amount of scrolling activity on the document, and whether the user has printed, saved or bookmarked the document, and thus also suggests the importance of the document to the user as well as the user's preferences. In some embodiments, information about user activities 209 is used when weighting the importance of information extracted or derived from the user identified documents. In some embodiments, information about user activities 209 is used to determine which of the user identified documents to use as the basis for deriving the user profile. For example, information 209 may be used to select only documents that received significant user activity (in accordance with predefined criteria) for generating the user profile, or information 209 may be used to exclude from the profiling process documents that the user viewed for less than a predefined threshold amount of time.
8 [00381 The content of identified documents from previous search activities is a rich source of information about a user's interests and preferences. Key terms appearing in the identified documents and their frequencies with which they appear in the identified documents are not only useful for indexing the document, but are also a strong indication of the user's personal interests, especially when they are reinforce other types of user information discussed above. In one embodiment, instead of the whole documents, sampled content 211 from the identified documents is extracted for the purpose of user profile construction, to save storage space and computational cost. In another embodiment, various information related to the identified documents may be classified to constitute category information 213 about the identified documents. More discussion about content sampling, the process of identifying key terms in an identified document and the usage of the category information is provided below.
[0039] Optionally, a user may choose to offer personal information 215, including demographic and geographic information associated with the user, such as the user's age or age range, educational level or range, income level or range, language preferences, marital status, geographic location (e.g., the city, state and country in which the user resides, and possibly also including additional information such as street address, zip code, and telephone area code), cultural background or preferences, or any subset of these.
Alternatively, the geographic information can be inferred, for example, from the user's IP
address, without having the user provide the geographic information explicitly. In particular, generally, one can map an IP address to an organization. If the organization is in one place (i.e. Stanford), then it is possible to infer the graphical location of the user searching from that IP address. The personal information 215 may also indicate whether the user is a member of in one or more defined groups (e.g., organizations, companies, associations, clubs, committees, and the like). The personal information 215 may also include psychographic information (e.g., personality trait information, or other personality descriptive information) either derived from other aspects of the user profile, or expressly provided by the user.
[0040] Compared with other types of personal information such as a user's favorite sports or movies that are often time varying, this personal information is more static and more difficult to infer from the user's search queries and search results, but maybe crucial in correctly interpreting certain queries submitted by the user. For example, if a user submits a query containing "Japanese restaurant", it is very likely that he may be searching for a local
9 Japanese restaurant for dinner. Without knowing the user's geographical location, it is hard to order the search results so as to bring to the top those items that are most relevant to the user's true intention. In certain cases, however, it is possible to infer this information. For example, users often select results associated with a specific region corresponding to where they live.
[0041] Another potential source of information are expressed topics or category preferences 217. The user profile can include a list of terms or topics that the user expressly indicates as being among the user's interests. The terms can be selected by the user from a predefined list or hierarchy of topics and terms, or provided by the entirely by the user.
Each term or topic can be associated with a weight indicating a degree of importance to the user.
[0042] Another potential source of information for the user profile is information 219 derived from web pages and web sites associated with the user. First, a given user often accesses the system 100 from a relatively limited number of IP addresses and domains. The system 100 can automatically identify and access one or more websites associated with these IP addresses and extract information from them, such as their type (commercial, educational, organization, government, etc.), their geographic location, their size, and so forth. The system can further perform analyses of one or more of the pages on these sites (such as the home page), to extract relevant topics, key words, or other descriptive information.
[0043] Creating a user profile 230 from the various sources of user information is a multi-step process, which be divided into sub-processes. Each sub-process produces one type of user profile characterizing a user's interests or preferences from a particular perspective. They are:
= a term-based profile 231 - this profile represents a user's search preferences with a plurality of terms, where each term is given a weight indicating the importance of the term to the user;
= a category-based profile 233 - this profile correlates a user's search preferences with a set of categories, which may be organized in a hierarchal fashion, with each category being given a weight indicating the extent of correlation between the user's search preferences and the category; and = a link-based profile 235 - this profile identifies a plurality of links that are directly or indirectly related to the user's search preferences, with each link being given a weight indicating the relevance between the user's search preferences and the link.
[0044] In some embodiments, the user profile 230 includes only a subset of these profiles 231, 233, 235, for example just one or two of these profiles. In one embodiment, the user profile 230 includes a term-based profile 231 and a category-based profile 233, but not a link-based profile 235.
[0045] In one embodiment, a user profile is created and stored on a server (e.g., user profile server 108) associated with a search engine. The advantage of such deployment is that the user profile can be easily accessed by multiple computers, and that since the profile is stored on a server associated with (or part of) the search engine 104, it can be easily used by the search engine 104 to personalize the search results. In another embodiment, the user profile can be created and stored on the user's client 118. Creating and storing a user profile on the client not only reduces the computational and storage cost for the search engine's servers, but also satisfies some users' privacy requirements. In yet another embodiment, the user profile may be created and updated on the client 118, but stored in the user profile server 110. Such embodiment combines some of the benefits illustrated in the other two embodiments. It is understood by a person of ordinary skill in the art that the user profiles of the present invention can be implemented using client computers, server computers, or both.
[0046] FIG. 3 illustrates=an exemplary data structure, a term-based profile table 300, that may be used for storing term-based profiles for a plurality of users.
Table 300 includes a plurality of records 310, each record corresponding to a user's term-based profile. A term-based profile record 310 includes a plurality of columns including a USER ID
column 320 and multiple columns of (TERM, WEIGHT) pairs 340. The USER ID column stores a value that uniquely identifies a user, which may be the USER_ID itself, or a hash thereof. For a given user, there is a set of (TERM, WEIGHT) pairs, where each (TERM, WEIGHT) pair 340 includes a term, typically 1-3 words long, that is usually important to the user, and a weight associated with the term that quantifies the importance of the term. In one embodiment, the term may be represented as one or more n-grams. An n-gram is defined as a sequence of n tokens, where the tokens may be words. For example, the phrase "search engine"
is an n-gram of length 2, and the word "search" is an n-gram of length 1. A particular USER_ID
may also be used to identify a group of users.

[0047] N-grams can be used to represent textual objects as vectors. This makes it possible to apply geometric, statistical and other mathematical techniques, which are well defined for vectors, but not for objects in general. In the present invention, n-grams can be used to define a similarity measure between two terms based on the application of a mathematical function to the vector representations of the terms.
[0048] The weiglit of a term is not necessarily a positive value. If a term has a negative weight, it may suggest that the user prefers that his search results should not include this term and the magnitude of the negative weight indicates the strength of the user's preference for avoiding this term in the search results. By way of example, for a user who is breeds Australian Shepard dogs in San Francisco, California, the term-based profile may include terms like "Australian Shepard", "agility training" and "San Francisco" with positive weights. The terms like "German Shepard" or "Australia" may also be included in the profile. However, these terms are more likely to receive a negative weight since they are irrelevant and confusing with the authentic preference of this particular user.
[0049] A term-based profile itemizes a user's preference using specific terms, each term having certain weight. If a document contains a term that is in a user's term-based profile, the term's weight will be assigned to the document; however, if a document does not contain the term, it will not receive any weight associated with this term.
Such a requirement of relevance between a document and a user profile sometimes may be less flexible when dealing with various scenarios in which a fuzzy relevance between a user's preference and a document exists. For example, if a user's term-based profile includes terms like "Mozilla" and "browser", a document containing no such terms, but other terms like "Galeon" or "Opera" will not receive any weight because they do not match any existing term in the profile, even though they are actually Internet browsers. To address the need for matching a user's interests without exact term matching, a user's profile may include a category-based profile.
[0050] FIG. 4A illustrates a hierarchical category map 400 according to the Open Directory Project (http://dmoz.org/). Starting from the root level of map 400, documents are organized under several major topics, such as "Art", "News", "Sports", etc. These major topics are often too broad to delineate a user's specific interest. Therefore, they are further divided into'sub-topics that are more specific. For example, topic "Art" may comprise sub-topics like "Movie", "Music" and "Literature" and the sub-topic "Music" may further comprise sub-sub-topics like "Lyrics", "News" and "Reviews". Note that each topic is associated with a unique CATEGORY_ID like 1.1 for "Art", 1.4.2.3 for "Talk Show" and 1.6.1 for "Basketball".
[0051] A user's specific interests may be associated with multiple categories at various levels, each of which may have a weight indicating the degree of relevance between the category and the user's interest. In one embodiment, a category-based profile may be implemented using a hash table data structure as shown in FIG. 4B. A category-based profile table 450 includes a table 455 that comprises a plurality of records 460, each record including a USER ID and a pointer pointing to another data structure, such as table 460-1.
Table 460-1 may include two columns, CATEGORY_ID column 470 and WEIGHT column 480. CATEGORY_ID column 470 contains a category's identification number as shown in FIG. 4A, suggesting that this category is relevant to the user's interests and the value in the WEIGHT column 480 indicates the degree of relevance of the category to the user's interests.
[0052] A user profile based upon the category map 400 is a topic-oriented implementation. The items in a category-based profile can also be organized in other ways.
In one embodiment, a user's preference can be categorized based on the formats of the documents identified by the user, such as HTML, plain text, PDF, Microsoft Word, etc.
Different formats may have different weights. In another embodiment, a user's preference can be categorized according to the types of the identified documents, e.g., an organization's homepage, a person's homepage, a research paper, or a news group posting, each type having an associated weight. Another type category that can be used to characterize a user's search preferences is document origin, for instance the country associated with each document's host. These types of category information can be derived from either the user's prior searches 203, or from the user's web related information 217. In yet another embodiment, the above-identified category-based profiles may co-exist, with each one reflecting one aspect of a user's preferences.
[0053] Besides term-based and category-based profiles, another type of user profile is referred to as a link-based profile. As discussed above, a page rank algorithm, such as disclosed in U.S. Patent No. 6,285,999 uses the link structure that connects various documents over the Internet. A document that has more links pointing to it is often assigned a higher page rank and therefore attracts more attention from a search engine.
Link information related to a document identified by a user can also be used to infer the user's preferences. In one embodiment, a list of preferred URLs are identified for a user by analyzing the frequency of his access to those URLs. Each preferred URL may be further weighted according to the time spent by the user and the user's scrolling activity at the URL, and/or other user activities 209 when visiting the document at the URL. In another embodiment, a list of preferred hosts are identified for a user by analyzing the user's frequency of accessing web pages of different hosts. When two preferred URLs are related to the same host the weights of the two URLs may be combined to determine a weight for the host. In another embodiment, a list of preferred domains are identified for a user by analyzing the user's frequency of accessing web pages of different domains.
For example, for finance.yahoo.com, the host is "finance.yahoo.com" while the domain is "yahoo.com".
[0054] FIG. 5 illustrates a link-based profile using a hash table data structure. A
link-based profile table 500 includes a table 510 that includes a plurality of records 520, each record including a USER ID and a pointer pointing to another data structure, such as table 510-1. Table 510-1 may include two columns, LINK_ID column 530 and WEIGHT
column 540. The identification number stored in the LINIC_ID column 530 may be associated with a preferred URL or host. The actual URL/host/domain may be stored in the table instead of the LINK_ID, however it is preferable to store the LINI<ID to save storage space.
[0055] A preferred list of URLs and/or hosts includes URLs and/or hosts that have been directly identified by the user. The preferred list of URLs and/or host may furthermore extend to URLs and/or hosts indirectly identified by using methods such as collaborative filtering or bibliometric analysis, which are known to persons of ordinary skill in the art. In one embodiment, the indirectly identified URLs and/ or host include URLs or hosts that have links to/from the directly identified URLs and/or hosts. These indirectly identified URLs and/or hosts are weighted by the distance between them and the associated URLs or hosts that are directly identified by the user. For example, when a directly identified URL or host has a weight of 1, URLs or hosts that are one link away may have a weight of 0.5, URLs or hosts that are two links away may have a weight of 0.25, etc. This procedure can be further refined by reducing the weight of links that are not related to the topic of the original URL or host, e.g., links to copyright pages or web browser software that can be used to view the documents associated with the user selected URL or host. Irrelevant Links can be identified based on their context or their distribution. For example, copyright links often use specific terms (e.g., copyright or "All rights reserved" are commonly used terms in the anchor text of a copyright link); and links to a website from many unrelated websites may suggest that this website is not topically related (e.g., links to the Internet Explorer website are often included in unrelated websites). The indirect links can also be classified according to a set of topics and links with very different topics may be excluded or be assigned a low weight. Various methods of bibliometric analysis are further described in the Ranking Nodes Application, referenced above.
[0056] The three types of user profiles discussed above are generally complimentary to one another since different profiles delineate a user's interests and preferences from different vantage points. However, this does not mean that one type of user profile, e.g., category-based profile, is incapable of playing a role that is typically played by another type of user profile. By way of example, a preferred URL or host in a link-based profile is often associated with a specific topic, e.g., finance.yahoo.com is a URL focusing on financial news.
Therefore, what is achieved by a link-based profile that comprises a list of preferred URLs or hosts to characterize a user's preference may also be achievable, at least in part, by a category-based profile that has a set of categories that cover the same topics covered by preferred URLs or hosts.
[0057] The generation of a term-based profile 231 is generally as follows.
Given a document identified (e.g., viewed) by a user, different terms in the document may have different importance in revealing the topic of the document. Some terms, e.g., the document's title, may be extremely important, while other terms may have little importance.
For example, many documents contaiv.l navigational links, copyright statements, disclaimers and other text that may not be related to the topic of the document. How to efficiently select appropriate documents, content from those documents and terms from within the content is a challenging topic in computational linguistics. Additionally, it is preferred to minimize the volume of user information processed, so as make the process of user profile construction computationally efficient. Skipping less important terms in a document helps in accurately matching a,document with a user's interest.
[00581 Paragraph sampling (described below with reference to FIG. 6) is a procedure for automatically extracting content from a document that may be relevant to a user. The paragraph sampling process takes advantage of the insight that less relevant content in a document, such as navigational links, copyright statements, disclaimer, etc., tends to from relatively short segments of text. In one embodiment, paragraph sampling looks for the paragraphs of greatest length in a document, processing the paragraphs in order of decreasing length until the length of a paragraph is below a predefined threshold. The paragraph sampling procedure 'optionally selects up to a certain maximum amount of content from each processed paragraph. If few paragraphs of suitable length are found in a document, the procedure falls back to extracting text from other parts of the document, such as anchor text and ALT tags.
[0059] FIG. 6 is a flowchart illustrating the major steps of paragraph sampling. The process assumes that the document is initially loaded the document into memory.
Paragraph sampling includes removing 610 (or simply ignoring) certain predefined items, such as comments, JavaScript and style sheets, etc., from a document. These items are removed because they are usually related to visual aspects of the document when rendered on a browser and are unl.ikely to be relevant to the document's topic.
Following that, the procedure selects 620 the first N words (or M sentences) from each paragraph whose length is greater than a threshold value, MinParagraphLength, as sampled content. In one embodiment, the values of N and M are chosen to be 100 and 5, respectively.
Other values may be used in other embodiments.
[0060] In order to reduce the computational and storage load associated with the paragraph sampling procedure, the procedure may impose a maximum limit, e.g., words, on the sampled content from each document. In one embodiment, the paragraph sampling procedure organizes all the paragraphs in a document in length decreasing order, and then starts the sampling process with a paragraph of maximum length. It is noted that the beginning and end of a paragraph depend on the appearance of the paragraph in a browser, not on the presence of uninterrupted a text string in the HTML
representation of the paragraph. For this reason, certain HTML commands, such as commands for inline links and for bold text, are ignored when determining paragraph boundaries. In some embodiments, the paragraph sampling procedure screens the first N words (or M
sentences) so as to filter out those sentences including boilerplate terms like "Terms of Service" or "Best viewed", because such sentences are usually deemed irrelevant to the document's topic.
[0061] Before sampling a next paragraph whose length is above the threshold value, the procedure may check to determine if the number of words in the sampled content has reached a maximum word limit. If so, the process can stop sampling content from the document. If the maximum word limit has not been reached after processing all paragraphs of length greater than the threshold, optional steps 630, 640, 650 and 670 are performed. In particular, the procedure adds the document title (630), the non-inline HREF
links (640), the ALT tags (650) and the meta tags (670) to the sampled content until it reaches the maximum word limit.

[0062] Once a document has been sampled, the sampled content can be used for identifying a list of most important (or unimportant) terms through context analysis.
Context analysis attempts to learn context terms that predict the most important (or unimportant) terms in a set of identified documents. Specifically, it looks for prefix patterns, postfix patterns, and a combination of both. For example, an expression "x's home page"
may identify the term "x" as an important term for a user and therefore the postfix pattern "* home page" can be used to predict the location of an important term in a document, where the asterisk "* " represents any term that fits this postfix pattern. In general, the patterns identified by context analysis usually consist of m terms before an important (or unimportant) term and n terms after the important (or unimportant) term, where both m and n are greater than or equal to 0 and at least one of them is greater than 0. Typically, m and n are less than 5, and when non-zero are preferably between 1 and 3.
Depending on its appearance frequency, a pattern may have an associated weight that indicates how important (or unimportant) the term recognized bay the pattern is expected to be.

[0063] FIG. 7A illustrates a flowchart for one embodiment of context analysis.
This embodiment has two distinct phases, a training phase 701 and an operational phase 703.
The training phase 701 receives 710 and utilizes a list of important terms 712, an optional list of unimportant terms 714, and a set of training documents. In some embodiments, the list of unimportant terms is not used. The source of the lists 712, 714 is not critical. In some embodiments, these lists 712, 714 are generated by extracting words or terms from a set of documents (e.g., a set of several thousand web pages of high page rank) in accordance with a set of rules, and then editing them to remove terms that in the opinion of the editor do not belong in the lists. The source of the training documents is also not critical. In some embodiments, the training documents comprise a randomly or pseudo-randomly selected set of documents already known to the search engine. In other embodiments, the training documents are selected from a database of documents in the search engine in accordance with predefined criteria.
[0064] During the training phase 701, the training documents are processed 720, using the lists of predefined important and unimportant terms, so as to identify a plurality of context patterns (e.g., prefix patterns, postfix patterns, and prefix-postfix patterns) and to associate a weight with each identified context pattern. During the operational phase 703, the context patterns are applied 730 to a document to identify 740 a set of important terms that characterize the user's specific interests and preferences. This process is repeated for any number of documents that are deemed to be associated with the user.
Learning and delineating a user's interests and preferences is usually an ongoing process.
Therefore, the operational phase 703 may be repeated to update the set of important terms that have been captured previously. This may be done each time a user accesses a document, according to a predetermined schedule, at times determined in accordance with specified criteria, or otherwise from time to time. Similarly, the training phase 701 may also be repeated to discover new sets of context patterns and to recalibrate the weights associated with the identified context patterns.
[0065] Below is a segment of pseudo code that exemplifies the training phase:
For each document in a set {
For each important term in the document {
For m = 0 to MaxPrefix {
For n= 0 to MaxPostfix {
Extract the m words before the important term and the n words after the important term as s;
Add 1 to ImportantContext(m,n,s);
}
}
}
For each unimportant term in the document {
For m= 0 to MaxPrefix {
For n= 0 to MaxPostfix {
Extract the m words before the unimportant term and the n words after the unimportant term as s;
Add 1 to UnimportantContext(m,n,s);
}
}
}
}
For m 0 to MaxPrefix {
For n= 0 to MaxPostfix {
For each value of s{

Set the weight for s to a function of ImportantContext(m,n,s), and UnimportantContext(m,n,s);
}
}
}

[0066] In the pseudo code above, the expression s refers to a prefix pattern (n=0), a postfix pattern (m=0) or a combination of both (m>0 & n>0). Each occurrence of a specific pattern is registered at one of the two multi-dimensional arrays, ImportantContext(m,n,s) or UnimportantContext(m,n,s). The weight of a prefix, postfix or combination pattern is set higher if this pattern identifies more important terms and fewer unimportant terms and vice versa. Note that it is possible that a same pattern may be associated with both important and unimportant terms. For example, the postfix expression " operating system"
may be used in the training documents 716 in conjunction with terms in the list of predefined important terms 712 and also used in conjunction with terms in the list of predefined unimportant terms 714. In this situation, the weight associated with the postfix pattern operating system" (represented by the expression Weight(1,0, "operating system")) will take into account the number of times the postfix expression is used in conjunction with terms in the list of predefined important terms as well as the number of times the postfix expression is used in conjunction with terms in the list of predefined unimportant terms.
One possible formula to determine the weight of a context patterns is:
Weight(m,n,s) = Log(ImportantContext(m,n,s)+1)-Log(UnimportantContext(m,n,s)+1).
Other weight determination formulas may be used in other embodiments.
[0067] In the second, operational phase 703 of the context analysis process, the weighted context patterns are used to identify important terms in one or more documents identified by the user. Referring to FIG. 7B, in the first phase the personalization server 108 receives training data 750 and creates a set of context patterns 760, each context pattern having an associated weight. The personalization server 108 then applies the set of context patterns 760 to a document 780. In FIG. 7B, previously identified context patterns found within the document 780 are identified. Terms 790 associated with the context patterns are identified and each such term receives a weight based on the weights associated with the context patterns. For example, the term "Foobar"appears in the document twice, in association with two different patterns, the prefix pattern "Welcome to *" and the postfix pattern "* builds", and the weight 1.2 assigned to "Foobar" is the sum of the two patterns' weights, 0.7 and 0.5. The other identified term "cars" has a weight of 0.8 because the matching prefix pattern "world's best *" has a weight of 0.8. In some embodiments the weight for each term is computed using a log transform, where the final weight is equal to log(initial weight +1). It is possible that the two terms "Foobar" and "cars"
may not be in the training data 750 and may have never been encountered by the user before.
Nevertheless, the context analysis method described above identifies these terms and adds them to the user's term-based profile. Thus, context analysis can be used to discover terms associated with a particular documents, where the documents are those associated with the user, and thus the user's interests and preferences.
[0068] As noted, the output of context analysis can be used directly in constructing a user's term-based profile. Additionally, it may be useful in building other types of user profiles, such as a user's category-based profile. For example, a set of weighted terms can be analyzed and classified into a plurality of categories covering different topics, and those categories can be added to a user's category-based profile.
[0069] After executing the context analysis on a set of documents identified by or for a user, the resulting set of terms and weights may occupy a larger amount of storage than allocated for each user's term-based profile. Also, the set of terms and corresponding weights may include some terms with weights much, much smaller than other terms within the set. Therefore, in some embodiments, at the conclusion of the context analysis, the set of terms and weights is pruned by removing terms having the lowest weights (A) so that the total amount of storage occupied by the term-based profile meets predefined limits, and/ or (B) so as to remove terms whose weights are so low, or terms that correspond to older items, as defined by predefined criteria, that the terms are deemed to be not indicative of the user's search preferences and interests. In some embodiments, similar pruning criteria and techniques are also applied to the category-based profile and/or the link-based profile.
[0070] In some embodiments, a user's profile is updated in the above manner each time the user performs a search and selects at least one document from the search results to download or view. In some embodiments, the personalization server 108 builds a list of documents identified by the user (e.g., by selecting the documents from search results) over time, and at predefined times (e.g., when the list reaches a predefined length, or a predefined amount of time has elapsed), performs a profile update of the user profile. When performing an update, new profile data is generated, and the new profile data is merged with the previously generated profile data for the user. In some embodiments, the new profile data is assigned higher importance than the previously generated profile data, thereby enabling the system to quickly adjust a user's profile in accordance with changes in the user's search preferences and interests. For example, the weights of items in the previously generated profile data may be automatically scaled downward prior to merging with the new profile data. In one embodiment, there is a date associated with each item in the profile, and the information in the profile is weighted based on its age, with older items receiving a lower weight than when they were new. In other embodiments, the new profile data is not assigned high importance than the previously generated profile data.

[0071] The paragraph sampling and context analysis methods may be used independently or in combination. When used in combination, the output of the paragraph sampling is used as input to the context analysis method. When used alone, the context analysis method can take the entire text of a document as its input, rather than just a sample.
[0072] Personalization of Search Results with the User Profile [0073] The above-described methods used for creating user profiles, e.g., paragraph sampling and context analysis, may be also leveraged for determining the relevance of a candidate document to a user's preference, and thereby personalizing the results of a given search. Indeed, one function of the system 100 is to identify a set of documents that are most relevant to a user's interests based on both the user's search query as well as the user's user profile. FIG. 8 illustrates several exemplary data structures that can be used to store information about a document's relevance to a user profile from multiple perspectives. As noted above, the search engine 104 retrieves a set of documents that form the search results.
These documents are herein called "candidate documents", since they are candidates that may be potentially provided to the user. For each candidate document, identified by a respective DOC_ID, term-based document information table 810 includes multiple pairs of terms and their weights, category-based document information table 830 includes a plurality of categories and associated weights, and link-based document information table 850 includes a set of links and corresponding weights.
[0074] The rightmost coluiny.l of each of the three tables (810, 830 and 850) stores the rank (or a computed score) of a document when the document is evaluated using the particular type of user profile associated with the table. A user profile rank for a given document can be determined by combining the weights of the items (columns) associated with a document. For instance, a category-based or topic-based profile rank may be computed as follows. A user may prefer documents associated with the "Science"
category with a weight of 0.6, while he dislikes documents about the "Business"
category with a weight of -0.2. Thus, when a document that is within the "Science" category matches a search query, it will be weighted higher than a document in the "Business"
category. In general, the document topic classification may not be exclusive. A candidate document may be classified as being a science document with probability of 0.8 and a business document with probability of 0.4. A link-based profile rank may be computed based on the relative weights allocated to a user's URL, host, domain, etc., preferences in the link-based profile.
In one embodiment, term-based proffle rank can be determined using known techniques, such as the term frequency-inverse document frequency (TF-IDF). The term frequency of a term is a function of the number of times the term appears in a document. The inverse document frequency is an inverse function of the number of documents in which the term appears within a collection of documents. For example, very common terms like "the" occur in many documents and consequently as assigned a relatively low inverse document frequency.
[0075] When a search engine generates search results in response to a search query, a candidate document D that satisfies the query is assigned a query score, QueryScore, in accordance with the search query. This query score is then modulated by document D's page rank, PageRank, to generate a generic score, GenericScore, that is expressed as GenericScore = QueryScore*PageRank.
[0076] This generic score may not appropriately reflect document D's importance to a particular user U if the user's interests or preferences are dramatically different from that of the random surfer. The relevance of document D to user U can be accurately characterized by a set of profile.ranks, based on the correlation between document D's content and user U's term-based profile, herein called the TermScore, the correlation between one or more categories associated with document D and user U's category-based profile, herein called the CategoryScore, and the correlation between the URL
and/or host of document D and user U's link-based profile, herein called the LinkScore.
Therefore, document D may be assigned a personalized rank that is a function of both the document's generic score and the user profile scores. In one embodiment, this personalized score can be expressed as:

PersonalizedScore = GenericScore*(TermScore+CategoryScore+LinkScore).

[0077] Figs. 9A and 9B represent two embodiments, both implemented in a network environment such as the network environment shown in FIG. 1. In the embodiment shown in FIG. 9A, the search engine 104 receives 910 via the front-end server 102, a search query from the client 118 that is submitted by a particular user. In response, the search engine 104 may optionally generate 915 a query strategy (e.g., the search query is normalized so as to be in proper form for further processing, and/or the search query may be modified in accordance with predefined criteria so as to automatically broaden or narrow the scope of the search query). The search engine 104 submits 920 the search query (or the query strategy, if one is generated) to the content server 106. The content server 106 identifies a list of documents that match the search query, each document having a generic score that depends on the document s page rank and the search query. This set of documents is also referred to as the search results, and they are typically ordered based on their GenericScore.
In general, all the three operations are conducted by the search engine 104 and content server 106, which is on the server side of the network. There are two options on where to implement the operations following these first three steps.
[0078] In some embodiments that employ a server-side implementation, the user's ID is embedded in the query string provided by the client 118. This ID is passed from the front-end server 102 to the personalization server 108. Based on the user's ID, the user profile server 110 identifies 925 the user's user profile 230. The personalization server 108 analyzes each document in the search results to determine its relevance to the user's profile, creates 935 a profile score for the identified document. The profile score is based on any or all of the parts of the user profile 230 and then assigns 940 the document a personalized score that is a function of the document's generic and profile score. The personalization server 108 checks whether the current document is the last one of the search results. If not, the personalization server 108 processes the next document in the search results. Otherwise, the search results are re-ordered 945 according to their personalized scores, to form the personalized search results. The personalized search results are provided to the front-end server 102 and to the content analysis module 112.
[0079] Embodiments using a client-side implementation are similar to the server-side implementation, except that after the search engine 104 obtains 920the initial set of results, the search results sent to the corresponding client from whom the user submitted the query. This client stores the user's user profile 230 and it is responsible for re-ordering the documents based upon the user profile. In this embodiment, the client device has a local version of the personalization server 108, which performs essentially the same scoring and ranking functionality as previously described. Therefore, this client-side implementation may reduce the workload on the system 100. Further, since there is no privacy concern with the client-side implementation, a user may be more wffling to provide private information to customize the search results. However, one limitation to the client-side implementation is that only a limited number of documents, e.g., the top 50 documents (as determined using the generic rank), may be sent to a client for reordering due to limited network bandwidth.
In contrast, the server-side implementation may be able to apply a user's profile 230 to a much larger number of documents in the search result, e.g., 1000. Therefore, the client-side implementation may deprive a user access to those documents having relatively low generic ranks, but significantly personalized ranks.
[0080] FIG. 9B illustrates another embodiment. As before, the user's query and user ID is received via the front-end server 102, and the search engine 104 constructs 915 a generic query strategy. In addition, the search engine 104 adjusts 965 the generic query strategy according to the user's user profile 230 to create a personalized query strategy. This is done by the front-end server 102 providing the user's ID to the personalization server 108, which retrieves the user profile 230 and terms from the user's term profile 231. These terms are then added to the search query. The creation of the personalized query strategy can be performed either on the client side or on the server side of the system. This embodiment avoids the network bandwidth restriction facing the previous embodiment. The search engine 104 submits 970 the personalized query strategy to the content server 106. Since the content server 106 takes into account the additional personalized terms for the user's profile, the search results returned by the content server 106 have already been ordered 975 by the documents' personalized ranks.
[0081] The profiles 230 of a group of users with related interests may be combined together to form a group profile, or a single profile may be formed based on the documents identified by the users in the group. For instance, several family members may use the same computer to submit search queries to a search engine. If the computer is tagged with a single user identifier by the search engine, the "user" will be the entire family of users, and the user profile will be represent a combination or mixture of the search preferences of the various fam.ily members. An individual user in the group may optionally have a separate user profile that differentiates this user from other group members. In operation, the search results for a user in the group are ranked according to the group profile, or according to the group profile and the user's user profile when the user also has a separate user profile.
[0082] It is possible that a user may switch his iv.lterests so dramatically that his new interests and preferences bear little resemblance to his user profile, or a user may be temporarily interested in a new topic. In this case, personalized search results produced according to the embodiments depicted in Figs. 9A and 9B may be less favorable than search results ranked in accordance with the generic ranks of the documents in the search results.
Additionally, the search results provided to a user may not include new websites among the top listed documents because the user's profile tends to increase the weight of older websites that the user has visited (i.e., older websites from which the user has viewed or downloaded web pages) in the past.
[0083] To reduce the impact caused by a change in a user's preferences and interests, the personalized search results may be merged with the generic search results.
In one embodiment, the generic search results and personalized search results are interleaved, with the odd positions (e.g., 1, 3, 5, etc.) of a search results list reserved for generic search results and the even positions (e.g., 2, 4, 6, etc.) reserved for personalized search results, or vice versa. Preferably, the items in the generic search results will not duplicate the items listed in the personalized search results, and vice versa. More generally, generic search results are intermixed or interleaved with personalized search results, so that the items in the search results presented to the user include both generic and personalized search results.
[0084] In another embodiment, the personalized ranks and generic ranks are further weighted by a user profile's confidence level. The confidence level takes into account factors such as how much information has been acquired about the user, how close the current search query matches the user's profile, how old the user profile is, etc. If only a very short history of the user is available, the user's profile may be assigned a correspondingly low confidence value. The final score of an identified document can be determined as:
FinalScore = ProfileScore*ProfileConfidence + GenericScore*(1-ProfileConfidence).
When intermixing generic and personalized results, the fraction of personalized results may be adjusted based on the profile confidence, for example using only one personalized result when the confidence is low.
[0085] Sometimes, multiple users may share a machine, e.g., in a public library.
These users may have different interests and preferences. In one embodiment, a user may explicitly login to the service so the system knows his identity.
Alternatively, different users can be automatically recognized based on the items they access or other characteristics of their access patterns. For example, different users may move the mouse in different ways, type differently, and use different applications and features of those applications. Based on a corpus of events on a client and/ or server, it is possible to create a model for identifying users, and for then using that identification to select an appropriate "user"
profile. In such circumstances, the "user" may actually be a group of people having somewhat similar computer usage patterns, interests and the like.
[0086] Personalization of Advertisements [0087] Referring again to FIG. 1, the content analysis module 112 receives from the personalized search results from the personalization server 108, which then analyses the documents referenced therein, and provides a search profile to the advertisement server.
The advertisement server 114 uses the search profile to select from the advertisement database 116 one or more advertisements for displaying in conjunction with the personalized search results.
[0088] The content analysis module 112 creates the search profile by determining key topic words or terms that are descriptive of the documents references in personalized search results as a group. Thus, for selected documents in the personalized search results, the content analysis module 112 determines a set of one or more topics, and then uses this set of topics to determine the topics descriptive of the personalized search results (e.g., selecting the N most frequently, occurring topics, or some other filtering/
selection process).
The content analysis module 112 may apply any type of topic extraction methods known in the art or developed hereafter, as the particular algorithm used for topic extraction is not a limitation of the invention.
[0089] The content analysis module 112 can analyze of the documents in the personalized search results, or any subset thereof. In one embodiment, the personalized search results form a plurality of pages, each page containing some number of the documents. The documents that would be on the first page of results are the subset which the content analysis module 112 analyzes. This approach is beneficial since the documents on this first page are those most relevant to the user's interests, and hence the resulting search profile will likewise contain the most relevant terms and topics.
[0090] In one embodiment, the content analysis module 112 uses the methods described above with respect to FIGS. 6, and 7A-7B for constructing the term based profile of the user. Here, the operational goal is a set of terms that describe the topics of the personalized search results. In another embodiment, the content analysis module 112 uses a combination of internal document analysis that extracts topics based on the frequencies of key words in the document and in the entire document collection, and link analysis (based on the inbound and outbound link structure of each document). As a particular example of the latter, the content analysis module 112 can determine if a given document in the personalized search results is linked to one or more topics in topical directory (e.g., ~), and if so, uses these linked topics as candidate topics for the document.
(http: // dmoz.or Further details of these types of methods are disclosed the Relevant Advertisements Application, cited above, which is incorporated by reference herein. In another embodiment, the content analysis module 112 uses a probabilistic model to determine the topics for inclusion in the search profile. One method of generation and use of a probabilistic model in this manner is described in the Clusters of Related Words Application, cited above, which is also incorporated by reference herein.
[0091] In any of these embodiments, the content analysis module 112 provides a search profile that includes a set of terms that describe the personalized search results, and may be characterized as the topics that the documents in the personalized search results are about. The search profile is provided to the advertisement server 114, which then selects one or more advertisements for inclusion with the personalized search results.
The advertisement server 114 can select the advertisements in any number of ways including any known or hereafter developed method, and the present invention is not limited to any particular method for selecting advertisements given a set of terms or topics.
One method of selection of relevant advertisements is described in the Relevant Advertisements Application, cited above. In general, the advertisement server 114 maintains a database of terms or topics, along with the advertisement database 116, which can also be indexed, either by keywords extracted from each advertisement, or with keywords selected by provider of the advertisement. The association of terms in the database to advertisement keywords can be by any number of mechanisms, including various types of monetary based models (e.g., pay-for-placement, pay-for-performance), or matching algorithms (e.g., Boolean match, or fuzzy matching). What is of interest in the advertisement selection process is that the advertisement server 114 selects advertisements using a search profile derived from the search results that were personalized based on the user's profile. Hence, the advertisements that are selected will in turn be personalized to the interests of the user.

[0092] Once selected, the advertisements are than provided to the front end server 102, along with the personalized search results. The front end server 102 integrates the selected personalized advertisements into the personalized search results, and provides the results to the client 118, for example as a web page, or through whatever other visualization or presentation interface the client 118 is using. The advertisements may be interlineated with the personalized search results, or placed in a visually segregated region of the user interface of the client (e.g., a separate window, pane, tab, or graphical demarcated area).
[0093] The advertisements provided to the front end server 102 can be integrated with the personalized search results so that they appear on every page of the results. In an alternative embodiment, a different set of advertisements is provided on each page of the personalized search results, where the advertisements are derived from a search profile that is responsive to just the documents listed on that page. Thus, in this embodiment, the content analysis module 112 updates the search profile in response to the user accessing another page of the personalized search results, and provides the updated search profile to the advertisement server 114, which selects the appropriate advertisements in response thereto.
[0094] In another embodiment, additional information is used to create the search profile. In particular, the results of both the personalized results of the current search query, and of at least one prior search query, are analyzed by the content analysis module 112 to form the search profile. This approach is beneficial to reflect a more long term assessment of the user's interests, as it spans multiple queries. This is beneficial because user's typically attempt multiple queries in a given area of interest, rather than just a single query.
[0095] In some instances, the search query itself may be such that the search results cannot be usefully personalized. For example, this is often the case when the user searches for a some type portal site, such as the home page of a commercial portal (e.g., Google.com, Yahoo.com, etc.), a news organization (e.g., CNN.com, or MSNBC.com), an organization (e.g., IEEE.com), or a government agency (e.g., the U.S. State Department).
For these types of searches, the search engine identifies the portal aspect of in the search results (e.g., from the domain name), and then uses just the user profile, without personalization of the results, to select the advertisement. Thus, in this case, the user profile itself operates as the search profile.
[0096] From the foregoing, it should be appreciated that the present invention includes a general model of using a first set of algorithms to obtain and rank a first set of search results, and then using a second set of algorithms that analyzes the first set of results in order to rank a second set of search results, where the first and second results are from different data sets, and the first and second sets of algorithms are different from each other as well. Thus, in the above described embodiment, the first set of algorithms includes a search query algorithm to obtain the first set of search results from a general content corpus, and a personalization algorithm which ranks a first set of search results according to a user profile, and the second set of algorithm includes the content analysis module which analyzes the ranked search results to produce the search profile and the advertisement server which uses the search profile to search for and rank a set of advertisements from the advertisement database. The general metliod here is to use the ranked data resulting from one process to rank the data resulting from another process. This method may be employed in other applications, for example, where the first set of data is business financial data, and the second set of data is product information data.
[0097] The present invention has been described in particular detail with respect to one possible embodiment. Those of skill in the art will appreciate that the invention may be practiced in other embodiments. First, the particular naming of the components, capitalization of terms, the attributes, data structures, or any other programming or structural aspect is not mandatory or significant, and the mechanisms that implement the invention or its features may have different names, formats, or protocols.
Further, the system may be implemented via a combination of hardware and software, as described, or entirely in hardware elements. Also, the particular division of functionality between the various system components described herein is merely exemplary, and not mandatory;
functions performed by a single system component may instead be performed by multiple components, and functions performed by multiple components may instead be performed by a single component.
[0098] Some portions of above description present the features of the present invention in terms of algorithms and symbolic representations of operations on information.
These algorithmic descriptions and representations are the means used by those skilled in the data processing arts to most effectively convey the substance of their work to others skilled in the art. These operations, while described functionally or logically, are understood to be implemented by computer programs. Furthermore, it has also proven convenient at times, to refer to these arrangements of operations as modules or by functional names, without loss of generality.

[0099] Unless specifically stated otherwise as apparent from the above discussion, it is appreciated that throughout the description, discussions utilizing terms such as "calculating" or' determ;n;ng' or "identifying" or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system memories or registers or other such information storage, transmission or display devices.
[00100] Certain aspects of the present invention include process steps and instructions described herein in the form of an algorithm. It should be noted that the process steps and instructions of the present invention could be embodied in software, firmware or hardware, and when embodied in software, could be downloaded to reside on and be operated from different platforms used by real time network operating systems.
[00101] The present invention also relates to an apparatus for performing the operations herein. This apparatus may be specially constructed for the required purposes, or it may comprise a general-purpose computer selectively activated or reconfigured by a computer program stored on a computer readable medium that can be accessed by the computer. Such a computer program may be stored in a computer readable storage medium, such as, but is not limited to, any type of disk including floppy disks, optical disks, CD-ROMs, magnetic-optical disks, read-only memories (ROMs), random access memories (RAMs), EPROMs, EEPROMs, magnetic or optical cards, or any type of media suitable for storing electronic instructions, and each coupled to a computer system bus.
[00102] The algorithms and operations presented herein are not inherently related to any particular computer or other apparatus. Various general-purpose systems may also be used with programs in accordance with the teachings herein, or it may prove convenient to construct more specialized apparatus to perform the required method steps. The required structure for a variety of these systems will be apparent to those of skill in the art, along with equivalent variations. In addition, the present invention is not described with reference to any particular programming language. It is appreciated that a variety of programming languages may be used to implement the teachings of the present invention as described herein, and any references to specific languages are provided for disclosure of enablement and best mode of the present invention.
[00103] Finally, it should be noted that the language used in the specification has been principally selected for readability and instructional purposes, and may not have been selected to delineate or circumscribe the inventive subject matter.
Accordingly, the disclosure of the present invention is intended to be illustrative, but not limiting, of the scope of the invention, which is set forth in the following claims.

Claims (45)

We claim:
1. A computer implemented method for providing personalized advertisements in an online search engine, the method comprising:
selecting a set of documents responsive to a user query and a user profile containing user interest information; and selecting an advertisement in response to a search profile derived from the set of documents.
2. The method of claim 1, wherein the user profile includes information derived from prior search queries provided by the user.
3. The method of claim 1, wherein the user profile includes keywords derived from prior search queries provided by the user.
4. The method of claim 1, wherein the user profile includes information derived from prior search results received by the user.
5. The method of claim 1, wherein the user profile includes keywords derived from documents included in prior search results received by the user.
6. The method of claim 1, wherein the user profile includes terms derived from anchor text of hyperlinks in documents included in prior search results received by the user.
7. The method of claim 1, wherein the user profile includes information derived from documents linked to documents included in prior search results received by the user.
8. The method of claim 1, wherein the user profile includes document format information of documents included in prior search results received by the user.
9. The method of claim 1, wherein the user profile includes information derived from user interactions with documents in prior search results received by the user.
10. The method of claim 1, wherein the user profile includes information describing an amount of time the user spent viewing a document included in prior search results received by the user.
11. The method of claim 1, wherein the user profile includes information describing an amount of scrolling activity in a document included in prior search results received by the user.
12. The method of claim 1, wherein the user profile includes information whether the user has printed a document included in prior search results received by the user.
13. The method of claim 1, wherein the user profile includes information whether the user has saved a document included in prior search results received by the user.
14. The method of claim 1, wherein the user profile includes information whether the user has bookmarked a document included in prior search results received by the user.
15. The method of claim 1, wherein the user profile is derived from previous web pages that the user has accessed.
16. The method of claim 1, wherein the user profile includes Universal Resource Locators derived from hyperlinks in documents included in prior search results received by the user.
17. The method of claim 1, wherein the user profile comprises a set of categories, each category associated with an weight indicating an importance of the category to the user.
18. The method of claim 1, wherein the user profile includes demographic information.
19. The method of claim 1, wherein the user profile includes psychographic information.
20. The method of claim 1, wherein the user profile includes geographic information of the user.
21. The method of claim 1, wherein the user profile indicates whether the user is a member of each of a plurality of groups.
22. The method of claim 1, wherein the user profile includes information derived from network domains associated with the user.
23. The method of claim 1, wherein the user profile is derived from the user's network address.
24. The method of claim 1, wherein the user profile includes information derived from network domains from which the user submitted the query.
25. The method of claim 1, wherein the user profile includes the types of network domains from which the user submitted the query.
26. The method of claim 1, wherein the user profile includes the keywords derived from websites associated with the network domains from which the user submitted the query.
27. The method of claim 1, wherein the user profile includes counts of network domains associated with prior search results received by the user.
28. The method of claim 1, wherein the user profile includes counts of URLs associated with prior search results received by the user.
29. The method of claim 1, wherein the user profile includes a list of keywords.
30. The method of claim 1, wherein the user profile is derived from preferences provided by the user.
31. The method of claim 1, wherein the search profile is derived from a subset of the documents.
32. The method of claim 1, wherein the set of documents form search results having a plurality of pages, and the search profile is derived from a subset of the documents appearing on a first page of the search results.
33. The method of claim 1, wherein the set of documents form search results having a plurality of pages, and the search profile is updated in response to the user accessing each page of the search results.
34. The method of claim 1, wherein the search profile is derived from the set of documents responsive to a current query, and a set of documents responsive to at least one previous query.
35. The method of claim 1 further comprising, responsive to the user accessing the advertisement, selecting another advertisement in response to the search profile.
36. The method of claim 1 further comprising, responsive to the query being for a portal, using the user profile to select an advertisement.
37. A computer implemented method for providing personalized advertisements in an online search engine, the method comprising:
receiving a query from a user;
receiving a user profile of the user, the user profile containing user interest information;
selecting a set of documents responsive to the query and the user profile;
deriving a search profile from the set of documents;
selecting an advertisement in response to the search profile; and providing the selected advertisement and the set of documents to the user.
38. A computer implemented system that provides personalized advertisements in an online search engine, the system comprising:
a user profile database, containing a user profile of each of a plurality of users, each user profile containing user interest information;
a search engine, comprising a content database storing documents, and a search algorithm that receives a search query from a user and a user profile of the user from the user profile database, and selects from the content database a set of documents responsive to the query and to the user profile;
a content analysis module that derives a search profile from at least some of the selected set of documents;
an advertisement database that stores a plurality of advertisements; and an advertisement selection module, coupled to the content analysis module to receive the search profile and coupled to the advertisement database to select an advertisement in response to the search profile.
39. A system for providing personalized advertisements in an online search engine, the system comprising:
a user profile database, containing a user profile of each of a plurality of users, each user profile containing user interest information;
a search means for receiving a search query from a user and receiving a user profile of the user from the user profile database, and selecting a set of documents responsive to the query and to the user profile;
a content analysis means for deriving a search profile from at least some of the selected set of documents;
an advertisement database for storing a plurality of advertisements; and an advertisement selection means for selecting an advertisement from the advertisement database in response to the search profile.
40. A computer program product, stored on a computer accessible medium, for controlling a computer system to provide personalized advertisements in an online search engine by performing the method of:
receiving a query from a user;
receiving a user profile of the user, the user profile containing user interest information;
selecting a set of documents responsive to the query and the user profile;
deriving a search profile from the set of documents;
selecting an advertisement in response to the search profile; and providing the selected advertisement and the set of documents to the user.
41. A computer implemented method of ranking results of a search query, the metod comprising:
using a first set of algorithms to obtain and rank a first set of search results from a first search query on a first data set, and using a second set of algorithms to obtain and rank a second set of search results from a second search query on a second data set different from the first data set as a function of the ranking of the first set of results, wherein the first and second sets of algorithms are different from each other.
42. The method of claim 41, wherein using a second set of algorithms to obtain and rank a second set of search results from a second search query on a second data set different from the first data set as a function of the ranking of the first set of results comprises:
deriving a profile of the first set of search results; and using the profile to rank the second set of search results.
43. The method of claim 41, wherein the first set of algorithms comprises:
a first search query algorithm that searches a first content database to obtain the first set of search results; and a first ranking algorithm that ranks a first set of search results according to a profile.
44. The method of claim 41, wherein the second set of algorithms comprises:
a content analysis algorithm that analyzes the ranked first set of search results to produce a search profile; and a second search query algorithm that searches a second content database using the search profile to obtain the second set of search results and that ranks the second set of search results.
45. A computer implemented method of ranking results of a search query, the metod comprising:
searching a first content database using a first search query algorithm to obtain a first set of search results;
ranking the first set of search results;
determining a profile of the first search results;
searching a second content database using a second search query algorithm to obtain a second set of search results; and ranking the second set of search results using the profile.
CA002571867A 2004-06-24 2005-06-21 Results based personalization of advertisements in a search engine Abandoned CA2571867A1 (en)

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US10/877,775 2004-06-24
US10/877,775 US20050222989A1 (en) 2003-09-30 2004-06-24 Results based personalization of advertisements in a search engine
PCT/US2005/021943 WO2006012120A2 (en) 2004-06-24 2005-06-21 Results based personalization of advertisements in a search engine

Publications (1)

Publication Number Publication Date
CA2571867A1 true CA2571867A1 (en) 2006-02-02

Family

ID=35786635

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002571867A Abandoned CA2571867A1 (en) 2004-06-24 2005-06-21 Results based personalization of advertisements in a search engine

Country Status (6)

Country Link
US (1) US20050222989A1 (en)
EP (1) EP1766507A4 (en)
KR (1) KR20070039072A (en)
AU (1) AU2005267370A1 (en)
CA (1) CA2571867A1 (en)
WO (1) WO2006012120A2 (en)

Families Citing this family (365)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8813123B2 (en) 2000-01-19 2014-08-19 Interad Technologies, Llc Content with customized advertisement
US6434747B1 (en) 2000-01-19 2002-08-13 Individual Network, Inc. Method and system for providing a customized media list
US8590013B2 (en) 2002-02-25 2013-11-19 C. S. Lee Crawford Method of managing and communicating data pertaining to software applications for processor-based devices comprising wireless communication circuitry
US7212615B2 (en) * 2002-05-31 2007-05-01 Scott Wolmuth Criteria based marketing for telephone directory assistance
US7752072B2 (en) * 2002-07-16 2010-07-06 Google Inc. Method and system for providing advertising through content specific nodes over the internet
US8050970B2 (en) 2002-07-25 2011-11-01 Google Inc. Method and system for providing filtered and/or masked advertisements over the internet
US20040044571A1 (en) * 2002-08-27 2004-03-04 Bronnimann Eric Robert Method and system for providing advertising listing variance in distribution feeds over the internet to maximize revenue to the advertising distributor
US8311890B2 (en) 2002-11-01 2012-11-13 Google Inc. Method and system for dynamic textual ad distribution via email
DE602004010098T3 (en) 2003-05-06 2014-09-04 Apple Inc. METHOD FOR MODIFYING A MESSAGE STORAGE AND TRANSMISSION NETWORK SYSTEM AND DATA ANSWERING SYSTEM
US7333997B2 (en) * 2003-08-12 2008-02-19 Viziant Corporation Knowledge discovery method with utility functions and feedback loops
US20050278362A1 (en) * 2003-08-12 2005-12-15 Maren Alianna J Knowledge discovery system
DE10345065A1 (en) * 2003-09-26 2005-04-14 Boehringer Ingelheim Pharma Gmbh & Co. Kg Aerosol formulation for inhalation containing an anticholinergic
US20050096980A1 (en) * 2003-11-03 2005-05-05 Ross Koningstein System and method for delivering internet advertisements that change between textual and graphical ads on demand by a user
US7930206B2 (en) * 2003-11-03 2011-04-19 Google Inc. System and method for enabling an advertisement to follow the user to additional web pages
US20050144069A1 (en) * 2003-12-23 2005-06-30 Wiseman Leora R. Method and system for providing targeted graphical advertisements
US20050222900A1 (en) * 2004-03-30 2005-10-06 Prashant Fuloria Selectively delivering advertisements based at least in part on trademark issues
US7533090B2 (en) 2004-03-30 2009-05-12 Google Inc. System and method for rating electronic documents
US7697791B1 (en) * 2004-05-10 2010-04-13 Google Inc. Method and system for providing targeted documents based on concepts automatically identified therein
US20050267799A1 (en) * 2004-05-10 2005-12-01 Wesley Chan System and method for enabling publishers to select preferred types of electronic documents
US8065611B1 (en) 2004-06-30 2011-11-22 Google Inc. Method and system for mining image searches to associate images with concepts
US7639898B1 (en) 2004-05-10 2009-12-29 Google Inc. Method and system for approving documents based on image similarity
US7996753B1 (en) 2004-05-10 2011-08-09 Google Inc. Method and system for automatically creating an image advertisement
US7801738B2 (en) * 2004-05-10 2010-09-21 Google Inc. System and method for rating documents comprising an image
US11409812B1 (en) * 2004-05-10 2022-08-09 Google Llc Method and system for mining image searches to associate images with concepts
US7698626B2 (en) 2004-06-30 2010-04-13 Google Inc. Enhanced document browsing with automatically generated links to relevant information
US8620915B1 (en) 2007-03-13 2013-12-31 Google Inc. Systems and methods for promoting personalized search results based on personal information
US20060106849A1 (en) * 2004-08-19 2006-05-18 Copernic Technologies, Inc. Idle CPU indexing systems and methods
US8635216B1 (en) * 2004-09-30 2014-01-21 Avaya Inc. Enhancing network information retrieval according to a user search profile
US20060085392A1 (en) * 2004-09-30 2006-04-20 Microsoft Corporation System and method for automatic generation of search results based on local intention
US8386453B2 (en) * 2004-09-30 2013-02-26 Google Inc. Providing search information relating to a document
US20060123001A1 (en) * 2004-10-13 2006-06-08 Copernic Technologies, Inc. Systems and methods for selecting digital advertisements
US20060085431A1 (en) * 2004-10-13 2006-04-20 Burns David M Systems and methods for protecting private electronic data
US7904337B2 (en) 2004-10-19 2011-03-08 Steve Morsa Match engine marketing
US20060106760A1 (en) * 2004-10-29 2006-05-18 Netzer Moriya Method and apparatus of inter-document data retrieval
US7389282B2 (en) * 2004-11-02 2008-06-17 Viziant Corporation System and method for predictive analysis and predictive analysis markup language
EP1834473A4 (en) * 2004-11-29 2014-06-18 Jingle Networks Inc Telephone search supported by response location advertising
US8874570B1 (en) 2004-11-30 2014-10-28 Google Inc. Search boost vector based on co-visitation information
US20060116983A1 (en) * 2004-11-30 2006-06-01 International Business Machines Corporation System and method for ordering query results
US7440968B1 (en) * 2004-11-30 2008-10-21 Google Inc. Query boosting based on classification
US8762280B1 (en) 2004-12-02 2014-06-24 Google Inc. Method and system for using a network analysis system to verify content on a website
US8538970B1 (en) * 2004-12-30 2013-09-17 Google Inc. Personalizing search results
US20060149710A1 (en) 2004-12-30 2006-07-06 Ross Koningstein Associating features with entities, such as categories of web page documents, and/or weighting such features
EP1835455A1 (en) * 2005-01-05 2007-09-19 Musicstrands, S.A.U. System and method for recommending multimedia elements
US7542816B2 (en) * 2005-01-27 2009-06-02 Outland Research, Llc System, method and computer program product for automatically selecting, suggesting and playing music media files
US20070189544A1 (en) 2005-01-15 2007-08-16 Outland Research, Llc Ambient sound responsive media player
US20060161541A1 (en) * 2005-01-19 2006-07-20 Microsoft Corporation System and method for prefetching and caching query results
US7693887B2 (en) * 2005-02-01 2010-04-06 Strands, Inc. Dynamic identification of a new set of media items responsive to an input mediaset
WO2006084102A2 (en) 2005-02-03 2006-08-10 Musicstrands, Inc. Recommender system for identifying a new set of media items responsive to an input set of media items and knowledge base metrics
EP1844386A4 (en) * 2005-02-04 2009-11-25 Strands Inc System for browsing through a music catalog using correlation metrics of a knowledge base of mediasets
US7593925B2 (en) * 2005-02-25 2009-09-22 Microsoft Corporation Method and system for locating contact information collected from contact sources
US20060195472A1 (en) * 2005-02-25 2006-08-31 Microsoft Corporation Method and system for aggregating contact information from multiple contact sources
US7562104B2 (en) * 2005-02-25 2009-07-14 Microsoft Corporation Method and system for collecting contact information from contact sources and tracking contact sources
US7657520B2 (en) * 2005-03-03 2010-02-02 Google, Inc. Providing history and transaction volume information of a content source to users
US8087068B1 (en) 2005-03-08 2011-12-27 Google Inc. Verifying access to a network account over multiple user communication portals based on security criteria
US7757080B1 (en) 2005-03-11 2010-07-13 Google Inc. User validation using cookies and isolated backup validation
US20060212353A1 (en) * 2005-03-16 2006-09-21 Anton Roslov Targeted advertising system and method
US7620631B2 (en) * 2005-03-21 2009-11-17 Microsoft Corporation Pyramid view
US7421419B2 (en) * 2005-04-12 2008-09-02 Viziant Corporation System and method for evidence accumulation and hypothesis generation
US7917389B2 (en) 2005-04-15 2011-03-29 The Go Daddy Group, Inc. Relevant email ads for domain name advertiser
US7921035B2 (en) 2005-04-15 2011-04-05 The Go Daddy Group, Inc. Parked webpage domain name suggestions
US7890369B2 (en) 2005-04-15 2011-02-15 The Go Daddy Group, Inc. Relevant online ads for domain name advertiser
US7599916B2 (en) * 2005-04-20 2009-10-06 Microsoft Corporation System and method for personalized search
US7466244B2 (en) 2005-04-21 2008-12-16 Microsoft Corporation Virtual earth rooftop overlay and bounding
US7777648B2 (en) 2005-04-21 2010-08-17 Microsoft Corporation Mode information displayed in a mapping application
US8103445B2 (en) 2005-04-21 2012-01-24 Microsoft Corporation Dynamic map rendering as a function of a user parameter
US20070210937A1 (en) * 2005-04-21 2007-09-13 Microsoft Corporation Dynamic rendering of map information
US8843309B2 (en) 2005-04-21 2014-09-23 Microsoft Corporation Virtual earth mapping
US7840570B2 (en) * 2005-04-22 2010-11-23 Strands, Inc. System and method for acquiring and adding data on the playing of elements or multimedia files
US7734631B2 (en) * 2005-04-25 2010-06-08 Microsoft Corporation Associating information with an electronic document
US20060265283A1 (en) * 2005-05-20 2006-11-23 Anchorfree, Inc. System and method for monetizing internet usage
US7744256B2 (en) * 2006-05-22 2010-06-29 Edison Price Lighting, Inc. LED array wafer lighting fixture
US20060265501A1 (en) 2005-05-20 2006-11-23 Anchorfree Wireless System and method for enabling wireless internet access in public areas
US9626683B2 (en) * 2005-05-20 2017-04-18 Anchorfree, Inc. Method and system for advanced messaging
US20070011050A1 (en) * 2005-05-20 2007-01-11 Steven Klopf Digital advertising system
US20070078718A1 (en) * 2005-05-20 2007-04-05 Anchorfree, Inc. System and method for monetizing internet usage
US7747619B2 (en) * 2005-11-30 2010-06-29 Anchorfree, Inc. Computerized system and method for advanced advertising
US20070162342A1 (en) * 2005-05-20 2007-07-12 Steven Klopf Digital advertising system
US7647305B2 (en) * 2005-11-30 2010-01-12 Anchorfree, Inc. Method and apparatus for implementing search engine with cost per action revenue model
US20060293962A1 (en) * 2005-05-20 2006-12-28 Anchorfree, Inc. Computerized networking device with embedded advanced content and web traffic monetization functionality
AU2006251563A1 (en) * 2005-05-24 2006-11-30 Paxfire, Inc. Enhanced features for direction of communication traffic
US7962462B1 (en) 2005-05-31 2011-06-14 Google Inc. Deriving and using document and site quality signals from search query streams
US8103659B1 (en) * 2005-06-06 2012-01-24 A9.Com, Inc. Perspective-based item navigation
US7725502B1 (en) 2005-06-15 2010-05-25 Google Inc. Time-multiplexing documents based on preferences or relatedness
US7903099B2 (en) * 2005-06-20 2011-03-08 Google Inc. Allocating advertising space in a network of displays
US20080010125A1 (en) * 2006-06-27 2008-01-10 Rocky Wright System and Method For Enabling Bi-Directional Communication Between Providers And Consumers of Information In Multi-Level Markets Using A Computer Network
US20090265245A1 (en) * 2005-06-27 2009-10-22 Wright Rocky J Communications platform for enabling bi-directional communication between providers consumers and advertisers using a computer network and/or mobile devices using desktop and or mobiletop interactive windowless video
CA2614440C (en) 2005-07-07 2016-06-21 Sermo, Inc. Method and apparatus for conducting an information brokering service
US20070038516A1 (en) * 2005-08-13 2007-02-15 Jeff Apple Systems, methods, and computer program products for enabling an advertiser to measure user viewing of and response to an advertisement
WO2007027967A2 (en) * 2005-08-31 2007-03-08 Eagleforce Associates System for hypothesis generation
US20070050389A1 (en) * 2005-09-01 2007-03-01 Opinmind, Inc. Advertisement placement based on expressions about topics
US9703892B2 (en) 2005-09-14 2017-07-11 Millennial Media Llc Predictive text completion for a mobile communication facility
US8832100B2 (en) 2005-09-14 2014-09-09 Millennial Media, Inc. User transaction history influenced search results
US9058406B2 (en) 2005-09-14 2015-06-16 Millennial Media, Inc. Management of multiple advertising inventories using a monetization platform
US8364540B2 (en) 2005-09-14 2013-01-29 Jumptap, Inc. Contextual targeting of content using a monetization platform
US8103545B2 (en) 2005-09-14 2012-01-24 Jumptap, Inc. Managing payment for sponsored content presented to mobile communication facilities
US8805339B2 (en) 2005-09-14 2014-08-12 Millennial Media, Inc. Categorization of a mobile user profile based on browse and viewing behavior
US8290810B2 (en) 2005-09-14 2012-10-16 Jumptap, Inc. Realtime surveying within mobile sponsored content
US8989718B2 (en) 2005-09-14 2015-03-24 Millennial Media, Inc. Idle screen advertising
US8131271B2 (en) 2005-11-05 2012-03-06 Jumptap, Inc. Categorization of a mobile user profile based on browse behavior
US8503995B2 (en) 2005-09-14 2013-08-06 Jumptap, Inc. Mobile dynamic advertisement creation and placement
US8532633B2 (en) 2005-09-14 2013-09-10 Jumptap, Inc. System for targeting advertising content to a plurality of mobile communication facilities
US10592930B2 (en) 2005-09-14 2020-03-17 Millenial Media, LLC Syndication of a behavioral profile using a monetization platform
US7912458B2 (en) 2005-09-14 2011-03-22 Jumptap, Inc. Interaction analysis and prioritization of mobile content
US8195133B2 (en) 2005-09-14 2012-06-05 Jumptap, Inc. Mobile dynamic advertisement creation and placement
US7577665B2 (en) 2005-09-14 2009-08-18 Jumptap, Inc. User characteristic influenced search results
US8302030B2 (en) 2005-09-14 2012-10-30 Jumptap, Inc. Management of multiple advertising inventories using a monetization platform
US8666376B2 (en) 2005-09-14 2014-03-04 Millennial Media Location based mobile shopping affinity program
US8209344B2 (en) 2005-09-14 2012-06-26 Jumptap, Inc. Embedding sponsored content in mobile applications
US7860871B2 (en) 2005-09-14 2010-12-28 Jumptap, Inc. User history influenced search results
US8027879B2 (en) 2005-11-05 2011-09-27 Jumptap, Inc. Exclusivity bidding for mobile sponsored content
US7752209B2 (en) 2005-09-14 2010-07-06 Jumptap, Inc. Presenting sponsored content on a mobile communication facility
US20110313853A1 (en) 2005-09-14 2011-12-22 Jorey Ramer System for targeting advertising content to a plurality of mobile communication facilities
US10038756B2 (en) 2005-09-14 2018-07-31 Millenial Media LLC Managing sponsored content based on device characteristics
US8688671B2 (en) 2005-09-14 2014-04-01 Millennial Media Managing sponsored content based on geographic region
US9076175B2 (en) 2005-09-14 2015-07-07 Millennial Media, Inc. Mobile comparison shopping
US10911894B2 (en) 2005-09-14 2021-02-02 Verizon Media Inc. Use of dynamic content generation parameters based on previous performance of those parameters
US7660581B2 (en) 2005-09-14 2010-02-09 Jumptap, Inc. Managing sponsored content based on usage history
US8229914B2 (en) 2005-09-14 2012-07-24 Jumptap, Inc. Mobile content spidering and compatibility determination
US7769764B2 (en) * 2005-09-14 2010-08-03 Jumptap, Inc. Mobile advertisement syndication
US9201979B2 (en) 2005-09-14 2015-12-01 Millennial Media, Inc. Syndication of a behavioral profile associated with an availability condition using a monetization platform
US9471925B2 (en) 2005-09-14 2016-10-18 Millennial Media Llc Increasing mobile interactivity
US8311888B2 (en) 2005-09-14 2012-11-13 Jumptap, Inc. Revenue models associated with syndication of a behavioral profile using a monetization platform
US8238888B2 (en) 2006-09-13 2012-08-07 Jumptap, Inc. Methods and systems for mobile coupon placement
US7676394B2 (en) 2005-09-14 2010-03-09 Jumptap, Inc. Dynamic bidding and expected value
US8156128B2 (en) 2005-09-14 2012-04-10 Jumptap, Inc. Contextual mobile content placement on a mobile communication facility
US8660891B2 (en) 2005-11-01 2014-02-25 Millennial Media Interactive mobile advertisement banners
US8615719B2 (en) 2005-09-14 2013-12-24 Jumptap, Inc. Managing sponsored content for delivery to mobile communication facilities
US7702318B2 (en) 2005-09-14 2010-04-20 Jumptap, Inc. Presentation of sponsored content based on mobile transaction event
US8812526B2 (en) 2005-09-14 2014-08-19 Millennial Media, Inc. Mobile content cross-inventory yield optimization
US8364521B2 (en) 2005-09-14 2013-01-29 Jumptap, Inc. Rendering targeted advertisement on mobile communication facilities
US8819659B2 (en) 2005-09-14 2014-08-26 Millennial Media, Inc. Mobile search service instant activation
US20070073641A1 (en) * 2005-09-23 2007-03-29 Redcarpet, Inc. Method and system for improving search results
US8176101B2 (en) 2006-02-07 2012-05-08 Google Inc. Collaborative rejection of media for physical establishments
US8688673B2 (en) * 2005-09-27 2014-04-01 Sarkar Pte Ltd System for communication and collaboration
US20070073696A1 (en) * 2005-09-28 2007-03-29 Google, Inc. Online data verification of listing data
US7877387B2 (en) * 2005-09-30 2011-01-25 Strands, Inc. Systems and methods for promotional media item selection and promotional program unit generation
US7761423B1 (en) * 2005-10-11 2010-07-20 OneSpot, Inc. System and method for indexing a network of interrelated elements
US20070100915A1 (en) * 2005-10-31 2007-05-03 Rose Daniel E Methods for displaying dynamic suggestions in a user interface
US7693912B2 (en) * 2005-10-31 2010-04-06 Yahoo! Inc. Methods for navigating collections of information in varying levels of detail
US20070100883A1 (en) * 2005-10-31 2007-05-03 Rose Daniel E Methods for providing audio feedback during the navigation of collections of information
US20070100800A1 (en) * 2005-10-31 2007-05-03 Rose Daniel E Methods for visually enhancing the navigation of collections of information
US20070112749A1 (en) * 2005-11-04 2007-05-17 Minfo, Inc. Query methods and apparatuses including user profile with domain views
US8175585B2 (en) 2005-11-05 2012-05-08 Jumptap, Inc. System for targeting advertising content to a plurality of mobile communication facilities
US8571999B2 (en) 2005-11-14 2013-10-29 C. S. Lee Crawford Method of conducting operations for a social network application including activity list generation
US7603619B2 (en) * 2005-11-29 2009-10-13 Google Inc. Formatting a user network site based on user preferences and format performance data
US9202241B2 (en) * 2005-11-30 2015-12-01 John Nicholas and Kristin Gross System and method of delivering content based advertising
US7856445B2 (en) * 2005-11-30 2010-12-21 John Nicholas and Kristin Gross System and method of delivering RSS content based advertising
US8924558B2 (en) 2005-11-30 2014-12-30 John Nicholas and Kristin Gross System and method of delivering content based advertising
US8417569B2 (en) 2005-11-30 2013-04-09 John Nicholas and Kristin Gross Trust System and method of evaluating content based advertising
US8903810B2 (en) * 2005-12-05 2014-12-02 Collarity, Inc. Techniques for ranking search results
US8429184B2 (en) * 2005-12-05 2013-04-23 Collarity Inc. Generation of refinement terms for search queries
US7725530B2 (en) * 2005-12-12 2010-05-25 Google Inc. Proxy server collection of data for module incorporation into a container document
US7730082B2 (en) 2005-12-12 2010-06-01 Google Inc. Remote module incorporation into a container document
US20070204010A1 (en) * 2005-12-12 2007-08-30 Steven Goldberg Remote Module Syndication System and Method
US7730109B2 (en) * 2005-12-12 2010-06-01 Google, Inc. Message catalogs for remote modules
US8185819B2 (en) 2005-12-12 2012-05-22 Google Inc. Module specification for a module to be incorporated into a container document
US7971137B2 (en) * 2005-12-14 2011-06-28 Google Inc. Detecting and rejecting annoying documents
US20070143181A1 (en) * 2005-12-16 2007-06-21 Josh Linkner Fully automated interactive promotion tool including wizard-driven web interface
BRPI0620084B1 (en) * 2005-12-19 2018-11-21 Apple Inc method for identifying individual users in a defined user community, based on comparing the first user's profile with other user profiles, for a first community member, and method for measuring individual user similarity for a first user in a defined user community. users
US20070162546A1 (en) * 2005-12-22 2007-07-12 Musicstrands, Inc. Sharing tags among individual user media libraries
US7925649B2 (en) * 2005-12-30 2011-04-12 Google Inc. Method, system, and graphical user interface for alerting a computer user to new results for a prior search
US20070244880A1 (en) 2006-02-03 2007-10-18 Francisco Martin Mediaset generation system
JP5075132B2 (en) 2006-02-10 2012-11-14 アップル インコーポレイテッド System and method for prioritizing mobile media player files
WO2007092053A1 (en) 2006-02-10 2007-08-16 Strands, Inc. Dynamic interactive entertainment
US8386469B2 (en) * 2006-02-16 2013-02-26 Mobile Content Networks, Inc. Method and system for determining relevant sources, querying and merging results from multiple content sources
US20070208733A1 (en) * 2006-02-22 2007-09-06 Copernic Technologies, Inc. Query Correction Using Indexed Content on a Desktop Indexer Program
CN100421113C (en) * 2006-03-03 2008-09-24 中国移动通信集团公司 Searching system and method based on personalized information
WO2007103923A2 (en) 2006-03-06 2007-09-13 La La Media, Inc Article trading process
US7835998B2 (en) * 2006-03-06 2010-11-16 Veveo, Inc. Methods and systems for selecting and presenting content on a first system based on user preferences learned on a second system
US20070220010A1 (en) * 2006-03-15 2007-09-20 Kent Thomas Ertugrul Targeted content delivery for networks
US8122049B2 (en) * 2006-03-20 2012-02-21 Microsoft Corporation Advertising service based on content and user log mining
US20070239533A1 (en) * 2006-03-31 2007-10-11 Susan Wojcicki Allocating and monetizing advertising space in offline media through online usage and pricing model
US7747686B2 (en) * 2006-03-31 2010-06-29 Yahoo! Inc. System and method for interacting with data using visual surrogates
US20070233734A1 (en) * 2006-04-03 2007-10-04 Sony Ericsson Mobile Communications Ab Enhanced use of map and map metadata
KR100754768B1 (en) * 2006-04-06 2007-09-03 엔에이치엔(주) System and method for providing recommended word of adjustment each user and computer readable recording medium recording program for implementing the method
US20070250855A1 (en) * 2006-04-10 2007-10-25 Graphwise, Llc Search engine for presenting to a user a display having both graphed search results and selected advertisements
US20070255687A1 (en) * 2006-04-27 2007-11-01 Al-Yousuf Ahmed K Research report search system
US8326890B2 (en) * 2006-04-28 2012-12-04 Choicebot, Inc. System and method for assisting computer users to search for and evaluate products and services, typically in a database
US8745226B2 (en) * 2006-05-02 2014-06-03 Google Inc. Customization of content and advertisements in publications
CN100530183C (en) * 2006-05-19 2009-08-19 华为技术有限公司 System and method for collecting watch database
US7822745B2 (en) * 2006-05-31 2010-10-26 Yahoo! Inc. Keyword set and target audience profile generalization techniques
US7631263B2 (en) * 2006-06-02 2009-12-08 Scenera Technologies, Llc Methods, systems, and computer program products for characterizing links to resources not activated
US7761464B2 (en) * 2006-06-19 2010-07-20 Microsoft Corporation Diversifying search results for improved search and personalization
US8023927B1 (en) 2006-06-29 2011-09-20 Google Inc. Abuse-resistant method of registering user accounts with an online service
WO2008005305A2 (en) 2006-06-29 2008-01-10 Cie Studios Press release distribution system
US20100057559A1 (en) * 2006-06-30 2010-03-04 Saar Wilf method of choosing advertisements to be shown to a search engine user
WO2008012834A2 (en) * 2006-07-25 2008-01-31 Jain Pankaj A method and a system for searching information using information device
US7685199B2 (en) * 2006-07-31 2010-03-23 Microsoft Corporation Presenting information related to topics extracted from event classes
US8407250B2 (en) 2006-08-07 2013-03-26 Google Inc. Distribution of content document to varying users with security customization and scalability
US8185830B2 (en) 2006-08-07 2012-05-22 Google Inc. Configuring a content document for users and user groups
US8954861B1 (en) 2006-08-07 2015-02-10 Google Inc. Administrator configurable gadget directory for personalized start pages
US20080040324A1 (en) * 2006-08-11 2008-02-14 Clenova, Llc Search result-based advertisements
US7752195B1 (en) * 2006-08-18 2010-07-06 A9.Com, Inc. Universal query search results
US7831472B2 (en) * 2006-08-22 2010-11-09 Yufik Yan M Methods and system for search engine revenue maximization in internet advertising
WO2008023994A1 (en) * 2006-08-25 2008-02-28 Search Capital Ltd Method of targeting messages
US7739231B2 (en) * 2006-08-28 2010-06-15 Manyworlds, Inc. Mutual commit people matching process
WO2008030510A2 (en) * 2006-09-06 2008-03-13 Nexplore Corporation System and method for weighted search and advertisement placement
US20080065602A1 (en) * 2006-09-12 2008-03-13 Brian John Cragun Selecting advertisements for search results
US9009133B2 (en) * 2006-10-02 2015-04-14 Leidos, Inc. Methods and systems for formulating and executing concept-structured queries of unorganized data
US9852430B2 (en) * 2006-10-03 2017-12-26 Microsoft Technology Licensing, Llc Dynamic generation of advertisement text
US8442972B2 (en) * 2006-10-11 2013-05-14 Collarity, Inc. Negative associations for search results ranking and refinement
US7844591B1 (en) * 2006-10-12 2010-11-30 Adobe Systems Incorporated Method for displaying an image with search results
US20080109285A1 (en) * 2006-10-26 2008-05-08 Mobile Content Networks, Inc. Techniques for determining relevant advertisements in response to queries
US11392595B2 (en) 2006-10-26 2022-07-19 EMB Partners, LLC Techniques for determining relevant electronic content in response to queries
US7680786B2 (en) * 2006-10-30 2010-03-16 Yahoo! Inc. Optimization of targeted advertisements based on user profile information
KR100829499B1 (en) 2006-11-08 2008-05-19 엔에이치엔(주) Method for calculating weight of advertising keyword and system thereof
US8086600B2 (en) * 2006-12-07 2011-12-27 Google Inc. Interleaving search results
US20090234814A1 (en) * 2006-12-12 2009-09-17 Marco Boerries Configuring a search engine results page with environment-specific information
US8140566B2 (en) * 2006-12-12 2012-03-20 Yahoo! Inc. Open framework for integrating, associating, and interacting with content objects including automatic feed creation
US9477969B2 (en) 2006-12-12 2016-10-25 Yahoo! Inc. Automatic feed creation for non-feed enabled information objects
US20090240564A1 (en) * 2006-12-12 2009-09-24 Marco Boerries Open framework for integrating, associating, and interacting with content objects including advertisement and content personalization
EP2126715A4 (en) * 2006-12-22 2011-11-02 Phorm Uk Inc Systems and methods for channeling client network activity
US20080222283A1 (en) * 2007-03-08 2008-09-11 Phorm Uk, Inc. Behavioral Networking Systems And Methods For Facilitating Delivery Of Targeted Content
US8631005B2 (en) * 2006-12-28 2014-01-14 Ebay Inc. Header-token driven automatic text segmentation
US7640236B1 (en) * 2007-01-17 2009-12-29 Sun Microsystems, Inc. Method and system for automatic distributed tuning of search engine parameters
US7657514B2 (en) * 2007-01-30 2010-02-02 Google Inc. Content identification expansion
US20080183691A1 (en) * 2007-01-30 2008-07-31 International Business Machines Corporation Method for a networked knowledge based document retrieval and ranking utilizing extracted document metadata and content
US8583592B2 (en) * 2007-03-30 2013-11-12 Innography, Inc. System and methods of searching data sources
US9977827B2 (en) * 2007-03-30 2018-05-22 Innography, Inc. System and methods of automatic query generation
US8671000B2 (en) 2007-04-24 2014-03-11 Apple Inc. Method and arrangement for providing content to multimedia devices
EP2156316A4 (en) * 2007-05-07 2013-03-06 Fourthwall Media Inc Providing personalized resources on-demand over a broadband network to consumer device applications
US7734641B2 (en) 2007-05-25 2010-06-08 Peerset, Inc. Recommendation systems and methods using interest correlation
US20080294624A1 (en) * 2007-05-25 2008-11-27 Ontogenix, Inc. Recommendation systems and methods using interest correlation
US20080306931A1 (en) * 2007-06-06 2008-12-11 Chad Brower Event Weighting Method and System
US8150868B2 (en) * 2007-06-11 2012-04-03 Microsoft Corporation Using joint communication and search data
US20090024546A1 (en) * 2007-06-23 2009-01-22 Motivepath, Inc. System, method and apparatus for predictive modeling of spatially distributed data for location based commercial services
US8380563B2 (en) * 2007-06-28 2013-02-19 Google Inc. Using previous user search query to target advertisements
US20090013051A1 (en) 2007-07-07 2009-01-08 Qualcomm Incorporated Method for transfer of information related to targeted content messages through a proxy server
US20090048977A1 (en) * 2007-07-07 2009-02-19 Qualcomm Incorporated User profile generation architecture for targeted content distribution using external processes
US9392074B2 (en) 2007-07-07 2016-07-12 Qualcomm Incorporated User profile generation architecture for mobile content-message targeting
US7920849B2 (en) * 2007-07-13 2011-04-05 Pop Adrian Method and system for providing advertisements/messages based on wireless data communication technology
US8073803B2 (en) * 2007-07-16 2011-12-06 Yahoo! Inc. Method for matching electronic advertisements to surrounding context based on their advertisement content
KR100954624B1 (en) * 2007-08-10 2010-04-28 야후! 인크. Method and system for providing content according to personal preference
KR101395518B1 (en) * 2007-09-03 2014-05-14 엘지전자 주식회사 Information search system
US20090070310A1 (en) * 2007-09-07 2009-03-12 Microsoft Corporation Online advertising relevance verification
CN101388013A (en) * 2007-09-12 2009-03-18 日电(中国)有限公司 Method and system for clustering network files
US20090077163A1 (en) * 2007-09-14 2009-03-19 Phorm Uk, Inc. Approach for identifying and providing targeted content to a network client with reduced impact to the service provider
US20080033822A1 (en) * 2007-10-03 2008-02-07 The Go Daddy Group, Inc. Systems and methods for filtering online advertisements containing third-party trademarks
US7933228B2 (en) * 2007-10-09 2011-04-26 Keep In Touch Services, Inc. Time sensitive scheduling data delivery network
US20090100051A1 (en) * 2007-10-10 2009-04-16 Yahoo! Inc. Differentiated treatment of sponsored search results based on search context
WO2009054928A2 (en) * 2007-10-19 2009-04-30 Keep In Touch Systems, Inc. System and method for time sensitive scheduling data privacy protection
US20090106076A1 (en) * 2007-10-19 2009-04-23 Keep In Touch Systemstm, Inc. System and method for a time sensitive scheduling data promotions network
CN101159967B (en) * 2007-10-29 2011-08-31 中国移动通信集团设计院有限公司 Method and device for using drive test data for propagation model revision
US20090125499A1 (en) * 2007-11-09 2009-05-14 Microsoft Corporation Machine-moderated mobile social networking for managing queries
US9705998B2 (en) * 2007-11-14 2017-07-11 Qualcomm Incorporated Method and system using keyword vectors and associated metrics for learning and prediction of user correlation of targeted content messages in a mobile environment
US10083420B2 (en) * 2007-11-21 2018-09-25 Sermo, Inc Community moderated information
US20090177530A1 (en) 2007-12-14 2009-07-09 Qualcomm Incorporated Near field communication transactions in a mobile environment
WO2009085115A2 (en) * 2007-12-21 2009-07-09 Keep In Touch Systems, Inc. System and method for reception time zone presentation of time sensitive scheduling data
US20090164293A1 (en) * 2007-12-21 2009-06-25 Keep In Touch Systemstm, Inc. System and method for time sensitive scheduling data grid flow management
KR100903499B1 (en) * 2007-12-27 2009-06-18 엔에이치엔비즈니스플랫폼 주식회사 Method for offering advertisement according to search intention segmentation and system for executing the method
US7984019B2 (en) * 2007-12-28 2011-07-19 Knowledge Computing Corporation Method and apparatus for loading data files into a data-warehouse system
US20090216639A1 (en) * 2008-02-25 2009-08-27 Mark Joseph Kapczynski Advertising selection and display based on electronic profile information
US20090216563A1 (en) * 2008-02-25 2009-08-27 Michael Sandoval Electronic profile development, storage, use and systems for taking action based thereon
US7711622B2 (en) * 2008-03-05 2010-05-04 Stephen M Marceau Financial statement and transaction image delivery and access system
US8762364B2 (en) * 2008-03-18 2014-06-24 Yahoo! Inc. Personalizing sponsored search advertising layout using user behavior history
US20090241065A1 (en) * 2008-03-18 2009-09-24 Cuill, Inc. Apparatus and method for displaying search results with various forms of advertising
US7962438B2 (en) * 2008-03-26 2011-06-14 The Go Daddy Group, Inc. Suggesting concept-based domain names
US20090248736A1 (en) * 2008-03-26 2009-10-01 The Go Daddy Group, Inc. Displaying concept-based targeted advertising
US8069187B2 (en) * 2008-03-26 2011-11-29 The Go Daddy Group, Inc. Suggesting concept-based top-level domain names
US7904445B2 (en) * 2008-03-26 2011-03-08 The Go Daddy Group, Inc. Displaying concept-based search results
US8029359B2 (en) * 2008-03-27 2011-10-04 World Golf Tour, Inc. Providing offers to computer game players
CN101981570A (en) * 2008-04-01 2011-02-23 雅虎公司 Open framework for integrating, associating and interacting with content objects
US9092454B2 (en) * 2008-04-22 2015-07-28 Microsoft Technology Licensing, Llc Discovering co-located queries in geographic search logs
US20090299945A1 (en) * 2008-06-03 2009-12-03 Strands, Inc. Profile modeling for sharing individual user preferences
US8285717B2 (en) * 2008-06-25 2012-10-09 Microsoft Corporation Storage of advertisements in a personal account at an online service
US8438178B2 (en) * 2008-06-26 2013-05-07 Collarity Inc. Interactions among online digital identities
US9268843B2 (en) * 2008-06-27 2016-02-23 Cbs Interactive Inc. Personalization engine for building a user profile
US8214346B2 (en) * 2008-06-27 2012-07-03 Cbs Interactive Inc. Personalization engine for classifying unstructured documents
US8346749B2 (en) * 2008-06-27 2013-01-01 Microsoft Corporation Balancing the costs of sharing private data with the utility of enhanced personalization of online services
KR101006181B1 (en) * 2008-06-28 2011-01-07 조광현 Personalized advertising system and method based on semantic technology
US20100010982A1 (en) * 2008-07-09 2010-01-14 Broder Andrei Z Web content characterization based on semantic folksonomies associated with user generated content
US20100023399A1 (en) * 2008-07-22 2010-01-28 Saurabh Sahni Personalized Advertising Using Lifestreaming Data
US8037050B2 (en) * 2008-08-02 2011-10-11 Knowledge Computing Corporation Methods and apparatus for performing multi-data-source, non-ETL queries and entity resolution
US8489582B2 (en) * 2008-08-06 2013-07-16 Yahoo! Inc. Interconnected, universal search experience across multiple verticals
US8751559B2 (en) * 2008-09-16 2014-06-10 Microsoft Corporation Balanced routing of questions to experts
US20100235231A1 (en) * 2009-01-30 2010-09-16 Cbs Interactive, Inc. Lead acquisition, promotion and inventory management system and method
US9195739B2 (en) * 2009-02-20 2015-11-24 Microsoft Technology Licensing, Llc Identifying a discussion topic based on user interest information
US20100223278A1 (en) * 2009-02-27 2010-09-02 The Go Daddy Group, Inc. Generating online advertisments based upon available dynamic content relevant domain names
US20100223144A1 (en) * 2009-02-27 2010-09-02 The Go Daddy Group, Inc. Systems for generating online advertisements offering dynamic content relevant domain names for registration
US8352319B2 (en) * 2009-03-10 2013-01-08 Google Inc. Generating user profiles
US8185544B2 (en) * 2009-04-08 2012-05-22 Google Inc. Generating improved document classification data using historical search results
US8145623B1 (en) * 2009-05-01 2012-03-27 Google Inc. Query ranking based on query clustering and categorization
CA2764496C (en) 2009-06-05 2018-02-27 Wenhui Liao Feature engineering and user behavior analysis
US20100318425A1 (en) * 2009-06-12 2010-12-16 Meherzad Ratan Karanjia System and method for providing a personalized shopping assistant for online computer users
US20100325253A1 (en) * 2009-06-18 2010-12-23 The Go Daddy Group, Inc. Generating and registering screen name-based domain names
US20110153425A1 (en) * 2009-06-21 2011-06-23 James Mercs Knowledge based search engine
US20110040753A1 (en) * 2009-08-11 2011-02-17 Steve Knight Personalized search engine
US20110060738A1 (en) 2009-09-08 2011-03-10 Apple Inc. Media item clustering based on similarity data
US8312364B2 (en) 2009-09-17 2012-11-13 Go Daddy Operating Company, LLC Social website domain registration announcement and search engine feed
US8276057B2 (en) 2009-09-17 2012-09-25 Go Daddy Operating Company, LLC Announcing a domain name registration on a social website
US8615442B1 (en) 2009-12-15 2013-12-24 Project Rover, Inc. Personalized content delivery system
US8392829B2 (en) * 2009-12-31 2013-03-05 Juniper Networks, Inc. Modular documentation using a playlist model
US8875038B2 (en) * 2010-01-19 2014-10-28 Collarity, Inc. Anchoring for content synchronization
US20110178856A1 (en) * 2010-01-20 2011-07-21 Haven Lorenzini Micaelian and Marcantonio Parisi System and method for sharing with registered users revenue generated by advertisements displayed with content
US20110178868A1 (en) * 2010-01-21 2011-07-21 Priyank Shanker Garg Enhancing search result pages using content licensed from content providers
US9152696B2 (en) * 2010-03-12 2015-10-06 Nec Corporation Linkage information output apparatus, linkage information output method and computer-readable recording medium
US9858593B2 (en) 2010-04-09 2018-01-02 Go Daddy Operating Company, LLC URL shortening based online advertising
CN102971738A (en) 2010-05-06 2013-03-13 水宙责任有限公司 Systems, methods, and computer readable media for security in profile utilizing systems
US20110282964A1 (en) * 2010-05-13 2011-11-17 Qualcomm Incorporated Delivery of targeted content related to a learned and predicted future behavior based on spatial, temporal, and user attributes and behavioral constraints
US8666802B2 (en) 2010-05-20 2014-03-04 Google Inc. Classifying locations for ad presentation
US8560365B2 (en) 2010-06-08 2013-10-15 International Business Machines Corporation Probabilistic optimization of resource discovery, reservation and assignment
US8326861B1 (en) * 2010-06-23 2012-12-04 Google Inc. Personalized term importance evaluation in queries
US8489641B1 (en) 2010-07-08 2013-07-16 Google Inc. Displaying layers of search results on a map
US9646271B2 (en) 2010-08-06 2017-05-09 International Business Machines Corporation Generating candidate inclusion/exclusion cohorts for a multiply constrained group
US8370350B2 (en) 2010-09-03 2013-02-05 International Business Machines Corporation User accessibility to resources enabled through adaptive technology
US8968197B2 (en) 2010-09-03 2015-03-03 International Business Machines Corporation Directing a user to a medical resource
US9292577B2 (en) * 2010-09-17 2016-03-22 International Business Machines Corporation User accessibility to data analytics
US9443211B2 (en) 2010-10-13 2016-09-13 International Business Machines Corporation Describing a paradigmatic member of a task directed community in a complex heterogeneous environment based on non-linear attributes
US8429182B2 (en) 2010-10-13 2013-04-23 International Business Machines Corporation Populating a task directed community in a complex heterogeneous environment based on non-linear attributes of a paradigmatic cohort member
US10282744B2 (en) * 2010-10-29 2019-05-07 Excalibur Ip, Llc Consumer group buying through online ads
US20120197732A1 (en) * 2011-01-31 2012-08-02 Microsoft Corporation Action-aware intent-based behavior targeting
US20120209698A1 (en) * 2011-02-11 2012-08-16 Yahoo! Inc. Hybrid search results listings
US9519717B2 (en) * 2011-03-02 2016-12-13 Microsoft Technology Licensing, Llc Content customization with security for client preferences
CN102737027B (en) * 2011-04-01 2016-08-31 深圳市世纪光速信息技术有限公司 Individuation search method and system
US11841912B2 (en) 2011-05-01 2023-12-12 Twittle Search Limited Liability Company System for applying natural language processing and inputs of a group of users to infer commonly desired search results
US8326862B2 (en) * 2011-05-01 2012-12-04 Alan Mark Reznik Systems and methods for facilitating enhancements to search engine results
US8983905B2 (en) 2011-10-03 2015-03-17 Apple Inc. Merging playlists from multiple sources
US20130246595A1 (en) 2011-10-18 2013-09-19 Hugh O'Donoghue Method and apparatus for using an organizational structure for generating, using, or updating an enriched user profile
US8869208B2 (en) * 2011-10-30 2014-10-21 Google Inc. Computing similarity between media programs
US9292504B2 (en) * 2011-12-15 2016-03-22 Verizon Patent And Licensing Inc. Context generation from active viewing region for context sensitive searching
US10616782B2 (en) 2012-03-29 2020-04-07 Mgage, Llc Cross-channel user tracking systems, methods and devices
US8849799B1 (en) 2012-05-09 2014-09-30 Google Inc. Content selection using boolean query expressions
US9245428B2 (en) 2012-08-02 2016-01-26 Immersion Corporation Systems and methods for haptic remote control gaming
US8849804B1 (en) * 2012-08-10 2014-09-30 Google Inc. Distributing interest categories within a hierarchical classification
GB2504935A (en) * 2012-08-13 2014-02-19 Ibm Associating ancillary information with an application user interface
US20140109137A1 (en) * 2012-10-11 2014-04-17 Faisal Mushtaq Method and apparatus for user interaction with programs utilizing closed captioning data content
US10650063B1 (en) 2012-11-27 2020-05-12 Robert D. Fish Systems and methods for making correlations
US9398104B2 (en) * 2012-12-20 2016-07-19 Facebook, Inc. Ranking test framework for search results on an online social network
US10229415B2 (en) 2013-03-05 2019-03-12 Google Llc Computing devices and methods for identifying geographic areas that satisfy a set of multiple different criteria
US8935272B2 (en) 2013-03-17 2015-01-13 Alation, Inc. Curated answers community automatically populated through user query monitoring
US20150046419A1 (en) * 2013-08-12 2015-02-12 Vidmind Ltd. Method of sorting search results by recommendation engine
US9886523B2 (en) * 2013-09-16 2018-02-06 Delonaco Limited Intelligent search and service customization
EP3055790B1 (en) * 2013-10-08 2018-07-25 Spotify AB System, method, and computer program product for providing contextually-aware video recommendation
US9754036B1 (en) * 2013-12-23 2017-09-05 Google Inc. Adapting third party applications
US9818065B2 (en) 2014-03-12 2017-11-14 Microsoft Technology Licensing, Llc Attribution of activity in multi-user settings
US10699299B1 (en) 2014-04-22 2020-06-30 Groupon, Inc. Generating optimized in-channel and cross-channel promotion recommendations using free shipping qualifier
US11488205B1 (en) * 2014-04-22 2022-11-01 Groupon, Inc. Generating in-channel and cross-channel promotion recommendations using promotion cross-sell
US9319522B1 (en) * 2014-04-28 2016-04-19 West Corporation Applying user preferences, behavioral patterns and/or environmental factors to an automated customer support application
CN105095231A (en) * 2014-04-29 2015-11-25 阿里巴巴集团控股有限公司 Method and device for presenting search result
US10438229B1 (en) * 2014-06-30 2019-10-08 Groupon, Inc. Systems and methods for providing dimensional promotional offers
US20160078133A1 (en) * 2014-09-15 2016-03-17 Microsoft Corporation Content interface layout construction
US9805097B2 (en) * 2014-12-17 2017-10-31 Excalibur Ip, Llc Method and system for providing a search result
US10755294B1 (en) 2015-04-28 2020-08-25 Intuit Inc. Method and system for increasing use of mobile devices to provide answer content in a question and answer based customer support system
US10061818B2 (en) * 2015-11-02 2018-08-28 International Business Machines Corporation Rank-based calculation for keyword searches
US9747348B2 (en) * 2015-11-12 2017-08-29 International Business Machines Corporation Personality-relevant search services
US20170228462A1 (en) * 2016-02-04 2017-08-10 Microsoft Technology Licensing, Llc Adaptive seeded user labeling for identifying targeted content
US20170286534A1 (en) * 2016-03-29 2017-10-05 Microsoft Technology Licensing, Llc User location profile for personalized search experience
KR101834307B1 (en) * 2016-05-19 2018-04-13 남기원 Search result antomatic alignment apparatus and system and method of the same
US10733677B2 (en) 2016-10-18 2020-08-04 Intuit Inc. Method and system for providing domain-specific and dynamic type ahead suggestions for search query terms with a customer self-service system for a tax return preparation system
US10552843B1 (en) 2016-12-05 2020-02-04 Intuit Inc. Method and system for improving search results by recency boosting customer support content for a customer self-help system associated with one or more financial management systems
US11010784B2 (en) 2017-01-31 2021-05-18 Walmart Apollo, Llc Systems and methods for search query refinement
US11609964B2 (en) 2017-01-31 2023-03-21 Walmart Apollo, Llc Whole page personalization with cyclic dependencies
US10554779B2 (en) 2017-01-31 2020-02-04 Walmart Apollo, Llc Systems and methods for webpage personalization
US10366133B2 (en) * 2017-01-31 2019-07-30 Walmart Apollo, Llc Systems and methods for whole page personalization
KR102010418B1 (en) * 2017-04-03 2019-08-14 네이버 주식회사 Method and system for subject-based ranking considering writer-reader interaction
US10936653B2 (en) 2017-06-02 2021-03-02 Apple Inc. Automatically predicting relevant contexts for media items
US10922367B2 (en) 2017-07-14 2021-02-16 Intuit Inc. Method and system for providing real time search preview personalization in data management systems
US11093951B1 (en) 2017-09-25 2021-08-17 Intuit Inc. System and method for responding to search queries using customer self-help systems associated with a plurality of data management systems
KR102123155B1 (en) * 2017-12-20 2020-06-15 팜클라우드 주식회사 System for measurement display of contents
KR102142986B1 (en) * 2018-01-24 2020-08-10 충북대학교 산학협력단 Learning based search results visualization method and device
US11436642B1 (en) * 2018-01-29 2022-09-06 Intuit Inc. Method and system for generating real-time personalized advertisements in data management self-help systems
US11269665B1 (en) 2018-03-28 2022-03-08 Intuit Inc. Method and system for user experience personalization in data management systems using machine learning
CN110737756B (en) * 2018-07-03 2023-06-23 百度在线网络技术(北京)有限公司 Method, apparatus, device and medium for determining answer to user input data
US10949224B2 (en) 2019-01-29 2021-03-16 Walmart Apollo Llc Systems and methods for altering a GUI in response to in-session inferences
CN111782907B (en) * 2020-07-01 2024-03-01 北京知因智慧科技有限公司 News classification method and device and electronic equipment

Family Cites Families (54)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5887133A (en) * 1997-01-15 1999-03-23 Health Hero Network System and method for modifying documents sent over a communications network
US5724567A (en) * 1994-04-25 1998-03-03 Apple Computer, Inc. System for directing relevance-ranked data objects to computer users
DE69530595T2 (en) * 1994-09-01 2004-03-18 Computer Associates Think, Inc. SYSTEM AND METHOD FOR THE X.500 DATABASE STANDARD
US5724521A (en) * 1994-11-03 1998-03-03 Intel Corporation Method and apparatus for providing electronic advertisements to end users in a consumer best-fit pricing manner
US6460036B1 (en) * 1994-11-29 2002-10-01 Pinpoint Incorporated System and method for providing customized electronic newspapers and target advertisements
US5758257A (en) * 1994-11-29 1998-05-26 Herz; Frederick System and method for scheduling broadcast of and access to video programs and other data using customer profiles
US5809242A (en) * 1996-04-19 1998-09-15 Juno Online Services, L.P. Electronic mail system for displaying advertisement at local computer received from remote system while the local computer is off-line the remote system
US5933811A (en) * 1996-08-20 1999-08-03 Paul D. Angles System and method for delivering customized advertisements within interactive communication systems
US5948061A (en) * 1996-10-29 1999-09-07 Double Click, Inc. Method of delivery, targeting, and measuring advertising over networks
US6285999B1 (en) * 1997-01-10 2001-09-04 The Board Of Trustees Of The Leland Stanford Junior University Method for node ranking in a linked database
US6098065A (en) * 1997-02-13 2000-08-01 Nortel Networks Corporation Associative search engine
US6112202A (en) * 1997-03-07 2000-08-29 International Business Machines Corporation Method and system for identifying authoritative information resources in an environment with content-based links between information resources
US6772200B1 (en) * 1997-05-15 2004-08-03 Intel Corporation System for providing non-intrusive dynamic content to a client device
US6137911A (en) * 1997-06-16 2000-10-24 The Dialog Corporation Plc Test classification system and method
US6012053A (en) * 1997-06-23 2000-01-04 Lycos, Inc. Computer system with user-controlled relevance ranking of search results
US6134532A (en) * 1997-11-14 2000-10-17 Aptex Software, Inc. System and method for optimal adaptive matching of users to most relevant entity and information in real-time
US6289342B1 (en) * 1998-01-05 2001-09-11 Nec Research Institute, Inc. Autonomous citation indexing and literature browsing using citation context
US6308202B1 (en) * 1998-09-08 2001-10-23 Webtv Networks, Inc. System for targeting information to specific users on a computer network
US6327574B1 (en) * 1998-07-07 2001-12-04 Encirq Corporation Hierarchical models of consumer attributes for targeting content in a privacy-preserving manner
US6665837B1 (en) * 1998-08-10 2003-12-16 Overture Services, Inc. Method for identifying related pages in a hyperlinked database
US6138113A (en) * 1998-08-10 2000-10-24 Altavista Company Method for identifying near duplicate pages in a hyperlinked database
US6356898B2 (en) * 1998-08-31 2002-03-12 International Business Machines Corporation Method and system for summarizing topics of documents browsed by a user
US6317722B1 (en) * 1998-09-18 2001-11-13 Amazon.Com, Inc. Use of electronic shopping carts to generate personal recommendations
US6370527B1 (en) * 1998-12-29 2002-04-09 At&T Corp. Method and apparatus for searching distributed networks using a plurality of search devices
US6385619B1 (en) * 1999-01-08 2002-05-07 International Business Machines Corporation Automatic user interest profile generation from structured document access information
US6366298B1 (en) * 1999-06-03 2002-04-02 Netzero, Inc. Monitoring of individual internet usage
US6327590B1 (en) * 1999-05-05 2001-12-04 Xerox Corporation System and method for collaborative ranking of search results employing user and group profiles derived from document collection content analysis
US6601061B1 (en) * 1999-06-18 2003-07-29 Surfwax, Inc. Scalable information search and retrieval including use of special purpose searching resources
US6665838B1 (en) * 1999-07-30 2003-12-16 International Business Machines Corporation Web page thumbnails and user configured complementary information provided from a server
US6449657B2 (en) * 1999-08-06 2002-09-10 Namezero.Com, Inc. Internet hosting system
US6360221B1 (en) * 1999-09-21 2002-03-19 Neostar, Inc. Method and apparatus for the production, delivery, and receipt of enhanced e-mail
US6665656B1 (en) * 1999-10-05 2003-12-16 Motorola, Inc. Method and apparatus for evaluating documents with correlating information
US20020120619A1 (en) * 1999-11-26 2002-08-29 High Regard, Inc. Automated categorization, placement, search and retrieval of user-contributed items
US6922685B2 (en) * 2000-05-22 2005-07-26 Mci, Inc. Method and system for managing partitioned data resources
JP5105456B2 (en) * 2000-05-30 2012-12-26 株式会社ホットリンク Distributed monitoring system that provides knowledge services
US20040073485A1 (en) * 2000-07-25 2004-04-15 Informlink, Inc. Method for an on-line promotion server
US6681223B1 (en) * 2000-07-27 2004-01-20 International Business Machines Corporation System and method of performing profile matching with a structured document
US6895406B2 (en) * 2000-08-25 2005-05-17 Seaseer R&D, Llc Dynamic personalization method of creating personalized user profiles for searching a database of information
US6584468B1 (en) * 2000-09-29 2003-06-24 Ninesigma, Inc. Method and apparatus to retrieve information from a network
US6684205B1 (en) * 2000-10-18 2004-01-27 International Business Machines Corporation Clustering hypertext with applications to web searching
US6560600B1 (en) * 2000-10-25 2003-05-06 Alta Vista Company Method and apparatus for ranking Web page search results
AU2002225822A1 (en) * 2000-10-31 2002-05-15 Contextweb Internet contextual communication system
US7363308B2 (en) * 2000-12-28 2008-04-22 Fair Isaac Corporation System and method for obtaining keyword descriptions of records from a large database
US7356530B2 (en) * 2001-01-10 2008-04-08 Looksmart, Ltd. Systems and methods of retrieving relevant information
JP2002222210A (en) * 2001-01-25 2002-08-09 Hitachi Ltd Document search system, method therefor, and search server
US20020198882A1 (en) * 2001-03-29 2002-12-26 Linden Gregory D. Content personalization based on actions performed during a current browsing session
US7778872B2 (en) * 2001-09-06 2010-08-17 Google, Inc. Methods and apparatus for ordering advertisements based on performance information and price information
US7716161B2 (en) * 2002-09-24 2010-05-11 Google, Inc, Methods and apparatus for serving relevant advertisements
US7089252B2 (en) * 2002-04-25 2006-08-08 International Business Machines Corporation System and method for rapid computation of PageRank
US6892198B2 (en) * 2002-06-14 2005-05-10 Entopia, Inc. System and method for personalized information retrieval based on user expertise
US7599911B2 (en) * 2002-08-05 2009-10-06 Yahoo! Inc. Method and apparatus for search ranking using human input and automated ranking
US20040044571A1 (en) * 2002-08-27 2004-03-04 Bronnimann Eric Robert Method and system for providing advertising listing variance in distribution feeds over the internet to maximize revenue to the advertising distributor
US8311890B2 (en) * 2002-11-01 2012-11-13 Google Inc. Method and system for dynamic textual ad distribution via email
US8438154B2 (en) * 2003-06-30 2013-05-07 Google Inc. Generating information for online advertisements from internet data and traditional media data

Also Published As

Publication number Publication date
US20050222989A1 (en) 2005-10-06
WO2006012120A3 (en) 2007-12-13
WO2006012120A2 (en) 2006-02-02
AU2005267370A1 (en) 2006-02-02
KR20070039072A (en) 2007-04-11
EP1766507A2 (en) 2007-03-28
EP1766507A4 (en) 2009-12-09

Similar Documents

Publication Publication Date Title
US20050222989A1 (en) Results based personalization of advertisements in a search engine
US8321278B2 (en) Targeted advertisements based on user profiles and page profile
US11816114B1 (en) Modifying search result ranking based on implicit user feedback
US10839029B2 (en) Personalization of web search results using term, category, and link-based user profiles
JP5572596B2 (en) Personalize the ordering of place content in search results
US9940398B1 (en) Customization of search results for search queries received from third party sites
US8938463B1 (en) Modifying search result ranking based on implicit user feedback and a model of presentation bias
Bennett et al. Inferring and using location metadata to personalize web search
KR101191531B1 (en) Search systems and methods using in-line contextual queries
US20160350797A1 (en) Ranking advertisements with pseudo-relevance feedback and translation models
US20070067294A1 (en) Readability and context identification and exploitation
AU2012202738B2 (en) Results based personalization of advertisements in a search engine
US8676790B1 (en) Methods and systems for improving search rankings using advertising data

Legal Events

Date Code Title Description
EEER Examination request
FZDE Discontinued

Effective date: 20150224