WO2000067162A1 - Systeme, procede et logiciel servant a classer des documents - Google Patents

Systeme, procede et logiciel servant a classer des documents Download PDF

Info

Publication number
WO2000067162A1
WO2000067162A1 PCT/US2000/012386 US0012386W WO0067162A1 WO 2000067162 A1 WO2000067162 A1 WO 2000067162A1 US 0012386 W US0012386 W US 0012386W WO 0067162 A1 WO0067162 A1 WO 0067162A1
Authority
WO
WIPO (PCT)
Prior art keywords
classes
document
particular document
list
classified
Prior art date
Application number
PCT/US2000/012386
Other languages
English (en)
Other versions
WO2000067162A9 (fr
Inventor
Bokyung Yang-Stephens
M. Charles Swope
Jeffrey Locke
Isabelle Moulinier
Original Assignee
West Publishing Company
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by West Publishing Company filed Critical West Publishing Company
Priority to JP2000615932A priority Critical patent/JP4732593B2/ja
Priority to EP00932127A priority patent/EP1212699A4/fr
Priority to NZ515293A priority patent/NZ515293A/en
Priority to AU49898/00A priority patent/AU781157B2/en
Priority to CA002371688A priority patent/CA2371688C/fr
Publication of WO2000067162A1 publication Critical patent/WO2000067162A1/fr
Priority to US10/013,190 priority patent/US7065514B2/en
Publication of WO2000067162A9 publication Critical patent/WO2000067162A9/fr
Priority to US11/388,753 priority patent/US7567961B2/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/35—Clustering; Classification
    • G06F16/353—Clustering; Classification into predefined classes
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/30—Information retrieval; Database structures therefor; File system structures therefor of unstructured textual data
    • G06F16/38—Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99932—Access augmentation or optimizing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99933—Query processing, i.e. searching
    • Y10S707/99935—Query augmenting and refining, e.g. inexact access
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99941—Database schema or data structure
    • Y10S707/99943—Generating database or data structure, e.g. via user interface

Definitions

  • the present invention concerns document classification systems and methods for legal documents, such as judicial decisions.
  • West Group (formerly West Publishing Company) of St. Paul, Minnesota, not only collect and publish the judicial opinions of jurisdictions from almost every federal and state jurisdiction in the United States, but also classify the opinions based on the principles or points of law they contain.
  • West Group for example, classifies judicial opinions using its proprietary Key NumberTM System. (Key Number is a trademark of
  • the Key Number System is a hierarchical system of over 400 major legal topics, with the topics divided into subtopics, the subtopics into sub-subtopics, and so on. Each topic or sub-topic has a unique alpha-numeric code, known as its Key Number classification. Table 1 shows an example of a portion of the
  • West Group classifiers manually classify over 350,000 headnotes across the approximately 82,000 separate classes of the Key Number classification system. Over time, many of the classifiers memorize significant portions of the Key Number System, enabling them to quickly assign Key Number classes to most headnotes they encounter. However, many headnotes are difficult to classify. For these, the classifier often invokes the WestLawTM online legal search service, which allows the user to manually define queries against a database of classified headnotes. (WestLaw is a trademark of West Group.)
  • an editor might define and run a query including the terms “abuse,” “discretion,” “maintenance,” and “divorce.”
  • the search service would return a set of annotated judicial opinions compliant with the query and the classifier would in turn sift through the headnotes in each judicial opinion, looking for those most similar to the headnote targeted for classification. If one or more of the headnotes satisfies the editor's threshold for similarity, the classifier manually assigns the Key Number classes associated with these headnotes to the target headnote.
  • the classifier through invocation of a separate application, may also view an electronic document listing a portion of the Key Number System to help identify related classes that may not be included in the search results.
  • This process of classification suffers from at least two problems.
  • this conventional process of classification lacks an efficient method of correcting misclassified headnotes.
  • a classifier makes a written request to a database administrator with rights to a master headnote database.
  • One exemplary system includes a personal computer or work station coupled to a memory storing classified judicial headnotes or abstracts and a memory containing one or more headnotes requiring classification.
  • the personal computer includes a graphical user interface that concurrently displays one of the headnotes requiring classification, a list of one or more candidate classes for the one headnote, at least one classification description associated with one of the listed candidate classes, and at least one classified headnote that is associated with one of the listed candidate classes.
  • the graphical user interface also facilitates user assignment of the one headnote requiring classification to one or more of the listed candidate classes.
  • the list of candidate classes results from automatically defining and executing a query against the classified headnotes, with the query derived from the one headnote requiring classification.
  • the exemplary system also displays the candidate classes in a ranked order based on measured similarity of corresponding classified headnotes to the headnote requiring classification, further assisting the user in assigning the headnote to an appropriate class.
  • Other features of the interface allow the user to reclassify a classified headnote and to define and execute an arbitrary query against the classified headnotes to further assist classification.
  • Figure 1 is a diagram of an exemplary classification system 100 embodying several aspects of the invention, including a unique graphical user interface 114;
  • Figure 2 is a flowchart illustrating an exemplary method embodied in classification system 100 of Figure 1;
  • Figure 3 is a diagram illustrating an unclassified document or headnote
  • Figure 4A is a facsimile of an exemplary graphical user interface 400 that forms a portion of classification system 100.
  • Figure 4B is a facsimile of exemplary graphical user interface 400 after responding to a user input.
  • Figure 4C is a facsimile of exemplary graphical user interface 400 after responding to another user input.
  • Figure 5 is a facsimile of an exemplary graphical user interface 500.
  • document refers to any logical collection or arrangement of machine-readable data having a filename.
  • Figure 1 shows a diagram of an exemplary document classification system 100 for assisting editors in manually classifying electronic documents according to a document classification scheme.
  • the exemplary embodiment assists in the classification of judicial abstracts, or headnotes, according to West Group's Key Number System.
  • West Group's Key Number System For further details on the Key Number System, see West's Analysis of American Law: Guide to the American Digest System, 2000 Edition, West Group, 1999. This text is inco ⁇ orated herein by reference.
  • the present invention is not limited to any particular type of documents or type of classification system.
  • System 100 includes an exemplary personal computer or classification work station 1 10, an exemplary classified documents database 120, an exemplary classification system database 130, and an unclassified documents database 140.
  • work station 110 and databases 120-140 as separate components, some embodiments combine the functionality of these components into a greater or lesser number of components. For example, one embodiment combines databases 120-140 within work station
  • database 110 and another embodiment combines database 130 with work station 110 and databases 120 and 140 into a single database.
  • work station 110 includes a processing unit
  • processor unit 11 1 includes one or more processors and an operating system which supports graphical-user interfaces.
  • Storage device 112 include one or more electronic, magnetic, and/or optical memory devices.
  • processors and data-storage devices use other types and numbers of processors and data-storage devices.
  • some embodiment implement one or more portions of system 100 using one or more mainframe computers or servers, such as the Sun Ultra 4000 server.
  • Exemplary display devices include a color monitor and virtual-reality goggles
  • exemplary user-interface devices include a keyboard, mouse, joystick, microphone, video camera, body-field sensors, and virtual-reality apparel, such as gloves, headbands, bodysuits, etc.
  • the invention is not limited to any genus or species of computerized platforms.
  • Classified documents database 120 includes documents classified according to a classification system.
  • database 120 includes an indexed collection of approximately twenty million headnotes spanning the entirety of the West Group's Key Number System.
  • some embodiments include an indexed subset of the total collection of classified headnotes. For example, one embodiment indexes headnotes from decisions made within the last 25 years. This reduces the number of headnotes by about half and thus reduces the time necessary to run queries against the the headnotes.
  • Other embodiments further reduce the size of the training collection to include only headnotes specific to the jurisdiction of the query. This is expected not only to result in retrieval of headnotes with greater similarity, but also to further reduce processing time.
  • Each headnote in the training collection has one or more logically associated Key Number classification codes.
  • An exemplary indexing procedure entails tokenizing the headnotes, generating transactions, and creating an inverted file. Tokenization entails reading in documents and removing predetermined stop-words, single digits, and stems.
  • the exemplary embodiment uses the Porter stemming algorithm to remove stems. See, M.F. Porter, An Algorithm for Suffix Stripping, Program, 14(3):130-137, July 1980. Single digits are removed since they tend to appear as item markers in enumerations and thus contribute very little to the substance of headnotes.
  • the procedure After tokenization, the procedure generates a transactions for each headnote.
  • a transaction is a tuple grouping a term t, a document identifier n, the frequency of the term t in the document n, and the positions of the term t in document n.
  • the procedure creates an inverted file containing records.
  • the records store the term, the number of documents in the collection that contain the term, and the generated transactions.
  • the inverted file allows efficient access to term information at search time. For further details, see G. Salton, Automatic Text Processing: the Transformation, Analysis and Retrieval of Information by Computer, Addison Wesley, 1989.
  • database 120 In addition to an indexed collection of headnotes, database 120 also includes a search engine 121.
  • search engine 121 comprises a natural-language search engine, such as the natural language version of WestLaw ® legal search tools.
  • search engines include other search engines based on the work by H. Turtle, Inference Networks for Document Retrieval, PhD thesis, Computer and Information Science Department, University of Massachusetts, October 1990.
  • Still other embodiments use an Inquery Retrieval System as described in J.P. Gallan, W.B. Croft, and S.M. Harding, The Inquery Retrieval System. In Proceedings of the Third International Conference on Database and Expert Systems Applications, pages 78-83, Valencia, Spain, 1992. Springer- Verlag.
  • Classification system database 130 includes searchable data describing the logical and hierarchical structure of the classification system used in system 100. In the exemplary embodiment, this data describes the approximately 82,000 classes of West Group's Key Number System. Each class description includes its Key Number code, a topic description, and data linking the class to adjacent classes.
  • Unclassified documents database 140 includes a set of one or more unclassified documents.
  • each document is an unclassified headnote or more generally a headnote requiring initial classification or reclassification.
  • each headnote has a corresponding judicial opinion.
  • the headnotes are determined manually by professional editor.
  • other embodiments may determine headnotes automatically using a computerized document summarizer. See for example U.S. Patent 5,708,825 to Bernardo Rafael Sotomayer, which is inco ⁇ orated herein by reference.
  • System 100 also includes, within data-storage device 112, classification- aiding software 112a.
  • software 112a comprises one or more software modules and operates as a separate application program or as part of the kernel or shell of an operating system.
  • Software 112a can be installed on work station 110 through a network-download or through a computer-readable medium, such as an optical or magnetic disc, or through other software transfer methods.
  • software 112a enables system 100 to generate graphical-user interface 114 which integrates unclassified headnotes from database 140 with classified headnotes and ranked candidate classes from database 120 and classification system data from database 130 to assist users in manually classifying or reclassifying headnotes.
  • FIG. 2 shows a flow chart 200 of an exemplary classification method at least partly embodied within and facilitated by software 112a.
  • Flow chart 200 includes a number of process blocks 202-214, which are arranged serially in the exemplary embodiment.
  • other embodiments of the invention may reorder the blocks, omits one or more blocks, and/or execute two or more blocks in parallel using multiple processors or a single processor organized as two or more virtual machines or subprocessors.
  • still other embodiments implement the blocks as one or more specific interconnected hardware or integrated-circuit modules with related control and data signals communicated between and through the modules.
  • the exemplary process flow is applicable to software, firmware, and hardware implementations.
  • the exemplary method begins at process block 202 with automatic or user-directed retrieval of a set of one or more unclassified headnotes from unclassified document database 140.
  • a number of sets of unclassified headnotes can be scheduled for classification at particular stations or a set of unclassified headnotes can be queued for sequential distribution to the next available work station.
  • Some embodiments allow the user to define and run a query against the unclassified headnotes and in effect define the set of headnotes he or she will classify or alternatively transfer the set of headnotes to another work station for classification.
  • execution of the exemplary method then proceeds to block 204.
  • Block 204 entails defining a query based on one of the headnotes in the set of unclassified headnotes. In the exemplary embodiment, this entails forwarding the one headnote to the natural-language search engine 121 which automatically defines the query using the indexing procedure already applied to index the classified headnotes of database 120.
  • Figure 3 shows the text of a sample headnote 300 and a structured query 300' that search engine 121 derives from it.
  • some embodiments include a query structuring or definition module within software 112a.
  • search engine 121 After defining the query, the exemplary method runs, or executes, the query against the classified document database 120, as indicated in block 206.
  • search engine 121 which has already defined the query from the unclassified headnote, executes a search based on the query.
  • search engine 121 implements memory-based reasoning, a variant of a -nearest neighbor method. This generally entails retrieving the classified headnotes that are closest to the unclassified headnote, or more precisely the query form of the unclassified headnote, based on some distance function.
  • the exemplary embodiment compares the query to each classified headnote in the database, scores all the terms, or concepts, that each classified headnote has in common with the query, sums the scores of all the common terms, and divides by the total number of query terms in the classified headnote to determine an average score for the classified headnote.
  • the inverse-document-frequency factor (idf) favors (that is, gives greater weight to) terms that are rare in the collection, while the term frequency factor (tf) gives a higher importance to terms that are frequent in the document being scored.
  • Block 208 entails determining the classes associated with a predetermined number k of the top classified headnotes from the ranked list of search results.
  • the k classified headnotes are the k nearest neighbors of the unclassified headnote according to the distance function used in search engine 121. Exemplary values for k include 5, 10, 25, 50, and 100. In the exemplary embodiment, some of the classified headnotes have two or more associated Key Number classes.
  • the method executes block 210 which entails transferring the k classified headnotes and their associated class identifiers from classified document database 120 to work station 110.
  • the station 110 next determines a ranking for the class identifiers (Key Number classes) associated with the top k classified headnotes.
  • the exemplary embodiment ranks the class identifiers based on their frequencies of occurrence within the set of candidate classes. In other words, each class identifier is ranked based on how many times it appears in the set of candidate classes.
  • the total similarity score is the sum of the similarity scores for all the headnotes associated with the class.
  • Some embodiments rank the similarity scores for all the headnotes associated with a class, weight the ranks according to a function, and then sum the weighted ranks to determine where to rank the class.
  • the system executes block 214 which entails displaying on display device 113 (shown in Figure 1) the exemplary graphical user interface 400 which is shown in Figure 4A.
  • Graphical user interface 400 includes concurrently displayed windows or regions 410, 420, 430, 440, and 450.
  • Window 410 displays the one unclassified headnote, headnote 300 of Figure 3, which was selected or retrieved from classification in block 202 of the exemplary flow chart in Figure 2.
  • Window 420 displays a sorted list or table 422 of candidate classes and their corresponding frequencies. A class 422a in list 422 is highlighted in subregion 420a of window 420.
  • Window 430 displays a portion 432a of the classification system hierarchy which includes class 422a.
  • Window 440 displays one or more of the classified headnotes that is similar to the one unclassified headnote and which has class 422a as one of its assigned classes.
  • Window 450 is an input window for assigning one or more classes to unclassified headnote 412 displayed in window 410.
  • interface devices 114-116 of system 100 enable a user to highlight or select one or more of the candidate classes in list 422. For example, a user may point and double click on candidate class 422a (232Akl79) to select the class, or a user may single click on the class to highlight it for further consideration. Selecting, or double-clicking, a class in the list, results in automatic insertion of the class into window 450.
  • the interface not only allows the user to select as many of the classes as desired, but also to manually insert one or more classes, including classes not listed, into window 450.
  • interface 400 When interface 400 is closed, it prompts the user to save, or in effect, actually assign the one or more classes in window 450 to the headnote in window 410.
  • interface 400 In response to highlighting class 422a, interface 400 displays subregion 420a of window 420 in reverse- video, that is, by reversing the background and foreground colors of subregion 420a. (Other embodiments use other techniques not only to indicate selection of one of the classes, but also to select one or more of the classes.)
  • classification station 110 In further response to highlighting a class in list 422 of window 420, classification station 110 (in Figure 1) defines a query based on all or a portion of the highlighted class and runs it against classification system database 130. Database 130 returns one or more classes in the neighborhood of the selected class to station 110, and window 430 displays one or more of these neighborhood classes, as portion 432a, allowing the user to view the highlighted class in context of the classification system, complete with class identifiers and class descriptors.
  • the interface In addition to responding to highlighting of class 422a by displaying it in context of the classification system in window 430, the interface also displays in window 440 one or more of the classified headnotes that is similar to the headnote being classified.
  • window 440 displays one of the headnotes, such as headnote 442a, which resulted in the highlighted class 422a being included in list 422. If there are more than one of these headnotes, window 440 allows the user to view each of them in order from most similar to least similar to the headnote being classified.
  • Figure 4B shows that the user may also highlight another class, such as class 422b in the list 422 to view this class in context of the classification system in window 430 and to view the classified headnotes associated with the class in window 440. More specifically, window 430 shows a portion 432b of the classification system stored in database 130, and window 440 shows a headnote 442b associated with highlighted class 422b. The interface allows the user to repeat this process with each of the classes in list. Window 430 also includes an enter-query button 434 which the user may invoke to convert window 430 into a query-entry window 430' as shown in Figure 4C.
  • another class such as class 422b in the list 422 to view this class in context of the classification system in window 430 and to view the classified headnotes associated with the class in window 440.
  • window 430 shows a portion 432b of the classification system stored in database 130
  • window 440 shows a headnote 442b associated with highlighted class 422b.
  • the interface allows the user to repeat this process with
  • This figure shows an exemplary query 436, which the user has defined to include several terms and/or phrases from or related to unclassified headnote 412 in window 410.
  • enter-query button 434 has been converted to a run-query button 434', which the use may actuate after entering query 436.
  • Actuating the run-query button runs the query against classified documents database 120, and results in representation of interface 400, with an updated list 422' of candidate classes for possible assignment to the unclassified headnote. (Once the user highlights one of the classes in the updated list 422', window 430 will display this class in context of the classification system hierarchy.
  • window 440 includes a reclassification button 444, which the user can invoke to initiate reclassification of the particular headnote, such as headnote 442b to another class. Invocation of button 444 results in display of window 500 as shown in Figure 5.
  • Window 500 includes a region 510 that displays a headnote 512 that is being reclassified, a region 520 which displays the highlighted class from list 422 that is associated with the headnote, and region 530 displays a ranked list 532 of candidate classes and an input field 534 for entry of new class.
  • Ranked list 532 is developed using the same process used for developing list 422.
  • One exemplary system includes a single graphical user interface that concurrently displays one of the headnotes requiring classification, a list of one or more candidate classes for the one headnote, at least one classification description associated with one of the listed candidate classes, and at least one classified headnote that is associated with one of the listed candidate classes.
  • the exemplary interface integrates two or more tools necessary for a user to accurately and efficiently classify judicial headnotes or other documents.

Abstract

Tous les ans, des spécialistes du classement de West Group classent manuellement plus de 350.000 notes ou abrégés d'arrêtés judiciaires dans environ 82.000 catégories séparées du système de classement Key Number System (130). Bien que la plupart de ces notes soient classées de mémoire par ces spécialistes, un nombre important en est difficile et, par conséquent, coûteux à classer (130) manuellement. De ce fait, l'invention concerne des systèmes (120), des procédés et un logiciel facilitant le classement manuel (120) de notes et de documents généralement difficiles à classer, en particulier, les notes générales. Un exemple de ces systèmes consiste en une interface utilisateur graphique (114) affichant simultanément une note non classée (140), une liste classée d'une ou plusieurs catégories candidates, une catégorie candidate combinée à des catégories contiguës du système de classement (100) et au moins une note classée associée à une des catégories candidates.
PCT/US2000/012386 1999-05-05 2000-05-05 Systeme, procede et logiciel servant a classer des documents WO2000067162A1 (fr)

Priority Applications (7)

Application Number Priority Date Filing Date Title
JP2000615932A JP4732593B2 (ja) 1999-05-05 2000-05-05 ドキュメント分類システム、ドキュメント分類方法およびドキュメント分類ソフトウェア
EP00932127A EP1212699A4 (fr) 1999-05-05 2000-05-05 Systeme, procede et logiciel servant a classer des documents
NZ515293A NZ515293A (en) 1999-05-05 2000-05-05 Document-classification system, method and software
AU49898/00A AU781157B2 (en) 1999-05-05 2000-05-05 Document-classification system, method and software
CA002371688A CA2371688C (fr) 1999-05-05 2000-05-05 Systeme, procede et logiciel servant a classer des documents
US10/013,190 US7065514B2 (en) 1999-05-05 2001-11-05 Document-classification system, method and software
US11/388,753 US7567961B2 (en) 1999-05-05 2006-03-24 Document-classification system, method and software

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US13267399P 1999-05-05 1999-05-05
US60/132,673 1999-05-05

Related Child Applications (1)

Application Number Title Priority Date Filing Date
US10/013,190 Continuation US7065514B2 (en) 1999-05-05 2001-11-05 Document-classification system, method and software

Publications (2)

Publication Number Publication Date
WO2000067162A1 true WO2000067162A1 (fr) 2000-11-09
WO2000067162A9 WO2000067162A9 (fr) 2002-06-06

Family

ID=22455084

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/012386 WO2000067162A1 (fr) 1999-05-05 2000-05-05 Systeme, procede et logiciel servant a classer des documents

Country Status (7)

Country Link
US (2) US7065514B2 (fr)
EP (1) EP1212699A4 (fr)
JP (1) JP4732593B2 (fr)
AU (1) AU781157B2 (fr)
CA (1) CA2371688C (fr)
NZ (1) NZ515293A (fr)
WO (1) WO2000067162A1 (fr)

Cited By (21)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1213665A2 (fr) * 2000-12-07 2002-06-12 Patentmall Limited Méthode et appareil d'affichage d'une classification des brevets
WO2003040875A2 (fr) * 2001-11-02 2003-05-15 West Publishing Company Doing Business As West Group Systemes, procedes et logiciels de classement de documents
EP1324219A1 (fr) * 2001-12-11 2003-07-02 Abb Research Ltd. Procédé de la recherche basé sur des catégories pour des objets d'information dans des bases de données et système de trouver tels objets d'information
FR2840088A1 (fr) * 2002-05-24 2003-11-28 Overture Services Inc Moteur de recherche et base de donnees, et procedes pour leur mise en oeuvre
EP1449111A1 (fr) * 2001-10-30 2004-08-25 Goldman, Sachs & Co. Systemes et procedes destines a faciliter l'acces a des documents a l'aide d'etiquettes associees
EP1483691A2 (fr) * 2002-03-11 2004-12-08 The Boeing Company Gestion des connaissances par classification de textes
US7412463B2 (en) 2002-01-11 2008-08-12 Bloomberg Finance L.P. Dynamic legal database providing historical and current versions of bodies of law
US7529756B1 (en) 1998-07-21 2009-05-05 West Services, Inc. System and method for processing formatted text documents in a database
US7778954B2 (en) 1998-07-21 2010-08-17 West Publishing Corporation Systems, methods, and software for presenting legal case histories
WO2011017098A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage de relations entre des informations stockées électroniquement dans le but de fournir des suggestions de classement via le voisin le plus proche
US8028001B2 (en) 2001-10-30 2011-09-27 Goldman Sachs & Co. Systems and methods for facilitating access to documents via a set of content selection tags
US8126818B2 (en) 2002-12-30 2012-02-28 West Publishing Company Knowledge-management systems for law firms
US8260786B2 (en) 2002-05-24 2012-09-04 Yahoo! Inc. Method and apparatus for categorizing and presenting documents of a distributed database
US8942488B2 (en) 2004-02-13 2015-01-27 FTI Technology, LLC System and method for placing spine groups within a display
US9053179B2 (en) 2006-04-05 2015-06-09 Lexisnexis, A Division Of Reed Elsevier Inc. Citation network viewer and method
US9176642B2 (en) 2005-01-26 2015-11-03 FTI Technology, LLC Computer-implemented system and method for displaying clusters via a dynamic user interface
US9195399B2 (en) 2001-08-31 2015-11-24 FTI Technology, LLC Computer-implemented system and method for identifying relevant documents for display
US9208592B2 (en) 2005-01-26 2015-12-08 FTI Technology, LLC Computer-implemented system and method for providing a display of clusters
US9208221B2 (en) 2001-08-31 2015-12-08 FTI Technology, LLC Computer-implemented system and method for populating clusters of documents
US9275344B2 (en) 2009-08-24 2016-03-01 Fti Consulting, Inc. Computer-implemented system and method for generating a reference set via seed documents
US11068546B2 (en) 2016-06-02 2021-07-20 Nuix North America Inc. Computer-implemented system and method for analyzing clusters of coded documents

Families Citing this family (82)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2002082224A2 (fr) * 2001-04-04 2002-10-17 West Publishing Company Systeme, procede et logiciel permettant d'identifier des opinions judiciaires historiquement liees
US7333966B2 (en) 2001-12-21 2008-02-19 Thomson Global Resources Systems, methods, and software for hyperlinking names
US7356461B1 (en) * 2002-01-14 2008-04-08 Nstein Technologies Inc. Text categorization method and apparatus
US8370761B2 (en) * 2002-02-21 2013-02-05 Xerox Corporation Methods and systems for interactive classification of objects
US7283998B2 (en) * 2002-09-03 2007-10-16 Infoglide Software Corporation System and method for classification of documents
US20040193596A1 (en) * 2003-02-21 2004-09-30 Rudy Defelice Multiparameter indexing and searching for documents
GB0304782D0 (en) * 2003-03-03 2003-04-09 Percy Richard System and method using alphanumeric codes for the identification, description, classification and encoding of information
US7536368B2 (en) * 2003-11-26 2009-05-19 Invention Machine Corporation Method for problem formulation and for obtaining solutions from a database
BRPI0506675A (pt) * 2003-12-31 2007-05-15 Thomson Global Resources sistema, métodos, interfaces e software para estender resultados de busca além dos limites definidos pela consulta inicial
US20050219263A1 (en) * 2004-04-01 2005-10-06 Thompson Robert L System and method for associating documents with multi-media data
US7392474B2 (en) * 2004-04-30 2008-06-24 Microsoft Corporation Method and system for classifying display pages using summaries
US7275052B2 (en) * 2004-08-20 2007-09-25 Sap Ag Combined classification based on examples, queries, and keywords
CA2577376C (fr) * 2004-08-23 2012-02-21 Lexisnexis, A Division Of Reed Elsevier Inc. Systeme et procede de recherche de questions de droit
US20060074883A1 (en) * 2004-10-05 2006-04-06 Microsoft Corporation Systems, methods, and interfaces for providing personalized search and information access
US20060218110A1 (en) * 2005-03-28 2006-09-28 Simske Steven J Method for deploying additional classifiers
US20060282884A1 (en) * 2005-06-09 2006-12-14 Ori Pomerantz Method and apparatus for using a proxy to manage confidential information
US20070005588A1 (en) * 2005-07-01 2007-01-04 Microsoft Corporation Determining relevance using queries as surrogate content
US10510087B2 (en) 2005-07-07 2019-12-17 Sermo, Inc. Method and apparatus for conducting an information brokering service
US9177050B2 (en) 2005-10-04 2015-11-03 Thomson Reuters Global Resources Systems, methods, and interfaces for extending legal search results
CN107103027A (zh) * 2005-10-04 2017-08-29 汤姆森路透社全球资源公司 用于识别相关法律文件的系统、方法、和软件
US7917519B2 (en) * 2005-10-26 2011-03-29 Sizatola, Llc Categorized document bases
US9495349B2 (en) * 2005-11-17 2016-11-15 International Business Machines Corporation System and method for using text analytics to identify a set of related documents from a source document
US20070112833A1 (en) * 2005-11-17 2007-05-17 International Business Machines Corporation System and method for annotating patents with MeSH data
US7814102B2 (en) * 2005-12-07 2010-10-12 Lexisnexis, A Division Of Reed Elsevier Inc. Method and system for linking documents with multiple topics to related documents
US20070247394A1 (en) * 2006-04-20 2007-10-25 Boyan Corydon J Display menu allowing better accessibility in a limited space
JP2007293769A (ja) * 2006-04-27 2007-11-08 Sony Corp プログラム、情報処理方法、情報処理装置
EP2033084A4 (fr) * 2006-05-23 2012-04-11 David P Gold Système et procédé d'organisation, de traitement et de présentation d'informations
US10380231B2 (en) * 2006-05-24 2019-08-13 International Business Machines Corporation System and method for dynamic organization of information sets
JP2008070958A (ja) * 2006-09-12 2008-03-27 Sony Corp 情報処理装置および方法、並びに、プログラム
JP4910582B2 (ja) * 2006-09-12 2012-04-04 ソニー株式会社 情報処理装置および方法、並びに、プログラム
US8918318B2 (en) * 2007-01-16 2014-12-23 Nec Corporation Extended recognition dictionary learning device and speech recognition system
US9460164B2 (en) 2007-01-26 2016-10-04 Recommind, Inc. Apparatus and method for single action approval of legally categorized documents
US9031947B2 (en) * 2007-03-27 2015-05-12 Invention Machine Corporation System and method for model element identification
US20080270119A1 (en) * 2007-04-30 2008-10-30 Microsoft Corporation Generating sentence variations for automatic summarization
US10083420B2 (en) 2007-11-21 2018-09-25 Sermo, Inc Community moderated information
US8788523B2 (en) * 2008-01-15 2014-07-22 Thomson Reuters Global Resources Systems, methods and software for processing phrases and clauses in legal documents
US20090248690A1 (en) * 2008-03-31 2009-10-01 International Business Machines Corporation System and method for determining preferences from information mashups
US8713007B1 (en) 2009-03-13 2014-04-29 Google Inc. Classifying documents using multiple classifiers
US20100287177A1 (en) * 2009-05-06 2010-11-11 Foundationip, Llc Method, System, and Apparatus for Searching an Electronic Document Collection
US20100287148A1 (en) * 2009-05-08 2010-11-11 Cpa Global Patent Research Limited Method, System, and Apparatus for Targeted Searching of Multi-Sectional Documents within an Electronic Document Collection
WO2010141799A2 (fr) * 2009-06-05 2010-12-09 West Services Inc. Ingénierie de particularité et analyse de comportement d'utilisateur
US8364679B2 (en) * 2009-09-17 2013-01-29 Cpa Global Patent Research Limited Method, system, and apparatus for delivering query results from an electronic document collection
US20110082839A1 (en) * 2009-10-02 2011-04-07 Foundationip, Llc Generating intellectual property intelligence using a patent search engine
JP2011095905A (ja) * 2009-10-28 2011-05-12 Sony Corp 情報処理装置および方法、並びにプログラム
US20110119250A1 (en) * 2009-11-16 2011-05-19 Cpa Global Patent Research Limited Forward Progress Search Platform
US8868402B2 (en) 2009-12-30 2014-10-21 Google Inc. Construction of text classifiers
US20110295861A1 (en) * 2010-05-26 2011-12-01 Cpa Global Patent Research Limited Searching using taxonomy
US8595220B2 (en) * 2010-06-16 2013-11-26 Microsoft Corporation Community authoring content generation and navigation
US9582575B2 (en) 2010-07-09 2017-02-28 Lexisnexis, A Division Of Reed Elsevier Inc. Systems and methods for linking items to a matter
US9639602B2 (en) * 2011-02-02 2017-05-02 Nanoprep Technologies Ltd. Method for matching queries with answer items in a knowledge base
US8407208B2 (en) * 2011-02-02 2013-03-26 Nanorep Technologies Ltd Method for matching queries with answer items in a knowledge base
US8650136B2 (en) * 2011-02-24 2014-02-11 Ketera Technologies, Inc. Text classification with confidence grading
US9348852B2 (en) 2011-04-27 2016-05-24 Microsoft Technology Licensing, Llc Frequent pattern mining
US20120278659A1 (en) * 2011-04-27 2012-11-01 Microsoft Corporation Analyzing Program Execution
US20130006986A1 (en) * 2011-06-28 2013-01-03 Microsoft Corporation Automatic Classification of Electronic Content Into Projects
US9519883B2 (en) 2011-06-28 2016-12-13 Microsoft Technology Licensing, Llc Automatic project content suggestion
WO2013123182A1 (fr) * 2012-02-17 2013-08-22 The Trustees Of Columbia University In The City Of New York Systèmes et procédés mis en œuvre par ordinateur pour effectuer une révision de contrat
US9336302B1 (en) 2012-07-20 2016-05-10 Zuci Realty Llc Insight and algorithmic clustering for automated synthesis
US9348899B2 (en) 2012-10-31 2016-05-24 Open Text Corporation Auto-classification system and method with dynamic user feedback
CA2904633C (fr) * 2013-03-12 2021-06-29 Thomson Reuters Global Resources Logiciel de flux de travaux structure autour de themes taxonomiques d'activite reglementaire
WO2014178859A1 (fr) 2013-05-01 2014-11-06 Hewlett-Packard Development Company, L.P. Classification de contenus
US9542391B1 (en) 2013-11-11 2017-01-10 Amazon Technologies, Inc. Processing service requests for non-transactional databases
US10599753B1 (en) 2013-11-11 2020-03-24 Amazon Technologies, Inc. Document version control in collaborative environment
US11336648B2 (en) 2013-11-11 2022-05-17 Amazon Technologies, Inc. Document management and collaboration system
US10540404B1 (en) * 2014-02-07 2020-01-21 Amazon Technologies, Inc. Forming a document collection in a document management and collaboration system
US10691877B1 (en) 2014-02-07 2020-06-23 Amazon Technologies, Inc. Homogenous insertion of interactions into documents
US9740748B2 (en) * 2014-03-19 2017-08-22 International Business Machines Corporation Similarity and ranking of databases based on database metadata
US20170109439A1 (en) * 2014-06-03 2017-04-20 Hewlett-Packard Development Company, L.P. Document classification based on multiple meta-algorithmic patterns
US9807073B1 (en) 2014-09-29 2017-10-31 Amazon Technologies, Inc. Access to documents in a document management and collaboration system
US20160103823A1 (en) * 2014-10-10 2016-04-14 The Trustees Of Columbia University In The City Of New York Machine Learning Extraction of Free-Form Textual Rules and Provisions From Legal Documents
WO2016093836A1 (fr) 2014-12-11 2016-06-16 Hewlett Packard Enterprise Development Lp Détection interactive d'anomalies de système
US20160350766A1 (en) * 2015-05-27 2016-12-01 Ascent Technologies Inc. System and methods for generating a regulatory alert index using modularized and taxonomy-based classification of regulatory obligations
US10803074B2 (en) 2015-08-10 2020-10-13 Hewlett Packard Entperprise Development LP Evaluating system behaviour
US20170364827A1 (en) * 2016-06-16 2017-12-21 Jack Conrad Scenario Analytics System
US11205103B2 (en) 2016-12-09 2021-12-21 The Research Foundation for the State University Semisupervised autoencoder for sentiment analysis
US10419269B2 (en) 2017-02-21 2019-09-17 Entit Software Llc Anomaly detection
CN111356997B (zh) * 2017-08-03 2024-04-09 皇家飞利浦有限公司 具有颗粒化注意力的层次神经网络
CN108415959B (zh) * 2018-02-06 2021-06-25 北京捷通华声科技股份有限公司 一种文本分类方法及装置
US11106664B2 (en) * 2018-05-03 2021-08-31 Thomson Reuters Enterprise Centre Gmbh Systems and methods for generating a contextually and conversationally correct response to a query
US11640504B2 (en) 2019-05-17 2023-05-02 Samsung Electronics Co., Ltd. Electronic apparatus and controlling method thereof
US20240086433A1 (en) * 2022-09-12 2024-03-14 Thomson Reuters Enterprise Centre Gmbh Interactive tool for determining a headnote report
CN116758560B (zh) * 2023-08-16 2023-11-17 湖北微模式科技发展有限公司 一种文档图像分类方法与装置

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5708825A (en) * 1995-05-26 1998-01-13 Iconovex Corporation Automatic summary page creation and hyperlink generation
US5794236A (en) * 1996-05-29 1998-08-11 Lexis-Nexis Computer-based system for classifying documents into a hierarchy and linking the classifications to the hierarchy
US5815392A (en) * 1993-03-24 1998-09-29 Engate Incorporated Attorney terminal having outline preparation capabilities for managing trial proceedings

Family Cites Families (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5157783A (en) 1988-02-26 1992-10-20 Wang Laboratories, Inc. Data base system which maintains project query list, desktop list and status of multiple ongoing research projects
US5321833A (en) * 1990-08-29 1994-06-14 Gte Laboratories Incorporated Adaptive ranking system for information retrieval
US5265065A (en) 1991-10-08 1993-11-23 West Publishing Company Method and apparatus for information retrieval from a database by replacing domain specific stemmed phases in a natural language to create a search query
US5488725A (en) 1991-10-08 1996-01-30 West Publishing Company System of document representation retrieval by successive iterated probability sampling
US7249026B1 (en) * 1993-03-24 2007-07-24 Engate Llc Attorney terminal having outline preparation capabilities for managing trial proceedings
US5497317A (en) 1993-12-28 1996-03-05 Thomson Trading Services, Inc. Device and method for improving the speed and reliability of security trade settlements
US5434932A (en) 1994-07-28 1995-07-18 West Publishing Company Line alignment apparatus and process
US5642502A (en) * 1994-12-06 1997-06-24 University Of Central Florida Method and system for searching for relevant documents from a text database collection, using statistical ranking, relevancy feedback and small pieces of text
JP3603392B2 (ja) * 1995-07-06 2004-12-22 株式会社日立製作所 文書分類支援方法および装置
US5644720A (en) 1995-07-31 1997-07-01 West Publishing Company Interprocess communications interface for managing transaction requests
JPH09153049A (ja) * 1995-11-29 1997-06-10 Hitachi Ltd 文書分類支援方法及び装置
US7051024B2 (en) * 1999-04-08 2006-05-23 Microsoft Corporation Document summarizer for word processors
JP3001460B2 (ja) * 1997-05-21 2000-01-24 株式会社エヌイーシー情報システムズ 文書分類装置
US5940821A (en) * 1997-05-21 1999-08-17 Oracle Corporation Information presentation in a knowledge base search and retrieval system
US6038560A (en) * 1997-05-21 2000-03-14 Oracle Corporation Concept knowledge base search and retrieval system
US6137911A (en) * 1997-06-16 2000-10-24 The Dialog Corporation Plc Test classification system and method
JPH1115848A (ja) * 1997-06-26 1999-01-22 Sharp Corp 情報分類装置、文書情報分類方法及び同方法の実行に用いる記録媒体
JPH11110409A (ja) * 1997-10-07 1999-04-23 Ntt Data Corp 情報分類方法及び装置
US6289342B1 (en) * 1998-01-05 2001-09-11 Nec Research Institute, Inc. Autonomous citation indexing and literature browsing using citation context
US6533822B2 (en) * 1998-01-30 2003-03-18 Xerox Corporation Creating summaries along with indicators, and automatically positioned tabs
US6584479B2 (en) * 1998-06-17 2003-06-24 Xerox Corporation Overlay presentation of textual and graphical annotations
US6772149B1 (en) * 1999-09-23 2004-08-03 Lexis-Nexis Group System and method for identifying facts and legal discussion in court case law documents

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5815392A (en) * 1993-03-24 1998-09-29 Engate Incorporated Attorney terminal having outline preparation capabilities for managing trial proceedings
US5708825A (en) * 1995-05-26 1998-01-13 Iconovex Corporation Automatic summary page creation and hyperlink generation
US5794236A (en) * 1996-05-29 1998-08-11 Lexis-Nexis Computer-based system for classifying documents into a hierarchy and linking the classifications to the hierarchy

Non-Patent Citations (1)

* Cited by examiner, † Cited by third party
Title
See also references of EP1212699A4 *

Cited By (64)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8250118B2 (en) 1998-07-21 2012-08-21 West Services, Inc. Systems, methods, and software for presenting legal case histories
US8661066B2 (en) 1998-07-21 2014-02-25 West Service, Inc. Systems, methods, and software for presenting legal case histories
US8600974B2 (en) 1998-07-21 2013-12-03 West Services Inc. System and method for processing formatted text documents in a database
US7529756B1 (en) 1998-07-21 2009-05-05 West Services, Inc. System and method for processing formatted text documents in a database
US7778954B2 (en) 1998-07-21 2010-08-17 West Publishing Corporation Systems, methods, and software for presenting legal case histories
EP1213665A3 (fr) * 2000-12-07 2003-12-10 Patentmall Limited Méthode et appareil d'affichage d'une classification des brevets
EP1213665A2 (fr) * 2000-12-07 2002-06-12 Patentmall Limited Méthode et appareil d'affichage d'une classification des brevets
US9619551B2 (en) 2001-08-31 2017-04-11 Fti Technology Llc Computer-implemented system and method for generating document groupings for display
US9558259B2 (en) 2001-08-31 2017-01-31 Fti Technology Llc Computer-implemented system and method for generating clusters for placement into a display
US9208221B2 (en) 2001-08-31 2015-12-08 FTI Technology, LLC Computer-implemented system and method for populating clusters of documents
US9195399B2 (en) 2001-08-31 2015-11-24 FTI Technology, LLC Computer-implemented system and method for identifying relevant documents for display
EP1449111A1 (fr) * 2001-10-30 2004-08-25 Goldman, Sachs & Co. Systemes et procedes destines a faciliter l'acces a des documents a l'aide d'etiquettes associees
US8028001B2 (en) 2001-10-30 2011-09-27 Goldman Sachs & Co. Systems and methods for facilitating access to documents via a set of content selection tags
EP1449111A4 (fr) * 2001-10-30 2006-08-23 Goldman Sachs & Co Systemes et procedes destines a faciliter l'acces a des documents a l'aide d'etiquettes associees
US8554803B2 (en) 2001-10-30 2013-10-08 Goldman, Sachs & Co. Systems and methods for facilitating access to documents via a set of content selection tags
US7580939B2 (en) 2001-11-02 2009-08-25 Thomson Reuters Global Resources Systems, methods, and software for classifying text from judicial opinions and other documents
US7062498B2 (en) 2001-11-02 2006-06-13 Thomson Legal Regulatory Global Ag Systems, methods, and software for classifying text from judicial opinions and other documents
WO2003040875A2 (fr) * 2001-11-02 2003-05-15 West Publishing Company Doing Business As West Group Systemes, procedes et logiciels de classement de documents
WO2003040875A3 (fr) * 2001-11-02 2003-08-07 West Publishing Company Doing Systemes, procedes et logiciels de classement de documents
EP1324219A1 (fr) * 2001-12-11 2003-07-02 Abb Research Ltd. Procédé de la recherche basé sur des catégories pour des objets d'information dans des bases de données et système de trouver tels objets d'information
US7412463B2 (en) 2002-01-11 2008-08-12 Bloomberg Finance L.P. Dynamic legal database providing historical and current versions of bodies of law
EP1483691A2 (fr) * 2002-03-11 2004-12-08 The Boeing Company Gestion des connaissances par classification de textes
FR2840088A1 (fr) * 2002-05-24 2003-11-28 Overture Services Inc Moteur de recherche et base de donnees, et procedes pour leur mise en oeuvre
US7792818B2 (en) 2002-05-24 2010-09-07 Overture Services, Inc. Method and apparatus for categorizing and presenting documents of a distributed database
EP1367509A3 (fr) * 2002-05-24 2005-08-31 Overture Services, Inc. Procédé et dispositif de catégorisation et de présentation de documents d'une base de données distribuée
US8260786B2 (en) 2002-05-24 2012-09-04 Yahoo! Inc. Method and apparatus for categorizing and presenting documents of a distributed database
US7231395B2 (en) 2002-05-24 2007-06-12 Overture Services, Inc. Method and apparatus for categorizing and presenting documents of a distributed database
AU2003204327B2 (en) * 2002-05-24 2006-12-21 Excalibur Ip, Llc Method and Apparatus for Categorizing and Presenting Documents of a Distributed Database
US10832212B2 (en) 2002-12-30 2020-11-10 Thomson Reuters Enterprise Centre Gmbh Systems and methods for managing documents for law firms
US8126818B2 (en) 2002-12-30 2012-02-28 West Publishing Company Knowledge-management systems for law firms
US9710786B2 (en) 2002-12-30 2017-07-18 Thomson Reuters Global Resources Systems and methods for managing documents for law firms
US8942488B2 (en) 2004-02-13 2015-01-27 FTI Technology, LLC System and method for placing spine groups within a display
US9858693B2 (en) 2004-02-13 2018-01-02 Fti Technology Llc System and method for placing candidate spines into a display with the aid of a digital computer
US9245367B2 (en) 2004-02-13 2016-01-26 FTI Technology, LLC Computer-implemented system and method for building cluster spine groups
US9984484B2 (en) 2004-02-13 2018-05-29 Fti Consulting Technology Llc Computer-implemented system and method for cluster spine group arrangement
US9619909B2 (en) 2004-02-13 2017-04-11 Fti Technology Llc Computer-implemented system and method for generating and placing cluster groups
US9082232B2 (en) 2004-02-13 2015-07-14 FTI Technology, LLC System and method for displaying cluster spine groups
US9495779B1 (en) 2004-02-13 2016-11-15 Fti Technology Llc Computer-implemented system and method for placing groups of cluster spines into a display
US9384573B2 (en) 2004-02-13 2016-07-05 Fti Technology Llc Computer-implemented system and method for placing groups of document clusters into a display
US9342909B2 (en) 2004-02-13 2016-05-17 FTI Technology, LLC Computer-implemented system and method for grafting cluster spines
US9176642B2 (en) 2005-01-26 2015-11-03 FTI Technology, LLC Computer-implemented system and method for displaying clusters via a dynamic user interface
US9208592B2 (en) 2005-01-26 2015-12-08 FTI Technology, LLC Computer-implemented system and method for providing a display of clusters
US9053179B2 (en) 2006-04-05 2015-06-09 Lexisnexis, A Division Of Reed Elsevier Inc. Citation network viewer and method
US8909647B2 (en) 2009-07-28 2014-12-09 Fti Consulting, Inc. System and method for providing classification suggestions using document injection
US9064008B2 (en) 2009-07-28 2015-06-23 Fti Consulting, Inc. Computer-implemented system and method for displaying visual classification suggestions for concepts
WO2011017064A3 (fr) * 2009-07-28 2011-03-31 Fti Technology Llc Offre d'une suggestion de classification pour des informations stockées électroniquement
US9336303B2 (en) 2009-07-28 2016-05-10 Fti Consulting, Inc. Computer-implemented system and method for providing visual suggestions for cluster classification
WO2011017134A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage de relations entre des concepts dans le but de proposer des suggestions de classement par injection
WO2011017080A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage des relations entre des informations stockées électroniquement pour offrir des suggestions de classification par le biais d'une injection
US9477751B2 (en) 2009-07-28 2016-10-25 Fti Consulting, Inc. System and method for displaying relationships between concepts to provide classification suggestions via injection
US10083396B2 (en) 2009-07-28 2018-09-25 Fti Consulting, Inc. Computer-implemented system and method for assigning concept classification suggestions
US9165062B2 (en) 2009-07-28 2015-10-20 Fti Consulting, Inc. Computer-implemented system and method for visual document classification
US9542483B2 (en) 2009-07-28 2017-01-10 Fti Consulting, Inc. Computer-implemented system and method for visually suggesting classification for inclusion-based cluster spines
WO2011017098A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage de relations entre des informations stockées électroniquement dans le but de fournir des suggestions de classement via le voisin le plus proche
WO2011017152A3 (fr) * 2009-07-28 2011-04-07 Fti Technology Llc Affichage de relations entre des concepts de façon à obtenir des suggestions de classement par l'intermédiaire du voisin le plus proche
WO2011017133A3 (fr) * 2009-07-28 2011-03-31 Fti Technology Llc Offre d'une suggestion de classification pour des concepts
WO2011017155A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage de relations entre des concepts de façon à obtenir des suggestions de classement par l'intermédiaire d'une inclusion
WO2011017065A1 (fr) * 2009-07-28 2011-02-10 Fti Technology Llc Affichage de relations entre des informations stockées électroniquement dans le but de proposer des suggestions de classification par inclusion
US9898526B2 (en) 2009-07-28 2018-02-20 Fti Consulting, Inc. Computer-implemented system and method for inclusion-based electronically stored information item cluster visual representation
US9275344B2 (en) 2009-08-24 2016-03-01 Fti Consulting, Inc. Computer-implemented system and method for generating a reference set via seed documents
US9489446B2 (en) 2009-08-24 2016-11-08 Fti Consulting, Inc. Computer-implemented system and method for generating a training set for use during document review
US10332007B2 (en) 2009-08-24 2019-06-25 Nuix North America Inc. Computer-implemented system and method for generating document training sets
US9336496B2 (en) 2009-08-24 2016-05-10 Fti Consulting, Inc. Computer-implemented system and method for generating a reference set via clustering
US11068546B2 (en) 2016-06-02 2021-07-20 Nuix North America Inc. Computer-implemented system and method for analyzing clusters of coded documents

Also Published As

Publication number Publication date
JP2002543528A (ja) 2002-12-17
EP1212699A4 (fr) 2006-01-11
JP4732593B2 (ja) 2011-07-27
US20020138529A1 (en) 2002-09-26
US20070038625A1 (en) 2007-02-15
AU4989800A (en) 2000-11-17
NZ515293A (en) 2004-04-30
CA2371688C (fr) 2008-09-09
EP1212699A1 (fr) 2002-06-12
AU781157B2 (en) 2005-05-12
US7065514B2 (en) 2006-06-20
US7567961B2 (en) 2009-07-28
WO2000067162A9 (fr) 2002-06-06
CA2371688A1 (fr) 2000-11-09

Similar Documents

Publication Publication Date Title
CA2371688C (fr) Systeme, procede et logiciel servant a classer des documents
US6363379B1 (en) Method of clustering electronic documents in response to a search query
US8341159B2 (en) Creating taxonomies and training data for document categorization
US7617176B2 (en) Query-based snippet clustering for search result grouping
Liu et al. Personalized web search for improving retrieval effectiveness
US6691108B2 (en) Focused search engine and method
US7778954B2 (en) Systems, methods, and software for presenting legal case histories
US7496567B1 (en) System and method for document categorization
Kim et al. Automatic MeSH term assignment and quality assessment.
US20040049499A1 (en) Document retrieval system and question answering system
Lin et al. ACIRD: intelligent Internet document organization and retrieval
Raghavan et al. Experiments on the determination of the relationships between terms
Lang A tolerance rough set approach to clustering web search results
JP4426041B2 (ja) カテゴリ因子による情報検索方法
Attardi et al. Theseus: categorization by context
Moschitti Answer filtering via text categorization in question answering systems
Wei et al. A mining-based category evolution approach to managing online document categories
Borko The conceptual foundations of information systems
Weiss et al. Lightweight document matching for help-desk applications
WO2002037328A2 (fr) Integration de recherche et de classification: resultat et classement
Chakrabarti et al. Topic distillation and spectral filtering
WO2001039008A1 (fr) Procede et systeme de collecte de ressources par sujet
Lancaster Mechanized document control: A review of some recent research
Yang-Stephens et al. Computer-assisted classification of legal abstracts
Chi et al. Context query in information retrieval

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
ENP Entry into the national phase

Ref document number: 2371688

Country of ref document: CA

Kind code of ref document: A

Ref document number: 2371688

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 49898/00

Country of ref document: AU

REEP Request for entry into the european phase

Ref document number: 2000932127

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 2000932127

Country of ref document: EP

ENP Entry into the national phase

Ref document number: 2000 615932

Country of ref document: JP

Kind code of ref document: A

WWE Wipo information: entry into national phase

Ref document number: 10013190

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 515293

Country of ref document: NZ

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

AK Designated states

Kind code of ref document: C2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: C2

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

COP Corrected version of pamphlet

Free format text: PAGES 1/7-7/7, DRAWINGS, REPLACED BY NEW PAGES 1/7-7/7; DUE TO LATE TRANSMITTAL BY THE RECEIVING OFFICE

WWP Wipo information: published in national office

Ref document number: 2000932127

Country of ref document: EP

WWG Wipo information: grant in national office

Ref document number: 49898/00

Country of ref document: AU