US20040190794A1 - Method and apparatus for image identification and comparison - Google Patents

Method and apparatus for image identification and comparison Download PDF

Info

Publication number
US20040190794A1
US20040190794A1 US10/653,608 US65360803A US2004190794A1 US 20040190794 A1 US20040190794 A1 US 20040190794A1 US 65360803 A US65360803 A US 65360803A US 2004190794 A1 US2004190794 A1 US 2004190794A1
Authority
US
United States
Prior art keywords
image
color
images
determining
color space
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Abandoned
Application number
US10/653,608
Inventor
Ken Belanger
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Individual
Original Assignee
Individual
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Individual filed Critical Individual
Priority to US10/653,608 priority Critical patent/US20040190794A1/en
Publication of US20040190794A1 publication Critical patent/US20040190794A1/en
Abandoned legal-status Critical Current

Links

Images

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00Image analysis
    • G06T7/90Determination of colour characteristics
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/50Information retrieval; Database structures therefor; File system structures therefor of still image data
    • G06F16/58Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually
    • G06F16/583Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content
    • G06F16/5838Retrieval characterised by using metadata, e.g. metadata not derived from the content or metadata generated manually using metadata automatically derived from the content using colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/40Extraction of image or video features
    • G06V10/56Extraction of image or video features relating to colour
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06VIMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00Arrangements for image or video recognition or understanding
    • G06V10/70Arrangements for image or video recognition or understanding using pattern recognition or machine learning
    • G06V10/74Image or video pattern matching; Proximity measures in feature spaces
    • G06V10/75Organisation of the matching processes, e.g. simultaneous or sequential comparisons of image or video features; Coarse-fine approaches, e.g. multi-scale approaches; using context analysis; Selection of dictionaries
    • G06V10/758Involving statistics of pixels or of feature values, e.g. histogram matching
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2201/00General purpose image data processing
    • G06T2201/005Image watermarking
    • G06T2201/0201Image watermarking whereby only tamper or origin are detected and no embedding takes place
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00Indexing scheme for image analysis or image enhancement
    • G06T2207/10Image acquisition modality
    • G06T2207/10024Color image

Definitions

  • the present invention relates generally to image identification and, more specifically, to a computer-implemented method for analyzing, identifying, and comparing images.
  • a digital watermark must be affirmatively added to an electronic image. Therefore, it is not possible to use this method to identify copies of images that either have not been digitally watermarked, or that were made prior to the addition of a digital watermark.
  • a digital watermark may not survive the transfer of an electronic image to printed format.
  • a duplicate digital image can be downloaded from the Internet and printed.
  • the unauthorized print may not display the digital watermark.
  • the present invention is a computer-implemented method and apparatus for analyzing, identifying, and comparing images.
  • the method can be used with any visually-displayed medium that is represented in any type of color space.
  • An identified image can be authenticated, registered, marked, compared to another image, or recognized using the method and apparatus according to the present invention.
  • an image's displayed composition is parsed to generate unique image characteristics. At least one characteristic of the image's color space is selected and determined for a displayed image. In the preferred embodiment of the invention, the selected characteristics include color distribution, color space usage, color range distance, and image size. The information determined for each selected characteristic comprises a unique description of an image. This identification information can be then used to compare different identified images to determine if they are identical.
  • a plurality of color values are combined to provide an expressed color value.
  • the color values are combined by grouping colors that cannot be distinguished by visual inspection.
  • the color values are combined by truncating a specified number of the lower bits representing each color value and then by combining all color values whose remaining bits are equal in value.
  • a set of predetermined criteria is used to ascertain whether a second image is a duplicate of a first image.
  • Such criteria can include the percentage of identity of the determined characteristics of the compared image. Thus, if the determined characteristics are identical within the predetermined percentage, the images will be considered to be duplicates.
  • the predetermined criteria can be adjusted to permit the identification of images that are identical in part, such as a clipped copy of an image compared to an original.
  • a software search application such as a search engine or a spider, is used to retrieve an image from an electronic network.
  • the retrieved image can then be identified using the method of the present invention.
  • the software search application can be used to search an electronic network, such as the Internet, to seek out copies of an identified image.
  • a notification alarm is provided when a duplicate image is located.
  • the present invention is implemented using a computer.
  • identification information for an image can be stored in a computer-accessible database.
  • the computer can be adapted for communication with an electronic network such as the Internet.
  • One or more software applications are used to determine the identification information for the selected image characteristics.
  • Software applications are also used to compare images, provide notification of identical images, and to generate a database of identified images.
  • FIG. 1 is a block diagram of a computer network according to one embodiment of the present invention.
  • FIG. 2 is a block diagram illustrating an apparatus for accessing an electronic network, according one embodiment of the present invention
  • FIG. 3 is a flow chart of a method for identifying an image according to the present invention.
  • FIG. 4 is a flow chart illustrating the determination of an image's color distribution according to the preferred embodiment of the present invention.
  • FIG. 5 is a diagram illustrating the use of a spider to search an electronic network according to one embodiment of the present invention.
  • FIG. 6 is a flow chart illustrating the use of a spider software application according to one embodiment of the present invention.
  • the present invention is a method and apparatus for analyzing, identifying, and comparing images.
  • the method can be used with any visually-displayed medium that is represented in any type of color space.
  • the present invention can be used for purposes including but not limited identifying a particular image, authenticating an image as being identical to a particular image, registering an image, for example with a registry, organization, database, or digital library, marking an image for subsequent identification, or identifying copies of a particular image.
  • the present invention is implemented using a computer.
  • a computer can include but is not limited to a personal computer, network computer, network server computer, dummy terminal, local area network, wide area network, personal digital assistant, work station, minicomputer, and mainframe computer.
  • the identification, search and/or comparison features of the present invention can be implemented as one or more software applications, software modules, firmware such as a programmable ROM or EEPROM, hardware such as an application-specific integrated circuit (“ASIC”), or any combination of the above.
  • ASIC application-specific integrated circuit
  • FIG. 1 is a block diagram of a computer network system 100 according to one embodiment of the present invention.
  • a network server computer 104 is connected to a network client computer 102 through a network 110 .
  • the network interface between server computer 104 and client computer 102 can also include one or more routers, such as routers 106 and 108 .
  • the routers serve to buffer and route the data transmitted between the server and client computers.
  • Network 110 may be the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), or any combination thereof.
  • the server computer 104 is a World-Wide Web (WWW) server that stores data in the form of ‘web pages’ and transmits these pages as Hypertext Markup Language (HTML) files over the Internet network 110 to client computer 102 .
  • WWW World-Wide Web
  • HTML Hypertext Markup Language
  • one or more software applications accessible to a computer can be used to determine the identification information for the selected image characteristics.
  • Software applications can also be used to compare images, provide notification of identical images, and to generate a database of identified images.
  • Any or all of the software applications or hardware configurations of the present invention can be implemented by one skilled in the art using well known programming techniques and hardware components.
  • the original data source for the original reference image, and for any subsequently-identified comparison images can be in any appropriate form, including but not limited to processed film (black-and-white, color, or negatives), video, CD, CD-ROM, photographs, optical disks, magazines, brochures, newspapers, books, paintings, and computer images.
  • Computer image data sources can be stored in any format including but not limited to JPG, GIF, TIFF, PNG, PCX, MacPaint, GEM, IFF/ILBM, Targa, Microsoft Windows Device Independent Bitmap, WordPerfect Graphics, Sun Raster files, PBM, X Windows bitmaps, FITS, DXF, HPGL, Lotus PIC, UNIX plot format, PCL, Basic PostScript graphics, WMF, PICT, CGM, RIB, FLI/FLC, MPEG, QuickTIme animations, Kodak ICC, PDS, RIFF, SGI, XPM, HP Paintjet, PC Paint, Utah RLE, VICAR, and XPM.
  • the present invention is a vendor-provided service, with the image identification, search, and any image comparisons performed by the vendor for use by users or customers.
  • the software applications, firmware, and hardware for implementing the invention reside with the vendor.
  • a user can electronically access information previously obtained by the vendor, can request that a search be performed for specific information, and can provide an image for comparison with a database, file, library of stored images, or any other image.
  • the user provides an image for identification by the vendor.
  • the vendor stores the identification information for this image and searches, for example on the Internet, for duplicate images. The user is notified when a duplicate image is located.
  • the entire process and apparatus or any portion thereof can reside with one or more users or third parties.
  • the present invention can be implemented as one or more software applications, software modules, firmware; and hardware that are provided to individual users for their utilization.
  • FIG. 2 is a block diagram illustrating an apparatus 200 for accessing an electronic network, according one embodiment of the present invention.
  • a computer 202 is adapted for communication with an electronic network 204 such as the Internet.
  • Identified reference images 206 can be stored on the computer, for example, in a database.
  • a spider or search engine 208 also resident on the computer, can be used to search the electronic network for images. The identification of retrieved images can then be performed using a software application 210 resident on the computer.
  • the image identification is performed manually.
  • the comparison of an identified image with another image can be performed either manually, or by using a computer.
  • an image's displayed composition is parsed to generate unique image characteristics. At least one characteristic of the image's color space is selected and determined for a displayed image. The information determined for each selected characteristic comprises a unique description of an image. This identification information can be then used to compare different identified images to determine if they are identical.
  • the selected characteristics include color distribution, color space usage, color range distance, and image size.
  • the selected characteristics can be determined in any order.
  • any or all of the characteristics of a color space can be used to identify an image according to the present invention.
  • the examples described herein use the RGB color space.
  • any suitable display type or color space type can be used, including but not limited to RGB, YIQ, YUV, YDbDr, and YCbCr.
  • the RGB color space is an “additive” color system.
  • all colors are represented according to the values of the red, green, and blue components required to produce each color.
  • Each of the three component colors is divided into 256 digital steps. Therefore, black is represented as 0,0,0 and white, which contains the maximum amount of all three colors is 255,255,255.
  • FIG. 3 is a flow chart of a method for identifying an image according to the present invention.
  • the image data is obtained from the data source and, if necessary, is converted to the color space being used in the identification procedure 300 .
  • a JPG file format image can be converted to the RGB color space.
  • Color ranges for the particular color space are then defined by divided the total color range for the particular color space into a specific number of groups 302 .
  • Image colors used in the image are assigned to their defined color ranges and color usage counts for each color range are recorded 304 .
  • the average farthest distance between color points in each color range is then derived 306 .
  • the image's display width and height for the current display medium is also determined 308 .
  • the image is identified by taking the average of the color range distribution, color usage counts, and color distances, and by making each of the averaged characteristics relative to 100% of all characteristic ranges 310 .
  • FIG. 4 is a flow chart illustrating the determination of an image's color distribution according to the preferred embodiment of the present invention.
  • a first step all possible display ranges for a media type pixel are defined 400 .
  • the display range is from 0,0,0 through 255,255,255.
  • N represents the total number of discreet elements desired 402 .
  • the image Color Distribution can be generated using methods including but not limited to one or more software applications, a calculator, or by hand calculation. Range sizes can differ among the selected characteristics in an image identification procedure according to the present invention.
  • the color value is then determined for each pixel in the image 404 .
  • a plurality of color values are combined to provide an expressed color value 406 .
  • no such color values are combined.
  • the color values can be combined in several different manners.
  • the color values are combined by grouping colors that cannot be distinguished by visual inspection 408 .
  • color 233,233,233 can be considered the same color as 233,233,232 or 233,232,234 for purposes of the present invention.
  • the three visually indistinguishable colors are considered to be the same color and are counted as one instead of three colors in the color space range. This method is used to advantage in averaging out display media differences when comparing screen-captured images.
  • the color values are combined by truncating a specified number of the lower bits representing each component color value 410 .
  • the truncated component color values are re-calculated.
  • all colors having the same component color values are then combined 412 .
  • the binary representation of the number 255 is 11111111.
  • the RGB color space color 233,233,233 would therefore be represented as:
  • RGB color 236,236,236 is represented as:
  • the RGB colors 233,233,233 and 236,236,236 will be considered to be the same color. This method is advantageous because it allows you to create a color table of 4096 elements that can be stored and directly indexed in memory.
  • the number of expressed color values in each group of N elements for which there is at least one pixel with a corresponding color value is then determined 414 .
  • the image included one pixel having the value 1,244,244 then the range 0,0,0 through 7,255,255, would have at a minimum one of its color space values used in the image. Only one color space element is considered to be used when the image includes a plurality of pixels whose color values are combined and considered to be the same color, as discussed previously.
  • the total number of color space range elements of each color space range can optionally be divided by the total color space range elements used in all the color space ranges 416 . This will generate the percentage of elements used in each of the color space ranges.
  • the color space distribution is 33%, 66% for a two range color space.
  • the range elements are represented by other methods including but not limited to averaging, and calculating the deviation from a specific point.
  • the image's color space usage is determined by, for each color range defined in the image's color space, counting the number of pixels that use a color element in the color range. Once all such pixel usage counts have been done, each color space range total pixel count can optionally be divided by the total number of pixels used in the image. This generates the percentage of usage for each specific color range of the color space. Other representational methods such as averaging or calculating deviation from a specific point can also optionally be used.
  • Color range distance is determined by determining the distance between the two farthest points of each color element defined in each color range. For example, when distance is defined as:
  • the total distances for each color range are then averaged.
  • the color range distance can be represented by any other methods such as deviation from a specific point.
  • An example of color range distancing using averaging is as follows:
  • Color Range Distance (CRE 1 +CRE 2 + . . . +CRE N ) ⁇ Total CRE's for a range
  • Image size is derived by determining the width and height of an image.
  • the width of an image is defined as the number of color space units used from right-to-left of the image
  • the height of an image is the number of color space units used from the top-to-bottom of the image. It is readily apparent to one skilled in the art that the directions of measurement and the size of the color space units can be varied without departing from the scope and spirit of the present invention.
  • this data constitutes identification information for the image. Depending on the number and type of selected characteristics, this identification information can uniquely identify the image.
  • the image identification information is used to identify copies of a reference image.
  • the identification of such copies can be performed using methods including but not limited to one or more software applications, a calculator, or by hand calculation.
  • the identification information can be used to authenticate an image.
  • a work of computer art can be authenticated by generating the identification information according to the present invention.
  • This authentication does not require the use of a prior art identification marker implanted within or associated with the image, such as a digital watermark.
  • a digital watermark implanted within or associated with the image
  • copies of an image authenticated according to the present invention can be readily identified even if the digital watermark has been cropped from the copied image.
  • the identification information according to the present invention can be used to authenticate, catalog, index, retrieve, identify, and register an image or images.
  • the identification information can also be used to search for image copies including but not limited to reproductions, screen captures, and cropped areas.
  • identification information for a reference and/or comparison image is stored in a computer-accessible database.
  • the image identification and/or search is conducted for images stored on an electronic network, such as the Internet.
  • an electronic network such as the Internet.
  • teachings of the present invention can equally be applied to images stored on any type of storage or electronic storage medium, network, or system, including but not limited to CD-ROMs, Digital Video Disks, billboards, films, videos, photographs, posters, newspapers, books, and magazines.
  • a photograph can be electronically scanned and analyzed to determine its selected characteristics.
  • the identification information thus generated for the photograph can be used to identify digital copies of the photograph that are stored on the Internet, or hard copies of the photograph on posters.
  • a software search application such as a search engine or a spider, is used to retrieve an image from an electronic network.
  • an Internet spider is a software application running on a node on a network.
  • the spider software application is programmed to access other hosts' websites on the Internet and retrieve reference information from the HTML pages and images found on the visited sites.
  • the retrieved data is loaded and stored on at least one database.
  • This database can be on the same computer as the spider software application, or on another computer(s).
  • a search engine is a software application that is programmed to use the retrieved data (reference information) stored in the database by the spider.
  • the search engine locates websites that contain requested information and images that are based upon the stored reference information collected by the spider.
  • the teachings of the present invention can be implemented either using a proprietary or a commercially-available spider or search engine.
  • Such commercially-available spider software applications or search engines include but are not limited to America On-Line's Web Crawler, Compaq Corporation's Alta Vista, Yahoo! Corporation's Yahoo!, InfoSeek Corporation's InfoSeek, Lycos Corporation's Lycos, and @Home Corporation's Excite. Any other search software application of other searching technique known to one skilled in the art can also be used.
  • FIG. 5 is a diagram illustrating the use of a spider to search an electronic network according to one embodiment of the present invention.
  • a spider 502 is in communication with a database 504 that contains image identification information, also according to the present invention.
  • the spider is also in communication with an electronic network, such as the Internet 500 .
  • the spider is programmed to access different sites on the Internet 506 , 508 , 510 , 512 , 514 , 516 , 518 , 520 , 522 , 524 , 526 . These sites can be selected by any appropriate means as described below in further detail. Images located by the spider can be retrieved and added to a database 528 , identified and compared to image identification information from the database 504 . Duplicate, copied, cropped, and transformed versions of the reference image can thereby be located and identified.
  • the database 528 in which the spider stores retrieved reference information can be the same database as the image identification information database 504 , or can be a separate database as illustrated in FIG. 5.
  • FIG. 6 is a flow chart illustrating the use of a spider software application according to one embodiment of the present invention.
  • the reference image identification information is provided to the spider 600 .
  • the search parameters such as the Internet sites that the spider is to search are also provided to the spider 602 .
  • the spider then accesses and searches the selected search locations 604 .
  • the spider can be configured to, for example, locate and identify each image available on a visited site.
  • the image identification can be performed either by the spider software application itself, or by another software application resident upon a computer to which the spider transmits a located image.
  • the located image identification information is stored in a database 606 .
  • This located image identification information is compared to reference image identification information 608 for one or more images that is stored in the same or in a separate database.
  • a report indicating a possible duplicate image is generated for each located image whose identification information matches within a selected percentage of the reference image identification data 610 .
  • a secondary comparison can be performed on any such possible duplicate images located 612 .
  • a possible duplicate image can be reloaded to the computer and compared to the reference image using pattern matching, quadrant frequency, usage counts, or any other applicable method. The results of the secondary comparison can then be reported.
  • the spider or search engine is provided with an alarm or notification feature.
  • Such features can include notifying an operator that an image match has occurred, notifying another party that an image match has occurred, and notifying the addressee of a particular site that an image(s) on that site matches an image(s) on another site.
  • An alarm or notification can be visually displayed by using, for example, a text message, flashing display, color display, different font type or size, shading, borders, graying out, highlighting, animation, audio display, sound alarm, audibly broadcast message, and printed notice.
  • An alarm or notification can be stored for later retrieval, configured to display at particular times, or conditioned upon the occurrence of particular events. For example, the notification can be triggered to display every ten minutes, every time an image match is found, every time ten image matches are found, when no image match is found, to identify the total number of images on a site or electronic network, and to identify the total number or percentage of matching images or sites having matching images.
  • a search for duplicate images can be performed at the direction of user, or can be performed automatically.
  • the user can have a particular image identified and compared to an authenticated image to determine of the images are identical.
  • the search engine or spider can be configured to search for and to determine the selected characteristics of am image or group of images.
  • the spider or search engine can be programmed to locate all images at a particular site, locate images and identify only specific images, locate and identify all images at a particular site, compare located images with a predetermined identified image, and compare located images with each other to identify sites containing identical images.
  • Example 1 An example illustrating one embodiment of the present invention is hereby provided as Example 1.
  • Example 1 an image in the RGB color space is identified and compared to another image to determine if the two images are duplicates.
  • a duplicate image according to the present invention maintains a certain percentage of identity with the reference image. This percentage can vary according to the method of duplication, or according to whether the image was duplicated in its entirety.
  • a set of predetermined criteria is used to ascertain whether a second image is a duplicate of a first image.
  • criteria can include the percentage of identity of the determined characteristics of the compared image. Thus, if the determined characteristics are identical within the predetermined percentage, the images will be considered to be duplicates.
  • the predetermined criteria can be adjusted to permit the identification of images that are identical in part, such as a clipped copy of an image compared to an original.
  • a comparison of two images to determine 100% identity of selected characteristics could be used to identify a direct copy of an image file to another file of the same type and storage specifications, as described above. Such a comparison might not identify an image copied to another format in which certain image characteristics are altered. However, a comparison to determine 80% identify of selected characteristics might be sufficient to identify such duplicate image stored in a different format.
  • Example 1 four characteristics of the image composition are selected, Color Distribution, Color Space Usage, Color Range Distance, and Image Size.
  • Image Depth could be a selected characteristic for a three-dimensional rendering
  • Image Size might not be selected for standard image size databases.
  • the steps performed in Example 1 can be performed in any suitable order. Steps can be combined and additional steps can be added to accomplish the image identification according to the present invention.
  • Image 1 Reference image
  • Image 2 Comparison image
  • Step 1 All colors used in the reference image are assigned to one of 32 different ranges in the RGB color space to generate the image Color Distribution, starting with white 255,255,255 and ending with black 0,0,0.
  • Step 2 The percentage of color elements used by the reference image in each RGB color space range is generated.
  • Step 3 The percentage that each color range is used in the reference image in the RGB color space is generated.
  • Step 4 The average distance between the two farthest points of each color in a Color Range is generated for each Color Range.
  • Step 5 The image height and width for the specific selected display model is determined.
  • IDC [((Image 1 , Range 1 ) ⁇ (Image 2 , Range 1 ))+((Image 1 , Range 2 ) ⁇ (Image 2 , Range 2 ))+ . . . . . ((Image 1 , Range N ) ⁇ (Image 2 , Range N ))] ⁇ N
  • Step 7 Image Usage Characteristic (“IUC”)
  • IDC [((Image 1 , Range 1 Usage) ⁇ (Image 2 , Range 1 Usage))+((Image 1 , Range 2 Usage)+(Image 2 , Range 2 Usage))+((Image 1 , Range N Usage)+(Image 2 , Range N Usage))] ⁇ N
  • Step 8 Image Distance Characteristic (“IDIC”)
  • c. Optionally weight distance. For each Range distance, multiply it by the IUC percentage of the corresponding Image 1 Range (or by some other selected Usage factor). This procedure weights the distance to the relative use of its Color Range. Thus, when comparing one distance range to another, a distance whose representative color forms a larger percentage of the image will be weighted more heavily than a distance whose representative color forms a smaller percentage of the image.
  • IDIC [(((Image 1 , Range 1 Distance) ⁇ (Image 1 , Range 1 Usage)) ⁇ (Image 2 , Range 1 Usage))+(((Image 1 , Range 2 Distance) ⁇ (Image 1 , Range 2 Usage)) ⁇ (Image 2 , Range 2 Usage))+ . . . . . (((Image 1 , Range N Distance) ⁇ (Image 1 , Range N Usage)) ⁇ (Image 2 , Range N Usage))] ⁇ N
  • Step 9 Image Size Characteristic (“ISC”)
  • ISC [((Image 1 , Range 1 Size) ⁇ (Image 2 , Range 1 Size))+((Image 1 , Range 2 Size) ⁇ (Image 2 , Range 2 Size))+ . . . . . ((Image 1 , Range N Size) ⁇ (Image 2 , Range N Size))]+ N
  • Step 10 Average the four selected group characteristic differences to derive the Percent Probability (“PP”) that Image 2 is a copy of reference Image 1 :
  • a PP of 100 can be considered to be a 100% match.
  • PP ranges can be selected from 0% to 100%.
  • Second level or above testing can be performed to confirm an image match. For example, one or both images can be re-analyzed using different characteristics, visually inspected, analyzed using pattern matching techniques to confirm such match. Such tests can be computer-implemented, performed by a person, or both.
  • the present invention can be used with data, images, libraries and files stored in any suitable file or data storage program including but not limited to Claris Filemaker, Microsoft's Office and Excel, and the database programs and applications of Lotus, Oracle Corporation, Informix, and Sybase.

Abstract

A method and apparatus are provided for analyzing, identifying, and comparing images. The method can be used with any visually-displayed medium that is represented in any type of color space. An identified image can be authenticated, registered, marked, compared to another image, or recognized using the method and apparatus according to the present invention. At least one characteristic of an image's color space is selected and determined to generate a unique description of the image. This identification information is then used to compare different identified images to determine if they are identical according to a set of predetermined criteria. The predetermined criteria can be adjusted to permit the identification of images that are identical in part. In the preferred embodiment of the present invention, a software search application, such as a search engine or a spider, is used to locate and retrieve an image to be identified from an electronic network. A notification alarm is triggered when a duplicate image is located. In one embodiment, the present invention is implemented using a computer. One or more software applications, software modules, firmware, and hardware, or any combination thereof, are used to determine the identification information for the selected image characteristics, search for images, provide notification of identical images, and to generate a database of identified images.

Description

    CROSS REFERENCE TO RELATED APPLICATIONS
  • This application is a divisional of U.S. patent application Ser. No. 09/271,112, filed Mar. 17, 1999, which is claims priority from provisional application No. 60/078,878, filed Mar. 20, 1998. The subject matter of each of these applications is incorporated herein by reference. This application claims priority under 35 U.S.C. Section 120 from each of application Ser. Nos. 09/271,112 and 60/078,878.[0001]
  • BACKGROUND OF THE INVENTION
  • 1. Field of the Invention [0002]
  • The present invention relates generally to image identification and, more specifically, to a computer-implemented method for analyzing, identifying, and comparing images. [0003]
  • 2. Description of Related Art [0004]
  • With the development of computers and electronic networks such as the Internet, it is now possible to create, represent, and store, and view electronic representations of visually displayed images such as photographs, paintings, and prints. In addition to such electronic representations of “hard-copy” images, computer generated art forms that are created, stored, and viewed exclusively as electronic representations are becoming more common. [0005]
  • Electronic representations, such as digital images, are extremely easy to duplicate. Unfortunately, it can be difficult or impossible to determine whether an electronic image is an original image, or is a duplicate of the original. Furthermore, the Internet has greatly facilitated the transmitting of duplicated images. This can be a significant problem for artists, copyright owners, and others who have interests in particular images. [0006]
  • Attempts have been made to mark electronic images to permit identification of unauthorized copies. For example, a digital watermark can be added to an electronic image. A suspected duplicate image can be identified by its hidden digital watermark. However, a digital watermark is located at one or more specific locations on an electronic image. Thus, if the portion of an image in which the watermark is stored is cropped upon duplication, image identification will not be possible using the digital watermark. [0007]
  • Furthermore, a digital watermark must be affirmatively added to an electronic image. Therefore, it is not possible to use this method to identify copies of images that either have not been digitally watermarked, or that were made prior to the addition of a digital watermark. [0008]
  • In addition, a digital watermark may not survive the transfer of an electronic image to printed format. For example, a duplicate digital image can be downloaded from the Internet and printed. The unauthorized print may not display the digital watermark. [0009]
  • It would be an advantage to provide a method and apparatus for identifying an image without requiring the use of an identifying mark. It would be a further advantage if such method and apparatus enabled the identification of altered duplicate images, such as cropped images. It would be yet another advantage if such method and apparatus were available to search an electronic network to locate, compare, and identify images. [0010]
  • SUMMARY AND OBJECTS OF THE INVENTION
  • The present invention is a computer-implemented method and apparatus for analyzing, identifying, and comparing images. The method can be used with any visually-displayed medium that is represented in any type of color space. An identified image can be authenticated, registered, marked, compared to another image, or recognized using the method and apparatus according to the present invention. [0011]
  • In the present invention, an image's displayed composition is parsed to generate unique image characteristics. At least one characteristic of the image's color space is selected and determined for a displayed image. In the preferred embodiment of the invention, the selected characteristics include color distribution, color space usage, color range distance, and image size. The information determined for each selected characteristic comprises a unique description of an image. This identification information can be then used to compare different identified images to determine if they are identical. [0012]
  • In the preferred embodiment of the present invention, a plurality of color values are combined to provide an expressed color value. In one embodiment, the color values are combined by grouping colors that cannot be distinguished by visual inspection. In an alternative embodiment, the color values are combined by truncating a specified number of the lower bits representing each color value and then by combining all color values whose remaining bits are equal in value. [0013]
  • A set of predetermined criteria is used to ascertain whether a second image is a duplicate of a first image. Such criteria can include the percentage of identity of the determined characteristics of the compared image. Thus, if the determined characteristics are identical within the predetermined percentage, the images will be considered to be duplicates. The predetermined criteria can be adjusted to permit the identification of images that are identical in part, such as a clipped copy of an image compared to an original. [0014]
  • In the preferred embodiment of the present invention, a software search application, such as a search engine or a spider, is used to retrieve an image from an electronic network. The retrieved image can then be identified using the method of the present invention. The software search application can be used to search an electronic network, such as the Internet, to seek out copies of an identified image. In one embodiment, a notification alarm is provided when a duplicate image is located. [0015]
  • In one embodiment, the present invention is implemented using a computer. In this embodiment, identification information for an image can be stored in a computer-accessible database. The computer can be adapted for communication with an electronic network such as the Internet. One or more software applications are used to determine the identification information for the selected image characteristics. Software applications are also used to compare images, provide notification of identical images, and to generate a database of identified images. [0016]
  • BRIEF DESCRIPTION OF THE DRAWINGS
  • FIG. 1 is a block diagram of a computer network according to one embodiment of the present invention; [0017]
  • FIG. 2 is a block diagram illustrating an apparatus for accessing an electronic network, according one embodiment of the present invention; [0018]
  • FIG. 3 is a flow chart of a method for identifying an image according to the present invention; [0019]
  • FIG. 4 is a flow chart illustrating the determination of an image's color distribution according to the preferred embodiment of the present invention; [0020]
  • FIG. 5 is a diagram illustrating the use of a spider to search an electronic network according to one embodiment of the present invention; and [0021]
  • FIG. 6 is a flow chart illustrating the use of a spider software application according to one embodiment of the present invention. [0022]
  • DETAILED DESCRIPTION
  • A method and apparatus for identifying images is described. In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present invention. It will be evident, however, to one skilled in the art that the present invention may be practiced without the specific details. In other instances, well-known structures and devices are shown in block diagram form to facilitate explanation. The description of preferred embodiments is not intended to limit the scope of the claims appended hereto. [0023]
  • The present invention is a method and apparatus for analyzing, identifying, and comparing images. The method can be used with any visually-displayed medium that is represented in any type of color space. The present invention can be used for purposes including but not limited identifying a particular image, authenticating an image as being identical to a particular image, registering an image, for example with a registry, organization, database, or digital library, marking an image for subsequent identification, or identifying copies of a particular image. [0024]
  • In one embodiment, the present invention is implemented using a computer. Such computer can include but is not limited to a personal computer, network computer, network server computer, dummy terminal, local area network, wide area network, personal digital assistant, work station, minicomputer, and mainframe computer. The identification, search and/or comparison features of the present invention can be implemented as one or more software applications, software modules, firmware such as a programmable ROM or EEPROM, hardware such as an application-specific integrated circuit (“ASIC”), or any combination of the above. [0025]
  • FIG. 1 is a block diagram of a [0026] computer network system 100 according to one embodiment of the present invention. In computer network system 100, a network server computer 104 is connected to a network client computer 102 through a network 110. The network interface between server computer 104 and client computer 102 can also include one or more routers, such as routers 106 and 108. The routers serve to buffer and route the data transmitted between the server and client computers. Network 110 may be the Internet, a Wide Area Network (WAN), a Local Area Network (LAN), or any combination thereof. In one embodiment of the present invention, the server computer 104 is a World-Wide Web (WWW) server that stores data in the form of ‘web pages’ and transmits these pages as Hypertext Markup Language (HTML) files over the Internet network 110 to client computer 102. It should be noted that, although only one server and client computer each are illustrated in network system 100, a network that implements embodiments of the present invention may include a large number of interconnected client and server computers.
  • For example, one or more software applications accessible to a computer can be used to determine the identification information for the selected image characteristics. Software applications can also be used to compare images, provide notification of identical images, and to generate a database of identified images. Any or all of the software applications or hardware configurations of the present invention can be implemented by one skilled in the art using well known programming techniques and hardware components. [0027]
  • The original data source for the original reference image, and for any subsequently-identified comparison images can be in any appropriate form, including but not limited to processed film (black-and-white, color, or negatives), video, CD, CD-ROM, photographs, optical disks, magazines, brochures, newspapers, books, paintings, and computer images. Computer image data sources can be stored in any format including but not limited to JPG, GIF, TIFF, PNG, PCX, MacPaint, GEM, IFF/ILBM, Targa, Microsoft Windows Device Independent Bitmap, WordPerfect Graphics, Sun Raster files, PBM, X Windows bitmaps, FITS, DXF, HPGL, Lotus PIC, UNIX plot format, PCL, Basic PostScript graphics, WMF, PICT, CGM, RIB, FLI/FLC, MPEG, QuickTIme animations, Kodak ICC, PDS, RIFF, SGI, XPM, HP Paintjet, PC Paint, Utah RLE, VICAR, and XPM. [0028]
  • In one embodiment, the present invention is a vendor-provided service, with the image identification, search, and any image comparisons performed by the vendor for use by users or customers. In this embodiment, the software applications, firmware, and hardware for implementing the invention reside with the vendor. A user can electronically access information previously obtained by the vendor, can request that a search be performed for specific information, and can provide an image for comparison with a database, file, library of stored images, or any other image. In one embodiment, the user provides an image for identification by the vendor. The vendor stores the identification information for this image and searches, for example on the Internet, for duplicate images. The user is notified when a duplicate image is located. [0029]
  • In alternative embodiments of the present invention, the entire process and apparatus or any portion thereof can reside with one or more users or third parties. In this embodiment, the present invention can be implemented as one or more software applications, software modules, firmware; and hardware that are provided to individual users for their utilization. [0030]
  • The computer can be adapted for communication with an electronic network such as the Internet. As a result, the method according to the present invention can be used to identify images stored on an electronic network, such as images displayed on a World Wide Web (“Web”) page. FIG. 2 is a block diagram illustrating an [0031] apparatus 200 for accessing an electronic network, according one embodiment of the present invention. In this embodiment, a computer 202 is adapted for communication with an electronic network 204 such as the Internet. Identified reference images 206 can be stored on the computer, for example, in a database. A spider or search engine 208, also resident on the computer, can be used to search the electronic network for images. The identification of retrieved images can then be performed using a software application 210 resident on the computer.
  • In an alternative embodiment of the present invention, the image identification is performed manually. Similarly, the comparison of an identified image with another image can be performed either manually, or by using a computer. [0032]
  • In the present invention, an image's displayed composition is parsed to generate unique image characteristics. At least one characteristic of the image's color space is selected and determined for a displayed image. The information determined for each selected characteristic comprises a unique description of an image. This identification information can be then used to compare different identified images to determine if they are identical. [0033]
  • In the preferred embodiment of the invention, the selected characteristics include color distribution, color space usage, color range distance, and image size. The selected characteristics can be determined in any order. In alternative embodiments, any or all of the characteristics of a color space can be used to identify an image according to the present invention. For purposes of explaining the present invention, the examples described herein use the RGB color space. However, any suitable display type or color space type can be used, including but not limited to RGB, YIQ, YUV, YDbDr, and YCbCr. [0034]
  • The RGB color space is an “additive” color system. In the RGB color space, all colors are represented according to the values of the red, green, and blue components required to produce each color. Each of the three component colors is divided into 256 digital steps. Therefore, black is represented as 0,0,0 and white, which contains the maximum amount of all three colors is 255,255,255. [0035]
  • FIG. 3 is a flow chart of a method for identifying an image according to the present invention. The image data is obtained from the data source and, if necessary, is converted to the color space being used in the [0036] identification procedure 300. For example, a JPG file format image can be converted to the RGB color space.
  • Color ranges for the particular color space are then defined by divided the total color range for the particular color space into a specific number of [0037] groups 302. Image colors used in the image are assigned to their defined color ranges and color usage counts for each color range are recorded 304. The average farthest distance between color points in each color range is then derived 306. The image's display width and height for the current display medium is also determined 308.
  • The image is identified by taking the average of the color range distribution, color usage counts, and color distances, and by making each of the averaged characteristics relative to 100% of all characteristic ranges [0038] 310.
  • FIG. 4 is a flow chart illustrating the determination of an image's color distribution according to the preferred embodiment of the present invention. In a first step, all possible display ranges for a media type pixel are defined [0039] 400. For a RGB color space, the display range is from 0,0,0 through 255,255,255.
  • Each display range is divided into groups of N elements, where N represents the total number of discreet elements desired [0040] 402. N can be any value from 1 to the maximum number of color values in a display range. For example, in an RGB color space, if N=32, then the first group of 32 elements is from 0,0,0 through 7,255,255. The second group of 32 elements is from 8,0,0 through 15,255,255. The third group of 32 elements is from 16,0,0 through 31,255,255. The remaining groups are similarly determined, with the last group of 32 elements being from 247,0,0 through 255,255,255. The image Color Distribution can be generated using methods including but not limited to one or more software applications, a calculator, or by hand calculation. Range sizes can differ among the selected characteristics in an image identification procedure according to the present invention.
  • The color value is then determined for each pixel in the [0041] image 404. In the preferred embodiment of the present invention, a plurality of color values are combined to provide an expressed color value 406. In an alternative embodiment, however, no such color values are combined. The color values can be combined in several different manners. In one embodiment, the color values are combined by grouping colors that cannot be distinguished by visual inspection 408. For example, color 233,233,233 can be considered the same color as 233,233,232 or 233,232,234 for purposes of the present invention. In this example, the three visually indistinguishable colors are considered to be the same color and are counted as one instead of three colors in the color space range. This method is used to advantage in averaging out display media differences when comparing screen-captured images.
  • In an alternative embodiment, the color values are combined by truncating a specified number of the lower bits representing each [0042] component color value 410. The truncated component color values are re-calculated. After the truncation step, all colors having the same component color values are then combined 412. For example, the binary representation of the number 255 is 11111111. The RGB color space color 233,233,233 would therefore be represented as:
  • 11101001,11101001,11101001. [0043]
  • The last four bits of each color component's value are underlined for emphasis. The last four bits of each color component's value are truncated to produce the color value: [0044]
  • 11100000,11100000,11100000. [0045]
  • Similarly, the RGB color 236,236,236 is represented as: [0046]
  • 11101100,11101100,11101100. [0047]
  • The last four bits of each component color's value can be truncated to also produce the color value: [0048]
  • 11100000,11100000,11100000. [0049]
  • Therefore, in this preferred embodiment, the RGB colors 233,233,233 and 236,236,236 will be considered to be the same color. This method is advantageous because it allows you to create a color table of 4096 elements that can be stored and directly indexed in memory. [0050]
  • The number of expressed color values in each group of N elements for which there is at least one pixel with a corresponding color value is then determined [0051] 414. As an example, if the image included one pixel having the value 1,244,244, then the range 0,0,0 through 7,255,255, would have at a minimum one of its color space values used in the image. Only one color space element is considered to be used when the image includes a plurality of pixels whose color values are combined and considered to be the same color, as discussed previously.
  • Once all color space range elements used by pixels in the image are determined, the total number of color space range elements of each color space range can optionally be divided by the total color space range elements used in all the color space ranges [0052] 416. This will generate the percentage of elements used in each of the color space ranges.
  • In the following example, the total number of color ranges is two, and a total of three color elements are used: [0053]
    Range: 0,0,0 to 127,255,255 128,0,0 to 255,255,255
    Colors Used: 1 2
    Total Colors Used: 1     + 2     =  3
    Range %: 1/3 = 33% 2/3 = 66%
  • In the previous example, the color space distribution is 33%, 66% for a two range color space. In alternative embodiments of the present invention, the range elements are represented by other methods including but not limited to averaging, and calculating the deviation from a specific point. [0054]
  • The image's color space usage is determined by, for each color range defined in the image's color space, counting the number of pixels that use a color element in the color range. Once all such pixel usage counts have been done, each color space range total pixel count can optionally be divided by the total number of pixels used in the image. This generates the percentage of usage for each specific color range of the color space. Other representational methods such as averaging or calculating deviation from a specific point can also optionally be used. [0055]
  • In the following example, the total number of color ranges is two, and the image has four pixels. Three pixels use colors defined in the first color range and one pixel uses a color defined in the second color range. [0056]
    Range: 0,0,0 to 127,255,255 128,0,0 to 255,255,255
    Color Element 3     + 1     =  4
    Usage Count:
    Usage %: 3/4 = 75% 1/4 = 25%
  • Color range distance is determined by determining the distance between the two farthest points of each color element defined in each color range. For example, when distance is defined as:[0057]
  • Point 1 X 1=20, Y 1=10
  • Point 2 X 2=30, Y 2=15
  • Distance=|(X 2 −X 1)|×|(Y 2 −Y 1)|=|(30−20)|×|(15−10)|=50
  • The total distances for each color range are then averaged. The color range distance can be represented by any other methods such as deviation from a specific point. An example of color range distancing using averaging is as follows:[0058]
  • Color Range Distance=(CRE1+CRE2+ . . . +CREN)÷Total CRE's for a range
  • where CRE=Color Range Element. [0059]
  • Image size is derived by determining the width and height of an image. In one embodiment of the present invention, the width of an image is defined as the number of color space units used from right-to-left of the image, and the height of an image is the number of color space units used from the top-to-bottom of the image. It is readily apparent to one skilled in the art that the directions of measurement and the size of the color space units can be varied without departing from the scope and spirit of the present invention. [0060]
  • Once the selected characteristics of an image, such as the color distribution, color space usage, color range distance, and image size according to the preferred embodiment of the present invention are determined, this data constitutes identification information for the image. Depending on the number and type of selected characteristics, this identification information can uniquely identify the image. [0061]
  • In one embodiment of the present invention, the image identification information is used to identify copies of a reference image. The identification of such copies can be performed using methods including but not limited to one or more software applications, a calculator, or by hand calculation. [0062]
  • The identification information can be used to authenticate an image. For example, a work of computer art can be authenticated by generating the identification information according to the present invention. This authentication does not require the use of a prior art identification marker implanted within or associated with the image, such as a digital watermark. As a result, copies of an image authenticated according to the present invention can be readily identified even if the digital watermark has been cropped from the copied image. [0063]
  • The identification information according to the present invention can be used to authenticate, catalog, index, retrieve, identify, and register an image or images. In addition, the identification information can also be used to search for image copies including but not limited to reproductions, screen captures, and cropped areas. In one embodiment of the present invention, identification information for a reference and/or comparison image is stored in a computer-accessible database. [0064]
  • In the preferred embodiment of the present invention, the image identification and/or search is conducted for images stored on an electronic network, such as the Internet. However, in alternative embodiments, the teachings of the present invention can equally be applied to images stored on any type of storage or electronic storage medium, network, or system, including but not limited to CD-ROMs, Digital Video Disks, billboards, films, videos, photographs, posters, newspapers, books, and magazines. For example, a photograph can be electronically scanned and analyzed to determine its selected characteristics. The identification information thus generated for the photograph can be used to identify digital copies of the photograph that are stored on the Internet, or hard copies of the photograph on posters. [0065]
  • In the preferred embodiment of the present invention, a software search application, such as a search engine or a spider, is used to retrieve an image from an electronic network. For the purposes of this application, an Internet spider is a software application running on a node on a network. The spider software application is programmed to access other hosts' websites on the Internet and retrieve reference information from the HTML pages and images found on the visited sites. The retrieved data is loaded and stored on at least one database. This database can be on the same computer as the spider software application, or on another computer(s). [0066]
  • For the purposes of this application, a search engine is a software application that is programmed to use the retrieved data (reference information) stored in the database by the spider. The search engine locates websites that contain requested information and images that are based upon the stored reference information collected by the spider. [0067]
  • The teachings of the present invention can be implemented either using a proprietary or a commercially-available spider or search engine. Such commercially-available spider software applications or search engines include but are not limited to America On-Line's Web Crawler, Compaq Corporation's Alta Vista, Yahoo! Corporation's Yahoo!, InfoSeek Corporation's InfoSeek, Lycos Corporation's Lycos, and @Home Corporation's Excite. Any other search software application of other searching technique known to one skilled in the art can also be used. [0068]
  • An image retrieved using such spider or search engine can then be identified using the method of the present invention. The spider or search engine can be used to search an electronic network, such as the Internet, to seek out copies of an identified image. FIG. 5 is a diagram illustrating the use of a spider to search an electronic network according to one embodiment of the present invention. [0069]
  • In FIG. 5, a [0070] spider 502 according to the present invention is in communication with a database 504 that contains image identification information, also according to the present invention. The spider is also in communication with an electronic network, such as the Internet 500.
  • The spider is programmed to access different sites on the [0071] Internet 506, 508, 510, 512, 514, 516, 518, 520, 522, 524, 526. These sites can be selected by any appropriate means as described below in further detail. Images located by the spider can be retrieved and added to a database 528, identified and compared to image identification information from the database 504. Duplicate, copied, cropped, and transformed versions of the reference image can thereby be located and identified. The database 528 in which the spider stores retrieved reference information can be the same database as the image identification information database 504, or can be a separate database as illustrated in FIG. 5.
  • FIG. 6 is a flow chart illustrating the use of a spider software application according to one embodiment of the present invention. In the Figure, the reference image identification information is provided to the [0072] spider 600. The search parameters, such as the Internet sites that the spider is to search are also provided to the spider 602. The spider then accesses and searches the selected search locations 604. The spider can be configured to, for example, locate and identify each image available on a visited site. The image identification can be performed either by the spider software application itself, or by another software application resident upon a computer to which the spider transmits a located image.
  • For each located image that is identified, the located image identification information is stored in a [0073] database 606. This located image identification information is compared to reference image identification information 608 for one or more images that is stored in the same or in a separate database.
  • A report indicating a possible duplicate image is generated for each located image whose identification information matches within a selected percentage of the reference [0074] image identification data 610. A secondary comparison can be performed on any such possible duplicate images located 612. For example, a possible duplicate image can be reloaded to the computer and compared to the reference image using pattern matching, quadrant frequency, usage counts, or any other applicable method. The results of the secondary comparison can then be reported.
  • In one embodiment, the spider or search engine is provided with an alarm or notification feature. Such features can include notifying an operator that an image match has occurred, notifying another party that an image match has occurred, and notifying the addressee of a particular site that an image(s) on that site matches an image(s) on another site. An alarm or notification can be visually displayed by using, for example, a text message, flashing display, color display, different font type or size, shading, borders, graying out, highlighting, animation, audio display, sound alarm, audibly broadcast message, and printed notice. [0075]
  • An alarm or notification can be stored for later retrieval, configured to display at particular times, or conditioned upon the occurrence of particular events. For example, the notification can be triggered to display every ten minutes, every time an image match is found, every time ten image matches are found, when no image match is found, to identify the total number of images on a site or electronic network, and to identify the total number or percentage of matching images or sites having matching images. [0076]
  • A search for duplicate images can be performed at the direction of user, or can be performed automatically. For example, the user can have a particular image identified and compared to an authenticated image to determine of the images are identical. Alternatively, the search engine or spider can be configured to search for and to determine the selected characteristics of am image or group of images. The spider or search engine can be programmed to locate all images at a particular site, locate images and identify only specific images, locate and identify all images at a particular site, compare located images with a predetermined identified image, and compare located images with each other to identify sites containing identical images. [0077]
  • An example illustrating one embodiment of the present invention is hereby provided as Example 1. In Example 1, an image in the RGB color space is identified and compared to another image to determine if the two images are duplicates. A duplicate image according to the present invention maintains a certain percentage of identity with the reference image. This percentage can vary according to the method of duplication, or according to whether the image was duplicated in its entirety. [0078]
  • According to one embodiment of the present invention, the closer the selected characteristics of the suspected duplicate image are to those of the reference image, the greater the amount of duplication of the two images. For example, a direct copy of an image file to another file of the same type and storage specifications would approach a 100% match of selected characteristics. However, a copy of an image file from, for example, the JPG format to the GIF format, a cropped copy, or a copy saved as a smaller JPG file could alter the selected characteristics. Therefore, the percentage of identity between the selected characteristics of the suspected duplicate image and the reference image would be less than 100%. [0079]
  • In one embodiment of the present invention, a set of predetermined criteria is used to ascertain whether a second image is a duplicate of a first image. Such criteria can include the percentage of identity of the determined characteristics of the compared image. Thus, if the determined characteristics are identical within the predetermined percentage, the images will be considered to be duplicates. The predetermined criteria can be adjusted to permit the identification of images that are identical in part, such as a clipped copy of an image compared to an original. [0080]
  • As an example, a comparison of two images to determine 100% identity of selected characteristics could be used to identify a direct copy of an image file to another file of the same type and storage specifications, as described above. Such a comparison might not identify an image copied to another format in which certain image characteristics are altered. However, a comparison to determine 80% identify of selected characteristics might be sufficient to identify such duplicate image stored in a different format. [0081]
  • In Example 1, four characteristics of the image composition are selected, Color Distribution, Color Space Usage, Color Range Distance, and Image Size. One skilled in the art will recognize that other amounts and types of image characteristics could be used to identify an image according to the present invention. For example, Image Depth could be a selected characteristic for a three-dimensional rendering, and Image Size might not be selected for standard image size databases. The steps performed in Example 1 can be performed in any suitable order. Steps can be combined and additional steps can be added to accomplish the image identification according to the present invention. [0082]
  • EXAMPLE 1
  • Image[0083] 1=Reference image
  • Image[0084] 2=Comparison image
  • I. Image Identification: [0085]
  • Number of Ranges for: [0086]
  • Color Distribution=32 [0087]
  • Color Space Usage=32 [0088]
  • Color Range Distance=32[0089]
  • Step 1: All colors used in the reference image are assigned to one of 32 different ranges in the RGB color space to generate the image Color Distribution, starting with white 255,255,255 and ending with black 0,0,0. For example, [0090] Range 1 is 255,255,255 through 247,0,0 and Range 2=246,255,255. The remaining ranges are similarly determined.
  • Step 2: The percentage of color elements used by the reference image in each RGB color space range is generated. [0091]
  • Step 3: The percentage that each color range is used in the reference image in the RGB color space is generated. [0092]
  • Step 4: The average distance between the two farthest points of each color in a Color Range is generated for each Color Range. [0093]
  • Step 5: The image height and width for the specific selected display model is determined.[0094]
  • II. Image Comparison:[0095]
  • Step 6: Image Distribution Characteristic (“IDC”) [0096]
  • a. For each Range defined for the IDC: [0097]
  • Compare [0098] Image 1, Ranges 1 through N to Image2, Ranges 1 through N.
  • b. Record the differences found in each of the comparisons of step 6a . Ranges not used by either image are ignored. [0099]
  • c. The image differences results are subtotaled for each range and totaled for all ranges. The total for all ranges is divided by the total number of ranges.[0100]
  • IDC=[((Image1, Range1)÷(Image2, Range1))+((Image1, Range2)÷(Image2, Range2))+ . . . . . . ((Image1, RangeN)÷(Image2, RangeN))]÷N
  • Step 7: Image Usage Characteristic (“IUC”) [0101]
  • a. For each Range defined for the IUC: [0102]
  • Compare Image[0103] 1, Ranges 1 through N Usage to Image2, Ranges 1 through N Usage.
  • b. Record the differences found in each of the comparisons of step 7a. Ranges not used by either image are ignored. [0104]
  • c. The image differences results are subtotaled for each range and totaled for all ranges. The total for all ranges is divided by the total number of ranges to derive the individual Usage Characteristic match for the two images.[0105]
  • IDC=[((Image1, Range1 Usage)÷(Image2, Range1 Usage))+((Image1, Range2 Usage)+(Image2, Range2 Usage))+((Image1, RangeN Usage)+(Image2, RangeN Usage))]÷N
  • Step 8: Image Distance Characteristic (“IDIC”) [0106]
  • a. For each Range defined for the IDIC: [0107]
  • Compare Image[0108] 1, Ranges 1 through N Distance to Image2, Ranges 1 through N Distance.
  • b. Record the differences found in each of the comparisons of step 8a. Ranges not used by either image are ignored. [0109]
  • c. Optionally weight distance. For each Range distance, multiply it by the IUC percentage of the corresponding Image[0110] 1 Range (or by some other selected Usage factor). This procedure weights the distance to the relative use of its Color Range. Thus, when comparing one distance range to another, a distance whose representative color forms a larger percentage of the image will be weighted more heavily than a distance whose representative color forms a smaller percentage of the image.
  • d. The image differences results are subtotaled for each range and totaled for all ranges. The total for all ranges is divided by the total number of ranges to derive the individual Distance Characteristic match for the two images.[0111]
  • IDIC=[(((Image1, Range1 Distance)×(Image1, Range1 Usage))÷(Image2, Range1 Usage))+(((Image1, Range2 Distance)×(Image1, Range2 Usage))÷(Image2, Range2 Usage))+ . . . . . . (((Image1, RangeN Distance)×(Image1, RangeN Usage))÷(Image2, RangeN Usage))]÷N
  • Step 9: Image Size Characteristic (“ISC”) [0112]
  • a. For each Range defined for the ISC: [0113]
  • Compare Image[0114] 1, Ranges 1 through N Size to Image2, Ranges 1 through N Size.
  • b. Record the differences found in each of the comparisons of step 9a. Ranges not used by either image are ignored. [0115]
  • c. The image differences results are subtotaled for each range and totaled for all ranges. The total for all ranges is divided by the total number of ranges to derive the individual Size Characteristic match for the two images.[0116]
  • ISC=[((Image1, Range1 Size)÷(Image2, Range1 Size))+((Image1, Range2 Size)÷(Image2, Range2 Size))+ . . . . . . ((Image1, RangeN Size)÷(Image2, RangeN Size))]+N
  • Step 10: Average the four selected group characteristic differences to derive the Percent Probability (“PP”) that Image[0117] 2 is a copy of reference Image1:
  • PP=(IDC+IUC+IDIC+ISC)÷4
  • Depending upon the probability ranges selected for the comparison process, a PP of 100 can be considered to be a 100% match. PP ranges can be selected from 0% to 100%. Second level or above testing can be performed to confirm an image match. For example, one or both images can be re-analyzed using different characteristics, visually inspected, analyzed using pattern matching techniques to confirm such match. Such tests can be computer-implemented, performed by a person, or both. [0118]
  • Although the present invention has been described with reference to specific exemplary embodiments, it will be evident that various modifications and changes may be made to these embodiments without departing from the broader spirit and scope of the invention as set forth in the claims. Accordingly, the specification and drawings are to be regarded in an illustrative rather than a restrictive sense. [0119]
  • For example, the present invention can be used with data, images, libraries and files stored in any suitable file or data storage program including but not limited to Claris Filemaker, Microsoft's Office and Excel, and the database programs and applications of Lotus, Oracle Corporation, Informix, and Sybase. [0120]

Claims (35)

What is claimed is:
1. A method for analyzing image information, comprising the steps of:
selecting at least one characteristic of a color space; and
determining the selected characteristic for a displayed image;
wherein the determined image characteristic can be used to identify the image.
2. The method of claim 1, further comprising the steps of:
determining the image's color distribution;
determining the image's color space usage;
determining the image's color range distance; and
determining the image's image size;
wherein the determined color distribution, color space usage, color range distance, and image size can be used to identify the image.
3. The method of claim 2, wherein the determination of the image's color distribution further comprises the steps of:
defining all possible display ranges for a pixel of a selected color space;
dividing the ranges into groups of N elements, wherein N is the total number of desired discrete finger print elements;
determining the color value for each pixel in the image; and
determining the number of expressed color values in each group of N elements for which there is at least one pixel with a corresponding color value.
4. The method of claim 3, further comprising the step of, for each group of N elements, dividing the number of expressed color values of the group with the total number of color values for all groups.
5. The method of claim 3, further comprising the step of combining a plurality of color values as a single expressed color value.
6. The method of claim 5, wherein the plurality of color values are combined by grouping colors that cannot be visually distinguished.
7. The method of claim 5, wherein, in an RGB color space, the plurality of color values are combined by
truncating a specified number of the lower bits representing one or more component colors of a first color value;
determining the value of the component colors of the first color value after the truncation; and
combining the first color value with any other color values whose color components are equal in value to the value of the component colors of the first color value after the truncation.
8. The method of claim 2, wherein the determination of the image's color space usage further comprises the step of, for each color range defined in the image's color space, counting the number of pixels that use a color element in the color range.
9. The method of claim 8, further comprising the step of, for each specific color range of the color space, dividing the total number of pixels using a color element in the color range by the total number of pixels used in the image to generate the percentage of usage for each specific color range of the color space.
10. The method of claim 2, wherein the determination of the image's color range distance further comprises the steps of:
determining the distance between the two farthest points of the color element for each color element of a color range defined in the image's color space; and
averaging the total distances for all color elements in the color range.
11. The method of claim 2, wherein the determination of the image's image size further comprises the step of determining the width and height of the image.
12. The method of claim 1, further comprising the step of comparing at least one determined image characteristic of a first image with the determined image characteristic of at least a second image.
13. The method of claim 12, further comprising the step of determining whether the first image is identical to the compared second image.
14. The method of claim 1, wherein the determination of the selected characteristic for a displayed image is computer-implemented.
15. A method for comparing a plurality of images, comprising the steps of
selecting a plurality of characteristics of a color space;
determining the selected characteristics for a first displayed image;
determining the selected characteristics for at least a second displayed image;
comparing the determined characteristics of the first and second displayed images; and
using a set of predefined criteria to determine whether the determined characteristics of the first displayed image match the determined characteristics of the at least a second displayed image.
16. The method of claim 15, wherein the set of predetermined criteria includes the percentage of identical characteristics.
17. A method for identifying a copy of an image, comprising the steps of:
identifying a first image;
storing identification information for the first image;
identifying a second image; and
comparing identification information for the second image with the stored identification information for the first image;
wherein if a predetermined set of criteria is met, the second image is identical to the first image.
18. The method of claim 17, wherein the first and second images are compared manually.
19. The method of claim 17, wherein the first and second images are compared automatically.
20. The method of claim 17, wherein the first and second images are retrieved from an electronic medium.
21. The method of claim 20, wherein the first and second images are manually or automatically retrieved from the electronic medium.
22. The method of claim 21, further comprising the step of using a search engine to locate the first or second image from an electronic network.
23. The method of claim 21, further comprising the step of using a spider to locate the first or second image from an electronic network.
24. The method of claim 23, wherein the spider is configured to identify any located images.
25. An article of manufacture embodying a program of instructions executable by a computer, the program of instructions including instructions for:
locating a second image from an electronic network;
determining selected characteristics of the second image;
comparing the selected characteristics of the second image with selected characteristics of a first image; and
determining whether the first and second images are identical based upon the comparison of selected characteristics.
26. The article of manufacture of claim 25, further comprising means for providing notification of identical first and second images.
27. The article of manufacture of claim 26, wherein the notification means is an alarm.
28. The article of manufacture of claim 25, further comprising means for generating a database of identified images.
29. A computer for communication with an electronic network, the computer comprising:
means for locating a second image from an electronic network;
means for determining selected characteristics of the second image;
means for comparing the selected characteristics of the second image with the selected characteristics of a first image; and
means for determining whether the first and second images are identical based upon the comparison of selected characteristics.
30. The computer of claim 29 wherein the image characteristics are selected from the group consisting of image distribution characteristics, image usage characteristics, image distance characteristics, and image sizing characteristics.
31. The computer of claim 29, further comprising means for storing identification information of an image.
32. The computer of claim 29, wherein the means for determining whether the first and second images are identical further comprises means for comparing at least one predetermined criterion.
33. A method for retrieving image information from an electronic network, comprising the steps of:
using a search software application to locate at least a second image from the electronic network;
determining selected characteristics of the second image to identify the second image; and
comparing the selected characteristics of the second image with selected characteristics of a first image;
wherein if a predetermined set of criteria is met, the second image is identical to the first image.
34. The method of claim 33, wherein the search software application is selected from the group consisting of search engines and spiders.
35. The method of claim 33, wherein the search software application is adapted to identify any located images.
US10/653,608 1998-03-20 2003-09-02 Method and apparatus for image identification and comparison Abandoned US20040190794A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
US10/653,608 US20040190794A1 (en) 1998-03-20 2003-09-02 Method and apparatus for image identification and comparison

Applications Claiming Priority (3)

Application Number Priority Date Filing Date Title
US7887898P 1998-03-20 1998-03-20
US09/271,112 US6628824B1 (en) 1998-03-20 1999-03-17 Method and apparatus for image identification and comparison
US10/653,608 US20040190794A1 (en) 1998-03-20 2003-09-02 Method and apparatus for image identification and comparison

Related Parent Applications (1)

Application Number Title Priority Date Filing Date
US09/271,112 Division US6628824B1 (en) 1998-03-20 1999-03-17 Method and apparatus for image identification and comparison

Publications (1)

Publication Number Publication Date
US20040190794A1 true US20040190794A1 (en) 2004-09-30

Family

ID=28456534

Family Applications (2)

Application Number Title Priority Date Filing Date
US09/271,112 Expired - Fee Related US6628824B1 (en) 1998-03-20 1999-03-17 Method and apparatus for image identification and comparison
US10/653,608 Abandoned US20040190794A1 (en) 1998-03-20 2003-09-02 Method and apparatus for image identification and comparison

Family Applications Before (1)

Application Number Title Priority Date Filing Date
US09/271,112 Expired - Fee Related US6628824B1 (en) 1998-03-20 1999-03-17 Method and apparatus for image identification and comparison

Country Status (1)

Country Link
US (2) US6628824B1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050063667A1 (en) * 2002-05-31 2005-03-24 Microsoft Corporation System and method for identifying and segmenting repeating media objects embedded in a stream
US20070146833A1 (en) * 2005-12-22 2007-06-28 Canon Kabushiki Kaisha Image editing system, image management apparatus, and image editing program
US20070292112A1 (en) * 2006-06-15 2007-12-20 Lee Shih-Hung Searching method of searching highlight in film of tennis game
US20080155409A1 (en) * 2006-06-19 2008-06-26 Andy Santana Internet search engine
US20130145303A1 (en) * 2011-06-17 2013-06-06 Nokia Corporation Method and apparatus for providing a notification mechanism
US20140218496A1 (en) * 2011-09-08 2014-08-07 Lg Electronics Inc. Health care system based on video in remote health care solution and method for providing health care service
US8879837B2 (en) 2011-06-27 2014-11-04 International Business Machines Corporation Method for identifying pairs of derivative and original images
US20150187038A1 (en) * 2013-12-27 2015-07-02 General Electric Company System for integrated protocol and decision support
CN111581409A (en) * 2020-05-13 2020-08-25 中国民用航空飞行学院 Damage image feature database construction method and system and engine

Families Citing this family (57)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7010144B1 (en) * 1994-10-21 2006-03-07 Digimarc Corporation Associating data with images in imaging systems
US6449377B1 (en) * 1995-05-08 2002-09-10 Digimarc Corporation Methods and systems for watermark processing of line art images
US8429205B2 (en) 1995-07-27 2013-04-23 Digimarc Corporation Associating data with media signals in media signal systems through auxiliary data steganographically embedded in the media signals
US6735253B1 (en) * 1997-05-16 2004-05-11 The Trustees Of Columbia University In The City Of New York Methods and architecture for indexing and editing compressed video over the world wide web
US7653635B1 (en) 1998-11-06 2010-01-26 The Trustees Of Columbia University In The City Of New York Systems and methods for interoperable multimedia content descriptions
US7143434B1 (en) 1998-11-06 2006-11-28 Seungyup Paek Video description system and method
WO2000034867A1 (en) 1998-12-09 2000-06-15 Network Ice Corporation A method and apparatus for providing network and computer system security
US7346929B1 (en) 1999-07-29 2008-03-18 International Business Machines Corporation Method and apparatus for auditing network security
US6999636B1 (en) * 1999-11-09 2006-02-14 Canon Kabushiki Kaisha Image search method and apparatus
US8006243B2 (en) 1999-12-07 2011-08-23 International Business Machines Corporation Method and apparatus for remote installation of network drivers and software
AU2637101A (en) * 2000-01-07 2001-07-24 Ideo Product Development Inc. System and method for image capture and management in an electronic device
US20010041021A1 (en) * 2000-02-04 2001-11-15 Boyle Dennis J. System and method for synchronization of image data between a handheld device and a computer
AU2001257400A1 (en) 2000-04-28 2001-11-12 Internet Security Systems, Inc. System and method for managing security events on a network
US20040125877A1 (en) * 2000-07-17 2004-07-01 Shin-Fu Chang Method and system for indexing and content-based adaptive streaming of digital video content
US7747673B1 (en) * 2000-09-08 2010-06-29 Corel Corporation Method and apparatus for communicating during automated data processing
CN1440521A (en) * 2000-10-08 2003-09-03 皇家菲利浦电子有限公司 Method of organizing and presenting message and deadline information in electronic calendar system
US9027121B2 (en) * 2000-10-10 2015-05-05 International Business Machines Corporation Method and system for creating a record for one or more computer security incidents
US6978419B1 (en) * 2000-11-15 2005-12-20 Justsystem Corporation Method and apparatus for efficient identification of duplicate and near-duplicate documents and text spans using high-discriminability text fragments
US7043473B1 (en) * 2000-11-22 2006-05-09 Widevine Technologies, Inc. Media tracking system and method
US7130466B2 (en) * 2000-12-21 2006-10-31 Cobion Ag System and method for compiling images from a database and comparing the compiled images with known images
AU2002243763A1 (en) 2001-01-31 2002-08-12 Internet Security Systems, Inc. Method and system for configuring and scheduling security audits of a computer network
US7657419B2 (en) 2001-06-19 2010-02-02 International Business Machines Corporation Analytical virtual machine
US7339992B2 (en) 2001-12-06 2008-03-04 The Trustees Of Columbia University In The City Of New York System and method for extracting text captions from video and generating video summaries
JP3848877B2 (en) * 2001-12-27 2006-11-22 三菱重工業株式会社 Color tone control method and apparatus for printing press
WO2003058451A1 (en) 2002-01-04 2003-07-17 Internet Security Systems, Inc. System and method for the managed security control of processes on a computer system
US7913303B1 (en) 2003-01-21 2011-03-22 International Business Machines Corporation Method and system for dynamically protecting a computer system from attack
US20040210575A1 (en) * 2003-04-18 2004-10-21 Bean Douglas M. Systems and methods for eliminating duplicate documents
JP4336950B2 (en) * 2003-05-15 2009-09-30 富士ゼロックス株式会社 Image processing device
US20050108540A1 (en) * 2003-09-26 2005-05-19 Budi Kusnoto Digital image validations system (DIVA)
US7657938B2 (en) 2003-10-28 2010-02-02 International Business Machines Corporation Method and system for protecting computer networks by altering unwanted network data traffic
US20050168588A1 (en) * 2004-02-04 2005-08-04 Clay Fisher Methods and apparatuses for broadcasting information
JP4795941B2 (en) * 2004-05-18 2011-10-19 パナソニック株式会社 Image processing device
US9700334B2 (en) * 2004-11-23 2017-07-11 Intuitive Surgical Operations, Inc. Articulating mechanisms and link systems with torque transmission in remote manipulation of instruments and tools
WO2006058292A2 (en) * 2004-11-29 2006-06-01 Purdue Research Foundation Methods for retrieving shapes and drawings
US20060120686A1 (en) * 2004-12-03 2006-06-08 Frank Liebenow Method, apparatus and system for storage and retrieval of images
WO2006096612A2 (en) 2005-03-04 2006-09-14 The Trustees Of Columbia University In The City Of New York System and method for motion estimation and mode decision for low-complexity h.264 decoder
WO2006116751A2 (en) * 2005-04-28 2006-11-02 Ultradots Inc. Germanium-based polymers and products formed from germanium-based polymers
US20090116753A1 (en) * 2005-09-12 2009-05-07 Ultradots, Inc. Authenticating and identifying objects using nanoparticles
JP4662873B2 (en) * 2006-03-23 2011-03-30 Hoya株式会社 Pattern matching system
US20080027985A1 (en) * 2006-07-31 2008-01-31 Microsoft Corporation Generating spatial multimedia indices for multimedia corpuses
US7712052B2 (en) 2006-07-31 2010-05-04 Microsoft Corporation Applications of three-dimensional environments constructed from images
US7764849B2 (en) * 2006-07-31 2010-07-27 Microsoft Corporation User interface for navigating through images
US20080288350A1 (en) * 2007-05-18 2008-11-20 Qwikplay Llc System and method for enabling advertisers to purchase advertisement space in video games
WO2009126785A2 (en) 2008-04-10 2009-10-15 The Trustees Of Columbia University In The City Of New York Systems and methods for image archaeology
CN101582941A (en) * 2008-05-13 2009-11-18 鸿富锦精密工业(深圳)有限公司 Communication terminal and number inquiry method
WO2009155281A1 (en) 2008-06-17 2009-12-23 The Trustees Of Columbia University In The City Of New York System and method for dynamically and interactively searching media data
US8671069B2 (en) 2008-12-22 2014-03-11 The Trustees Of Columbia University, In The City Of New York Rapid image annotation via brain state decoding and visual pattern mining
US20100169757A1 (en) * 2008-12-26 2010-07-01 Adam Jude Ahne Filtering Method for Evaluating Patents
CN101576932B (en) * 2009-06-16 2012-07-04 阿里巴巴集团控股有限公司 Close-repetitive picture computer searching method and device
US8774561B2 (en) 2010-09-01 2014-07-08 Apple Inc. Consolidating information relating to duplicate images
US11016938B2 (en) 2010-09-01 2021-05-25 Apple Inc. Consolidating information relating to duplicate images
US9372871B2 (en) * 2012-08-24 2016-06-21 Google Inc. Combining unstructured image and 3D search results for interactive search and exploration
ES2530687B1 (en) * 2013-09-04 2016-08-19 Shot & Shop. S.L. Method implemented by computer for image recovery by content and computer program of the same
US10078977B2 (en) * 2015-12-04 2018-09-18 Chromera, Inc. Optically determining messages on a display
US20180101540A1 (en) * 2016-10-10 2018-04-12 Facebook, Inc. Diversifying Media Search Results on Online Social Networks
US10460412B1 (en) 2018-01-07 2019-10-29 Robert Louis Stupack Authentication of Norman Rockwell paintings
CN112335351B (en) * 2020-11-06 2021-12-28 太原理工大学 Lever puller with image recognition function

Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4246568A (en) * 1978-12-08 1981-01-20 Peterson Vernon L Apparatus and method of personal identification by fingerprint comparison
US5579471A (en) * 1992-11-09 1996-11-26 International Business Machines Corporation Image query system and method
US5974412A (en) * 1997-09-24 1999-10-26 Sapient Health Network Intelligent query system for automatically indexing information in a database and automatically categorizing users
US6108437A (en) * 1997-11-14 2000-08-22 Seiko Epson Corporation Face recognition apparatus, method, system and computer readable medium thereof

Family Cites Families (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
DE4119489C2 (en) 1991-06-13 1994-09-29 Linotype Hell Ag Werk Kiel Multispectral color image acquisition system
EP0590759B1 (en) 1992-08-12 1998-12-09 International Business Machines Corporation System and method for locating video segment boundaries
JPH07123436A (en) 1993-10-27 1995-05-12 Matsushita Electric Ind Co Ltd Automatic white balance control circuit
JPH07283938A (en) 1994-04-13 1995-10-27 Ricoh Co Ltd Image forming device
US5848189A (en) 1996-03-25 1998-12-08 Focus Automation Systems Inc. Method, apparatus and system for verification of patterns
JPH10105705A (en) 1996-09-25 1998-04-24 Sony Corp Image collation device
JPH10187983A (en) 1996-12-26 1998-07-21 Sony Corp Image collating device
US6181817B1 (en) * 1997-11-17 2001-01-30 Cornell Research Foundation, Inc. Method and system for comparing data objects using joint histograms
US6345274B1 (en) * 1998-06-29 2002-02-05 Eastman Kodak Company Method and computer program product for subjective image content similarity-based retrieval

Patent Citations (4)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4246568A (en) * 1978-12-08 1981-01-20 Peterson Vernon L Apparatus and method of personal identification by fingerprint comparison
US5579471A (en) * 1992-11-09 1996-11-26 International Business Machines Corporation Image query system and method
US5974412A (en) * 1997-09-24 1999-10-26 Sapient Health Network Intelligent query system for automatically indexing information in a database and automatically categorizing users
US6108437A (en) * 1997-11-14 2000-08-22 Seiko Epson Corporation Face recognition apparatus, method, system and computer readable medium thereof

Cited By (15)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US20050063667A1 (en) * 2002-05-31 2005-03-24 Microsoft Corporation System and method for identifying and segmenting repeating media objects embedded in a stream
US20070146833A1 (en) * 2005-12-22 2007-06-28 Canon Kabushiki Kaisha Image editing system, image management apparatus, and image editing program
US8325398B2 (en) * 2005-12-22 2012-12-04 Canon Kabushiki Kaisha Image editing system, image management apparatus, and image editing program
US8842322B2 (en) * 2005-12-22 2014-09-23 Canon Kabushiki Kaisha Image editing system, image management apparatus, and image editing program
US20070292112A1 (en) * 2006-06-15 2007-12-20 Lee Shih-Hung Searching method of searching highlight in film of tennis game
US20080155409A1 (en) * 2006-06-19 2008-06-26 Andy Santana Internet search engine
US20180157406A1 (en) * 2011-06-17 2018-06-07 Nokia Technologies Oy Method and apparatus for providing a notification mechanism
US20130145303A1 (en) * 2011-06-17 2013-06-06 Nokia Corporation Method and apparatus for providing a notification mechanism
US11709588B2 (en) * 2011-06-17 2023-07-25 Nokia Technologies Oy Method and apparatus for providing a notification mechanism
US9891800B2 (en) * 2011-06-17 2018-02-13 Nokia Technologies Oy Method and apparatus for providing a notification mechanism
US8879837B2 (en) 2011-06-27 2014-11-04 International Business Machines Corporation Method for identifying pairs of derivative and original images
US20140218496A1 (en) * 2011-09-08 2014-08-07 Lg Electronics Inc. Health care system based on video in remote health care solution and method for providing health care service
US10037821B2 (en) * 2013-12-27 2018-07-31 General Electric Company System for integrated protocol and decision support
US20150187038A1 (en) * 2013-12-27 2015-07-02 General Electric Company System for integrated protocol and decision support
CN111581409A (en) * 2020-05-13 2020-08-25 中国民用航空飞行学院 Damage image feature database construction method and system and engine

Also Published As

Publication number Publication date
US6628824B1 (en) 2003-09-30

Similar Documents

Publication Publication Date Title
US6628824B1 (en) Method and apparatus for image identification and comparison
US8107739B2 (en) System and method for compiling images from a database and comparing the compiled images with known images
US7031555B2 (en) Perceptual similarity image retrieval
US7454061B2 (en) System, apparatus, and method for providing illegal use research service for image data, and system, apparatus, and method for providing proper use research service for image data
US6396963B2 (en) Photocollage generation and modification
US6871200B2 (en) Registration and monitoring system
US20040153653A1 (en) Preservations system for digitally created and digitally signed documents
EP1004967A1 (en) Photocollage generation and modification using image recognition
US7561310B2 (en) Method and apparatus for digital scanning and archiving
WO2001073585A2 (en) System and method for performing flood zone certifications
US7934097B1 (en) Method, apparatus, and system for managing, reviewing, comparing and detecting data on a wide area network
JP2007026386A (en) Image search system and method
JP2005038402A (en) Illicit use investigation service providing system of image data, device, method, program and recording medium
US8478033B2 (en) Image inspection apparatus and method
CN114610777A (en) Intelligent management system for civil archives based on block chain
WO2000067204A2 (en) Image analysis process
Thomee et al. Large scale image copy detection evaluation
US20070122062A1 (en) Method and system for processing employment related images
Beamsley Securing digital image assets in museums and libraries: A risk management approach
JP2003281148A (en) Method and system of document management
US20020172424A1 (en) Work identification system and signature management system
Kenney Digital to Microfilm Conversion: A Demonstration Project
CN114329616B (en) Credible file system based on block chain
KR102418865B1 (en) A database building method to digitize for public literature files
CN114691035A (en) Certificateless affair handling system based on block chain

Legal Events

Date Code Title Description
STCB Information on status: application discontinuation

Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION