CA2400085A1 - Visual attention system - Google Patents

Visual attention system Download PDF

Info

Publication number
CA2400085A1
CA2400085A1 CA002400085A CA2400085A CA2400085A1 CA 2400085 A1 CA2400085 A1 CA 2400085A1 CA 002400085 A CA002400085 A CA 002400085A CA 2400085 A CA2400085 A CA 2400085A CA 2400085 A1 CA2400085 A1 CA 2400085A1
Authority
CA
Canada
Prior art keywords
visual
image
visual attention
pixels
dissimilarities
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002400085A
Other languages
French (fr)
Other versions
CA2400085C (en
Inventor
Frederick Warwick Michael Stentiford
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
British Telecommunications PLC
Original Assignee
British Telecommunications Public Limited Company
Frederick Warwick Michael Stentiford
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Priority claimed from EP00301262A external-priority patent/EP1126411A1/en
Application filed by British Telecommunications Public Limited Company, Frederick Warwick Michael Stentiford filed Critical British Telecommunications Public Limited Company
Publication of CA2400085A1 publication Critical patent/CA2400085A1/en
Application granted granted Critical
Publication of CA2400085C publication Critical patent/CA2400085C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V10/00—Arrangements for image or video recognition or understanding
    • G06V10/40—Extraction of image or video features
    • G06V10/46—Descriptors for shape, contour or point-related descriptors, e.g. scale invariant feature transform [SIFT] or bags of words [BoW]; Salient regional features
    • G06V10/462—Salient features, e.g. scale invariant feature transforms [SIFT]

Abstract

This invention identifies the most significant features in visual scenes, without prior training, by measuring the difficulty in finding similarities between neighbourhoods in the scene. Pixels in an area that is similar to much of the rest of the scene score low measures of visual attention. On the other hand a region that possesses many dissimilarities with other parts of the image will attract a high measure of visual attention. The invention makes use of a trial and error process to find dissimilarities between parts of the image and does not require prior knowledge of the nature of the anomalies that may be present. The method avoids the use of processing dependencies between pixels and is capable of a straightforward parallel implementation for each pixel.
The invention is of wide application in searching for anomalous patterns in health screening, quality control processes and in analysis of visual ergonomics for assessing the visibility of signs and advertisements. The invention provides a measure of significant features to an image processor in order to provide variable rate image compression.
CA002400085A 2000-02-17 2001-02-08 Visual attention system Expired - Fee Related CA2400085C (en)

Applications Claiming Priority (5)

Application Number Priority Date Filing Date Title
EP00301262.2 2000-02-17
EP00301262A EP1126411A1 (en) 2000-02-17 2000-02-17 Visual attention location system
EP00307771 2000-09-08
EP00307771.6 2000-09-08
PCT/GB2001/000504 WO2001061648A2 (en) 2000-02-17 2001-02-08 Visual attention location system

Publications (2)

Publication Number Publication Date
CA2400085A1 true CA2400085A1 (en) 2001-08-23
CA2400085C CA2400085C (en) 2008-02-19

Family

ID=26073010

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002400085A Expired - Fee Related CA2400085C (en) 2000-02-17 2001-02-08 Visual attention system

Country Status (8)

Country Link
US (1) US6934415B2 (en)
EP (1) EP1281164B1 (en)
JP (1) JP4732660B2 (en)
KR (1) KR100821847B1 (en)
CN (1) CN1214349C (en)
AU (1) AU2001232029A1 (en)
CA (1) CA2400085C (en)
WO (1) WO2001061648A2 (en)

Families Citing this family (71)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1281164B1 (en) * 2000-02-17 2015-05-27 BRITISH TELECOMMUNICATIONS public limited company Visual attention location system
US20020154833A1 (en) * 2001-03-08 2002-10-24 Christof Koch Computation of intrinsic perceptual saliency in visual environments, and applications
US6870956B2 (en) 2001-06-14 2005-03-22 Microsoft Corporation Method and apparatus for shot detection
ES2256768T3 (en) 2002-03-22 2006-07-16 British Telecommunications Public Limited Company COMPARISON OF MODELS.
EP1488413B1 (en) 2002-03-22 2012-02-29 BRITISH TELECOMMUNICATIONS public limited company Anomaly recognition method for data streams
US7098117B2 (en) * 2002-10-18 2006-08-29 The Regents Of The University Of Michigan Method of fabricating a package with substantially vertical feedthroughs for micromachined or MEMS devices
US7116716B2 (en) * 2002-11-01 2006-10-03 Microsoft Corporation Systems and methods for generating a motion attention model
US7274741B2 (en) 2002-11-01 2007-09-25 Microsoft Corporation Systems and methods for generating a comprehensive user attention model
US20040088723A1 (en) * 2002-11-01 2004-05-06 Yu-Fei Ma Systems and methods for generating a video summary
US7130461B2 (en) * 2002-12-18 2006-10-31 Xerox Corporation Systems and method for automatically choosing visual characteristics to highlight a target against a background
GB0229625D0 (en) 2002-12-19 2003-01-22 British Telecomm Searching images
US7164798B2 (en) * 2003-02-18 2007-01-16 Microsoft Corporation Learning-based automatic commercial content detection
US7260261B2 (en) * 2003-02-20 2007-08-21 Microsoft Corporation Systems and methods for enhanced image adaptation
US7369167B2 (en) * 2003-06-02 2008-05-06 Micron Technology, Inc. Photo diode ID for CMOS imagers
US7400761B2 (en) * 2003-09-30 2008-07-15 Microsoft Corporation Contrast-based image attention analysis framework
US7471827B2 (en) 2003-10-16 2008-12-30 Microsoft Corporation Automatic browsing path generation to present image areas with high attention value as a function of space and time
JP4396430B2 (en) * 2003-11-25 2010-01-13 セイコーエプソン株式会社 Gaze guidance information generation system, gaze guidance information generation program, and gaze guidance information generation method
AU2004233453B2 (en) * 2003-12-03 2011-02-17 Envysion, Inc. Recording a sequence of images
GB0328326D0 (en) * 2003-12-05 2004-01-07 British Telecomm Image processing
JP4207883B2 (en) * 2004-03-24 2009-01-14 セイコーエプソン株式会社 Gaze guidance degree calculation system
US9053754B2 (en) * 2004-07-28 2015-06-09 Microsoft Technology Licensing, Llc Thumbnail generation and presentation for recorded TV programs
US7986372B2 (en) * 2004-08-02 2011-07-26 Microsoft Corporation Systems and methods for smart media content thumbnail extraction
KR101016429B1 (en) * 2004-09-03 2011-02-21 유칸시 인코포레이티드 Systems and methods for improving visual perception
WO2006030173A1 (en) 2004-09-17 2006-03-23 British Telecommunications Public Limited Company Analysis of patterns
US7562056B2 (en) * 2004-10-12 2009-07-14 Microsoft Corporation Method and system for learning an attention model for an image
EP1732030A1 (en) 2005-06-10 2006-12-13 BRITISH TELECOMMUNICATIONS public limited company Comparison of patterns
EP1908013B1 (en) 2005-07-28 2014-04-23 BRITISH TELECOMMUNICATIONS public limited company Image analysis
WO2007048061A2 (en) * 2005-10-21 2007-04-26 Amimon Ltd. Apparatus and method for uncompressed, wireless transmission of video
US20070297612A1 (en) * 2005-10-21 2007-12-27 Meir Feder Method, device and system of encrypted wireless communication
US8559525B2 (en) * 2005-10-21 2013-10-15 Amimon Ltd. Apparatus and method for uncompressed, wireless transmission of video
US7860180B2 (en) * 2005-10-21 2010-12-28 Amimon Ltd OFDM modem for transmission of continuous complex numbers
US8180826B2 (en) 2005-10-31 2012-05-15 Microsoft Corporation Media sharing and authoring on the web
US7773813B2 (en) * 2005-10-31 2010-08-10 Microsoft Corporation Capture-intention detection for video content analysis
US8196032B2 (en) * 2005-11-01 2012-06-05 Microsoft Corporation Template-based multimedia authoring and sharing
EP1798961A1 (en) 2005-12-19 2007-06-20 BRITISH TELECOMMUNICATIONS public limited company Method for focus control
US20070156382A1 (en) * 2005-12-29 2007-07-05 Graham James L Ii Systems and methods for designing experiments
US7599918B2 (en) * 2005-12-29 2009-10-06 Microsoft Corporation Dynamic search with implicit user intention mining
JP2007241479A (en) * 2006-03-06 2007-09-20 Toshiba Corp Variable area detecting device and method thereof
US7809170B2 (en) 2006-08-10 2010-10-05 Louisiana Tech University Foundation, Inc. Method and apparatus for choosing and evaluating sample size for biometric training process
TWI324326B (en) * 2006-11-03 2010-05-01 Univ Nat Taipei Technology A mura defect detection algorithm for flat panel displays
US8132096B1 (en) * 2007-03-26 2012-03-06 Hewlett-Packard Development Company, L.P. Image composition evaluation
US7940985B2 (en) * 2007-06-06 2011-05-10 Microsoft Corporation Salient object detection
EP2179393A4 (en) * 2007-07-03 2012-05-30 3M Innovative Properties Co System and method for generating time-slot samples to which content may be assigned for measuring effects of the assigned content
WO2009006542A2 (en) * 2007-07-03 2009-01-08 3M Innovative Properties Company System and method for assessing effectiveness of communication content
AU2008272901B2 (en) 2007-07-03 2011-03-17 3M Innovative Properties Company System and method for assigning pieces of content to time-slots samples for measuring effects of the assigned content
EP2101503A1 (en) 2008-03-11 2009-09-16 British Telecommunications Public Limited Company Video coding
US8326061B2 (en) * 2008-05-12 2012-12-04 Google Inc. Fast visual degrading of images
AU2009298428B2 (en) * 2008-10-03 2013-03-14 3M Innovative Properties Company Systems and methods for optimizing a scene
EP2386098A4 (en) 2009-01-07 2014-08-20 3M Innovative Properties Co System and method for concurrently conducting cause-and-effect experiments on content effectiveness and adjusting content distribution to optimize business objectives
KR101584115B1 (en) * 2009-03-31 2016-01-12 삼성전자주식회사 Device for generating visual attention map and method thereof
WO2011152893A1 (en) * 2010-02-10 2011-12-08 California Institute Of Technology Methods and systems for generating saliency models through linear and/or nonlinear integration
US8542875B2 (en) 2010-09-17 2013-09-24 Honeywell International Inc. Image processing based on visual attention and reduced search based generated regions of interest
US8504912B2 (en) * 2011-07-15 2013-08-06 Neodata Group S.R.L. System to forecast performance of online news articles to suggest the optimal homepage layout to maximize article readership and readers stickiness
CN102568016B (en) * 2012-01-03 2013-12-25 西安电子科技大学 Compressive sensing image target reconstruction method based on visual attention
US9042648B2 (en) * 2012-02-23 2015-05-26 Microsoft Technology Licensing, Llc Salient object segmentation
US8705870B2 (en) 2012-03-02 2014-04-22 Microsoft Corporation Image searching by approximate κ-NN graph
US9710493B2 (en) 2013-03-08 2017-07-18 Microsoft Technology Licensing, Llc Approximate K-means via cluster closures
US9866900B2 (en) * 2013-03-12 2018-01-09 The Nielsen Company (Us), Llc Methods, apparatus and articles of manufacture to detect shapes
US9128994B2 (en) * 2013-03-14 2015-09-08 Microsoft Technology Licensing, Llc Visually representing queries of multi-source data
WO2014198055A1 (en) * 2013-06-14 2014-12-18 Intel Corporation Image processing including adjoin feature based object detection, and/or bilateral symmetric object segmentation
US9245192B2 (en) 2013-09-20 2016-01-26 Here Global B.V. Ad collateral detection
US9373057B1 (en) 2013-11-01 2016-06-21 Google Inc. Training a neural network to detect objects in images
US10026010B2 (en) 2014-05-14 2018-07-17 At&T Intellectual Property I, L.P. Image quality estimation using a reference image portion
CN108139799B (en) * 2016-04-22 2022-01-14 深圳市大疆创新科技有限公司 System and method for processing image data based on a region of interest (ROI) of a user
US10776659B2 (en) 2016-08-26 2020-09-15 Goodrich Corporation Systems and methods for compressing data
US10685432B2 (en) * 2017-01-18 2020-06-16 Ricoh Company, Ltd. Information processing apparatus configured to determine whether an abnormality is present based on an integrated score, information processing method and recording medium
US10901726B2 (en) 2018-10-12 2021-01-26 International Business Machines Corporation Intelligent visual regression system
US20200160089A1 (en) * 2018-11-15 2020-05-21 International Business Machines Corporation Visual pattern recognition with selective illumination for assisted inspection
CN111079740A (en) * 2019-12-02 2020-04-28 咪咕文化科技有限公司 Image quality evaluation method, electronic device, and computer-readable storage medium
WO2023203493A1 (en) * 2022-04-18 2023-10-26 Lean Ai Technologies Ltd. Similarity map-based outliers detection
CN115171328B (en) * 2022-06-30 2023-11-10 国网北京市电力公司 Smoke and fire identification method, device, equipment and medium based on video compression coding

Family Cites Families (8)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5113454A (en) 1988-08-19 1992-05-12 Kajaani Electronics Ltd. Formation testing with digital image analysis
US5200820A (en) * 1991-04-26 1993-04-06 Bell Communications Research, Inc. Block-matching motion estimator for video coder
JPH08248303A (en) * 1995-03-07 1996-09-27 Minolta Co Ltd Focus detector
JP3580670B2 (en) * 1997-06-10 2004-10-27 富士通株式会社 Method for associating input image with reference image, apparatus therefor, and storage medium storing program for implementing the method
US6078680A (en) * 1997-07-25 2000-06-20 Arch Development Corporation Method, apparatus, and storage medium for detection of nodules in biological tissue using wavelet snakes to characterize features in radiographic images
US6282317B1 (en) * 1998-12-31 2001-08-28 Eastman Kodak Company Method for automatic determination of main subjects in photographic images
EP1281164B1 (en) * 2000-02-17 2015-05-27 BRITISH TELECOMMUNICATIONS public limited company Visual attention location system
EP1126411A1 (en) 2000-02-17 2001-08-22 BRITISH TELECOMMUNICATIONS public limited company Visual attention location system

Also Published As

Publication number Publication date
WO2001061648A2 (en) 2001-08-23
JP2003523587A (en) 2003-08-05
EP1281164A2 (en) 2003-02-05
CN1430767A (en) 2003-07-16
CA2400085C (en) 2008-02-19
JP4732660B2 (en) 2011-07-27
CN1214349C (en) 2005-08-10
EP1281164B1 (en) 2015-05-27
US20020081033A1 (en) 2002-06-27
US6934415B2 (en) 2005-08-23
KR20020075918A (en) 2002-10-07
WO2001061648A3 (en) 2002-03-21
AU2001232029A1 (en) 2001-08-27
KR100821847B1 (en) 2008-04-11

Similar Documents

Publication Publication Date Title
CA2400085A1 (en) Visual attention system
Ni et al. ESIM: Edge similarity for screen content image quality assessment
Meesters et al. A single-ended blockiness measure for JPEG-coded images
Wang et al. A novel approach for human face detection from color images under complex background
Chandler et al. Seven challenges for image quality research
WO2002086818A3 (en) Image processing apparatus for and method of improving an image and an image display apparatus comprising the image processing apparatus
EP1300801A3 (en) Method for extracting object region
EP1860875A3 (en) High resolution enabling apparatus and method
Tourancheau et al. Impact of subjective dataset on the performance of image quality metrics
WO2002067188A3 (en) Image analysis of the golgi complex
WO2002093488A3 (en) Segmentation unit for and method of determining a second segment and image processing apparatus
EP1760624A3 (en) Image processing apparatus and file transmission method
DE69808522D1 (en) IMAGE PROCESSING DEVICE
Ma et al. Efficient saliency analysis based on wavelet transform and entropy theory
EP1437887A3 (en) Image signal processing apparatus and method
CN111654719A (en) Video micro-motion detection method based on permutation entropy algorithm
EP1355498A3 (en) Adaptive pixel processing
CN1302151A (en) Detecting Gauss noise in video frequency signal
WO2002061672A3 (en) System and method for extracting a point of interest of an object in front of a computer controllable display captured by an imaging device
WO2019205603A1 (en) Image fuzziness measurement method and apparatus, computer device and readable storage medium
CN106611417B (en) Method and device for classifying visual elements into foreground or background
MacCormac On-line image processing for tobacco grading in Zimbabwe
EP1762978A3 (en) Image analysis for detecting loss of an image in a set of images
Zhai Recent advances in image quality assessment
Ben Amor et al. Improved performance of quality metrics using saliency map and CSF filter for standard coding H264/AVC

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed

Effective date: 20200210