WO2001009820A3 - System and method for dynamic image recognition - Google Patents

System and method for dynamic image recognition Download PDF

Info

Publication number
WO2001009820A3
WO2001009820A3 PCT/US2000/016831 US0016831W WO0109820A3 WO 2001009820 A3 WO2001009820 A3 WO 2001009820A3 US 0016831 W US0016831 W US 0016831W WO 0109820 A3 WO0109820 A3 WO 0109820A3
Authority
WO
WIPO (PCT)
Prior art keywords
image
interest
image recognition
features
region
Prior art date
Application number
PCT/US2000/016831
Other languages
French (fr)
Other versions
WO2001009820A2 (en
Inventor
Mark R Deyong
Jeff E Newberry
John W Grace
Thomas C Eskridge
Original Assignee
Intelligent Reasoning Systems
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Intelligent Reasoning Systems filed Critical Intelligent Reasoning Systems
Priority to AU56242/00A priority Critical patent/AU5624200A/en
Priority to EP00941546A priority patent/EP1203341A2/en
Publication of WO2001009820A2 publication Critical patent/WO2001009820A2/en
Publication of WO2001009820A3 publication Critical patent/WO2001009820A3/en

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T7/00—Image analysis
    • G06T7/0002—Inspection of images, e.g. flaw detection
    • G06T7/0004—Industrial image inspection
    • G06T7/0008—Industrial image inspection checking presence/absence
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F18/00—Pattern recognition
    • H—ELECTRICITY
    • H05—ELECTRIC TECHNIQUES NOT OTHERWISE PROVIDED FOR
    • H05K—PRINTED CIRCUITS; CASINGS OR CONSTRUCTIONAL DETAILS OF ELECTRIC APPARATUS; MANUFACTURE OF ASSEMBLAGES OF ELECTRICAL COMPONENTS
    • H05K13/00—Apparatus or processes specially adapted for manufacturing or adjusting assemblages of electric components
    • H05K13/08—Monitoring manufacture of assemblages
    • H05K13/081—Integration of optical monitoring devices in assembly lines; Processes using optical monitoring devices specially adapted for controlling devices or machines in assembly lines
    • H05K13/0815—Controlling of component placement on the substrate during or after manufacturing
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T2207/00—Indexing scheme for image analysis or image enhancement
    • G06T2207/30—Subject of image; Context of image processing
    • G06T2207/30108—Industrial image inspection
    • G06T2207/30141—Printed circuit board [PCB]
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06V—IMAGE OR VIDEO RECOGNITION OR UNDERSTANDING
    • G06V2201/00—Indexing scheme relating to image or video recognition or understanding
    • G06V2201/06—Recognition of objects for industrial automation
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S706/00—Data processing: artificial intelligence
    • Y10S706/902—Application using ai with detail of the ai system
    • Y10S706/903—Control
    • Y10S706/908—Electronic or computer, internal or network, circuit

Abstract

A system and method for object inspection that includes an image recognition program stored on a tangible medium for classifying and subclassifying regions of interest on an image. The image recognition program can be used in an image inspection system to determine defects on objects such as printed wiring assemblies. The image recognition program is executable to collect raw image data, segment out rectangular regions of interest that can be component sites defined by CAD data, preprocess each region of interest by scaling, gain and offset correction, and gamma correction, generating a set of image spaces for each region of interest using a set of spatial image transforms, generating features on the image spaces, scoring the features, comparing the feature scores to a knowledge base of feature scores to make a class determination for the features, generating a presence/absence decision confidence for the features, calculating a class determination and decision confidence for each region of interest. The class determinations can include present or absent, and right or wrong polarity. Another aspect of the image recognition software includes the ability to subclassify the defects. Another aspect of the present invention includes the ability to incrementally train the existing knowledge base as more images are processed.
PCT/US2000/016831 1999-07-28 2000-06-19 System and method for dynamic image recognition WO2001009820A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
AU56242/00A AU5624200A (en) 1999-07-28 2000-06-19 System and method for dynamic image recognition
EP00941546A EP1203341A2 (en) 1999-07-28 2000-06-19 System and method for dynamic image recognition

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/363,004 US6577757B1 (en) 1999-07-28 1999-07-28 System and method for dynamic image recognition
US09/363,004 1999-07-28

Publications (2)

Publication Number Publication Date
WO2001009820A2 WO2001009820A2 (en) 2001-02-08
WO2001009820A3 true WO2001009820A3 (en) 2001-11-15

Family

ID=23428396

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/016831 WO2001009820A2 (en) 1999-07-28 2000-06-19 System and method for dynamic image recognition

Country Status (5)

Country Link
US (5) US6577757B1 (en)
EP (1) EP1203341A2 (en)
AU (1) AU5624200A (en)
TW (1) TW571246B (en)
WO (1) WO2001009820A2 (en)

Families Citing this family (80)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7092860B1 (en) * 1999-02-03 2006-08-15 Mitutoyo Corporation Hardware simulation systems and methods for vision inspection systems
IL131282A (en) * 1999-08-05 2009-02-11 Orbotech Ltd Apparatus and methods for inspection of objects
US6999614B1 (en) * 1999-11-29 2006-02-14 Kla-Tencor Corporation Power assisted automatic supervised classifier creation tool for semiconductor defects
IL133696A (en) * 1999-12-23 2006-04-10 Orbotech Ltd Cam reference inspection of multi-color and contour images
US6765666B1 (en) * 2000-08-03 2004-07-20 Semiconductor Technologies & Instruments, Inc. System and method for inspecting bumped wafers
JP4176977B2 (en) * 2000-09-28 2008-11-05 矢崎総業株式会社 Terminal fitting inspection equipment
US7203342B2 (en) * 2001-03-07 2007-04-10 Schlumberger Technology Corporation Image feature extraction
US6944343B2 (en) * 2001-05-31 2005-09-13 Abb Inc. Image analyzing method for detecting significant changes in a time sequence of images
US7283659B1 (en) 2002-01-09 2007-10-16 Kla-Tencor Technologies Corporation Apparatus and methods for searching through and analyzing defect images and wafer maps
US6618629B2 (en) * 2002-01-15 2003-09-09 Teradyne, Inc. Communications interface for assembly-line monitoring and control
US7076332B2 (en) * 2002-01-18 2006-07-11 National Instruments Corporation System and method for invoking execution of a sequence of operations that includes motion control, machine vision, and data acquisition (DAQ) functionality
US20040010444A1 (en) * 2002-04-18 2004-01-15 Photon Dynamics, Inc. Automated infrared printed circuit board failure diagnostic system
US6999625B1 (en) * 2002-07-12 2006-02-14 The United States Of America As Represented By The Secretary Of The Navy Feature-based detection and context discriminate classification for digital images
US6999624B1 (en) * 2002-07-12 2006-02-14 The United States Of America As Represented By The Secretary Of The Navy Context discriminate classification for digital images
US6990239B1 (en) * 2002-07-16 2006-01-24 The United States Of America As Represented By The Secretary Of The Navy Feature-based detection and context discriminate classification for known image structures
US7359544B2 (en) * 2003-02-12 2008-04-15 Kla-Tencor Technologies Corporation Automatic supervised classifier setup tool for semiconductor defects
US7463765B2 (en) * 2003-02-25 2008-12-09 Lamda-Lite Enterprises Incorporated System and method for detecting and reporting fabrication defects using a multi-variant image analysis
JP4442119B2 (en) * 2003-06-06 2010-03-31 オムロン株式会社 Image recognition apparatus and image recognition method, and teaching apparatus and teaching method of image recognition apparatus
US20050047647A1 (en) * 2003-06-10 2005-03-03 Ueli Rutishauser System and method for attentional selection
DE10331594A1 (en) * 2003-07-11 2005-01-27 Leica Microsystems Semiconductor Gmbh Inspecting structures on semiconducting wafers involves assigning region(s) of interest to structural element in single element, transferring to corresponding structural element in other elements
EP1654705A1 (en) * 2003-08-07 2006-05-10 Koninklijke Philips Electronics N.V. Image object processing
US20050157931A1 (en) * 2004-01-15 2005-07-21 Delashmit Walter H.Jr. Method and apparatus for developing synthetic three-dimensional models from imagery
ITMO20040036A1 (en) * 2004-02-16 2004-05-16 Fondmatic Societa Per Azioni IMAGE CONTROL METHOD
US7634127B1 (en) * 2004-07-01 2009-12-15 Advanced Micro Devices, Inc. Efficient storage of fail data to aid in fault isolation
GB2417073A (en) * 2004-08-13 2006-02-15 Mv Res Ltd A machine vision analysis system and method
JP4562126B2 (en) * 2004-09-29 2010-10-13 大日本スクリーン製造株式会社 Defect detection apparatus and defect detection method
US20060193520A1 (en) * 2005-02-28 2006-08-31 Takeshi Mita Object detection apparatus, learning apparatus, object detection system, object detection method and object detection program
US8036497B2 (en) * 2005-03-01 2011-10-11 Osaka Prefecture University Public Corporation Method, program and apparatus for storing document and/or image using invariant values calculated from feature points and method, program and apparatus for retrieving document based on stored document and/or image
US7213761B2 (en) * 2005-03-23 2007-05-08 Microscan Systems Incorporated Apparatus and process for two-stage decoding of high-density optical symbols
US7961937B2 (en) * 2005-10-26 2011-06-14 Hewlett-Packard Development Company, L.P. Pre-normalization data classification
US20070098247A1 (en) * 2005-10-27 2007-05-03 Sanderson David I Method for checking the pattern density of a semiconductor chip design with variable checking box size and variable stepping distance
GB2432064B (en) * 2005-10-31 2011-01-19 Hewlett Packard Development Co Method of triggering a detector to detect a moving feature within a video stream
US7933451B2 (en) * 2005-11-23 2011-04-26 Leica Geosystems Ag Feature extraction using pixel-level and object-level analysis
JP5044968B2 (en) * 2006-04-03 2012-10-10 オムロン株式会社 Factor estimation apparatus, factor estimation method, program, and computer-readable recording medium
US7870517B1 (en) 2006-04-28 2011-01-11 Cadence Design Systems, Inc. Method and mechanism for implementing extraction for an integrated circuit design
DE102006060741A1 (en) * 2006-12-21 2008-06-26 Henkel Kgaa Method and device for the optical inspection of objects
US8300890B1 (en) * 2007-01-29 2012-10-30 Intellivision Technologies Corporation Person/object image and screening
US8126267B2 (en) * 2007-02-05 2012-02-28 Albany Medical College Methods and apparatuses for analyzing digital images to automatically select regions of interest thereof
US8131077B2 (en) * 2007-04-03 2012-03-06 Flashfoto, Inc. Systems and methods for segmenting an image based on perceptual information
US20080255840A1 (en) * 2007-04-16 2008-10-16 Microsoft Corporation Video Nametags
US8526632B2 (en) * 2007-06-28 2013-09-03 Microsoft Corporation Microphone array for a camera speakerphone
US8330787B2 (en) * 2007-06-29 2012-12-11 Microsoft Corporation Capture device movement compensation for speaker indexing
US8165416B2 (en) * 2007-06-29 2012-04-24 Microsoft Corporation Automatic gain and exposure control using region of interest detection
US8180112B2 (en) * 2008-01-21 2012-05-15 Eastman Kodak Company Enabling persistent recognition of individuals in images
EP2329433A4 (en) 2008-08-08 2014-05-14 Snap On Tools Corp Image-based inventory control system
US9147174B2 (en) 2008-08-08 2015-09-29 Snap-On Incorporated Image-based inventory control system using advanced image recognition
US9041508B2 (en) 2008-08-08 2015-05-26 Snap-On Incorporated Image-based inventory control system and method
US8842183B2 (en) 2008-08-08 2014-09-23 Snap-On Incorporated Image-based inventory control system with automatic calibration and image correction
TWI479428B (en) * 2008-10-14 2015-04-01 Sicpa Holding Sa Method and system for item identification
US8553989B1 (en) * 2010-04-27 2013-10-08 Hrl Laboratories, Llc Three-dimensional (3D) object recognition system using region of interest geometric features
US9311567B2 (en) 2010-05-10 2016-04-12 Kuang-chih Lee Manifold learning and matting
TWI408611B (en) * 2010-11-30 2013-09-11 Pixart Imaging Inc Method and system for recognizing objects in an image based on characteristics of the objects
US9092979B2 (en) * 2010-12-14 2015-07-28 Xerox Corporation Automated license plate recognition system and method using human-in-the-loop based adaptive learning
JP2013080326A (en) * 2011-10-03 2013-05-02 Sony Corp Image processing device, image processing method, and program
JP5932376B2 (en) * 2012-02-08 2016-06-08 富士機械製造株式会社 Image transfer method and image transfer apparatus
US8654398B2 (en) 2012-03-19 2014-02-18 Seiko Epson Corporation Method for simulating impact printer output, evaluating print quality, and creating teaching print samples
US10043264B2 (en) 2012-04-19 2018-08-07 Applied Materials Israel Ltd. Integration of automatic and manual defect classification
US9715723B2 (en) 2012-04-19 2017-07-25 Applied Materials Israel Ltd Optimization of unknown defect rejection for automatic defect classification
US9595091B2 (en) 2012-04-19 2017-03-14 Applied Materials Israel, Ltd. Defect classification using topographical attributes
US9858658B2 (en) * 2012-04-19 2018-01-02 Applied Materials Israel Ltd Defect classification using CAD-based context attributes
US9607233B2 (en) 2012-04-20 2017-03-28 Applied Materials Israel Ltd. Classifier readiness and maintenance in automatic defect classification
US9699447B2 (en) * 2012-11-26 2017-07-04 Frito-Lay North America, Inc. Calibration of a dynamic digital imaging system for detecting defects in production stream
TW201423088A (en) * 2012-12-07 2014-06-16 Hon Hai Prec Ind Co Ltd Electronic element checking system and checking method
US8996413B2 (en) 2012-12-28 2015-03-31 Wal-Mart Stores, Inc. Techniques for detecting depleted stock
JP6074272B2 (en) * 2013-01-17 2017-02-01 キヤノン株式会社 Image processing apparatus and image processing method
US10114368B2 (en) 2013-07-22 2018-10-30 Applied Materials Israel Ltd. Closed-loop automatic defect inspection and classification
US9833962B2 (en) 2014-02-26 2017-12-05 Toyota Motor Engineering & Manufacturing Norh America, Inc. Systems and methods for controlling manufacturing processes
ES2547474B1 (en) * 2014-04-04 2016-09-09 Emdep-2, S.L. Device and inspection procedure for elements in fuse boxes
US9460367B2 (en) * 2014-11-26 2016-10-04 Xerox Corporation Method and system for automating an image rejection process
CN107257985A (en) 2015-04-15 2017-10-17 实耐宝公司 Use the automatic asset management system of multiple sensing technologies
US10586102B2 (en) * 2015-08-18 2020-03-10 Qualcomm Incorporated Systems and methods for object tracking
US10600175B2 (en) * 2017-03-24 2020-03-24 Kla-Tencor Corporation Dynamic care areas for defect detection
CN111213045B (en) * 2017-06-14 2022-07-01 康特科技公司 Automatic defect classification
JP7054436B2 (en) * 2017-12-14 2022-04-14 オムロン株式会社 Detection system, information processing device, evaluation method and program
US10951859B2 (en) 2018-05-30 2021-03-16 Microsoft Technology Licensing, Llc Videoconferencing device and method
US11132787B2 (en) * 2018-07-09 2021-09-28 Instrumental, Inc. Method for monitoring manufacture of assembly units
JP6670410B2 (en) * 2019-03-13 2020-03-18 株式会社Ｆｕｊｉ Inspection support device and inspection support method
CN111311515B (en) * 2020-02-13 2023-05-30 山西大学 Depth image rapid iterative restoration method for automatic detection of error region
US20220318667A1 (en) * 2021-03-30 2022-10-06 Accenture Global Solutions Limited Intelligent real-time defect prediction, detection, and ai driven automated correction solution
DE102021116495A1 (en) 2021-06-25 2022-12-29 Ford Global Technologies, Llc Method and device for checking a connection during a laser-based connection process

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5204911A (en) * 1991-05-29 1993-04-20 Nira Schwartz Inspection method using unique templates and histogram analysis
WO1996002897A2 (en) * 1994-07-14 1996-02-01 Philips Electronics N.V. Mass detection in digital x-ray images using multiple threshold levels to discriminate spots
US5517234A (en) * 1993-10-26 1996-05-14 Gerber Systems Corporation Automatic optical inspection system having a weighted transition database
US5586058A (en) * 1990-12-04 1996-12-17 Orbot Instruments Ltd. Apparatus and method for inspection of a patterned object by comparison thereof to a reference
US5638465A (en) * 1994-06-14 1997-06-10 Nippon Telegraph And Telephone Corporation Image inspection/recognition method, method of generating reference data for use therein, and apparatuses therefor

Family Cites Families (16)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPS59136875A (en) * 1983-01-26 1984-08-06 Fuji Electric Co Ltd Pattern identifier
US4783829A (en) * 1983-02-23 1988-11-08 Hitachi, Ltd. Pattern recognition apparatus
US4978224A (en) 1987-07-14 1990-12-18 Sharp Kabushiki Kaisha Method of and apparatus for inspecting mounting of chip components
EP0550131A2 (en) * 1991-12-31 1993-07-07 AT&T Corp. Graphical system for automated segmentation and recognition for image recognition systems
US5442792A (en) 1992-08-07 1995-08-15 Hughes Aircraft Company Expert system compilation method
JPH06325181A (en) * 1993-05-17 1994-11-25 Mitsubishi Electric Corp Pattern recognizing method
US5544256A (en) * 1993-10-22 1996-08-06 International Business Machines Corporation Automated defect classification system
US5694482A (en) * 1994-11-08 1997-12-02 Universal Instruments Corporation System and method for locating solder bumps on semiconductor chips or chip carriers
US5694481A (en) * 1995-04-12 1997-12-02 Semiconductor Insights Inc. Automated design analysis system for generating circuit schematics from high magnification images of an integrated circuit
US5539752A (en) * 1995-06-30 1996-07-23 Advanced Micro Devices, Inc. Method and system for automated analysis of semiconductor defect data
US5777901A (en) * 1995-09-29 1998-07-07 Advanced Micro Devices, Inc. Method and system for automated die yield prediction in semiconductor manufacturing
US6072895A (en) * 1996-12-13 2000-06-06 International Business Machines Corporation System and method using minutiae pruning for fingerprint image processing
JPH10213422A (en) * 1997-01-29 1998-08-11 Hitachi Ltd Pattern inspecting device
US6122397A (en) * 1997-07-03 2000-09-19 Tri Path Imaging, Inc. Method and apparatus for maskless semiconductor and liquid crystal display inspection
US5966459A (en) * 1997-07-17 1999-10-12 Advanced Micro Devices, Inc. Automatic defect classification (ADC) reclassification engine
US6298176B2 (en) * 1997-10-17 2001-10-02 Welch Allyn Data Collection, Inc. Symbol-controlled image data reading system

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5586058A (en) * 1990-12-04 1996-12-17 Orbot Instruments Ltd. Apparatus and method for inspection of a patterned object by comparison thereof to a reference
US5204911A (en) * 1991-05-29 1993-04-20 Nira Schwartz Inspection method using unique templates and histogram analysis
US5517234A (en) * 1993-10-26 1996-05-14 Gerber Systems Corporation Automatic optical inspection system having a weighted transition database
US5638465A (en) * 1994-06-14 1997-06-10 Nippon Telegraph And Telephone Corporation Image inspection/recognition method, method of generating reference data for use therein, and apparatuses therefor
WO1996002897A2 (en) * 1994-07-14 1996-02-01 Philips Electronics N.V. Mass detection in digital x-ray images using multiple threshold levels to discriminate spots

Non-Patent Citations (2)

* Cited by examiner, † Cited by third party
Title
"COMPONENT PLACEMENT VERIFICATION THROUGH HEIGHT DISCONTINUITIES", IBM TECHNICAL DISCLOSURE BULLETIN,US,IBM CORP. NEW YORK, vol. 29, no. 5, 1 October 1986 (1986-10-01), pages 2216 - 2223, XP002063434, ISSN: 0018-8689 *
MOGANTI ET AL: "A Modular Approach to Automatic Printed Circuit Board Inspection", PROCEEDINGS OF THE SPIE, 31 January 1996 (1996-01-31), XP002094862 *

Also Published As

Publication number Publication date
US20030053677A1 (en) 2003-03-20
AU5624200A (en) 2001-02-19
WO2001009820A2 (en) 2001-02-08
EP1203341A2 (en) 2002-05-08
US20020168098A1 (en) 2002-11-14
US20020159643A1 (en) 2002-10-31
US6771819B2 (en) 2004-08-03
US6577757B1 (en) 2003-06-10
TW571246B (en) 2004-01-11
US6687397B2 (en) 2004-02-03
US6650770B2 (en) 2003-11-18
US20030016858A1 (en) 2003-01-23
US6614925B2 (en) 2003-09-02

Similar Documents

Publication Publication Date Title
WO2001009820A3 (en) System and method for dynamic image recognition
JP3864945B2 (en) Road lane detection device
WO2017113805A1 (en) Method and system for identifying train number and model, and safety check method and system
US7715628B2 (en) Precise grayscale character segmentation apparatus and method
MY140267A (en) System and method for identifying objects of interest in image data
WO2002069267A3 (en) Classification of objects through model ensembles
US8331670B2 (en) Method of detection document alteration by comparing characters using shape features of characters
WO2003073359A3 (en) Method and apparatus for recognizing objects
US5969753A (en) Method and system for detecting errors in a sample image
TWI256597B (en) Image processing apparatus and image processing method
DE50209847D1 (en) Method and arrangement for assigning information to digital x-ray images
JP2020501206A (en) Online cartoon identification system and method based on region of interest
CN106815814B (en) Image pollution processing method applied to paper marking system
DE50206591D1 (en) METHOD FOR DETECTING AND TRACKING OBJECTS
CN105721738B (en) A kind of chromoscan file and picture preprocess method
JP2004219291A (en) Line defect detection method and device for screen
CN101854461A (en) Printed document evidence obtaining method for detecting authenticity of document by using half-tone information
JPH0217832B2 (en)
JP2007140703A (en) Method for reading insurance policy, system thereof, and insurance policy recognition system
JP4672513B2 (en) Information processing system, tint block superimposing device, answer extracting device, tint block superimposing method, answer extracting method
JP2009150855A (en) Inspection method of inspection target, and inspection device for the inspection target
JPH07230525A (en) Method for recognizing ruled line and method for processing table
WO2001084497A3 (en) Image processing
JP3124597B2 (en) Edge detection method and image recognition method using the same
JP2002342880A (en) Vehicle number recognition device

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
AK Designated states

Kind code of ref document: A3

Designated state(s): AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A3

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

WWE Wipo information: entry into national phase

Ref document number: 2000941546

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2000941546

Country of ref document: EP

REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

WWW Wipo information: withdrawn in national office

Ref document number: 2000941546

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: JP