EP1703441A1 - Photographic subject authenticating device, portable telephone, photographic subject authenticating method and photographic subject authenticating program - Google Patents
Photographic subject authenticating device, portable telephone, photographic subject authenticating method and photographic subject authenticating program Download PDFInfo
- Publication number
- EP1703441A1 EP1703441A1 EP06111134A EP06111134A EP1703441A1 EP 1703441 A1 EP1703441 A1 EP 1703441A1 EP 06111134 A EP06111134 A EP 06111134A EP 06111134 A EP06111134 A EP 06111134A EP 1703441 A1 EP1703441 A1 EP 1703441A1
- Authority
- EP
- European Patent Office
- Prior art keywords
- photographic subject
- authenticating
- photographing
- timing
- face
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Withdrawn
Links
Images
Classifications
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01D—SEPARATION
- B01D50/00—Combinations of methods or devices for separating particles from gases or vapours
- B01D50/40—Combinations of devices covered by groups B01D45/00 and B01D47/00
-
- G—PHYSICS
- G07—CHECKING-DEVICES
- G07C—TIME OR ATTENDANCE REGISTERS; REGISTERING OR INDICATING THE WORKING OF MACHINES; GENERATING RANDOM NUMBERS; VOTING OR LOTTERY APPARATUS; ARRANGEMENTS, SYSTEMS OR APPARATUS FOR CHECKING NOT PROVIDED FOR ELSEWHERE
- G07C9/00—Individual registration on entry or exit
- G07C9/30—Individual registration on entry or exit not involving the use of a pass
- G07C9/32—Individual registration on entry or exit not involving the use of a pass in combination with an identity check
- G07C9/37—Individual registration on entry or exit not involving the use of a pass in combination with an identity check using biometric data, e.g. fingerprints, iris scans or voice recognition
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01D—SEPARATION
- B01D45/00—Separating dispersed particles from gases or vapours by gravity, inertia, or centrifugal forces
- B01D45/12—Separating dispersed particles from gases or vapours by gravity, inertia, or centrifugal forces by centrifugal forces
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01D—SEPARATION
- B01D47/00—Separating dispersed particles from gases, air or vapours by liquid as separating agent
- B01D47/06—Spray cleaning
- B01D47/063—Spray cleaning with two or more jets impinging against each other
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01D—SEPARATION
- B01D53/00—Separation of gases or vapours; Recovering vapours of volatile solvents from gases; Chemical or biological purification of waste gases, e.g. engine exhaust gases, smoke, fumes, flue gases, aerosols
- B01D53/24—Separation of gases or vapours; Recovering vapours of volatile solvents from gases; Chemical or biological purification of waste gases, e.g. engine exhaust gases, smoke, fumes, flue gases, aerosols by centrifugal force
-
- B—PERFORMING OPERATIONS; TRANSPORTING
- B01—PHYSICAL OR CHEMICAL PROCESSES OR APPARATUS IN GENERAL
- B01D—SEPARATION
- B01D53/00—Separation of gases or vapours; Recovering vapours of volatile solvents from gases; Chemical or biological purification of waste gases, e.g. engine exhaust gases, smoke, fumes, flue gases, aerosols
- B01D53/34—Chemical or biological purification of waste gases
- B01D53/74—General processes for purification of waste gases; Apparatus or devices specially adapted therefor
- B01D53/77—Liquid phase processes
- B01D53/78—Liquid phase processes with gas-liquid contact
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L63/00—Network architectures or network communication protocols for network security
- H04L63/08—Network architectures or network communication protocols for network security for authentication of entities
- H04L63/0861—Network architectures or network communication protocols for network security for authentication of entities using biometrical features, e.g. fingerprint, retina-scan
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
- H04W12/06—Authentication
- H04W12/065—Continuous authentication
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
- H04W12/06—Authentication
- H04W12/068—Authentication using credential vaults, e.g. password manager applications or one time password [OTP] applications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
- H04W12/08—Access security
- H04W12/084—Access security using delegated authorisation, e.g. open authorisation [OAuth] protocol
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W12/00—Security arrangements; Authentication; Protecting privacy or anonymity
- H04W12/60—Context-dependent security
- H04W12/65—Environment-dependent, e.g. using captured environmental data
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04W—WIRELESS COMMUNICATION NETWORKS
- H04W88/00—Devices specially adapted for wireless communication networks, e.g. terminals, base stations or access point devices
- H04W88/02—Terminal devices
Definitions
- This invention relates to a photographic subject authenticating device, a portable telephone, a photographic subject authenticating method and a photographic subject authenticating program for photographing a photographic subject such as the face of a person, the iris, a palm print, etc. and authenticating the photographic subject.
- Various kinds of authenticating systems such as a face authenticating system for photographing and authenticating the face, an iris authenticating system for photographing and authenticating the iris, a palm print authenticating system for photographing and authenticating the palm print of a hand, etc. are conventionally proposed as a system for authenticating the person in question.
- the photographic subject such as the face, the eye or the hand is photographed and authenticated.
- These systems are mounted to various devices such as a personal computer, a portable information terminal, an ATM or a vehicle, etc., and can be practically used.
- a vehicle monitor for improving reliability of security is proposed to solve this problem (see patent literature 1). As described later, this vehicle monitor again performs the authentication even when the image of a crew member is periodically acquired and the authenticating result is once conformed. Thus, for example, it is possible to detect the disguise in a mounting state of a person face mask.
- an object of this invention is to provide a photographic subject authenticating device, a portable telephone, a photographic subject authenticating method and a photographic subject authenticating program for improving reliability of security with respect to the disguise.
- This invention resides in a photographic subject authenticating method, a photographic subject authenticating device or a photographic subject authenticating program including photographing means for photographing a photographic subject, and performing authentication processing for authenticating the photographic subject on the basis of a photographing image provided by photographing the photographic subject by the photographing means;
- the photographic subject authenticating method, the photographic subject authenticating device or the photographic subject authenticating program further including control means for executing:
- the above timing determination processing can be constructed by suitable processing such as processing for determining the timing at random every time, or processing in which plural timings of different time intervals are set in advance and the repeating time intervals are changed by sequentially switching these plural timings, etc.
- the authentication of the photographic subject can be repeatedly executed in irregular timing, and the disguise using a photograph, etc. can be set to be difficult. Namely, even when an unfair user once succeeds in the disguise, the unfair user must succeed in the disguise many times in the repeated authentication processing. Further, since it is the irregular timing, it is impossible to perform the disguise by estimating the timing so that reliability of security can be improved.
- the above timing determination processing can be set to a construction for determining the timing at random every repetition.
- this invention can be set to a face authenticating device having the above photographic subject authenticating device and constructed so as to photograph a face as the photographic subject by the above photographing means.
- a mental resistance feeling is little in comparison with a palm print, the iris, etc., and the disguise using the photograph can be appropriately excluded in face authentication easily accepted from a custom such as a nodding acquaintanceship, a face pass, etc.
- this invention can be set to a portable telephone having the above photographic subject authenticating device.
- the photographic subject authenticating device 1 is constructed by a portable telephone as one kind of a portable information terminal.
- a speaker 11 of outputting a voice, a liquid crystal monitor 14 for displaying an image, plural operation buttons 16 for inputting operations, and a microphone 18 for inputting a voice are sequentially arranged from above on the front face of the photographic subject authenticating device 1.
- a camera 12 and an illuminating device 13 for photographing are vertically proximately arranged on the right-hand transversal side of the above speaker 11.
- the camera 12 and the illuminating device 13 for photographing and the above liquid crystal monitor 14 are arranged on the same face (the surface in this embodiment mode) of the photographic subject authenticating device 1 such that a photographing direction of the camera 12, an illuminating direction of the illuminating device 13 and a display direction of the liquid crystal monitor 14 become the same direction.
- the above illuminating device 13 is constructed by a suitable illuminating device such as a flash illuminating device for emitting flash light, or a lighting illuminating device (e.g., a LED and a fluorescent lamp) lighted, etc.
- a shutter button 15 of the camera 12 is arranged on the right-hand side face of the photographic subject authenticating device 1.
- An opening-closing cover 19 rotated forward and backward is pivotally mounted to the lower portion of the front face of the photographic subject authenticating device 1.
- the opening-closing cover 19. is constructed so as to cover and protect the plural operation buttons 16 in a closing state.
- An antenna 10 for wireless communication is arranged in the upper portion of the rear face of the photographic subject authenticating device 1.
- a controller constructed by a CPU, a ROM and a RAM, and a battery charger for supplying operating electric power are arranged within the photographic subject authenticating device 1.
- a storing section is also arranged in this controller.
- a database for registering registration data for face collation as one kind of living body authentication, and normal operation data for true and false judgments of an input operation, and a photographic subject authenticating program for repeatedly executing the authentication using the face collation are stored into this storing section.
- the operation button 16 is operated and electricity is supplied (a signal is transmitted) from the photographic subject authenticating device 1. Further, the photographic subject authenticating device 1 can receive an arriving signal by operating the operation button 16. Thus, voice telephonic communication with a telephone set of a remote place can be allowed. Further, it is possible to display contents by Internet connection and transmit and receive an electronic mail by operating the operation button 16.
- the photographing of a static image and a dynamic image using the camera 12 can be executed, and a photographing image can be displayed in the liquid crystal monitor 14.
- the personal authentication of a photographic subject can be performed by the photographing image obtained in this photographing:
- the photographic subject authenticating device 1 is constructed by an electric power source section 41, a timer 42, a time judging section 43, a face collating section 44, a collating result output section 45.
- the above electric power source section 41 is constructed by a battery charger and an electric power button (one of the operation buttons 16 shown in Fig. 1), and supplies operating electric power to each constructional element by turning-on the electric power button.
- the above timer 42 is constructed by a controller of the photographic subject authenticating device 1, and receives the supply of the operating electric power from the above electric power source section 41, and executes counting of time.
- the above time judging section 43 receives the time counted by the above timer 42, and judges whether it is timing for executing the face collation or not. For example, this timing is determined by a time interval determined at random by random number processing, etc.
- the above face collating section 44 is constructed by the controller of the photographic subject authenticating device 1 and the camera 12.
- the face collation of the photographing image acquired by the camera 12, and the registration data stored to the storing section of the controller is performed. It is then judged whether it is conformity (the same person) or not.
- These registration data are photographing image data of a user registered in advance. In this embodiment mode, a face image small in mental resistance with respect to the user is used.
- the registration data are not limited to the image data, but may be also constructed by characteristic data provided by extracting a characteristic point and a characteristic amount from these image data.
- the above collating result output section 45 outputs one of conformity and unconformity as a result of the face collation, i.e., an authenticating result.
- the face collation is irregularly repeated and is intermittently executed.
- the face collation is irregularly repeated and is intermittently executed.
- the controller starts the counting of the timer 42 (step n1).
- the controller determines time for executing the face collation by the time judging section 43 at random. The controller then waits while allowing the normal use of the user until this time (collation execution timing) determined at random passes (step n2: No).
- step n2 the controller executes the photographing using the camera 12, and also executes the face collation using the photographing image acquired by this photographing, and the registration data by the face collating section 44 (step n3).
- a characteristic amount proper to the person in question is calculated from the photographing image, and is compared (collated) with the characteristic amount of the registration data. If the difference in the characteristic amount lies within a constant threshold value determined in advance, it is judged that it is the same person.
- the above characteristic amount proper to the person in question can be calculated by using Gabor wavelet transformation with respect to the characteristic point acquired from the face image of the photographing image.
- This characteristic point can be acquired by cutting-out a face portion from a rough position of the face and normalizing the size of the face and further applying a detailed graph and detecting the position of the characteristic point of the face in detail.
- the Gabor wavelet transformation is a technique used in signal analysis and image compression. In this technique, a wavelet waveform is utilized from a transformation object, and only a character (a frequency component, etc.) provided by this waveform is taken out.
- the collating result output section 45 outputs information of unconformity to the controller as the authenticating result.
- the controller stops the use of the device, i,e., the use of the portable telephone (step n5). For example, if an operation such as telephonic communication, a setting change, WEB communication, etc. is being operated, such an operation is stopped and a subsequent operation input is refused.
- this authenticating request operation of the use restarting is set to a predetermined operation such as pushing-down of the shutter button 15, etc.
- the controller is constructed so as to execute the same face collation as the above step n3. If the result of the face collation is conformed, it is returned to the normal state and the processing is executed from step n1. In contrast to this, if the result of the face collation is unconformity, a state stopping the use of the portable telephone is maintained.
- the authentication (authentication for restarting) for this restarting may be also set to authentication except for the face collation, and may be also set to authentication using e.g., a password, a palm print, a voice, a word, etc.
- the collating result output section 45 outputs information of conformity to the controller as an authenticating result.
- the controller allows the use of the device, i.e., the use of the portable telephone (step n6). Accordingly, a user can continuously use the portable telephone, and can use the portable telephone without hindrance. Namely, if it is seen from the user, the above face collation is freely executed by the portable telephone. Therefore, the registered normal user can usually use the portable telephone without particularly being conscious of the face collation.
- the controller outputs contents able to stop the repetition of the collation. If no contents for stopping the repeating collation are inputted by the user (step n7: No), time for executing the face collation is determined at random by the time judging section 43 and the controller waits until this time (collation executing timing) determined at random passes (step n8: No).
- the contents able to stop the repetition of the irregular collation can be outputted by display using the liquid crystal monitor 14 or/and a voice output using the speaker 11.
- a selecting screen for selecting whether the repetition is stopped on the screen or not is displayed. Otherwise, it is possible to notify information by displaying an icon showing ability of the stoppage at a corner of the screen, etc.
- the display and a voice guide of the contents able to stop the repetition may not be also executed.
- a stopping function screen of the repeating collation is started by an operation of the user in a determined sequence
- a selection for requiring the stoppage or requiring no stoppage may be also displayed.
- step n8 If the time determined at random in the above step n8 has passed (step n8: Yes), it is returned to step n3.
- step n7 When the contents of stoppage in the above step n7 are inputted (step n7: Yes), the controller performs an output for requesting a password input as repeating stoppage instructions, and receives the password input by the user (step n9).
- the output for requesting the password input can be performed by the display using the liquid crystal monitor 14, the voice output using the speaker 11, or both this display and this voice output.
- the displaying case using the liquid crystal monitor 14 it is possible to notify password input waiting to the user by displaying a password input screen requesting the password input on the screen, or displaying an icon showing a password input state at a corner of the screen, etc.
- the controller judges whether this password is conformed to a password registered as normal instructions or not. Thus, it is judged whether it is the person in question or not (step n10).
- step n10 If it is not the person in question, i.e., when the inputted password is incorrect (step n10: No), the use of the device, i.e., the use of the portable telephone is stopped (step n11), and the processing is terminated.
- step n10 when it is the person in question, i.e., when the inputted password is correct (step n10: Yes), the use of the device, i.e., the use of the portable telephone is continuously allowed (step n12).
- the controller waits until the electric power source is turned off (step n13: No), and terminates the processing if the electric power source is turned off (step n13: Yes).
- the authentication of the person in question using the face collation can be repeatedly executed irregularly by the above operation while the device is used.
- the user When the user wants to stop the execution of the authentication of the person in question using the face collation, the user can stop the subsequent face collation by inputting the password.
- the face collation is stopped.
- the user performs the normal telephonic communication instead of a television telephone, it is possible to use the portable telephone in a state unable to perform the face collation, in which the portable telephone is held to a user's ear. Further, it is possible to restrain that the electric power of the battery charger is consumed by repeating the authentication processing by this stoppage.
- the stoppage of the face collation using the password input is constructed so as not to be executed unless after the face collation is performed at least once. Therefore, it is possible to prevent that only the password is broken and the device is unfairly used.
- the face collation is repeatedly irregularly executed without notifying this execution beforehand to the user. Therefore, timing of this face collation, i.e., photographing timing is not known by the unfair user so that the disguise can be excluded.
- step n1 If the electric power source is turned off, the processing is started from step n1 at the using time of the device after the electric power source is next turned on. As shown by (C) of Fig. 4, the irregular face collation is restarted. Therefore, it is possible to prevent that a long period has passed in a stopping state of the face collation.
- the photographing timing for the repeated face collation is constructed so as to be determined at random, but may be also set to a construction in which plural timings of different time intervals are set in advance and the repeating time intervals are changed by sequentially switching these plural timings.
- the construction for executing the authentication processing if the use of the device is started is set to the construction for executing the authentication processing if the use of the device is started.
- it may be also set to a construction for allowing the use without performing the face collation at a signal arriving time.
- the user noticing the signal arrival can make a telephone call without performing an operation of the stoppage of a collating function.
- voice telephonic communication is performed instead of the use of the portable telephone as in a television telephone, the continuation of the telephonic communication can be allowed even in a state in which no face image is obtained by holding the portable telephone to a user's ear so that convenient property of the user is improved.
- the voice telephonic communication when the voice telephonic communication is performed, the user inputs the password and stops the repeating authentication, and can perform the telephonic communication. Accordingly, it is possible to prevent that the repeating authentication is executed during the voice telephonic communication and the use of the portable telephone is inhibited. It is also possible to prevent that the telephonic communication is interrupted by this use inhibition.
- the voice telephonic communication and the transmission and reception of a screen image are performed as the television telephone, the telephonic communication can be performed while receiving the repeating authentication even when no user inputs the password.
- the restarting of the face collation is not limited to turning-on of the electric power source after the electric power source is turned off, but may be also set to constructions in which the face collation is restarted when a constant time (e.g., 0 a.m. every day, every one hour, etc.) set on the setting screen has passed, and the face collation is restarted at the next using time after the use of the user is terminated.
- the use can include the use of the telephonic communication, the use of WEB perusal, the use of mail transmission and reception, the use of a setting change, etc. Thus, it is possible to more reliably prevent that the stopping state of the face collation is continued for a long period.
- an input means e.g., a button for selecting and operating a button for the face collation, or a face collation button displayed in the liquid crystal monitor 14
- a face collation executing input may be also arranged so as to immediately stop the repetition of the authentication.
- the face collation and the password input can be executed in arbitrary timing without waiting the face collation irregularly performed, and the irregular collation can be stopped.
- the photographic subject authenticating device 1 is not limited to the case constructed by the portable telephone, but can be set to a suitable construction such as a construction using another portable information terminal such as a PDA, a note type personal computer, etc., or a construction using another device such as a desk top type personal computer, an ATM, etc.
- a suitable construction such as a construction using another portable information terminal such as a PDA, a note type personal computer, etc., or a construction using another device such as a desk top type personal computer, an ATM, etc.
- the face collation can be also repeatedly executed by using a camera, etc. arranged in the portable information terminal, the device, etc., and the repetition can be stopped in accordance with necessity.
- the face authenticating device and the portable telephone of this invention correspond to the photographic subject authenticating device 1 of the embodiment mode.
- control means corresponds to the controller of the photographic subject authenticating device 1.
- the photographing means corresponds to the camera 12.
- the input means corresponds to the operation button 16.
- the timing determination processing corresponds to steps n2, n8.
- the authentication processing corresponds to steps n3 to n4.
- the authentication repeating processing corresponds to step n7.
- the irregular timing corresponds to the time determined at random.
- This invention is not limited to only the construction of the above embodiment mode, but many embodiment modes can be obtained.
Abstract
Description
- This invention relates to a photographic subject authenticating device, a portable telephone, a photographic subject authenticating method and a photographic subject authenticating program for photographing a photographic subject such as the face of a person, the iris, a palm print, etc. and authenticating the photographic subject.
- Various kinds of authenticating systems such as a face authenticating system for photographing and authenticating the face, an iris authenticating system for photographing and authenticating the iris, a palm print authenticating system for photographing and authenticating the palm print of a hand, etc. are conventionally proposed as a system for authenticating the person in question.
- In these authenticating systems, the photographic subject such as the face, the eye or the hand is photographed and authenticated. These systems are mounted to various devices such as a personal computer, a portable information terminal, an ATM or a vehicle, etc., and can be practically used.
- However, for example, when disguise using a photograph, etc. is performed and an authenticating result is once conformed, a problem exists in that all subsequent use and operations of the device are allowed since it is the person in question.
- A vehicle monitor for improving reliability of security is proposed to solve this problem (see patent literature 1). As described later, this vehicle monitor again performs the authentication even when the image of a crew member is periodically acquired and the authenticating result is once conformed. Thus, for example, it is possible to detect the disguise in a mounting state of a person face mask.
- However, in this vehicle monitor, since the authentication is periodically executed, the problem that timing of the image acquisition is estimated and the disguise can be performed in this timing, is left.
- [Patent literature 1]
JP-A-2004-276783 - In consideration of the above problems, an object of this invention is to provide a photographic subject authenticating device, a portable telephone, a photographic subject authenticating method and a photographic subject authenticating program for improving reliability of security with respect to the disguise.
- This invention resides in a photographic subject authenticating method, a photographic subject authenticating device or a photographic subject authenticating program including photographing means for photographing a photographic subject, and performing authentication processing for authenticating the photographic subject on the basis of a photographing image provided by photographing the photographic subject by the photographing means;
- the photographic subject authenticating method, the photographic subject authenticating device or the photographic subject authenticating program further including control means for executing:
- authentication repeating processing for also repeatedly executing the authentication processing after it is judged as conformity by the authentication processing; and
- timing determination processing for determining repetitious execution timing so as to become irregular timing.
- The above timing determination processing can be constructed by suitable processing such as processing for determining the timing at random every time, or processing in which plural timings of different time intervals are set in advance and the repeating time intervals are changed by sequentially switching these plural timings, etc.
- In accordance with the above construction, the authentication of the photographic subject can be repeatedly executed in irregular timing, and the disguise using a photograph, etc. can be set to be difficult. Namely, even when an unfair user once succeeds in the disguise, the unfair user must succeed in the disguise many times in the repeated authentication processing. Further, since it is the irregular timing, it is impossible to perform the disguise by estimating the timing so that reliability of security can be improved.
- As a mode of this invention, the above timing determination processing can be set to a construction for determining the timing at random every repetition.
- Thus, it is reliably prevented that the authentication timing is estimated with respect to the unfair user, and reliability of security can be further improved.
- Further, this invention can be set to a face authenticating device having the above photographic subject authenticating device and constructed so as to photograph a face as the photographic subject by the above photographing means.
- Thus, a mental resistance feeling is little in comparison with a palm print, the iris, etc., and the disguise using the photograph can be appropriately excluded in face authentication easily accepted from a custom such as a nodding acquaintanceship, a face pass, etc.
- Further, this invention can be set to a portable telephone having the above photographic subject authenticating device.
- Thus, unfair use of the portable telephone can be prevented.
- Reliability of security with respect to the disguise can be improved by this invention.
-
- Fig. 1 is a perspective view of a photographic subject authenticating device.
- Fig. 2 is a block diagram showing the construction of the photographic subject authenticating device.
- Fig. 3 is a flow chart showing an operation executed by a control section.
- Fig. 4 is a timing chart of the photographic subject authenticating device.
- One embodiment mode of this invention will next be explained together with the drawings.
- First, the construction of a photographic subject
authenticating device 1 ofembodiment 1 will be explained together with the perspective view of the photographic subjectauthenticating device 1 shown in Fig. 1. - The photographic subject
authenticating device 1 is constructed by a portable telephone as one kind of a portable information terminal. Aspeaker 11 of outputting a voice, aliquid crystal monitor 14 for displaying an image,plural operation buttons 16 for inputting operations, and amicrophone 18 for inputting a voice are sequentially arranged from above on the front face of the photographic subjectauthenticating device 1. - A
camera 12 and anilluminating device 13 for photographing are vertically proximately arranged on the right-hand transversal side of theabove speaker 11. Thecamera 12 and theilluminating device 13 for photographing and the aboveliquid crystal monitor 14 are arranged on the same face (the surface in this embodiment mode) of the photographic subjectauthenticating device 1 such that a photographing direction of thecamera 12, an illuminating direction of theilluminating device 13 and a display direction of theliquid crystal monitor 14 become the same direction. The aboveilluminating device 13 is constructed by a suitable illuminating device such as a flash illuminating device for emitting flash light, or a lighting illuminating device (e.g., a LED and a fluorescent lamp) lighted, etc. - A
shutter button 15 of thecamera 12 is arranged on the right-hand side face of the photographic subjectauthenticating device 1. An opening-closing cover 19 rotated forward and backward is pivotally mounted to the lower portion of the front face of the photographic subjectauthenticating device 1. The opening-closing cover 19. is constructed so as to cover and protect theplural operation buttons 16 in a closing state. - An
antenna 10 for wireless communication is arranged in the upper portion of the rear face of the photographic subjectauthenticating device 1. A controller constructed by a CPU, a ROM and a RAM, and a battery charger for supplying operating electric power are arranged within the photographic subjectauthenticating device 1. A storing section is also arranged in this controller. A database for registering registration data for face collation as one kind of living body authentication, and normal operation data for true and false judgments of an input operation, and a photographic subject authenticating program for repeatedly executing the authentication using the face collation are stored into this storing section. - In accordance with the above construction, the
operation button 16 is operated and electricity is supplied (a signal is transmitted) from the photographic subjectauthenticating device 1. Further, the photographic subject authenticatingdevice 1 can receive an arriving signal by operating theoperation button 16. Thus, voice telephonic communication with a telephone set of a remote place can be allowed. Further, it is possible to display contents by Internet connection and transmit and receive an electronic mail by operating theoperation button 16. - The photographing of a static image and a dynamic image using the
camera 12 can be executed, and a photographing image can be displayed in theliquid crystal monitor 14. The personal authentication of a photographic subject can be performed by the photographing image obtained in this photographing: - Next, the construction of the photographic subject
authenticating device 1 will be explained together with the block diagram shown in Fig. 2. In this explanation, elements relating to a photographing function and an authenticating function required in the personal authentication will be explained, and the explanations of the other elements are omitted. - The photographic subject
authenticating device 1 is constructed by an electricpower source section 41, atimer 42, atime judging section 43, aface collating section 44, a collatingresult output section 45. - The above electric
power source section 41 is constructed by a battery charger and an electric power button (one of theoperation buttons 16 shown in Fig. 1), and supplies operating electric power to each constructional element by turning-on the electric power button. - The
above timer 42 is constructed by a controller of the photographic subjectauthenticating device 1, and receives the supply of the operating electric power from the above electricpower source section 41, and executes counting of time. - The above
time judging section 43 receives the time counted by theabove timer 42, and judges whether it is timing for executing the face collation or not. For example, this timing is determined by a time interval determined at random by random number processing, etc. - The above
face collating section 44 is constructed by the controller of the photographic subjectauthenticating device 1 and thecamera 12. The face collation of the photographing image acquired by thecamera 12, and the registration data stored to the storing section of the controller is performed. It is then judged whether it is conformity (the same person) or not. These registration data are photographing image data of a user registered in advance. In this embodiment mode, a face image small in mental resistance with respect to the user is used. The registration data are not limited to the image data, but may be also constructed by characteristic data provided by extracting a characteristic point and a characteristic amount from these image data. - The above collating
result output section 45 outputs one of conformity and unconformity as a result of the face collation, i.e., an authenticating result. - In accordance with the above construction, the face collation is irregularly repeated and is intermittently executed. Thus, it is possible to prevent that an unfair user continuously uses the photographic
subject authenticating device 1 by the disguise. - Next, the operation of repeating authentication processing executed by the controller using a photographic subject authenticating program will next be explained together with the flow chart showing an operation executed by the controller of the photographic
subject authenticating device 1 shown in Fig. 3. - When the user starts the use of a portable telephone (photographic subject authenticating device 1), the controller starts the counting of the timer 42 (step n1).
- The controller determines time for executing the face collation by the
time judging section 43 at random. The controller then waits while allowing the normal use of the user until this time (collation execution timing) determined at random passes (step n2: No). - When the time determined at random has passed (step n2: Yes), the controller executes the photographing using the
camera 12, and also executes the face collation using the photographing image acquired by this photographing, and the registration data by the face collating section 44 (step n3). - In the comparison of the face image data and the registration data in the face collation, a characteristic amount proper to the person in question is calculated from the photographing image, and is compared (collated) with the characteristic amount of the registration data. If the difference in the characteristic amount lies within a constant threshold value determined in advance, it is judged that it is the same person.
- For example, the above characteristic amount proper to the person in question can be calculated by using Gabor wavelet transformation with respect to the characteristic point acquired from the face image of the photographing image. This characteristic point can be acquired by cutting-out a face portion from a rough position of the face and normalizing the size of the face and further applying a detailed graph and detecting the position of the characteristic point of the face in detail. The Gabor wavelet transformation is a technique used in signal analysis and image compression. In this technique, a wavelet waveform is utilized from a transformation object, and only a character (a frequency component, etc.) provided by this waveform is taken out.
- When it is impossible to authenticate that it is the person in question as a result of the face collation (step n4: No), the collating
result output section 45 outputs information of unconformity to the controller as the authenticating result. Thus, the controller stops the use of the device, i,e., the use of the portable telephone (step n5). For example, if an operation such as telephonic communication, a setting change, WEB communication, etc. is being operated, such an operation is stopped and a subsequent operation input is refused. - In this state, it is preferable to set a construction for allowing only an authenticating request operation for restarting of the use. For example, this authenticating request operation of the use restarting is set to a predetermined operation such as pushing-down of the
shutter button 15, etc. When this authenticating request operation is received, the controller is constructed so as to execute the same face collation as the above step n3. If the result of the face collation is conformed, it is returned to the normal state and the processing is executed from step n1. In contrast to this, if the result of the face collation is unconformity, a state stopping the use of the portable telephone is maintained. The authentication (authentication for restarting) for this restarting may be also set to authentication except for the face collation, and may be also set to authentication using e.g., a password, a palm print, a voice, a word, etc. - If the result of the face collation is conformity (step n4: Yes), the collating
result output section 45 outputs information of conformity to the controller as an authenticating result. Thus, the controller allows the use of the device, i.e., the use of the portable telephone (step n6). Accordingly, a user can continuously use the portable telephone, and can use the portable telephone without hindrance. Namely, if it is seen from the user, the above face collation is freely executed by the portable telephone. Therefore, the registered normal user can usually use the portable telephone without particularly being conscious of the face collation. - The controller outputs contents able to stop the repetition of the collation. If no contents for stopping the repeating collation are inputted by the user (step n7: No), time for executing the face collation is determined at random by the
time judging section 43 and the controller waits until this time (collation executing timing) determined at random passes (step n8: No). - Here, the contents able to stop the repetition of the irregular collation can be outputted by display using the liquid crystal monitor 14 or/and a voice output using the
speaker 11. In the displaying case using theliquid crystal monitor 14, a selecting screen for selecting whether the repetition is stopped on the screen or not is displayed. Otherwise, it is possible to notify information by displaying an icon showing ability of the stoppage at a corner of the screen, etc. - The display and a voice guide of the contents able to stop the repetition may not be also executed. In this case, after a stopping function screen of the repeating collation is started by an operation of the user in a determined sequence, a selection for requiring the stoppage or requiring no stoppage may be also displayed. Thus, it is possible to set a construction in which no unfair user notices that the repeatedly executed authentication can be stopped. Thus, the disguise can be more reliably prevented.
- If the time determined at random in the above step n8 has passed (step n8: Yes), it is returned to step n3.
- When the contents of stoppage in the above step n7 are inputted (step n7: Yes), the controller performs an output for requesting a password input as repeating stoppage instructions, and receives the password input by the user (step n9). The output for requesting the password input can be performed by the display using the
liquid crystal monitor 14, the voice output using thespeaker 11, or both this display and this voice output. In the displaying case using theliquid crystal monitor 14, it is possible to notify password input waiting to the user by displaying a password input screen requesting the password input on the screen, or displaying an icon showing a password input state at a corner of the screen, etc. - When the password is inputted and an input completion input (e.g., pushing-down of an OK button, etc.) is performed, the controller judges whether this password is conformed to a password registered as normal instructions or not. Thus, it is judged whether it is the person in question or not (step n10).
- If it is not the person in question, i.e., when the inputted password is incorrect (step n10: No), the use of the device, i.e., the use of the portable telephone is stopped (step n11), and the processing is terminated.
- In contrast to this, when it is the person in question, i.e., when the inputted password is correct (step n10: Yes), the use of the device, i.e., the use of the portable telephone is continuously allowed (step n12).
- The controller waits until the electric power source is turned off (step n13: No), and terminates the processing if the electric power source is turned off (step n13: Yes).
- As shown by (A) of the timing chart of Fig. 4, the authentication of the person in question using the face collation can be repeatedly executed irregularly by the above operation while the device is used.
- Accordingly, even when unfair use is intended, no timing of the authentication can be known and it is difficult to perform the disguise so that reliability of security can be improved.
- When the user wants to stop the execution of the authentication of the person in question using the face collation, the user can stop the subsequent face collation by inputting the password.
- Thus, as shown by (B) of Fig. 4, the face collation is stopped. When the user performs the normal telephonic communication instead of a television telephone, it is possible to use the portable telephone in a state unable to perform the face collation, in which the portable telephone is held to a user's ear. Further, it is possible to restrain that the electric power of the battery charger is consumed by repeating the authentication processing by this stoppage.
- The stoppage of the face collation using the password input is constructed so as not to be executed unless after the face collation is performed at least once. Therefore, it is possible to prevent that only the password is broken and the device is unfairly used.
- The face collation is repeatedly irregularly executed without notifying this execution beforehand to the user. Therefore, timing of this face collation, i.e., photographing timing is not known by the unfair user so that the disguise can be excluded.
- If the electric power source is turned off, the processing is started from step n1 at the using time of the device after the electric power source is next turned on. As shown by (C) of Fig. 4, the irregular face collation is restarted. Therefore, it is possible to prevent that a long period has passed in a stopping state of the face collation.
- In the above embodiment mode, the photographing timing for the repeated face collation is constructed so as to be determined at random, but may be also set to a construction in which plural timings of different time intervals are set in advance and the repeating time intervals are changed by sequentially switching these plural timings. In this case, it is also difficult for a person intending the unfair use to grasp the photographing timing so that the disguise using measurement of the timing can be prevented.
- Further, it is set to the construction for executing the authentication processing if the use of the device is started. However, it may be also set to a construction for allowing the use without performing the face collation at a signal arriving time. Thus, the user noticing the signal arrival can make a telephone call without performing an operation of the stoppage of a collating function. When only voice telephonic communication is performed instead of the use of the portable telephone as in a television telephone, the continuation of the telephonic communication can be allowed even in a state in which no face image is obtained by holding the portable telephone to a user's ear so that convenient property of the user is improved.
- Further, it may be also set to a construction in which the face collation is executed in an electricity supplying operation at an electricity supplying time, and the password can be inputted if it is judged as conformity, and electricity is then supplied. Thus, when the voice telephonic communication is performed, the user inputs the password and stops the repeating authentication, and can perform the telephonic communication. Accordingly, it is possible to prevent that the repeating authentication is executed during the voice telephonic communication and the use of the portable telephone is inhibited. It is also possible to prevent that the telephonic communication is interrupted by this use inhibition. When the voice telephonic communication and the transmission and reception of a screen image are performed as the television telephone, the telephonic communication can be performed while receiving the repeating authentication even when no user inputs the password.
- The restarting of the face collation is not limited to turning-on of the electric power source after the electric power source is turned off, but may be also set to constructions in which the face collation is restarted when a constant time (e.g., 0 a.m. every day, every one hour, etc.) set on the setting screen has passed, and the face collation is restarted at the next using time after the use of the user is terminated. Here, the use can include the use of the telephonic communication, the use of WEB perusal, the use of mail transmission and reception, the use of a setting change, etc. Thus, it is possible to more reliably prevent that the stopping state of the face collation is continued for a long period.
- Further, an input means (e.g., a button for selecting and operating a button for the face collation, or a face collation button displayed in the liquid crystal monitor 14) for receiving a face collation executing input may be also arranged so as to immediately stop the repetition of the authentication. In this case, the face collation and the password input can be executed in arbitrary timing without waiting the face collation irregularly performed, and the irregular collation can be stopped.
- The photographic
subject authenticating device 1 is not limited to the case constructed by the portable telephone, but can be set to a suitable construction such as a construction using another portable information terminal such as a PDA, a note type personal computer, etc., or a construction using another device such as a desk top type personal computer, an ATM, etc. In this case, the face collation can be also repeatedly executed by using a camera, etc. arranged in the portable information terminal, the device, etc., and the repetition can be stopped in accordance with necessity. - The correspondence of the construction of this invention and the above embodiment mode is set as follows.
- The face authenticating device and the portable telephone of this invention correspond to the photographic
subject authenticating device 1 of the embodiment mode. - Similarly, the control means corresponds to the controller of the photographic
subject authenticating device 1. - The photographing means corresponds to the
camera 12. - The input means corresponds to the
operation button 16. - The timing determination processing corresponds to steps n2, n8.
- The authentication processing corresponds to steps n3 to n4.
- The authentication repeating processing corresponds to step n7.
- The irregular timing corresponds to the time determined at random.
- This invention is not limited to only the construction of the above embodiment mode, but many embodiment modes can be obtained.
Claims (6)
- A photographic subject authenticating device comprising photographing means for photographing a photographic subject, and performing authentication processing for authenticating the photographic subject on the basis of a photographing image provided by photographing the photographic subject by the photographing means;
the photographic subject authenticating device further comprising control means for executing:authentication repeating processing for also repeatedly executing the authentication processing after it is judged as conformity by said authentication processing; andtiming determination processing for determining repetitious execution timing so as to become irregular timing. - The photographic subject authenticating device according to claim 1, wherein said timing determination processing is constructed so as to determine the timing at random every repetition.
- A face authenticating device comprising the photographic subject authenticating device according to claim 1 or 2, and constructed so as to photograph a face as the photographic subject by said photographing means.
- A portable telephone comprising the photographic subject authenticating device according to claim 1 or 2.
- A photographic subject authenticating method for performing authentication processing for authenticating a photographic subject on the basis of a photographing image provided by photographing the photographic subject by photographing means, comprising:repeatedly executing the authentication processing after it is judged as conformity by said authentication processing; anddetermining repetitious execution timing so as to become irregular timing.
- A photographic subject authenticating program for performing authentication processing for authenticating a photographic subject on the basis of a photographing image provided by photographing the photographic subject by photographing means,
the photographic subject authenticating program executing:authentication repeating processing for also repeatedly executing the authentication processing after it is judged as conformity by said authentication processing; andtiming determination processing for determining repetitious execution timing so as to become irregular timing.
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
JP2005074036A JP2006259925A (en) | 2005-03-15 | 2005-03-15 | Object authentication device, cellular phone, object authentication method and object authentication program |
Publications (1)
Publication Number | Publication Date |
---|---|
EP1703441A1 true EP1703441A1 (en) | 2006-09-20 |
Family
ID=36645825
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
EP06111134A Withdrawn EP1703441A1 (en) | 2005-03-15 | 2006-03-14 | Photographic subject authenticating device, portable telephone, photographic subject authenticating method and photographic subject authenticating program |
Country Status (5)
Country | Link |
---|---|
US (1) | US20060212718A1 (en) |
EP (1) | EP1703441A1 (en) |
JP (1) | JP2006259925A (en) |
KR (1) | KR100760102B1 (en) |
CN (1) | CN1834991A (en) |
Families Citing this family (14)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JP4793179B2 (en) * | 2005-11-14 | 2011-10-12 | オムロン株式会社 | Authentication device and portable terminal |
JP2009223651A (en) * | 2008-03-17 | 2009-10-01 | Nec Saitama Ltd | Face authentication apparatus, program, and portable terminal |
US20100082490A1 (en) * | 2008-09-30 | 2010-04-01 | Apple Inc. | Systems and methods for secure wireless transactions |
JP5244551B2 (en) * | 2008-11-14 | 2013-07-24 | 株式会社野村総合研究所 | Information acquisition mediation program, operating system, information acquisition mediation method |
KR101325292B1 (en) * | 2009-06-16 | 2013-11-08 | 인텔 코오퍼레이션 | Camera applications in a handheld device |
US8254542B2 (en) | 2009-08-25 | 2012-08-28 | Bank Of America Corporation | Phone key authentication |
US9444816B2 (en) | 2011-03-30 | 2016-09-13 | Qualcomm Incorporated | Continuous voice authentication for a mobile device |
JP6008660B2 (en) * | 2012-08-28 | 2016-10-19 | キヤノン株式会社 | Information processing apparatus and information processing method |
JP5796052B2 (en) * | 2013-09-24 | 2015-10-21 | レノボ・イノベーションズ・リミテッド(香港) | Screen display control method, screen display control method, electronic device, and program |
JP6056837B2 (en) * | 2013-11-25 | 2017-01-11 | キヤノンマーケティングジャパン株式会社 | Information processing apparatus, information processing system, control method, and program |
KR102647637B1 (en) | 2019-01-08 | 2024-03-15 | 삼성전자주식회사 | Method for authenticating a user and electronic device thereof |
EP3982620A4 (en) | 2019-06-10 | 2022-08-17 | NEC Corporation | Communication terminal, information processing device, information processing system, information processing method, and program |
SG10201906721SA (en) | 2019-07-19 | 2021-02-25 | Nec Corp | Method and system for chrominance-based face liveness detection |
JP6979135B2 (en) * | 2019-07-31 | 2021-12-08 | 真旭 徳山 | Terminal devices, information processing methods, and programs |
Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5229764A (en) * | 1991-06-20 | 1993-07-20 | Matchett Noel D | Continuous biometric authentication matrix |
US20020095586A1 (en) * | 2001-01-17 | 2002-07-18 | International Business Machines Corporation | Technique for continuous user authentication |
EP1447794A1 (en) * | 2003-02-12 | 2004-08-18 | Hans Dr. Kuebler | Continuous speaker verification by means of speech input |
JP2004276783A (en) * | 2003-03-17 | 2004-10-07 | Aisin Seiki Co Ltd | Vehicle monitoring device |
US20040218070A1 (en) * | 2000-02-24 | 2004-11-04 | Nokia Corporation | Method and apparatus for user recognition using CCD cameras |
Family Cites Families (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
JPS6180475A (en) * | 1984-09-28 | 1986-04-24 | Matsushita Electric Ind Co Ltd | Result selecting method for pattern recognition |
WO2002019124A1 (en) * | 2000-08-30 | 2002-03-07 | Matsushita Electric Industrial Co.,Ltd. | Authentication system, authentication request device, validating device, and service medium |
US7702918B2 (en) * | 2001-07-18 | 2010-04-20 | Daon Holdings Limited | Distributed network system using biometric authentication access |
KR20040048114A (en) * | 2002-12-02 | 2004-06-07 | 주식회사 시큐아이티 | Authentication method and device using multi biological identification in portable radiotelephone |
US7738857B2 (en) * | 2003-03-28 | 2010-06-15 | Varia Holdings Llc | Wireless mobile phone with authenticated mode of operation including photo based authentication |
-
2005
- 2005-03-15 JP JP2005074036A patent/JP2006259925A/en not_active Withdrawn
-
2006
- 2006-03-10 CN CNA200610059514XA patent/CN1834991A/en active Pending
- 2006-03-10 US US11/372,589 patent/US20060212718A1/en not_active Abandoned
- 2006-03-13 KR KR1020060023033A patent/KR100760102B1/en not_active IP Right Cessation
- 2006-03-14 EP EP06111134A patent/EP1703441A1/en not_active Withdrawn
Patent Citations (5)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5229764A (en) * | 1991-06-20 | 1993-07-20 | Matchett Noel D | Continuous biometric authentication matrix |
US20040218070A1 (en) * | 2000-02-24 | 2004-11-04 | Nokia Corporation | Method and apparatus for user recognition using CCD cameras |
US20020095586A1 (en) * | 2001-01-17 | 2002-07-18 | International Business Machines Corporation | Technique for continuous user authentication |
EP1447794A1 (en) * | 2003-02-12 | 2004-08-18 | Hans Dr. Kuebler | Continuous speaker verification by means of speech input |
JP2004276783A (en) * | 2003-03-17 | 2004-10-07 | Aisin Seiki Co Ltd | Vehicle monitoring device |
Non-Patent Citations (2)
Title |
---|
CHELLAPPA R ET AL: "HUMAN AND MACHINE RECOGNITION OF FACES: A SURVEY", PROCEEDINGS OF THE IEEE, IEEE. NEW YORK, US, vol. 83, no. 5, 1 May 1995 (1995-05-01), pages 705 - 740, XP000517100, ISSN: 0018-9219 * |
PATENT ABSTRACTS OF JAPAN vol. 2003, no. 12 5 December 2003 (2003-12-05) * |
Also Published As
Publication number | Publication date |
---|---|
JP2006259925A (en) | 2006-09-28 |
US20060212718A1 (en) | 2006-09-21 |
CN1834991A (en) | 2006-09-20 |
KR20060101264A (en) | 2006-09-22 |
KR100760102B1 (en) | 2007-09-18 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
EP1703441A1 (en) | Photographic subject authenticating device, portable telephone, photographic subject authenticating method and photographic subject authenticating program | |
US11294336B2 (en) | Alarm control apparatus and method using face recognition | |
US7561791B2 (en) | Photographed body authenticating device, face authenticating device, portable telephone, photographed body authenticating unit, photographed body authenticating method and photographed body authenticating program | |
US7366497B2 (en) | Mobile terminal, method of controlling the same, and computer program of the same | |
US7705737B2 (en) | Object identifying device, mobile phone, object identifying method, program executable on computer for operating the object identifying device and computer-readable medium including the program | |
JP5964190B2 (en) | Terminal device | |
KR100526369B1 (en) | Cellular phone | |
EP2606449A1 (en) | Method and system for access to secure resources | |
WO2007029710A1 (en) | Mobile processor apparatus | |
JP2006306191A (en) | Personal authentication system for vehicle | |
CN110096244A (en) | A kind of information sharing method and relevant device based on data processing | |
CN109828734A (en) | Intelligent terminal shows screen control method, system and storage medium | |
US7417551B2 (en) | Photographic subject authenticating device, portable telephone, photographic subject authenticating method and photographic subject authenticating program | |
JPH1125246A (en) | Non-contact ic card and log-in method using the same | |
TW200635640A (en) | Game machine management device having penalty function, game device, driver, and penalty setting server | |
JP2000250861A (en) | System and method for non-contact type ic card log-in | |
JP2010088053A (en) | Mobile terminal, security door unlocking system, and security door unlocking method | |
WO2016059710A1 (en) | Authentication system, authentication device, authentication method, and authentication program | |
CN114252920A (en) | Article carrying prompting method, article carrying prompting device and readable storage medium | |
JP2022041038A (en) | Terminal device, information processing system, control method of terminal device, and control program of terminal device | |
JP2002008034A (en) | Personal identification device and method, and communication device | |
JP2006099461A (en) | Card operation device, operation method of device communicating with card, program and storage medium | |
JP2004021737A (en) | Service providing system, portable device, and service providing device | |
JP2008225989A (en) | Personal identification device and its method | |
JP2008083921A (en) | Principal collation device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
PUAI | Public reference made under article 153(3) epc to a published international application that has entered the european phase |
Free format text: ORIGINAL CODE: 0009012 |
|
AK | Designated contracting states |
Kind code of ref document: A1 Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
AX | Request for extension of the european patent |
Extension state: AL BA HR MK YU |
|
17P | Request for examination filed |
Effective date: 20070316 |
|
17Q | First examination report despatched |
Effective date: 20070413 |
|
AKX | Designation fees paid |
Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR |
|
STAA | Information on the status of an ep patent application or granted ep patent |
Free format text: STATUS: THE APPLICATION IS DEEMED TO BE WITHDRAWN |
|
18D | Application deemed to be withdrawn |
Effective date: 20090916 |