WO2001080494A1 - System and method for remote control and monitoring using internet - Google Patents

System and method for remote control and monitoring using internet Download PDF

Info

Publication number
WO2001080494A1
WO2001080494A1 PCT/KR2001/000629 KR0100629W WO0180494A1 WO 2001080494 A1 WO2001080494 A1 WO 2001080494A1 KR 0100629 W KR0100629 W KR 0100629W WO 0180494 A1 WO0180494 A1 WO 0180494A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
host
server
image data
control signal
Prior art date
Application number
PCT/KR2001/000629
Other languages
French (fr)
Inventor
Eung-Joo Lee
Seok-Je Cho
Ki-Ryong Kwon
Original Assignee
Digitalnetbank Inc.
Ahn, Hyun-Sik
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Digitalnetbank Inc., Ahn, Hyun-Sik filed Critical Digitalnetbank Inc.
Priority to AU2001248910A priority Critical patent/AU2001248910A1/en
Publication of WO2001080494A1 publication Critical patent/WO2001080494A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L12/00Data switching networks
    • H04L12/02Details
    • H04L12/16Arrangements for providing special services to substations
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • H04L67/025Protocols based on web technology, e.g. hypertext transfer protocol [HTTP] for remote control or remote monitoring of applications
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06QINFORMATION AND COMMUNICATION TECHNOLOGY [ICT] SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES; SYSTEMS OR METHODS SPECIALLY ADAPTED FOR ADMINISTRATIVE, COMMERCIAL, FINANCIAL, MANAGERIAL OR SUPERVISORY PURPOSES, NOT OTHERWISE PROVIDED FOR
    • G06Q30/00Commerce
    • G06Q30/02Marketing; Price estimation or determination; Fundraising
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/02Protocols based on web technology, e.g. hypertext transfer protocol [HTTP]
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L67/00Network arrangements or protocols for supporting network services or applications
    • H04L67/01Protocols
    • H04L67/12Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks
    • H04L67/125Protocols specially adapted for proprietary or special-purpose networking environments, e.g. medical networks, sensor networks, networks in vehicles or remote metering networks involving control of end-device applications over a network
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2219/00Program-control systems
    • G05B2219/30Nc systems
    • G05B2219/31From computer integrated manufacturing till monitoring
    • G05B2219/31457Factory remote control, monitoring through internet
    • GPHYSICS
    • G05CONTROLLING; REGULATING
    • G05BCONTROL OR REGULATING SYSTEMS IN GENERAL; FUNCTIONAL ELEMENTS OF SUCH SYSTEMS; MONITORING OR TESTING ARRANGEMENTS FOR SUCH SYSTEMS OR ELEMENTS
    • G05B2223/00Indexing scheme associated with group G05B23/00
    • G05B2223/06Remote monitoring
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04LTRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
    • H04L69/00Network arrangements, protocols or services independent of the application payload and not provided for in the other groups of this subclass
    • H04L69/30Definitions, standards or architectural aspects of layered protocol stacks
    • H04L69/32Architecture of open systems interconnection [OSI] 7-layer type protocol stacks, e.g. the interfaces between the data link level and the physical level
    • H04L69/322Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions
    • H04L69/329Intralayer communication protocols among peer entities or protocol data unit [PDU] definitions in the application layer [OSI layer 7]

Definitions

  • the present invention relates to remote control and monitoring system and method using the Internet, and more particularly, to remote control and monitoring system and method for performing home automation, factory automation, safety monitoring and remote control using the Internet
  • the system includes devices for performing operation or temperature setting in an air conditioner, reserved recording in a video cassette recorder (VCR), lighting control, crime prevention, and protection against disasters.
  • VCR video cassette recorder
  • the devices of such the system receive and transfer remote image, control signal and sensing signal by executing a dedicated Internet programming without using a web browser.
  • an object of the invention is to resolve the above problem and to monitor sound, image and control signal by receiving sound data, image data and sensing data in relation to a control object connected through the Internet using a web browser of a web client.
  • It is another object of the invention is to transmit a control command through a web browser of a web client and thereby remotely and electrically control a control object.
  • a remote control and monitoring system using the Internet comprises: a host part installed at a place where a control object is positioned, for receiving image data, sound data and sensing data and outputting a control signal; a server part for storing the image data, sound data and sensing data received from the host part and transmitting the stored control signal to the host part; and a web client part for receiving the image data, sound data and sensing data in a programmed form, displaying the received image data, sound data and sensing data through a web browser and transmitting the control signal to the server part.
  • a remote control and monitoring method using the Internet comprises the steps of: setting a client homepage and a database record and determining whether or not a service is requested from the host part; determining whether or not a flag of a database of the server part has a specific value if a service is requested from the host part; transmitting a service start signal to a host network part of the host part if the flag has the specific value; receiving the image data, sound data and sensing data from the host network part of the host part and recording the received data in a record of the database of the server part; displaying the homepage of the client depending on a request of the web client and displaying the stored image data, sound data and sensing data on the homepage; and determining whether or not to initialize the flag of the database, if the flag is not initialized, repeating the recording, displaying and transmitting steps while if the flag is initialized, requesting an ending of the service.
  • FIG. 1 is a block diagram for describing the concept of a remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention
  • FIG. 2 is a block diagram for specifically describing the remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention
  • FIG. 3 is a data flowchart for describing a process to realize a remote control and monitoring method using the Internet in accordance with one preferred embodiment of the present invention
  • FIG. 4 is a flowchart for describing data transmission and receipt between a server network part and a host network part
  • FIG. 5 is a flowchart for describing functions of a host part centering on the host network part
  • FIG. 6 is a flowchart for describing operation of a web server part in the system of FIG. l.
  • Fig. 7 is one example of a web page displayed through a web browser of the web client in the remote control and monitoring system using the Internet in accordance with the present invention.
  • FIG. 1 is a block diagram for describing the concept of a remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention.
  • a remote control and monitoring system of the present invention includes hosts 210 and 220 established at places where control objects are disposed, a server part 300 connected through the Internet 100 and web clients 410 and
  • Position information, address information and the like on the Internet are registered in the server part 300 in advance.
  • Hosts 210 and 220 are established at home, factory, office, etc., for example and they receive image data, sound data and sensing data all of which are related to a control object or transmit a control signal to the control object.
  • Web clients 410 and 420 are connected to the server part 300 through the Internet 100.
  • Each of the hosts 410 and 420 is programmed and connected in accordance with a socket manner of TCP/IP (Transmission control protocol/Internet protocol).
  • FIG. 2 is a block diagram for specifically describing the remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention.
  • host part 200 includes a sound data input part 201, an image data input part 202, a control signal output part 203, a sensing data input part and a host network part 205.
  • the sound data input part 201 is connected to, for example, a microphone (MIC), the image data input part 202 is connected to an image input camera (CM), the control signal output part 203 is connected to a driving means (ML) such as a motor, a relay, etc., and the sensing data input part 204 is connected to a sensor (SS) such as an optical sensor, a temperature sensor, a displacement sensor, etc.
  • a microphone MIC
  • the image data input part 202 is connected to an image input camera (CM)
  • CM image input camera
  • CM image input camera
  • ML driving means
  • SS such as an optical sensor, a temperature sensor, a displacement sensor, etc.
  • the sound data input part 201 functions to transmit an onsite circumstance of a control object to a remote place in sound and it includes a sound card and a driver.
  • the image data input part 202 receives and processes an image data of current state of a object for the control or observation.
  • the image data is input through the image input camera (CM).
  • CM image input camera
  • the image input camera (CM) is connected through a USB port.
  • a separate image input board is installed.
  • the control signal output part 203 moves a motor or drives a relay depending on information received from the server part 300.
  • the control signal output part 203 is connected to a controller of a high performance apparatus such as a robot as well as the motor or relay, so that it becomes possible to control such the elements using the web browser 401 of the web client part 400 positioned at a remote place.
  • the sensing data input part 204 receives a state data of a control object sensed by sensors and transfers the received state data to the server part 300.
  • the host network part 205 communicates with the server network part 301 of the server part to receive and transmit a variety of data from and to the server network part 301.
  • the host network part 205 transmits sound data obtained by the sound data input part 201, image data obtained by the image data input part 202 and sensing data obtained by the sensing data input part 204 and receives control signal output from the server part 300.
  • the server part 300 further includes a database (hereinafter referred to as "DB") 303 functioning to store and relay the sound data, image data and control command.
  • DB database
  • the server network part 301 of the server part 300 transmits and receives data to and from the host part 200.
  • the server network part 301 receives sound data obtained by the sound data input part, image data obtained by the image data input part 202 and sensing data obtained by the sensing data input part 204, and transmits to the host 200 control signal for driving and controlling motor, relay, etc.
  • the web server part 302 is built to allow a client to see the state of a control object through the web browser 401 of the web client part 400.
  • the web server part 302 can use a language such as HTML (HyperText Markup Language) 302a file or JAVA language and is fabricated using a CGI (Common Gateway Interface) 302b, Java applet, etc.
  • CGI Common Gateway Interface
  • WAP Wireless Application Protocol
  • WML Wireless Markup Language
  • CGI functions to read and write records of DB 303.
  • the web server part 302 functions to allow displaying an image, output a sound and displaying the state of sensed information received upon opening the HTML file of the web server part 302 using the web browser 401 of the web client part 400 based on sound data, image data and sensing data all of which are received by the server network part 301.
  • the CGI 302b perceives the clicking and functions to store it in a record form in the DB 303.
  • the server part 303 is operated by two processors corresponding to the server network part 301 and the web server part 302, respectively. If necessary, the two processors can be integrated into a single processor and they share the DB 303.
  • the web client part 400 indicates a personal computer or workstation in which the web browser 401 is installed.
  • the web server part 400 receives image data, sound data and sensing data of a corresponding onsite and shows picture and sound, or a check button for confirming a sensing state when a user opens a corresponding HTML file 302a through the web server part 302 of the server part 300.
  • the web client part 400 provides an interface environment allowing a user to click a control button for the remote control of a control object.
  • FIG. 3 is a data flow chart for describing a process for realizing a remote control and monitoring method in accordance with one preferred embodiment of the present invention
  • FIG. 4 is a flow chart for describing data transmission and receipt between the server network part and the host network part.
  • the DB 303 of the server part 300 stores records for inputting and outputting information related to clients who need services. The records are meant by sound data, image data, sensing data, control signal and flag values dealt by the host part 200. Flag is a signal used for transmitting and receiving information between respective elements.
  • the server network part 301 and the web server part 302 can transmit and receive information to and from the DB. Record of the DB 303 in an initial state is "0".
  • the server part 300 designates client homepage and records of the DB 303 so that it can transmit and receive information of client to and from a client who needs information related to a client (Step 100).
  • the step 100 as the client homepage and the DB record 303 are designated, it is determined whether or not to request a service that the host network part 205 of the host part 200 are operated (Step 101). If the service is not requested, the step 101 is repeated until the service is requested.
  • step 101 if the service is requested, the server network part 301 of the server part 300 sets respective records of the DB 303 as "0" to thereby request a service of the web client part 400 and complete the initializing procedure.
  • the web browser 401 of the web client part 400 in a remote place calls the HTML file 302a which has been installed in the web server part 302 of the server part 300, a homepage is displayed.
  • the HTML file 302a receives image data, sound data and sensing data of a corresponding onsite and shows image and sound or shows the check button for confirming a sensing state. Also, the HTML file 302a provides a control button to transmit a control signal for remotely controlling a control object. If the service is requested in the step 101, it is determined whether or not the flag of the DB 303 is set as "1" (Step 102). If the flag is not set as "1", the step 102 is repeated.
  • the server network part 301 perceives the conversion of the flag into "1" and transmits a start signal of the service to the host network part 205 (Step 103).
  • the server network part 301 of the server part 300 receives image data, sound data and sensing data from the host network part 205 (Step 104), and records and stores the received image data, sound data and sensing data in the DB 303 (Step 105).
  • the server network part 301 receives the image data, sound data and sensing data from the host network part 205 by a certain period. The period can be designated arbitrarily. It is allowed that the server network part 301 receives any one data, displays the received data on the homepage and receives next data or signal. In addition, it is allowed to make a difference in a time to transmit and receive the image data, sound data and sensing data.
  • Step 103 when the start signal of the service is transmitted and the control button on the homepage of the web browser of the web client part 400 is clicked in the step 103, control signal records are read from the DB 303 (Step 106) and the read control signal is transmitted to the host network part 205 (SI 07).
  • Step 108 it is determined whether or not the flag is "0" (Step 108). If the flag is not "0", it returns to the steps 104 and 106 respectively while if the flag is "0", it is determined whether or not to end the service
  • FIG. 5 is a flow chart for describing a function of the host part centered at the host network part.
  • the host part 200 first requests a service to the server part 300 (Step 200). After that, it is determined whether or not the service start signal is input into the host network part 205 (Step 201). If the service start signal is input, the host network part 205 receives sound data, image data and sensing data from the sound data input part 201, image data input part 202 and sensing data input part 204, respectively (S202), and transmits the received sound data, image data and sensing data to the server network part 301 (Step 203). Concurrently with this, if the service start signal is input in the step 201, the host network part 301 receives a control signal of a corresponding record stored in the DB
  • the control signal output part 203 outputs a driving signal of a motor or relay, etc., depending on the control signal transmitted from the host network part 205.
  • Step 206 it is determined whether or not to end the service. If the service is not ended, it returns to the steps 202 and 204, respectively while if the service is ended, it ends the function of the host part 200.
  • FIG. 6 is a flow chart for describing functions of the web server part in the remote control and monitoring system using the Internet shown in FIG. 1.
  • Step 301 When the HTML file 302a installed in the web server part 302 is called through the web browser 401 of the web client part 400, the flag is set as "1" (Step 301).
  • the image data, sound data and sensing data are read from a corresponding record of the DB 303 (S302) and the read image data, sound data and sensing data are displayed on the homepage (Step 303).
  • Step 305 If the flag is set as "1" in the step 301 and the control button on the homepage is clicked through the web browser 401 of the web client part 400, a control signal is recorded in a corresponding record of the DB 303 (Step 305). After the steps 303 and 305 are executed, it is determined whether or not to end the homepage (Step 306). If the homepage is not ended, it returns to the steps 302 and 304 while if the homepage is ended, the flag is set as "0" (Step 307).
  • FIG. 7 is one example of a web page displayed through the web browser of the web client part in the remote control and monitoring system using the Internet in accordance with the present invention.
  • the web page of the remote place displays states of image data, sound data and sensing signal and can transmit a control command through the control button (Command) to the remote place.
  • Command control button
  • the remote control and monitoring system in accordance with the present invention has the following advantages.
  • a host part is installed at home or factory of a client who needs the service and a server part connected to the respective host parts through the Internet manages image data, sound data and sensing data, it is possible to perform a state check of a control object and various controls from a remote place.

Abstract

The present invention relates to a remote control and a monitoring system using an Internet, which includes a host part installed on a position wherein a controlled object is located for imputting an image data, a sound data and a sensing data to output a control signal, a server part for storing the image data, the sound data and the sensing data received from the host part and transmitting the stored control signal to the host part, and a web client part for receiving the image data, the sound data and the sensing data stored in the server part in a programmed form, displaying thereof by a web browser, and transmitting the control signal to the server part.

Description

SYSTEM AND METHOD FOR REMOTE CONTROL AND MONITORING
USING INTERNET
Technical Field
The present invention relates to remote control and monitoring system and method using the Internet, and more particularly, to remote control and monitoring system and method for performing home automation, factory automation, safety monitoring and remote control using the Internet
Background Art Recently, Internet web sites increasing in geometrical progression have been widely used covering the whole filed of industry. For instance, these web sites provide images, etc., from a remote place using a web client connected to the Internet. Using such the method, these web sites are also being applied to video conference or video chatting which is one kind of on-line bi-directional communications between remote places.
In the meanwhile, there is being developed a system for controlling home electronics established in a house on virtual reality. The system includes devices for performing operation or temperature setting in an air conditioner, reserved recording in a video cassette recorder (VCR), lighting control, crime prevention, and protection against disasters. The devices of such the system receive and transfer remote image, control signal and sensing signal by executing a dedicated Internet programming without using a web browser.
Then, such the remote control system has problems in that the devices are too high in price, a separate client should be used or a dedicated program should be installed.
Disclosure of the Invention Therefore, it is an object of the invention is to resolve the above problem and to monitor sound, image and control signal by receiving sound data, image data and sensing data in relation to a control object connected through the Internet using a web browser of a web client.
It is another object of the invention is to transmit a control command through a web browser of a web client and thereby remotely and electrically control a control object.
Other objects and features of the present invention will become apparent from the following detailed description considered in connection with the accompanying drawings that disclose an embodiment of the present invention. To accomplish the above objects and advantages, there is provided a remote control and monitoring system using the Internet. The system comprises: a host part installed at a place where a control object is positioned, for receiving image data, sound data and sensing data and outputting a control signal; a server part for storing the image data, sound data and sensing data received from the host part and transmitting the stored control signal to the host part; and a web client part for receiving the image data, sound data and sensing data in a programmed form, displaying the received image data, sound data and sensing data through a web browser and transmitting the control signal to the server part.
According to another aspect of the invention, there is provided a remote control and monitoring method using the Internet. The method comprises the steps of: setting a client homepage and a database record and determining whether or not a service is requested from the host part; determining whether or not a flag of a database of the server part has a specific value if a service is requested from the host part; transmitting a service start signal to a host network part of the host part if the flag has the specific value; receiving the image data, sound data and sensing data from the host network part of the host part and recording the received data in a record of the database of the server part; displaying the homepage of the client depending on a request of the web client and displaying the stored image data, sound data and sensing data on the homepage; and determining whether or not to initialize the flag of the database, if the flag is not initialized, repeating the recording, displaying and transmitting steps while if the flag is initialized, requesting an ending of the service.
Brief Description of the Drawings FIG. 1 is a block diagram for describing the concept of a remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention;
FIG. 2 is a block diagram for specifically describing the remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention;
FIG. 3 is a data flowchart for describing a process to realize a remote control and monitoring method using the Internet in accordance with one preferred embodiment of the present invention;
FIG. 4 is a flowchart for describing data transmission and receipt between a server network part and a host network part;
FIG. 5 is a flowchart for describing functions of a host part centering on the host network part;
FIG. 6 is a flowchart for describing operation of a web server part in the system of FIG. l; and
Fig. 7 is one example of a web page displayed through a web browser of the web client in the remote control and monitoring system using the Internet in accordance with the present invention.
Best Mode for Carrying Out the Invention
Now, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings. In reference numeral assigned to elements of respective drawings, it is noted that like elements are denoted by like reference numerals if possible although they are shown in different drawings. FIG. 1 is a block diagram for describing the concept of a remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention.
Referring to FIG. 1, a remote control and monitoring system of the present invention includes hosts 210 and 220 established at places where control objects are disposed, a server part 300 connected through the Internet 100 and web clients 410 and
420. Position information, address information and the like on the Internet are registered in the server part 300 in advance.
Hosts 210 and 220 are established at home, factory, office, etc., for example and they receive image data, sound data and sensing data all of which are related to a control object or transmit a control signal to the control object. Web clients 410 and 420 are connected to the server part 300 through the Internet 100. Each of the hosts 410 and 420 is programmed and connected in accordance with a socket manner of TCP/IP (Transmission control protocol/Internet protocol). FIG. 2 is a block diagram for specifically describing the remote control and monitoring system using the Internet in accordance with one preferred embodiment of the present invention.
Referring to FIG. 2, host part 200 includes a sound data input part 201, an image data input part 202, a control signal output part 203, a sensing data input part and a host network part 205.
The sound data input part 201 is connected to, for example, a microphone (MIC), the image data input part 202 is connected to an image input camera (CM), the control signal output part 203 is connected to a driving means (ML) such as a motor, a relay, etc., and the sensing data input part 204 is connected to a sensor (SS) such as an optical sensor, a temperature sensor, a displacement sensor, etc.
The sound data input part 201 functions to transmit an onsite circumstance of a control object to a remote place in sound and it includes a sound card and a driver. The image data input part 202 receives and processes an image data of current state of a object for the control or observation. The image data is input through the image input camera (CM). In case that a USB (Universal serial bus) is used, the image input camera (CM) is connected through a USB port. And, in case that a television image standard, for example, NTSC is used, a separate image input board is installed.
The control signal output part 203 moves a motor or drives a relay depending on information received from the server part 300. The control signal output part 203 is connected to a controller of a high performance apparatus such as a robot as well as the motor or relay, so that it becomes possible to control such the elements using the web browser 401 of the web client part 400 positioned at a remote place.
The sensing data input part 204 receives a state data of a control object sensed by sensors and transfers the received state data to the server part 300.
The host network part 205 communicates with the server network part 301 of the server part to receive and transmit a variety of data from and to the server network part 301. In other words, the host network part 205 transmits sound data obtained by the sound data input part 201, image data obtained by the image data input part 202 and sensing data obtained by the sensing data input part 204 and receives control signal output from the server part 300.
In the meanwhile, the server part 300 further includes a database (hereinafter referred to as "DB") 303 functioning to store and relay the sound data, image data and control command. The server network part 301 of the server part 300 transmits and receives data to and from the host part 200. Specifically, the server network part 301 receives sound data obtained by the sound data input part, image data obtained by the image data input part 202 and sensing data obtained by the sensing data input part 204, and transmits to the host 200 control signal for driving and controlling motor, relay, etc. The web server part 302 is built to allow a client to see the state of a control object through the web browser 401 of the web client part 400. The web server part 302 can use a language such as HTML (HyperText Markup Language) 302a file or JAVA language and is fabricated using a CGI (Common Gateway Interface) 302b, Java applet, etc. In case of using wireless Internet, WAP (Wireless Application Protocol)-based WML (Wireless Markup Language), etc., can be used instead of the HTML file. At this time, CGI functions to read and write records of DB 303.
The web server part 302 functions to allow displaying an image, output a sound and displaying the state of sensed information received upon opening the HTML file of the web server part 302 using the web browser 401 of the web client part 400 based on sound data, image data and sensing data all of which are received by the server network part 301.
In addition, when clicking a button for controlling a control object on the web browser 401, the CGI 302b perceives the clicking and functions to store it in a record form in the DB 303.
In terms of a processor, the server part 303 is operated by two processors corresponding to the server network part 301 and the web server part 302, respectively. If necessary, the two processors can be integrated into a single processor and they share the DB 303. The web client part 400 indicates a personal computer or workstation in which the web browser 401 is installed. The web server part 400 receives image data, sound data and sensing data of a corresponding onsite and shows picture and sound, or a check button for confirming a sensing state when a user opens a corresponding HTML file 302a through the web server part 302 of the server part 300. In addition, the web client part 400 provides an interface environment allowing a user to click a control button for the remote control of a control object. Accordingly, due to the characteristic of the web browser 401, wherever such the computers are placed, the computers can observe picture, hear sound of a current state, check sensing state and transmit a control signal for the remote control. FIG. 3 is a data flow chart for describing a process for realizing a remote control and monitoring method in accordance with one preferred embodiment of the present invention and FIG. 4 is a flow chart for describing data transmission and receipt between the server network part and the host network part. In FIGS. 3 and 4, the DB 303 of the server part 300 stores records for inputting and outputting information related to clients who need services. The records are meant by sound data, image data, sensing data, control signal and flag values dealt by the host part 200. Flag is a signal used for transmitting and receiving information between respective elements. The server network part 301 and the web server part 302 can transmit and receive information to and from the DB. Record of the DB 303 in an initial state is "0".
The server part 300 designates client homepage and records of the DB 303 so that it can transmit and receive information of client to and from a client who needs information related to a client (Step 100). In the step 100, as the client homepage and the DB record 303 are designated, it is determined whether or not to request a service that the host network part 205 of the host part 200 are operated (Step 101). If the service is not requested, the step 101 is repeated until the service is requested.
In step 101, if the service is requested, the server network part 301 of the server part 300 sets respective records of the DB 303 as "0" to thereby request a service of the web client part 400 and complete the initializing procedure.
As aforementioned, if the web browser 401 of the web client part 400 in a remote place calls the HTML file 302a which has been installed in the web server part 302 of the server part 300, a homepage is displayed. The HTML file 302a receives image data, sound data and sensing data of a corresponding onsite and shows image and sound or shows the check button for confirming a sensing state. Also, the HTML file 302a provides a control button to transmit a control signal for remotely controlling a control object. If the service is requested in the step 101, it is determined whether or not the flag of the DB 303 is set as "1" (Step 102). If the flag is not set as "1", the step 102 is repeated. In the step 102, if the flag of the DB 303 becomes "1" at the instant that the HTML file 302a is called, the server network part 301 perceives the conversion of the flag into "1" and transmits a start signal of the service to the host network part 205 (Step 103).
In the step 103, if the start signal of the service is transmitted, the server network part 301 of the server part 300 receives image data, sound data and sensing data from the host network part 205 (Step 104), and records and stores the received image data, sound data and sensing data in the DB 303 (Step 105). In step 104, the server network part 301 receives the image data, sound data and sensing data from the host network part 205 by a certain period. The period can be designated arbitrarily. It is allowed that the server network part 301 receives any one data, displays the received data on the homepage and receives next data or signal. In addition, it is allowed to make a difference in a time to transmit and receive the image data, sound data and sensing data.
In the meanwhile, when the start signal of the service is transmitted and the control button on the homepage of the web browser of the web client part 400 is clicked in the step 103, control signal records are read from the DB 303 (Step 106) and the read control signal is transmitted to the host network part 205 (SI 07). After the Steps 105 and 107 are executed, it is determined whether or not the flag is "0" (Step 108). If the flag is not "0", it returns to the steps 104 and 106 respectively while if the flag is "0", it is determined whether or not to end the service
(SI 09). If the ending of the service is not requested, it returns to the step 102. And if the ending of the service is requested, it returns to the step of 101.
FIG. 5 is a flow chart for describing a function of the host part centered at the host network part.
The host part 200 first requests a service to the server part 300 (Step 200). After that, it is determined whether or not the service start signal is input into the host network part 205 (Step 201). If the service start signal is input, the host network part 205 receives sound data, image data and sensing data from the sound data input part 201, image data input part 202 and sensing data input part 204, respectively (S202), and transmits the received sound data, image data and sensing data to the server network part 301 (Step 203). Concurrently with this, if the service start signal is input in the step 201, the host network part 301 receives a control signal of a corresponding record stored in the DB
303 through the server network part 301 (Step 204), and transmits the received signal to the control signal output part 203 (Step 205). The control signal output part 203 outputs a driving signal of a motor or relay, etc., depending on the control signal transmitted from the host network part 205.
After the steps 203 and 205 are executed, it is determined whether or not to end the service (Step 206). If the service is not ended, it returns to the steps 202 and 204, respectively while if the service is ended, it ends the function of the host part 200.
FIG. 6 is a flow chart for describing functions of the web server part in the remote control and monitoring system using the Internet shown in FIG. 1.
When the HTML file 302a installed in the web server part 302 is called through the web browser 401 of the web client part 400, the flag is set as "1" (Step 301).
If the flag is set as "1", the image data, sound data and sensing data are read from a corresponding record of the DB 303 (S302) and the read image data, sound data and sensing data are displayed on the homepage (Step 303).
In addition, If the flag is set as "1" in the step 301 and the control button on the homepage is clicked through the web browser 401 of the web client part 400, a control signal is recorded in a corresponding record of the DB 303 (Step 305). After the steps 303 and 305 are executed, it is determined whether or not to end the homepage (Step 306). If the homepage is not ended, it returns to the steps 302 and 304 while if the homepage is ended, the flag is set as "0" (Step 307).
FIG. 7 is one example of a web page displayed through the web browser of the web client part in the remote control and monitoring system using the Internet in accordance with the present invention. Referring to FIG. 7, the web page of the remote place displays states of image data, sound data and sensing signal and can transmit a control command through the control button (Command) to the remote place.
While the present invention has been described in detail with reference to the preferred embodiments, those skilled in the art will appreciate that various modifications and substitutions can be made thereto without departing from the spirit and scope of the present invention as set forth in the appended claims.
As described above, the remote control and monitoring system in accordance with the present invention has the following advantages.
Since the remote control and observation are performed using web on the Internet, it is possible to observe image and sound and sense control signal including a variety of signals regardless of positions without installing a specific program if a web browser has been installed in the computer.
In addition, since a host part is installed at home or factory of a client who needs the service and a server part connected to the respective host parts through the Internet manages image data, sound data and sensing data, it is possible to perform a state check of a control object and various controls from a remote place.

Claims

Claims:
1. system and method for remote control and monitoring using Internet, the system comprising: a host part installed at a place where a control object is positioned, for receiving image data, sound data and sensing data and outputting a control signal; a server part for storing the image data, sound data and sensing data received from the host part and transmitting the stored control signal to the host part; and a web client part for receiving the image data, sound data and sensing data in a programmed form, displaying the received image data, sound data and sensing data through a web browser and transmitting the control signal to the server part.
2. The system of claim 1 , wherein said host part comprises: an image data input part connected to an image input device, for receiving the image data; a sound data input part connected to a sound input device, for receiving the sound data; a sensing data input part connected to a sensor, for receiving the sensing data; a control signal output part for outputting a control signal received from the server part to a driving device; and a host network part for transmitting or receiving the sound data, image data and sensing data and the control signal to or from the server part. wherein the background picture managing server further comprises: a homepage managing part which constructs a homepage and stores and manages the constructed homepage at a homepage information DB; and
3. The system of claim 1, wherein said server part comprises a server network part for receiving the image data, sound data and sensing data from the host and transmitting the control signal to the host; a web server part for programming and storing the received image data, sound data and sensing data and reading out the stored control signal depending a request of the web client part; and a database for storing the image data, sound data, sensing data and the control signal, the database being shared by the server network part and the web server part.
4. The system of claim 1, wherein said web client part is connected to the server part through a wireless Internet and has a built-in web browser using a WAP (Wireless application protocol)-based WML (Wireless markup language).
5. A remote control and monitoring method using the Internet, the method being applied to the system of claim 1 and comprising the steps of: setting a client homepage and a database record and determining whether or not a service is requested from the host part; determining whether or not a flag of a database of the server part has a specific value if a service is requested from the host part; transmitting a service start signal to a host network part of the host part if the flag has the specific value; receiving the image data, sound data and sensing data from the host network part of the host part and recording the received data in a record of the database of the server part; displaying the homepage of the client depending on a request of the web client and displaying the stored image data, sound data and sensing data on the homepage; and determining whether or not to initialize the flag of the database, if the flag is not initialized, repeating the recording, displaying and transmitting steps while if the flag is initialized, requesting an ending of the service.
6. The method of claim 5, further comprising the step of reading out a corresponding control signal record from the database depending on a control signal of the web client part and transmitting a control command to the host part after displaying the stored image data, sound data and sensing data. a homepage setting part which allows a homepage user to select the homepage from the homepage information DB.
PCT/KR2001/000629 2000-04-15 2001-04-16 System and method for remote control and monitoring using internet WO2001080494A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU2001248910A AU2001248910A1 (en) 2000-04-15 2001-04-16 System and method for remote control and monitoring using internet

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
KR10-2000-0019768A KR100390530B1 (en) 2000-04-15 2000-04-15 Apparatus and Method for remote control and monitoring using internet
KR2000/19768 2000-04-15

Publications (1)

Publication Number Publication Date
WO2001080494A1 true WO2001080494A1 (en) 2001-10-25

Family

ID=19664457

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/KR2001/000629 WO2001080494A1 (en) 2000-04-15 2001-04-16 System and method for remote control and monitoring using internet

Country Status (3)

Country Link
KR (1) KR100390530B1 (en)
AU (1) AU2001248910A1 (en)
WO (1) WO2001080494A1 (en)

Cited By (24)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6560543B2 (en) 1998-12-17 2003-05-06 Perlorica, Inc. Method for monitoring a public water treatment system
EP1339201A2 (en) * 2002-02-26 2003-08-27 United Technologies Corporation Remote tablet-based internet inspection system
EP1562151A2 (en) 2004-01-30 2005-08-10 United Technologies Corporation System for remote monitoring of a vehicle
DE102004004344A1 (en) * 2004-01-29 2005-08-25 Abb Research Ltd. Automatic system remote monitoring system uses web server with unidirectional serial link from automatic equipment
US6954701B2 (en) 1998-12-17 2005-10-11 Watereye, Inc. Method for remote monitoring of water treatment systems
WO2006019909A1 (en) * 2004-07-14 2006-02-23 York International Corporation Html driven embedded controller
US7100427B2 (en) 2004-05-07 2006-09-05 Sensicore, Inc. Multi-sensor system for fluid monitoring with selective exposure of sensors
US7104115B2 (en) 2004-05-07 2006-09-12 Sensicore, Inc. Fluid treatment apparatus with input and output fluid sensing
US7249000B2 (en) 2004-05-07 2007-07-24 Sensicore, Inc. Fluid monitoring systems and methods with data communication to interested parties
US7373524B2 (en) 2004-02-24 2008-05-13 Covelight Systems, Inc. Methods, systems and computer program products for monitoring user behavior for a server application
US7383036B2 (en) * 2002-02-28 2008-06-03 Lg Electronics Inc. Home network system
US7454295B2 (en) 1998-12-17 2008-11-18 The Watereye Corporation Anti-terrorism water quality monitoring system
GB2449518A (en) * 2007-03-08 2008-11-26 American Power Conv Corp Remote monitoring device
US7844385B2 (en) 2004-01-28 2010-11-30 United Technologies Corporation Microserver engine control card
EP2320287A1 (en) * 2009-11-05 2011-05-11 Siemens Aktiengesellschaft Monitoring system and method for monitoring the state of a technical installation
US8145748B2 (en) 2004-12-13 2012-03-27 American Power Conversion Corporation Remote monitoring system
FR2974698A1 (en) * 2011-04-29 2012-11-02 Ga Remote control system for electrical equipment e.g. air-conditioning equipment, in building, has web server transmitting commands received from web client to centralized technical management server for controlling electrical equipment
CN103635915A (en) * 2012-02-28 2014-03-12 松下电器产业株式会社 Display device for control information, method for displaying control information, and system for displaying control information
US8920619B2 (en) 2003-03-19 2014-12-30 Hach Company Carbon nanotube sensor
US8958917B2 (en) 1998-12-17 2015-02-17 Hach Company Method and system for remote monitoring of fluid quality and treatment
CN104468497A (en) * 2014-08-19 2015-03-25 北京绿叶丰谷科技发展有限公司 Data isolation method and device of monitoring system
US9056783B2 (en) 1998-12-17 2015-06-16 Hach Company System for monitoring discharges into a waste water collection system
WO2015188453A1 (en) * 2014-06-11 2015-12-17 中兴通讯股份有限公司 Client access method and device
US20170331929A1 (en) * 2016-05-16 2017-11-16 Fisher-Rosemount Systems, Inc. Multi-Protocol Field Device in Process Control Systems

Families Citing this family (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR20020006214A (en) * 2000-07-11 2002-01-19 김철병 Management system of boiler using internet
KR20020006211A (en) * 2000-07-11 2002-01-19 김철병 Management method of boiler using internet
KR20000063800A (en) * 2000-08-04 2000-11-06 전익수 Apparatus and Method for serving a image program and for controlling a residence facility using internet
KR100380904B1 (en) * 2000-10-13 2003-04-18 주식회사 엔써티 Wireless Terminal For Remote Controlled System
KR20020032164A (en) * 2000-10-26 2002-05-03 김대위 Apparatus for remote monitoring and controlling home using internet
KR20030063810A (en) * 2002-01-24 2003-07-31 삼우정보기술 주식회사 Repeating instellation of watching and management system using internet
KR100475570B1 (en) * 2002-11-04 2005-03-11 삼성전자주식회사 system and method for remote controlling home network
KR100793813B1 (en) * 2007-07-11 2008-01-11 주식회사 예향텔레콤 Remote control security system and method using internet network, cellular network and pstn
KR20160079342A (en) 2014-12-26 2016-07-06 전자부품연구원 Apparatus for controlling sound signal based on flexible filter bank
KR101668098B1 (en) * 2015-03-31 2016-10-24 주식회사 아이디스 Access method for a remote point without Plugin

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0825506A2 (en) * 1996-08-20 1998-02-25 Foxboro Corporation Methods and apparatus for remote process control
JPH10124418A (en) * 1996-10-22 1998-05-15 Nippon Telegr & Teleph Corp <Ntt> Remote control method using www server
JPH1117678A (en) * 1997-06-19 1999-01-22 Nec Commun Syst Ltd Remote control system for network management device
WO1999018532A1 (en) * 1997-10-07 1999-04-15 Health Hero Network, Inc. Networked system for interactive communication and remote monitoring of individuals
JPH11219388A (en) * 1998-02-04 1999-08-10 Fujitsu Ltd Remote management system
KR20000003244A (en) * 1998-06-26 2000-01-15 민기철 Remote home automatization system using internet
EP0973297A2 (en) * 1998-07-17 2000-01-19 Tektronix, Inc. Web based remote monitoring/control of a measurement instrument

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP0825506A2 (en) * 1996-08-20 1998-02-25 Foxboro Corporation Methods and apparatus for remote process control
JPH10124418A (en) * 1996-10-22 1998-05-15 Nippon Telegr & Teleph Corp <Ntt> Remote control method using www server
JPH1117678A (en) * 1997-06-19 1999-01-22 Nec Commun Syst Ltd Remote control system for network management device
WO1999018532A1 (en) * 1997-10-07 1999-04-15 Health Hero Network, Inc. Networked system for interactive communication and remote monitoring of individuals
JPH11219388A (en) * 1998-02-04 1999-08-10 Fujitsu Ltd Remote management system
KR20000003244A (en) * 1998-06-26 2000-01-15 민기철 Remote home automatization system using internet
EP0973297A2 (en) * 1998-07-17 2000-01-19 Tektronix, Inc. Web based remote monitoring/control of a measurement instrument

Cited By (40)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US9056783B2 (en) 1998-12-17 2015-06-16 Hach Company System for monitoring discharges into a waste water collection system
US7698073B2 (en) 1998-12-17 2010-04-13 Hach Company Anti-terrorism water quality monitoring system
US6560543B2 (en) 1998-12-17 2003-05-06 Perlorica, Inc. Method for monitoring a public water treatment system
US8958917B2 (en) 1998-12-17 2015-02-17 Hach Company Method and system for remote monitoring of fluid quality and treatment
US7454295B2 (en) 1998-12-17 2008-11-18 The Watereye Corporation Anti-terrorism water quality monitoring system
US9015003B2 (en) 1998-12-17 2015-04-21 Hach Company Water monitoring system
US9588094B2 (en) 1998-12-17 2017-03-07 Hach Company Water monitoring system
US6954701B2 (en) 1998-12-17 2005-10-11 Watereye, Inc. Method for remote monitoring of water treatment systems
US9069927B2 (en) 1998-12-17 2015-06-30 Hach Company Anti-terrorism water quality monitoring system
WO2003038685A3 (en) * 2001-10-26 2003-11-27 Perlorica Inc Method for monitoring a public water treatment system
WO2003038685A2 (en) * 2001-10-26 2003-05-08 Perlorica, Inc. Method for monitoring a public water treatment system
EP1339201A3 (en) * 2002-02-26 2003-10-01 United Technologies Corporation Remote tablet-based internet inspection system
US8082317B2 (en) 2002-02-26 2011-12-20 United Technologies Corporation Remote tablet-based internet inspection system
EP1339201A2 (en) * 2002-02-26 2003-08-27 United Technologies Corporation Remote tablet-based internet inspection system
US7383036B2 (en) * 2002-02-28 2008-06-03 Lg Electronics Inc. Home network system
US9739742B2 (en) 2003-03-19 2017-08-22 Hach Company Carbon nanotube sensor
US8920619B2 (en) 2003-03-19 2014-12-30 Hach Company Carbon nanotube sensor
US7844385B2 (en) 2004-01-28 2010-11-30 United Technologies Corporation Microserver engine control card
DE102004004344A1 (en) * 2004-01-29 2005-08-25 Abb Research Ltd. Automatic system remote monitoring system uses web server with unidirectional serial link from automatic equipment
US7167788B2 (en) 2004-01-30 2007-01-23 United Technologies Corporation Dual-architecture microserver card
EP1562151A2 (en) 2004-01-30 2005-08-10 United Technologies Corporation System for remote monitoring of a vehicle
EP1562151A3 (en) * 2004-01-30 2005-11-16 United Technologies Corporation Dual-architecture microserver card
US7373524B2 (en) 2004-02-24 2008-05-13 Covelight Systems, Inc. Methods, systems and computer program products for monitoring user behavior for a server application
US7104115B2 (en) 2004-05-07 2006-09-12 Sensicore, Inc. Fluid treatment apparatus with input and output fluid sensing
US7100427B2 (en) 2004-05-07 2006-09-05 Sensicore, Inc. Multi-sensor system for fluid monitoring with selective exposure of sensors
US7249000B2 (en) 2004-05-07 2007-07-24 Sensicore, Inc. Fluid monitoring systems and methods with data communication to interested parties
US7440809B2 (en) 2004-07-14 2008-10-21 York International Corporation HTML driven embedded controller
WO2006019909A1 (en) * 2004-07-14 2006-02-23 York International Corporation Html driven embedded controller
US9166870B2 (en) 2004-12-13 2015-10-20 Schneider Electric It Corporation Remote monitoring system
US8145748B2 (en) 2004-12-13 2012-03-27 American Power Conversion Corporation Remote monitoring system
GB2449518A (en) * 2007-03-08 2008-11-26 American Power Conv Corp Remote monitoring device
GB2449518B (en) * 2007-03-08 2011-08-03 American Power Conv Corp Remote monitoring system
EP2320287A1 (en) * 2009-11-05 2011-05-11 Siemens Aktiengesellschaft Monitoring system and method for monitoring the state of a technical installation
FR2974698A1 (en) * 2011-04-29 2012-11-02 Ga Remote control system for electrical equipment e.g. air-conditioning equipment, in building, has web server transmitting commands received from web client to centralized technical management server for controlling electrical equipment
CN103635915A (en) * 2012-02-28 2014-03-12 松下电器产业株式会社 Display device for control information, method for displaying control information, and system for displaying control information
CN103635915B (en) * 2012-02-28 2017-12-15 松下知识产权经营株式会社 Control information display device, control information display methods and control information display system
WO2015188453A1 (en) * 2014-06-11 2015-12-17 中兴通讯股份有限公司 Client access method and device
CN104468497A (en) * 2014-08-19 2015-03-25 北京绿叶丰谷科技发展有限公司 Data isolation method and device of monitoring system
US20170331929A1 (en) * 2016-05-16 2017-11-16 Fisher-Rosemount Systems, Inc. Multi-Protocol Field Device in Process Control Systems
US11108893B2 (en) * 2016-05-16 2021-08-31 Fisher-Rosemount Systems, Inc. Multi-protocol field device in process control systems

Also Published As

Publication number Publication date
AU2001248910A1 (en) 2001-10-30
KR100390530B1 (en) 2003-07-04
KR20010096839A (en) 2001-11-08

Similar Documents

Publication Publication Date Title
WO2001080494A1 (en) System and method for remote control and monitoring using internet
US9401950B2 (en) Node unregisterable without user account at remote site
US6170007B1 (en) Embedding web access functionality into a device for user interface functions
JP3735942B2 (en) COMMUNICATION CONTROL METHOD, COMMUNICATION SYSTEM AND ELECTRONIC DEVICE USED FOR THE SAME
JP3677453B2 (en) Internet camera gateway
US8146124B2 (en) Camera adapter for remote controlling a camera, control method thereof, and storage medium
US20030052860A1 (en) Modular remote controller
JP4878409B2 (en) Information control apparatus, information control method, and storage medium
JP4109739B2 (en) CAMERA CONTROL DEVICE, CAMERA CONTROL SYSTEM, CAMERA CONTROL DEVICE CONTROL METHOD, AND STORAGE MEDIUM
JPH1185651A (en) Communication interface device, object equipment and communication method
US20060044106A1 (en) Remote control device, remote control method, and remotely controlled device
Nikolova et al. Remote mobile control of home appliances
KR100911754B1 (en) Peer distributed embedded web server system
JP2002034026A (en) Remote monitor system
JP3381772B2 (en) Production line monitoring system
JP4196978B2 (en) COMMUNICATION SYSTEM, INFORMATION OBTAINING METHOD, AND ELECTRONIC DEVICE
KR100301111B1 (en) Remote digital camera control system and its control method on the Internet
KR20020032164A (en) Apparatus for remote monitoring and controlling home using internet
KR20020016300A (en) Remote image providing method through network and apparatus therefor
JP2004295873A (en) Remote control device, remote control method, and remote controlled device
JP3369966B2 (en) REMOTE CONTROL DEVICE AND COMPUTER-READABLE MEDIUM RECORDING REMOTE CONTROL PROGRAM
JP2001016576A (en) Camera operation system, its control method and storage medium

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BY BZ CA CH CN CR CU CZ DE DK DM DZ EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG US UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW MZ SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE TR BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: JP