WO2005120028A1 - Terminal device, and control method of terminal device - Google Patents

Terminal device, and control method of terminal device Download PDF

Info

Publication number
WO2005120028A1
WO2005120028A1 PCT/JP2005/010310 JP2005010310W WO2005120028A1 WO 2005120028 A1 WO2005120028 A1 WO 2005120028A1 JP 2005010310 W JP2005010310 W JP 2005010310W WO 2005120028 A1 WO2005120028 A1 WO 2005120028A1
Authority
WO
WIPO (PCT)
Prior art keywords
telephone
terminal
partner terminal
protocol
terminal device
Prior art date
Application number
PCT/JP2005/010310
Other languages
French (fr)
Inventor
Muneki Nakao
Yosuke Ezumi
Yukio Nohata
Atsushi Takahashi
Shinya Kogure
Original Assignee
Canon Kabushiki Kaisha
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Canon Kabushiki Kaisha filed Critical Canon Kabushiki Kaisha
Publication of WO2005120028A1 publication Critical patent/WO2005120028A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M7/00Arrangements for interconnection between switching centres
    • H04M7/006Networks other than PSTN/ISDN providing telephone service, e.g. Voice over Internet Protocol (VoIP), including next generation networks with a packet-switched transport layer
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/253Telephone sets using digital voice transmission
    • H04M1/2535Telephone sets using digital voice transmission adapted for voice communication over an Internet Protocol [IP] network
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M1/00Substation equipment, e.g. for use by subscribers
    • H04M1/72Mobile telephones; Cordless telephones, i.e. devices for establishing wireless links to base stations without route selection
    • H04M1/724User interfaces specially adapted for cordless or mobile telephones
    • H04M1/72403User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality
    • H04M1/7243User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages
    • H04M1/72436User interfaces specially adapted for cordless or mobile telephones with means for local support of applications that increase the functionality with interactive means for internal management of messages for text messaging, e.g. SMS or e-mail
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M3/00Automatic or semi-automatic exchanges
    • H04M3/42Systems providing special services or facilities to subscribers
    • H04M3/50Centralised arrangements for answering calls; Centralised arrangements for recording messages for absent or busy subscribers ; Centralised arrangements for recording messages
    • H04M3/53Centralised arrangements for recording incoming messages, i.e. mailbox systems
    • H04M3/533Voice mail systems
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2201/00Electronic components, circuits, software, systems or apparatus used in telephone systems
    • H04M2201/60Medium conversion
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04MTELEPHONIC COMMUNICATION
    • H04M2203/00Aspects of automatic or semi-automatic exchanges
    • H04M2203/45Aspects of automatic or semi-automatic exchanges related to voicemail messaging
    • H04M2203/4536Voicemail combined with text-based messaging

Definitions

  • the present invention relates to a terminal device which calls a partner terminal based on a protocol for an IP (Internet Protocol) telephone and executes at least voice communication to the called partner terminal, and a control method which is adapted to control the relevant terminal device.
  • IP Internet Protocol
  • an image communication technique as in television conference or the like is conventionally diverted to a sizable percentage of the IP telephone, whereby a video call (so called a television telephone) including transmission/reception of moving images can of course be executed by the IP telephone.
  • a video call (so called a television telephone) including transmission/reception of moving images can of course be executed by the IP telephone.
  • one of the important things in the IP telephone technique is to achieve the various functions same as those in conventional PSTN (Public Switched Telephone Networks) , and, at that time, to achieve more satisfactory services by making the best use of the Internet.
  • PSTN Public Switched Telephone Networks
  • the technique achieved by the conventional PSTN terminal includes telephone message recording (by an answering machine) , transmission/reception of a voice message, and the like.
  • the conventional PSTN terminal on a reception side often records in a message recording means a voice message sent from the terminal on a calling side.
  • the IP telephone the following techniques are proposed. For example, in Japanese • Patent Application Laid-Open No. 2001-309040, in a case where the IP telephone terminal calls an analog public telephone terminal, if no response is sent from the public telephone terminal due to, e.g., absence of its user, a gateway saves the voice mail data to be transmitted from the IP telephone terminal. Then, after elapsing a certain period of time, the IP telephone terminal again calls the relevant public telephone terminal by automatic dialing, and, when a response is sent therefrom, the IP telephone terminal reads the saved voice mail data and transmits it thereto.
  • the SIP of which the standardization is advanced by IETF Internet Engineering Task Force
  • the standard technique which is suitable for multimedia communication and has a high affinity to the Internet technique.
  • the SIP is used to identify a partner station in case of data transmission.
  • IETF - RFC3261, RFC3262, RFC3263, RFC3264, RFC3265 and RFC3515 http: //www.
  • the mail processing unit of a television conference device creates a video mail from voice and video signals, and, in response to the indication by a user, the mail processing unit restores the voice and video signals from the relevant mail and outputs these signals respectively to a voice output device and a video output device.
  • a transfer destination information processing unit of the mail processor creates a transfer information table and registers the transfer destination of the absence-registered user, and a message transformation processing unit transforms the file received from a message restoration processing unit or a telephone/facsimile processing unit to the type of file notified from the transfer destination information processing unit.
  • the message capable of being received at the transfer destination is created and then transferred thereto.
  • the called-side terminal since the called-side terminal is the analog public telephone terminal, there is a high possibility that the terminal itself is locationally fixed. For this reason, a restriction occurs with respect to the location where it can receive the voice message.
  • timing for receiving the voice message at the called-side terminal depends on management by the gateway, there is a possibility that the voice message cannot be received during a period that called operation is refused due to call (telephone call) or the like on the called side.
  • various voice message transmission methods are proposed by the SIP protocols (IETF - RFC3261, RFC3262, RFC3263, RFC3264, RFC3265, RFC3515) .
  • the standard voice message transmission dares to establish the media session between the terminal and the voice message server to transmit in real time the voice of the calling side to the voice message server, and saves the transmitted voice on the voice message server.
  • an object of the present invention is to provide-, in a telephone system of executing transmission/reception of voice data or video data, a terminal device and a control method for the terminal device which can transmit/receive a business mail produced by high quality voice and/or video data without losing the operation feeling of a conventional automatic answering telephone and requiring the use of an expensive terminal, in a case where a called side does not respond due to such a situation as absence or the like.
  • a terminal device which executes at least voice communication to a partner terminal, comprising: a telephone calling unit adapted to execute a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation unit adapted to, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulate in the terminal device a business message of a user; and a mail transmission unit adapted to transmit data indicating the business message to a mail address of the partner terminal by using an electronic mail protocol.
  • Fig. 1 is a block diagram showing the hardware constitution of a terminal device adopting the present invention (first embodiment) ;
  • Fig. 2 is a block diagram showing the constitution of a display unit of the device in Fig-. 1;
  • Fig. 3 is a block diagram showing the constitution of a DRAM (Dynamic Random Access Memory) composing a storage unit in Fig. 1;
  • Fig. 4 is an external view showing the constitution of an operation unit of the device in Fig. 1;
  • Fig. 5 is an outline view showing the form wherein the terminal device adopting the present invention is connected to the Internet;
  • Fig. 6 is a sequence view showing a standard calling control sequence of SIP in case of executing a call;
  • FIG. 7 is a sequence view showing the control sequence executed by the terminal device adopting the present invention and each of equipments on the network;
  • Fig. 8 is a flowchart showing a control procedure of a calling side terminal (terminal A) according to the present invention;
  • Fig. 9 is an explanation view showing an example of a UI (user interface) display screen of the calling side terminal (terminal A) according to the present invention;
  • Fig. 10 is a block diagram showing another hardware constitution of a terminal device adopting the present invention (second embodiment) ;
  • Fig. 11 is a block diagram showing the constitution of a DRAM composing a storage unit in Fig. 10;
  • Fig. 12 is an external view showing the constitution of an operation unit of the device in Fig. 10;
  • FIG. 13 is a sequence view showing the control sequence executed by the terminal device adopting the present invention and each of equipments on the network;
  • Fig. 14 is a flowchart showing a control procedure of a calling side terminal (terminal A) according to the present invention;
  • Fig. 15 is an explanation view showing an example of a UI display screen of the calling side terminal (terminal A) according to the present invention.
  • a constitutional example of a terminal device which transmits a voice message as a business message by an E-mail in a case where a partner terminal does not respond although a calling according to a VoIP (Voice over Internet Protocol) has been, executed, is shown.
  • Fig. 1 shows the constitution of the terminal device coping .with an IP (Internet Protocol) telephone adopting the present invention.
  • the shown terminal device can be constituted as a product such as an MFP (Multi Function Printer) which includes a telephone device or the image transmission and input/output functions, or as a mobile communication terminal (mobile phone) or the like.
  • numeral 101 denotes a central ' processing unit (CPU) which controls the entire device.
  • Numeral 102 denotes a ROM (Read Only Memory) which stores programs and data.
  • Numeral 103 denotes a storage unit (DRAM; Dynamic Random Access Memory) which stores CPU work data, a codec (compression/decompression) work area, mail data, HTML (Hyper Text Markup Language) data, display data, printing data and other data.
  • Numeral 104 denotes a non-volatile RAM (SRAM; Static Random Access Memory) which stores private data, telephone directory data and backup data for preserving various device constants.
  • SRAM Static Random Access Memory
  • Numeral 105 denotes a sensor group which includes a sensor for detecting the condition of a receiver as a telephone device, a sensor for detecting the size of recording sheets, a sensor for detecting width of an original to be read, a sensor for detecting presence/absence of the original and other sensors .
  • Numeral 106 denotes a display unit which realizes a UI (User Interface) of a telephone terminal together with an operation unit 108 composed of various keys and displays received contents data, the condition of the device or the like in color. The constitutional examples of the display unit 106 and the operation unit 108 will be described in detail in Fig. 4.
  • Numeral 107 denotes a codec (hereinafter, to be described as CODEC) which can execute at least the encoding/decoding of voice data in the present embodiment.
  • the CODEC 107 may be constituted that it can further execute the encoding/decoding of color or monochrome image data (a stil image and an animation as in the embodiment to be .described later) .
  • the terminal device in the present embodiment has an image communication function and has blocks used for inputting and outputting image data, denoted by numerals 109 and 111.
  • the block 109 is a reading unit composed of a reading element such as a CCD (Charge Coupled Device) or a CIS (Contact Image Sensor) used for scanning a color or monochrome image and a mechanism such as an original convey unit or the like.
  • the block 111 which is a printing unit having a printer function for printing the received image or text data, is constituted based on an arbitrary printing system such as an electrophotographic system or an inkjet system. It should be noted that the above image communication function is not always required in the present embodiment and can be omitted in a case where the terminal device is constituted as the mobile communication terminal (mobile phone) .
  • Numeral 112 denotes a communication unit for communicating with external units connecting with a line 113.
  • connection with an interned and an IP communication through the network connection of the Internet can be executed by the communication unit 112. Further, it may be constituted -that a call and an image communication via a PSTN (Public Switched Telephone Network) can be executed through the communication unit 112. If the above-mentioned communication can ⁇ be executed, the detailed constitution of the communication unit 112 is arbitrary. Connection with the Internet can be realized through the PSTN (including ISDN (Integrated Services Digital
  • the communication unit 112 requires a MODEM (Modulator/Demodulator) or a router coping with various communication lines . Otherwise, such the MODEM or the router is substituted for the external one, and only a LAN (CSMA/CD; Carrier Sense Multiple Access with Collision Detection (for example, Ethernet (brand name) ) interface used for connecting with the network equipments may be provided in the terminal device.
  • CSMA/CD Carrier Sense Multiple Access with Collision Detection
  • Ethernet brand name
  • Internet communication and PSTN communication may be executed using the same communication line (for example, ISDN) , or different lines for the Internet communication and the PSTN communication may be respectively used.
  • a connecting system with the line or the network may employ a mobile communication system utilizing a radio connection or the like.
  • a line/network interface coping with the corresponded system is installed in the communication unit 112.
  • Numeral 114 denotes a call unit, which includes devices such as a receiver, a speaker, a microphone and the like as a telephone device, is a block for realizing a voice MMI (Man Machine Interface) with a user.
  • the above-explained blocks shown in Fig. 1 are mutually connected through a system bus 110.
  • the display unit 106 includes a VRAM (Video RAM) 200 for storing display data and an LCD (Liquid Crystal Display) driver 201 for outputting the contents of the VRAM 200 to a dot matrix LCD 202.
  • Fig. 3 shows a memory map which indicates the internal constitution of the DRAM 103 composing the storage unit.
  • the DRAM 103 is constituted by a CPU work area 1031 used as a work area of the CPU 101, a CODEC work area 1032 used as a work area in case of executing the encoding/decoding, a mail data storage area 1033 for storing mail data, an HTML data storage area 1034 for storing the received HTML data, a display data storage area 1035 for storing display data, a printing ' data storage area 1036 for storing print data and an other data storage area 1037 for storing other data or used as a work area for an operation.
  • Fig. 4 shows the external constitution of the display unit 106 and the operation unit 108 in Fig. 1
  • Numeral 202 denotes an LCD which constitutes the display unit 106.
  • the operation unit 108 includes ten keys 402 used for inputting a telephone number and the like, a menu key 403 used for setting the function, four function keys 404 used for inputting various information, a set key 405 being a setting input key and a right and left/up and down directions key 406 used for moving a cursor on the display unit 106 (LCD 202) .
  • Fig. 5 conceptually shows the network constitution in a case where the terminal device in Fig. 1 executes a communication through a network including the Internet.
  • a terminal (A) 503 and a terminal (B) 504 are connected to the Internet 500 by an IP connection.
  • At least the calling side terminal (A) 503 is- assumed to be composed of the terminal device shown in Fig. 1, and the above-mentioned communication unit 112 is used for the IP connection.
  • An SIP/proxy server 501 which is connected with the Internet, provides an SIP service.
  • the SIP/proxy server 501 controls an SIP being a signal protocol used for executing a calling control in real time on the Internet.
  • the SIP is characterized in that it is excellent in protocol extendability and affinity with another Internet service.
  • the SIP/proxy server 501 executes a control of SIP signaling standardized in RFC3261 (Request For Comments 3261), the registration/certification of a user, a user management and the like.
  • the mail server 502 is provided by an Internet service provider or a company managing the network.
  • an ENUM (Enumeration) DNS (Domain Name System) server 505 is also connected with the Internet 500 by the IP connection, and "registrar" associated with telephone numbers of end users and address information in a different communication and the like are included. For example, in case of generating a call, an IP address or a mail address of a partner terminal can be obtained (resolved) from the telephone number by accessing to the ENUM DNS server 505 on the basis of a predetermined protocol. It should be noted that the ENUM service and the DNS service are not always provided by a single server (505) as in- an example shown in Fig. 5. Both of the terminals A and B (503 and 504) shown in Fig.
  • Fig. 6 shows a sequence of the session of the general SIP used in calling/called operations by an IP telephone. In Fig. 6, the communication state in a case where the terminal A calls the terminal B is indicated. The details of an SIP message in Fig. 6 (or Fig.
  • the terminal A being an end point of the IP telephone service transmits an INVITE message to the SIP/Proxy server (step S601) .
  • the SIP/Proxy server 501 receives the INVITE, a calling destination address to be called by the terminal A is specified from data included in the INVITE message, and the INVITE is transmitted to the terminal B being an end point (step S602).
  • the SIP/Proxy server 501 transmits the lOOTrying to the terminal A (step S603:
  • "100" denotes a discrimination or result code indicating a Trying message.
  • another message is denoted by the same description method
  • the 180Ringing message is returned to the SIP/Proxy server 501 from the terminal B as a response (step S604)
  • the message as the 180Ringing is transmitted to the terminal A (step S605) .
  • the terminal A is in a state of calling the terminal B, and a ring back tone in calling is sent to the partner terminal from the call unit 114 at the terminal A in a state of the general terminal mode or control condition, and the terminal B is in a receiving state of ringing a call sound of the telephone.
  • step S606 when the terminal B responds to the reception, the terminal B sends the 200OK (step S606) , and the 200OK is transmitted to the terminal A being an end point at the calling side through the SIP/Proxy server 501 (step S607) .
  • the terminal A transmits the ACK (Acknowledgement) message as a response to the transmission of the 200OK (step S608), the ACK is transmitted to the terminal B being an end point at the called side through the SIP/Proxy server 501 (step S609) .
  • a media session is started (step S610) to become a call state betw,een the end points.
  • a UDP User Datagram Protocol
  • flow control and the ACK transmission acknowledgement
  • a lower-layer an encoded voice data communication is executed by using, for example, an RTP (Real-time Transport Protocol) /RTCP (Real-time Transport Control Protocol) .
  • Regulated methods G.711, G.726, G.729 and the like are prepared for the encoding/decoding of voice data, and an appropriate encoding/decoding method is selected according to a using band.
  • Fig. 7 shows a sequence in a case where the terminal B does not respond to the calling from the terminal A due to such the situation as absence or the like, in the present embodiment.
  • the calling sequence in steps S701 to S706 shown in Fig. 7 is similar to that in the steps S601 to S605 shown in Fig.
  • an INVITE message is transmitted to the SIP/Proxy server 501 from the terminal A (step S701) .
  • the SIP/Proxy server 501 receives the INVITE and further transmits the INVITE to the terminal B (step S702) .
  • the SIP/Proxy server 501 transmits the lOOTrying message to the terminal A (step S703) .
  • the terminal B receives the INVITE and transmits the lOOTrying (step S704) and the 180Ringing subsequently to the SIP/Proxy server 501 (step 705) .
  • the SIP/Proxy server 501 transmits the 180Ringing to the terminal A.
  • the terminal A is in a state of calling the terminal B.
  • the terminal B does not respond to the calling from the terminal A due to such the situation as absence or the like.
  • the terminal B executes a call by informing means such as a called sound or the like in order to call a user.
  • the terminal B itself judges a fact that the user does not respond by the timeout.
  • the terminal B itself may make judgment even in a case where the terminal B is set in a telephone automatic answering mode.
  • the terminal B transmits the 302Moved Temporarily message to the terminal A through the SIP/Proxy server 501 (step SI 01 ) .
  • the , transmission is executed by including a contact URI (Uniform Resource Identifiers) of a mail server (for example, a mail server 502 shown in Fig. 5) , by which the terminal B can receive mails, in a Contact header of this redirection response such as the 302Moved Temporarily.
  • a contact URI Uniform Resource Identifiers
  • the terminal A can obtain an address, to which a voice message is transmitted later.
  • the SIP/Proxy server 501 transmits the ACK to the terminal B (step S708) and subsequently transmits the 302Moved Temporarily to the terminal A. (step S709) .
  • the terminal A receives the 302Moved Temporarily and transmits the ACK to the SIP/Proxy server 501 (step S710) . Thereafter, the voice message is generated in the terminal A (step S711) .
  • step S709 when the 302Moved Temporarily is received from the terminal B being an end point of the calling destination through the SIP/Proxy server 501 (step S709) , it is judged that the calling destination does not respond to the dialing, and subsequently the voice message is generated (step S711) .
  • Generation of the voice message is to be realized to execute by the same operation feeling as that of a method of recording a message to a telephone receiver by a calling party in a case where a partner telephone device responds to the absence by an automatic answering telephone in a telephone device of a conventional analog line.
  • the voice of an operator is input by a telephone receiver included in the call unit 114 shown in Fig.
  • the input voice data is encoded at the CODEC 107.
  • the CODEC work area 1032 in the DRAM 103 is used as an encoding work area.
  • the voice encoded data is once stored into the mail data storage area 1037 in the DRAM 103 as a voice file.
  • an example of generating message data by treating a business message as the voice data is indicated.
  • the voice of the calling party is recognized by a technology, of voice recognition and then the recognized voice data is transformed into character information, and the message data may be generated by treating the message of the calling party as a mail of the character information. Since the voice recognition is the known technology, a detailed description thereof will be omitted.
  • the voice message data is transformed into a format capable of transmitting the information as a mail in the generation of the voice' message shown in Fig. 7 (step S711) .
  • the message can be informed to the partner side as the character information even if the partner terminal does not have means of decoding voice data and reproducing the voice.
  • the partner terminal has a function capable of listening the character ⁇ information as voice information again by the voice data synthesis, an effect of reducing the data amount on an information transmission route and decreasing the traffic is kept by transmitting the business message to the reception side terminal from the - transmission side terminal with a form of the character information.
  • the terminal A is connected with a TCP No. 25 port (SMTP port) of the mail server 502 by a telenet (step S712) .
  • the Connect message is sent back from the mail server 502, and the connected. state with the telenet is kept.
  • a voice file of the voice message stored into the mail data storage area is transmitted to ' the mail server 502 (step S714).
  • the voice file is encoded by a format regulated by the SMTP, for example, by a MIME (Multipurpose Internet Mail Extension) format and then attached to the inside of an E-mail text.
  • a MIME Multipurpose Internet Mail Extension
  • both of the terminals A and B have accounts of the- ' mail service on the Internet and can transmit/receive mails by connecting with the mail server 502 in Fig. 5 by the SMTP/POP3.
  • a mail address associated with the partner telephone number can be obtained by accessing to the ENUM DNS server 505.
  • the voice message generated as mail data is to be transmitted to the mail address obtained as mentioned above.
  • the voice message can be transmitted to the mail address of the terminal.B..
  • the voice message can be transmitted to a terminal designated by a mail address other than the mail address of the terminal B.
  • the mail address of the partner is previously preserved in a memory of the own device associating with the telephone number, and a method of executing a transmission by treating the mail address as a transmission destination by obtaining the mail address in the own device from the telephone number in case of calling the telephone may be proper.
  • a method of previously preserving the mail address of the partner in the memory of the own device associating with the telephone number since it is equivalent to the constitution of the telephone directory registration of the conventional facsimile device, the mobile phone or the like, an explanation thereof will be omitted because of the known technology.
  • the OK message is sent back from the mail server 502 (step S715) .
  • the voice data is to be transmitted by the service with the TCP/IP (Transmission Control
  • Fig. 8 shows a state of a communication control which is to be executed by the terminal device (the above-mentioned terminal A) shown in Fig. 1 so as to execute the general calling/called operation shown in Fig.
  • Fig. 8 shows a flow from a start of the dial transmission to the end of the call, and the procedure shown in Fig. 8 is stored into, for example, the ROM 102 or the like as a control program of the CPU 101 shown in Fig. 1.
  • a calling control' of the SIP is executed so as to establish the call connection of the IP telephone in a step S802.
  • the calling control of the SIP it is executed as indicated in Figs . 6 to 7.
  • step S7 in a case where the terminal A receives the 302Moved Temporarily (step S709) and it is judged that the partner terminal does not respond by the calling control of SIP, it is judged that the partner terminal is in a state of "NO" response in a step S803 to be advanced to an absence message generation UI (step S805) .
  • the absence message generation UI in the step S805 a calling party executes an operation to generate the voice message by using the display unit 106 and the operation unit 108 of the terminal device (terminal A) .
  • An example of the absence message generation UI (mainly, a screen display) will be described later.
  • a step S806 it is judged whether or not the recording of the absence message is stopped by checking the state of an operation of the user at the operation unit 108 (refer to User Interface described later) , and when the recording of the absence message is stopped, the flow advances to a step S810 and the call is terminated.
  • the voice recording process and the encoding process are executed in a step S807.
  • the operator voice is input by the telephone receiver in the call unit 114 shown in Fig. 1, and the voice data is encoded by the CODEC 107.
  • the voice encoded data is once stored into the DRAM 103 as a voice file and further transformed into an E-mail format capable of transmitting a mail, in a step S808.
  • a process of formatting the E-mail is executed according to the regulation of the MIME format as mentioned before, and the voice data is attached to the E-mail text as an attachment file.
  • the data formatted into the E-mail text is transmitted to the mail server 502 using the SMTP.
  • an operation sequence from the start of the dial transmission is terminated.
  • Fig. 9 shows an example of the user interface executed by using the display unit 106 and the operation unit 108 in the generation of the absence message to be executed in the step S805 shown in Fig. 8.
  • Fig. 9 shows an example of the user interface executed by using the display unit 106 and the operation unit 108 in the generation of the absence message to be executed in the step S805 shown in Fig. 8.
  • Fig. 9 shows an example of the user interface executed by using the display unit 106 and the operation unit 108 in the
  • FIG. 9- shows a display screen from a case where the partner terminal does not respond until the termination of transmitting the voice message extracted out of the operation sequence in Fig. 8.
  • a character row display such as "No response to calling" is displayed on a central portion of the screen in order to indicate that the partner terminal does not respond as in a ⁇ • > screen 901 shown in Fig. 9.
  • a partner abbreviated name, a partner telephone number and a partner mail address are displayed on a lower portion of the character row display.
  • Information related to the partner terminal can be obtained from ENUM information regulated in the RFC 2916 through the SIP/Proxy server 501, and the terminal being a user agent can obtain from the server in the calling control of SIP. It should be noted that information to be displayed on the screen 901 is not limited to the above-mentioned information but, for example, other arbitrary information related to the partner terminal can be displayed. On a lower portion of the screen 901, a button 901a used for instructing the stop of the current calling (or an automatically . activated re-calling may be included) is displayed.
  • the button 901a is selected by the right and left/up and down directions key 406 or the like, and an input operation (or, if the display unit 106 is a screen of touch panel system, a direct input is executed, or the input operation is executed by a pointing device such as a mouse) is executed by such a method of defining an input by the set key 405 (other buttons described later are similarly operated) .
  • the display screen is changed to a screen 902 in accordance with the elapse of a predetermined time (or a predetermined operation in the operation unit 108), and the user is made to start the recording of the voice message using this screen.
  • buttons 902a, 902b and 902c are arranged.
  • the button 902a is a dial stop button similar to the button 901a
  • the button 902b is a record stop button
  • the button 902c is used for instructing a timing of the record end.
  • the display screen is changed to a screen 903 where it is displayed that the recorded voice message is transmitted to the partner terminal as an E-mail by the above-mentioned manner.
  • a button 903a for stopping the transmission of the corresponded E-mail is arranged.
  • the voice message is recorded by using the user interface as shown in Fig. 9, and the message can be transmitted by the E-mail.
  • the UI being one form of an automatic answering telephone of the IP telephone can be suitably ' realized with the operation feeling equivalent to or finer than that of the automatic answering telephone based on the conventional analog line .
  • the partner terminal in a case where the partner terminal does not respond in the IP telephone system, it becomes possible to realize the suitable operability without losing the operation feeling of the automatic answering telephone based on the conventional analog line. Further, even in the terminal set in a state of the low QoS (Quality of Service) of the IP telephone system, since such the constitution wherein the voice message is once encoded and is transmitted by a mail format is adopted, the voice message can be transmitted to the partner terminal with a sate without lacking data. Therefore, even in a case where a mobile communication system is used for the connection with a network, the extremely favorable > constitution can be provided as a telephony application which can transmit a message recorded in the absence to the partner terminal without deteriorating quality of the voice.
  • QoS Quality of Service
  • a voice message is to tje transmitted by an E-mail as a business mail in a case where a partner terminal does not respond even if a calling according to a VoIP (Voice over Internet Protocol) is executed.
  • VoIP Voice over Internet Protocol
  • an example of transmitting a video message by the E-Mail as the business mail will be indicated.
  • the drawings are the are same as those in the- first embodiment.
  • the constituent components which are the same as or correspond to those in the first embodiment are respectively denoted by the same (or similar) numerals and symbols, and the detailed description thereof will be omitted.
  • Fig. 10 which corresponds to Fig. 1 in the first embodiment, shows the constitution of a terminal device adopting the present invention.
  • a CCD (Charge Coupled Device) 115 is added for the purpose of shooting an animation (or a still image) and the CODEC 107 shown in Fig. 1 is replaced by an MPEG4 (Moving Picture coding Experts Group 4) CODEC 116 for executing the encoding/decoding of the animation.
  • CCD Charge Coupled Device
  • MPEG4 Motion Picture coding Experts Group 4
  • the CCD 115 is arranged so that an animation video of a user can be shot as described later for the purpose of using the terminal device as a TV telephone especially.
  • the constitution is the same as that in an explanation related to Fig. 1 in the first embodiment.
  • the constitution of a peripheral control system of the display unit 106 is the same as that shown in Fig. 2.
  • Fig. 11, which corresponds to Fig. 3 in the first embodiment, is a memory map indicating the internal constitution of the DRAM 103, and a different point as compared with the constitution in Fig. 3 is that the CODEC work area 1032 in Fig.
  • Fig. 3 is replaced by a CODEC work area 1038 of the MPEG4 to be used as a work area in case of executing the encoding/decoding of the MPEG 4.
  • Fig. 12 which corresponds to Fig. 4 in the first embodiment, shows the external constitution of the display unit 106 and the operation unit 108.
  • a different point as compared with ' the constitution in Fig. 4 is that the CCD 115 shown in Fig. 1 is provided on an upper portion of an LCD 202.
  • the CCD 115 is disposed so that a shooting lens can be turned toward a user in order that a face or the upper half of body .of the user can be shot (the rotationally supported constitution is available so as to become possible the tilt or the pan) .
  • the terminal device shown in Fig. 10 can be used in the network constitution where the SIP/Proxy server 501, the mail server 502 and the ENUM DNS server 505 are arranged as shown in Fig. 5 similar to the first embodiment.
  • at least the calling side terminal (A) 503 is assumed to be composed of the terminal device shown in Fig. 10, and the aforementioned communication unit 112 is used for the IP connection.
  • the calling/called operation of the IP telephone is • controlled by utilizing the SIP.
  • the calling/called sequence of the IP telephone in the ordinary condition is indicated as shown in Fig. 6.
  • the calling/called sequence of the IP telephone in case of the no-response because of absence of the partner is executed as shown in Fig. 13.
  • the sequence in Fig. 13 corresponds to that in Fig. 7 in the first embodiment.
  • a different point- as compared with the sequence in Fig. 7 is that the voice message generation executed in the step S711 shown in Fig. 3 in a case where the partner does not respond is replaced by the video message generation executed in a step S718.
  • the other sequences are the same as those in .
  • Fig. 14 which corresponds to Fig. 8 in the first embodiment, indicates a state of a communication control executed by the terminal device (the above-mentioned terminal A) shown in Fig. 10 in order to execute the sequence in case of the ordinary calling/called operation shown in Fig. 6 and the sequence in case of absence of the partner shown in Fig. 13.
  • Fig. 14 shows a flow from a start of the dial transmission until the end of the call, and a procedure shown in Fig. 14 is ' stored into, for example, the ROM 102 or the like as a control program of the CPU 101 shown in Fig. 1.
  • the step numbers corresponding to the level of No. 800 used in Fig. 8 are respectively replaced by those corresponding to the level of No. 1800.
  • the video message is transmitted by an E-mail in steps S1805 to S1809 instead of the voice message.
  • the calling executed in steps S1801 to S1803 and the calling executed in a step S1804 are controlled similar to the control in Fig. 8.
  • the generation of the video message executed in the steps S1805 to S1809 shown in Fig. 14 and a transmission by the E-mail will be explained.
  • Advancing to a video (absence) message generation UI in the step S1805 is executed in a case where judgment in the step S1803 is in the "NO" state due to the no-response because of absence in the partner terminal.
  • a calling party executes an operation for generating the video (absence) message by using the display unit 106, the operation unit 108 and the CCD 115 of the terminal device.
  • An example of the video (absence) message generation UI (mainly, a screen display) will be described later.
  • step S1806 it is judged whether or not the recording of the video (absence) message is •stopped by checking the state of an operation of the user at the operation unit 108 (refer to User Interface described later) , and when the recording of the video (absence) message is stopped, a flow advances to a step S1810 and the calling is terminated. '
  • the message generation is continued, the message is recorded and encoded in the step S1807.
  • An image input is executed by the CCD 115 shown in Figs. 10 and 12, and a voice input is executed by the telephone receiver of the call unit 114 shown in Fig. 10 by inputting the voice of an operator.
  • the image and the voice which were input are encoded into an animation format of MPEG4 by an MPEG4 CODEC 116.
  • the encoded data is once stored into the DRAM
  • step S1808 A process of formatting the E-mail is executed according to the regulation of the MIME format as mentioned before, and the video data is attached to the E-mail text as an attachment file.
  • step S1809 the data formatted into the E-mail text is transmitted to the mail server 502 using the SMTP.
  • Fig. 15 which corresponds to Fig.
  • Fig. 9 in the first embodiment shows an example of a User Interface executed by using the display unit 106, the operation unit 108 and the CCD 115 in the generation of the video (absence) message (step S1805).
  • Fig. 15 shows a display screen from a case where the partner terminal does not respond until the termination of transmitting the voice message extracted out of the above operation sequence.
  • a character row display such as "No responap to calling" is displayed on a central portion of the screen in order to indicate that the partner terminal does not respond as in a screen 1901 shown in Fig.
  • a partner abbreviated name, a partner telephone number and a partner mail address are displayed on a lower portion of the character row display.
  • Information related to the partner terminal can be obtained from ENUM information regulated in the RFC 2916 through the SIP/Proxy server 501, and the terminal being a user agent can obtain from the server in the calling control of SIP. Similar to the case in Fig. 9, information to be displayed on the screen 1901 is not limited to the above-mentioned information but, for example, other arbitrary information related to the partner terminal can be displayed.
  • a button 1901a used for instructing the stop of the current calling (or automatically activated recalling may be included) is displayed.
  • the same constitution as that described in the first embodiment can be used.
  • the display screen is changed to a screen 1902 in accordance with the elapse of a predetermined time (or a predetermined operation in the operation unit 108), and a prepare screen for starting the recording of the video message is displayed for several seconds (the screen 1902 in Fig. 15 indicates a state that 3 seconds up to the start of the recording of video) , then after giving a prepare period of the recording to the user, the display screen is further changed to a screen 1903, where the recording of the video message is started.
  • a button 1902a which is similar to the button 1901a, for stopping an entire calling process and a button 1902b for stopping the recording of video are arranged.
  • a timing of recording the video message is informed to the user by displaying a character row of "video message is now recording” or generating the appropriate information sound or the like, thereafter an animation video of a face or the upper half of body of the user is shot by using the CCD 115 and also the voice is input by using the telephone receiver of the call unit 114.
  • a button 1903a for stopping a calling process On a lower portion of the screen 1903, a button 1903a for stopping a calling process, a button 1903b for stopping the video recording and a button 1903c for instructing a timing of terminating the recording are arranged.
  • the display screen is changed to a screen 1904 where it is displayed that the recorded video (absence) message is transmitted to the partner terminal as an E-mail by the above-mentioned manner.
  • a button 1904a for stopping the transmission of the corresponded E- mail is arranged on a lower portion of the screen 1904.
  • the video (absence) message is recorded by using the user interface as shown in Fig. 15, and the message can be transmitted by the E-mail. Accordingly, the communication with the animation video can be executed with the operation feeling equivalent to or finer than that of the automatic answering telephone based on the conventional analog line . Also, in the present embodiment, in a system of the IP telephone terminal capable of executing the communication with the animation video by equipping the CCD or the like, when the partner terminal does not respond, it become possible to execute the message transmission for realizing the suitable operability without losing the operation feeling of the conventional automatic answering telephone based on the analog line.
  • the voice and animation messages can be transmitted to the partner terminal with a sate without lacking data. Therefore, even in a case where a mobile communication system is used for the connection with a network, the extremely favorable constitution can be provided as a telephony application which can transmit a message recorded in the absence to the partner terminal without deteriorating quality of the voice and the video.
  • the data size of the animation. is larger than that of the voice only, especially in case of the animation, the present constitution is .more effective as compared with a case of the voice only.
  • the partner terminal in a case where the partner terminal does not respond, according to the constitution of transmitting the voice message or the video message as the business message by the E-mail, the high quality business message can be transmitted to the partner terminal, and the excellent operability equivalent to or finer than that of the conventional automatic answering telephone can be obtained at the terminal device of the calling side.
  • the business message to be transmitted to the absent partner terminal which does not respond may be an arbitrary multimedia message.
  • the animation data including the voice data may be transmitted by the E-mail, or arbitrary musical composition data (MIDI data or digitized music data) may be included in the voice data.
  • MIDI data arbitrary musical composition data
  • the present invention is applicable to a system composed of plural equipments or to a device including single equipment.
  • the present invention can be constituted as a product such as an MFP (Multi Function Printer) including a telephone device, an image communication function, an image input/output function or the like, or a mobile communication terminal (mobile phone or the like) .
  • MFP Multi Function Printer
  • the present invention is accomplished also in a case where the program codes for realizing the functions of the above-mentioned embodiments are directly or remotely supplied to a system or a device and then the system or the device reads the supplied program code and executes the program codes. Therefore, the program codes themselves which are installed into a computer so as to realize the functions processes of the present invention are also included in the technical field of the present invention. In this case, any program such as an object code, a program executed by the interpreter, script data to be supplied to an OS (Operating System) or the like is available if having the function of the program irrespective of a form of the program.
  • OS Operating System
  • a recording medium for supplying the program codes it can be, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magnetooptical disk, an MO, a CD-ROM, a CR-R, a CD-RW, a magnetic tape, a non-volatile memory card, a ROM, a DVD (DVD-ROM, DVD-R) or the like.
  • the programs can be also supplied by downloading a computer program itself of the present invention or a compressed file including an automatic installation function to the recording medium such as a hard disk or the like from a homepage by connecting with the homepage on the Internet by using the browser of a client computer.
  • a WWW server for downloading the program files used for realizing the functions processes of the present invention by a computer to plural users is also included in Claims of the present invention.
  • the programs of the present invention are stored into a storage medium such as a CD-ROM or the like after encoding the programs and then the storage medium is distributed to a user, and key information for solving the encoded program is downloaded from a . homepage through the Internet for the user who clears a predetermined condition, thereafter the ' encoded program is executed by using the key information to be installed in a computer.
  • the computer executes the readout program, thereby realizing the functions of the above-mentioned embodiments, and the OS functioning on the computer executes all the actual process or a part thereof on the basis of an instruction of the program, thereby also realizing the functions of the above-mentioned embodiments by such the process.
  • the program which was read from the recording medium is once written in a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer, then a CPU or the like provided in the function expansion board or the function expansion unit executes all the actual process or a part thereof on the basis of the instructions of such the program, thereby realizing the functions of the above-mentioned embodiments by such the process.

Landscapes

  • Engineering & Computer Science (AREA)
  • Signal Processing (AREA)
  • Computer Networks & Wireless Communication (AREA)
  • Business, Economics & Management (AREA)
  • General Business, Economics & Management (AREA)
  • Human Computer Interaction (AREA)
  • Telephonic Communication Services (AREA)
  • Data Exchanges In Wide-Area Networks (AREA)
  • Information Transfer Between Computers (AREA)
  • Two-Way Televisions, Distribution Of Moving Picture Or The Like (AREA)

Abstract

The present invention provides, in a telephone system, the device which enables to transmit and receive a business message of a high-quality voice or video with an excellent operation feeling in a case where a called side does not respond. To accomplish this, the partner terminal is called by the communication unit based on a telephone protocol (S702), and, when it is discriminated based on the telephone protocol that the called partner terminal does not respond (S709), the voice (or audio) data of the user is accumulated as the business message by using the receiver or the like of the user calling unit (S718). Then, the data indicating the business message is transmitted to the mail address of the partner terminal acquired through the telephone protocol (S714).

Description

DESCRIPTION
TERMINAL DEVICE, AND CONTROL METHOD OF TERMINAL DEVICE
TECHNICAL FIELD The present invention relates to a terminal device which calls a partner terminal based on a protocol for an IP (Internet Protocol) telephone and executes at least voice communication to the called partner terminal, and a control method which is adapted to control the relevant terminal device.
BACKGROUND ART In recent years, the Internet is rapidly widespread on a global mass scale. Thus, in view of the advantage of the Internet that communication charges can be remarkably decreased, an IP telephone is paid to attention. Here, the standard which is particularly important currently in the IP telephone is SIP (Session Initiation Protocol) which is indicated by ITU-T (International Telecommunication Union - Telecommunication) recommendation H.323 (http: //www. itu. int/) . For this reason, various types of devices corresponding to the IP telephone according to the above standard are proposed. Besides, an image communication technique as in television conference or the like is conventionally diverted to a sizable percentage of the IP telephone, whereby a video call (so called a television telephone) including transmission/reception of moving images can of course be executed by the IP telephone. Here, one of the important things in the IP telephone technique is to achieve the various functions same as those in conventional PSTN (Public Switched Telephone Networks) , and, at that time, to achieve more satisfactory services by making the best use of the Internet. Incidentally, the technique achieved by the conventional PSTN terminal includes telephone message recording (by an answering machine) , transmission/reception of a voice message, and the like. In this connection, for example, the conventional PSTN terminal on a reception side often records in a message recording means a voice message sent from the terminal on a calling side. Meanwhile, in the IP telephone, the following techniques are proposed. For example, in Japanese Patent Application Laid-Open No. 2001-309040, in a case where the IP telephone terminal calls an analog public telephone terminal, if no response is sent from the public telephone terminal due to, e.g., absence of its user, a gateway saves the voice mail data to be transmitted from the IP telephone terminal. Then, after elapsing a certain period of time, the IP telephone terminal again calls the relevant public telephone terminal by automatic dialing, and, when a response is sent therefrom, the IP telephone terminal reads the saved voice mail data and transmits it thereto. Besides, the SIP of which the standardization is advanced by IETF (Internet Engineering Task Force) is known as the standard technique which is suitable for multimedia communication and has a high affinity to the Internet technique. In the current IP telephone system, the SIP is used to identify a partner station in case of data transmission. Here, in the SIP, as indicated by IETF - RFC3261, RFC3262, RFC3263, RFC3264, RFC3265 and RFC3515 (http: //www. ietf.org/) , if there is no response from the partner terminal when the IP telephone terminal calls up the partner IP telephone terminal, it is known that a media session is established • based on the SIP of the IP telephone between the voice mail server and the calling terminal, and then a voice message is sent to the voice mail server. Moreover, in a moving image communication technique, particularly in a television conference technique, the technique for easily providing information to a person who does not take part in the conference as well as the technique for easing temporal and locational restrictions is known. For example, the mail processing unit of a television conference device creates a video mail from voice and video signals, and, in response to the indication by a user, the mail processing unit restores the voice and video signals from the relevant mail and outputs these signals respectively to a voice output device and a video output device. Moreover, in Japanese Patent Application Laid-Open No. 2000-115738, it is proposed that absence of a user is first registered, a transfer destination information processing unit of the mail processor creates a transfer information table and registers the transfer destination of the absence-registered user, and a message transformation processing unit transforms the file received from a message restoration processing unit or a telephone/facsimile processing unit to the type of file notified from the transfer destination information processing unit. By doing so, the message capable of being received at the transfer destination is created and then transferred thereto.- Incidentally, in the conventional constitution as disclosed in Japanese Patent Application Laid-Open No. 2001-309040, since the called-side terminal is the analog public telephone terminal, there is a high possibility that the terminal itself is locationally fixed. For this reason, a restriction occurs with respect to the location where it can receive the voice message. Moreover, since timing for receiving the voice message at the called-side terminal depends on management by the gateway, there is a possibility that the voice message cannot be received during a period that called operation is refused due to call (telephone call) or the like on the called side. In addition, various voice message transmission methods are proposed by the SIP protocols (IETF - RFC3261, RFC3262, RFC3263, RFC3264, RFC3265, RFC3515) . In.such circumstances, even in a case where line or call quality is not in a satisfactory condition due to a problem of distance, a problem of number of stages in a router, a problem of traffic, a problem of packet loss and the like in the network connection pattern to be used by the IP telephone terminal, the standard voice message transmission dares to establish the media session between the terminal and the voice message server to transmit in real time the voice of the calling side to the voice message server, and saves the transmitted voice on the voice message server. For this reason, there is a possibility that it is impossible to generate a high-quality voice message. Here, it should be noted that such a problem affects the called side which receives the voice message. That is, there is a possibility that the called-side terminal listens the low-quality voice message transmitted from the server in the state of lower line quality. Thus, there is fear that the voice quality in the voice message service is seriously lowered. Moreover, when the called-side terminal receives the voice message, the SIP protocol is used. Thus, there is an inconvenience that the voice message cannot be reproduced in, for example, a mobile terminal or a personal computer which does not correspond to the SIP protocol or does not have an account for IP telephone services. Besides, the conventional constitution as disclosed in Japanese Patent Application Laid-Open No. 2000-115738 concerning the moving image communication is premised on a television conference system, whereby it is possible to transmit voice and video files to a remote location. In this connection, even in a case where the above conventional constitution is interpreted enlargedly. as a telephone terminal, if a called partner is absent, the procedure to transfer these files to the partner, is executed humanly. Thus, the above conventional constitution is not optimized as the constitution for increasing convenience of a terminal device.
DISCLOSURE OF THE INVENTION Accordingly, an object of the present invention is to provide-, in a telephone system of executing transmission/reception of voice data or video data, a terminal device and a control method for the terminal device which can transmit/receive a business mail produced by high quality voice and/or video data without losing the operation feeling of a conventional automatic answering telephone and requiring the use of an expensive terminal, in a case where a called side does not respond due to such a situation as absence or the like. According to the present invention, the foregoing object is attained by providing a terminal device which executes at least voice communication to a partner terminal, comprising: a telephone calling unit adapted to execute a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation unit adapted to, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulate in the terminal device a business message of a user; and a mail transmission unit adapted to transmit data indicating the business message to a mail address of the partner terminal by using an electronic mail protocol. Other features and advantages of the present invention will be apparent from the following description taken in conjunction with the accompanying drawings, in which like reference characters designate the same or similar parts throughout the figures there.
BRIEF DESCRIPTION OF THE DRAWINGS Fig. 1 is a block diagram showing the hardware constitution of a terminal device adopting the present invention (first embodiment) ; Fig. 2 is a block diagram showing the constitution of a display unit of the device in Fig-. 1; Fig. 3 is a block diagram showing the constitution of a DRAM (Dynamic Random Access Memory) composing a storage unit in Fig. 1; Fig. 4 is an external view showing the constitution of an operation unit of the device in Fig. 1; Fig. 5 is an outline view showing the form wherein the terminal device adopting the present invention is connected to the Internet; Fig. 6 is a sequence view showing a standard calling control sequence of SIP in case of executing a call; Fig. 7 is a sequence view showing the control sequence executed by the terminal device adopting the present invention and each of equipments on the network; Fig. 8 is a flowchart showing a control procedure of a calling side terminal (terminal A) according to the present invention; Fig. 9 is an explanation view showing an example of a UI (user interface) display screen of the calling side terminal (terminal A) according to the present invention; Fig. 10 is a block diagram showing another hardware constitution of a terminal device adopting the present invention (second embodiment) ; Fig. 11 is a block diagram showing the constitution of a DRAM composing a storage unit in Fig. 10; Fig. 12 is an external view showing the constitution of an operation unit of the device in Fig. 10; Fig. 13 is a sequence view showing the control sequence executed by the terminal device adopting the present invention and each of equipments on the network; Fig. 14 is a flowchart showing a control procedure of a calling side terminal (terminal A) according to the present invention; and Fig. 15 is an explanation view showing an example of a UI display screen of the calling side terminal (terminal A) according to the present invention. BEST MODE FOR CARRYING OUT THE INVENTION The preferred embodiments of the present invention will now be described in detail with reference to the drawings. Here, it should be noted that the relative arrangement of the components, the numerical . expressions and numerical values set forth in these embodiments do not limit the scope of the present invention unless it is specifically stated otherwise . (First Embodiment) In the present embodiment, a constitutional example of a terminal device, which transmits a voice message as a business message by an E-mail in a case where a partner terminal does not respond although a calling according to a VoIP (Voice over Internet Protocol) has been, executed, is shown. Fig. 1 shows the constitution of the terminal device coping .with an IP (Internet Protocol) telephone adopting the present invention. The shown terminal device can be constituted as a product such as an MFP (Multi Function Printer) which includes a telephone device or the image transmission and input/output functions, or as a mobile communication terminal (mobile phone) or the like. In Fig. 1, numeral 101 denotes a central ' processing unit (CPU) which controls the entire device. Numeral 102 denotes a ROM (Read Only Memory) which stores programs and data. Numeral 103 denotes a storage unit (DRAM; Dynamic Random Access Memory) which stores CPU work data, a codec (compression/decompression) work area, mail data, HTML (Hyper Text Markup Language) data, display data, printing data and other data. Numeral 104 denotes a non-volatile RAM (SRAM; Static Random Access Memory) which stores private data, telephone directory data and backup data for preserving various device constants. Numeral 105 denotes a sensor group which includes a sensor for detecting the condition of a receiver as a telephone device, a sensor for detecting the size of recording sheets, a sensor for detecting width of an original to be read, a sensor for detecting presence/absence of the original and other sensors . Numeral 106 denotes a display unit which realizes a UI (User Interface) of a telephone terminal together with an operation unit 108 composed of various keys and displays received contents data, the condition of the device or the like in color. The constitutional examples of the display unit 106 and the operation unit 108 will be described in detail in Fig. 4. Numeral 107 denotes a codec (hereinafter, to be described as CODEC) which can execute at least the encoding/decoding of voice data in the present embodiment. The CODEC 107 may be constituted that it can further execute the encoding/decoding of color or monochrome image data (a stil image and an animation as in the embodiment to be .described later) . The terminal device in the present embodiment has an image communication function and has blocks used for inputting and outputting image data, denoted by numerals 109 and 111. The block 109 is a reading unit composed of a reading element such as a CCD (Charge Coupled Device) or a CIS (Contact Image Sensor) used for scanning a color or monochrome image and a mechanism such as an original convey unit or the like. The block 111, which is a printing unit having a printer function for printing the received image or text data, is constituted based on an arbitrary printing system such as an electrophotographic system or an inkjet system. It should be noted that the above image communication function is not always required in the present embodiment and can be omitted in a case where the terminal device is constituted as the mobile communication terminal (mobile phone) . Numeral 112 denotes a communication unit for communicating with external units connecting with a line 113. In the present embodiment, at least the connection with an interned and an IP communication through the network connection of the Internet can be executed by the communication unit 112. Further, it may be constituted -that a call and an image communication via a PSTN (Public Switched Telephone Network) can be executed through the communication unit 112. If the above-mentioned communication can ■be executed, the detailed constitution of the communication unit 112 is arbitrary. Connection with the Internet can be realized through the PSTN (including ISDN (Integrated Services Digital
Network") ) or through a broadband line such as an ADSL (Asymmetric Digital Subscriber Line) , a FTTH (Fiber To The Home) or the like. For the purpose of connecting with such the Internet, the communication unit 112 requires a MODEM (Modulator/Demodulator) or a router coping with various communication lines . Otherwise, such the MODEM or the router is substituted for the external one, and only a LAN (CSMA/CD; Carrier Sense Multiple Access with Collision Detection (for example, Ethernet (brand name) ) interface used for connecting with the network equipments may be provided in the terminal device. Internet communication and PSTN communication may be executed using the same communication line (for example, ISDN) , or different lines for the Internet communication and the PSTN communication may be respectively used. Of course, a connecting system with the line or the network may employ a mobile communication system utilizing a radio connection or the like. In this case, a line/network interface coping with the corresponded system is installed in the communication unit 112. Numeral 114 denotes a call unit, which includes devices such as a receiver, a speaker, a microphone and the like as a telephone device, is a block for realizing a voice MMI (Man Machine Interface) with a user. The above-explained blocks shown in Fig. 1 are mutually connected through a system bus 110. Fig. 2 shows the circuit constitution of the display unit 106. The display unit 106 includes a VRAM (Video RAM) 200 for storing display data and an LCD (Liquid Crystal Display) driver 201 for outputting the contents of the VRAM 200 to a dot matrix LCD 202. Fig. 3 shows a memory map which indicates the internal constitution of the DRAM 103 composing the storage unit. The DRAM 103 is constituted by a CPU work area 1031 used as a work area of the CPU 101, a CODEC work area 1032 used as a work area in case of executing the encoding/decoding, a mail data storage area 1033 for storing mail data, an HTML data storage area 1034 for storing the received HTML data, a display data storage area 1035 for storing display data, a printing' data storage area 1036 for storing print data and an other data storage area 1037 for storing other data or used as a work area for an operation. Fig. 4 shows the external constitution of the display unit 106 and the operation unit 108 in Fig. 1 Numeral 202 denotes an LCD which constitutes the display unit 106. The operation unit 108 includes ten keys 402 used for inputting a telephone number and the like, a menu key 403 used for setting the function, four function keys 404 used for inputting various information, a set key 405 being a setting input key and a right and left/up and down directions key 406 used for moving a cursor on the display unit 106 (LCD 202) . Fig. 5 conceptually shows the network constitution in a case where the terminal device in Fig. 1 executes a communication through a network including the Internet. In Fig. 5, a terminal (A) 503 and a terminal (B) 504 are connected to the Internet 500 by an IP connection. Between the two terminals, at least the calling side terminal (A) 503 is- assumed to be composed of the terminal device shown in Fig. 1, and the above-mentioned communication unit 112 is used for the IP connection. An SIP/proxy server 501, which is connected with the Internet, provides an SIP service. The SIP/proxy server 501 controls an SIP being a signal protocol used for executing a calling control in real time on the Internet. As mentioned above, the SIP is characterized in that it is excellent in protocol extendability and affinity with another Internet service. Especially, as the telephone service, the SIP/proxy server 501 executes a control of SIP signaling standardized in RFC3261 (Request For Comments 3261), the registration/certification of a user, a user management and the like. A mail server 502, which is connected to the Internet 500 by the IP connection, has the function of SMTP (Simple Mail Transfer Protocol) /POP3 (Post Office Protocol 3) standardized in the RFC 821 and has the constitution of a server for managing mails. Generally, the mail server 502 is provided by an Internet service provider or a company managing the network. Further, an ENUM (Enumeration) DNS (Domain Name System) server 505 is also connected with the Internet 500 by the IP connection, and "registrar" associated with telephone numbers of end users and address information in a different communication and the like are included. For example, in case of generating a call, an IP address or a mail address of a partner terminal can be obtained (resolved) from the telephone number by accessing to the ENUM DNS server 505 on the basis of a predetermined protocol. It should be noted that the ENUM service and the DNS service are not always provided by a single server (505) as in- an example shown in Fig. 5. Both of the terminals A and B (503 and 504) shown in Fig. 5, which have accounts of the IP telephone service on the Internet 500, can connect to the SIP/proxy server 501 connected with the Internet and can function as a user agent of an end point of the IP telephone service. Further, in the present embodiment, both of the terminals A and B have accounts of the mail service on the Internet, and it is assumed that the terminals can utilize the mail transmission/reception service by connecting to the mail server 502 by the SMTP/POP3 Fig. 6 shows a sequence of the session of the general SIP used in calling/called operations by an IP telephone. In Fig. 6, the communication state in a case where the terminal A calls the terminal B is indicated. The details of an SIP message in Fig. 6 (or Fig. 7 described later) are described in the each RFC relevant to the aforementioned SIP. Initially, the terminal A being an end point of the IP telephone service transmits an INVITE message to the SIP/Proxy server (step S601) . When the SIP/Proxy server 501 receives the INVITE, a calling destination address to be called by the terminal A is specified from data included in the INVITE message, and the INVITE is transmitted to the terminal B being an end point (step S602). Next, the SIP/Proxy server 501 transmits the lOOTrying to the terminal A (step S603: Here, "100" denotes a discrimination or result code indicating a Trying message. Hereinafter, another message is denoted by the same description method) . Then, when the 180Ringing message is returned to the SIP/Proxy server 501 from the terminal B as a response (step S604), the message as the 180Ringing is transmitted to the terminal A (step S605) . At this time, the terminal A is in a state of calling the terminal B, and a ring back tone in calling is sent to the partner terminal from the call unit 114 at the terminal A in a state of the general terminal mode or control condition, and the terminal B is in a receiving state of ringing a call sound of the telephone. Next, when the terminal B responds to the reception, the terminal B sends the 200OK (step S606) , and the 200OK is transmitted to the terminal A being an end point at the calling side through the SIP/Proxy server 501 (step S607) . When the terminal A transmits the ACK (Acknowledgement) message as a response to the transmission of the 200OK (step S608), the ACK is transmitted to the terminal B being an end point at the called side through the SIP/Proxy server 501 (step S609) . Subsequent to the above sequence, a media session is started (step S610) to become a call state betw,een the end points. In the media session, a UDP (User Datagram Protocol) of not executing a . flow control and the ACK (transmission acknowledgement) is used in a lower-layer. In an upper-layer, an encoded voice data communication is executed by using, for example, an RTP (Real-time Transport Protocol) /RTCP (Real-time Transport Control Protocol) . Regulated methods G.711, G.726, G.729 and the like are prepared for the encoding/decoding of voice data, and an appropriate encoding/decoding method is selected according to a using band. In a case where the call is terminated, as a sequence of terminating the media session of the call, the BYE/OK message is transmitted to the SIP/Proxy server 501 from the terminal A, and the same message is transmitted to the terminal B. Accordingly, the call between the terminal A and the terminal B is terminated (steps S611 to S614) . Fig. 7 shows a sequence in a case where the terminal B does not respond to the calling from the terminal A due to such the situation as absence or the like, in the present embodiment. The calling sequence in steps S701 to S706 shown in Fig. 7 is similar to that in the steps S601 to S605 shown in Fig. 6, and, initially, an INVITE message is transmitted to the SIP/Proxy server 501 from the terminal A (step S701) . The SIP/Proxy server 501 receives the INVITE and further transmits the INVITE to the terminal B (step S702) . Next, the SIP/Proxy server 501 transmits the lOOTrying message to the terminal A (step S703) . The terminal B receives the INVITE and transmits the lOOTrying (step S704) and the 180Ringing subsequently to the SIP/Proxy server 501 (step 705) . Next, the SIP/Proxy server 501 transmits the 180Ringing to the terminal A. At this time, the terminal A is in a state of calling the terminal B. In Fig. 7, the terminal B does not respond to the calling from the terminal A due to such the situation as absence or the like. At this time, the terminal B executes a call by informing means such as a called sound or the like in order to call a user. However, in a case where the user at the terminal B side does not respond to the telephone call, the terminal B itself judges a fact that the user does not respond by the timeout. With respect to another means, as another method of judging the absence at the terminal B side, if there is no response for the calling form the terminal A, the terminal B itself may make judgment even in a case where the terminal B is set in a telephone automatic answering mode. In any case, when the user at the terminal B side does not respond to the telephone call, the terminal B transmits the 302Moved Temporarily message to the terminal A through the SIP/Proxy server 501 (step SI 01 ) . In the present embodiment, the , transmission is executed by including a contact URI (Uniform Resource Identifiers) of a mail server (for example, a mail server 502 shown in Fig. 5) , by which the terminal B can receive mails, in a Contact header of this redirection response such as the 302Moved Temporarily. By referring to this Contact header, the terminal A can obtain an address, to which a voice message is transmitted later. Then, the SIP/Proxy server 501 transmits the ACK to the terminal B (step S708) and subsequently transmits the 302Moved Temporarily to the terminal A. (step S709) . The terminal A receives the 302Moved Temporarily and transmits the ACK to the SIP/Proxy server 501 (step S710) . Thereafter, the voice message is generated in the terminal A (step S711) . In the terminal A, when the 302Moved Temporarily is received from the terminal B being an end point of the calling destination through the SIP/Proxy server 501 (step S709) , it is judged that the calling destination does not respond to the dialing, and subsequently the voice message is generated (step S711) . Generation of the voice message is to be realized to execute by the same operation feeling as that of a method of recording a message to a telephone receiver by a calling party in a case where a partner telephone device responds to the absence by an automatic answering telephone in a telephone device of a conventional analog line. In case of recording the message, the voice of an operator is input by a telephone receiver included in the call unit 114 shown in Fig. 1 at the terminal A, and then the input voice data is encoded at the CODEC 107. In the voice encoding process, the CODEC work area 1032 in the DRAM 103 is used as an encoding work area. Then, the voice encoded data is once stored into the mail data storage area 1037 in the DRAM 103 as a voice file. In the present embodiment, an example of generating message data by treating a business message as the voice data is indicated. However, as another method, the voice of the calling party is recognized by a technology, of voice recognition and then the recognized voice data is transformed into character information, and the message data may be generated by treating the message of the calling party as a mail of the character information. Since the voice recognition is the known technology, a detailed description thereof will be omitted. Even in the above case, there is no difference in a flow, in which the voice message data is transformed into a format capable of transmitting the information as a mail in the generation of the voice' message shown in Fig. 7 (step S711) . As a merit in case of transmitting the voice message by transforming it into the character information, the message can be informed to the partner side as the character information even if the partner terminal does not have means of decoding voice data and reproducing the voice. In a case where the partner terminal has a function capable of listening the character information as voice information again by the voice data synthesis, an effect of reducing the data amount on an information transmission route and decreasing the traffic is kept by transmitting the business message to the reception side terminal from the - transmission side terminal with a form of the character information. Further, in the partner terminal at the transmission destination, such an effect capable of holding the voice message with the small memory size as compared with the size of the voice data can be kept. Next, when the generation of the voice message is terminated, as shown in Fig. 7, the terminal A is connected with a TCP No. 25 port (SMTP port) of the mail server 502 by a telenet (step S712) . When the connection with the mail server 502 is established, the Connect message is sent back from the mail server 502, and the connected. state with the telenet is kept. Next, a voice file of the voice message stored into the mail data storage area is transmitted to 'the mail server 502 (step S714). The voice file is encoded by a format regulated by the SMTP, for example, by a MIME (Multipurpose Internet Mail Extension) format and then attached to the inside of an E-mail text. As indicated by an explanation in Fig. 5, both of the terminals A and B have accounts of the-' mail service on the Internet and can transmit/receive mails by connecting with the mail server 502 in Fig. 5 by the SMTP/POP3. Also, with respect to an address of the partner destination to which the voice message is transmitted, a mail address associated with the partner telephone number can be obtained by accessing to the ENUM DNS server 505. The voice message generated as mail data is to be transmitted to the mail address obtained as mentioned above. In this case, even if a mail address of the terminal B is not previously registered in the terminal A, if a mail address of the terminal B is registered in the ENUM DNS server 505, the voice message can be transmitted to the mail address of the terminal.B.. With respect to the mail address of the terminal B, since a user of the terminal B can designate an arbitrary mail address, the voice message can be transmitted to a terminal designated by a mail address other than the mail address of the terminal B. As another method from a method of obtaining a mail address of the partner by accessing to the ENUM DNS server, the mail address of the partner is previously preserved in a memory of the own device associating with the telephone number, and a method of executing a transmission by treating the mail address as a transmission destination by obtaining the mail address in the own device from the telephone number in case of calling the telephone may be proper. In this case, as to a method of previously preserving the mail address of the partner in the memory of the own device associating with the telephone number, since it is equivalent to the constitution of the telephone directory registration of the conventional facsimile device, the mobile phone or the like, an explanation thereof will be omitted because of the known technology. When the transmission/reception of the E-Mail text to/from the mail address of the partner terminal resulted in success, the OK message is sent back from the mail server 502 (step S715) . In this case, since the voice data is to be transmitted by the service with the TCP/IP (Transmission Control
Protocol/Internet Protocol) base not depending on a media session of a UDP/IP (User Datagram Protocol/Internet Protocol) base, the voice data can be surely transmitted with the, same condition as that when the data is encoded without generating the lack and the deformation, therefore the voice quality can be secured. Next, the terminal A transmits the quite message (step S716) and the connection with the SMTP and the mail server- 502 is disconnected. When the response of the Connection closed message is received (step S717), the mail transmission is terminated. Fig. 8 shows a state of a communication control which is to be executed by the terminal device (the above-mentioned terminal A) shown in Fig. 1 so as to execute the general calling/called operation shown in Fig. 6 and a sequence in case of absence of the partner shown in Fig. 7. Fig. 8 shows a flow from a start of the dial transmission to the end of the call, and the procedure shown in Fig. 8 is stored into, for example, the ROM 102 or the like as a control program of the CPU 101 shown in Fig. 1. When the dial transmission is started in a step S801 shown in Fig. 8, a calling control' of the SIP is executed so as to establish the call connection of the IP telephone in a step S802. As to the calling control of the SIP, it is executed as indicated in Figs . 6 to 7. As shown in Fig. 7, in a case where the terminal A receives the 302Moved Temporarily (step S709) and it is judged that the partner terminal does not respond by the calling control of SIP, it is judged that the partner terminal is in a state of "NO" response in a step S803 to be advanced to an absence message generation UI (step S805) . As shown in Fig. 6, in a case where the terminal A receives the 200OK (step S607) and it is judged that the called side responds, a flow branches off in "YES" to advance to the in-call UI in a step S804. In this case, a media session is generated between the terminal A and the called side so as to be executed the call according to the VoIP. In a case where the judgment in the step S803 is in a state of "NO" and the flow advances to the absence message generation UI of the step S805, the following process is executed. In the absence message generation UI in the step S805, a calling party executes an operation to generate the voice message by using the display unit 106 and the operation unit 108 of the terminal device (terminal A) . An example of the absence message generation UI (mainly, a screen display) will be described later. In a step S806, it is judged whether or not the recording of the absence message is stopped by checking the state of an operation of the user at the operation unit 108 (refer to User Interface described later) , and when the recording of the absence message is stopped, the flow advances to a step S810 and the call is terminated. When the generation of the message is continued, the voice recording process and the encoding process are executed in a step S807. With respect to an input of the voice, the operator voice is input by the telephone receiver in the call unit 114 shown in Fig. 1, and the voice data is encoded by the CODEC 107. The voice encoded data is once stored into the DRAM 103 as a voice file and further transformed into an E-mail format capable of transmitting a mail, in a step S808. A process of formatting the E-mail is executed according to the regulation of the MIME format as mentioned before, and the voice data is attached to the E-mail text as an attachment file. In a step S809, the data formatted into the E-mail text is transmitted to the mail server 502 using the SMTP. When the transmission of the E-mail text is terminated, an operation sequence from the start of the dial transmission is terminated. Fig. 9 shows an example of the user interface executed by using the display unit 106 and the operation unit 108 in the generation of the absence message to be executed in the step S805 shown in Fig. 8. Fig. 9- shows a display screen from a case where the partner terminal does not respond until the termination of transmitting the voice message extracted out of the operation sequence in Fig. 8. In the calling control of SIP, as an initial screen in a case where the partner terminal does not respond, a character row display such as "No response to calling" is displayed on a central portion of the screen in order to indicate that the partner terminal does not respond as in a■> screen 901 shown in Fig. 9. In this screen 901, a partner abbreviated name, a partner telephone number and a partner mail address are displayed on a lower portion of the character row display. Information related to the partner terminal can be obtained from ENUM information regulated in the RFC 2916 through the SIP/Proxy server 501, and the terminal being a user agent can obtain from the server in the calling control of SIP. It should be noted that information to be displayed on the screen 901 is not limited to the above-mentioned information but, for example, other arbitrary information related to the partner terminal can be displayed. On a lower portion of the screen 901, a button 901a used for instructing the stop of the current calling (or an automatically. activated re-calling may be included) is displayed. The button 901a is selected by the right and left/up and down directions key 406 or the like, and an input operation (or, if the display unit 106 is a screen of touch panel system, a direct input is executed, or the input operation is executed by a pointing device such as a mouse) is executed by such a method of defining an input by the set key 405 (other buttons described later are similarly operated) . Subsequent to the screen 901, the display screen is changed to a screen 902 in accordance with the elapse of a predetermined time (or a predetermined operation in the operation unit 108), and the user is made to start the recording of the voice message using this screen. In this screen, a character row display such as "voice message recording starts subsequently" and "record message after beep" are displayed on a central portion of the screen, and a timing of recording the voice message is informed to the user. On a lower portion of the screen 902, buttons 902a, 902b and 902c are arranged. The button 902a is a dial stop button similar to the button 901a, the button 902b is a record stop button and the button 902c is used for instructing a timing of the record end. When the recording of voice is ended (time measurement for a predetermined recording time is ended or instructed by an operation of the button
902c) , the display screen is changed to a screen 903 where it is displayed that the recorded voice message is transmitted to the partner terminal as an E-mail by the above-mentioned manner. On a lower portion of the screen 903, a button 903a for stopping the transmission of the corresponded E-mail is arranged. As mentioned above, in a case where the calling partner does not respond, the voice message is recorded by using the user interface as shown in Fig. 9, and the message can be transmitted by the E-mail. Accordingly, the UI being one form of an automatic answering telephone of the IP telephone can be suitably' realized with the operation feeling equivalent to or finer than that of the automatic answering telephone based on the conventional analog line . As mentioned above, according to the present embodiment, in a case where the partner terminal does not respond in the IP telephone system, it becomes possible to realize the suitable operability without losing the operation feeling of the automatic answering telephone based on the conventional analog line. Further, even in the terminal set in a state of the low QoS (Quality of Service) of the IP telephone system, since such the constitution wherein the voice message is once encoded and is transmitted by a mail format is adopted, the voice message can be transmitted to the partner terminal with a sate without lacking data. Therefore, even in a case where a mobile communication system is used for the connection with a network, the extremely favorable > constitution can be provided as a telephony application which can transmit a message recorded in the absence to the partner terminal without deteriorating quality of the voice. (Second Embodiment) In the above embodiment 1, a voice message is to tje transmitted by an E-mail as a business mail in a case where a partner terminal does not respond even if a calling according to a VoIP (Voice over Internet Protocol) is executed. However, in the present embodiment, an example of transmitting a video message by the E-Mail as the business mail will be indicated. In the present embodiment, the drawings are the are same as those in the- first embodiment. In this connection, the constituent components which are the same as or correspond to those in the first embodiment are respectively denoted by the same (or similar) numerals and symbols, and the detailed description thereof will be omitted. In the present embodiment, when the drawing which corresponds to that in the first embodiment does not exist, the constitution shown in the drawing corresponding to that in the first embodiment can be utilized within a scope of not contradicting the constitution of the present embodiment. Fig. 10, which corresponds to Fig. 1 in the first embodiment, shows the constitution of a terminal device adopting the present invention. In Fig. 10, different points as compared- with the constitution in Fig. 1 are that a CCD (Charge Coupled Device) 115 is added for the purpose of shooting an animation (or a still image) and the CODEC 107 shown in Fig. 1 is replaced by an MPEG4 (Moving Picture coding Experts Group 4) CODEC 116 for executing the encoding/decoding of the animation. The CCD 115 is arranged so that an animation video of a user can be shot as described later for the purpose of using the terminal device as a TV telephone especially. With respect to other blocks, the constitution is the same as that in an explanation related to Fig. 1 in the first embodiment. The constitution of a peripheral control system of the display unit 106 is the same as that shown in Fig. 2. Fig. 11, which corresponds to Fig. 3 in the first embodiment, is a memory map indicating the internal constitution of the DRAM 103, and a different point as compared with the constitution in Fig. 3 is that the CODEC work area 1032 in Fig. 3 is replaced by a CODEC work area 1038 of the MPEG4 to be used as a work area in case of executing the encoding/decoding of the MPEG 4. The rest constitution is the same as that in Fig. 3. Fig. 12, which corresponds to Fig. 4 in the first embodiment, shows the external constitution of the display unit 106 and the operation unit 108. A different point as compared with ' the constitution in Fig. 4 is that the CCD 115 shown in Fig. 1 is provided on an upper portion of an LCD 202. The CCD 115 is disposed so that a shooting lens can be turned toward a user in order that a face or the upper half of body .of the user can be shot (the rotationally supported constitution is available so as to become possible the tilt or the pan) . In the present embodiment, the terminal device shown in Fig. 10 can be used in the network constitution where the SIP/Proxy server 501, the mail server 502 and the ENUM DNS server 505 are arranged as shown in Fig. 5 similar to the first embodiment. Also in the present embodiment, at least the calling side terminal (A) 503 is assumed to be composed of the terminal device shown in Fig. 10, and the aforementioned communication unit 112 is used for the IP connection. Also in the present embodiment, the calling/called operation of the IP telephone is • controlled by utilizing the SIP. The calling/called sequence of the IP telephone in the ordinary condition is indicated as shown in Fig. 6. However, the calling/called sequence of the IP telephone in case of the no-response because of absence of the partner is executed as shown in Fig. 13. The sequence in Fig. 13 corresponds to that in Fig. 7 in the first embodiment.' A different point- as compared with the sequence in Fig. 7 is that the voice message generation executed in the step S711 shown in Fig. 3 in a case where the partner does not respond is replaced by the video message generation executed in a step S718. The other sequences are the same as those in. Fig. 7 indicated by the same symbols Fig. 14, which corresponds to Fig. 8 in the first embodiment, indicates a state of a communication control executed by the terminal device (the above-mentioned terminal A) shown in Fig. 10 in order to execute the sequence in case of the ordinary calling/called operation shown in Fig. 6 and the sequence in case of absence of the partner shown in Fig. 13. Fig. 14 shows a flow from a start of the dial transmission until the end of the call, and a procedure shown in Fig. 14 is' stored into, for example, the ROM 102 or the like as a control program of the CPU 101 shown in Fig. 1. In Fig. 14, the step numbers corresponding to the level of No. 800 used in Fig. 8 are respectively replaced by those corresponding to the level of No. 1800. As apparent from the comparison with Fig. 8, a different point is that the video message is transmitted by an E-mail in steps S1805 to S1809 instead of the voice message. The calling executed in steps S1801 to S1803 and the calling executed in a step S1804 (however, not only the voice calling but also so-called the TV telephone call, which is executed while exchanging an image of a user shot by the CCD 115, may be executed in this call) are controlled similar to the control in Fig. 8. Hereinafter, the generation of the video message executed in the steps S1805 to S1809 shown in Fig. 14 and a transmission by the E-mail will be explained. Advancing to a video (absence) message generation UI in the step S1805 is executed in a case where judgment in the step S1803 is in the "NO" state due to the no-response because of absence in the partner terminal. In the video message generation UI in the step S1805, a calling party executes an operation for generating the video (absence) message by using the display unit 106, the operation unit 108 and the CCD 115 of the terminal device. An example of the video (absence) message generation UI (mainly, a screen display) will be described later. In the step S1806, it is judged whether or not the recording of the video (absence) message is •stopped by checking the state of an operation of the user at the operation unit 108 (refer to User Interface described later) , and when the recording of the video (absence) message is stopped, a flow advances to a step S1810 and the calling is terminated.' When the message generation is continued, the message is recorded and encoded in the step S1807. An image input is executed by the CCD 115 shown in Figs. 10 and 12, and a voice input is executed by the telephone receiver of the call unit 114 shown in Fig. 10 by inputting the voice of an operator. The image and the voice which were input are encoded into an animation format of MPEG4 by an MPEG4 CODEC 116. The encoded data is once stored into the DRAM
103 as a video data file and further transformed into an E-mail format, which can be transmitted by the E- mail, in a step S1808. A process of formatting the E-mail is executed according to the regulation of the MIME format as mentioned before, and the video data is attached to the E-mail text as an attachment file. In the step S1809, the data formatted into the E-mail text is transmitted to the mail server 502 using the SMTP. When the transmission of the E-mail text is terminated, an operation sequence from the start of the dial transmission is terminated. Fig. 15, which corresponds to Fig. 9 in the first embodiment, shows an example of a User Interface executed by using the display unit 106, the operation unit 108 and the CCD 115 in the generation of the video (absence) message (step S1805). Fig. 15 shows a display screen from a case where the partner terminal does not respond until the termination of transmitting the voice message extracted out of the above operation sequence. In the calling control of SIP, as an initial screen in a case where the partner terminal does not respond, a character row display such as "No responap to calling" is displayed on a central portion of the screen in order to indicate that the partner terminal does not respond as in a screen 1901 shown in Fig. 15 In this screen 1901, a partner abbreviated name, a partner telephone number and a partner mail address are displayed on a lower portion of the character row display. Information related to the partner terminal can be obtained from ENUM information regulated in the RFC 2916 through the SIP/Proxy server 501, and the terminal being a user agent can obtain from the server in the calling control of SIP. Similar to the case in Fig. 9, information to be displayed on the screen 1901 is not limited to the above-mentioned information but, for example, other arbitrary information related to the partner terminal can be displayed. On a lower portion of the screen 1901, a button 1901a used for instructing the stop of the current calling (or automatically activated recalling may be included) is displayed. As to an operation method of the button 1901a or another button to be described later, the same constitution as that described in the first embodiment can be used. Subsequent to the screen 1901, the display screen is changed to a screen 1902 in accordance with the elapse of a predetermined time (or a predetermined operation in the operation unit 108), and a prepare screen for starting the recording of the video message is displayed for several seconds (the screen 1902 in Fig. 15 indicates a state that 3 seconds up to the start of the recording of video) , then after giving a prepare period of the recording to the user, the display screen is further changed to a screen 1903, where the recording of the video message is started. On a lower portion of the screen 1902, a button 1902a, which is similar to the button 1901a, for stopping an entire calling process and a button 1902b for stopping the recording of video are arranged. In the screen 1903, a timing of recording the video message is informed to the user by displaying a character row of "video message is now recording" or generating the appropriate information sound or the like, thereafter an animation video of a face or the upper half of body of the user is shot by using the CCD 115 and also the voice is input by using the telephone receiver of the call unit 114. On a lower portion of the screen 1903, a button 1903a for stopping a calling process, a button 1903b for stopping the video recording and a button 1903c for instructing a timing of terminating the recording are arranged. When the recording of the video message is ended (time measurement for a predetermined recording time is ended or instructed by an operation of the button 1903c) , the display screen is changed to a screen 1904 where it is displayed that the recorded video (absence) message is transmitted to the partner terminal as an E-mail by the above-mentioned manner. On a lower portion of the screen 1904, a button 1904a for stopping the transmission of the corresponded E- mail is arranged. As mentioned abov.e, according to the present embodiment, in a case where the calling partner does not respond, the video (absence) message is recorded by using the user interface as shown in Fig. 15, and the message can be transmitted by the E-mail. Accordingly, the communication with the animation video can be executed with the operation feeling equivalent to or finer than that of the automatic answering telephone based on the conventional analog line . Also, in the present embodiment, in a system of the IP telephone terminal capable of executing the communication with the animation video by equipping the CCD or the like, when the partner terminal does not respond, it become possible to execute the message transmission for realizing the suitable operability without losing the operation feeling of the conventional automatic answering telephone based on the analog line. Further, even in the terminal set in a state of the low QoS (Quality of Service) of the IP telephone system, since such the constitution wherein the video message is once encoded and is transmitted by a mail format is adopted, the voice and animation messages can be transmitted to the partner terminal with a sate without lacking data. Therefore, even in a case where a mobile communication system is used for the connection with a network, the extremely favorable constitution can be provided as a telephony application which can transmit a message recorded in the absence to the partner terminal without deteriorating quality of the voice and the video. Generally, since the data size of the animation. is larger than that of the voice only, especially in case of the animation, the present constitution is .more effective as compared with a case of the voice only. As indicated in each of the embodiments, in a case where the partner terminal does not respond, according to the constitution of transmitting the voice message or the video message as the business message by the E-mail, the high quality business message can be transmitted to the partner terminal, and the excellent operability equivalent to or finer than that of the conventional automatic answering telephone can be obtained at the terminal device of the calling side. In the above-mentioned embodiments, although such the constitution of transmitting voice or animation data as the business message by the E- mail has been indicated, the business message to be transmitted to the absent partner terminal which does not respond may be an arbitrary multimedia message. For example, instead of the animation data including the voice data as in the second embodiment, only the animation data, a still image or the combination of the still image and the user voice may be transmitted by the E-mail, or arbitrary musical composition data (MIDI data or digitized music data) may be included in the voice data. (Another Embodiment) As above, although the embodiments of the present invention have been described in detail, the present invention is applicable to a system composed of plural equipments or to a device including single equipment. The present invention can be constituted as a product such as an MFP (Multi Function Printer) including a telephone device, an image communication function, an image input/output function or the like, or a mobile communication terminal (mobile phone or the like) . The present invention is accomplished also in a case where the program codes for realizing the functions of the above-mentioned embodiments are directly or remotely supplied to a system or a device and then the system or the device reads the supplied program code and executes the program codes. Therefore, the program codes themselves which are installed into a computer so as to realize the functions processes of the present invention are also included in the technical field of the present invention. In this case, any program such as an object code, a program executed by the interpreter, script data to be supplied to an OS (Operating System) or the like is available if having the function of the program irrespective of a form of the program. As a recording medium for supplying the program codes, it can be, for example, a floppy (registered trademark) disk, a hard disk, an optical disk, a magnetooptical disk, an MO, a CD-ROM, a CR-R, a CD-RW, a magnetic tape, a non-volatile memory card, a ROM, a DVD (DVD-ROM, DVD-R) or the like. As another method of supplying the programs, the programs can be also supplied by downloading a computer program itself of the present invention or a compressed file including an automatic installation function to the recording medium such as a hard disk or the like from a homepage by connecting with the homepage on the Internet by using the browser of a client computer. Further, it is realized to supply the programs by dividing the program codes constituting the programs of the present invention into plural files and downloading the respective files from each different homepage. That is, a WWW server for downloading the program files used for realizing the functions processes of the present invention by a computer to plural users is also included in Claims of the present invention. Further, it can be also realized to supply the programs by such a method, wherein the programs of the present invention are stored into a storage medium such as a CD-ROM or the like after encoding the programs and then the storage medium is distributed to a user, and key information for solving the encoded program is downloaded from a . homepage through the Internet for the user who clears a predetermined condition, thereafter the' encoded program is executed by using the key information to be installed in a computer. Further, the computer executes the readout program, thereby realizing the functions of the above-mentioned embodiments, and the OS functioning on the computer executes all the actual process or a part thereof on the basis of an instruction of the program, thereby also realizing the functions of the above-mentioned embodiments by such the process. Still further, the program which was read from the recording medium is once written in a memory provided in a function expansion board inserted in the computer or a function expansion unit connected to the computer, then a CPU or the like provided in the function expansion board or the function expansion unit executes all the actual process or a part thereof on the basis of the instructions of such the program, thereby realizing the functions of the above-mentioned embodiments by such the process. According to the above-mentioned constitution, in a telephone system of executing the transmission/reception of voice data or video data, an excellent effect capable of transmitting a - business mail produced by the high quality voice and/or video data without losing the operation feeling of the conventional automatic answering telephone and requiring the use of an expensive terminal can be obtained in a case where a called side does not respond due to such the situation as absence or the like. The present application claims priority from Japanese Patent Application No. 2004-166624 which is incorporated herein by reference. As many apparently widely different embodiments of the present invention can be made without departing from the spirit and scope thereof, it is to be understood that the invention is not limited to the specific embodiments thereof except as defined in the appended claims .
This application claims priority from Japanese Patent Application No. 2004-166624 filed June 4, 2004, which is hereby incorporated by reference herein.

Claims

CLAIMS 1. A terminal device which executes at least voice communication to a partner terminal, comprising: a telephone calling unit adapted to execute a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation unit adapted to, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulate in said terminal device a business message of a user; an acquisition unit adapted to acquire a mail address of the partner terminal through the telephone protocol; and a mail transmission unit adapted to transmit data indicating the business message to the mail address acquired by said acquisition unit, by using an electronic mail protocol.
2. A terminal device according to Claim 1, wherein the data indicating the business message includes voice data of the user.
3. A terminal device according to Claim 1, further comprising a control unit adapted to stop the telephone calling sequence and the business message accumulation process being executed, in response to a predetermined operation by the user.
4. A terminal device which executes at least voice communication to a partner terminal, comprising: a telephone calling unit -adapted to execute a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation unit adapted to, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulate in said terminal device a business message of a user, the business message including a video; and a mail transmission unit adapted to transmit data indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol.
5. A terminal device according to Claim 4, further comprising an acquisition unit adapted to acquire the mail address of the partner terminal through the telephone protocol.
6. A terminal device according to Claim 4, further comprising: a storage unit adapted to store in said terminal device a mail address in relationship to a telephone number; and an acquisition unit adapted to acquire the mail address of the partner terminal from said storage unit .
7. A terminal device according to Claim 4, further comprising a control unit adapted to stop the telephone calling sequence and the business message 5 accumulation process being executed, in response to a predetermined operation by the user..
8. A terminal device? which executes at least voice communication to a partner terminal, comprising : 10 a telephone calling unit adapted to execute a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation unit adapted to, in a case where it is discriminated based on the telephone 15 protocol that the called partner terminal does not respond, execute voice recognition for a message of a user, transform the voice-recognized message into character information to acquire a business message, and accumulate in said terminal device the acquired 20 business message; and a mail transmission unit adapted to transmit data indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol. 25 9. A terminal device according to Claim 8, further comprising an acquisition unit adapted to acquire the mail address of the partner terminal through the telephone protocol. 10. A terminal device according to Claim 8, further comprising: a storage unit adapted to store in said terminal device the mail address in relationship to a telephone number; and an acquisition unit adapted to acquire the mail address of the partner terminal from said storage unit . 11. A terminal device according to Claim 8, further comprising a control unit adapted to stop the telephone calling sequence and the message accumulation process being executed, in response to a predetermined operation by the user. 12. A control method for a terminal device which executes at least voice communication to a partner terminal, said method comprising: a telephone calling step of executing a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation step of, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulating in the terminal device a business message of a user; an acqμisition step of acquiring a mail address of the partner terminal through the telephone protocol; and a mail transmission step of transmitting data indicating the business message to the mail address acquired in said acquisition step, by using an electronic mail protocol. 13. A control method according to Claim 12, wherein the indicating the business message includes voice data of the user. 14. A control method according to Claim 12, further comprising a control step of stopping the telephone calling sequence and the business message accumulation process being executed, in response to a predetermined operation by the user. 15. A control method for a terminal device which executes at least voice communication to a partner terminal, said method comprising: a telephone calling step of executing a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation step of, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulating in the terminal device a business message of a user, the business message including a video; and a mail transmission step of transmitting data indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol. 16. A control method according to Claim 15, further comprising an acquisition step of acquiring the mail address of the partner terminal through the telephone protocol. 17. A control method according to Claim 15, further comprising: a storage step of storing in a memory of the terminal device a mail address in relationship to a telephone number; and an acquisition step of acquiring the mail address of the partner terminal from the memory in which the mail address was stored in said storage step. 18. A control method according to Claim 15, further comprising a control step of stopping the telephone calling sequence and the business message accumulation process being executed, in response to a predetermined operation by the user. 19. A control method for a terminal device which executes at least voice communication to a partner terminal, said method comprising: a telephone calling step of executing a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation step of, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, executing voice recognition for a message of a user, transforming the voice-recognized message into character information to acquire a business message, and accumulating in the terminal device, the acquired business message^; and a mail transmission step of transmitting data indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol . 20. A control method according to Claim 19, further comprising an acquisition step of acquiring the mail address of the partner terminal through the telephone protocol. 21. A control method according to Claim 19, further comprising: a storage step of storing in the terminal device the mail address in relationship to a telephone number; and an acquisition step of acquiring the mail address of the partner terminal from the memory in which the mail address was stored in said storage step. 22. A control method according to Claim 19, further comprising a control step of stopping the telephone calling sequence and the business message accumulation process being executed, in response to a predetermined operation by the user. 23. A control program for a terminal device which executes at least voice communication to a partner terminal, said program comprising: a telephone calling module of executing a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation module of, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, accumulating in the terminal device a business message of a user; an acquisition module of acquiring a mail address of the partner terminal through the telephone protocol; and a mail transmission module of transmitting data indicating the business message to the mail address acquired by said acquisition module, by using an electronic mail protocol. 24. A control program for a terminal device which executes at least voice communication to a partner terminal, said program comprising: a telephone calling module of executing a telephone calling sequence for calling the partner terminal based on a telephone protocol; an accumulation module of, in a case where it is discriminated based on the telephone protocol that the called- partner terminal does not respond, accumulating in the terminal device a business message of a user, the business message including a - 5 video; and a mail transmission module of transmitting data indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol . -10 25. A control program for a terminal device which executes at least voice communication to a partner terminal, said program comprising: a telephone calling module of executing a telephone calling sequence for calling the partner 15 terminal based on a telephone protocol; an accumulation module of, in a case where it is discriminated based on the telephone protocol that the called partner terminal does not respond, executing voice repognition for a message of a user, 20 transforming the voice-recognized message into character information to acquire a business message, and accumulating in the terminal device the acquired business message; and a mail transmission module of transmitting data 25 indicating the business message to a mail address of the partner terminal, by using an electronic mail protocol .
PCT/JP2005/010310 2004-06-04 2005-05-31 Terminal device, and control method of terminal device WO2005120028A1 (en)

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
JP2004166624A JP2005348192A (en) 2004-06-04 2004-06-04 Terminal device, control method of terminal device, and control program of terminal device
JP2004-166624 2004-06-04

Publications (1)

Publication Number Publication Date
WO2005120028A1 true WO2005120028A1 (en) 2005-12-15

Family

ID=35463194

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/JP2005/010310 WO2005120028A1 (en) 2004-06-04 2005-05-31 Terminal device, and control method of terminal device

Country Status (2)

Country Link
JP (1) JP2005348192A (en)
WO (1) WO2005120028A1 (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7471783B1 (en) 2006-09-30 2008-12-30 Huawei Technologies Co., Ltd. Method and system for replicating ring back tones

Families Citing this family (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8688789B2 (en) 2009-01-30 2014-04-01 Voxer Ip Llc Progressive messaging apparatus and method capable of supporting near real-time communication
US20110019662A1 (en) 2007-06-28 2011-01-27 Rebelvox Llc Method for downloading and using a communication application through a web browser
US8645477B2 (en) 2009-01-30 2014-02-04 Voxer Ip Llc Progressive messaging apparatus and method capable of supporting near real-time communication
US11095583B2 (en) 2007-06-28 2021-08-17 Voxer Ip Llc Real-time messaging method and apparatus
US20100198988A1 (en) 2009-01-30 2010-08-05 Rebelvox Llc Methods for using the addressing, protocols and the infrastructure of email to support near real-time communication
US8180029B2 (en) 2007-06-28 2012-05-15 Voxer Ip Llc Telecommunication and multimedia management method and apparatus
US9178916B2 (en) 2007-06-28 2015-11-03 Voxer Ip Llc Real-time messaging method and apparatus
US8825772B2 (en) 2007-06-28 2014-09-02 Voxer Ip Llc System and method for operating a server for real-time communication of time-based media
JP5284745B2 (en) * 2008-10-10 2013-09-11 インターナショナル・ビジネス・マシーンズ・コーポレーション Apparatus and method for managing access to electronic messages
KR101525283B1 (en) * 2009-01-30 2015-06-02 복서 아이피 엘엘씨 Method and device for near real-time communication
US8849927B2 (en) 2009-01-30 2014-09-30 Voxer Ip Llc Method for implementing real-time voice messaging on a server node
US8941707B2 (en) * 2011-12-01 2015-01-27 Tangome, Inc. Video messaging
JP2016038615A (en) * 2014-08-05 2016-03-22 株式会社未来少年 Terminal device and management server

Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05160895A (en) * 1991-12-03 1993-06-25 A W New Hard:Kk Communication equipment
JPH09135298A (en) * 1995-11-09 1997-05-20 Fujitsu Ltd Telephone message notification system
JP2000115738A (en) * 1998-10-08 2000-04-21 Ntt Data Corp Video conference system, video conference device, mail transfer device and recording medium
JP2001119471A (en) * 1999-10-15 2001-04-27 Nippon Telegraph & Telephone East Corp Automatic telephone answering set
JP2001309040A (en) * 2000-04-26 2001-11-02 Ntt Communications Kk Voice mail system and storage medium recording program
US20030016656A1 (en) * 2001-07-20 2003-01-23 Net2Phone, Inc. Active voice messaging

Patent Citations (6)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
JPH05160895A (en) * 1991-12-03 1993-06-25 A W New Hard:Kk Communication equipment
JPH09135298A (en) * 1995-11-09 1997-05-20 Fujitsu Ltd Telephone message notification system
JP2000115738A (en) * 1998-10-08 2000-04-21 Ntt Data Corp Video conference system, video conference device, mail transfer device and recording medium
JP2001119471A (en) * 1999-10-15 2001-04-27 Nippon Telegraph & Telephone East Corp Automatic telephone answering set
JP2001309040A (en) * 2000-04-26 2001-11-02 Ntt Communications Kk Voice mail system and storage medium recording program
US20030016656A1 (en) * 2001-07-20 2003-01-23 Net2Phone, Inc. Active voice messaging

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7471783B1 (en) 2006-09-30 2008-12-30 Huawei Technologies Co., Ltd. Method and system for replicating ring back tones
US8170194B2 (en) 2006-09-30 2012-05-01 Huawei Technologies Co., Ltd. Method and system for replicating ring back tones

Also Published As

Publication number Publication date
JP2005348192A (en) 2005-12-15

Similar Documents

Publication Publication Date Title
WO2005120028A1 (en) Terminal device, and control method of terminal device
JP4343626B2 (en) Image communication control method, image communication control program, and image communication apparatus
JP4312700B2 (en) Network communication equipment
KR100738548B1 (en) Apparatus and method for visual communication by using voip
EP1583310B1 (en) Telephone and adaptor for voice and video communication over IP
JP4646657B2 (en) TV phone adapter
US20150163374A1 (en) Communication apparatus, control method, and computer-usable medium for selcting a network for data transmission
US7283273B2 (en) Image communication apparatus using IP addresses and control method thereof, program, and storage medium
US20050271062A1 (en) Communication terminal and method for controlling the same
JP3873048B2 (en) Ringback tone transmission method, terminal, ringback tone generation method, and system for generating ringback tone
US20060230161A1 (en) System and method for providing service in a communication system
JP4405305B2 (en) Information communication device, information communication program, and recording medium recording information communication program
JP2005079929A (en) Communication apparatus, control method of communication apparatus, and control program for communication apparatus
KR101069530B1 (en) Apparatus and method for terminating call's bearer control, and multimedia information providing service system and method in NGN
JP2010263319A (en) Image communication apparatus
WO2010070986A1 (en) Multimedia provision service
JP4111393B2 (en) IP telephone system and IP telephone apparatus
JP4836221B2 (en) PSTN terminal accommodating device
JP4039973B2 (en) IP terminal equipment
JP2006211001A (en) Television telephone
JP4193144B2 (en) Image communication device
JP2005269165A (en) Ip phone
KR100879362B1 (en) Method and apparatus for supporting of video communication service based on sip
JP3867861B2 (en) Facsimile device
JP2005328291A (en) Signal relaying server, method, and program

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS KE KG KM KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NG NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SM SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): BW GH GM KE LS MW MZ NA SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LT LU MC NL PL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
NENP Non-entry into the national phase

Ref country code: DE

WWW Wipo information: withdrawn in national office

Country of ref document: DE

122 Ep: pct application non-entry in european phase