US20120155827A1

US20120155827A1 - Communication device and method for operating the same

Info

Publication number: US20120155827A1
Application number: US13/324,342
Authority: US
Inventors: Masafumi KOUZUKI; Naoya Takao; Kazuo Fujimoto; Shigeaki Watanabe; Masaki Itoh
Original assignee: Panasonic Corp
Current assignee: Panasonic Corp
Priority date: 2010-12-15
Filing date: 2011-12-13
Publication date: 2012-06-21
Also published as: US8902277B2; JP5877351B2; JPWO2012081203A1; US20120155657A1; JP2012142910A; US20120162346A1; JP2012142927A; JP2012142915A; WO2012081203A1; US20120154512A1

Abstract

When a receiver in a control LSI receives a conversation request from another device, a controller in the control LSI determines whether a camera/microphone device is connected to a USB interface in a communication device. If it is determined that the camera/microphone device is not connected to the USB interface in the communication device, the controller in the control LSI performs a message recording operation.

Description

BACKGROUND OF THE INVENTION

(1) Field of the Invention
The present invention relates to a communication device capable of transmitting and receiving video data as well as audio data and a method for operating the same.
(2) Description of Related Art
In a communication system and a data communication method discussed in JP 2010-521856 A, communication is performed between a first terminal and a second terminal via a network. In the communication system, each of the first and second terminals includes a receiving circuit and a transmitting circuit. Each of the first and second terminals includes a web camera and a microphone as input devices, and includes a display screen and a loudspeaker as output devices.
For example, in the first terminal, video of a user of the first terminal is input to the web camera, and audio of the user of the first terminal is input to the microphone. In the second terminal, video of a user of the second terminal is input to the web camera, and audio of the user of the second terminal is input to the microphone.
In the transmitting circuit in the first terminal, data based on the video and the audio input to the web camera and the microphone is transmitted to the second terminal via the network. In this case, the data transmitted from the first terminal via the network is received in the receiving circuit in the second terminal, and video and audio based on the received data are output from the display screen and the loudspeaker.
Similarly, in the transmitting circuit in the second terminal, data based on the video and the audio input to the web camera and the microphone is transmitted to the first terminal via the network. In this case, the data transmitted from the second terminal via the network is received in the receiving circuit in the first terminal, and video and audio based on the received data are output from the display screen and the loudspeaker.
Thus, the user of the first terminal can talk with the user of the second terminal while visually recognizing the video of the user of the second terminal. Similarly, the user of the second terminal can talk with the user of the first terminal while visually recognizing the video of the user of the first terminal.

BRIEF SUMMARY OF THE INVENTION

In the above-mentioned communication system, when a user of a first terminal talks with a user of a second terminal, the user of the first terminal transmits a conversation request to the second terminal. The user of the second terminal transmits a response signal to the first terminal by a predetermined operation when the user receives the conversation request. Thus, the user of the first terminal and the user of the second terminal can talk with each other.
If communication between the first terminal and the second terminal is established, however, a conversation may be impossible between the first terminal and the second terminal depending on a connected state of the second terminal. In such a case, the user of the first terminal cannot transmit information to the user of the second terminal.
The present invention is directed to enabling, even when a communication device receives a conversation request from another communication terminal with a conversation being not possible between the communication device and the other communication terminal depending on a connected state of the communication device, a user of the other communication terminal to transmit information to the communication device.
According to an aspect of the present invention, a communication device capable of transmitting and receiving video data and audio data to and from another device and being connectable to an audio input device and an audio output device includes a main functional unit that performs a main functional operation based on the video data and the audio data, a communication unit configured to be capable of transmitting the video data and the audio data to the other device and receiving the video data and the audio data transmitted from the other device, and a controller that controls communication of the video data and the audio data by the communication unit, in which the controller is configured to be capable of performing a message recording operation for transmitting a response message to the other device by the communication unit while recording a recording message received from the other device by the communication unit, and determine whether the audio input device is connected to the communication device when the communication unit receives a conversation request from the other device, to perform the message recording operation when it determines that the audio input device is not connected to the communication device.
According to the present invention, even when the communication device receives the conversation request from the other communication terminal with the conversation being not possible between the communication device and the other communication terminal depending on the connected state of the communication device, the user of the other communication terminal can transmit the information to the communication device.
Other features, elements, characteristics, and advantages of the present invention will become more apparent from the following description of preferred embodiments of the present invention with reference to the attached drawings.

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWING

FIG. 1 illustrates an outline of a communication system according to an embodiment of the present invention;

FIG. 2 is a block diagram illustrating a configuration of a terminal;

FIG. 3 is a schematic view illustrating a state transition of a communication device;

FIG. 4 illustrates an example of a start condition of a conversation program;

FIG. 5 illustrates a sign-in screen;

FIG. 6 illustrates a user registration screen;

FIG. 7 illustrates an example of a contact screen;

FIG. 8 illustrates another example of a contact screen;

FIG. 9 illustrates still another example of a contact screen;

FIG. 10 illustrates still another example of a contact screen;

FIG. 11 illustrates an example of an incoming call screen;

FIG. 12 illustrates another example of an incoming call screen;

FIG. 13 illustrates a conversation screen;

FIG. 14 illustrates priorities of an automatic response operation and a message recording operation performed when an automatic response is set;

FIG. 15 is a flowchart illustrating an example of an operation of a control LSI based on a conversation program according to an embodiment of the present invention;

FIG. 16 is a block diagram illustrating a detailed configuration and an operation of the control LSI;

FIG. 17 is a block diagram illustrating the detailed configuration and the operation of the control LSI; and

FIG. 18 is a flowchart illustrating another example of the operation of the control LSI illustrated in FIG. 2.

DESCRIPTION OF THE PREFERRED EMBODIMENTS

[1] Embodiment of Present Invention

A communication device and a method for operating the same according to an embodiment of the present invention will be described with reference to the drawings.
(1) Outline of Communication System
FIG. 1 illustrates an outline of a communication system according to an embodiment of the present invention, and FIG. 2 is a block diagram illustrating a configuration of a terminal 1000 illustrated in FIG. 1.
As illustrated in FIG. 1, the terminal 1000, a base station 800, a personal computer 600, a television receiver (hereinafter abbreviated as a television) 700, and a server for conversation 2000 are connected to a network 500 in the communication system. A mobile phone 900 is connected to the network 500 via the base station 800. In this manner, the terminal 1000, the personal computer 600, the television 700, and the mobile phone 900 are connected as a plurality of communication terminals to the network 500. The network 500 is the interne in the present embodiment.
In an example illustrated in FIG. 1, a control large-scale integrated circuit (LSI) 101 (FIG. 2), described below, is incorporated in each of the plurality of communication terminals (the terminal 1000, the personal computer 600, the television 700, and the mobile phone 900) connected to one another. A conversation program, described below, is stored in a memory of the incorporated control LSI 101 (FIG. 2).
Each of the communication terminals includes a video input unit, an audio input unit, a video output unit, and an audio output unit. The video input unit includes a camera, for example. The audio input unit includes a microphone, for example. The video output unit includes a monitor, for example. The audio output unit includes a speaker, for example.
In the present embodiment, users of the plurality of communication terminals are required to previously register their own unique user information in the server for conversation 2000. The user information includes a user identifier (hereinafter referred to as a user ID) and a password associated with the user ID. The server for conversation 2000 manages a plurality of users by storing a plurality of user information of the plurality of users.
New user information, together with a request to register the user information, is transmitted from any of the communication terminals to the server for conversation 2000 when registered.
The server for conversation 2000 determines whether a user ID of the received user information matches any of user IDs of the plurality of user information that have already been registered while referring to the plurality of user information that have already been stored.
When the user ID of the received user information does not match any of the user IDs of the plurality of user information that have already been registered, the server for conversation 2000 stores the fed user information. On the other hand, when the user ID of the received user information matches any of the user IDs of the plurality of user information that have already been registered, the server for conversation 2000 does not store the received user information. This prevents the plurality of user information including the same user ID from being registered in the server for conversation 2000. A sign-in request, together with the user information, is transmitted from the one communication terminal, for example, to the server for conversation 2000. In this case, the server for conversation 2000 determines whether the received user information matches any of the plurality of user information that have been stored. More specifically, the server for conversation 2000 determines whether the user information received from the one communication terminal has already been registered.
When the received user information has already been registered, the server for conversation 2000 determines whether the signing-in using the same user information as the received user information is currently performed to prevent the plurality of users from signing in using the same user information.
When the signing-in using the same user information as the received user information is not performed, the server for conversation 2000 permits the user to sign in. On the other hand, when the user information received from the one communication terminal is not registered and when the signing-in using the same user information as the received user information is currently performed, the server for conversation 2000 does not permit the user to sign in.
The user signs in to the server for conversation 2000 so that an address (e.g., an interne protocol address) of the communication terminal is transmitted from the communication terminal used by the user to the server for conversation 2000. A request to continue the signing-in is transmitted from the communication terminal to the server for conversation 2000 in a predetermined period.
Thus, the user who currently signs in and the address of the communication terminal used by the user who signsin are managed in the server for conversation 2000.
The user signs in to the server for conversation 2000 using the one communication terminal so that a conversation request with the other user, together with a user ID of the other user, is transmitted to the server for conversation 2000. In this case, the server for conversation 2000 determines whether the other user has signed in based on the received user ID.
When the other user has signed in, the server for conversation 2000 transmits the address of the communication terminal used by the other user to the one communication terminal. Thus, the one communication terminal accesses the other communication terminal using the received address. This enables various types of data including video data and audio data to be communicated between the one communication terminal and the other communication terminal.
On the other hand, when the other user has not signed in, the server for conversation 2000 transmits information indicating that the other user has not signed in to the one communication terminal. In this case, information indicating that a conversation with the other user is not possible is presented to the user with a monitor or a speaker in the one communication terminal.
Further, the user can accept an access from the other communication terminal by signing in to the server for conversation 2000 using the one communication terminal.
Communication of the video data based on video of each of the users captured by the camera and the audio data based on audio of each of the users input to the microphone is performed among the plurality of communication terminals. This allows the user of each of the communication terminals to talk with the user of the other communication terminal.
A configuration of the terminal 1000 will be described below. As illustrated in FIGS. 1 and 2, the terminal 1000 includes a communication device 100, a camera/microphone device 200, a television 300, and two remote controllers 400 and 490.
As illustrated in FIG. 2, the communication device 100 includes the control LSI 101, a network interface 103, a wireless receiver 104, a universal serial bus (hereinafter referred to as a USB) interface 105, a power supplier 106, a high-definition multimedia interface (hereinafter referred to as an HDMI) 107, an optical disk drive 108, a memory slot 109, a fluorescent display tube (hereinafter referred to as an FL display) 191, a light emitting diode unit (hereinafter referred to as an LED unit) 192, a buzzer 193, and a flash memory 112. A memory card 110 is inserted into the memory slot 109. The network interface 103 in the communication device 100 is connected to the network 500 via a network cable (e.g., a local area network cable) in the present embodiment.
The control LSI 101 includes a central processing unit (CPU) and a memory, and is implemented by an integrated circuit using semiconductors. As described above, a conversation program, described below, together with a system program for the communication device 100, is stored in the memory of the control LSI 101. The CPU executes each program stored in the memory so that the control LSI 101 performs various types of processing. The control LSI 101 controls an operation of each of constituent elements in the communication device 100 while controlling communication with the other communication terminals (the personal computer 600, the television 700, the mobile phone 900, etc. illustrated in FIG. 1). A detailed configuration of the control LSI 101 will be described below.
The network interface 103 is connected to the network 500 via the network cable. The network interface 103 causes various types of data including the video data and the audio data to be fed from the network 500 to the control LSI 101 in the communication device 100. Various types of data including the video data and the audio data are also fed from the control LSI 101 in the communication device 100 to the network 500.
The remote controller 400 transmits an operation signal, described below, to the communication device 100 by wireless communication (e.g., infrared communication), as described below. The wireless receiver 104 receives the operation signal wirelessly transmitted from the remote controller 400. The operation signal, which has been received by the wireless receiver 104, is fed to the control LSI 101.
The USB interface 105 is connected to the camera/microphone device 200 via a USB cable. The power supplier 106 includes a power supply circuit for converting alternating current (AC) power to direct current (DC) power. A power supply plug is connected to the power supply circuit. The power supply plug is connectable to a household electrical outlet. The power supplier 106 supplies electric power obtained from the household electrical outlet to each of the constituent elements in the communication device 100. The HDMI 107 is connected to the television 300 via an HDMI cable. The optical disk drive 108 reads and writes data to and from an optical disk.
The memory slot 109 is configured so that the memory card 110 can be inserted thereinto and ejected therefrom. With the memory card 110 inserted into the memory slot 109, the control LSI 101 can read data stored in the memory card 110. The control LSI 101 can write data into the memory card 110.
The flash memory 112 is connected to the control LSI 101. The flash memory 112 may be replaced with another nonvolatile memory. The flash memory 112 stores the user information of the user who uses the terminal 1000 and a list of user IDs of the other users (hereinafter referred to as a contact list), for example. The flash memory 112 stores, when the user cannot accept accesses from the other communication terminals, data (e.g., video data and audio data for notifying that the user is absent) that is to be fed to the other communication terminals in response to the accesses from the other communication terminals.
The communication device 100 has a box-shaped casing, for example. The control LSI 101, the network interface 103, the wireless receiver 104, the USB interface 105, the power supplier 106, the HDMI 107, the optical disk drive 108, and the memory slot 109 are accommodated in the casing. The FL display 191, the LED unit 192, and the buzzer 193 are attached to the casing.
The FL display 191 is composed of a fluorescent display tube of seven segments or a fluorescent display tube of fourteen segments, for example. Information representing current time, reproduction time of the optical disk, and so on are fed from the control LSI 101 to the FL display 191. The FL display 191 displays the fed information.
The LED unit 192 generates monochromatic light. Information representing lighting or non-lighting is fed from the control LSI 101 to the LED unit 192. The LED unit 192 lights up, goes out, or flashes based on the information fed from the control LSI 101.
Information for instructing the buzzer 193 to generate an alarm is fed from the control LSI 101. In this case, the buzzer 193 generates an alarm sound based on the information fed from the control LSI 101.
The remote controller 400 includes an operation unit 401, a processing circuit 402, and a wireless transmitter 403. The operation unit 401 includes a power supply button 411, a conversation start button 412, a conversation response button 413, a cross key 414, and a determination button 415 illustrated in FIG. 1, and a plurality of number buttons (not illustrated). The cross key 414 includes an upper button, a lower button, a left button, and a right button. The user operates any of the buttons in the operation unit 401. The processing circuit 402 generates an operation signal according to the operated button. The generated operation signal is transmitted from the wireless transmitter 403 to the wireless receiver 104 in the communication device 100. As described above, wireless communication between the communication device 100 and the remote controller 400 is implemented by infrared communication, for example.
The camera/microphone device 200 includes a camera 201, a microphone 202, two analog/digital (hereinafter referred to as A/D) converters 203 and 204, and a USB interface 205. The USB interface 205 in the camera/microphone device 200 is connected to the USB interface 105 in the communication device 100 via the USB cable.
The camera 201 includes an image sensor. The image sensor acquires video of an object. In the camera 201, a video signal in an analog format is generated based on the acquired video. The A/D converter 203 converts the generated video signal to video data in a digital format. The video data in a digital format is fed to the control LSI 101 in the communication device 100 via the USB interface 205, the USB cable, and the USB interface 105.
Audio (a sound wave) is input to the microphone 202 from outside. In the microphone 202, an audio signal in an analog format is generated based on the input audio. The A/D converter 204 converts the generated audio signal to audio data in a digital format. The audio data in a digital format is fed to the control LSI 101 in the communication device 100 via the USB interface 205, the USB cable, and the USB interface 105.
The camera/microphone device 200 is used to acquire video and audio of the user, for example, in the present embodiment.
As described above, the camera/microphone device 200 includes the camera 201 and the microphone 202. The camera 201 and the microphone 202 may individually be connected to the communication device 100 instead of the camera/microphone device 200 being connected to the communication device 100.
The camera/microphone device 200 may include an HDMI. In this case, the HDMI in the camera/microphone device 200 is connected to the communication device 100 via an HDMI cable. The camera/microphone device 200 may include a wireless transmitter. In this case, the video data and the audio data are fed from the wireless transmitter in the camera/microphone device 200 to the wireless receiver 104 in the communication device 100.
The television 300 includes a monitor 301, a speaker 302, digital/analog (hereinafter referred to as D/A) converters 303 and 304, an HDMI 305, a wireless receiver 306, an audio volume adjuster 310, and a tuner 320. The HDMI 305 in the television 300 is connected to the HDMI 107 in the communication device 100 via the HDMI cable in the present embodiment.
The video data and the audio data in a digital format are fed from the control LSI 101 in the communication device 100 to the television 300 via the HDMI 107, the HDMI cable, and the HDMI 305. The D/A converter 303 converts the video data fed to the television 300 to a video signal in an analog format. The video signal in an analog format is fed to the monitor 301. Thus, video is displayed on the monitor 301.
On the other hand, the D/A converter 304 converts the audio data fed to the television 300 to an audio signal in an analog format. The audio signal in an analog format is fed to the audio volume adjuster 310.
An operation signal for adjusting the level of the audio signal, for example, is input from the remote controller 490, described below, to the audio volume adjuster 310. Thus, the audio volume adjuster 310 adjusts the level of the audio signal based on the operation signal fed from the remote controller 490. The adjusted audio signal is fed to the speaker 302, and audio based on the audio signal is output.
The tuner 320 receives, selects, demodulates, and decodes a broadcast signal for a program to be broadcast or distributed, to generate video data and audio data, and feeds the generated video data and audio data to the D/A converter 303 and the D/A converter 304, respectively. Thus, video of the program is displayed on the monitor 301, and audio of the program is output from the speaker 302.
As described above, the communication device 100 and the television 300 are connected to each other via the HDMI 107, the HDMI cable, and the HDMI 305. In this case, the communication device 100 can feed a control signal for controlling an operation of the television 300 to the television 300.
The monitor 301 and the speaker 302 may individually be connected to the communication device 100 instead of the television 300 being connected to the communication device 100.
The remote controller 490 includes an operation unit 491, a processing circuit 492, and a wireless transmitter 493. The operation unit 491 includes a power supply button 481 and audio volume adjustment buttons 484 a and 484 b illustrated in FIG. 1. The user operates any of the buttons in the operation unit 491. The processing circuit 492 generates an operation signal according to the operated button.
The power supply button 481 is operated so that an operation signal for turning on power to the television 300 is generated. The audio volume adjustment button 484 a is operated so that an operation signal for increasing the level of the audio signal is generated. The audio volume adjustment button 484 b is operated so that an operation signal for decreasing the level of the audio signal is generated.
The generated operation signal is wirelessly transmitted from the wireless transmitter 493 to the wireless receiver 306 in the television 300. Wireless communication between the television 300 and the remote controller 490 is implemented by infrared communication, for example.
In the terminal 1000, the video data and the audio data are fed from the camera/microphone device 200 to the communication device 100, for example. In the communication device 100, the fed video data is encoded, and the fed audio data is encoded. During a conversation operation of the terminal 1000, described below, the communication device 100 transmits the encoded video data and audio data to the other communication terminals (the personal computer 600, the television 700, and the mobile phone 900) connected to the network 500.
The user signs in to the server for conversation 2000 illustrated in FIG. 1 so that the communication device 100 receives video data and audio data transmitted from the other communication terminals connected to the network 500 in the terminal 1000. In the communication device 100, the received video data and audio data are decoded. During the conversation operation of the terminal 1000, described below, the communication device 100 feeds the decoded video data and audio data to the television 300. In the television 300, the video data in a digital format is converted to the video signal after the conversion in an analog format, and the video based on the video signal after the conversion is displayed on the monitor 301. The audio data in a digital format is converted to the audio signal in an analog format, and the audio based on the audio signal after the conversion is output from the speaker 302.
This causes communication of the video data and the audio data to be performed between the terminal 1000 and the other communication terminals, as described above. Similarly to the terminal 1000, each of the plurality of communication terminals connected to the network 500 includes a camera, a microphone, a monitor, and a speaker. This enables the user who uses the terminal 1000 to talk with users who use the other communication terminals.
In the communication device 100 in the terminal 1000, the video data and the audio data, which have been read from the optical disk by the optical disk drive 108, for example, are fed to the television 300. In the television 300, the video data in a digital format is converted to a video signal in an analog format, and video based on the video signal after the conversion is displayed on the monitor 301. The audio data in a digital format is converted to an audio signal in an analog format, and audio based on the audio signal after the conversion is output from the speaker 302.
Furthermore, video data and audio data, which have been received from the network 500, for example, are written into the memory card 110 in the communication device 100 in the terminal 1000.
(2) State Transition of Communication Device 100
FIG. 3 is a schematic view illustrating a state transition of the communication device 100. As illustrated in FIG. 3, the communication device 100 transits among at least three states. The three states include a power-off state, a standby state, and a power-on state.
The power-off state means a state where supply of electric power from the power supplier 106 to the control LSI 101 and the other constituent element in the communication device 100. If the power supply plug in the power supplier 106 is disconnected from the household electrical outlet, for example, the communication device 100 is in the power-off state. When the power supply plug in the power supplier 106 is connected to the household electrical outlet in the power-off state, the communication device 100 transits from the power-off state to the standby state, as indicated by an arrow a.
The standby state means a state where electric power is supplied to a control functional unit in the communication device 100 and electric power is not supplied to a main functional unit in the communication device 100. In the standby state, the main functional unit in the communication device 100 is stopped. In the present embodiment, the main functional unit is an optical disk drive 108, and has a function of recording and reproducing video data and audio data. The control functional unit includes the control LSI 101, the wireless receiver 104, the FL display 191, the LED unit 192, and the buzzer 193. In the standby state in the present embodiment, electric power is supplied from the power supplier 106 to at least the control LSI 101, the wireless receiver 104, the FL display 191, the LED unit 192, and the buzzer 193, and the function of the optical disk drive 108 is stopped. In this case, at least a part of the conversation program is executable. When the power supply button 411 in the remote controller 400 is operated in the standby state, the communication device 100 transits from the standby state to the power-on state, as indicated by an arrow c.
The power-on state means a state where electric power is supplied to the control functional unit and the main functional unit in the communication device 100. In the power-on state in the present embodiment, electric power is supplied from the power supplier 106 to the control LSI 101, the wireless receiver 104, the optical disk drive 108, the FL display 191, the LED unit 192, and the buzzer 193. In this case, the conversation program is being executed. When the power supply button 411 in the remote controller 400 is operated in the power-on state, the communication device 100 transits from the power-on state to the standby state, as indicated by an arrow d. When the power supply plug in the power supplier 106 is disconnected from the household electrical outlet in the power-on state, the communication device 100 transits from the power-on state to the power-off state, as indicated by an arrow e.
(3) Start Condition of Conversation Program
A start condition of the conversation program is set by a user's operation. The setting by the user's operation (hereinafter referred to as user setting) includes setting of automatic signing-in and setting of incoming call permission at standby time.
The user can set the automatic signing-in to “YES” or “NO” in the user setting. If the automatic signing-in is set to “YES”, the signing-in is automatically performed.
If the automatic signing-in is set to “YES”, the user can set the incoming call permission at standby time to “YES” or “NO”. When the incoming call permission at standby time is set to “YES”, an incoming call becomes possible even when the communication device 100 is in the standby state.
FIG. 4 illustrates an example of the start condition of the conversation program. In FIG. 4, “O” indicates that the conversation program is running, and “X” indicates that the conversation program is not running.
If the automatic signing-in is set to “YES”, and the incoming call permission at standby time is set to “NO”, the control LSI 101 starts the conversation program at the time of transition from the standby state to the power-on state. Then, the control LSI 101 communicates with the conversation server 2000 using a user ID in which the automatic signing-in is set to “YES”.
If the automatic signing-in is set to “YES”, and the incoming call permission at standby time is set to “YES”, the control LSI 101 starts the conversation program at the time of transition from the power-off state to the standby state. Then, the control LSI 101 communicates with the conversation server 200 using a user ID in which the automatic signing-in is set to “YES”.
If the automatic signing-in is set to “NO”, the control LSI 101 starts the conversation program when the user operates the conversation start button 412 in the power-on state.
(4) Outline of Operation of Terminal 1000 by User
(a) Signing-In
In the following description, the video signal is fed from the communication device 100 to the monitor 301 in the television 300 via the D/A converter 303. The monitor 301 in the television 300 displays video based on the fed video signal. The audio signal is fed from the communication device 100 to the speaker 302 in the television 300 via the D/A converter 304. The speaker 302 in the television 300 outputs audio based on the fed audio signal.
An outline of the operation of the terminal 1000 by the user, together with the video to be displayed on the monitor 301 in the television 300, will be described.
When one user signs in to the server for conversation 2000 using the terminal 1000, the one user operates the conversation start button 412 illustrated in FIG. 1, for example. Thus, an operation signal indicating that the conversation program is to be executed is fed from the remote controller 400 to the communication device 100. The conversation program is executed so that a sign-in screen is displayed on the monitor 301 in the television 300.
FIG. 5 illustrates the sign-in screen. As illustrated in FIG. 5, an input frame f1 for a user ID, an input frame f2 for a password, a sign-in button b1, and a new user registration button b2 are displayed on a sign-in screen SC1. The user can select the input frames f1 and f2, the sign-in button b1, and the new user registration button b2 by operating the cross key 414 in the remote controller 400 illustrated in FIG. 1. The user can input characters in the input frames f1 and f2 using the plurality of number buttons (not illustrated) in the remote controller 400 illustrated in FIG. 1.
After inputting a user ID and a password in the respective input frames f1 and f2, the user selects the sign-in button b1 and operates the determination button 415 in the remote controller 400 illustrated in FIG. 1. Thus, signing-in to the server for conversation 2000 is performed.
A check box c1 for selecting “automatically sign in next time” for setting automatic signing-in and a check box c2 for selecting “accept incoming call at standby time” are displayed on the sign-in screen SC1.
When the signing-in is performed with the check box c1 selected, the control LSI 101 associates information indicating that the automatic signing-in is “YES” with the user ID input to the input frame f1, and stores the information in the flash memory 112. Thus, the automatic signing-in is set to “YES”.
When the signing-in is performed with the check box c2 selected, the control LSI 101 associates information indicating that the incoming call permission at standby time is “YES” with the user ID input to the input frame f1, and stores the information in the flash memory 112. Thus, the incoming call permission at standby time is set to “YES”.
If the user does not select the check box c1, the sign-in screen SC1 is configured so that the check box c2 cannot be selected.
In the present embodiment, the automatic signing-in is settable to “YES” for only the one user ID. Thus, processing of the control LSI 101 is prevented from being complicated.
(b) User Registration
The user selects the new user registration button b2 in the sign-in screen SC1 and operates the determination button 415 in the remote controller 400 illustrated in FIG. 1 when registering user information in the server for conversation 2000. In this case, a user registration screen is displayed on the monitor 301 in the television 300.
FIG. 6 illustrates the user registration screen. As illustrated in FIG. 6, an input frame f3 for a user name, the input frame f1 for a user ID, an input frame f2 for a password, and a registration button b3 are displayed on the user registration screen SC2. The user can select the input frames f1, f2, and f3 and the registration button b3 by operating the cross key 414 in the remote controller 400 illustrated in FIG. 1. After inputting the user ID, the password, and the name in the respective input frames f1, f2, and f3, the user selects the registration button b3, and operates the determination button 415 in the remote controller 400 illustrated in FIG. 1. Thus, the user information is registered in the server for conversation 2000.
The signing-in to the server for conversation 2000 is performed so that a contact screen is displayed on the monitor 301 in the television 300.
(c) Contact List
FIG. 7 illustrates an example of the contact screen. A contact screen SC3 includes a tub Tb on the left side and a main body portion Bd on the right side. The tab Tb includes a plurality of large items. The plurality of large items include “set”, “account”, “online”, and “contact list”. The user can select processing to be performed in the conversation program from the large items in the tub Tb using the cross key 414 and the determination button 415 in the remote controller 400.
As described above, the contact list is stored in the flash memory 112 in the communication device 100 illustrated in FIG. 2. As illustrated in FIG. 7, a contact list button b4 for displaying the contact list stored in the flash memory 112 is displayed on the tab Tb in the contact screen SC3. In this state, the user selects the contact list button b4, and operates the determination button 415 in the remote controller 400 illustrated in FIG. 1. In this case, the contact list is displayed on the main body portion Bd in the contact screen SC3.
As illustrated in FIG. 7, a plurality of user ID buttons b5 associated with a plurality of user IDs, respectively, stored in the communication device 100, for example, are displayed on the main body portion Bd in the contact screen SC3. The user selects any of the plurality of user ID buttons b5, and operates the determination button 415 in the remote controller 400 illustrated in FIG. 1.
Thus, the selected user ID, together with a request signal, is transmitted to the server for conversation 2000. When the signing-in using the selected user ID has already been performed, the communication device 100 in the terminal 1000 acquires an address of the other communication terminal used for the signing-in using the user ID from the server for conversation 2000.
Thereafter, a conversation request for requesting a conversation (a conversation request signal) is transmitted from the communication device 100 in the terminal 1000 to the other communication terminal using the acquired address. The communication device 100 receives a response signal from the other communication terminal so that a conversation screen, described below, is displayed on the monitor 301 in the television 300.
(d) User Setting
FIG. 8 illustrates another example of a contact screen. When the user selects a setting button b11, middle items “video”, “sound”, “conversation”, “message recording”, “security”, “communication”, and “high level setting” included in the large item “setting” are displayed in a main body portion Bd.
When the user selects a high level setting button b12, a small item (not illustrated) is displayed in the main body portion Bd. The small item includes “automatic signing-in” and “incoming call permission at standby time”. The user can set the automatic signing-in to “YES” or “NO” depending on “automatic signing-in” in the small item. The user can set the incoming call permission at standby time to “YES” or “NO” depending on “incoming call permission at standby time” in the small item.
FIG. 9 illustrates still another example of a contact screen. When the user selects the conversation button b13 illustrated in FIG. 8, an automatic response setting item is displayed in a main body portion Bd. A check box c3 for setting an automatic response to “use” and a check box c4 for setting an automatic response to “not use” are displayed in the automatic response setting item. The user selects the check box c3 so that the automatic response is set. The user selects the check box c4 so that the automatic response is not set.
The automatic response is a function of automatically enabling the communication device 100 to make a conversation response using only audio without receiving a conversation response instruction from the user when a conversation request instruction is received from the other communication terminal (at the time of an incoming call). If the automatic response is set, a response signal is transmitted to the other communication terminal without the user performing an operation for the conversation response for the communication device 100 at the time of an incoming call from the other communication terminal. Thus, the user of the communication device 100 can immediately talk with a user of the other communication device 100 even if the user does not know an operation for issuing the conversation response instruction.
FIG. 10 illustrates still another example of a contact screen. When the user selects a message recording button b14 illustrated in FIG. 8, “return to setting”, “message recording”, “time to switching from incoming call to message recording”, and “response message setting” are displayed in a main body portion Bd as small items included in a middle item “message recording”, as illustrated in FIG. 10.
“Return to setting” means an item for returning to the contact screen SC3 illustrated in FIG. 8. “Message recording” is an item for switching ON and OFF of a message recording function. If the user selects “use”, the message recording function is set to ON. If the user selects “not use”, the message recording function is set to OFF. “Time to switching from incoming call to message recording” is an item for setting a time elapsed since the communication device 100 received an incoming call until it transits to a message recording operation. The user can select “immediately after incoming call”, “5 seconds” or “15 seconds”, for example, as “time to switching from incoming call to message recording”.
“Response message setting” is an item for setting a response message to be transmitted to the other communication terminal using the message recording function when the communication device 100 receives an incoming call from the other communication terminal. The user can set a response message by selecting the item. In this case, the control LSI 101 can record both or only one of video data and audio data corresponding to video and audio acquired by the camera/microphone device 200 as a response message in the memory card 110.
(e) Incoming Call Screen
If the communication device 100 is in the power-on state, or if the communication device 100 is in the standby state and the incoming call permission at standby time is set to “YES”, the conversation program is started, as illustrated in FIG. 4. In this case, when a conversation request is received from the communication terminal of the other user, an incoming call screen is displayed on the monitor 301 in the television 300.
FIG. 11 illustrates an example of the incoming call screen. FIG. 12 illustrates another example of the incoming call screen. As illustrated in FIGS. 11 and 12, a video response button b6, a voice response button b7, a message recording response button b8, and a rejection response button b9 are displayed on an incoming call screen SC4. In the example illustrated in FIG. 11, landscape video SS is further displayed on the incoming call screen SC4. In the example illustrated in FIG. 12, landscape video is displayed on the incoming call screen SC4.
When the conversation request is received from the communication terminal of the other user, the buzzer 193 illustrated in FIG. 2 generates a ringtone while the LED unit 192 lights up or flashes. Information (e.g., a name or a user ID) for specifying the other user are displayed on the FL display 191. Thus, the user of the communication device 100 can recognize the ringtone.
The user can select the video response button b6 in the incoming call screen SC4 illustrated in FIG. 11 or 12, and operate the determination button 415 in the remote controller 400 illustrated in FIG. 1. Alternatively, the user can operate the conversation response button 413 in the remote controller 400 illustrated in FIG. 1. In this case, a response signal is transmitted from the communication device 100 in the terminal 1000 to the communication terminal of the other user. A conversation request is transmitted from the communication device 100 to the other communication terminal. The communication device 100 receives the response signal from the other communication terminal so that the conversation screen SC5 illustrated in FIG. 13, described below, is displayed on the monitor 301 in the television 300. In this state, the user can talk with the user of the other communication terminal while seeing the video.
The user can select the voice response button b7 in the incoming call screen SC4, and operate the determination button 415 in the remote controller 400 illustrated in FIG. 1. Thus, a response signal is transmitted from the communication device 100 in the terminal 1000 to the communication terminal of the other user. Then, a conversation request is transmitted from the communication device 100 to the other communication terminal. The communication device 100 receives the response signal from the other communication terminal so that the user can talk with the user of the other communication terminal with a conversation partner display window W1 and a self-display window W2 in the conversation screen SC5 illustrated in FIG. 13, described below, not displayed on the monitor 301 in the television 300.
Further, the user can select the message recording response button b8 in the incoming call screen SC4, and operate the determination button 415 in the remote controller 400 illustrated in FIG. 1. In this case, the communication device 100 in the terminal 1000 executes a message recording operation, described below.
The user can select the rejection response button b9 in the incoming call screen SC4, and operate the determination button 415 in the remote controller 400 illustrated in FIG. 1. In this case, a rejection message for rejecting a conversation is transmitted from the communication device 100 in the terminal 1000 to the communication terminal of the other user.
(f) Conversation Screen
FIG. 13 illustrates a conversation screen. As illustrated in FIG. 13, the conversation partner display window W1 and the self-display window W2 are displayed on the conversation screen SC5. Video of the other user captured by a camera in the other communication terminal is displayed on the conversation partner display window W1. Video of the user captured by the camera 201 in the camera/microphone device 200 is displayed on the self-display window W2. Audio of the user of the terminal 1000 is input to the microphone 202 in the camera/microphone device 200. Audio of the other user input to a microphone in the other communication terminal is output from the speaker 302 in the television 300.
If the conversation screen SC5 is displayed on the monitor 301 in the television 300 in the terminal 1000, the conversation screen SC5 is also displayed on a monitor in the communication terminal of the other user. The video of the user of the communication terminal 1000 and the video of the user of the other communication terminal are displayed on the monitor in the communication terminal of the other user. The audio of the other user is input to the microphone in the other communication terminal. The audio of the user of the terminal 1000 is output from a speaker in the other communication terminal.
If the automatic response is set, not the incoming call screen SC4 illustrated in FIGS. 11 and 12 but the conversation screen SC5 illustrated in FIG. 13 is displayed when a conversation request is received from the other communication terminal. In the present embodiment, the conversation partner display window W1 and the self-display window W2 are not displayed on the conversation screen SC5 during the automatic response. In this case, the user can immediately talk with the user of the other communication terminal by audio without operating the video response button b6 or the voice response button b7 in the incoming call screen SC4 and the determination button 415 in the remote controller 400.
During the automatic response, the conversation partner display window W1 and the self-display window W2 may be displayed on the conversation screen SC5. In the case, the user can talk with the user of the other communication terminal by video and audio.
(5) Conversation Program
The camera/microphone device 200 includes a portable video camera for recording audio and video. In this case, the user is required to remove the portable video camera from the communication device 100 to capture a subject using the portable video camera. If the portable video camera is left while being removed from the communication device 100, the camera/microphone device 200 remains unconnected to the communication device 100.
An example of processing based on a conversation program according to an embodiment of the present invention will be described below. FIG. 14 illustrates priorities of an automatic response operation and a message recording operation performed when the automatic response is set. As illustrated in FIG. 14, the automatic response operation is given priority if the communication device 100 is in the power-on state and the camera/microphone device 200 is connected the USB interface 105 illustrated in FIG. 2. On the other hand, the message recording operation is given priority if the communication device 100 is in the standby state or the camera/microphone device 200 is not connected to the USB interface 105.
FIG. 15 is a flowchart illustrating an example of an operation of the control LSI 101 based on the conversation program according to the present embodiment. In an operation, described below, the communication device 100 is in the power-on state. The user of the terminal 1000 signs in to the conversation server 2000, or the automatic signing-in is set. Further, the incoming call permission at standby time is set to “YES”. Therefore, the conversation program is running.
The control LSI 101 illustrated in FIG. 2 accepts a conversation request from the other communication terminal. In this case, in step S1, the control LSI 101 determines whether the camera/microphone device 200 is connected to the USB interface 105 illustrated in FIG. 2. If the camera/microphone device 200 is connected to the USB interface 105 (YES in step 51), the processing proceeds to step S2. In step S2, the control LSI 101 determines whether an automatic response is set.
If the automatic response is set (YES in step S2), the processing proceeds to step S11. In step S11, the control LSI 101 displays the conversation screen SC5 illustrated in FIG. 13 on the monitor 301 in the television 300, and automatically performs a conversation operation. If a power supply switch in the television 300 is OFF, the control LSI 101 turns on the power supply switch in the television 300, and then displays the conversation screen SC5 in the monitor 301.
In the case of an automatic response using only audio, video of the user of the other communication terminal is not displayed on the conversation partner display window W1 in the conversation screen SC5 while audio of the user of the other communication terminal is output from the speaker 302 in the television 300. The video of the user of the communication device 100 is not displayed on the self-display window W2 in the conversation screen SC5. The user of the communication device 100 can immediately talk with the user of the other communication terminal by audio without performing an operation of the remote controller 400.
In the case of an automatic response using video and audio, the video of the user of the other communication terminal is displayed on the conversation partner display window W1 in the conversation screen SC5 while the audio of the user of the other communication terminal is output from the speaker 302 in the television 300. The video of the user of the communication device 100 is displayed on the self-display window W2 in the conversation screen SC5. The user of the communication device 100 can immediately talk with the user of the other communication terminal without operating the remote controller 400.
If the automatic response is not set (NO in step S2), the processing proceeds to step S3. In step S3, the control LSI 101 starts to count system clocks. In step S4, the control LSI 101 performs call processing. In the call processing, the control LSI 101 causes the buzzer 193 illustrated in FIG. 2 to generate a ringtone while causing the LED unit 192 to light up or flash, to display information (e.g., a name or a user ID) for specifying the other user on the FL display 191. Thus, the user is notified that an incoming call is received from the other communication terminal. The control LSI 101 displays the incoming call screen SC4 illustrated in FIG. 11 or 12 on the monitor 301 in the television 300.
In step S5, the control LSI 101 then determines whether the user issues a conversation response instruction. The user can issue the conversation response instruction by operating the determination button 415 in the remote controller 400 after selecting the video response button b6 or the voice response button b7 in the incoming call screen SC4. Alternatively, the user can easily issue the conversation response instruction by operating the conversation response button 413 in the remote controller 400. If the user issues the conversation response instruction (YES in step S5), the processing proceeds to step S11. In step S11, the control LSI 101 displays the conversation screen SC5 illustrated in FIG. 13 on the monitor 301 in the television 300, to perform a conversation operation.
If the user does not issue the conversation response instruction (NO in step S5), the processing proceeds to step S6. In step S6, the control LSI 101 determines whether the user issues a message recording response instruction. The user can issues the message recording response instruction by operating the determination button 415 in the remote controller 400 after selecting the message recording response button b8 in the incoming call screen SC4. The remote controller 400 may be provided with a message recording button. In this case, the user can easily issue the message recording response instruction by operating the message recording button in the remote controller 400.
If the user does not issue the message recording response instruction (NO in step S6), the processing proceeds to step S7. In step S7, the control LSI 101 determines whether the user issues a rejection response instruction. The user can issue the rejection response instruction by operating the determination button 415 in the remote controller 400 after selecting the rejection response button b9 in the incoming call screen SC4. The remote controller 400 may be provided with a rejection response button. In this case, the user can easily issue the rejection response instruction by operating the rejection response button in the remote controller 400. If the user issues the rejection response instruction (YES in step S7), the processing proceeds to step S10. In step S 10, the control LSI 101 performs a rejection response operation. In the rejection response operation, the control LSI 101 transmits a signal representing a rejection response to the other communication terminal.
If the user does not issue the rejection response instruction (NO in step S7), the processing proceeds to step S8. In step S8, the control LSI 101 determines whether a time for counting system clocks is shorter than a set time. The set time is a time set as “time to switching from incoming call to message recording” in a message recording setting item illustrated in FIG. 10. If “time to switching from incoming call to message recording” is set to “immediately after incoming call”, the control LSI 101 performs a message recording operation in step S9 without performing steps S5 to S8.
If the time for counting system clocks is shorter than the set time (YES in step S8), the processing returns to step S4. If the time for counting system clocks is the set time or more (NO in step S8), the processing proceeds to step S9. In step S9, the control LSI 101 performs a message recording operation.
If the camera/microphone device 200 is not connected to the USB interface 105 (NO in step Si), the processing proceeds to step S12. If the camera/microphone device 200 is not thus connected to the USB interface 105, the user of the communication device 100 and the user of the other communication terminal cannot talk with each other even if communication is established between the communication device 100 and the other communication terminal. Even if the automatic response is set, therefore, the automatic response operation is not performed. In this case, in step S12, the control LSI 101 causes at least one of the buzzer 193, the FL display 191, and the LED unit 192 illustrated in FIG. 2 to generate a warning that the camera/microphone device 200 is not connected. For example, the buzzer 193 generates a warning sound, the FL display 191 displays a warning, or the LED unit 192 lights up or flashes as a warning. Thus, the user of the communication device 100 can recognize that the camera/microphone device 200 is not connected to the communication device 100. In step S9, the control LSI 101 performs a message recording operation.
(6) Conversation Operation
The conversation operation of the terminal 1000 based on the conversation program stored in the memory of the control LSI 101 illustrated in FIG. 2, together with a detailed configuration of the control LSI 101, will be described.
FIG. 16 is a block diagram illustrating a detailed configuration and an operation of the control LSI 101 illustrated in FIG. 2. A connection relationship among the control LSI 101, and the camera/microphone device 200, the television 300, and the network 500 illustrated in FIG. 2 is illustrated in FIG. 16. Illustration of an interface of each connection unit is omitted.
As illustrated in FIG. 16, the control LSI 101 includes a control block 101A and a communication block 101B. The control block 101A includes a buffer 121, a decoder 122, a synthesizer 123, an encoder 124, a clock unit 125, a time applicator 126, a response extractor 127, and a controller 129. The communication block 101B includes a communication management unit 131, a receiver 132, a packetizer 133, and a transmitter 134.
In the communication block 101B in the control LSI 101, when communication is performed between the terminal 1000 and the other communication terminal, the communication management unit 131 detects an encoding method of data that can be decoded in the other communication terminal, and feeds an instruction signal for issuing an instruction to encode data for transmission in the detected encoding method to the controller 129 in the control block 101A. If video data encoded in an H. 264 format can be decoded in the other communication terminal, for example, the communication management unit 131 feeds an instruction signal for issuing an instruction to encode the video data in an H. 264 format to the controller 129. If audio data encoded in a SILK format can be decoded in the other communication terminal, the communication management unit 131 feeds an instruction signal for issuing an instruction to encode the audio data in the SILK format to the controller 129.
The other communication terminal transmits data (video data and audio data) to the terminal 1000 via the network 500. The receiver 132 in the terminal 1000 receives the data (video data and audio data) transmitted from the other communication terminal. The received data is packetized.
The receiver 132 feeds the received data to the buffer 121 in the control block 101A. The data is temporarily stored in the buffer 121. The receiver 132 feeds a reception signal indicating that the data (video data and audio data) is being received to the controller 129.
In this case, the controller 129 feeds an instruction signal for issuing an instruction to decode the data (video data and audio data) stored in the buffer 121 to the decoder 122. Thus, the decoder 122 decodes the data (video data and audio data) stored in the buffer 121.
In the following description, the video data decoded by the decoder 122 is referred to as received video data Da, and the audio data decoded by the decoder 122 is referred to as received audio data Db.
The received video data Da is fed to the synthesizer 123. Transmitted video data Dc, described below, is fed from the camera/microphone device 200 to the synthesizer 123. The synthesizer 123 synthesizes the received video data Da and the transmitted video data Dc into synthesized video data E.
The synthesizer 123 feeds the generated synthesized video data E to a D/A converter 303 in the television 300. The D/A converter 303 converts the synthesized video data E in a digital format to a synthesized video signal in an analog format. Thus, video based on the synthesized video signal (e.g., the conversation screen SC5 illustrated in FIG. 13) to be displayed on the monitor 301 in the television 300.
The received audio data Db is fed to the D/A converter 304 in the television 300. The D/A converter 304 converts the received audio data Db in a digital format to an audio signal in an analog format. The audio signal in an analog format is input to the speaker 302 via the audio volume adjuster 310. Audio based on the audio signal is output from the speaker 302.
The camera 201 in the camera/microphone device 200 acquires video. A video signal based on the acquired video is fed to an A/D converter 203. The A/D converter 203 converts the video signal in an analog format to video data in a digital format.
Audio is input to the microphone 202 in the camera/microphone device 200. An audio signal based on the input audio is fed to the A/D converter 204. The A/D converter 204 converts the audio signal in an analog format to audio data in a digital format.
In the following description, the video data after the conversion by the A/D converter 203 is referred to as transmitted video data Dc, and the audio data after the conversion by the A/D converter 204 is referred to as transmitted audio data Dd.
When the received audio data Db is fed from the communication device 100 to the television 300, the audio based on the received audio data Db is output from the speaker 302. In the camera/microphone device 200, the transmitted audio data Dd based on the input audio is generated, and is fed to the communication device 100.
During the conversation operation, when an instruction signal relating to encoding is fed from the communication management unit 131 to the controller 129, the controller 129 feeds a designation signal for designating an encoding method according to the fed instruction signal to the encoder 124. Thus, the encoder 124 encodes the transmitted video data Dc and the transmitted audio data Dd in the encoding method designated by the designation signal. The encoded transmitted video data Dc and transmitted audio data Dd are fed to the packetizer 133. The packetizer 133 packetizes the transmitted video data Dc and the transmitted audio data Dd. The packetized transmitted video data Dc and transmitted audio data Dd are transmitted from the transmitter 134 to the communication terminal of the other user via the network 500.
The functions of the controller 129 are implemented by hardware such as a central processing unit (CPU) and a memory and software such as computer programs.
The buffer 121, the decoder 122, the synthesizer 123, the encoder 124, the clock unit 125, the time applicator 126, the response extractor 127, the communication management unit 131, the receiver 132, the packetizer 133, and the transmitter 134 may be implemented by hardware such as electronic circuits, and parts of these constituent elements may be implemented by hardware such as a CPU and a memory and software such as computer programs.
(7) Message Recording Operation
The message recording operation of the terminal 1000 based on the conversation program stored in the memory of the control LSI 101 illustrated in FIG. 2, together with the detailed configuration of the control LSI 101, will be described.
FIG. 17 is a block diagram illustrating a detailed configuration and an operation of a control LSI 101 illustrated in FIG. 2. FIG. 17 illustrates a connection relationship among the control LSI 101, and the camera/microphone device 200, the television 300, and the network 500 illustrated in FIG. 2. Illustration of an interface of each connection unit is omitted.
The message recording operation includes processing for transmitting a response message, a recording-in-progress message, and a recording end message, and processing for recording a recording message (a message recording message).
The response message includes video data and audio data, and is previously recorded on the memory card 110 by the response message setting in the message recording setting item illustrated in FIG. 10. Common time information is applied to the video data and the audio data in the response message. The recording-in-progress message is information indicating that a recording message received from the other communication terminal is recorded. The recording-in-progress message is video data for displaying a mark indicating that recording is being performed, for example. A mark indicating that recording is being performed is displayed as the recording-in-progress message on the other communication terminal.
The recording end message is information indicating that recording of the recording message has ended by an elapse of a predetermined time (e.g., one minute) since the response message finished being transmitted. The recording end message is audio data for outputting a beep sound, for example. The beep sound is output from the other communication terminal when a predetermined time has elapsed since the response message finished being transmitted. The recording-in-progress message and the recording end message are previously stored in an internal memory of the controller 129.
The recording message is video data and audio data, which have been received from the other communication terminal during the message recording operation. For example, the recording message is video data corresponding to video acquired by the camera in the other communication terminal and audio data corresponding to audio acquired by the microphone in the other communication terminal. The recording message may include only the audio data.
The communication management unit 131 establishes communication between the terminal 1000 and the other communication terminal. The control unit 129 then controls the response extractor 127 to read out the response message. Thus, the response extractor 127 reads out the response message from the memory card 110, and transmits the read response message to the other communication terminal via the packetizer 133 and the transmitter 134.
The other communication terminal transmits the recording message including the video data and the audio data to the terminal 1000 when it receives the response message. The receiver 132 in the terminal 1000 receives a recording message transmitted from the other communication terminal. The receiver 132 gives the received recording message to the buffer 121. The buffer 121 temporarily stores the recording message. The decoder 122 decodes the recording message stored in the buffer 121.
The controller 129 controls the time applicator 126 to apply time information to the recording message decoded by the decoder 122. The time applicator 126 applies common time information to the video data and the audio data in the recording message based on system clocks in the clock unit 125, and records the recording message, to which the time information has been applied, on the memory card 110.
In this case, the controller 129 gives the recording-in-progress message, which has previously been stored in the internal memory, to the response extractor 127. The response extractor 127 transmits the recording-in-progress message to the other communication terminal via the packetizer 133 and the transmitter 134. After an elapse of a predetermined time, the controller 129 gives the recording end message, which has previously been stored in the internal memory, to the response extractor 127. The response extractor 127 transmits the recording end message to the other communication terminal via the packetizer 133 and the transmitter 134.
The recording message may be recorded in the flash memory 112 illustrated in FIG. 2 instead of being recorded in the memory card 110.
(8) Effects
In the communication device 100 according to the present embodiment, if the receiver 132 in the control LSI 101 receives the conversation request from the other communication terminal, the controller 129 in the control LSI 101 determines whether the camera/microphone device 200 is connected to the communication device 100. If it is determined that the camera/microphone device 200 is not connected to the communication device 100, the controller 129 performs the message recording operation. Thus, the conversation operation is prevented from being performed with the audio of the user of the communication device 100 not transmitted to the user of the other communication terminal. In this case, the user of the other communication terminal can receive the response message from the communication device 100 while transmitting the recording message to the communication device 100. As a result, even if the communication device 100 receives the conversation request from the other communication terminal with the conversation being not possible between the communication device 100 and the other communication terminal depending on a connected state of the communication device 100, the user of the other communication terminal can transmit information to the communication device 100.
The determination whether the camera/microphone device 200 is connected to the USB interface 105 in the communication device 100 is not always performed but is performed when the conversation request is accepted. Thus, power consumption in the communication device 100 is reduced.

[2] Correspondences between Elements in the Claims and Parts in Embodiments

In the following paragraphs, non-limiting examples of correspondences between various elements recited in the claims below and those described above with respect to various preferred embodiments of the present invention are explained.
In the embodiment, described above, the communication device 100 is an example of a communication device, the personal computer 600, the television 700, and the mobile phone 900 are examples of other devices, and the optical disk drive 108 is an example of a main functional unit. The transmitter 134 and the receiver 132 in the control LSI 101 are examples of a communication unit, the controller 129 in the control LSI 101 is an example of a controller, the microphone 202 is an example of an audio input device, and the speaker 302 is an example of an audio output device. Further, the camera 201 is an example of a video input device, the monitor 301 is an example of a video output device, and the optical disk is an example of a recording medium.
As each of various elements recited in the claims, various other elements having configurations or functions described in the claims can be also used.

[3] Another Embodiment

(1) While the communication device 100 includes the optical disk drive 108 as the main functional unit in the above-mentioned embodiment, the communication device 100 may include as a main functional unit another drive for driving another recording medium such as a hard disk or a memory card in place or in addition to the optical disk drive 108.
(2) While the optical disk drive 108 serving as the main functional unit of the communication device 100 is configured to record the video data and the audio data on the recording medium while reproducing the video data and the audio data from the recording medium, and the communication device 100 is the recording/reproduction device (recorder), the present invention is not limited to this. The optical disk drive 108 in the communication device 100 may be configured to reproduce video data and audio data from the recording medium, and the communication device 100 may be a reproduction device (player).
(3) The communication device may be a television receiver. In the case, the television receiver includes respective configurations of the communication device 100 and the television 300 illustrated in FIG. 2. The television receiver may or may not have the optical disk drive 108. In this case, the tuner 320 is an example of a main functional unit.
(4) While the control LSI 101 determines whether the camera/microphone device 200 is connected to the USB interface 105 when the conversation request is accepted from the other communication terminal in the above-mentioned embodiment, the present invention is not limited to this. The control LSI 101 may perform call processing when the conversation request is accepted from the other communication terminal, and determine whether the camera/microphone device 200 is connected to the USB interface 105 when the user makes a conversation response.
FIG. 18 is a flowchart illustrating another example of an operation of a control LSI 101 illustrated in FIG. 2. The control LSI 101 accepts a conversation request from the other communication terminal. In this case, in step S21, the control LSI 101 performs call processing.
In step S22, the control LSI 101 then determines whether a user issues a conversation response instruction. If the user does not issues the conversation response instruction (NO in step S22), the processing returns to step S21.
If the user issues the conversation response instruction (YES in step S22), the processing proceeds to step S23. In step S23, the control LSI 101 determines whether a camera/microphone device 200 is connected to a USB interface 105 illustrated in FIG. 2. If the camera/microphone device 200 is connected to the USB interface 105 (YES in step S23), the processing proceeds to step S24. In step S24, the control LSI 101 displays a conversation screen SC5 illustrated in FIG. 13 on a monitor 301 in a television 300, and performs a conversation operation.
If the camera/microphone device 200 is not connected to the USB interface 105 (NO in step S23), the processing proceeds to step S25. In step S25, the control LSI 101 generates a warning that the camera/microphone device 200 is not connected to the USB interface 105. In step S26, the control LSI 101 performs a message recording operation.
(5) While in the flowchart illustrated in FIG. 15, if the camera/microphone device 200 is not connected to the USB interface 105, the warning that the camera/microphone device 200 is not connected is generated in step S12, and the message recording operation is performed in step S9, the present invention is not limited to this. If the camera/microphone device 200 is not connected to the USB interface 105, the warning that the camera/microphone device 200 is not connected need not be generated but the message recording operation in step S9 may be performed. Similarly, in the flowchart illustrated in FIG. 18, if the camera/microphone device 200 is not connected to the USB interface 105, the warning that the camera/microphone device 200 is not connected need not be generated but the message recording operation in step S26 may be performed.
(6) While the control LSI 101 performs the message recording operation if the camera/microphone device 200 is not connected to the USB interface 105 in the above-mentioned embodiment, the present invention is not limited to this. If the camera 201 and the microphone 202 are separately connected to the USB interface 105, the control LSI 101 may determine whether the microphone 202 is connected to the communication device 100, to perform the message recording operation if it determines that the microphone 202 is not connected.

[4] Comprehensive Description of Communication Device and Communication Method According to Embodiment

(1) As described above, according to an embodiment of the present invention, a communication device capable of transmitting and receiving video data and audio data to and from another device and being connectable to an audio input device and an audio output device includes a communication unit configured to be capable of transmitting the video data and the audio data to the other device and receiving the video data and the audio data transmitted from the other device, and a controller that controls communication of the video data and the audio data by the communication unit, in which the controller is configured to be capable of performing a message recording operation for transmitting a response message to the other device by the communication unit while recording a recording message received from the other device by the communication unit, and determine whether the audio input device is connected to the communication device when the communication unit receives a conversation request from the other device, to perform the message recording operation when it determines that the audio input device is not connected to the communication device.
In the communication device, the communication unit transmits the video data and the audio data to the other device, and receives video data and audio data transmitted from the other device. Thus, a user of the communication device can talk with a user of the other device by audio using the audio input device and the audio output device.
If the audio input device is not connected to the communication device, the user of the other device cannot hear audio of the user of the communication device. If the communication unit receives the conversation request from the other device, the controller determines whether the audio input device is connected to the communication device. If it is determined that the audio input device is not connected to the communication device, the controller performs the message recording operation. This prevents the conversation operation from being performed with the audio of the user of the communication device not transmitted to the user of the other device. In this case, the user of the other device can accept the response message from the communication device while transmitting the recording message to the communication device.
As a result, even if the communication device receives the conversation request from the other device with the conversation being not possible between the communication device and the other device depending on the connected state of the communication device, the user of the other device can transmit the information to the communication device.
(2) The controller may generate, when it determines that the audio input device is not connected to the communication device, a warning that the audio input device is not connected.
In this case, the user of the communication device can easily recognize that the audio input device is not connected to the communication device.
(3) The communication device may be configured to be connectable to a video input device and a video output device, and the controller may be configured to determine whether the video input device is connected to the communication device when the communication unit receives the conversation request from the other device, to perform the message recording operation when it determines that the video input device is not connected to the communication device.
The video input device and the video output device are connected to the communication device so that the user of the communication device can talk with the user of the other device by the audio and the video using the video input device and the video output device. When the communication unit receives the conversation request from the other device, the user of the other device cannot see the video of the user of the communication device if the video input device is not connected to the communication device. If the communication unit receives the conversation request from the other device, the controller determines whether the video input device is connected to the communication device. If it is determined that the video input device is not connected to the communication device, the controller performs the message recording operation. This prevents the conversation operation from being performed with the video of the user of the communication device not presented to the user of the other device.
(4) The controller may be configured to be capable of performing a conversation operation for feeding to the audio output device the audio data received from the other device by the communication unit while transmitting to the other device the audio data fed from the audio input device by the communication unit, and determine, when the communication unit receives the conversation request from the other device, whether the audio input device is connected to the communication device and whether an automatic response for starting a conversation operation without the user performing an operation for a conversation response is set, to perform the conversation operation when it determines that the audio input device is connected to the communication device and the automatic response is set.
In this case, if it is determined that the audio input device is connected to the communication device and the automatic response is set, the controller automatically performs the conversation operation without the user performing the operation for the conversation response. Thus, the user of the communication device can immediately talk with the user of the other device even if the user does not know the operation for the conversation response.
(5) The communication device may further include a main functional unit that performs a main functional operation based on video data and audio data according to the control by the controller.
(6) The main functional unit may be configured to be operable to reproduce video data and audio data recorded on a recording medium.
In this case, the communication device functions as a reproduction device for the video and the audio. If the audio input device is not connected to the reproduction device and the conversation request from the other device is received, therefore, the message recording operation is performed. This prevents the conversation operation from being performed with audio of a user of the reproduction device not transmitted to the other device.
(7) The main functional unit may be configured to be operable to receive video data and audio data to be broadcast or distributed while respectively outputting the received video data and audio data as video and audio, respectively.
In this case, the communication device functions as a television receiver. If the audio input device is not connected to the television receiver, and the conversation request from the other device is received, therefore, the message recording operation is performed. This prevents the conversation operation from being performed with audio of a user of the television receiver not transmitted to the other device.
(8) The main functional unit may be configured to be operable to record video data and audio data on a recording medium while being operable to reproduce the video data and the audio data recorded on the recording medium.
In this case, the communication device functions as a recording/reproduction device for the video and the audio. If the audio input device is not connected to the recording/reproduction device, and the conversation request from the other device is received, therefore, the message recording operation is performed. This prevents the conversation operation from being performed with audio of a user of the recording/reproduction device not transmitted to the other device.
(9) According to an embodiment of the present invention, a method for operating a communication device capable of transmitting and receiving video data and audio data to and from another device and being connectable to an audio input device and an audio output device includes the steps of determining by a controller in the communication device whether the audio input device is connected to the communication device when a conversation request from the other device is received, and performing a message recording operation for transmitting a response message to the other device when it is determined that the audio input device is not connected to the communication device while recording a recording message received from the other device.
In the method for operating the communication device, the video data and the audio data are transmitted to the other device, and video data and audio data transmitted from the other device are received. Thus, a user of the communication device can talk with a user of the other device by audio using the audio input device and the audio output device.
If the audio input device is not connected to the communication device, the user of the other device cannot hear audio of the user of the communication device. If the conversation request is received from the other device, the controller determines whether the audio input device is connected to the communication device. If it is determined that the audio input device is not connected to the communication device, the controller performs the message recording operation. This prevents the conversation operation from being performed with the audio of the user of the communication device not transmitted to the user of the other device. In this case, the user of the other device can receive the response message from the communication device while transmitting the recording message to the communication device.
As a result, even if the communication device receives the conversation request from the other device with the conversation being not possible between the communication device and the other device depending on the connected state of the communication device, the user of the other device can transmit the information to the communication device.
(10) The method for operating the communication device may further include the step of generating, when it is determined that the audio input device is not connected to the communication device, a warning that the audio input device is not connected.
In this case, the user of the communication device can easily recognize that the audio input device is not connected to the communication device.
While preferred embodiments of the present invention have been described above, it is to be understood that variations and modifications will be apparent to those skilled in the art without departing the scope and spirit of the present invention. The scope of the present invention, therefore, is to be determined solely by the following claims.

Claims

1. A communication device capable of transmitting and receiving video data and audio data to and from another device and being connectable to an audio input device and an audio output device, the communication device comprising:

a communication unit configured to be capable of transmitting the video data and the audio data to said other device and receiving the video data and the audio data transmitted from said other device; and

a controller that controls communication of the video data and the audio data by said communication unit,

wherein said controller is configured to be capable of performing a message recording operation for transmitting a response message to said other device by said communication unit while recording a recording message received from said other device by said communication unit, and determine whether said audio input device is connected to said communication device when said communication unit receives a conversation request from said other device, to perform said message recording operation when it determines that said audio input device is not connected to said communication device.

2. The communication device according to claim 1, wherein said controller generates, when it determines that said audio input device is not connected to said communication device, a warning that said audio input device is not connected.

3. The communication device according to claim 1, wherein said communication device is configured to be connectable to a video input device and a video output device, and

said controller is configured to determine whether said video input device is connected to said communication device when said communication unit receives the conversation request from said other device, to perform said message recording operation when it determines that said video input device is not connected to said communication device.

4. The communication device according to claim 1, wherein

said controller is configured to be capable of performing a conversation operation for feeding to said audio output device the audio data received from said other device by said communication unit while transmitting to said other device the audio data fed from said audio input device by said communication unit, and determine, when said communication unit receives the conversation request from said other device, whether said audio input device is connected to said communication device and whether an automatic response for starting a conversation operation without a user performing an operation for a conversation response is set, to perform said conversation operation when it determines that said audio input device is connected to said communication device and said automatic response is set.

5. The communication device according to claim 1, further comprising a main functional unit that performs a main functional operation based on video data and audio data according to the control by said controller.

6. The communication device according to claim 5, wherein said main functional unit is configured to be operable to reproduce video data and audio data recorded on a recording medium.

7. The communication device according to claim 5, wherein said main functional unit is configured to be operable to receive video data and audio data to be broadcast or distributed while respectively outputting the received video data and audio data as video and audio, respectively.

8. The communication device according to claim 5, wherein said main functional unit is configured to be operable to record video data and audio data on a recording medium while being operable to reproduce the video data and the audio data recorded on said recording medium.

9. A method for operating a communication device capable of transmitting and receiving video data and audio data to and from another device and being connectable to an audio input device and an audio output device, the method comprising the steps of:

determining by a controller in said communication unit whether said audio input device is connected to said communication device when a conversation request from said other device is received; and

performing a message recording operation for transmitting a response message to said other device when it is determined that said audio input device is not connected to said communication device while recording a recording message received from said other device.

10. The method according to claim 9, further comprising the step of generating, when it is determined that said audio input device is not connected to said communication device, a warning that said audio input device is not connected.