Patent Application
20050104909
The present invention relates to a communication system, and more particularly, to a communication system used and suitable for transmitting/receiving static image data and/or dynamic image data.
In general, when voice data, hand-written data, and/or image data is to be exchanged between terminals during communication using a wireless network, to ensure effective use of a limited communication band of the network, the amount of data to be transmitted is reduced by applying a technology for compressing static image data/dynamic image data, such as JPEG or MPEG. Also, the technology described in, for example, JP10-51773, and in other documents, is known as a conventional technology relating to a method of transmitting/receiving dynamic image data smoothly between terminals by using the limited communication band of the network. This conventional technology is used to transmit image data and reduce a data size of the image data by suppressing radio-frequency components thereof when the network is congested in terms of traffic.
When a wireless network is used with a mobile telephone, a PDA (Personal Digital Assistant), or the like, in a city, it may be possible to secure t a sufficient communication bandwidth. There is also the problem that even when a technology for compressing static image data or dynamic image data is used to standards such as JPEG or MPEG, it may be difficult to transmit desired image data.
In addition, mobile telephone, PDAs, and other hand-held terminals have relatively low processing power compared to stationary terminals, e.g., personal computers (PCs). Accordingly, handheld devices are generally unable to experience problem processing a large volume of data transmitted by stationary terminals. Furthermore, when image are transmitted/received using mobile telephones or PDAs, output screen resolution (the number of vertical and/or horizontal dots that defines an output screen) may differ between the transmitting terminal and the receiving terminal. In such a case, even when users of the two terminals wish to simultaneously view the same section of image data as that being viewed at each other's terminal, the same section may not be displayed at the other terminal.
Besides, when a communication is to be conducted in real time between terminals via a wireless network, it is important that each device displays the same image. Assume, for example, that both users are talking about an entire image of a person's portrait while transmitting/receiving voice data using the respective terminals. In this example, it is preferable that although slightly unclear, the image transmitted/received should be of a state in which the entire image of the portrait can be viewed at both of the terminals. In another example, in which a specific section of an image is being discussed, the specific section of interest should be displayed on the both devices.
However,in the method according to the conventional technology described in JP Laid-open No. 10-51773, the radio-frequency components of the image are suppressed when the network becomes congested in terms of traffic. The method using the conventional technology, therefore, is problematic if a specific section of an image is not displayed due to the traffic bottleneck.
When, as described above, a communication is to be conducted in real time between the terminals connected via a wireless network, it may be difficult to communication smoothly unless the display method to be used is changed according to communication conditions or display parameters. The display parameters include a resolution (i.e., the number of vertical and/or horizontal dots that defines a display screen) of the display device of the terminal which is to receive image data during the communication and information on what section of an image the transmitting device is to transmit to the receiving device, so that the users of these devices can focus on the same section of the image.
The embodiments of the invention provide the following features:
According to the present embodiment, the above object can be achieved as follow; in a communication system for transmitting/receiving data between terminal, wherein:
According to the present embodiments, when two or more terminals each having a different number of vertical and/or horizontal dots that defines an output screen of one another's display device transmit/receive static image data or dynamic image data to/from one another, it is possible to reduce the transmission of unnecessary data and realize smooth communication.
In one embodiment, a communication terminal includes a display device configured to display an image on the display device according to image parameter; a processor to process the image data; and a communication interface to transmit or receive data, the communication interface configured to be couple to be coupled to a remote image processing device via a network. The communication terminal transmits the display parameters to the remote image processing terminal and the remote image processing device. The communication terminal receives first image data of a first image from the remote image processing device after the display parameters has been transmitted to the remote image processing device, the first image being a modified version of a first original image. The first image is modified according to the display parameters provided to the remote image processing device by the communication terminal.
In another embodiment, a communication terminal includes a display device configured to display an image on the display device according to image first display parameters; a processor to process the image data; and a communication interface to transmit or receive data, the communication interface configured to be coupled to a remote handheld communication terminal via a network. The communication terminal receives second display parameters from the handheld communication terminal, the second display information providing information on resolution and size of an image that the handheld communication terminal is configured to display on a display area of the handheld communication terminal. The communication terminal generates a first image from an original image according to the second display parameters received from the handheld communication terminal, the first image being represented by first image data. The first image data are transmitted to the handheld communication terminal.
In yet another embodiment, a method for operating a communication terminal having a display device and a processor includes transmitting display parameters of the display device to the remote image processing device to commence an image data communication operation between the communication terminal and remote image processing device; and receiving at the communication terminal first image data of a first image from the remote image processing device after the display parameters has been transmitted to the remote image processing device, the first image being a modified version of a first original image. The first is modified according to the display parameters provided to the remote image processing device by the communication terminal.
FIG 4. is a block diagram showing the software configuration of a terminal;
FIG 6 is a diagram explaining another example of a display screen configuration of a terminal;
An embodiment of a communication system according to the present invention will be described in detail below with reference to the accompanying drawings.
In
In one implementation, the transmitting terminal 101 is a personal computer and the receiving terminal 102 is a portable or handheld device. The handheld device is a device that is configured to be operated while being held on a user's hand, e.g., a mobile phone or personal digital assistant. These terminals have be other types of devices in other implementations.
In the above example, if the image data 1 is transmitted from the terminal 101 to the terminal 102 in accordance with the conventional technology, the image received at the terminal 102 will be of a size 3 larger than the size of the display region 2. As shown at the lower left end of
In the present invention, when a communication is conducted, it is explicitly indicated on the display of the transmitting terminal what section of the image data is to be transmitted during the communication. Also, the transmitting terminal considers the focused section of the image data and the size of the display device of the receiving of the terminal (i.e., the size of the image data or extracts a part thereof, and transmits the thus-processed image data. Accordingly, transmission of unnecessary data can bee prevented, which, in turn, make it possible to reduce processing loads on the terminals and thus to display only the focused image data section in a shared fashion between the terminals during the communication.
That is, in the example of
In
In the above-described embodiment of the present invention, in order to solve such a problem, the terminals first notify to each other the size of the display on the screen). Next, the device (i.e., the number of vertical and horizontal dots displayed on the screen). Next, the terminal to transmit image data conducts image data processing based on size information of the display region of the terminal to receive the image data, and then starts the transmission. Image data processing can be accomplished by reducing the size of the entire image at the transmitting terminal, by extracting a part of the image at the image at the transmitting terminal, or by using other methods. Hence, it become possible, during inter-terminal communication, to output a desired image section between terminals each having a different number of vertical and/or horizontal dots that defines an output screen of a display device. Smooth communication can thus be realized.
As shown in
The central processing unit 201 reads data from the storage device 202, processes the thus-read data, writes processed data into the storage device 202, and conducts other processes The storage device 202 retains the data read/written by the central processing unit 201. The voice input device 203 stores input voice data into the storage device 202, and the voice output device 204 outputs the voice data received from the storage device 202. The hand-written data input device 205 stores into the storage device 202 the data input by use of a pen. The display device 206 displays the data received from the central processing unit 201. The settings the data to the storage device 202. The communications control/IO device 208 receives data via a network and outputs onto the network the data the central processing unit 201 retains in the storage device 202. The bus 210 is used for the internal components of the terminal to transmit/receive data between one another. The image input device 211 output to the storage device 202 the images acquired using a means such as a camera not shown.
As shown in
The control block 301 controls the operation of the software component 302 to 311. The voice-transmitting block 302 transmits voice data, and the voice-receiving block 303 receives the voice data. The image data-receiving block 305 receives and processes the static image data or the dynamic image data. The hand-written data transmitting block 306 transmits hand-written data, and the hand-written data receiving block 307 receives and processes the hand-written data. The image acquisition block 308 acquires image data from a camera or the like. The image-processing management block 309 manages whether, on the basis of the information defining the size of the display device of the receiving terminal (i,e., the number of vertical and horizontal dots of the output screen), the transmitting terminal is to process static image data or dynamic image data before transmitting the image data. On the basis of the information defining the size of the display device of the receiving terminal (i.e., the number of vertical and horizontal dots of the output screen), the image-processing block 310 changes a data size of the static image data or dynamic image data that the transmitting terminal is to transmit. The device information management block 311 manages the number of vertical and horizontal dots for each output screen of the display device belonging to the terminal including the device information management block 311, and to the other terminal. In other words, the device information management block 311 manages the information requires for the transmitting or receiving terminal to notify to each other the information that defines the size of the display device (i.e., the number of vertical and horizontal dots of the output screen). The display control block 312 creats superimposed screen data from different types of data such as static image data or dynamic image data and hand-written data, and controls display on the display unit.
As shown in
As shown in
The table shown in
In
(1) Before starting connection, a user of a terminal which is to start communication inputs a destination, namely, an address, of another terminal with which to communicate. The destination is an IP address, a telephone number, a name, or any other data that allows the other terminal to be uniquely identified. When the destination is input, the input data relating to the other terminal is displayed on the screen and a connection request is transmitted. (Steps 801 and 802)
(2) When the communication is started and a voice session is established, the device information management block 311 is started. In accordance with the flowchart of
(3) Meanwhile, if the connection request is received either after processing in step 902 or without destination being input in step 804, that terminal determines whether talking is to be started. If talking is to be started, a voice session for transmitting/receiving voice data is established. Whether the voice session is to be arbitrarily established between the terminals can be determined, (Steps 804, 805)
(4) Talking can be ended after the establishment of the voice session or without talking being started, and if talking is to be ended, the voice session is terminated. In this case, the voice session can be terminated from either of the two terminals. (Steps 806, 807)
(5) The terminal that started the communication can determine whether a hand-writing session for transmitting/receiving hand-written data is to be stored. If hand-written data is to be transmitted/received, the hand-writing session is established. Whether the hand-writing session is to be arbitrarily established between the terminals can be determined. (Steps 808, 809)
(6) Hand-writing can be ended after the establishment of the hand-writing session or without hand-writing being started, and if hand-writing is to be ended, the hand-writing session is terminated. In this case, the hand-writing session can be terminated from either of the two terminals. (Steps 810, 811)
(7) When it also wishes to start communicating with another terminal, the terminal can start communicating with the second terminal, by clearing the destination and assigning a new destination. (Steps 812, 813)
(8) Next, it is judged whether a particular setting of an adjustment screen transmission flag for judging whether to reduce a size of the image or to extract part thereof and transmit the image data in a reduce-size format is to be changed. If the setting is to be changed, the image-processing management block 309 is started. The image-processing management block 309 can be started from either of the two terminals. (Steps 814, 815)
(9) The image-processing management block 309 transmits the image data in a processed format to a reduced-size screen (smaller screen) or the like in accordance with the flowchart of
(10) Next, it is judged whether any input image data from a camera or the like is to be transmitted to the current communication destination terminal. If image data is to be transmitted, the image acquisition block 308 is activated to start acquiring image data. (Steps 816, 817)
(11) In accordance with the flowchart of
(12) Next, it is determined whether an image size of any image retained in the temporary plane is to be changed. Whether the image size is to be changed is determined according to a state of the adjustment image transmission flag managed by the image-processing management block 309. If the adjustment image transmission flag is On, the image-processing block 310 is started. (Steps 818, 819)
(13) In accordance with flowchart of
(14) In accordance with the flowchart of
(15) If, in step 1301, the image reduction is judged necessary, it is then judged whether the image is to be processed into an image of the same resolution by extracting only a range that can be displayed, not by changing the image size. (Step 1302)
(16) If, in step 1302, it is judged that a reduced image is to be created as an image of the same resolution, the image of the same resolution is created by extracting only a range that can be displayed at the current communication destination terminal, not by changing the image size. (Step 1303) That is, a relevant portion of the entire image is selected for transmission.
(17) If, in step 1302, it is judged that a reduced image is not to be created as an image of the same resolution, an image is created with horizontal and vertical sizes reduced to fit the display device size defined in the display device information of the current communication destination terminal. Thus, the entire image can be displayed. (Step 1304)
In one implementation, the transmitting terminal automatically selects whether to perform step 1304 or 1305. Also, the user of the terminal may conduct the determination or during the start of the communication.
(18) The reduction of the image size in the above-mentioned process is followed by selection of whether the reduced image is to be compressed, and if the image is not to be compressed, processing is terminated. If the image data is to be compressed, it is compressed using an appropriate compression method. Irrespective of whether image compression has been conducted, the image data that was created during the process in step 1303 or 1304 is subsequently developed in the temporary plane. (Steps 1305, 1306, 1204)
(19) Next, it is judged whether an image-receiving request has been received from the current communication destination terminal, and if the image-receiving request has been received, the image data-receiving block 305 is started. (Steps 820, 821)
(20) In accordance with the flowchart of
(21) Whether to select an image to be displayed is judged, and if the image to be displayed is selected, whether the image selected from the images that the current communication destination terminal retains is to be displayed is then judged. If the image selected from the images that the current communication destination terminal retains is to be displayed, an image-terminal request is transmitted to the current communication destination terminal. (Steps 822 to 824)
(22) After this, the image data-receiving block 305 is started and it waits for image data to be sent from the destination terminal. The processing operation of the image data-receiving block 305 is the same as that described using the flowchart shown in
(23) If, in step 823, it is judged that the image data retained in the destination terminal is to be transmitted, an image-receiving request is transmitted to the current communication destination terminal. Next, whether image size adjustments are to be performed is judged from the display device information of the current communication destination terminal, and if image size adjustments are to be performed, the image-processing block 310 is started. The processing operation of the image-processing block 310 is the same as that described using the flowchart shown in
(24) If, in step 827, it was judged that there is no need to perform image size adjustment, or after image size adjustments were performed in step 828, the image data-transmitting block 304 is started. (Step 829)
(25) In accordance with the flowchart of
(26) Next, whether an image-transmitting request has been received is judged and if the image transmitting request has been received, image data-transmitting block 304 is started and transmits image data. The processing operation of the image data-transmitting block 304 is the same as that described using the flowchart shown in
(27) After this, whether an image-receiving request has been received is judged and if the image-receiving request has been received, image data-receiving block 305 is started and receives the image data. The processing operation of the image data-receiving block 305 is the same as that described using the flowchart shown in
(28) Next, whether a voice session has been established is judged, and if the voice session has been established, the voice-transmitting block 302 and the voice-receiving block 303 are started. (Steps 834, 835)
(29) In accordance with the flowchart of
(30) Whether the next voice data to be acquired is present is judged and if the voice data is not present, the transmitting process is ended. If the next voice data is present, control is returned to step 1601, in which voice data is then acquired once again and packetized. The process of transmitting voice data is continued in this manner. (Step 1605)
(31) In accordance with the flowchart of
(32) Whether the next voice data to be received is present is judged and if the voice data is not present, the receiving process is ended. If the next voice data to be received is present, control is returned to step 1701, in which packetized encoded voice data is then received once again. The voice data output is continued in this manner. (Step 1705)
(33) Whether the voice session is to be terminated is judged and if the session is to be terminated, processing in both the voice-transmitting block 302 and the voice-receiving bock 303 is brought to an end. (Steps 836, 837)
(34) Next, whether a hand-writing session is established is judged and if the hand-writing session is established, the hand-written data transmitting block 306 and the hand-written data receiving block 307 are started. (Steps 838, 839)
(35) In accordance with the flowchart of
(36) If, after processing in step 1804 or during the judgment in step 1801, hand-written data has not been present, whether the next hand-written data to be acquired is further judged. If the next hand-written data is not present, this transmitting process is ended. If the next hand-written data is present, control is returned to step 1801, in which hand-written data is then acquired once again. The process of transmitting hand-written data is continued in this manner. (Step 1805)
(37) In accordance with the flowchart of
(38) If, after processing in step 1903 or during the judgment in step 1901, hand-written data has not been present, whether the next hand-written data to received is further judged. If the next hand-written data to be received is not present, this process is ended. If the next hand-written data to be received is present, control is returned to step 1901, from which the process of receiving hand-written data is continued once again. (Step 1904)
(39) Whether the hand-writing session is to be terminated is judged and if the session is to be terminated, processing both the hand-written data transmitting block 306 and the hand-written data receiving block 307 is brought to an end. (steps 840, 841)
(40) Next, the display control block 312 is started. In accordance with the flowchart of
During processing in the above-described embodiment of the present invention, when image data is reduced in size in accordance with size information on the output display screen of the receiving terminal (i.e., the number of vertical and horizontal display dots of the output screen) and then transmitted, the transmitting terminal can also update hand-written data coordinates according to a particular image data reduction ratio and transmit the updated hand-written data. The same section of an image can thus be indicated between terminals each different in the number of vertical and horizontal dots that defines the output screen of the display screen.
By executing above-described processing with a terminal, it becomes possible, during real-time and hand-written data) and static image data or dynamic image data to/from two or more terminals each different in the number of vertical and/or horizontal dots that defines an output screen of a display device of the terminal, to transmit/receive information on a size of a display device of a communication destination terminal (i.e., the number of vertical and horizontal display dots of an output screen) prior to the communication. Accordingly, for example if the number of vertical and horizontal dots of the screen of the display device in the communication destination terminal differs from that of the transmitting terminal, it becomes possible to reduce the transmission of unnecessary data and thus to realize smooth communication, by transmitting image data in reduced-size form or partly extracted form.
Processing in the above-described embodiment of the present invention can be constructed as a processing program, and this processing program can be supplied in the form where it is stored in/on a recording medium such as HD, DAT, FD, MO, DVD-ROM, or CD-ROM. The processing program can also be supplied via a communication medium such as the Internet or any other appropriate communication network.
The present invention has been described in terms of specific embodiments. These specific embodiments may be amended, modified, or altered without departing from the scope of the present invention. Accordingly, the scope of the present invention should be interpreted using the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2003-355359 | Oct 2003 | JP | national |
The present application claims priority to Japanese Patent Application No. 2003-355359, filed on Oct. 15, 2003.
