(1) Field of the Invention
The present invention relates to an information processing device, and specifically to playback of a moving image during a communication performed by the information processing device.
(2) Description of the Related Art
In recent years, increased number of people have viewed moving images on mobile phones. A problem in such a viewing is that, when the mobile phone receives an incoming signal while the user is viewing a moving image displayed on the display thereof, the mobile phone displays, on the display, information indicating the detection of the incoming signal, instead of the moving image. This prevents the user from viewing the moving image. Also, typically, the user puts the mobile phone to an ear when he/she performs a conversation. This also prevents the user from viewing the moving image since he/she cannot see the display. Also, since the priority is given to the voice of the conversation over the sound of the moving image, the sound of the moving image is not output.
There is known a technology aimed to solve the problem and enable the user to perform a conversation while viewing the moving image. According to this technology, when an incoming signal is received, the input/output of the audio is automatically changed such that the voice of the conversation is output to an external device, such as an earphone, connected to the mobile phone, and the voice of the user is picked up by a microphone connected to the mobile phone.
However, according to this technology, the user is required to carry the earphone and microphone always so that any time the mobile phone receives a conversation request, the user can perform a conversation while viewing the moving image. This impairs the mobility of the mobile phone since the user is required to carry devices such as the earphone and microphone, as well as the mobile phone.
According to one aspect of the present invention, for achieving the above object, there is provided an information processing device with a function to transmit and receive signal to/from another device, comprising: a display unit for displaying an image; a projection unit for projecting an image; and a control unit for, when a predetermined signal is received from the other device while the display unit is displaying a first image in accordance with an image data, causing the projection unit to project a second image in accordance with the image data.
In the above recitation, the first image is an image displayed by the display unit, and the second image is an image projected by the projection unit. Also, the other device is present outside the information processing device.
According to another aspect of the present invention, for achieving the above object, there is provided an information processing device with a function to transmit and receive signal to/from another device, comprising: a display unit for displaying an image; a projection unit for projecting an image; and a control unit for, when a predetermined signal is received from the other device while the display unit is displaying a first image in accordance with an image data, and when a predetermined instruction is further detected, causing the projection unit to project a second image in accordance with the image data.
Here, the predetermined instruction is, for example: an instruction for projecting an image, where the instruction is issued by a certain operation of the user; an instruction that is issued when a sensor senses an object; or an instruction regarding the direction of the projection of image.
According to still another aspect of the present invention, for achieving the above object, there is provided A projection program which is read into a computer of an information processing device having a function to transmit and receive signal to/from another device, the projection program indicating a processing procedure comprising the steps of: displaying an image; and projecting an image, wherein a second image is projected in accordance with an image data when a predetermined signal is received from the other device while a first image is being displayed in accordance with the image data.
These and the other objects, advantages and features of the invention will become apparent from the following description thereof taken in conjunction with the accompanying drawings which illustrate a specific embodiment of the invention.
In the drawings:
The following describes a mobile phone as a preferred embodiment of an information processing device of the present invention, with reference to the attached drawings.
As shown in
As shown in
The communication unit 110 includes an antenna 111, and has a function to demodulate a reception signal received with the antenna 111 into a reception audio signal and a reception data signal, and output the reception audio signal and the reception data signal to the audio processing unit 130 and 170, respectively. The communication unit 110 has a function to modulate a transmission audio signal generated by the audio processing unit 130 through an A/D (Analog to Digital) conversion, an output the modulated signal from the antenna 111, and a function to modulate a transmission data signal representing an electronic mail or the like, received from the control unit 170, an output the modulated signal from the antenna 111.
The operation unit 120 includes a key group that includes a numeric keypad, an on hook key, an off hook key, direction keys, a determination key, a mail key and the like. The operation unit 120 has a function to receive an operation of the user, and convey an instruction indicated by the received operation to the control unit 170.
The audio processing unit 130 has a function to perform a D/A (Digital to Analog) conversion onto the reception audio signal output from the communication unit 110, and output the conversion result to the speaker 132, and has a function to perform an A/D conversion onto the transmission audio signal obtained from the microphone 131, and output the conversion result signal to the communication unit 110.
The display unit 140 includes the display 141 that may be achieved by an LCD (Liquid Crystal Display). The display unit 140 has a function to display an image on the display 141 in accordance with an instruction by the control unit 170. More specifically, the display unit 140 displays a standby screen, text of a mail, time or the like. The display unit 140 also displays a moving image onto the display 141 in accordance with an instruction by the control unit 170.
The projection unit 150 has a function to project an image outward in accordance with an instruction by the control unit 170. In recent years, small-sized projectors have been developed. In view of this, a projector is adopted in the present embodiment.
The storage unit 160 includes a ROM (Read Only Memory) and a RAM (Random Access Memory), and may be achieved by a small hard disk, a nonvolatile memory and the like. The storage unit 160 has a function to store music data, image data and the like, as well as various types of data or program required for operating the mobile phone 100.
The control unit 170 has a function to control the other units constituting the mobile phone 100. In the present invention, the control unit 170 includes a judgment unit 171. The judgment unit 171, when the display unit 140 is displaying a moving image onto the display 141, judges whether or not an incoming signal has been received and further judges whether or not a received incoming signal is a conversation request. When the judgment unit 171 judges that a received incoming signal is a conversation request, the control unit 170 causes the projection unit 150 to project the moving image that is currently displayed on the display 141 of the display unit 140.
Here, the operation of the mobile phone 100 in the present embodiment will be described with reference to the flowcharts shown in
First, the operation to be performed when the mobile phone 100 receives an incoming signal while the user is viewing a moving image displayed on the display 141 will be described. The mobile phone 100 is playing back and displaying a moving image onto the display 141 (step S401). The control unit 170 judges whether or not an incoming signal has been received via the communication unit 110 (step S403). When it is judged that no incoming signal has been received (NO in step S403), the control unit 170 causes the moving image to be kept displayed on the display 141 (step S401).
When it is judged that an incoming signal has been received (YES in step S403), the control unit 170 stops displaying the moving image onto the display 141, and judges whether or not the received incoming signal is a conversation request (step S405). When it is judged that the received incoming signal is not a conversation request (NO in step S405), the control unit 170 resumes displaying the moving image on the display 141 (step S401). It should be noted here that an incoming signal other than a conversation request is, for example, a mail.
When it is judged that the received incoming signal is a conversation request (YES in step S405), the control unit 170 instructs the projection unit 150 to activate the projector (step S407). After the projector is ready for projection, the control unit 170 causes the projection unit 150 to project the moving image starting with a position at which the playback stopped due to the reception of the incoming signal (step S409). The control unit 170 obtains a playback elapsed time which indicates a time period for which the playback continued until it was stopped due to the reception of the incoming signal. The control unit 170 transfers, to the projection unit 150, the moving image data from a position that corresponds to the obtained playback elapsed time. The conversation is started as the conversation button is pressed (step S411). This ends the process of this flowchart. It should be noted here that the projection of the moving image ends as the conversation ends, and the moving image having been projected is displayed on the display 141.
Next, the operation of the mobile phone 100 during the projection will be described with reference to
The mobile phone 100 is projecting a moving image outward (step S501). The control unit 170 of the mobile phone 100 judges whether or not the human presence sensor 105 has sensed an object, namely, whether or not the human presence sensor 105 has detected a presence of a human being (step S503). In this judgment, when the human presence sensor 105 is, for example, an infrared sensor, the sensor judges whether or not there is any thing that has a temperature within a predetermined range, namely, a body temperature of a human being.
Unless the human presence sensor 105 senses an object (NO in step S503), the projector of the mobile phone 100 keeps on projecting the moving image. When the human presence sensor 105 has sensed an object (YES in step S503), the control unit 170 of the mobile phone 100 instructs the projection unit 150 to stop the projection. Upon receiving the instruction, the projection unit 150 stops projecting the moving image (step S505). While the projection is stopped, the control unit 170 judges whether or not the human presence sensor 105 has ceased to sense the object (step S507). The control unit 170 keeps on causing the projection unit 150 to stop projecting the moving image unless the human presence sensor 105 ceases to sense the object (step S505).
When the human presence sensor 105 has ceased to sense the object (YES in step 5507), the control unit 170 instructs the projection unit 150 to resume projecting the moving image. Upon receiving the instruction, the projection unit 150 resumes projecting the moving image starting with a position where a presence of a human being was sensed and the projection of the moving image was stopped (step S501).
With this structure, for example, when there is a person in the direction of the projection, the presence of the person is detected, and the projection of the moving image is stopped. The structure thus prevents passersby from being annoyed by the projection when the image is projected outdoors.
Up to now, the operation of the mobile phone 100 in Embodiment 1 has been described. As described above, when a conversation request is received while a moving image is being displayed on the display 141, the moving image being displayed on the display 141 can be projected outward of the device by the projector. This is one of the characteristics of Embodiment 1. Since the mobile phone 100 projects the moving image using the projector that is provided in the device itself, the user needs not carry any equipment such as a microphone or an earphone. Also, even if the user receives a conversation request while he/she is viewing a moving image, the user can keep on viewing the moving image while having a conversation, and thus the user does not fail to view a scene.
In the above-described Embodiment 1, when a phone call is received while a moving image is displayed on the display 141, the moving image is projected. To be described in the present embodiment is an operation to be performed when the mobile phone 100 receives a TV phone call, not a mere phone call, while it is displaying a moving image.
The functional structure of the mobile phone 100 in Embodiment 2 is almost the same as that of the mobile phone 100 in Embodiment 1. The following shows the structural difference from Embodiment 1, which is required to achieve the operation unique to Embodiment 2.
The judgment unit 171 of the mobile phone 100 has, in addition to the function explained in Embodiment 1, a function to judge whether an incoming signal is a conversation request or a TV phone request. This judgment is made based on information contained in the received signal, where the information indicates whether the signal is a conversation request or a TV phone request.
Also, when a TV phone request is received while a moving image is displayed on the display 141, the control unit 170 transfers, to the projection unit 150, both of two types of data: data of a moving image transmitted from the partner of the TV phone communication; and data of the moving image having been displayed on the display 141. The control unit 170 also has a function to instruct the projection unit 150 to project the two types of moving images.
The projection unit 150 has a function to, based on an instruction from the control unit 170, project the two different moving images through the projector lens 152 respectively into two split regions of the projected screen.
As shown in
When it is judged that an incoming signal has been received (YES in step S803), the control unit 170 stops displaying the moving image onto the display 141, and judges whether or not the received incoming signal is a conversation request (step S805). When it is judged that the received incoming signal is not a conversation request but a mail or the like (NO in step S805), the control unit 170 resumes displaying the moving image on the display 141 (step S801).
When it is judged that the received incoming signal is a conversation request (YES in step S805), the control unit 170 instructs the projection unit 150 to activate the projector (step S807). The judgment unit 171 judges whether or not the conversation request is a TV phone request (step S809). Here, the judgment unit 171 makes the judgment based on a difference in the header of the received signal. When it is judged that the conversation request is not a TV phone request (NO in step S809), the control unit 170 instructs the projection unit 150 to project the moving image having been displayed on the display 141, and the projection unit 150 projects the moving image in accordance with the instruction. In this case, the projection unit 150 projects the moving image through the projector lens 151, for example, as shown in
When it is judged that the conversation request is a TV phone request (YES in step S809), the control unit 170 instructs the projection unit 150 to project both the moving image having been displayed on the display 141 and the moving image of the partner of the TV phone communication. The control unit 170 transfers, to the projection unit 150, data of the moving image of the partner of the TV phone communication and data of the moving image having been displayed on the display 141. The projection unit 150 projects the moving image having been displayed on the display 141 in a moving image region 701, which is an upper region of the projected screen, and projects the moving image of the communication partner that is transmitted from the communication partner, in a partner image region 702 that is a lower region of the projected screen, for example, as shown in
The conversation or the TV phone communication is started as the conversation button is pressed by the user (step S813). This ends the process of this flowchart. It should be noted here that the projection of the moving image(s) ends as the conversation or the TV phone communication ends, and the moving image having been projected in the moving image region 701 is displayed on the display 141.
Up to now, the operation of the mobile phone 100 in Embodiment 2 has been described. As described above, when a TV phone request is received while a moving image is being displayed on the display 141, the moving image transmitted from the partner of the TV phone communication and the moving image having been displayed on the display 141 are projected into two split regions of the projected screen, respectively. This is one of the characteristics of Embodiment 2. This enables the user to view the moving image while checking on the facial expression of partner of the TV phone communication, with ease, eliminating the need of the user to be busy in switching between viewing the partner on the display and viewing the projected moving image.
In the above-described Embodiments 1 and 2, when a phone call or a TV phone call is received while the user is viewing a moving image displayed on the display 141, the mobile phone 100 projects the moving image having been displayed on the display 141. In such a case, when the mobile phone 100 receives a phone call or a TV phone call, the mobile phone 100 displays information indicating reception of the phone call or TV phone call on the display 141, and while the information is displayed on the display 141, the moving image is not displayed on the display 141. Also, it takes time (although it is slight) before a projector has been activated. This causes a time lag to the start of projecting a moving image. In such cases, the user might miss an important scene when the moving image displayed on the display 141 is a TV broadcast image or a streaming image. The present embodiment discloses a technology for avoiding such problems from occurring.
The functional structure of the mobile phone 100 in Embodiment 3 is almost the same as that of the mobile phone 100 in Embodiment 1. The following will describe only the differences from Embodiment 1, omitting overlapping explanations.
The mobile phone 100 has, in addition to the functions explained in Embodiment 1, a function to receive TV broadcast moving image data or streaming moving image data, via the communication unit 110.
Also, the control unit 170 has, in addition to the functions explained in Embodiment 1, a function to record the received TV broadcast data or streaming data into the storage unit 160. The control unit 170 also has a function to cause the display unit 140 to display, or the projection unit 150 to project, the recorded data in a time-shift playback.
The mobile phone 100 is receiving and playing back TV broadcast data onto the display 141 (step S901). The control unit 170 judges whether or not an incoming signal has been received via the communication unit 110 (step S903). When it is judged that no incoming signal has been received (NO in step S903), the control unit 170 causes the TV broadcast data to be kept displayed on the display 141 (step S901).
When it is judged that an incoming signal has been received (YES in step S903), the control unit 170 stops displaying the TV broadcast data onto the display 141, and starts recording the TV broadcast data (step S905). The control unit 170 then judges whether or not the received incoming signal is a conversation request (step S907). When it is judged that the received incoming signal is not a conversation request (NO -in step S907), the control unit 170 stops recording the TV broadcast data. It should be noted here that an incoming signal other than a conversation request is, for example, a mail. After this, the control unit 170 discards the recorded TV broadcast data (step S908), and resumes playing back the TV broadcast data onto the display 141.
When it is judged that the received incoming signal is a conversation request (YES in step S907), the control unit 170 instructs the projection unit 150 to activate the projector (step S909). After the projector is ready for projection, the control unit 170 causes the projection unit 150 to project the TV broadcast data starting with a position at which the playback stopped due to the reception of the incoming signal (step S911). The conversation is started as the conversation button is pressed (step S913). This ends the process of this flow chart. It should be noted here that the projection of the TV broadcast data ends as the conversation ends, and a continuation of the TV broadcast data having been projected is displayed on the display 141.
Up to now, the operation of the mobile phone 100 in Embodiment 3 has been described. As described above, when a conversation request is received while a moving image of one segment TV broadcast or streaming is being displayed on the display 141, the moving image data can be recorded. This is one of the characteristics of Embodiment 3. With this structure where the received moving image data is recorded, it is possible to prevent the user from missing an important scene due to a time lag that occurs when a display of moving image data is switched to a projection thereof.
Up to now, mobile phones as preferred embodiments of the present invention have been described. However, the present invention is not limited to these embodiments. The following describes some examples of modifications to the embodiments.
Further, when the projector lens is provided in the hinge as is the case with Embodiment 2, the hinge may be provided with a motor such that the motor rotates the projector. With this structure, compared with the case where the projector adjusts the projection angle only by a slight amount, it is possible to adjust the projection angle by a large amount.
Alternatively, the mobile phone 100 may not detect the illuminance using an illuminance sensor, but may merely control the lighting devices in the room so that the surrounding environment becomes dark.
Still further, the projected screen maybe split into three or more regions such that the moving image having been displayed on the display is projected into one of the regions, and the moving image transmitted from the partner of the TV phone communication is projected into one of the remaining regions.
For example, the user may be able to set, as a piece of menu setting information by using a GUI (Graphical User Interface), ON or OFF with respect to whether a moving image should be projected when a conversation request is received while the moving image is being displayed. Further, the moving image may be projected when a conversation request is received while the moving image is being displayed, only when the setting information has been set to ON.
Alternatively, when a conversation request is received while the moving image is being displayed, a GUI may be displayed to ask the user whether the moving image should be projected. And then the moving image is projected when the user, on the GUI, inputs a selection to do so.
Although the present invention has been fully described by way of examples with reference to the accompanying drawings, it is to be noted that various changes and modifications will be apparent to those skilled in the art. Therefore, unless such changes and modifications depart from the scope of the present invention, they should be construed as being included therein.
Number | Date | Country | Kind |
---|---|---|---|
2007-051450 | Mar 2007 | JP | national |