Patent Grant
9742987
This application claims the benefit of Japanese Application No. 2014-103544 in Japan on May 19, 2014, the contents of which are incorporated by this reference.
Field of the Invention
The present invention relates to an image pickup display apparatus that is capable of displaying an image from a separated image pickup unit, an image pickup display method, and a recording medium.
Description of Related Art
In recent years, mobile devices with a photographing function (photographing devices) such as digital cameras have become common. Some of such photographing devices have a display section and a function for displaying a photographed image on the display section. In addition, some of them display a menu screen on a display section to facilitate the operation of the photographing devices. Such a display section is commonly provided on a rear surface of a photographing device main body, and a user is able to perform a photographing operation while checking a through image displayed on the display section on the rear surface at the time of photographing.
In addition, in recent years, a lens-style camera, which does not have a display section for displaying a picked-up image but only has functions of photographing and recording, has sometimes been employed. A lens-style camera of this type is generally attached to a smartphone, a tablet PC, or the like, and photographing is controlled by using the smartphone, tablet PC, or the like to which the lens-style camera is attached as a control device. In addition, the control device such as a smartphone, tablet PC, or the like also functions as an image pickup display apparatus that displays a picked-up image from the lens-style camera.
Such a lens-style camera is attachable to and detachable from a smartphone, tablet PC, or the like, and is capable of photographing also in a state detached from the smartphone, tablet PC, or the like. In this case, the control device such as the smartphone, tablet PC, or the like is connected to the lens-style camera by wireless or wire communication, and the photographing operation of the lens-style camera is possible by using a touch panel, etc., provided on the display section.
Japanese Patent Application Laid-Open Publication No. 2012-185692 proposes a technique for connecting such a smartphone, tablet PC, or the like to a mobile computer apparatus, etc., by wire or wireless connection, and allowing the smartphone, tablet PC or the like to act for a function of a mouse which is input means for the computer apparatus.
Note that the lens-style camera is used in a state attached to the image pickup display apparatus that displays a picked-up image from the lens-style camera (attached state) in some cases, and used in a state detached from the image pickup display apparatus (non-attached state) in other cases, and it is considered that the usage patterns of the lens-style camera are significantly different in the attached state and in the non-attached state.
An image pickup display apparatus according to the present invention includes: a communication section that is capable of receiving a picked-up image from an image pickup unit; a display section that displays the picked-up image received by the communication section; an operation section for controlling image pickup by the image pickup unit; a state determination section that determines a state of a case in which the communication section, the display section and the operation section are housed; and a control section that receives a result of determination performed by the state determination section, to change a user interface provided by the display section and the operation section based on whether or not the case is arranged on another object. In some example embodiments, the state determination section determines that the case is arranged on the other object when an operation surface of the operation section is fixed so as to face upward. In some such embodiments, the state determination section determines that the case is arranged on the other object when vibration of the operation surface of the operation section in a vertical direction is smaller than a predetermined threshold.
Further, an image pickup display method according to the present invention includes: receiving, by a communication section, a picked-up image from an image pickup unit; displaying, by a display section, the picked-up image received by the communication section; determining, by a state determination section, a state of a case in which an operation section for controlling image pickup by the image pickup unit, the communication section, and the display section are housed; and receiving a result of determination performed by the state determination section, to change a user interface provided by the display section and the operation section, by a control section, based on whether or not the case is arranged on another object.
Furthermore, a non-transitory computer readable recording medium according to the present invention which stores a program for causing a computer to execute procedures of receiving, by a communication section, a picked-up image from an image pickup unit; displaying, by a display section, the picked-up image received by the communication section, determining a state of a case in which an operation section for controlling image pickup by the image pickup unit, the communication section, and the display section are housed; and changing a user interface provided by the display section and the operation section based on whether or not the case is arranged on another object.
The above and other objects, features and advantages of the invention will become more clearly understood from the following description referring to the accompanying drawings.
Hereinafter, detailed description will be made on embodiments of the present invention with reference to drawings.
In
The image pickup unit 10 includes an image pickup device not shown. An image pickup control section 12 is configured to receive a control signal from the image pickup display apparatus 20 through the communication section 11, and to be able to control image pickup to be performed by the image pickup device. The communication section 11 is configured to be able to transmit a picked-up image obtained by the image pickup device to the communication section 21.
The image pickup display apparatus 20 includes an image pickup device not shown. An image pickup control section 22 is configured to be able to control image pickup by the image pickup device in the image pickup display apparatus 20. The image pickup display apparatus 20 includes a display section 23. The display section 23 is controlled by the control section 25, to display a picked-up image, a menu, and the like.
The control section 25 is capable of controlling image pickup performed by the image pickup unit 10 through the communication section 21, 11. In addition, the control section 25 performs predetermined image processing on the picked-up image transferred from the image pickup unit 10 through the communication sections 11 and 21, and thereafter can send the picked-up image subjected to the image processing to the display section 23 to cause the display section to display the picked-up image.
The image pickup display apparatus 20 is provided with an operation section 24. The operation section 24 can be configured by switches, buttons, and the like, not shown, for example, and outputs an operation signal based on a user operation performed on the operation section 24 to the control section 25. In addition, a touch panel, not shown, provided on a display screen of the display section 23 may be employed as the operation section 24.
The touch panel can generate an operation signal corresponding to a position which is pointed by the user with a finger on the display screen of the display section 23. The operation signal is supplied to the control section 25. Thus, when the user touches on or slides the display screen, the control section 25 is capable of detecting various operations, for example, the position touched by the user, operation for closing and then spreading two fingers (pinch operation), the sliding operation, the position reached by the sliding operation, the sliding direction, a period during which the user touches the display screen, etc., and capable of performing processing corresponding to the user operation. For example, touch operation enables various photographing operations in the image pickup unit 10 to be performed.
In the present embodiment, the image pickup display apparatus 20 includes a state determination section 26. The state determination section 26 can determine the state of the image pickup display apparatus 20 itself. For example, the state determination section 26 is capable of determining whether the image pickup display apparatus 20 is placed on a table or the like (placed state) or held by the user with a hand (held state). The state determination section 26 is configured by an acceleration sensor, a gyro sensor, or the like, for example, and capable of determining whether the image pickup display apparatus 20 is in the placed state or the held state based on the detection result obtained by any of these sensors.
In addition, the state determination section 26 may be configured to be able to determine the state of the image pickup unit 10. For example, the state determination section 26 determines whether the image pickup unit 10 is in a state disposed on a tripod stand, etc. (hereinafter, referred to as stationary state) or in a state held by the user with the hand (hereinafter, referred to as camera-held state), based on a picked-up image from the image pickup unit 10. For example, the state determination section 26 is capable of determining the stationary state and the camera-held state based on the movements of the respective image portions in the picked-up image from the image pickup unit 10.
Note that the state determination section 26 may determine the placed state and the held state of the image pickup display apparatus 20 based on the picked-up image obtained with the image pickup device of the image pickup display apparatus 20, and may determine the stationary state and the camera-held state of the image pickup unit 10 by using the detection signal from the acceleration sensor, the gyro sensor, or the like provided in the image pickup unit 10.
Furthermore, the state determination section 26 is configured to be able to determine whether the image pickup unit 10 is in a state attached to the image pickup display apparatus 20 (attached state) or in a state detached from the image pickup display apparatus 20 (non-attached state). These determination results by the state determination section 26 are supplied to the control section 25.
In accordance with the determination result by the state determination section 26, the control section 25 changes control for the display on the display section 23 and the operation signal corresponding to the display which is transmitted from the operation section 24, that is, a graphical user interface.
Next, the working in the embodiment thus configured will be described with reference to
The control section 25 of the image pickup display apparatus 20 controls the image pickup control section 12 of the image pickup unit 10 through the communication sections 21 and 11. The image pickup control section 12 is controlled by the control section 25 to drive the image pickup device of the image pickup unit 10. The picked-up image obtained by image pickup performed by the image pickup device is imported into the image pickup display apparatus 20 through the communication sections 11 and 21. The control section 25 of the image pickup display apparatus 20 performs predetermined signal processing on the imported picked-up image, and thereafter sends the image subjected to the predetermined signal processing to the display section 23 to cause the display section to display a through image.
The user can perform photographing operation while referring to the through image displayed on the display section 23. The control section 25 causes the display section 23 to perform operation display for photographing operation and the like. In this case, the control section 25 causes the display section to perform operation display according to the state determination result by the state determination section 26. The state determination section 26 determines at least one of the states of the image pickup display apparatus 20 and the image pickup unit 10, to output a state determination result to the control section 25.
For example, the state determination section 26 determines whether or not the image pickup display apparatus 20 and the image pickup unit 10 are separated from each other in step S1 in
When the user touches on the play button 35a, the mode button 35b, or the photographing button 35c, the control section 25 causes the image pickup display apparatus 20 to shift to a play mode, a mode setting mode, or a photographing mode.
When the image pickup unit 10 is attached to the image pickup display apparatus 20, it is expected that the user usually holds the case 20a with both hands, and as shown in the example in
The state determination section 26 determines whether or not the operation surface of the image pickup display apparatus (device) 20 faces upward and fixed in an up/down direction. For example, when the image pickup display apparatus 20 is placed substantially horizontally on an object according to the gravitational force, determination is made on whether the image pickup display apparatus 20 is placed such that the operation surface (touch surface) faces in the direction opposite to the direction of the gravitational force. In the case where the image pickup display apparatus 20 is not fixed, for example, in the case where the user holds the image pickup display apparatus 20 with the left hand and holds the image pickup unit 10 with the right hand, the processing procedure proceeds from the step S2 to step S4, and the control section 25 performs display and control based on an operation pattern 2. Note that the expression “fixed” is used in the above description. However, it may be determined that the image pickup display apparatus is in the fixed state, if the screen faces in a constant direction and is not likely to vibrate in the direction. That is, the image pickup display apparatus is not necessarily fixed in fact. In addition, the above-described state can be called also as “on-the-desk placement”, but a board on which the image pickup display apparatus is placed is not limited to a desk. The same operation can be performed also on the user's lap, and depending on a situation, the case where the user abuts the device on the wall and uses the device while sliding the device on the wall is also included in the above-described state. Even when the user uses the device in the above-described way, the wall functions as a support, which allows the user to use the device easily in some cases. The above-described way of using can be described as “on-the-surface shift arrangement”, or “arranging on another object”. That is, the state determination section 26 determines whether or not the image pickup display apparatus 20 is fixed to some extent on a surface of an object by the gravitational force, a pressing force of some sort, or the like, and the touch operation or the like on the operation surface is possible.
When the user touches on the photographing button 36a, the magnify button 36b, or the reduce button 36c, the control section 25 causes the image pickup display apparatus 20 to shift to a photographing mode, a magnify mode, or a reduce mode.
In the case of this display form, it is expected that the user usually holds the case 20a with one hand and holds the image pickup unit 10 with the other hand, and performs the touch operation only with the finger 41L of the left hand, for example, as shown in the example in
It is now supposed that the image pickup display apparatus 20 is placed on a table in the state where the image pickup unit 10 is detached. In this case, the processing procedure proceeds from the step S2 to step S5. The control section 25 of the image pickup display apparatus 20 performs display and control based on an operation pattern 3.
When the user touches on the zoom button 37a, the exposure button 37b, the focus button 37c, the photographing button 37d, or the play button 37e, the control section 25 causes the image pickup display apparatus 20 to shift to a zoom mode, an exposure mode, a focus mode, a photographing mode, or a play mode.
In the case of this display form, it is expected that the user usually holds the image pickup unit 10 with one hand and places the image pickup display apparatus 20 on a table, and the user performs the touch operation with one hand, for example, with the fingers 42L, 43L or the like of the left hand, as shown in the example in the
In addition, since the slide operation with the fingers is relatively easy in this case, a slide bar 44 is also displayed on the display screen 23a. The user performs the slide operation in the up/down direction shown with the arrow 45, thereby capable of setting various kinds of values.
When the control section 25 detects an operation for the display according to each of the operation patterns 1 to 3, the control section 25 performs photographing control according to the operation (step S7).
Note that the user interfaces shown in
In addition, the flowchart shown in the above-described
For example,
The example shown in
The example in
Thus, in the present embodiment, a different user interface can be provided depending on the state of at least one of the image pickup display apparatus 20 and the image pickup unit 10, and the user can perform operation suitable for each of the states.
For example, when the image pickup unit 10 and the image pickup display apparatus 20 are used in a state separated from each other, the image pickup unit and the image pickup display apparatus can be used in a manner different from that in the case where the image pickup unit and the image pickup display apparatus are unified, and there are situations where effective photographing is possible by using the separated image pickup unit 10. For example, when an image of a dish is photographed, it is sometimes effective to photograph the dish not only from the front side but also from the opposite side toward the front side. The separated image pickup unit 10 can be used for photographing in such a situation. In this case, it is expected that the user holds the image pickup unit 10 such as a lens-style camera with one hand, and operates a tablet PC or the like as the image pickup display apparatus 20 with the other hand. However, if the user holds the image pickup display apparatus 20, the user has to hold the image pickup display apparatus and perform operation simultaneously with one hand, which results in unstable operation. Therefore, in such a case, it is more advantageous to use the image pickup display apparatus 20 in the state placed on a table or the like. In such a case, the present embodiment can provide a user interface which enables operation suitable for the placed state. This makes it relatively easy to operate the operation section 24 of the image pickup display apparatus 20, which allows the user to concentrate on other photographing operations such as setting of a composition. As a result, the user can perform stable photographing operation.
In
As shown in
The lens-style camera 51 is provided with an image pickup section 52 having an optical system 52a. The image pickup section 52 is provided with an image pickup device, not shown, configured by a CCD, a CMOS sensor, or the like, and an object image is guided onto an image pickup surface of the image pickup device by the optical system 52a. The optical system 52a includes, in a lens barrel 51a, a focus lens which is movable for setting a focus (focusing) state by focusing, and a zoom lens whose power is varied in the focus state. In addition, the optical system 52a includes a mechanical portion, not shown, which drives these lenses and a diaphragm. A control section 53 is configured to control the mechanical portion of the optical system 52a to drive the focus lens, zoom lens and diaphragm.
The lens-style camera 51 is provided with an operation section 54 such as an operation ring 54a for performing setting operation of parameters for photographing by a user, for example, parameters related to focusing, zooming and diaphragm. The control section 53 detects the user operation performed on the operation section 54, to perform control based on a result of the detection. The control section 53 is configured by a CPU and the like, and controls the respective sections of the lens-style camera 51 based on the user operation performed on the operation section 54 and a signal from the smartphone 61 to be described later.
A photographing control section 53a generates a focus signal, a zoom signal, and a diaphragm control signal, to drive and control the focusing, zooming and diaphragm of the optical system 52a. In addition, the photographing control section 53a supplies a driving signal to the image pickup device to control the image pickup of the object.
An image processing section 53b receives a picked-up image from the image pickup device, and performs predetermined image signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various kinds of signal processing on the picked-up image, and thereafter sends the image subjected to the image signal processing to a recording section 56 and enables the recording section to record the image. As the recording section 56, an IC memory can be employed, for example. In addition, the image processing section 53b is configured to be able to transfer the picked-up image to the smartphone 61 through the communication section 55.
The communication section 55 can communicate with the camera communication section 62 provided in the smartphone 61 through a predetermined transmission channel. As the transmission channel, various wired and wireless transmission channels, for example, a USB (Universal Serial Bus) cable, a transmission channel for wireless LAN such as Wifi (Wireless Fidelity) can be employed. When communication is established between the lens-style camera 51 and the smartphone 61, the control section 53 is able to control the photographing in accordance with the control section 65 of the smartphone 61 and transfer the picked-up image and information related to the lens to the smartphone 61.
In the present embodiment, the lens-style camera 51 is provided with a posture determination section 57. The posture determination section 57 is configured by a three-axis acceleration sensor, a gyro sensor, or the like, and sends information such as the posture, rotation angle, etc., of the lens-style camera 51 to the control section 53. Note that the posture determination section 57 may use a geomagnetic sensor together with the above-described sensor. The control section 53 is configured to be able to transmit the information (posture determination result) from the posture determination section 57 to the smartphone 61 through the communication section 55.
The smartphone 61 includes a built-in camera section 63. The built-in camera section 63 includes an image pickup device, not shown, which is configured by a CCD, a CMOS sensor, or the like, and configured such that the optical image of the object entered through a lens 63a (see
The control section 65 of the smartphone 61 is configured by a processor such as a CPU, for example, and controls the respective sections of the smartphone 61. The control section 65 controls the built-in camera section 63 and outputs a signal for driving the image pickup section 52 of the lens-style camera 51. The control section 65 receives a picked-up image from the built-in camera section 63, and also receives a picked-up image from the lens-style camera 51. The control section 65 performs predetermined signal processing, for example, color adjustment processing, matrix conversion processing, noise removal processing, and other various kinds of signal processing on the picked-up image from the built-in camera section 63 and the picked-up image received from the lens-style camera 51.
The smartphone 61 is also provided with an operation section 66. The operation section 66 is configured by various kinds of operation sections such as switches, keys, software keyboard, or the like, which are not shown, provided to the smartphone 61, and configured to generate an operation signal based on a user operation, and output the generated operation signal to the control section 65. The control section 65 controls the respective sections based on the operation signal.
The control section 65 is capable of performing processing related to recording and playing of the picked-up image. For example, the control section 65 is capable of performing compression processing on the picked-up image subjected to the signal processing, transmitting the compressed image to a recording section 64, and causing the recording section to record the image. As the recording section 64, various kinds of recording media such as an IC memory can be employed, and the recording section 64 is capable of recording image information, voice information, and the like in the recording medium.
A display control section 67 performs various kinds of processing related to display. The display control section 67 receives the picked-up image subjected to the signal processing from the control section 65, and is capable of sending the received image to a display section 68. The display section 68 has a display screen such as an LCD, and displays the image received from the display control section 67. Furthermore, the display control section 67 is capable of causing the display section 68 to display various menus on the display screen. The control section 65 is capable of reading the picked-up image recorded in the recording section 64 and performing expansion processing on the read picked-up image. The display control section 67 sends the picked-up image subjected to the expansion processing to the display section 68, thereby capable of playing the recorded image.
Also a touch panel, not shown, is provided as the operation section 66 on the display screen of the display section 68. The touch panel is capable of generating an operation signal corresponding to a position on the display screen indicated by the user with a finger. The operation signal is supplied to the control section 65. Thus, when the user touches on or slides the display screen, the control section 65 is capable of detecting various operations, for example, the position touched by the user, operation for closing and spreading two fingers (pinch operation), the sliding operation, the position reached by the sliding operation, the sliding direction, a period during which the user touches the display screen, etc., and capable of performing processing corresponding to the user operation.
Note that the display section 68 is disposed so as to cover the substantially entire area of the operation surface of the smartphone 61, for example, and the user is capable of checking the picked-up image displayed on the display screen of the display section 68 at the time of photographing with the lens-style camera 51, and performing photographing operation while checking the picked-up image.
Furthermore, in the present embodiment, the smartphone 61 includes a posture determination section 69. The posture determination section 69 is configured by a three-axis acceleration sensor, a gyro sensor, or the like, and sends information on the posture of the smartphone 61 to the control section 65. Note that, the posture determination section 69 may use a geomagnetic sensor together with the above-described sensor.
The control section 65 is configured to change the operation interface based on at least one of the information (posture determination result) from the posture determination section 69 and the information on the posture determination result of the lens-style camera 51 received from the lens-style camera 51 through the camera communication section 62. That is, in the present embodiment, the graphical user interface provided by the display section 68 and the operation section 66 configured by the touch panel is controlled so as to be changed according to at least one of the states of the lens-style camera 51 and the smartphone 61, based on the determination result from the posture determination sections 57 and 69.
Next, description will be made on the working of the present embodiment thus configured, with reference to
The control section 53 of the lens-style camera 51 determines whether or not the power source is turned on in step S31. When the power source is turned on, the control section 53 determines whether or not the photographing mode is specified (step S32). When the photographing mode is specified, the control section 53 controls the image pickup section 52 to cause the image pickup section to pick up an image of an object. The picked-up image obtained by the image pickup section 52 is imported by the control section 53 and a through image is obtained (step S33). In addition, the control section 53 obtains the posture determination result by the posture determination section 57, for example, the determination result of vibration in step S34.
On the other hand, the control section 65 of the smartphone 61 determines whether or not a camera cooperative mode is specified in step S11. When the camera cooperative mode is specified, the control section 65 communicates with the lens-style camera 51 and generates a request for receiving a through image from the lens-style camera 15 in step S12.
Upon receiving the request for the through image from the smartphone 61, the control section 53 of the lens-style camera 51 establishes communication in step S35, and thereafter transmits the through image to the smartphone 61 through the communication section 15 (step S36). The control section 65 of the smartphone 61 receives the through image from the lens-style camera 51, sends the received through image to the display control section 27 to cause the through image to be displayed in step S14.
Next, the control section 65 determines at least one of the states of the smartphone 61 and the lens-style camera 51 in order to provide a graphical user interface optimal for the photographing operation. For example, the control section 65 causes the built-in camera section 63 to be activated and performs vibration determination using the output from the posture determination section 69 in step S15. Next, in step S16, the control section 65 detects whether or not an image of a lens barrel constituting the lens-style camera 51 is included in the picked-up image from the built-in camera section 63. When the lens barrel image is included, the control section 65 determines that the lens-style camera 51 is in the attached state, and sets the operation pattern 1 (step S17).
Furthermore, when the barrel image is not included in the picked-up image, the control section 65 cannot determine whether or not the lens-style camera 51 is in the attached state based only on the picked-up image from the built-in camera section 63. Therefore, the control section 65 performs communication for connection determination with respect to the lens-style camera 51 in step S18. Also the lens-style camera 51 performs communication for connection determination in step S37.
The control section 53 of the lens-style camera 51 determines whether or not a request for connection determination communication is generated in step S51 in
On the other hand, the control section 65 of the smartphone 61 determines a presence or absence of the camera communication between the smartphone 61 and the lens-style camera 51 in step S61 in
The control section 53 of the lens-style camera 51 determines whether or not the request for the image characteristics has been generated in step S54 in
When receiving the information on the image characteristics from the lens-style camera 51, the control section 65 determines similarity between the received information on the image characteristics and information on image characteristics acquired from the picked-up image obtained with the built-in camera section 63. When the information on these image characteristics are similar to each other, the control section 65 determines that the field of view of the lens-style camera 51 is similar to that of the built-in camera section 63, and the lens-style camera 51 is connected to the case 61a of the smartphone 61 (step S64). When determining that there is no similarity in the shake patterns and in the image characteristics, the control section 65 determines that the lens-style camera 51 is not connected to the case 61a of the smartphone 61.
When determining the connection in the step S19 in
In the operation pattern 1 in the step S17 in
In the step S73 and step S74, the control section 65 determines whether or not the lens-style camera 51 is in the stationary state. When determining that the smartphone 61 is in the hand-held state and the lens-style camera is also in the hand-held state, the control section 65 shifts the processing to step S75. In this case, since both hands of the user are occupied for holding the smartphone and the lens-style camera, the control section 65 sets the operation pattern 2 shown in
When determining that the smartphone 61 in the hand-held state and the lens-style camera is in the stationary state, the control section 65 shifts the processing to step S76. In this case, since only one hand of the user is occupied for holding the smartphone, operation of the smartphone 61 using all the fingers of the other hand which does not hold the smartphone 61 is possible, and the control section 65 sets the user interface suitable for the operation.
In addition, when determining that the smartphone 61 is in the placed state and the lens-style camera is in the hand-held state, the control section 65 shifts the processing to step S77. In this case, since one hand of the user is occupied for holding the lens-style camera, the control section 65 sets the operation pattern 3 shown in
Furthermore, when determining that the smartphone 61 is in the placed state and also the lens-style camera is in the stationary state, the control section 65 shifts the processing to step S78. In this case, since both hands of the user are not occupied for holding the smartphone and the lens-style camera, operation of the smartphone 61 using all the fingers of both hands is possible, and the control section 65 sets the user interface suitable for the operation.
In the step S21 in
The control section 53 of the lens-style camera 51 also determines whether or not the instruction for photographing has been given by operating the operation section 54 of the lens-style camera 51 (step S42). When the instruction for photographing is given by the operation section 54, the control section 53 performs photographing in step S43, and then causes the recording section 56, for example, to record the picked-up image (step S44).
Next, as an example of use in the present embodiment, description will be made on an example in which a dish is photographed with reference to
The user 94 can check the through image displayed on the display screen 68a of the smartphone 61 while moving the right hand 95R which holds the lens-style camera 51. The user 94 tries to determine the composition by appropriately moving the right hand 95R while checking the through image. The arrow in
As shown in
That is, the examples shown in
In step S71 in
When the input mode is not selected, the control section 65 displays, in step S72, a mode switch (SW) for selecting the input mode.
When the user touches on the photographing button 102 or the play button 103 with a finger 107, the control section 65 instructs the lens-style camera 51 to perform photographing or playing. In addition, when the user touches on the default button 105 or the keyboard button 106 with the finger 107, the control section 65 sets the interface to the default mode or the keyboard mode.
When the user selects the default button 105 with the finger 107, the control section 65 shifts the processing from the step S73 to the step S74, to set the default mode. In this case, the display and operation control shown in
The user interface shown in
The user can specify the control mode of the camera operation through keyboard input using the finger 107. The setting performed by the user is shown in a setting display section 114. The example shown in
Such a keyboard input operation using a software keyboard is an input method suitable for a tablet PC or a smartphone. In addition, the user has only to perform operation on the smartphone 61 placed on the table 91, which allows the control mode to be specified relatively easy. In the method of selecting a control mode from a menu display constituted of a plurality of hierarchies to decide the control mode, if the mode to be selected is set in a deep hierarchy, for example, the mode specifying operation by the user is relatively cumbersome in some cases. Even in such a case, in the example shown in
When the input mode is decided, the control section 65 shifts the processing to step S81 to detect presence or absence of button operation. When the user operates various buttons other than the key display 112 with the finger 107, the control section 65 shifts the processing to step S82 to perform control corresponding to the button operation. For example, when the user touches the position of the exposure button 37b in
On the other hand, when the user touches the key display 112, the control section 65 shifts the processing from step S83 to step S84, to determine the control mode according to the key input operation by the user (step S84). As shown in
In the photographing method shown in
When the rotation mode is set according to the button operation or the key input operation, the control section 65 shifts the processing from step S85 to step S86, to determine the initial position of the smartphone 61. Next, the control section 65 determines the rotation of the smartphone 61 to calculate the rotation angle.
For example, in the state where the user touches the position of the setting display section 114 with the finger 107a as shown in
When a predetermined period elapses from the state displaying the image as shown in
The present embodiment is thus capable of detecting the states of the lens-style camera and the smartphone, and providing the user interface suitable for at least one of the states. Such a configuration improves the operability, and the user can photograph an object in a desired composition with a simple operation. When the lens-style camera and the smartphone are used in the state separated from each other, in particular, the photographer does not have to move in accordance with the position of the lens-style camera. The photographer can capture the object in various compositions, and easily perform photographing operation by placing the smartphone on the table, and the like. Thus, if there are two devices to be operated with two hands of a human being, it is considered that there are various cases such as a case where the two devices are operated with both hands, respectively, a case where one of the devices is operated with both hands or with one hand, etc. However, there is not known a technique for controlling the devices by taking the states of the devices in the above-described cases into full consideration. According to the present invention, it is possible to surely achieve a simple operation using an optimal operation method under various situations. That is, according to the present invention, it is possible to detect the respective states such as holding state or placed-on-the-desk state of the two cooperative devices which are used by a user who operates the devices generally with two hands, by using the shaking determination function or the posture determination function provided to each of the devices, decide an operation optimal to the devices depending on the respective usage states of the devices, control the display, determine the operation, and perform control of simple and convenient cooperation of the devices. The present invention effectively uses the touch panel and display control of the devices.
Furthermore, in each of the embodiments of the present invention, description has been made by taking the digital camera as an example of the device for photographing. However, it is needless to say that the camera may be a lens-style camera, a digital single-lens reflex camera, a compact digital camera, a camera for moving picture such as a video camera and a movie camera, and also may be a camera built in a mobile information terminal (PDA: Personal Digital Assist) such as a mobile phone and a smartphone. Furthermore, the camera may be an industrial or medical optical device such as an endoscope and a microscope, or a monitoring camera, a car-mounted camera, or a stationary camera, for example, a camera attached to a television, a personal computer, or the like. It is needless to say that the present invention can be applied to an observation apparatus and an inspection apparatus which observe various objects from various angles. When inspection or observation is performed, it is more convenient if a plurality of devices can be mechanically connected or separated, or a way of holding the devices can be changed, depending on an object to be observed or inspected. Therefore, the present invention can be utilized in wide variety of fields.
The present invention is not limited to each of the embodiments as it is, but can be embodied by modifying constituent elements in the practical stage within a range without departing from the gist of the invention. Furthermore, various inventions can be formed by appropriately combining the plurality of constituent elements disclosed in each of the embodiments. For example, among all of the constituent elements shown in the embodiments, some constituent elements may be removed. Furthermore, the constituent elements from different embodiments may be appropriately combined.
Note that, in the claims, specification, and working flows in the drawings, even if description was made by using the expressions “first”, “next” and the like, for convenience sake, it does not mean that processing steps have to be executed in this order. In addition, needless to say, each of the steps constituting the working flow may be appropriately omitted regarding the part which does not affect the essential part of the invention.
In addition, among the techniques described above, many of the controls and functions described mainly in the flowcharts can be set by a program, and the above-described controls and functions can be executed by reading and executing the program by a computer. The entirety or a part of such a program can be recorded or stored as a computer program product in a portable medium such as a flexible disk, CD-ROM and a nonvolatile memory, or a storage medium such as a hard disk and a volatile memory, and can be distributed or provided at the time of product shipment or through a portable medium or telecommunications line. A user can easily use the image pickup display apparatus and display method according to the embodiments by downloading the program through a communication network to install the program into a computer, or by installing the program from a recording medium into a computer.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2014-103544 | May 2014 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20130178245 | Kulas | Jul 2013 | A1 |
| 20130203462 | Tahk | Aug 2013 | A1 |
| 20150334306 | Sato | Nov 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 2012-185692 | Sep 2012 | JP |
| Number | Date | Country | |
|---|---|---|---|
| 20150334306 A1 | Nov 2015 | US |
