1. Technical Field
The present invention relates to an imaging apparatus for adding location information to an image.
2. Background Art
In recent years, there is disclosed a camera which is equipped with a GPS receiver for receiving radio waves from a GPS (Global Positioning System) satellite, in which location information (longitude, latitude, altitude, time and the like) calculated based on the radio waves received by the GPS receiver from the GPS satellite is added to the image data of the captured image, and the resultant image data is stored (for example, see Patent Literature 1). The GPS receiver equipped in the camera receives the radio waves from the GPS satellite at each predetermined time.
In a camera using a battery as the source of power supply, a large amount of power is required when the GPS receiver is continuously operated using the camera battery as the source of power supply in order to receive radio waves from the GPS satellite at each predetermined time, and therefore, the battery life is shortened.
Furthermore, there is a problem that when the power supply to the GPS receiver is stopped at times other than image capture and power supply to the GPS receiver is started during image capture in order to suppress the consumption of power, some time is required for the GPS receiver to capture the radio waves from the GPS satellite, and therefore, if image capture is prioritized, the location information is not added to the image data, and if the capturing of radio waves is prioritized, the image-capture timing is missed. It is noted that the time required by the GPS receiver to capture radio waves from the GPS satellite is generally 30 seconds or more when the past history is not retained in the camera (startup from power OFF: Cold start), and approximately five seconds when the past history is retained in the camera (startup from the low power consumption mode, which is the minimum required power consumption: Hot start).
An object of the present invention is to provide an imaging apparatus capable of precisely adding location information to image data without missing an image-capture timing.
An imaging apparatus of the present invention is an imaging apparatus provided with: an imaging unit including an imaging sensor for imaging light from an object and a storage unit for storing image data generated based on an imaging signal output from the imaging sensor; and a GPS module for executing a process of calculating location information based on received data from a satellite, in which as a result of the imaging unit shifting from a low power consumption mode or a power OFF state to a normal image-capture mode, the GPS module shifts from the low power consumption mode or the power OFF state to a normal operation mode in which the process of calculating the location information is executed, and if it is not possible to perform the process of calculating the location information at the time of imaging the light from an object in the GPS module at a time point at which the light from an object is imaged after the imaging unit has been shifted to the normal image-capture mode, then imaging-time location information obtained in consideration of at least one of pre-image-capture location information already acquired at a time point before the time of imaging and post-image-capture location information calculated at a time point after the time of imaging is added to the image data and stored in the storage unit, and calculation technique information indicating in which technique the image-capture-time location information has been obtained is also added to the image data and stored in the storage unit.
It is noted that the low power consumption mode is a state where a normal image-capture mode or a normal operation mode is shifted to a state where the minimum required power consumption is achieved when a state in which an operation such as image capture is not performed in the imaging apparatus or a state in which no signal is input from an external device such as a cable release continues for a predetermined time or longer set beforehand. Furthermore, the normal image-capture mode is a state where an operation such as image capture can be performed promptly in the imaging apparatus, and the normal operation mode is a state where the satellite is captured by the GPS module and a process of calculating the location information is performed based on the data received from the satellite. The returning from the low power consumption mode to the normal image-capture mode and normal operation mode is executed when a release button is pressed, for example.
According to an imaging apparatus of the present invention, as a result of the imaging unit shifting from a low power consumption mode or a power OFF state to a normal image-capture mode, the GPS module shifts, in conjunction with the imaging unit, from the low power consumption mode or the power OFF state to a normal operation mode in which a process of calculating location information is executed. In other words, because a power supply unit of the GPS module operates in conjunction with a power supply unit of the imaging unit, the GPS module also is switched to a low power consumption mode when the imaging unit is switched to the low power consumption mode. Thus, the power consumption of the imaging apparatus can be suppressed.
Furthermore, when the imaging unit images the light from an object, even if the process of calculating location information at the time of imaging the light from an object cannot be performed in the GPS module, image data to which imaging-time location information that is based on at least one of location information already calculated before imaging light from an object and location information to be calculated after imaging the light from an object is added is stored in the storage unit. That is, the location information calculated by the GPS module on a date and time closest to a date and time of the imaging time is added. Furthermore, if the location information calculated by the GPS module within a predetermined time from the imaging time is not available, then location information that is estimated based on time information obtained at the imaging time, at least two location information items calculated either before or after imaging the light from an object in the GPS module, and time information obtained when each of the location information is calculated, is added. Therefore, the location information obtained at the time of imaging can be added precisely to the image data without missing the image-capture timing.
Hereinafter, an electronic camera (imaging apparatus) according to a first embodiment of the present invention will be explained with reference to drawings.
As illustrated in
An imaging sensor 6 is constituted by a CCD, CMOS, and the like, and outputs an imaging signal (analog signal as an accumulated charge), which is obtained by imaging light from an object passing through a photographic lens (not illustrated), to an A/D converter circuit 8. The imaging signal output from the imaging sensor 6 is converted to a digital signal from the analog signal after the execution of a gain adjustment process and the like in the A/D converter circuit 8, and is transmitted to the image processing circuit 10.
An image processing circuit 10 performs an image process such as white balance adjustment, sharpness adjustment, gamma correction, and gray level adjustment on the image data of the digital signal output from the A/D converter circuit 8. Furthermore, the image processing circuit 10 performs a compression process and the like, if necessary, for compressing to comply with a predetermined compression format. The image data on which the image process has been executed is temporarily stored in a storage unit 11 in a predetermined format such as Exif (Exchangeable image file format) along with an image-capture date and time (date and time information output from a timer device built in the electronic camera 2), exposure, shutter second time, and other information relating to image capture.
A recording medium (storage unit) 12 possesses the portability to be detachably mounted to a card slot (not illustrated) provided in the electronic camera 2, and examples of the recording medium 12 may include a CF card, an SD card, and smart media. In the recording medium 12, the image data which is read from the storage unit 11 by the control unit 4 and to which the imaging-time location information is added is recorded.
A display drive circuit 14 is a circuit for driving an image display unit 16 under the control of the control device 4. On the image display unit 16, an image recorded in the recording medium 12 or a live view image (through image) that is a real time image from the imaging sensor 6 can be displayed. On the image display unit 16, image-capture information and information relating to an operation performed by an operation unit 18 described later, such as a menu (selection item) can also be displayed. Here, the image-capture information includes an image-capture condition (for example, a value of shutter second time and an aperture value).
The operation unit 18 is configured by various switches, buttons, dials, and keys provided at the top or back of a main body of the electronic camera 2, for manually inputting an instruction by a user. Specifically, a power supply dial for switching ON/OFF a power supply, a release button for instructing image capture or the like, a menu button for displaying a menu or the like on the image display unit 16, a cross key for selecting the menu item or the like and for moving a cursor or the like, and a deciding button (OK button) are provided. It is noted that the imaging sensor 6, the A/D converter circuit 8, the image processing circuit 10, the storage unit 11, the recording medium 12, the display drive circuit 14, the image display unit 16, and the operation unit 18 configure the imaging unit of the electronic camera 2.
The power supply circuit 20 supplies power to each unit (each configuration that requires power, including the control device 4) configuring the electronic camera 2 under the control of the control device 4. Furthermore, the power supply circuit 20 selectively switches between a low power consumption mode and a normal image-capture mode, described later, under the control of the control device 4.
The GPS module 22 receives a radio signal from a plurality of GPS satellites orbiting the globe, and performs a process of calculating the location information including a latitude, a longitude, an altitude, and a time relating to a current location of the GPS module 22, based on a trajectory and time data (received data) of the GPS satellite included in the received radio signal. The GPS module 22 of this embodiment is an external device electrically connectable to the electronic camera 2, and although the GPS module 22 is configured to be detachable to the electronic camera 2, the GPS module 22 of the present invention can also be configured to be built inside the electronic camera 2. While the GPS module 22 is connected to the electronic camera 2, the power supply circuit 20 supplies power to the GPS module 22 under the control of the control device 4 configuring the electronic camera 2. Furthermore, during the normal operation mode described later, the GPS module 22 performs the process of calculating the location information at each predetermined timing set beforehand.
The control device 4 operates in association with the power supply circuit 20 and the operation unit 18 to shift from the normal image-capture mode to the low power consumption mode, and from the low power consumption mode to the normal image-capture mode. That is, in the normal image-capture mode, which is a power consumption state in which an operation such as image capture can be performed promptly, the control device 4 outputs to the power supply circuit 20 a control signal instructing transition to the lower power consumption mode that requires less power consumption than the normal image-capture mode, i.e., a minimum required power consumption state, when no operation signal is received from the operation unit 18 for a predetermined time or longer set beforehand. The power supply circuit 20 switches from the normal image-capture mode to the low power consumption mode in accordance with the control signal output from the control device 4.
On the other hand, if any operation signal is received from the operation unit 18 (for example, when the release button is pressed) in the low power consumption mode, the control device 4 outputs a control signal instructing transition from the low power consumption mode to the normal image-capture mode, to the power supply circuit 20. The power supply circuit 20 switches from the low power consumption mode to the normal image-capture mode in accordance with the control signal output from the control device 4.
The power is supplied to the GPS module 22 by the power supply circuit 20 in conjunction with the power supply to each unit of the electronic camera 2 according to the control signals from the control device 4. That is, in conjunction with the power supply to each unit of the electronic camera 2 being switched from the low power consumption mode to the normal image-capture mode and from the normal image-capture mode to the low power consumption mode, the power supply to the GPS module 22 also switches from the low power consumption mode to the normal operation mode and from the normal operation mode to the low power consumption mode. The GPS module 22 receives the radio signal from the GPS satellite only during the normal operation mode, and does not receive the radio signal from the GPS satellite during the low power consumption mode. It is noted that when the power supply state is switched from the power OFF to the power ON, the electronic camera 2 shifts to the normal image-capture mode and the power supply circuit 20 starts supplying power to each unit of the electronic camera 2. Also, at this time, the power supply circuit 20 starts supplying power to the GPS module 22 in order to operate the GPS module 22 in the normal operation mode.
Next, a process for adding the imaging-time location information to the image data at the time of imaging in the electronic camera 2 according to the first embodiment is described by using a flowchart shown in
First of all, when the electronic camera 2 shifts from the power OFF state to the power ON state, the electronic camera 2 shifts to the normal image-capture mode, and the control device 4 supplies power used in the normal image-capture mode to each unit of the electronic camera 2 and to the GPS module 22, via the power supply circuit 20. On the other hand, in the low power consumption mode, the power is supplied to each unit of the electronic camera 2 and to the GPS module 22, and if any operation signal is received from the operation unit 18, then the electronic camera 2 shifts to the normal image-capture mode, and the control device 4 supplies power used in the normal image-capture mode to each unit of the electronic camera 2 and to the GPS module 22 via the power supply circuit 20 (step S10). Here, due to the transition of the electronic camera 2 to the normal image-capture mode, the GPS module 22 shifts to the normal operation mode and starts capturing the radio wave from the GPS satellite in order to perform the process of calculating the location information.
Next, when the user performs image capture (step S11), the control device 4 stores the image data that is based on the imaging signal obtained at the time of imaging in the storage unit 11 via the image processing circuit 10 (step S12). Following this, the control device 4 acquires the location information (hereinafter, referred to as “imaging-time location information”) at the time of the image capture in step S11 (at the time of imaging by the imaging sensor 6) from the GPS module 22 (step S13).
That is, when the process of calculating the location information obtained at the time of imaging is performed in real time in the GPS module 22 at the time of imaging by the imaging sensor 6, the control device 4 adds the location information at the time of imaging, as the imaging-time location information, to the image data stored in step S12 (step S14). Next, the control device 4 stores the image data to which the imaging-time location information has been added in step S14, in the recording medium 12 (step S15).
Generally, when a past history (location information calculated in the past) is not retained in the GPS module 22 (startup from power OFF: Cold start), 30 seconds or more are required to receive the radio wave from the GPS satellite and then calculate the location information; and when the past history (location information calculated in the past) is retained in the GPS module 22 (startup from the low power consumption mode which is the minimum required power consumption: Hot start), approximately five seconds are required. Therefore, at the time of imaging by the imaging sensor 6, it may not be possible to calculate the location information obtained at the time of imaging in the GPS module 22. For example, as illustrated in
However, if the period t2 shown in
It is noted that the above-mentioned predetermined period depends on a displacement speed of the user, and the predetermined period is set long when the displacement speed is slow and is set short when the displacement speed is fast. For example, the following may be arranged: the predetermined period is set for each transportation means such as walking, bicycle, train, car, and airplane, and is stored in a storage device (not illustrated) inside the control device 4, which is followed by making the stored period readable according to types of transportation means being input through a user operation.
Further, together with the imaging-time location information, information indicating the method of calculating the imaging-time location information may be added to the image data as information of a mark visually recognizable on a display monitor (image display unit 16). In the embodiment, together with the imaging-time location information, if the location information for time T0 is added as the imaging-time location information, then a specific mark (for example, an “imaging-time GPS” mark) indicating the same is added to the image data as tag data, for example; if the above-mentioned first location information is added as the imaging-time location information, then a specific mark (for example, a “pre-imaging GPS” mark) indicating the same is added thereto for the same purpose; and if the above-mentioned second location information is added as the imaging-time location information, then a specific mark (for example, a “post-imaging GPS” mark) indicating the same is added thereto for the same purpose.
When the image based on the image data is displayed on the image display unit 16, if each mark is superimposed on the images and displayed, together with the imaging-time location information, as GPS information, on the image display unit 16, then the user can confirm the method of calculating the imaging-time location information, together with the imaging-time location information. As a result of understanding the calculation method, the user may prevent him/herself from being confused in various cases such as when the user arranges an image based on the GPS information added to the image data, or when the user estimates a location from the GPS information added to the image data in order to perform image capture from the same location.
According to the electronic camera 2 of the first embodiment, even if, at the time of imaging, the process of calculating the location information obtained at the time of imaging cannot be performed in the GPS module 22, the location information already calculated before the imaging or the location information calculated after the imaging is added as the imaging-time location information to the image data. Therefore, the location information at the time of imaging can be added precisely to the image data without missing the image-capture timing.
It is noted that in the electronic camera 2 according to the first embodiment, if the GPS module 22 cannot capture the radio waves during and after the imaging because the user is positioned at a place where the radio waves of the GPS satellite cannot be captured, for example, the first location information may be added to the image data as the imaging-time location information.
Next, an electronic camera according to a second embodiment of the present invention is explained with reference to drawings. The configuration of the electronic camera 2 according to the second embodiment is identical to that of the electronic camera 2 according to the first embodiment, and therefore such description will not be repeated. Further, in the electronic camera according to the second embodiment, reference numerals used in the configuration of the electronic camera 2 according to the first embodiment will be used for the description.
For example, as illustrated in
Specifically, first of all, the control device 4 acquires displacement speed information that has been stored in a storage device (not illustrated) inside the control device 4. Here, as described earlier, the displacement speed information is a displacement speed of respective transportation means such as walking, bicycle, train, car, and airplane, and the displacement speed of each transportation means is stored beforehand in the storage device. In this embodiment, for example, the configuration is such that the user can selectively input the transportation means used during a time from time T1 to time T2 on the menu screen displayed on the image display unit 16 of the electronic camera 2. The control device 4 acquires the transportation means input by the user via the operation unit 18, and then, the control device 4 acquires the displacement speed information from the acquired transportation means.
Next, the control device 4 uses the acquired displacement speed information to perform estimation of the imaging-time location information based on the first location information, the second location information, and the date and time (time information) obtained when each of the location information is calculated.
It is noted that if a high-speed train or an airplane is used as the transportation means, for example, the estimated location at time T0 lacks accuracy if the periods t1 and t2 illustrated in
The control device 4 adds the location information obtained by the estimation as the imaging-time location information to the image data (records in association with the image data), and stores the image data to which the imaging-time location information has been added, in the recording medium 12. It is noted that if the configuration is such that information added by the control device 4 to the image data also includes information indicating that the imaging-time location information, which has been added to the image data, is the location information calculated by the estimation, then identification is facilitated in the event that the user subsequently arranges the image data. Furthermore, similar to the first embodiment, the information showing the method of calculating the imaging-time location information (for example, an “estimated GPS” mark) may be added, together with the imaging-time location information, to the image data, as the tag data, for example.
According to the electronic camera of the second embodiment, even if the process of calculating the location information at the time of imaging cannot be performed in the GPS module 22 at the time of imaging, the location information obtained by the estimation based on the location information already calculated before the imaging, the location information calculated after the imaging, and the time information obtained when each of the location information is calculated is added to the image data as the imaging-time location information. Therefore, the location information at the time of imaging can be added precisely to the image data without missing the image-capture timing.
Furthermore, according to the electronic camera of each of the above embodiments, when the electronic camera shifts from the low power consumption mode or the power OFF state, to the normal image-capture mode, the GPS module operates in conjunction with the electronic camera and shifts from the low power consumption mode or the power OFF state to the normal operation mode in which the process of calculating the location information is executed. That is, since the power supply circuit of the electronic camera controls the power of the GPS module, the GPS module also switches to the low power consumption mode when the electronic camera switches to the low power consumption mode. Therefore, the power consumption of the electronic camera can be suppressed.
It is noted that in the second embodiment, the location information obtained by the estimation based on the location information items calculated before and after the imaging, and the time information obtained when each of the location information is calculated is added as the imaging-time location information (hereinafter, referred to as “post-imaging estimated location information”) to the image data; however, the location information obtained by the estimation based on the two location information items already calculated before the imaging and the time information obtained when each of the location information is calculated (hereinafter, referred to as “pre-imaging estimated location information”) may be added, as the imaging-time location information, to the image data. It is noted that upon calculation of the pre-imaging estimated location information, the location information items obtained at least two different time points and the time information obtained when each of the location information is calculated are either saved in the memory inside the camera or used by reading (the location information and the time information each added to the image data) from the image data recorded in the recording medium such as a memory card.
For example, as shown in
Furthermore, the post-imaging estimated location information and the pre-imaging estimated location information may be compared to select the more accurate location information, and the selected information may be added, as the imaging-time location information, to the image data.
Further, in the electronic camera according to the second embodiment, the location information obtained by estimation based on two location information items calculated before and after the imaging and the time information obtained when each of the location information is calculated is added, as the imaging-time location information, to the image data, however, location information obtained by estimation based on three or more location information items calculated before and after the imaging and the time information obtained when each of the location information is calculated may also be added, as the imaging-time location information, to the image data.
Further, the methods of calculating the imaging-time location information according to the first and second embodiments may be combined to select the most accurate location information, and the selected information may be added, as the imaging-time location information, to the image data.
Also, the estimation technique in the above-mentioned second embodiment can also be applied in situations such as the following. For example, as illustrated in
Furthermore, in the electronic camera according to each of the above embodiments, the detachable GPS module 22 is provided; however, the configuration may be such that the GPS module is built inside the electronic camera.
Moreover, in the electronic camera according to each of the above embodiments, the GPS module 22 performs the process of calculating the location information at each predetermined timing only during the normal operation mode and does not perform the process of calculating the location information during the low power consumption mode; however, the GPS module 22 may be shifted to the normal operation mode at each predetermined timing to perform the process of calculating the location information.
Number | Date | Country | Kind |
---|---|---|---|
2008-234233 | Sep 2008 | JP | national |
This application is a Continuation Application No. of U.S. patent application Ser. No. 13/025,924 filed on Feb. 11, 2011, which is a National Stage Application of Application No. PCT/JP2009/064728 filed on Aug. 24, 2009. The disclosure of the following priority application is herein incorporated by reference: Japanese Patent Application No. 2008-234233 filed on Sep. 12, 2008.
Number | Name | Date | Kind |
---|---|---|---|
6995792 | Ogura | Feb 2006 | B1 |
7912366 | Huliyapur Math | Mar 2011 | B2 |
8305479 | Park | Nov 2012 | B2 |
20070263981 | Ueno et al. | Nov 2007 | A1 |
20120223860 | Leclercq | Sep 2012 | A1 |
Number | Date | Country |
---|---|---|
A-10-282208 | Oct 1998 | JP |
A-2000-056386 | Feb 2000 | JP |
2006-154278 | Jun 2006 | JP |
2007-158887 | Jun 2007 | JP |
A-2007-295034 | Nov 2007 | JP |
A-2002-071376 | Mar 2012 | JP |
Entry |
---|
Mar. 15, 2011 International Preliminary Report on Patentability issued in PCT/JP2009/064728 (with translation). |
International Search Report in International Application No. PCT/JP2009/064728; dated Sep. 15, 2009 (with English-language translation). |
Jul. 2, 2012 Office Action against U.S. Appl. No. 13/025,924. |
Oct. 2, 2012 Office Action issued in Japanese Patent Application No. 2010-528700 (with translation). |
Number | Date | Country | |
---|---|---|---|
20130194452 A1 | Aug 2013 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 13025924 | Feb 2011 | US |
Child | 13692508 | US | |
Parent | PCT/JP2009/064728 | Aug 2009 | US |
Child | 13025924 | US |