Patent Grant
8994852
1. Field of the Invention
The present invention relates to an image-capturing apparatus and an image-capturing control method. More particularly, the present invention relates to an image-capturing apparatus for performing drive log image capturing and life log image capturing as automatic image capturing.
2. Description of the Related Art
For example, as a drive log camera, a camera which is disposed inside an automobile has been considered, in which still images are captured periodically, and thereby a user records scenery in the traveling direction and inside the car as image data while driving the car. Furthermore, in addition to image capturing of still images, a camera for capturing moving images has also been considered. Furthermore, a camera of a type, which is also called a life log camera or a life slice camera, which is worn by a user himself/herself, and in which image capturing is periodically performed to capture an activity history of the user, has also been considered.
By using the drive log camera and the life log camera, it is possible to record, as image data, the activity history and memories of the user when the user moves by an automobile, on foot, or the like.
In Japanese Unexamined Patent Application Publication No. 2007-109049, an apparatus is proposed in which images of the surroundings of a user's vehicle are captured using a camera disposed in the user's vehicle, an edge extraction process is performed on camera images when the user's vehicle is stopped and on camera images when the user's vehicle starts moving in order to detect an object. When an object is detected, the camera image at the departure time is displayed on a display device, and when an object is not detected, the camera image at the departure time is not displayed.
When, as a drive log camera and a life log camera, an apparatus is considered in which an image-capturing apparatus is disposed in an automobile, a small image-capturing apparatus, which is mounted in an eyeglass-type or headgear-type wearing unit, is worn by a user, image capturing is performed at fixed time intervals, captured image data is stored, and distance intervals as places where image capturing has been performed become uncertain depending on the movement speed of the automobile and the user.
As shown in
Then, at this time, the image-capturing apparatus automatically captures images of a subject at time intervals as time periods T and stores the captured image data.
In
As shown in
However, as shown in
The image-capturing apparatus moves at the highest speed between points in time P7 to P9. For this reason, the distance intervals between the image-capturing places at points in time P7, P8, and P9 are long distance intervals like a distance L5.
As described above, when image capturing is performed at fixed time intervals in the image-capturing apparatus, distance intervals as places at which capturing of image data to be stored is to be performed are not fixed due to changes in the speed of the image-capturing apparatus, and image capturing is performed at distance intervals corresponding to the speed of the image-capturing apparatus.
Here, when image capturing is performed to record a drive log or a life log, as one way of accurately storing a driving history and an activity history as images, performing of image capturing at places separated by fixed distance intervals that are as constant as possible has been demanded.
Accordingly, it is desirable to perform image capturing at places at approximately fixed distance intervals when image data to be stored is automatically captured in the image-capturing apparatus.
According to an embodiment of the present invention, there is provided an image-capturing apparatus including: image-capturing means for capturing image data of a subject and for storing the captured image data in an image-capturing operation; speed detection means for detecting speed information; and control means for controlling the image-capturing means so that, in an automatic image-capturing process that is not based on a shutter operation of a user, a distance moved by the image-capturing apparatus is computed on the basis of the speed information from the speed detection means, and the image-capturing operation is performed in response to the fact that a computation result indicating that the image-capturing apparatus has moved a predetermined distance is obtained.
The control means may set a shortest waiting time period as a time period from the time when the image-capturing operation is performed in the image-capturing means, and if the shortest waiting time period has not passed when the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may cause the image-capturing means to perform an image-capturing operation after the shortest waiting time period has elapsed.
The control means may set a longest waiting time period as a time period from the time when the image-capturing operation is performed in the image-capturing means, and when the longest waiting time period has passed before the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may cause the image-capturing means to perform an image-capturing operation in response to the passage of the longest waiting time period.
The control means may set a shortest waiting time period and a longest waiting time period as time periods from the time when the image-capturing operation is performed in the image-capturing means, if the shortest waiting time period has not passed when the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may cause the image-capturing means to perform an image-capturing operation after the shortest waiting time period has elapsed, and when the longest waiting time period has passed before the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may cause the image-capturing means to perform an image-capturing operation in response to the passage of the longest waiting time period.
When the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may instruct a change of an image size in the image-capturing operation of the image-capturing means on the basis of the time period elapsed after the image-capturing operation is performed in the image-capturing means.
When the computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may instruct a change of a compression ratio in the image-capturing operation of the image-capturing means on the basis of the time period elapsed after the image-capturing operation is performed in the image-capturing means.
When a computation result indicating that the image-capturing apparatus has moved the predetermined distance is obtained on the basis of the speed detection information from the speed detection means, the control means may instruct a switching between a still-image capturing operation and a moving-image capturing operation as the image-capturing operation of the image-capturing means on the basis of the time period elapsed after the image-capturing operation is performed in the image-capturing means.
According to another embodiment of the present invention, there is provided an image-capturing method for use with an image-capturing apparatus for performing an automatic image-capturing process that is not based on a shutter operation of a user, the image-capturing method including: detecting speed information; computing a distance moved by the image-capturing apparatus on the basis of the speed information in the speed detection; and capturing image data of a subject and storing the captured image data in an image-capturing operation in response to the fact that a computation result indicating that the image-capturing apparatus has moved a predetermined distance is obtained.
According to the embodiments of the present invention, the distance moved by the image-capturing apparatus is computed, and an image-capturing operation is performed in response to the image-capturing apparatus being moved a predetermined distance. The scenery at places separated by approximately fixed distance intervals are stored by automatic image capturing. The movement distance may be determined by computation of the detected speed of the image-capturing apparatus and the movement time period.
Furthermore, if the movement speed is too high, times at which a fixed distance interval is reached frequently occur. When the automobile is stopped, a time at which a fixed distance interval will be reached will not occur for a long time. Therefore, basically, image capturing is performed at times that correspond to fixed distance intervals and also, a shortest waiting time period and a longest waiting time are set, so that the above cases can be appropriately dealt with.
According to the embodiments of the present invention, in a case in which automatic image capturing for, for example, a drive log and a life log is performed using an image-capturing apparatus installed in a vehicle or worn by a user, an image-capturing operation is performed in response to the detection that the image-capturing apparatus has moved a predetermined distance. As a consequence, it is possible to perform image capturing for places at approximately fixed distance intervals regardless of the movement speed of the vehicle and the user. As a result, it is possible to store images appropriate for the vehicle and an activity history of the user.
Furthermore, if a shortest waiting time period and a longest waiting time period are set and image-capturing times are set, it is possible to perform an appropriate image capturing in such a manner as to cope with a case in which the movement speed is too high or too low.
Furthermore, the time interval from the time of the previous image capturing until the time of the next image capturing varies in response to a movement speed. If the size of an image to be captured and the compression ratio thereof are changed in response to the situation and switching between still-image capturing and moving-image capturing is performed, it is possible to store captured image data appropriate for a moving situation.
Embodiments of the present invention will be described below. The description will be given in the following order.
1. Exterior of Image-Capturing Apparatus
2. Example of Configuration of Image-Capturing Apparatus
3. Automatic Image-Capturing Processing Operation Example I
4. Automatic Image-Capturing Processing Operation Example II
5. Automatic Image-Capturing Processing Operation Example III
6. Automatic Image-Capturing Processing Operation Example IV
7. Automatic Image-Capturing Processing Operation Example V
8. Automatic Image-Capturing Processing Operation Example VI
9. Automatic Image-Capturing Processing Operation Example VII
10. Modification
1. Exterior of Image-Capturing Apparatus
As an image-capturing apparatus 1 according to an embodiment of the present invention, various kinds of forms are conceived. Examples of the exterior thereof are shown in
Although not shown in the figure, a display unit used to monitor or reproduce captured images may be provided in, for example, the back part of the image-capturing apparatus 1.
The image-capturing lens 3L may be disposed in such a manner that the direction of the image-capturing lens 3L is directed toward the inside of the automobile so that image capturing is performed by assuming, rather than the traveling direction of the automobile, the inside of the automobile as a subject direction.
Similarly to
In this image-capturing apparatus 1, in a state in which the user has worn the image-capturing apparatus 1, the image-capturing lens 3L is arranged toward the front in such a manner that image capturing is performed by assuming the field-of-view direction of the user to be a subject direction.
Furthermore, in the worn state shown in the figure, a pair of display units 5 and 5 for the left eye and the right eye are arranged immediately before both eyes of the user, that is, at a place where the lenses in normal eyeglasses are positioned. For the display units 5, for example, a liquid-crystal panel is used, and by controlling transmittance, a through state shown in the figure, that is, a transparent or semi-transparent state can be formed. As a result of the display units 5 being made to be a through state, even if the user wears the image-capturing apparatus 1 like eyeglasses at all times, no problem is posed in ordinary life.
A pair of display units 5 are provided so as to correspond to both eyes and also, one display unit 5 may be provided so as to correspond to one eye. In addition, the display units 5 may not be provided.
Up to this point, in
In the case of
Then, in the case of
Furthermore, in
As an image-capturing apparatus for capturing an image, of course, forms other than those shown in
Furthermore, in the above various forms, for example, a microphone for collecting outside sound may be provided, so that an audio signal that is recorded together with image data can be obtained. Furthermore, a speaker unit for performing audio output and an earphone unit may also be formed.
Furthermore, a light-emitting unit for performing illumination in the subject direction in the form of, for example, an LED (Light Emitting Diode), may be provided in the vicinity of the image-capturing lens 3L, or a flash light-emitting unit for capturing an image may be provided.
2. Example of Configuration of Image-Capturing Apparatus
At this point, an example of the configuration of the image-capturing apparatus 1 according to the embodiment of the present invention will be described.
As shown in the figure, the image-capturing apparatus 1 includes a system controller 2, an image-capturing unit 3, an image-capturing controller 4, a display unit 5, a display controller 6, an operation input unit 7, a storage unit 8, a communication unit 9, a speed detector 10, and a bus 11.
The system controller 2 is formed by a microcomputer including, for example, a CPU (Central Processing Unit), a ROM (Read Only Memory), a RAM (Random Access Memory), a non-volatile memory unit, and an interface unit, and serves as a controller for controlling the entire image-capturing apparatus 1. The system controller 2 performs various kinds of computation processes and transmission and reception of a control signal with each unit via the bus 11 in accordance with a program stored in the internal ROM or the like, and causes each unit to perform a necessary operation.
The image-capturing unit 3 includes an image-capturing optical system 3a, an image-capturing element unit 3b, and an image-capturing signal processor 3c.
The image-capturing optical system 3a in the image-capturing unit 3 is provided with a lens system including the image-capturing lens 3L shown in
In the image-capturing element unit 3b in the image-capturing unit 3, a solid-state image-capturing element array for detecting image-capturing light obtained by the image-capturing optical system 3a and for generating an image-capturing signal by performing photoelectric conversion thereon is provided. The solid-state image-capturing element array is formed as, for example, a CCD (Charge Coupled Device) sensor array or a CMOS (Complementary Metal Oxide Semiconductor) sensor array.
The image-capturing signal processor 3c in the image-capturing unit 3 includes a sample-hold/AGC (Automatic Gain Control) circuit for performing gain adjustment and waveform shaping on a signal obtained by solid-state image-capturing elements, and a video A/D converter, and obtains captured image data as digital data. Furthermore, a white-balance process, a luminance process, a color signal process, and the like are performed on the captured image data.
Image capturing is performed by the image-capturing unit 3 having the image-capturing optical system 3a, the image-capturing element unit 3b, and the image-capturing signal processor 3c, and captured image data is obtained.
The image data obtained by the image-capturing operation of the image-capturing unit 3 is processed by the image-capturing controller 4.
Under the control of the system controller 2, the image-capturing controller 4 performs a process for converting the captured image data into a predetermined image data format and a process for supplying the converted captured image data to the image analysis unit 12, the storage unit 9, and the display controller 6 in response to the operation status.
On the basis of the instruction of the system controller 2, the image-capturing controller 4 performs on/off control of an image-capturing operation in the image-capturing unit 3, driving control of a zoom lens and a focus lens of the image-capturing optical system 3a, control of the sensitivity of the image-capturing element unit 3b and the frame rate, parameter control of each process of the image-capturing signal processor 3c, and setting of execution processes.
For the configuration for performing display to a user in the image-capturing apparatus 1, a display unit 5 and a display controller 6 are provided.
The display unit 5 is provided with a display driving unit for driving a liquid-crystal display or the like. This display driving unit is formed of a pixel driving circuit for displaying image data supplied from the image-capturing controller 4 on, for example, a liquid-crystal display. The pixel driving circuit applies, at a predetermined horizontal/vertical driving timing, a driving signal based on a video signal to each of pixels arranged in a matrix in the liquid-crystal display, so that display is performed.
Under the control of the system controller 2, the display controller 6 drives a pixel driving circuit in the display unit 5 so as to perform predetermined display. That is, display as an image-capturing monitor in the image-capturing unit 3 is performed.
In order to perform these displays, for example, luminance level adjustment, color correction, contrast adjustment, sharpness (contour enhancement) adjustment, and the like can be performed. Furthermore, generation of an expanded image such that part of image data is expanded or generation of a reduced image, image effect processes, such as soft focus, mosaic, luminance inversion highlight display (enhancement display) of part of an image, changing of atmosphere of the color of the whole, and the like can be performed.
The operation input unit 7 has operation elements such as, for example, keys, buttons, and dials. For example, operation elements used in power-supply on/off operation and used in an on/off operation of an automatic image-capturing processing function (to be described later) are formed. Furthermore, operation elements used in the operation of the image-capturing system, for example, shutter operation, zoom operation, exposure setting operation, self-timer image-capturing operation, and the like may be formed.
The operation input unit 7 supplies information obtained from such operation elements to the system controller 2, and the system controller 2 performs necessary computation processes and control corresponding to these items of information.
The storage unit 8 is used to store various kinds of data. For example, the storage unit 8 is used to store captured image data.
This storage unit 8 may be formed of a solid-state memory such as a flash memory, and may also be formed of, for example, an HDD (Hard Disk Drive).
The storage unit 8, rather than being formed as an incorporated recording medium, may also be formed as a recording and reproduction drive compatible with a portable recording medium, for example, a memory card, an optical disc, a magneto-optical disc, a hologram memory, or the like, in which a solid-state memory is contained.
Of course, both a built-in type memory, such as a solid-state memory or an HDD, and a recording and reproduction drive for a portable recording medium may be installed.
Under the control of the system controller 2, the storage unit 8 records and stores the captured image data.
Under the control of the system controller 2, the recorded data is read, and the data is supplied to the system controller 2, the display controller 6, and the like.
The communication unit 9 is provided as a unit for performing data communication with various kinds of external devices.
For example, transmission and reception of data may be performed with a server apparatus (not shown). In that case, for example, network communication may be performed via a short-distance wireless communication with respect to a network access point by using a method, such as, for example, a wireless LAN or Bluetooth or, for example, wireless communication may be performed directly with a server apparatus having a compliant communication function.
Furthermore, the communication unit 9 may be connected to a device, such as a personal computer, by using an interface, such as, for example, a USB (Universal Serial Bus) method, so that transmission and reception of data is performed.
The communication unit 9 enables, for example, captured image data that is captured and stored in the storage unit 8 to be transferred to a personal computer or other external devices.
The speed detector 10 detects the movement speed of the image-capturing apparatus 1 and sends the detected speed information to the system controller 2. In the case of the in-vehicle image-capturing apparatus 1 shown in
The movement speed of the user is a movement speed that may be not only the speed of walking and running, but also the speed when the user rides a bicycle, an automobile, an electric train, or the like.
For example, when the image-capturing apparatus 1 is disposed in a vehicle, such as an automobile, the speed detector 10 can be configured to detect vehicle-speed pulses of the vehicle.
The speed detector 10 is not limited to an in-vehicle type or a user wearing type, and can be constituted by, for example, a GPS (Global Positioning System) receiver, a WiFi (Wireless Fidelity) device, a position detector using position information service provided by a mobile phone company, and a computation circuit.
For example, by performing position detection at unit time intervals and by computing a movement distance as a difference of the position, it is possible to compute the speed on the basis of the movement distance and the unit time period.
The configuration of the image-capturing apparatus 1 has been described above, but this is only an example. Addition and deletion of various components are of course considered on the basis of examples of operations and functions, which are performed in practice.
3. Automatic Image-Capturing Processing Operation Example I
The image-capturing apparatus 1 of this example, which is shown as an example in
Then, when this automatic image-capturing process function is used, an automatic image-capturing processing operation is performed so that an image-capturing operation is performed at approximately fixed distance intervals irrespective of the movement speed of the automobile and the user.
An automatic image-capturing processing operation of this embodiment will be described below. As the image-capturing apparatus 1 in automatic image-capturing processing operation example I to be described herein and automatic image-capturing processing operation examples II, III, IV, V, VI, and VII (to be described later), a type of image-capturing apparatus 1 disposed in an automobile, shown in
Since the image-capturing apparatus 1 is disposed in an automobile, the speed referred to herein indicates that the speed at which the automobile travels is shown as the speed of the image-capturing apparatus 1. This also applies to the automatic image-capturing processing operation examples II, III, IV, V, VI, and VII (to be described later).
The traveling speed of the automobile constantly changes.
In
That is, if image-capturing operation times are assumed to be points in time P1 to P9 in
The processing of the system controller 2 for implementing such an operation will be described with reference to
The processing shown in
In step F101, the system controller 2 performs processing for resetting a variable Ln indicating the distance moved by the image-capturing apparatus 1 to an initial value 0 and for setting the movement distance Ln=0.
Then, in step F102, the system controller 2 resets a timer Tm, which is an internal timer, in order to set a count value=0 and also, starts the counting of the timer Tm.
Next, in step F103, the system controller 2 obtains the current speed V of the image-capturing apparatus 1 (the automobile having the image-capturing apparatus 1 installed therein, etc.) from the speed detector 10.
In step F104, the system controller 2 computes a movement distance on the basis of the timer Tm in which counting has started in step F102 and on the basis of the speed V of the image-capturing apparatus 1, which is obtained in step F103. That is, on the basis of (speed V)×(time period Tm), the movement distance in the processing period of steps F102 to F104 is determined. By adding the current movement distance Ln to the above movement distance, a new movement distance Ln is set.
At the initial processing point in time, Ln=0, and therefore, Ln=(speed V)×(time period Tm)+0. Thereafter, processing of steps F102, F103, and F104 is repeated through step F105. At the processing point in time of step F104, the movement distance during steps F102 to F104 is determined by (speed V)×(time period Tm). Therefore, by adding the current movement distance Ln to the above movement distance in order to determine a new movement distance Ln, the movement distance Ln is a total movement distance after the processing in step F101 has started.
In step F105, the system controller 2 determines whether or not the current movement distance Ln determined in step F104 has reached a predetermined distance Lx shown in
When the system controller 2 determines in step F105 that the current movement distance Ln has not reached the distance Lx, the process returns to step F102, and processing of steps F102, 103, and F104 described above is performed.
When the movement distance Ln reaches the distance Lx, the system controller 2 causes the process to proceed to step F106. In step F106, the system controller 2 issues instructions for performing an image-capturing operation. That is, an operation of obtaining captured image data by the image-capturing unit 3, predetermined signal processing, such as a compression process, by the image-capturing controller 4, an operation of transferring to the storage unit 8, and an operation of recording on a recording medium in the storage unit 8 are performed, and thus image capturing of one still image is performed.
After the performance of the image-capturing operation in step F106 has been instructed, the system controller 2 performs the processing of
According to the processing of
That is, each of points in time P1, P2, P3 . . . P9 of
As described above, as a result of automatic image capturing being performed at approximately fixed distance intervals, which are each the distance Lx, captured image data of scenery at approximately fixed distance intervals is stored, which is preferable as a drive log.
4. Automatic Image-Capturing Processing Operation Example II
In the automatic image-capturing processing operation example I described with reference to
However, if an image-capturing operation is performed only in response to an interval that is equal to or greater than the distance Lx being reached after the image-capturing apparatus 1 performed the previous image-capturing operation, there is a case in which an image-capturing operation is performed too frequently.
For example, when an automobile having the image-capturing apparatus 1 is moving at a high speed along a highway or the like, it is considered that the automobile might travel the distance Lx or more in a very short time period. In that case, image capturing is performed very frequently, and a large amount of captured image data is recorded in the storage unit 8 in a short time.
For the drive log camera or the life log camera for recording the traveling of the automobile and everyday life of the user, if captured image data is recorded too frequently in the storage unit 8, the available capacity of the storage unit 8 could become insufficient. In particular, each place passed during high-speed movement may not be of much value as an image to the user.
Therefore, whereas automatic image capturing is basically performed at intervals of the distance Lx as in the above-described automatic image-capturing processing operation example I, the following processing operation is considered in which, during high-speed movement, image capturing is not performed too frequently and the amount of captured image data to be recorded in the storage unit 8 is reduced.
A description will be given below, with reference to
The system controller 2 repeats the processing of
Initially, in step F201, the system controller 2 resets a timer Tm2, which is an internal timer, in order to set the timer Tm2=0, and causes the counting of the timer Tm2 to be started.
The timer Tm2 causes the counting to be started immediately after an image-capturing operation is performed in the image-capturing apparatus 1, and is used to determine whether a predetermined time period has passed from the time when the image-capturing operation was performed in step F207 (to be described later).
Then, in steps F202 to F206, the system controller 2 performs the same processing operations as the processing operations from steps F101 to F105 described with reference to
That is, initially, the system controller 2 performs processing for resetting the movement distance Ln of the image-capturing apparatus 1 to an initial value 0, and performs processing for resetting the timer Tm1, which is an internal timer, to an initial value 0 and starting counting. Then, processing for obtaining the speed V supplied from the speed detector 10 as the speed V of the image-capturing apparatus 1, multiplying the value of the speed V with the value of the timer Tm1, and adding the value of the movement distance Ln to the value of the multiplied result is performed. After the movement distance Ln of the image-capturing apparatus 1 is computed in the manner described above, a process for determining whether or not the movement distance Ln has reached the distance Lx is performed. When a negative result is obtained, the process returns to step F203. Then, until a determination result that the movement distance Ln has reached the distance Lx at a certain point in time, processing of step F203→step F204→step F205→step F206→step F203→ . . . is repeated.
Then, when the determination result that the movement distance Ln has a magnitude equal to or greater than the distance Lx is obtained, the process proceeds to step F207.
In step F207, the system controller 2 compares the count value of the timer Tm2 with a preset shortest waiting time period Tmin. That is, it is determined whether or not the shortest waiting time period has passed from the time of the previous image capturing.
The shortest waiting time period Tmin is a time period that is provided as a minimum time period after which an image-capturing operation may be performed even if the image-capturing apparatus 1 has already moved a distance equal to or greater than the distance Lx after the image-capturing apparatus 1 performed the previous image-capturing operation.
If the count value of the timer Tm2 has not reached the shortest waiting time period Tmin, the system controller 2 waits in step F207 until the shortest waiting time period Tmin is reached.
Then, when the timer Tm2 has reached the shortest waiting time period Tmin or more at a certain point in time, the system controller 2 causes the process to proceed to step F208.
In step F208, the system controller 2 issues instructions for performing an image-capturing operation. That is, the system controller 2 issues instructions for causing the image-capturing unit 3 to capture an image of a subject, and causes the image-capturing controller 4 to retrieve the captured image data of one frame, to perform predetermined processing thereon, and to transfer the captured image data to the storage unit 8.
In the storage unit 8, a process for recording the transferred captured image data of one frame as a still image on a recording medium is performed.
Thereafter, the system controller 2 repeats the processing of
That is, according to the processing of
For this reason, even if the automobile is traveling at a high speed and the distance Lx is traveled too quickly, in that case, image capturing at intervals of a fixed distance is not performed, the distance intervals becoming wide to some extent, but image capturing at certain times is performed.
As a result, if the above is practised while image capturing is usually performed at intervals of fixed distances, during high-speed traveling, the case in which image capturing is performed too frequently can be avoided, and the amount of captured image data to be recorded in the storage unit 8 can be reduced to an appropriate amount.
5. Automatic Image-Capturing Processing Operation Example III
In the above-described automatic image-capturing processing operation examples I and II of
Furthermore, in the automatic image-capturing processing operation example II of
As described above, in the automatic image-capturing processing operation example II, it is possible to store captured image data in which the state of a subject has changed, and by providing the shortest waiting time period Tmin in such a manner as to cope with a case in which the speed of the image-capturing apparatus 1 is high, the amount of captured image data to be recorded in the storage unit 8 is reduced.
However, usually, regarding the speed at which an automobile travels, the speed is considered to vary frequently, for example, becoming high or low.
For example, when the speed of the automobile in which the image-capturing apparatus 1 is disposed is low or the automobile is stopped, the image-capturing apparatus 1 is moving at a low speed or is stopped. Then, it takes a considerable amount of time to move a distance equal to or greater than the distance Lx from the place where the image-capturing apparatus 1 performed the previous image-capturing operation, or it is difficult to move a distance equal to or greater than the distance Lx, and thus a case may occur in which an image-capturing operation time is not reached soon enough.
At such a time, if an image-capturing operation is not performed because the image-capturing apparatus 1 has not moved a distance equal to or greater than the distance Lx, this is not so appropriate for the intended use of the life log camera for recording the daily life of the user.
Furthermore, even if not accompanied by the movement of a distance, the scenery around the subject may change with the passage of time. As a consequence, even if the distance has not changed much, the user has a possibility of obtaining a valuable image for the drive log or life log.
Therefore, it is considered that a fixed time interval (longest waiting time) is provided as a time interval at which image-capturing operations are performed in such a manner as to deal with a case in which the movement speed of the image-capturing apparatus 1 is low or the image-capturing apparatus 1 is stopped. That is, the following processing operation is considered in which, whereas automatic image capturing is basically performed at intervals of the distance Lx as in the above-described automatic image-capturing processing operation example I, the case in which an image-capturing time is not reached due to a situation of low-speed traveling or stopping does not occur.
A description will be given below, with reference to
Initially, in step F301, the system controller 2 resets a timer Tm2, which is an internal timer, in order to set the timer Tm2=0, and causes the counting of the timer Tm2 to be started.
The timer Tm2 is used to start counting immediately after the image-capturing operation is performed in the image-capturing apparatus 1, and is used to determine whether or not a predetermined time period or more has passed from the time when the image-capturing operation was performed in step F307 (to be described later).
Thereafter, the system controller 2 performs the processing operations from steps F302 to F305, which are the same processing operations as steps F202 to F205 described with reference to
That is, initially, the system controller 2 resets the timer Tm2, which is an internal timer, to an initial value 0 and thereafter causes counting to be started. Then, the movement distance Ln of the image-capturing apparatus 1 is reset to an initial value 0, and after the timer Tm1, which is an internal timer, is reset to an initial value 0, counting is started. Furthermore, processing for obtaining the speed V supplied from the speed detector 10 as the speed V of the image-capturing apparatus 1, for multiplying the value of the speed V with the value of the timer Tm1, and for adding the value of the multiplied result to the value of the movement distance Ln is performed. In the manner described above, the movement distance Ln of the image-capturing apparatus 1 is computed.
Then, in step F306, the system controller 2 determines whether or not the movement distance Ln of the image-capturing apparatus 1 has reached the distance Lx.
When it is determined in step F306 that the movement distance Ln has reached the distance Lx, the process proceeds to step F308.
In step F308, the system controller 2 issues instructions for performing an image-capturing operation similarly to the process of step F208 of
That is, the system controller 2 issues instructions for causing the image-capturing unit 3 to capture an image of a subject, and performs processing for causing the image-capturing controller 4 to retrieve the captured image data of one frame, to perform predetermined processing thereon, transferring the captured image data to the storage unit 8, and recording, as a still image, the transferred captured image data of one frame on a recording medium of the storage unit 8.
Then, the processing of
On the other hand, when it is determined in step F306 that the movement distance Ln has not yet reached the distance Lx, the system controller 2 causes the process to proceed to step F307.
In step F307, the system controller 2 determines whether or not the count value of the timer Tm2 is greater than the longest waiting time period Tmax.
The longest waiting time period refers to that which is set as a time at which image capturing is performed even if the image-capturing apparatus 1 has not moved a distance equal to or greater than the distance Lx from the place where the image-capturing apparatus 1 performed the previous image-capturing operation.
When the system controller 2 determines that the count value of the timer Tm2 is smaller than the longest waiting time period Tmax, the process returns to step F303.
However, when it is determined in step F306 that the movement distance Ln has not reached the distance Lx, but it is determined in step F307 that the longest waiting time period is reached, the process proceeds to step F308, where the performance of an image-capturing operation is instructed as described above. As a result, even if the movement distance Ln has not reached the distance Lx, image capturing is performed.
Thereafter, the system controller 2 returns to step F301, where processing is repeated.
According to the above-described processing of
Furthermore, when the movement of the distance Lx or more is not performed soon enough, such as when the speed of the image-capturing apparatus 1 is low or the image-capturing apparatus 1 is stopped, if the longest waiting time period Tmax has passed from the time when the previous image capturing was performed, image capturing is performed regardless of the moved distance, thereby making it possible to avoid a situation in which an image-capturing operation is not performed for a long time.
As a result, image capturing suitable as a drive log and a life log is implemented.
Furthermore, if image capturing is not performed due to, for example, a stopped state, a case in which the failure of the image-capturing apparatus 1 is suspected by the user can occur, and such a situation can be avoided.
6. Automatic Image-Capturing Processing Operation Example IV
In the above-described automatic image-capturing processing operation example II of
Furthermore, in the automatic image-capturing processing operation example III of
However, as described earlier, usually, there are cases in which the speed of an automobile increases or decreases, or sometimes the automobile is stopped while traveling, and the speed changes frequently.
For example, when an automobile travels along a highway, it is considered that the automobile travels at a speed higher than that in an ordinary road. When the automobile gets off halfway to an ordinary road and travels, there are cases in which the speed becomes low or the automobile is stopped due to congestion of the road or a red traffic light.
Therefore, the following processing operation is considered in which both the processing operation in which, in response to the above case, the image-capturing apparatus 1 performs an image-capturing operation in response to the passage of the shortest waiting time period Tmin after the image-capturing apparatus 1 moves the distance Lx or more from the place where the image-capturing apparatus 1 performed the previous image-capturing operation, and a processing operation in which the image-capturing apparatus 1 performs an image-capturing operation in response to the passage of the longest waiting time period Tmax when the image-capturing apparatus 1 has not moved the distance Lx or more, are combined.
A description will be given below, with reference to
Initially, in
Then, when it is determined in step F406 that the movement distance Ln has a magnitude equal to or greater than the distance Lx, the system controller 2 causes the process to proceed to step F408.
In step F408, similarly to step F207 described with reference to
That is, the system controller 2 performs a process for determining whether or not the shortest waiting time period Tmin that is provided as a minimum in order to perform an image-capturing operation after the image-capturing apparatus 1 has moved a distance equal to or greater than the distance Lx after the image-capturing apparatus 1 performed the previous image-capturing operation. Then, when it is determined that the shortest waiting time period Tmin has not passed, the system controller 2 waits in step F408 until the count value of the timer Tm2 becomes equal to or greater than the shortest waiting time period Tmin.
Then, when it is determined that the shortest waiting time period has passed, the system controller 2 causes the process to proceed to step F409.
Furthermore, when it is determined in step F406 that the movement distance Ln has not reached the distance Lx, the system controller 2 causes the process to proceed to step F407. Similarly to step F307 described with reference to
On the other hand, if the longest waiting time period Tmax has passed even while the image-capturing apparatus 1 is not recognized to have moved the distance Lx or more from the place where the image-capturing apparatus 1 performed the previous image-capturing operation, the process proceeds from step F407 to step F409.
In step F409, the system controller 2 performs the same process as the process of step F208 of
According to such a processing of
However, by performing an image-capturing operation in response to the passage of the shortest waiting time period Tmin or more, it is possible to avoid image capturing from being excessively performed during high-speed movement, and thus the amount of captured image data to be recorded in the storage unit 8 is reduced.
Furthermore, by performing an image-capturing operation in response to the passage of the longest waiting time period Tmax or more, a situation in which image capturing is not performed soon enough due to a low-speed movement or a stopped state can be avoided.
7. Automatic Image-Capturing Processing Operation Example V
In the above-described automatic image-capturing processing operation examples I, II, III, and IV of
However, if the image-capturing apparatus 1 performs an image-capturing operation in response to the image-capturing apparatus 1 being moved the distance Lx or more, it is considered that the amount of captured image data that is captured during that period could be a considerable amount. Furthermore, when the movement speed of the image-capturing apparatus 1 is high and the image-capturing apparatus 1 moves the distance Lx or more in a short time, the image-capturing operation is frequently performed in a short time, and it is considered that the amount of captured image data to be recorded in the storage unit 8 increases.
Since the recording capacity of the storage unit 8 is limited, the reduction in the amount of captured image data to be recorded in the storage unit 8 is preferable in the image-capturing apparatus 1.
The technique for reducing the amount of data should preferably be such that, for example, threshold values are provided for the time interval at which an image-capturing operation is performed, the image size of captured image data is decreased when the interval at which the image-capturing operation is performed is short, the image size of the captured image data is increased when the interval at which the image-capturing operation is performed is long, and the captured image data is recorded in the storage unit 8.
Such an automatic image-capturing processing operation will be described below.
In
This case shows that a threshold value for a time interval in which an image-capturing operation is performed is provided, so that the image size of captured image data to be stored is changed on the basis of the threshold value.
As shown in the figure, for example, three threshold values are provided for the time interval at which an image-capturing operation is performed. On the basis of the threshold value of the time interval at which an image-capturing operation has been performed, captured image data to be stored is determined from among image sizes of four levels.
That is, when an image-capturing operation is performed in response to the image-capturing apparatus 1 being moved the distance Lx or more after the image-capturing apparatus 1 performed the previous image-capturing operation, in the case that the time interval is smaller than or equal to a threshold value Th1, which is the shortest threshold value, the captured image data is stored at an image size sz1.
Furthermore, if the image-capturing time interval is between a threshold value Th1 and a threshold value Th2, the captured image data is stored at an image size sz2. If the image-capturing time interval is between the threshold value Th2 and a threshold value Th3, the captured image data is stored at an image size sz3. If the image-capturing time interval is greater than or equal to the threshold value Th3, the captured image data is stored at an image size sz4.
A description will be given below, with reference to
Initially, in steps F501 to F506 in
Then, when it is determined in step F506 that the distance Ln moved by the image-capturing apparatus 1 after the image-capturing apparatus 1 performed the previous image-capturing operation is a magnitude equal to or greater than the distance Lx, the system controller 2 causes the process to proceed to step F507.
In step F507, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 that started in step F501 is smaller than or equal to the threshold value Th1 of a time interval.
Then, when it is determined that the count value of the timer Tm2 is smaller than or equal to the threshold value Th1, the process proceeds to step F508.
In step F508, the system controller 2 instructs the image-capturing controller 4 to set the image size sz1, which is the smallest size among the sizes sz1 to sz4 of the captured image data shown in
Furthermore, when it is determined in step F507 that the count value of the timer Tm2 is greater than the threshold value Th1, in step F509, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 is smaller than or equal to a threshold value Th2.
Then, when it is determined in step F509 that the count value of the timer Tm2 is smaller than or equal to the threshold value Th2, in step F510, the system controller 2 instructs the image-capturing controller 4 to set the image size sz2 as the size of captured image data. The image size sz2 is an image size that is large next to the image size sz1. Then, the process proceeds to step F514.
When it is determined in step F509 that the count value of the timer Tm2 is greater than the threshold value Th2, the process proceeds to step F511. In step F511, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 is smaller than or equal to a threshold value Th3.
When it is determined in step F511 that the count value of the timer Tm2 is smaller than or equal to the threshold value Th3, the system controller 2 causes the process to proceed to step F512, where the system controller 2 instructs the image-capturing controller 4 to set the image size sz3 as the size of the captured image data.
The image size sz3 is an image size that is the next largest image size after the image size sz2. The process then proceeds to step F514.
Furthermore, when it is determined in step F511 that the count value of the timer Tm2 is greater than the threshold value Th3, the system controller 2 causes the process to proceed to step F513, where the system controller 2 instructs the image-capturing controller 4 to set an image size sz4 as the size of the captured image data. The image size sz4 is the largest image size. The process then proceeds to step F514.
In step F514, the system controller 2 issues instructions for performing an image-capturing operation. That is, the system controller 2 instructs the image-capturing unit 3 to capture an image of a subject, and causes the image-capturing controller 4 to retrieve the captured image data of one frame, to perform predetermined process thereon, and to transfer the captured image data to the storage unit 8. At this time, the image-capturing controller 4 processes the captured image data having an image size set in one of steps F508, F510, F512, and F513. In the storage unit 8, a process is performed for recording the transferred captured image data of one frame as a still image on a recording medium.
The system controller 2 instructs the performance of an image-capturing operation in step F514, and then starts processing from step F501 again.
As described above, by changing the image size of captured image data to be stored in accordance with the image-capturing time interval, efficient use of the recording capacity of the storage unit 8 can be achieved.
The image obtained at a comparatively long time interval is considered to have a high value for the image, and storing such an image at a large size is preferable.
In this example, the captured image data is recorded in the storage unit 8 in such a manner as to be divided into image sizes of four levels. The captured image data may be divided into image sizes of two, three, five or more levels, and may be recorded.
8. Automatic Image-Capturing Processing Operation Example VI
In the above-described automatic image-capturing processing operation example V of
Here, an automatic image-capturing processing operation in which a compression ratio is changed in the manner described above will be described below.
A specific technique is shown in
For example, three threshold values are provided for the time interval in the case that an image-capturing operation is performed, and on the basis of the threshold values for the time interval at which the image-capturing operation has been performed, compression ratios at four levels are determined with regard to the captured image data.
When the image-capturing apparatus 1 performs an image-capturing operation in response to the image-capturing apparatus 1 being moved the distance Lx or more after the image-capturing apparatus 1 performed the previous image-capturing operation, in the case that the time interval is smaller than or equal to the threshold value Th1, which is the shortest threshold value, the captured image data is compressed at the highest compression ratio qt1 and is stored.
Furthermore, if the image-capturing time interval is between the threshold value Th1 and the threshold values Th2, the captured image data is compressed at a compression ratio qt2 and is stored. If the image-capturing time interval is between the threshold value Th2 and the threshold value Th3, the captured image data is compressed at a compression ratio qt3 and is stored. If the image-capturing time interval is greater than or equal to the threshold value Th3, the captured image data is compressed at the lowest compression ratio qt4 and is stored.
A description will be given below, with reference to
Initially, in steps F601 to F606 in
Then, when it is determined in step F606 that the distance Ln moved by the image-capturing apparatus 1 after the image-capturing apparatus 1 performed the previous image-capturing operation is a magnitude equal to or greater than the distance Lx, the system controller 2 causes the process to proceed to step F607.
In step F607, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 that started in step F601 is smaller than or equal to the threshold value Th1 of the time interval. Then, when it is determined that the count value of the timer Tm2 is smaller than or equal to the threshold value Th1, the process proceeds to step F608.
In step F608, the system controller 2 indicates to the image-capturing controller 4 the highest compression ratio qt1 among the compression ratios qt1 to qt4 shown in
Furthermore, when it is determined in step F607 that the count value of the timer Tm2 is greater than the threshold value Th1, in step F609, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 is smaller than or equal to the threshold value Th2.
Then, when it is determined in step F609 that the count value of the timer Tm2 is smaller than or equal to the threshold value Th2, in step F610, the system controller 2 indicates the compression ratio qt2 to the image-capturing controller 4. The compression ratio qt2 is a compression ratio that is the next lowest compression ratio after the compression ratio qt1. The process then proceeds to step F614.
Furthermore, when it is determined in step F609 that the count value of the timer Tm2 is greater than the threshold value Th2, the process proceeds to step F611. In step F611, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 is smaller than or equal to the threshold value Th3.
Then, when it is determined in step F611 that the count value of the timer Tm2 is smaller than or equal to the threshold value Th3, the system controller 2 causes the process to proceed to step F612, where the compression ratio qt3 is indicated to the image-capturing controller 4. The compression ratio qt3 is a compression ratio that is the next lowest compression ratio after the compression ratio qt2. The process then proceeds to step F614.
Furthermore, when it is determined in step F611 that the count value of the timer Tm2 is greater than the threshold value Th3, the system controller 2 causes the process to proceed to step F613, where the compression ratio qt4 is indicated to the image-capturing controller 4. The compression ratio qt4 is the lowest compression ratio.
The process then proceeds to step F614.
In step F614, the system controller 2 issues instructions for performing an image-capturing operation. That is, the system controller 2 instructs the image-capturing unit 3 to capture an image of a subject, and causes the image-capturing controller 4 to retrieve the captured image data of one frame, to perform a predetermined process thereon, and to transfer the captured image data to the storage unit 8. At this time, the image-capturing controller 4 performs a process for compressing the captured image data at a compression ratio that is set in one of steps F608, F610, F612, and F613. Then, in the storage unit 8, a process for recording the transferred captured image data of one frame as a still image on a recording medium is performed.
After the system controller 2 instructs the performance of an image-capturing operation in step F614, the image-capturing apparatus 1 starts processing from step F601 again.
As described above, by changing the compression ratio of the captured image data to be stored on the basis of the image-capturing time interval, the recording capacity of the storage unit 8 can be efficiently used.
Furthermore, it can be considered that an image obtained at a comparatively long time interval has a comparatively high value regarding the image, and storage of such an image at a low compression ratio at a high image quality is preferable.
In this example, regarding a process for compressing captured image data, switching is performed among the compression ratios at four levels. Alternatively, the captured image data may be switched among two, three, five or more levels.
Furthermore, in the case of achieving the highest image quality (in the case that the time interval is longest), the captured image data may be not compressed.
9. Automatic Image-Capturing Processing Operation Example VII
In the automatic image-capturing processing operation examples I, II, III, IV, V, and VI described thus far of
However, it is considered that captured image data to be recorded in the storage unit 8 is recorded as moving images in addition to still images.
When a driving history and scenery of the daily life of a user are to be recorded as a drive log camera or a life log camera, making a record as moving images can produce a record having a higher sense of realism than one using still images. Furthermore, in still images, the time interval at which the image-capturing apparatus 1 performs an image-capturing operation is longer than in moving images, and there is a period in which an image of a subject is not captured. However, in moving images, since such a period in which it is difficult to capture an image of a subject is shorter than that in still images, it is possible to thoroughly record the daily life of the user, and a more preferable recording of the scenery of the daily life can be made.
However, when all the daily life of the user is to be recorded as moving images, a very large amount of captured image data is recorded in the storage unit 8, and it is considered that the recording capacity of the storage unit 8 is exceeded. Therefore, if captured image data to be recorded in the storage unit 8 is switched and recorded between still images and moving images in accordance with the situation, it is possible to save the recording capacity of the storage unit 8.
For example, a processing operation is also considered in which, when an image-capturing operation is performed in response to the image-capturing apparatus 1 being moved the distance Lx or more from the place where the image-capturing apparatus 1 performed the previous image-capturing operation, image capturing is performed in the form of moving images when image capturing is to be performed at a point in time shorter than or equal to a predetermined time interval, and image capturing is performed in the form of still images when image capturing is to be performed at a point in time longer than or equal to the predetermined time interval.
A description will be given below, with reference to
Initially, the system controller 2 performs the processing operations of steps F701 to F706 in
In step F707, the system controller 2 performs a process for determining whether or not the count value of the timer Tm2 is smaller than or equal to a predetermined time period Tx. The time period Tx is a threshold value for the period from the time when the previous image-capturing operation was performed.
When it is determined that the count value of the timer Tm2 is smaller than or equal to the time period Tx, the system controller 2 causes the process to proceed to step F709.
In step F709, the system controller 2 issues instructions for performing an image-capturing operation in the form of moving images. That is, the system controller 2 instructs the image-capturing unit 3 to capture image data of, for example, 30 frames per second, and causes the image-capturing controller 4 to retrieve the captured image data and compress it in accordance with the MPEG2 method, and to transfer the compressed moving image data to the storage unit 8. Then, the system controller 2 causes the storage unit 8 to record, as moving images, the transferred captured image data on a recording medium.
Furthermore, when it is determined in step F707 that the count value of the timer Tm2 is greater than the time period Tx, the system controller 2 causes the process to proceed to step F708.
In step F708, the system controller 2 issues instructions for performing an image-capturing operation in the form of still images. That is, the system controller 2 instructs the image-capturing unit 3 to capture an image of a subject, and causes the image-capturing controller 4 to retrieve the captured image data of one frame, to perform a process for compressing the captured image data in accordance with the JPEG method, and to transfer it to the storage unit 8. Then, the system controller 2 causes the storage unit 8 to record, as a still image, the transferred captured image data of one frame on a recording medium.
After the process of step F708 or F709, the system controller 2 returns to step F701 and performs processing in a similar manner.
According to such a processing, when the movement is comparatively slow, still images are recorded at intervals of a fixed distance Lx. In the case of high-speed movement in which a fixed distance Lx is reached within the time period Tx, a moving image is recorded.
When the captured image is stored as a moving image, the subject can be viewed as moving more smoothly when it is reproduced later, than when it is stored as a still image and scenery having a sense of realism can be recorded. However, a large amount of the recording capacity is consumed. Therefore, during high-speed movement in which the image-capturing apparatus 1 moves the distance Lx in the time period of the time period Tx or less, moving-image capturing is performed, and when it takes time to move the distance Lx, a switch is made to still images, thereby saving the capacity.
10. Modification
The embodiments of the present invention have thus been described. The present invention should not be limited to any of the above-described embodiments.
Each of the above-described examples has been basically described using an in-vehicle image-capturing apparatus 1 shown in
Furthermore, when scenery of the daily life of the user and scenery during driving are to be recorded as captured image data by being used as a life log camera or a drive log camera, audio may also be recorded simultaneously. In that case, the image-capturing apparatus 1 may be provided with a microphone and an audio processor, so that audio data is recorded together with images.
As a technique in which the amount of captured image data to be recorded in the storage unit 8 is reduced and the recording capacity of the storage unit 8 is saved, a technique of combining the processing examples of the automatic image-capturing processing operation examples V and VI described with reference to
It should be understood by those skilled in the art that various modifications, combinations, sub-combinations and alterations may occur depending on design requirements and other factors insofar as they are within the scope of the appended claims or the equivalents hereof.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2007-216669 | Aug 2007 | JP | national |
The present invention is a Divisional application of U.S. application Ser. No. 12/229,059, filed Aug. 19, 2008, which claims the priority benefit of Japanese patent application number 2007-216669, filed in the Japanese Patent Office on Aug. 23, 2007, which is hereby incorporated by reference to the maximum extent allowable by law.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5708863 | Satoh et al. | Jan 1998 | A |
| 6259960 | Inokuchi | Jul 2001 | B1 |
| 6459388 | Baron | Oct 2002 | B1 |
| 6893132 | Mori et al. | May 2005 | B2 |
| 7171285 | Kim et al. | Jan 2007 | B2 |
| 7472134 | Kaku | Dec 2008 | B2 |
| 7512494 | Nishiuchi | Mar 2009 | B2 |
| 7532975 | Ishikawa | May 2009 | B2 |
| 7616883 | Nakajima et al. | Nov 2009 | B2 |
| 7742083 | Fredlund et al. | Jun 2010 | B2 |
| 7924323 | Walker et al. | Apr 2011 | B2 |
| 7995109 | Kamada et al. | Aug 2011 | B2 |
| 8063952 | Kamada et al. | Nov 2011 | B2 |
| 8243156 | Sako | Aug 2012 | B2 |
| 8488012 | Kamada et al. | Jul 2013 | B2 |
| 20020039203 | Endo et al. | Apr 2002 | A1 |
| 20030151672 | Robins et al. | Aug 2003 | A1 |
| 20040061781 | Fennell et al. | Apr 2004 | A1 |
| 20040174434 | Walker et al. | Sep 2004 | A1 |
| 20040239776 | Shinohara et al. | Dec 2004 | A1 |
| 20050122405 | Voss et al. | Jun 2005 | A1 |
| 20050222753 | Ishikawa | Oct 2005 | A1 |
| 20060050982 | Grosvenor | Mar 2006 | A1 |
| 20060171694 | Kamimura et al. | Aug 2006 | A1 |
| 20060197845 | Masaki | Sep 2006 | A1 |
| 20070147814 | Nomura et al. | Jun 2007 | A1 |
| 20070206093 | Kuwabara et al. | Sep 2007 | A1 |
| 20070253696 | Nakajima et al. | Nov 2007 | A1 |
| 20070285533 | Furuya et al. | Dec 2007 | A1 |
| 20070291987 | Saka et al. | Dec 2007 | A1 |
| 20080192129 | Walker et al. | Aug 2008 | A1 |
| 20080316339 | Sugino et al. | Dec 2008 | A1 |
| 20090027513 | Sako | Jan 2009 | A1 |
| 20090051785 | Kamada et al. | Feb 2009 | A1 |
| 20090051788 | Kamada et al. | Feb 2009 | A1 |
| 20090115865 | Kamada et al. | May 2009 | A1 |
| 20090278766 | Sako et al. | Nov 2009 | A1 |
| 20130229562 | Kamada et al. | Sep 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 1816111 | Aug 2006 | CN |
| 06-030374 | Feb 1994 | JP |
| 07-107351 | Apr 1995 | JP |
| 08-279954 | Oct 1996 | JP |
| 10-150598 | Jun 1998 | JP |
| 10-282536 | Oct 1998 | JP |
| 2002-022463 | Jan 2002 | JP |
| 2002-034030 | Jan 2002 | JP |
| 2003-060972 | Feb 2003 | JP |
| 2004-212232 | Jul 2004 | JP |
| 2004-333921 | Nov 2004 | JP |
| 2005-276220 | Oct 2005 | JP |
| 2005-303492 | Oct 2005 | JP |
| 2005-348178 | Dec 2005 | JP |
| 2006-140695 | Jun 2006 | JP |
| 2006-251938 | Sep 2006 | JP |
| 2006-270561 | Oct 2006 | JP |
| 2007-057814 | Mar 2007 | JP |
| 2007-066251 | Mar 2007 | JP |
| 2007-109049 | Apr 2007 | JP |
| 2007-123953 | May 2007 | JP |
| 2007-150993 | Jun 2007 | JP |
| 2007-172035 | Jul 2007 | JP |
| 2007-206099 | Aug 2007 | JP |
| WO 9008371 | Jul 1990 | WO |
| Entry |
|---|
| Hewagamage et al., “Augmented Album: Situation-dependent System for a Personal Digital Video/Image Collection”, 2000 IEEE Int'l Conference on Multimedia Computing & Systems, New York, Jul. 30, 2000 to Aug. 2, 2000, vol. 1, pp. 323-326. |
| Yang et al., “Smart Sight: A Tourist Assistant System”, Proc 3rd Int'l Syposium on Wearable Computers, 1999, pp. 73-78 (retreived on Oct. 30, 2008 from http://isl.ira.uka.de/fileadmin/publicationfiles/ISWC99-jie.pdf. |
| Number | Date | Country | |
|---|---|---|---|
| 20120026334 A1 | Feb 2012 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12229059 | Aug 2008 | US |
| Child | 13272895 | US |
