The device 2 is connected to the Internet 6 via the LAN 3 and the router 5, and the image storage apparatus 1 can be connected to the device 2 over an external network or wireless communication.
The device 2 has a specific information transmission section 21 which transmits device-specific information which is information specific to the device (any kind of information specific to the device 2, such as its identification number, ID, serial number, manufacturer number, model number, model, and address on an external network) by superimposing it on an optical signal such as an infrared signal, and a reception section 22 which receives a remote control signal from the image storage apparatus 1 (which is transmitted as an infrared signal or other optical signal, or Bluetooth or other electrical signal). The specific information transmission section 21 may be a light emitting diode, an infrared LED or the like.
The image storage apparatus 1 also has a display control section 26 which controls display on a display section 13 in accordance with input operations to an operation section 14 which may be a numeric keypad, a cross key or the like, various operation signals received from outside by the remote control signal transmission/reception section 22, and/or images or device-specific information obtained by the camera section 20.
The image storage apparatus 1 also has a CPU 10 which is responsible for control of operation of the respective sections, a ROM 12 which stores various data and/or programs, and a RAM 11 which stores various data necessary for processing at the CPU 10.
The ROM 12 stores, among others, for each of devices 2 a control program for the CPU 10 to control a remote control signal control section 23 or a radio control section 16 to transmit a remote control signal on which a control code for the device 2 corresponding to an operation to the operation section 14 is superimposed, and a remote control GUI for visually indicating relationship between manipulation of a part of the operation section 14 and a control code which is superimposed in response to the manipulation.
For example, an optical double zoom lens is used as the image-taking lens, and the optical zoom magnification is changed by a motor driver forward and backward driving the image-taking lens to the telephotographic (tele) side or the wide-angle (wide) side in accordance with a magnification change operation inputted from the operation section 14. The magnification of the image-taking lens is not limited to the above. An aperture is provided for the image-taking lens. An appropriate amount of exposure is obtained by controlling the aperture via the motor driver.
When the photographing mode is set by the operation section 14, the CPU 10 displays a motion picture (live images) on the display section 13 to enable confirmation of the image-taking angle of field. That is, the solid-state image sensor converts a light of a subject which is incident through the image-taking lens and is formed on the light-receiving surface of the image sensor to an amount of signal charge corresponding to the amount of the light. The signal charges of respective pixels accumulated in this way are sequentially and individually read by the driver as voltage signals (image signals) corresponding to the signal charges, based on a driving pulse given by a timing generator in accordance with a direction from the CPU 10 and converted to digital signals in the analog front-end circuit, and each of them is added to the signal processing circuit.
The signal processing circuit includes a gain adjustment circuit and an A/D converter. It is an image processing device which includes a brightness/color difference signal generation circuit, a gamma correction circuit, a sharpness correction circuit, a contrast correction circuit, a white balance correction circuit, an outline processing section for performing imaging processing including outline correction for a taken image, a noise reduction processing section for performing noise reduction processing of an image and the like, and it processes an image signal in accordance with a command from the CPU 10.
The image data inputted into the signal processing circuit is converted to a brightness signal (Y signal) and a color difference signal (Cr/Cb signal), and the signals are stored in the VRAM after predetermined processings such as gamma correction is performed therefor.
When the monitor output of a taken image to the display section 13 is performed, a Y/C signal is read from the VRAM and sent to a display control section 26. The display control section 26 converts the inputted Y/C signal to a signal of a predetermined method for display (for example, a compound color picture signal of an NTSC method) and outputs it to the display section 13.
The Y/C signals of respective frames which have been processed at a predetermined frame rate are written in an A area and a B area of the VRAM alternatively, and a written Y/C signal is read not from the area in which a Y/C signal is being written but from the other area, between the A and B areas. By the Y/C signals in the VRAM being periodically overwritten, and picture signals generated from the Y/C signals being provided for the display section 13, the picture being taken is displayed on the display section 13 in real time. The user can confirm the image-taking angle of field by the picture (live images) displayed on the display section 13.
Here, when a photographing key provided on the operation section 14 is pressed, a photographing operation for storage is started. Image data acquired in response to the pressing of the photographing key is converted to a brightness/color difference signal (Y/C signal) in the signal processing circuit, and it is stored in the RAM 11 after predetermined processings such as gamma correction are performed therefor.
The Y/C signal stored in the RAM 11 is compressed in accordance with a predetermined format by a compression/expansion processing circuit and then stored in a memory card 27 as an image file in a predetermined format such as an Exif file. The image file can also be stored in a flash memory 28.
When the reproduction mode is set by the operation section 14, the compressed data of the final image file stored in the flash memory 28 (a file stored last) is read. When the file stored last is a still image file, the read compressed image data is expanded to an uncompressed Y/C signal via the compression/expansion processing circuit and stored in the VRAM. The Y/C signal stored in the VRAM is added to the display control section 26. The display control section 26 creates a compound RGB color picture signal of the NTSC method from the inputted Y/C signal and outputs it to the display section 13. Thereby, the frame image of the last frame stored in the memory card 27 is displayed on the display section 13.
After that, when the right key of a cross key provided on the operation section 14 is pressed, frame advancing is performed in the forward direction, and when the left key of the cross key is pressed, frame returning is performed in the opposite direction. Then, an image file at the frame position set by the frame advancing or returning is read from the memory card 27, and a frame image is reproduced on the display section 13 similarly as described above. If frame advancing is performed in the forward direction when the frame image of the last frame is displayed, the image file of the first frame stored in the memory card 27 is read, and the frame image of the first frame is reproduced on the display section 13.
The number of pixels of an image file to be stored is, for example, any of 2832×2128(6 M), 2048×1536 (3 M), 1280×960 (1 M) and 640×480 (VGA), and the amount of data of a taken image (the file size) changes according to the combination of the stored image quality and the number of stored pixels.
The remote control transmission/reception section 22 has a light-receiving element. Although
The remote control signal control section 23 converts device-specific information superimposed on an optical signal which is incident on the remote control transmission/reception section 22 from the external device 2 into digital data and outputs it to the CPU 10.
The CPU 10 retrieves a table defining control codes specific for the device 2 which is identified by the device-specific information from the ROM 12 into the RAM 11 in accordance with the device-specific information input from the remote control signal control section 23. Then, the CPU 10 retrieves a control code for the particular device 2 corresponding to an operation on the operation section 14 from the RAM 11 and sends the code to the remote control signal control section 23.
The remote control transmission/reception section 22 has an optical signal transmission device, which may be a light emitting diode, an infrared LED or the like. The remote control signal control section 23 transmits an optical signal on which a control code designated by the CPU 10 and other data are superimposed to the device 2. In this manner, a particular device 2 can be remotely operated through the operation section 14 by transmitting an optical control signal from the image storage apparatus 1 to the device 2.
The image storage apparatus 1 also has a radio transmission/reception section 17 which transmits/receives radio signals such as mobile communication radio wave, IrDA, Bluetooth, wireless LAN, Wireless USB to/from the base station 8 or the wireless station 4, a radio control section 16 which converts a received radio signal into data and sends it to the CPU 10 and/or superimposes a remote control signal designated by the CPU 10 onto a radio signal, and an external interface section 15 which communicates with various consumer electronics such as personal computers and printers in conformity with USB or other standards.
The CPU 10 can retrieve a control code for a particular device 2 corresponding to an operation on the operation section 14 from the RAM 11 and send it also to the radio control section 16. The radio control section 16 transmits a radio signal on which the control code input from the CPU 10 and other data are superimposed to the device 2. The radio signal is received by the wireless station 4 or the base station 8 to reach the device 2 via the LAN 3 or an external network. Upon receiving the control code, the device 2 performs an operation corresponding to the control code. In this manner, a particular device 2 can also be remotely operated through the operation section 14 by transmitting a radio signal from the image storage apparatus 1 to the device 2.
The image storage apparatus 1 has a voice input/output section 19 that includes a sounding device which makes a sound, e.g., a speaker, and a voice receiving device which receives sound and converts it to an electrical signal, e.g., a microphone, and a voice control section 18 which controls what is sounded from the sounding device.
The CPU 10 can also retrieve a control code for a particular device 2 corresponding to sound received by the voice input/output section 19 from the RAM 11 and send it to the remote control signal control section 23 or the radio control section 16. That is, a control code which will be transmitted as an optical signal or radio signal to a particular device 2 can also be designated through voice input, in addition to input operation to the operation section 14.
The CPU 10 also determines whether a control code should be transmitted from the remote control signal transmission/reception section 22 or the radio transmission/reception section 17 in accordance with an input operation to the operation section 14 or speech to the voice input/output section 19. When the image storage apparatus 1 is in front of the device 2 which is to be controlled, a control code may be transmitted from the remote control signal transmission/reception section 22. However, if this is not the case, the user instructs the CPU 10 to transmit a control code from the radio transmission/reception section 17 through an input operation to the operation section 14 and/or speech to the voice input/output section 19. The CPU 10 performs control so that the radio transmission/reception section 17 transmits the control code in accordance with the instruction.
First, at S1, the CPU 10 instructs the camera control section 21 to start operation of still image acquisition in accordance an image-taking instruction input to the operation section 14. The camera control section 21 controls the camera section 20 to obtain a still image and device-specific information. The still image is once stored in the RAM 11.
At S2, the CPU 10 identifies the image obtained by the camera section 20 and devices 2 contained in the image as subjects based on the device-specific information.
At S3, the CPU 10 stores the image and device-specific information obtained by the camera section 20 and identified devices 2 by associating them with one another in a non-volatile storage medium such as a memory card 27 and a flash memory 28. One or more still images may be stored.
At S11, the CPU 10 instructs the display control section 26 to retrieve a still image stored in the non-volatile storage medium into the RAM 11 through an operation image acquisition process and display it on the display section 13. If there are a plurality of still images, a desired one of them is selected through manual input to the operation section 14 or speech input to the voice input/output section 19 and the selected still image is displayed.
At S12, the CPU 10 prompts the user with indication on the display section 13 or voice guidance from the voice input/output section 19 to select a device 2 which the user wants to remotely control from among devices 2 stored in the non-volatile storage medium corresponding to the image by performing manual input to the operation section 14 or speech input to the voice input/output section 19. The CPU 10 selects a device 2 according to the user's manual input to the operation section 14 or speech input to the voice input/output section 19.
At S13, the CPU 10 retrieves a control program for the selected device 2 from the ROM 12 to the RAM 11 and executes it. In accordance with instructions from the control program, the CPU 10 retrieves a GUI corresponding to the selected device 2 from the ROM 12 to the RAM 11 and instructs the display control section 26 to display the GUI on the display section 13. The GUI may be displayed overlapping on an image.
At S14, the CPU 10 instructs the remote control signal control section 23 to transmit a control code prescribing a desired control operation from the remote control signal transmission/reception section 22, the radio transmission/reception section 17, or the external interface section 15 to the selected device 2 in accordance with manual input to the operation section 14 or speech input to the voice input/output section 19.
In this manner, the image storage apparatus 1 obtains a still image of the device 2 as a subject and device-specific information transmitted from the device 2 through image-taking operations of the camera section 20. The still image obtained and devices 2 identified by the device-specific information are stored being associated with each other. Then, the image storage apparatus 1 displays the stored still image and prompts the user to select a desired one from devices 2 corresponding to the still image and transmits a desired control code to the selected device 2 to remotely control the device 2.
Remote operation of a desired device 2 from any position can be realized by sending a desired control code from the radio transmission/reception section 17 to the device 2 based on an image and device-specific information which are previously stored, instead of the image storage apparatus 1 obtaining device-specific information from the device 2 in front of the device 2.
First, at S21, the CPU 10 instructs the camera control section 21 to start a still image acquisition operation in accordance with an image-taking instruction inputted to the operation section 14. The camera control section 21 controls the camera section 20 to obtain a still image and device-specific information.
At S22, the CPU 10 identifies devices 2 contained in the still image as subjects based on the image and device-specific information obtained by the camera section 20. The device-specific information contains the address of the devices 2 on the LAN 3.
At S23, the CPU 10 requests, for the address of each of the devices 2, information on control of the device 2, such as its status, a control code table, a control program, a GUI, a program and/or a document describing how to operate the device 2, and receives information transmitted in response to the request.
At S24, the CPU 10 stores the image and device-specific information obtained by the camera section 20, and information on control of the devices 2 in a non-volatile storage medium associating them with one another.
In this manner, remote control of the device 2 is further facilitated by obtaining information on control of the device 2 via the LAN 3 after acquisition of an image and device-specific information, storing the control information together with the image, and utilizing the information when the device 2 is actually operated.
The image storage apparatus 1 performs an operation image acquisition process which is similar to that in the second embodiment. However, at S23, the image storage apparatus 1 requests information on control of the device 2 for the server 30, not the device 2, and in response to the request, the server 30 extracts information on control of the device 2 from a device operation database 31 and sends it to the image storage apparatus 1. The image storage apparatus 1 receives the information on control of the device 2 from the server 30 and stores it in a non-volatile storage medium associating it with an image and device-specific information.
This eliminates the necessity for the device 2 to maintain information on its control by itself and enables the server 30 to send the latest information.
The address of the server 30 may be prestored in the ROM 12 of the image storage apparatus 1 or transmitted to the image storage apparatus 1 being included in device-specific information transmitted by the specific information transmission section 21 of the device 2.
At S23, the specific information transmission section 21 of the device 2 transmits the address of the server 30 including it in device-specific information. The image storage apparatus 1 recognizes the address of the server 30 from the device-specific information. Alternatively, even if only the address of the device 2 is included in device-specific information, the image storage apparatus 1 may request the device 2 over the LAN 3 to send the address of the server 30 to have the device 2 transmit the address of the server 30 over the LAN 3. The image storage apparatus 1 accesses the address of the server 30 transmitted from the device 2 and requests information on control of the device 2. In response to the request, the server 30 sends information on control of the device 2 to the image storage apparatus 1. The image storage apparatus 1 receives the information on control of the device 2 from the server 30.
This enables the image storage apparatus 1 to access the server 30 of a corresponding manufacturer for any device 2 to obtain the latest information on the device 2 as long as the device 2 can send the address of the server 30.
In a remote operation process of the first embodiment, the user can also designate by voice a device 2 which the user wants to operate.
At S31, the CPU 10 instructs the display control section 26 to display a still image stored in a non-volatile storage medium on the display section 13 through an operation image acquisition process. If there are a plurality of still images, the user is prompted to select a desired one of them through speech input to the voice input/output section 19 and the selected still image is displayed.
At S32, in accordance with an instruction to select a device 2 which is given through speech input to the voice input/output section 19 (e.g., an utterance specifying a device type such as “Video”), the CPU 10 selects a device 2 which the user wants to remotely operate from among devices 2 corresponding to the image.
At S33, the CPU 10 retrieves a GUI corresponding to the selected device 2 from the ROM 12 to the RAM 11 and instructs the display control section 26 to display the GUI on the display section 13.
At S34, the CPU 10 transmits a control code to the selected device 2 from the remote control signal transmission/reception section 22, the radio transmission/reception section 17, or the external interface section 15 in accordance with the contents of speech input to the voice input/output section 19 which is recognized by the voice control section 18. For example, if an utterance “Replay” is input to the voice input/output section 19 and the voice control section 18 correspondingly recognizes a word “replay”, the CPU 10 instructs the remote control signal control section 23 and the like to transmit a control code for starting reproduction of an image to a device 2 which is a “video cassette recorder”.
In addition, request for information on control of the device 2 from the server 30 of the third embodiment may also be done based on speech input to the voice input/output section 19.
In an operation image acquisition process of the first embodiment, it is also possible to audibly inform acquisition of an image, the type of a device 2 which is identified by device-specific information, an operation procedure, and an operation result.
At S41, the CPU 10 instructs the camera control section 21 to start acquisition of a still image in accordance with an image-taking instruction input to the operation section 14 or the voice input/output section 19. The camera control section 21 controls the camera section 20 to obtain a still image and device-specific information. The still image and device-specific information are once stored in the RAM 11. When storage of the image completes, the CPU 10 instructs the voice control section 18 to sound a guidance message informing completion of storage of the image, e.g., “You've taken a picture”, from the voice input/output section 19.
At S42, the CPU 10 identifies devices 2 based on the device-specific information in the RAM 11. When identification of devices 2 is complete, the CPU 10 instructs the voice control section 18 to sound a guidance message for informing the type of the identified devices 2 and confirming whether the image should be stored or not, e.g., “There are a television and a VCR. Do you want to store them?”, from the voice input/output section 19.
At S43, in accordance with an instruction to store the image which is input to the operation section 14 or the voice input/output section 19, the CPU 10 stores the image and device-specific information for the devices 2 obtained by the camera section 20 in a non-volatile storage medium associating them with each other.
Further, in a remote operation process, processing is done in a flow described below when the user designates by voice a device 2 which the user wants to remotely operate.
At S51, the CPU 10 instructs the display control section 26 to display a still image stored in a non-volatile storage medium on the display section 13 through an operation image acquisition process. In this process, the CPU 10 instructs the voice control section 18 to sound a guidance message informing the type of devices 2 which are identified by device-specific information in the non-volatile storage medium, e.g., “There are a television and a video”, from the voice input/output section 19.
At S52, the CPU 10 selects a device 2 which the user wants to remotely operate in accordance with an instruction to select a device 2 which is given through speech input to the voice input/output section 19 (e.g., an utterance designating a device type, such as “Video”.)
At S53, the CPU 10 retrieves a GUI corresponding to the selected device 2 (e.g., a selection menu for selecting Replay, Pause, or Eject, which are remote control codes for a “video”) from the ROM 12 into the RAM 11 and instructs the display control section 26 to display the GUI on the display section 13.
At S54, the CPU 10 instructs the remote control signal control section 23 to transmit a control code to the selected device 2 in accordance with speech input to the voice input/output section 19 from the remote control signal transmission/reception section 22, the radio transmission/reception section 17, or the external interface section 15. For example, when an utterance “Replay” is input to the voice input/output section 19, the CPU 10 instructs the remote control signal control section 23 and the like to transmit a control code for starting reproduction of an image to a device 2 which is a “video cassette recorder”.
As described above, voice guidance or voice instruction for remote control may also be enabled.
Number | Date | Country | Kind |
---|---|---|---|
2006-084029 | Mar 2006 | JP | national |