Patent Grant
7254776
The disclosures of the following priority applications are herein incorporated by reference:
Japanese Application No. 8-326545, filed Dec. 6, 1996; and
Japanese Application No. 9-096906, filed Apr. 15, 1997.
1. Field of Invention
The present invention relates to an information processing apparatus such as an information processing apparatus that can efficiently perform input and display of images of different resolutions.
2. Description of Related Art
In recent years, electronic cameras have come to be used in place of cameras using film such that images of objects are photographed using a CCD and are converted into digital data and stored in internal memory and removable memory cards. The photographed images can be reproduced and displayed on an LCD (or CRT screen) without undergoing development and printing as in conventional cameras. The photographed images can be transferred to a personal computer, displayed on the screen and stored on the hard disk of the personal computer.
Images of photographs and film can be input using a scanner and subsequently displayed on an LCD or CRT screen or can be read into a personal computer and displayed on the screen and stored on the hard disk of the personal computer.
Many pixels are required to represent landscapes and the like. For example, approximately one million pixels are required to photograph an ordinary “cabinet” sized photograph. On the other hand, not as many pixels are required to represent characters that are input into the same cabinet size area, for example, by a pen.
Consequently, there is a problem when inputting line drawings by pen along with inputting images and having the images and line drawings displayed superimposed at the same resolution. This becomes an inefficient system due to the different resolutions of the images and the line drawings.
For example, when line drawings of characters input by hand are to be superimposed on images read in by electronic cameras and scanners, wasteful memory space may be used to input the line drawings beyond the necessary resolution.
The present invention was made in consideration of such conditions and is intended to efficiently display images of different resolutions on the same apparatus at the specified resolution.
An information processing apparatus is provided that outputs a first image and a second image overlaid on the first image. The information processing apparatus may include a first output device (e.g., an image memory area) that outputs the first image and a second output device (e.g., a line drawing memory area) that outputs the second image overlaid on the first image. The first output device outputs the first image at a first resolution and the second output device outputs the second image at a second resolution different from the first resolution.
The image processing apparatus may further include a display device (e.g., a monitor) that displays the first image and the second image.
The smaller resolution of the first resolution and the second resolution may match the resolution of the display device.
Further, the larger resolution of the first resolution and the second resolution may match the resolution of the display device.
In at least one embodiment, the information processing apparatus may include a first image input device (e.g., a CCD) that inputs a first image, a first filter device (e.g., an optical low-pass filter) that eliminates the high spatial frequency component of the first image and a first memory device (e.g., the image memory area) that records the first image having the high spatial frequency component eliminated by the first filter device.
Additionally, the information processing apparatus may include a second image input device (e.g., a touch tablet and pen) that inputs a second image, a second filter device (e.g., a low-pass filter) that eliminates the high spatial frequency component of the second image and a second memory device (e.g., the line drawing memory area) that records the second image having the high spatial frequency component eliminated by the second filter device. An interpolation device (e.g., a CPU) may interpolate the second image recorded by the second memory device and a third filter device (e.g., a low-pass filter) may eliminate the high spatial frequency component of the first image output by the first memory device and the second image interpolated by the interpolation device. An output device (e.g., an LCD) may output a third image having superimposed the first image (having the high spatial frequency component eliminated by the third filter device) and the second image (having the high spatial frequency component eliminated by the third filter device).
In at least one embodiment, the information processing apparatus may include a first image input device (e.g., a CCD) that inputs a first image, a first filter device (e.g., an optical low-pass filter) that eliminates the high spatial frequency component of the first image and a first memory device (e.g., an image memory area) that records the first image having the high spatial frequency component eliminated by the first filter device. The information processing apparatus may also include a second image input device (e.g., a touch tablet and pen) that inputs a second image, a second filter device (e.g., a low-pass filter) that eliminates the high spatial frequency component of the second image and a second memory device (e.g., a line drawing memory area) that records the second image having the high spatial frequency component eliminated by the second filter device. An interpolation device (e.g., an interpolation circuit) may interpolate the second image recorded by the second memory device. An output device (e.g., a frame memory) may output a third image having superimposed the first image recorded by the first memory device and the second image interpolated by the interpolation device.
In at least one embodiment, the information processing apparatus may include a first image input device (e.g., a CCD) that inputs a first image, a first filter device (e.g., an optical low-pass filter) that eliminates the high spatial frequency component of the first image and a first memory device (e.g., an image memory area) that records the first image having the high spatial frequency component eliminated by the first filter device. A second image input device (e.g., the touch tablet and pen) may input a second image and a second filter device (e.g., a low-pass filter) may eliminate the high spatial frequency component of the second image. A second memory device (e.g., a line drawing memory) may record the second image having the high spatial frequency component eliminated by the second filter device. An interpolation device (e.g., the interpolation circuit) may interpolate the second image recorded by the second memory device and a pixel thinning device (e.g., a low-pass filter) may perform pixel thinning on the first image recorded by the first memory device. An output device (e.g., a frame memory) may output a third image having superimposed the first image having undergone processing by the pixel thinning device and the interpolated second image recorded by the second memory device.
A display device (e.g., a monitor) may display the third image output by the output device.
The first image may be a photographic image and the second image may be a line drawing.
The capacity of the first memory device may be greater than the capacity of the second memory device.
Further, the resolution of the first image may be higher than the resolution of the second image.
The first output device may output a first image and the second output device may output a second image overlaid on the first image. The first output device outputs the first image at a first resolution and the second output device outputs the second image at a second resolution different from the first resolution.
The first image input device may input a first image. The first filter device may eliminate the high spatial frequency component of the first image. Additionally, the first memory device may record the first image having the high spatial frequency component eliminated by the first filter device. The second image input device may input a second image and the second filter device may eliminate the high spatial frequency component of the second image. The second memory device may record the second image having the high spatial frequency component eliminated by the second filter device. The interpolation device may interpolate the second image recorded by the second memory device and the third filter device may eliminate the high spatial frequency component of the first image output by the first memory device and the second image interpolated by the interpolation device. The output device may output a third image having superimposed the first image having the high spatial frequency component eliminated by the third filter device and the second image having the high spatial frequency component eliminated by the third filter device.
The first image input device may input a first image and the first filter device may eliminate the high spatial frequency component of the first image. The first memory device may record the first image having the high spatial frequency component eliminated by the first filter device and the second image input device may input a second image. The second filter device may eliminate the high spatial frequency component of the second image and the second memory device may record the second image having the high spatial frequency component eliminated by the second filter device. The interpolation device may interpolate the second image recorded by the second memory device. Additionally, the output device may output a third image having superimposed the first image recorded by the first memory device and the second image interpolated by the interpolation device.
Still further, the first image input device may input a first image and the first filter device may eliminate the high spatial frequency component of the first image. The first memory device may record the first image having the high spatial frequency component eliminated by the first filter device. The second image input device may input a second image and the second filter device may eliminate the high spatial frequency component of the second image. The second memory device may record the second image having the high spatial frequency component eliminated by the second filter device. The interpolation device may interpolate the second image recorded by the second memory device. The pixel thinning device may perform pixel thinning on the first image recorded by the first memory device and the output device may output a third image having superimposed the first image having undergone processing by the pixel thinning device and the interpolated second image recorded by the second memory device.
A program may be recorded on a recording medium used in an information processing apparatus that outputs a first image and a second image overlaid on the first image. The program controls the apparatus so that the first image is output in a first resolution and the second image is output in a second resolution different from the first resolution.
Other objects, advantages and salient features of the invention will become apparent from the following detailed description taken in conjunction with the annexed drawings, which disclose preferred embodiments of the invention.
The invention will be described with reference to the following drawings in which like reference numerals refer to like elements and wherein:
Furthermore, a red-eye reduction (RER) LED 15 is provided on face X1 that reduces red-eye by emitting light before the strobe 4 flashes when performing photography. A photometry device 16 performs photometry when action of the CCD 20 (
Meanwhile, viewfinder 2 and speaker 5 that outputs sound corresponding to sound data recorded on a memory card are provided on the upper end of face X2 opposite face X1. LCD 6 and operating keys 7 are formed vertically below the viewfinder 2, photographic lens 3, flash component 4 and speaker 5. A touch tablet 6A is provided on the surface of the LCD 6 in which the positions indicated by contact operations of a pen-type pointing device are input as information.
The touch tablet 6A may be made of a transparent material such as glass, resin, or the like. The user may observe the images displayed to the LCD 6 formed beneath the touch tablet 6A.
The operating keys 7 are operated when reproducing and displaying recorded data to the LCD 6. The operating keys 7 sense operations input by the user and provide signals to the CPU 39.
The menu key 7A is operated when displaying menu screens to the LCD 6. The execute (run) key 7B is operated when reproducing the recorded information selected by the user.
The cancel key 7C is operated when aborting reproduction processing of the recorded data. The delete key 7D is operated when deleting recorded data. The scroll key 7E is operated when scrolling the screens up and down when lists of the recorded data are displayed on the LCD 6.
Freely slideable LCD cover 14 is also provided to protect the LCD 6 when not in use. The LCD cover 14 may be moved vertically upward (
Microphone 8 is provided on face Z on top of the electronic camera 1 to collect sound while an earphone jack 9 is provided for connecting to an earphone.
Face Y1 includes a release switch 10 operated when photographing objects and a continuous mode switch 13 operated when switching the continuous mode during photography. The release switch 10 and continuous mode switch 13 are vertically below the viewfinder 2, photographic lens 3 and flash component 4 provided on the upper end of face X1.
Face Y2 (right face opposite face Y1) includes a sound recording switch 12 operated when recording sounds and a power switch 11 that switches the power supply on and off. The sound recording switch 12 and power switch 11 are vertically below the viewfinder 2, photographic lens 3 and flash component 4 provided on the upper end of face X1. The sound recording switch 12 may be formed at the same height as the release switch 10 on face Y1 and formed such that there is no feeling of incongruity when held by either the left or right hand.
Alternatively, different heights of the sound recording switch 12 and the release switch 10 can be provided such that one switch is not accidentally pressed when pressing a switch on the other side.
The continuous mode switch 13 may be used to photograph the object in only one frame or to photograph it in a fixed plurality of frames when the user photographs the object by pressing the release switch 10. For example, when the continuous mode switch 13 is switched to the position “S” (i.e., switched to S mode), only one frame of photography is performed when the release switch 10 is pressed.
When the continuous mode switch 13 is switched to the position “L” (i.e., switched to L mode), photography of 8 frames per second is performed during the period when the release switch 10 is pressed (i.e., low-speed continuous mode photography is performed).
Furthermore, when the continuous mode switch 13 is switched to the position “H” (i.e., switched to H mode), photography of 30 frames per second is performed during the period when the release switch 10 is pressed (i.e., high-speed continuous mode photography is performed).
The internal structure of the electronic camera 1 will now be explained.
An in-viewfinder display 26 is placed inside the visual field of the viewfinder 2 to display the setting status of various functions for the user viewing the object through the viewfinder 2.
Four cylindrical batteries (size AA dry cells) 21 are arranged vertically below the LCD 6. The electric power accumulated in these batteries 21 is supplied to each component. Also, a condenser 22 that accumulates the load required when the flash component 4 flashes light is located alongside the batteries 21.
Various control circuits are formed on a circuit board 23 that control each component of the electronic camera 1. A removable memory card 24 is provided between the circuit board 23 and the LCD 6 and batteries 21. Various types of information input into this electronic camera 1 are recorded variously in predefined areas of the memory card 24.
An LCD switch 25 adjacent to the power switch 11 is placed in the on state only while its plunger is pressed. As shown in
When the LCD cover 14 is moved vertically upward, the power switch 11 can be operated independently of the LCD switch 25 by the user. For example, when the LCD cover 14 is closed and the electronic camera 1 is not used, as shown in
In a preferred embodiment, the memory card 24 is removable, and memory may be provided on the circuit board 23 such that various types of information can be recorded in that memory. The various types of information recorded in memory (memory card 24) may be output to a personal computer via an interface (not shown).
The internal electrical structure of the information input apparatus of a preferred embodiment will now be explained with reference to
An image processor 31 is controlled by the CPU 39 to sample the image signals photoelectrically converted by the CCD 20 in a predetermined timing and amplify the sampled signals to predefined levels. An analog/digital conversion circuit (hereafter A/D conversion circuit) 32 digitizes the image signals sampled by the image processor 31 and provides the digital signals to the DSP 33.
The DSP 33 controls the data bus connected to the buffer memory 36 and memory card 24, and after temporarily storing the image data provided to the DSP 33 from the A/D conversion circuit 32 in the buffer memory 36, it reads out the image data stored in the buffer memory 36 and records it in the memory card 24. The memory card 24 includes an image memory area 24A and a line drawing memory area 24B. The image data is recorded in the image memory area 24A and the line drawing data is recorded in the line drawing memory area 24B.
Also, the DSP 33 in addition to having the image data provided from the A/D conversion circuit 32 stored in the frame memory 35, provided to the LCD 6 via a low-pass filter 62, and displayed to the LCD 6, reads out the photographic image data from the memory card 24, and after expanding (decompressing) the photographic image data, stores expanded image data in the frame memory 35, provides the data to the LCD 6 via the low-pass filter 62, and has the corresponding images displayed on the LCD 6. The low-pass filter 62 eliminates the high spatial frequency component of the image data provided by the frame memory 35, and provides it to the LCD 6.
When the electronic camera 1 is started, the DSP 33 repeatedly activates the CCD 20 while adjusting the exposure time (exposure value) until the exposure level of the CCD 20 reaches the proper level. At this time, the DSP 33 may first activate the photometry circuit 51 and then calculate the initial value of the exposure time of the CCD 20 in response to the photoreceptive level detected by the photometry device 16. By doing this, adjustment of the exposure time of the CCD 20 can be shortened.
The DSP 33 performs timing management of the data input/output during recording to the memory card 24 and storage to the buffer memory 36 of the expanded image data.
The buffer memory 36 is used for accommodating the difference between the speed of data input/output of the memory card 24 and the processing speed in the CPU 39 and the DSP 33.
The microphone 8 inputs sound information, which is provided to the A/D and D/A conversion circuit 42.
The A/D and D/A conversion circuit 42 converts the analog signals corresponding to the sound detected by the microphone 8 into digital signals and then provides those digital signals to the CPU 39 and also converts the digital signals provided from the CPU 39 into analog signals and outputs the analog sound signals to the speaker 5.
The photometry device 16 measures luminosity of the object and the surroundings, and outputs those measurement results to the photometry circuit 51. The photometry circuit 51 applies specified processing to the analog signals (i.e., the photometry results provided by the photometry device 16) and then converts the processed analog signals to digital signals, and then outputs those digital signals to the CPU 39.
The colorimetry device 17 measures the color temperature of the object and the surroundings, and outputs the measurement results to the colorimetry circuit 52. The colorimetry circuit 52 applies specified processing to the analog signals (i.e., the colorimetry results provided by the colorimetry device 17) and then converts the processed analog signals to digital signals and outputs those digital signals to the CPU 39.
A timer 45 with a built-in clock circuit outputs the data corresponding to the current time (date and time) to the CPU 39.
A stop drive circuit 53 sets the aperture diameter of the stop 54 to a specified value. The stop 54 is positioned between the photographic lens 3 and the CCD 20 to modify the aperture of the light entering the CCD 20 through the photographic lens 3.
The CPU 39 stops operations of the photometry circuit 51 and the colorimetry circuit 52 when the LCD cover 14 is open according to signals from the LCD switch 25. The CPU 39 activates the photometry circuit 51 and the colorimetry circuit 52 while halting the action of the CCD 20 (e.g., the action of the electronic shutter) until the release switch 10 reaches the half-pressed state when the LCD cover 14 is closed.
The CPU 39 controls the photometry circuit 51 and the colorimetry circuit 52 when action of the CCD 20 is halted and receives the photometry results of the photometry device 16 and the colorimetry results of the colorimetry device 17.
The CPU 39 refers to a specified table, calculates the white balance corresponding to the color temperature provided by the colorimetry circuit, and provides the white balance adjusted value to the image processor 31.
When the LCD cover 14 is closed, operation of the CCD 20 is halted because the LCD 6 is not used as an electronic viewfinder. Halting operation of the CCD 20 conserves electric power of the batteries 21 because the CCD 20 consumes a large amount of electric power.
Also, when the LCD cover 14 is closed, the CPU 39 controls the image processor 31 so as not to execute processing until the release switch 10 is operated (i.e., until the release switch 10 becomes the half-depressed state).
When the LCD cover 14 is closed, the CPU 39 controls the stop drive circuit 53 so as not to change the aperture diameter of the stop 54 until the release switch 10 is operated (i.e., until the release switch 10 becomes the half-depressed state).
In addition to controlling the strobe drive circuit (driver 37) so that it causes the strobe 4 to flash appropriately, the CPU 39 controls the red-eye reduction LED drive circuit (driver) 38 to cause the red-eye reduction LED 15 to emit light prior to firing the strobe 4.
When the LCD cover 14 is open, (i.e., when the electronic viewfinder is being used), the CPU 39 prevents the strobe 4 from flashing. Thus, it is possible to photograph the object in the same state as it is displayed in the electronic viewfinder.
The CPU 39 records data and time information in the image memory area 24A of the memory card 24 as header information according to timer 45. In other words, the photographic image data recorded in the image memory area 24A contains photographic date and time data.
After the digitized sound information is compressed, the sound data is temporarily stored in the buffer memory 36 by the CPU 39 and is recorded in a specified area (i.e., sound recording area) of the memory card 24. The recording date and time data may also be recorded as header information of the sound data in the sound recording area of the memory card 24.
The CPU 39 controls the lens drive circuit (driver) 30 to perform autofocus operations by moving the photographic lens 3, and controls the stop drive circuit 53 to change the aperture diameter of the stop 54 positioned between the photographic lens 3 and the CCD 20.
The CPU 39 may control the in-viewfinder display circuit 40 to display the settings of the various actions on the in-viewfinder display 26.
The CPU 39 performs data receipt from external equipment (not shown) via the interface (I/F) 48.
The CPU 39 receives signals from operating keys 7 and touch tablet 6A and processes them appropriately.
When a specified position of the touch tablet 6A is pressed by the pen (or pen-type pointing device) 41, the CPU 39 reads the X-Y coordinates of the pressed position and has that coordinate data (i.e., the memo information described later) stored in the buffer memory 36. A low-pass filter 61 may be provided between the CPU 39 and the touch tablet 6A to eliminate the high spatial frequency component of the memo information provided from the touch tablet 6A. The CPU 39 has the memo information stored in the buffer memory 36 recorded in the line drawing memory area 24B of the memory card 24 along with header information such as date and time of the memo information.
Various operations of the electronic camera 1 of a preferred embodiment will now be explained. First, operation of the electronic viewfinder of LCD 6 will be explained.
In a state in which the release switch 10 is half-depressed by the user, the DSP 33 determines whether the LCD cover 14 is open based on the signal value provided by the CPU 39 corresponding to the state of the LCD switch 25. When the LCD cover 14 is closed, operation of the electronic viewfinder is not performed. In such a case, the DSP 33 halts processing until the release switch 10 is operated.
Because operation of the electronic viewfinder is not performed when the LCD cover 14 is closed, the CPU 39 halts operations of the CCD 20, the image processor 31 and the stop drive circuit 53. Also, the CPU 39 activates the photometry circuit 51 and the colorimetry circuit 52 and provides those measurement results to the image processor 31. The image processor 31 uses the measurement results when controlling the white balance and brightness.
Also, when the release switch 10 is operated, the CPU 39 activates the CCD 20 and the stop drive circuit 53.
On the other hand, when the LCD cover 14 is open, the CCD 20 performs an electronic shutter action at the specified exposure time for each specified time and photoelectrically converts the optical (light) images of the objects collected by the photographic lens 3 to electric signals. The CCD 20 then outputs the image signals obtained through that operation to the image processor 31.
The image processor 31 performs white balance control and brightness control, applies specified processing to the image signals, and then outputs the image signals to the A/D conversion circuit 32. When the CCD 20 is operating, the image processor 31 uses an adjusted value used for white balance control and brightness control calculated by the CPU 39 using the output of the CCD 20.
The A/D conversion circuit 32 converts the image signals (analog signals) to image data (digital signals) and outputs the data to the DSP 33.
The DSP 33 outputs the digital image data to the frame memory 35 and has the images corresponding to the digital image data displayed to the LCD 6.
Thus, when the LCD cover 14 is open, operation of the electronic viewfinder is performed whereby the CCD 20 performs the shutter action in the specified time interval and converts the signals output from the CCD 20 to digital image data. The image data is output to the frame memory 35 and images of the objects are continuously displayed to the LCD 6.
When the LCD cover 14 is closed, operation of electronic viewfinder is not performed and power consumption is conserved by halting operations of the CCD 20, image processor 31, and stop drive circuit 53.
Photography of objects using the present apparatus will now be explained.
A mode in which the continuous mode switch 13 (on face Y2) is switched to the S mode (i.e., the mode in which only one frame is photographed) will now be explained. When power is supplied to the electronic camera 1 by switching the power switch 11 (
When the LCD cover 14 is closed, the CPU 39 starts operations of the CCD 20, image processor 31 and stop drive circuit 53 when the release switch 10 is in the half-depressed state and starts photographic processing when the release switch reaches the fully depressed state.
The light image of the object observed through the viewfinder 2 is collected by the photographic lens 3 and is formed on the CCD 20, which has multiple pixels. The light image of the object formed on the CCD 20 is photoelectrically converted into image signals by each pixel and is sampled by the image processor 31. The image signals sampled by the image processor 31 are provided to the A/D conversion circuit 32, and they are digitized and output to the DSP 33.
After the image data has been temporarily output to the buffer memory 36, the DSP 33 reads the image data from the buffer memory 36, compresses it according to a JPEG (Joint Photographic Experts Group) method in which discrete cosine transformation, quantization, and Huffman encoding are applied, and has the compressed image data stored in the image memory area 24A of the memory card 24. At this time, the photographic date and time data are recorded in the image memory area 24A of the memory card 24 as header information of the photographic image data.
When the continuous mode switch 13 is in the S mode, only one frame of photography is performed. Even if the release switch 10 is continuously pressed, subsequent photography is not performed. When the release switch 10 is continuously depressed while the LCD cover 14 is open, the photographic image is displayed on the LCD 6.
A mode in which the continuous mode switch 13 is switched to the L mode (i.e., the mode in which continuous shooting of 8 frames per second is performed) will now be explained. When power is supplied to the electronic camera 1 by switching the power switch 11 to “ON,” the release switch 10 provided on face Y2 is depressed and photographic processing of the object is started.
When the LCD cover 14 is closed, the CPU 39 starts operations of the CCD 20, the image processor 31 and the stop drive circuit 53 when the release switch 10 is in the half-depressed state, and starts photographic processing when the release switch reaches the fully depressed state.
The light image of the object observed through the viewfinder 2 is collected by the photographic lens 3 and is formed on the CCD 20. The light image of the object formed on the CCD 20 is photoelectrically converted into image signals by each pixel and is sampled by the image processor 31 at a rate of 8 times per second. At this time the image processor 31 thins out ¾ of the pixels in the CCD 20.
In other words, the image processor 31 divides the pixels of the CCD 20, which are arranged in a matrix, into areas of 2×2 pixels (four pixels) as shown in
For example, during the first sampling (first frame), the top left pixel a of each area is sampled and the remaining pixels b, c, and d are thinned out. During the second sampling (second frame), the top right pixel b of each area is sampled and the remaining pixels a, c, and d are thinned out. Following that, during the third and fourth samplings, the bottom left pixel c and the bottom right pixel d are respectively sampled and the other pixels are thinned out. In short, each pixel is sampled every four frames.
The image signals sampled by the image processor 31 (i.e., the image signals of ¼ in the CCD 20) are provided to the A/D conversion circuit 32 and are digitized there before being output to the DSP 33.
After the image data has been temporarily output to the buffer memory 36, the DSP 33 reads the image data from the buffer memory 36, compresses it according to the JPEG method, and then has it stored in the image memory area 24A of the memory card 24. At this time, photographic date and time data are recorded in the image memory area 24A of the memory card 24 as header information of the photographic image data.
A mode in which the continuous mode switch 13 is switched to the H mode (i.e., the mode performing continuous shooting of 30 frames per second) will now be explained. When the power switch 11 is turned “ON” and the release switch 10 is depressed, photographic processing of the object is started.
When the LCD cover 14 is closed, the CPU 39 starts operations of the CCD 20, the image processor 31 and the stop drive circuit 53 when the release switch 10 is in the half-depressed state and starts photographic processing when the release switch reaches the fully depressed state.
The light image of the object observed through the viewfinder 2 is collected by the photographic lens 3 and is formed on the CCD 20. The light image of the object formed on the CCD 20 is photoelectrically converted into image signals by each pixel and is sampled by the image processor 31 at a rate of 30 times per second. At this time, the image processor 31 thins out 8/9 of the pixels of the image in the CCD 20.
In other words, the image processor 31 divides the pixels of the CCD 20 into areas of 3×3 pixels as shown in
For example, during the first sampling (first frame), the top left pixel a of each area is sampled, and the other pixels b through i are thinned out. During the second sampling (second frame), the pixel b located to the right of pixel a is sampled, and the other pixels a and c through i are thinned out. Following that, during the third sampling and so on, the pixel c, pixel d, etc. . . . , are variously sampled, and the other pixels are thinned out. In short, each pixel is sampled every nine frames.
The image signals sampled by the image processor 31 (i.e., the image signals of 1/9 the pixels in the CCD 20) are provided to the A/D conversion circuit 32 and are digitized there before being output to the DSP 33.
After the image data has been temporarily output to the buffer memory 36, the DSP 33 reads out the image data from the buffer memory 36, compresses it according to the JPEG method, and then has it stored in the image memory area 24A of the memory card 24 with the photographic date and time header information.
Light can be projected on the objects by operating the flash component 4. However, when the LCD cover 14 is open (i.e., when the LCD 6 is performing the electronic viewfinder operation) then the CPU 39 can control the strobe 4 to not flash.
Operations when inputting two-dimensional information (i.e., pen input information) from the touch tablet 6A will now be explained.
When the touch tablet 6A is pressed by the pen tip of the pen 41, the X-Y coordinates of the touched locations are input into the CPU 39 and stored in the buffer memory 36. Also, data is written into the locations within the frame memory 35 corresponding to the X-Y coordinates. Memos may be displayed on LCD 6 corresponding to contact of the pen 41.
Because the touch tablet 6A is made of a transparent material, the user can observe the points displayed on the LCD 6 in positions where the pen tip of the pen 41 has pressed the touch tablet 6A. Thus, it appears as if the pen 41 input the images directly on the LCD 6. When the pen 41 is moved while contacting the touch tablet 6A, a line is displayed on the LCD 6 following movement of the pen 41. When intermittently moving the pen 41 on the touch tablet 6A, a broken line is displayed on the LCD 6 following movement of the pen 41. Thus, the user can input the desired memo information such as characters and figures using the touch tablet 6A.
When memo information such as characters are input using the pen 41 while images are displayed on the LCD 6, the memo information is synthesized (combined) in the frame memory 35 along with the image information and is displayed on the LCD 6 at the same time.
The user can select colors of the memos displayed on the LCD 6 from colors such as black, white, red, and blue by operating a palette.
When the execute (run) key 7B of the operating keys 7 is pressed after input of memo information to the touch tablet 6A using the pen 41, the memo information stored in the buffer memory 36 is provided to the memory card 24 along with the input date and time as header information. It is then recorded in the line drawing memory area 24B of the memory card 24.
The memo information recorded on the memory card 24 is information that has undergone compression processing. Because the input memo information includes a great deal of information having a high spatial frequency component, when performing compression processing by the JPEG method the compression efficiency is poor and the amount of information is not reduced. Furthermore, because compression by the JPEG method is lossey compression, it is not suitable for compression of line drawings having a small amount of information because gathering and smearing become prominent due to gaps of the information when decompressed and displayed on the LCD 6.
Thus, in a preferred embodiment, the memo information is compressed by the run-length method as used by facsimile machines. The run-length method is a method of compressing memo information by scanning the line-drawn screen in the horizontal direction and encoding each continuous length of the information of each color (black, white, red, blue and the like) and each continuous length of non-information (the parts having no pen input).
By using this run-length method, it is possible for the memo information to be efficiently compressed to suppress the gaps of information even after decompressing the compressed memo information. When the amount of information of the memo information is comparatively small, it also can be made so as not to compress it.
Also, when memo information is input by the pen 41 while displaying a photographic image on the LCD 6, then the photographic image data and the pen-input memo information are synthesized in the frame memory 35 and a composite image of the photographic image and the memo information is displayed on the LCD 6. Meanwhile, the photographic image data is recorded on the image memory area 24A of the memory card 24 while the memo information is recorded on the line drawing memory area 24B of the memory card 24. Because two different types of information are recorded in the different areas, the user can delete either of the images (e.g., memo information) from the composite image of the photographic image and the memo. In addition, each type of information can be compressed using an individual compression method.
When data is recorded in the sound recording area (not shown), image memory area 24A or line drawing memory area 24B, a list of the recorded data can be displayed on the LCD 6 as shown in
Thumbnail images are displayed on the right side of the recording time when image data is recorded. These thumbnail images are reduced images created by thinning out the bit-mapped data of each image data recorded on the memory card 24. In other words, the information recorded at “10:16” and “10:21” includes image information, and the information recorded at the other times do not include image data.
The memo icon “[□]” indicates that a memo is recorded as line-drawing information.
A sound icon (musical note) is displayed on the right side of the thumbnail image display area and a sound recording duration (number of seconds) is displayed on the sound icon's right. This is not displayed when sound information is not input.
The user selects the sound information to be reproduced by pressing the desired sound icon with the pen tip of the pen 41 and causes reproduction of the selected information by pressing the execute (run) key 7B shown in
For example, when the displayed sound icon at “10:16” shown in
When reproducing image data, the user selects that information by pressing with the pen tip of the pen 41 on the desired thumbnail image, and then presses the execute (run) key 7B.
In other words, the CPU 39 instructs the DSP 33 to read the photographic image data from the memory card 24 corresponding to the recording date and time of the selected thumbnail. The DSP 33 expands the photographic image data (compressed photographic image data) read out from the memory card 24 and has the expanded data stored in the frame memory 35 as bit-mapped data and displayed on the LCD 6.
The images photographed in S mode are displayed as still images on the LCD 6. These still images are those having reproduced the image signals of all the pixels of the CCD 20.
The images photographed in L mode are displayed continuously (as moving pictures) at a rate of 8 frames per second on the LCD 6. At this time, the number of pixels displayed in each frame is ¼ the total number of pixels of the CCD 20.
Ordinarily, because the human eye reacts sensitively to the degradation of the resolution of still images, thinning out of the pixels of still images is observed as a degradation of image quality by the user. Nevertheless, when the continuous shooting speed during photography rises, 8 frames per second being photographed in L mode, and these images are reproduced at a speed of 8 frames per second, the number of pixels of each frame becomes ¼ the number of pixels of the CCD 20. However, because the human eye observes the images at 8 frames per second, the amount of information that enters the human eye in one second is twice that of a still image.
In other words, if the number of pixels of one frame of an image photographed in S mode is 1, then the number of pixels of one frame of an image photographed in L mode is ¼. The amount of information that enters the human eye in one second when the image photographed in S mode (still image) has been displayed to the LCD 6 becomes 1=((1 pixel)×(1 frame)). On the other hand, the amount of information that enters the human eye in one second when the images photographed in L mode are displayed to the LCD 6 becomes 2=((¼ pixels)×(8 frames)). In other words, twice as much information as the still image enters the human eye. Consequently, even though the number of pixels in one frame is ¼, the user can observe the reproduced images without noticing degradation of the image quality.
Furthermore, in at least one preferred embodiment, because each frame samples a different pixel, and those sampled pixels are displayed to the LCD 6, there is an after-image effect in the human eye. Even though ¾ of the pixels per frame have been thinned out, the user can observe the images photographed in L mode on the LCD 6 without noticing degradation of the image quality.
Also, images photographed in H mode are continuously displayed at a rate of 30 frames per second on the LCD 6. At this time, the number of pixels displayed in each frame is 1/9 the total number of pixels of the CCD 20. However, for the same reasons as in L mode, the user can observe the photographed images in H mode on the LCD 6 without noticing degradation of the image quality.
In at least one preferred embodiment, because the image processor 31 thins out the pixels of the CCD 20 to the extent that the degradation of the image quality during reproduction is not noticed when the objects are photographed in L mode and H mode, the load on the DSP 33 can be reduced and the DSP 33 can be operated at low speed and low power. Also, by doing this, it is possible to reduce the cost and power consumption of the apparatus.
It is possible to photograph light images of objects and to record memo (line-drawing) information. In at least one preferred embodiment, there are modes (photographing mode and memo input mode) that are appropriately selected according to operations of the user so that input of information can be performed smoothly.
An optical low-pass filter 60 is provided between the lens 3 and the CCD 20 to eliminate a designated spatial frequency component. The designated spatial frequency component is determined according to the size of the elements of the imaging elements constituting the CCD 20. Ordinarily, if the pixel pitch of the CCD corresponds to N pixels per 1 millimeter (mm), a spatial frequency component higher than N/2 per 1 mm cannot be input. In other words, the spatial frequency component (patterns finer than the pixel interval), contained in the object, which is higher than half the sampling frequency is commonly deleted. If this optical low-pass filter 60 does not exist, moire effects (bending illusions) and false color signals appear in the images and dirty images are recorded when those have been recorded having colors applied where they originally were not.
A ⅓-inch CCD having 640×480 pixels has been developed as a CCD for still imaging. Since the pixel pitch of this CCD is 7.4 microns, the cut-off frequency of the optical low-pass filter 60 is about 67 ((1/0.0074)/2) pixels per 1 mm.
A low-pass filter 61 may be provided between the touch tablet 6A and the CPU 39. When the touch tablet 6A is an analog-type (e.g., when performing input of line drawings by change in resistance when the touch tablet 6A is pressed), the signal levels input from the touch tablet 6A become almost continuously changing values. Nevertheless, when reproducing figures input by pen 41, the resolution should be sufficient so that the figures can be recognized; however, with a higher resolution, it runs up excess memory capacity. Since line drawings are input while confirming by the LCD 6, the resolution during input of the line drawings need not be higher than the resolution of the LCD 6. Conversely, jagged edges become prominent when making the resolution of the line drawings lower than the resolution of the LCD 6.
Thus, if the number of pixels of the LCD 6 is 280×220 pixels, the matrix representing the line drawings is 320×240, which is nearly identical to the number of pixels of the LCD 6.
Lines finer than that (320×240) and the high spatial frequency component that cannot be input are digitally deleted by the low-pass filter 61.
The horizontal-vertical ratio (aspect ratio) of the matrix of the screen is 4:3, which is identical to the aspect ratio of the CCD 20. However, because the aspect ratio of the CCD 20 and the aspect ratio of the LCD 6 are not identical, the aspect ratio of the LCD 6 and the aspect ratio of the matrix of the line drawing are not identical. Furthermore, when having selected matrix values to represent the line drawings, they become the values as discussed above.
The CPU 39 may perform processing of the low-pass filter 61 using software. In this case, the output of the touch tablet 6A is converted into digital signals and read in by the CPU 39 by thinning them out. Then, there is no longer any need to provide a low-pass filter 61 by hardware.
The output of the DSP 33 and the line-drawing information recorded in the line drawing memory area 24B of the memory card 24 are provided to the frame memory 35 having a number of pixels being 640×480 pixels. At the stage where the line-drawing information is input into the frame memory 35, the line drawing represented by a 320×240 pixel matrix is interpolated by the CPU 39 to become a line drawing represented by a 640×480 pixel matrix. The output of the frame memory 35 is input into a low-pass filter 62 along with being output from a video output terminal 63.
A low-pass filter 62 may be provided between the frame memory 35 and the LCD 6. In order to display the 640×480 pixel images imaged by the imaging elements and processed by the DSP 33, and the line drawings having a 640×480 pixel matrix interpolated by the CPU 39, on the LCD 6 with 280×220 pixels, the low-pass filter 62 eliminates their high spatial frequency components.
Moreover, if the value of the matrix showing the line drawing (memo image) as shown in
Thus, the image data and line-drawing data having the high spatial frequency components removed are provided to the LCD 6 such that the corresponding image and line drawing are superimposed displayed.
The memory card 24 can be divided into an image memory area 24A for recording images photographed by the CCD 20 and a line drawing memory area 24B for recording line drawings input from the touch tablet 6A using the pen 41. For each one screen, the side of the photographed image memory area 24A is larger than the line drawing memory area 24B. This is because the amount of information possessed by the line drawings represented by a 320×240 pixel matrix, and the color information of each pixel being represented by 4 bits, is less than the amount of information possessed by the images input by the CCD 20, having 640×480 pixels, and the color information of each pixel being represented by 24 bits. Thus, it is possible to efficiently record information having different amounts of information.
In
The interpolation circuit 73 applies interpolation processing to the line-drawing information and matches the number of pixels of the line-drawing information to the number of pixels of the monitor 76 and then provides it to the frame memory 75. The line-drawing and image information from the frame memory 75 are provided to the monitor 76 where they are displayed superimposed.
That is, because the line-drawing information recorded in the line drawing memory area 24B of the electronic camera 1 has only 320×240 pixels, it may be interpolated by the interpolation circuit 73 into 640×480 pixel line-drawing information and provided to the frame memory 75. Meanwhile, since the image information recorded in the image memory area 24A has a number of pixels identical to the number of pixels of the CCD 20 and the number of pixels of the display area of the monitor 76, it may be provided directly to the frame memory 75 via the interfaces 48 and 71 and the CPU 72. Thus, the line drawing corresponding to the interpolated line-drawing information mentioned above and the image corresponding to the image information are displayed superimposed on the monitor.
If the number of pixels of the image display area of the monitor 76 is less than the number of pixels of the CCD 20 (e.g., 400×300 pixels), then the PC 77 connected to the electronic camera shown in
In
Meanwhile, because the number of pixels of the CCD 20 is more than the number of pixels of the display area of the monitor 76, the image information recorded in the image memory area 24A is provided to the low-pass filter 74 via the interfaces 48 and 71 and the CPU 72. There, the image information is thinned out and is converted into image information having 400×300 pixels. After that, it is provided to the frame memory 75 and the line drawing corresponding to the interpolated line-drawing information mentioned above and the image corresponding to the image information are displayed superimposed on the monitor 76.
By eliminating the useless information contained in the input image information and line-drawing information using a low-pass filter based on the amount of image information input by the CCD 20 and the amount of line-drawing information input using the touch tablet 6A and the pen 41, it is possible to reduce the recording areas necessary for recording the information such that scale reduction, cost reduction and reduction of power consumption of the apparatus become possible.
A PC 77 may be connected to the electronic camera 1 so that the images and line drawings are displayed to the monitor 76 of the PC 77. However it is possible to have them displayed to a television or other display device.
Further, it is possible to make the pixel numbers (resolution) the same to display the superimposed images on the same display by performing an interpolation process using an interpolation circuit 73, the CPU 39 or the like, or a thinning process by low pass filters 62, 74 and the like to the readout of the recorded image information and line drawing information corresponding to the respective information amounts (resolution).
Further, it is possible for the program that performs each process on the CPU 39 to be stored on a ROM 43, memory card 24, or the like of the electronic camera 1. This program may be supplied to the user as previously stored in the ROM 43 or memory card 24. It is further acceptable if it is able to be copied on the ROM 43 or memory card 24 or supplied to the user as stored on a CD-ROM (compact disk-read only memory) or the like. In this case, the ROM 43 may be an electrically rewriteable EEPROM (electrically erasable and programmable read only memory) or the like. The program also can be provided via a communications network, such as the Internet (World Wide Web).
The specific number of pixels used in the above embodiments are examples and the present invention is not limited to those examples.
The information processing apparatus may include a first output device that outputs the first image at a first resolution and a second output device that outputs the second image at a second resolution different from the first resolution. It is therefore possible to use memory areas corresponding to each resolution and to conserve memory.
A first memory device may record the first image having the high spatial frequency component eliminated by a first filter device. A second memory device may record the second image having the high spatial frequency component eliminated by a second filter device. An interpolation device may interpolate the second image recorded by the second memory device. The third filter device eliminates the high spatial frequency components of the first image output by the first memory device and the second image interpolated by the interpolation device. The output device outputs a third image having superimposed the first image with the high spatial frequency component eliminated by the third filter device and the second image having the high spatial frequency component eliminated by the third filter device. Therefore, it is possible to efficiently record images of different resolutions and to display them on the same display device.
A first memory device may record the first image having the high spatial frequency component eliminated by the first filter device. A second memory device may record the second image having the high spatial frequency component eliminated by the second filter device. An interpolation device may interpolate the second image recorded by the second memory device. An output device may output a third image having superimposed the first image output by the first memory device and the second image interpolated by the interpolation device. Therefore, a low-resolution second image may be output by interpolating it to the same resolution as the first image. It is therefore possible to efficiently record images of different resolutions and have them displayed on the same display device.
A first memory device may record the first image having the high spatial frequency component eliminated by a first filter device. A second memory device may record the second image having the high spatial frequency component eliminated by the second filter device. An interpolation device may interpolate the second image recorded by the second memory device. A pixel thinning device may perform pixel thinning on the first image recorded by the first memory device. An output device may output a third image having superimposed the first image having undergone pixel thinning processing by the pixel thinning device and the interpolated second image recorded by the second memory device. Therefore, it is possible to output a first image having a resolution higher than the resolution of the display screen by thinning the pixels and a second image having a resolution lower than the display screen by interpolating it. It is therefore possible to efficiently record images of different resolutions and have them displayed on the same display device.
A program may be recorded on a recording medium to control the apparatus so that a first image is output in a first resolution, and a second image is output in a second resolution that differs from the first resolution. As a result, it is possible to use storage areas correlated to the respective resolutions, and to save memory.
Although the JPEG and run length encoding compression techniques are described, other compression techniques (or no compression at all) can be used with the invention.
Although a touch tablet with input pen is described as structures through which selections and commands can be input, the invention is not limited to such structure. For example, the touch tablet can be actuable by the user's finger.
The invention is not limited to implementation by a programmed general purpose computer as shown in the preferred embodiment. For example, the invention can be implemented using one or more special purpose integrated circuit(s) (e.g., ASIC). It will be appreciated by those skilled in the art that the invention can also be implemented using one or more dedicated or programmable integrated or other electronic circuits or devices (e.g., hardwired electronic or logic circuits such as discrete element circuits, or programmable logic devices such as PLDs, PLAs, PALs or the like).
While the invention has been described in relation to preferred embodiments, many modifications and variations are apparent from the description of the invention. All such modifications and variations are intended to be within the scope of the present invention as defined in the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 8-326545 | Dec 1996 | JP | national |
| 9-096906 | Apr 1997 | JP | national |
This is a Continuation of application Ser. No. 08/972,742 filed Nov. 18, 1997. The entire disclosure of the prior application(s) is hereby incorporated by reference herein in its entirety. This nonprovisional application claims the benefit of U.S. Provisional Application No. 60/033,698, filed Dec. 20, 1996.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4835532 | Fant | May 1989 | A |
| 4941191 | Miller et al. | Jul 1990 | A |
| 5345517 | Katayama et al. | Sep 1994 | A |
| 5453844 | George et al. | Sep 1995 | A |
| 5592220 | Ishii et al. | Jan 1997 | A |
| 5623587 | Bulman | Apr 1997 | A |
| 5642135 | Noguchi et al. | Jun 1997 | A |
| 5642498 | Kutner | Jun 1997 | A |
| 5648760 | Kumar | Jul 1997 | A |
| 5717793 | Ushida et al. | Feb 1998 | A |
| 5754242 | Ohkami | May 1998 | A |
| 5832136 | Hirose | Nov 1998 | A |
| 5838318 | Porter et al. | Nov 1998 | A |
| 5874960 | Mairs et al. | Feb 1999 | A |
| 5880786 | Oku et al. | Mar 1999 | A |
| 5883476 | Noguchi et al. | Mar 1999 | A |
| 5926155 | Arai et al. | Jul 1999 | A |
| 6046734 | Noguchi et al. | Apr 2000 | A |
| 6262778 | Nonweiler et al. | Jul 2001 | B1 |
| 6310657 | Chauvel et al. | Oct 2001 | B1 |
| 20030051255 | Bulman et al. | Mar 2003 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20020054110 A1 | May 2002 | US |
| Number | Date | Country | |
|---|---|---|---|
| 60033698 | Dec 1996 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 08972742 | Nov 1997 | US |
| Child | 09938601 | US |
