The present invention relates to an image reader that is appropriate for a TV telephone or a TV conference system, and relates in particular to an image reader that can be compactly and lightly constructed, and that can accurately and quickly read the image of even a distorted object.
An example, conventional image reader is disclosed in JP-A-11-136564.
This image reader comprises: an image pickup unit, for obtaining, using an image forming optical system having a variable magnification rate, an image of an object document at a predetermined magnification rate; a distance sensor, for measuring distances to three targeted points on the object document; and an image synthesizer, for employing, when the image pickup unit sequentially acquires the images of adjacent targeted portions at the same magnification rate, the distance values obtained by the distance sensor to transform multiple, thus obtained images into those equivalent to images viewed from the front, and for synthesizing the transformed images to prepare a single image of the entire document. According to this image reader, the document can be read very accurately, even when the document is positioned so that it is tilted. Further, since glass platen that is equal to or larger than a document is not required, the size of the image reader can be reduced.
However, since a premise of the employment of a conventional image reader is that a document have a flat face, such an image reader can not satisfactorily read a document that is bent, and distorted document information is obtained. When, for example, a page of an opened book is to be read, the images, such as character images, at the bound portion, where the page is bent, can not be read accurately.
When a document that is tilted is to be read, the distance to the image pickup unit varies, depending on the portion of the document that is to be read. Thus, the sizes of the individual images differ, and the synthesized image is distorted. In this case, the magnification rate can be changed by referring to the characteristics of adjacent images for the performance of the synthesization process. However, according to this method, the magnification rate must be changed repeatedly, and an extended time is required for the synthesization process.
It is, therefore, one objective of the present invention to provide an image reader that can accurately and quickly read an object, even one that is distorted.
It is another objective of the present invention to provide an image reader that can be compactly and lightly constructed.
To achieve the above objectives, according to the present invention, an image reader comprises:
image pickup means, for obtaining multiple targeted adjacent portions at the same optical magnification rate, and for obtaining multiple images;
measurement means, for measuring multiple distances to multiple respective points that are selected on the targeted portions; and
processing means, for employing the multiple distances to perform perspective transformations of the multiple images to acquire multiple plane images, and for altering the sizes of the multiple plane images so that all sizes correspond.
With this configuration, the perspective transformation is performed for the images obtained for the plane images, so that even a distorted object can be accurately read. Further, since a plurality of plane images are altered to provide corresponding sizes, the image synthesization process can be performed quickly.
Further, to achieve the above objectives, an image reader comprises:
image pickup means, for acquiring an image of an object;
measurement means, for measuring multiple distances to multiple respective points that are selected on the object; and
processing means, for employing the multiple distances to perform perspective transformations for the image to obtain a plane image.
With this arrangement, multiple images can be acquired using a hand-held image reader, distances to multiple target portions can be measured, and a small and light apparatus can be manufactured.
First Embodiment
The computer 4 includes a computer main body 40 in which a CPU and a memory are mounted; a display unit 41, such as a CRT; and an input unit 42, such as a keyboard or a mouse. The computer 4 processes an image that is read, or controls the zooming and the focusing of the digital CCD camera and the positioning that is required to read an image. The computer main body 40 also includes a drive 40a for reading data from a memory card, such as a floppy disk, that has been loaded.
The distance measurement unit 11 employs the pattern projection method or the phase distribution measurement method to obtain two-dimensional information for the distance to the document 2. According to an example pattern projection method, whereby a laser beam is employed to generate, based on pattern code, a light pattern that consists of multiple regions the intensity of which is modulated to obtain triple level or higher data, the light pattern produces an image of the document 2 and the light reflected from the document 2 is acquired to prepare an image pattern, whereafter, the pattern code and the pattern image are employed to obtain information for measuring the distance to the document 2. Using this method, since the laser beam used as a light source has a linearity that little affects the depth of focus, the edges between the regions are not blurred, and for the depth, the measurable range is expanded. Further, since an image of the document 2 is projected by the pattern light at the modulated intensity, two-dimensional information for measuring the distance to the document 2 can be obtained using a single image pickup. In addition, there is an example phase distribution measurement method whereby light, whose intensity is modulated at a predetermined frequency, is emitted and strikes the document 2, and whereby a composite light, consisting of light reflected by the document 2 and the above emitted light, is received by a plane sensor that is constituted by multiple, two-dimensionally arranged pixels, and information for the distance to the document 2 is obtained based on the detection signal. According to this method, the two-dimensional information for the distance to the document 2 can be obtained by a single one measurement.
The synthesization controller 16 performs perspective transformation, calculation of a magnification rate, the alteration of image size and image synthesization based on an image signal fetched into the image memory 15 and the information obtained by the distance measurement unit 11 for the distance between the document and the CCD camera 10.
Subsequently, based on the distance information obtained by the distance measurement unit 11 (ST2), the synthesization controller 16 analyzes the shape of the targeted portion of the document 2 and performs a perspective transformation for the image that is read (ST3). Thereafter, the image acquisition (ST1), the shape analysis of the target portion of the document 2 (ST2) and the perspective transformation of the image (ST3) are sequentially performed. When the synthesization controller 16 has performed the perspective transformation for all the images, it employs the obtained distance information to calculate the magnification rate for each plane image (ST4). The synthesization controller 16 compares the image sizes (magnification rates) of the plane images, and changes to the maximum or to the minimum the sizes of the plane images (ST5) Following this, the synthesization controller 16 compares each plane image with its adjacent image (ST6), corrects for distortions (ST7), synthesizes the plane images to form a single complete image, and stores the obtained image in the image memory 15 (ST8). The image reading is thereafter completed, and via the image signal line 3A, the complete image stored in the image memory 15 is transmitted to the computer 4 by the controller 13 and is displayed by the display unit 41.
According to the first embodiment, since the image that is acquired is transformed into a plane image, even that portion of an image near the bound portion of an opened book, or on the curved face of a can, can be accurately read. Furthermore, since the image synthesization is performed after the image sizes of the plane images have been aligned, the time required for synthesization can be reduced.
In the first embodiment, image synthesization is performed by the main body 1A. However, images and the information required for synthesization may be transferred as needed via the interface 3 to the computer 4, which may then perform image synthesization.
Second Embodiment
The processing for the second embodiment will now be described. First, a user sets a resolution using a zooming function, and reads images using a hand-held image reader, so that the images have a specific overlapping area. At this time, together with the images, the distance information is also obtained. As in the first embodiment, multiple images are synthesized to form one complete image, and the complete image is read from the image memory 15 and written to the memory card 17. The user loads the memory card 17 into a driver 40a of a computer 4, where at the complete image is read, and thereafter the image is displayed on a display unit 41.
According to the second embodiment, since a scanner 12 is not included, and since the synthesization of plane images may be performed by the computer 4, instead of by an image reader 1, a compact and light image reader can be constructed that is easily carried and transported.
Third Embodiment
Fourth Embodiment
The computer 104 includes a computer main body 140 in which a CPU and a memory are mounted; a display unit 141, such as a CRT; and an input unit 142, such as a keyboard or a mouse. The computer 4 processes an image that is read, or controls the zooming and the focusing of the digital CCD camera and the positioning that is required to read an image. The computer main body 140 also includes a drive 140a for reading data from a memory card, such as a floppy disk, that has been loaded.
The distance measurement unit 111 employs the pattern projection method or the phase distribution measurement method to obtain two-dimensional information for the distance to the document 102. According to an example pattern projection method, whereby a laser beam is employed to generate, based on pattern code, a light pattern that consists of multiple regions the intensity of which is modulated to obtain triple level or higher data, the light pattern produces an image of the document 102 and the light reflected from the document 102 is acquired to prepare an image pattern, whereafter, the pattern code and the pattern image are employed to obtain information for measuring the distance to the document 102. Using this method, since the laser beam used as a light source has a linearity that little affects the depth of focus, the edges between the regions are not blurred, and for the depth, the measurable range is expanded. Further, since an image of the document 102 is projected by the pattern light at the modulated intensity, two-dimensional information for measuring the distance to the document 102 can be obtained using a single image pickup. In addition, there is an example phase distribution measurement method whereby light, whose intensity is modulated at a predetermined frequency, is emitted and strikes the document 102, and whereby a composite light, consisting of light reflected by the document 102 and the above emitted light, is received by a plane sensor that is constituted by multiple, two-dimensionally arranged pixels, and information for the distance to the document 102 is obtained based on the detection signal. According to this method, the two-dimensional information for the distance to the document 102 can be obtained by a single one measurement.
Based on an image signal fetched into the image memory 115 and the information obtained by the distance measurement unit 111 for the distance between the document and the CCD camera 110, the synthesization controller 116 performs perspective transformation, calculation of a magnification rate, the alteration of image size, and a process for synthesizing image segments that are acquired by superimposing a specific area of the document 102 to a preview image obtained for the overall document 102.
The resolution (optical magnification rate) is changed by controlling the zooming of the CCD camera 110 (ST106), and an image is acquired of a specific portion (text area 120b) of the document 102 that requires a high resolution. That is, while watching a monitor (not shown), the user manipulates the input unit 142 and enters the range for reading the specific portion of the document 102. The CPU of the computer 104 then employs the information provided by the input unit 142 to transmit the control signal for the CCD camera 110 and the scanner 112 to the controller 113 of the image reader 111 via the RS232C cable 103B. Based on the control signal received from the computer 104, the controller 113 controls the zooming and focusing functions of the CCD camera 110 and the scanner 112 while the specific portion of the document 102 is read. The CCD camera 10 acquires, at a high resolution, the image of the specific portion of the document 102, and transmits the pickup signal for the obtained image segment 121 to the signal processor 114 (ST107). The signal processor 114 then performs signal processing, such as an amplification process and various correction processes, for the pickup signal received from the CCD camera 110, and stores the obtained image signal in the image memory 115. At the same time as the CCD camera 110 begins to acquire the image, the distance measurement unit 111 obtains a two-dimensional measurement for the distance to the specific portion of the document 102 that is acquired by the CCD camera 110, and transmits the distance information, via the controller 113, to the synthesization controller 116. Based on the distance information obtained by the distance measurement unit 111 (ST108), the synthesization controller 116 analyzes the shape of the specific portion of the document 102 and performs a perspective transformation for the image 121 that is read (ST109). Thereafter, the magnification rate is calculated for the plane image segment 122 obtained by the perspective transformation (ST110).
Following this, the synthesization controller 116 reduces the size of the plane image segment 122 obtained by a perspective transformation performed at the same optical magnification rate as that of the plane preview image 120, i.e., at na/np, to obtain the plane image segment 123 (ST111), and steps ST106 to ST111 are repeated until the reading of the image segment 121 is completed.
According to the above fourth embodiment, only a required portion of the document is read at a high resolution to obtain the image segment and at a low resolution to obtain the preview image, and the image segment and the previous image are superimposed. Thus, the number of required image segments can be reduced and the time needed for synthesization can be shortened.
Further, based on the distance information, the image that is picked up is transformed into the plane preview image and the plane image segment. Thus, even an image of an area near the bound portion of an opened book or an image of a portion of the curved face of a can be accurately read.
Fifth Embodiment
The processing for the fifth embodiment will now be described. First, a user sets a resolution using a zooming function, and scans the overall document 102 and a specific area of the document 2 using a hand-held image reader. At this time, together with the images, the distance information is also obtained. As in the fourth embodiment, the overall image and the image of the specific area are synthesized to form one complete image, and the complete image is read from the image memory 115 and written to the memory card 117. The user loads the memory card 117 into a driver 140a of a computer 104, whereat the complete image is read, and thereafter the image is displayed on a display unit 141.
According to the fifth embodiment, since the scanner 112 is not included, a compact and light image reader that is suitable for transportation by hand can be constructed, and the synthesization of plane images can be performed by the computer 104, instead of the image reader 111. In the fourth embodiment, since a high resolution image of a specific area can be acquired by changing the optical magnification rate, and in the fifth embodiment, since the image reader is portable, a user can hold the image reader while approaching a specific portion of the document 102, and an image of a specific portion can be acquired at a shorter distance.
Sixth Embodiment
A text area may be acquired at a resolution that is consonant with the font size. Further, three or more resolutions may be employed, depending on the object.
The magnification rate employed for an image may be calculated based on the zooming function of a CCD camera.
Furthermore, to synthesize a preview image at a low resolution and an image segment at a high resolution, the image segments may be hierarchically positioned on the preview image, and an image segment may be hieratically positioned on another image segment. Therefore, when an image segment is to be moved and positioned as a moving picture on a preview image, image processing can be facilitated.
As is described above, according to the image reader of this invention, perspective transformation is performed for multiple images that are acquired to prepare plane images, and the sizes of the plane images are altered so that they correspond. Thus, for the synthesization of plane images, even when an object is distorted, reading of an image of the object can be performed accurately and quickly.
Further, since multiple images are acquired using a hand-held image reader, and the distances to multiple target portions are calculated, a compact and light image reader can be provided.
Number | Date | Country | Kind |
---|---|---|---|
2000-108298 | Apr 2000 | JP | national |
2000-108299 | Apr 2000 | JP | national |
This is a Division of application Ser. No. 09/717,155 filed Nov. 22, 2000 now U.S. Pat. No. 7,016,551. The entire disclosure of the prior application is hereby incorporated by reference herein in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
5033725 | van Duursen | Jul 1991 | A |
5146275 | Tone et al. | Sep 1992 | A |
5187754 | Currin et al. | Feb 1993 | A |
5287272 | Rutenberg et al. | Feb 1994 | A |
5456256 | Schneider et al. | Oct 1995 | A |
5539524 | Hasebe et al. | Jul 1996 | A |
5757424 | Frederick | May 1998 | A |
5764379 | Matsuda et al. | Jun 1998 | A |
5764383 | Saund et al. | Jun 1998 | A |
5796861 | Vogt et al. | Aug 1998 | A |
5831750 | Okisu et al. | Nov 1998 | A |
5847884 | Kamon et al. | Dec 1998 | A |
5995245 | Moro | Nov 1999 | A |
6177979 | Oliva | Jan 2001 | B1 |
6269175 | Hanna et al. | Jul 2001 | B1 |
6552412 | Kano | Apr 2003 | B2 |
Number | Date | Country |
---|---|---|
11-136564 | May 1999 | JP |
2000-105818 | Apr 2000 | JP |
Number | Date | Country | |
---|---|---|---|
20060088226 A1 | Apr 2006 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 09717155 | Nov 2000 | US |
Child | 11245028 | US |