This application claims priority under 35 U.S.C. Section 119 of Japanese Patent Application No. 2010-155239 filed on Jul. 7, 2010, entitled “OBJECT DETECTING DEVICE AND INFORMATION ACQUIRING DEVICE” and No. 2011-88606 filed on Apr. 12, 2011, entitled “OBJECT DETECTING DEVICE AND INFORMATION ACQUIRING DEVICE.” The disclosure of the above applications is incorporated herein by reference.
1. Field of the Invention
The present invention relates to an object detecting device for detecting an object in a target area, based on a state of reflected light when light is projected onto the target area, and an information acquiring device incorporated with the object detecting device.
2. Disclosure of Related Art
Conventionally, there has been developed an object detecting device using light in various fields. An object detecting device incorporated with a so-called distance image sensor is operable to detect not only a two-dimensional image on a two-dimensional plane but also a depthwise shape or a movement of an object to be detected. In such an object detecting device, light in a predetermined wavelength band is projected from a laser light source or an LED (Light Emitting Diode) onto a target area, and light reflected on the target area is received by a light receiving element such as a CMOS image sensor. Various types of sensors are known as the distance image sensor.
A distance image sensor which is configured to irradiate a target area with laser light having a predetermined dot pattern is operable to receive reflected light of laser light from the target area at each dot position by a light receiving element. The distance image sensor is operable to detect a distance to each portion (each dot position on an object to be detected) of the object to be detected, based on the light receiving position of laser light on the light receiving element corresponding to each dot position, using a triangulation method (see e.g. pp. 1279-1280, the 19th Annual Conference Proceedings (Sep. 18th-20th, 2001) by the Robotics Society of Japan).
In the object detecting device thus constructed, a diffractive optical element is used for generating laser light having a dot pattern. A predetermined diffraction pattern is formed on the diffractive optical element by e.g. hologram, and laser light is diffracted by the diffraction pattern. A target area is irradiated with laser light having a predetermined dot pattern by such a diffractive function.
When laser light has such a dot pattern, the laser light is diffused in a relatively large area within a target area. However, as the diffraction pattern of the diffractive optical element is deteriorated by e.g. a change with time, the diffractive function with respect to laser light also changes. As a result, laser light transmitted through the diffractive optical element without diffusion may be concentratedly irradiated in a small area. In such a case, it is desirable to stop emitting laser light.
It is possible to detect deterioration of a diffractive optical element by e.g. monitoring a state of diffracted light. In this case, a monitor optical system may be disposed on downstream side of the diffractive optical element with respect to the propagating direction of laser light. In the above arrangement, however, since a laser light source, a collimator lens, a diffractive optical element, and a monitor optical system are linearly arranged, the size of the device increases in the arrangement direction of these parts.
A first aspect according to the invention is directed to an information acquiring device for acquiring information on a target area using light. The information acquiring device according to the first aspect includes a laser light source; a diffractive optical element which is disposed in such a direction as to be away from an optical axis of the laser light source; a photodetector which is disposed to face the diffractive optical element with respect to the optical axis; and an optical path separating portion which guides laser light emitted from the laser light source to the diffractive optical element, and guides the laser light reflected on the diffractive optical element to the photodetector. The diffractive optical element irradiates the target area with the laser light having a predetermined pattern. The photodetector receives a part of the laser light diffracted and reflected on the diffractive optical element.
A second aspect according to the invention is directed to an object detecting device. The object detecting device according to the second aspect has the information acquiring device according to the first aspect.
These and other objects, and novel features of the present invention will become more apparent upon reading the following detailed description of the embodiment along with the accompanying drawings.
The drawings are provided mainly for describing the present invention, and do not limit the scope of the present invention.
In the following, an embodiment of the invention is described referring to the drawings. In the embodiment, a PBS 113 and a quarter wave plate 114 correspond to an “optical path separating portion” in the claims. A DOE 116 corresponds to a “diffractive optical element” in the claims. A PD 117 corresponds to a “photodetector” in the claims. A half mirror 122 corresponds to a “non-polarized beam splitter” in the claims. A laser controller 21a corresponds to a “control portion” in the claims. The description regarding the correspondence between the claims and the embodiment is merely an example, and the claims are not limited by the description of the embodiment.
In the following, an embodiment of the invention is described referring to the drawings. In the embodiment, an information acquiring device configured to irradiate a target area with laser light having a predetermined dot pattern is described as an example.
Firstly, a schematic arrangement of an object detecting device according to the first embodiment is described. As shown in
The information acquiring device 1 projects infrared light to the entirety of a target area, and receives reflected light from the target area by a CMOS image sensor to thereby acquire a distance (hereinafter, called as “three-dimensional distance information”) to each part of an object in the target area. The acquired three-dimensional distance information is transmitted to the information processing device 2 through a cable 4.
The information processing device 2 is e.g. a controller for controlling a TV or a game machine, or a personal computer. The information processing device 2 detects an object in a target area based on three-dimensional distance information received from the information acquiring device 1, and controls the TV 3 based on a detection result.
For instance, the information processing device 2 detects a person based on received three-dimensional distance information, and detects a motion of the person based on a change in the three-dimensional distance information. For instance, in the case where the information processing device 2 is a controller for controlling a TV, the information processing device 2 is installed with an application program operable to detect a gesture of a user based on received three-dimensional distance information, and output a control signal to the TV 3 in accordance with the detected gesture. In this case, the user is allowed to control the TV 3 to execute a predetermined function such as switching the channel or turning up/down the volume by performing a certain gesture while watching the TV 3.
Further, for instance, in the case where the information processing device 2 is a game machine, the information processing device 2 is installed with an application program operable to detect a motion of a user based on received three-dimensional distance information, and operate a character on a TV screen in accordance with the detected motion to change the match status of a game. In this case, the user is allowed to play the game as if the user himself or herself is the character on the TV screen by performing a certain action while watching the TV 3.
The information acquiring device 1 is provided with a projection optical system 11 and a light receiving optical system 12, which constitute an optical section. In addition to the above, the information acquiring device 1 is provided with a CPU (Central Processing Unit) 21, a laser driving circuit 22, an image signal processing circuit 23, an input/output circuit 24, and a memory 25, which constitute a circuit section.
The projection optical system 11 irradiates a target area with laser light having a dot matrix pattern. The light receiving optical system 12 receives laser light reflected on the target area. The arrangement of the projection optical system 11 and the light receiving optical system 12 will be described later referring to
The CPU 21 controls the parts of the information acquiring device 1 in accordance with a control program stored in the memory 25. By the control program, the CPU 21 has a function of a laser controller 21a for controlling the laser light source 111 (to be described later) in the projection optical system 11, and a three-dimensional distance calculator 21b for generating three-dimensional distance information.
The laser driving circuit 22 drives the laser light source 111 (to be described later) in accordance with a control signal from the CPU 21. The image signal processing circuit 23 controls the CMOS image sensor 124 (to be described later) in the light receiving optical system 12 to successively read signals (electric charges) from the pixels, which have been generated in the CMOS image sensor 124, line by line. Then, the image signal processing circuit 23 outputs the read signals successively to the CPU 21.
The CPU 21 calculates a distance from the information acquiring device 1 to each portion of an object to be detected, by a processing to be implemented by the three-dimensional distance calculator 21b, based on the signals (image signals) to be supplied from the image signal processing circuit 23. The input/output circuit 24 controls data communications with the information processing device 2.
The information processing device 2 is provided with a CPU 31, an input/output circuit 32, and a memory 33. The information processing device 2 is provided with e.g. an arrangement for communicating with the TV 3, or a drive device for reading information stored in an external memory such as a CD-ROM and installing the information in the memory 33, in addition to the arrangement shown in
The CPU 31 controls each of the parts of the information processing device 2 in accordance with a control program (application program) stored in the memory 33. By the control program, the CPU 31 has a function of an object detector 31a for detecting an object in an image. The control program is e.g. read from a CD-ROM by an unillustrated drive device, and is installed in the memory 33.
For instance, in the case where the control program is a game program, the object detector 31a detects a person and a motion thereof in an image based on three-dimensional distance information supplied from the information acquiring device 1. Then, the information processing device 2 causes the control program to execute a processing for operating a character on a TV screen in accordance with the detected motion.
Further, in the case where the control program is a program for controlling a function of the TV 3, the object detector 31a detects a person and a motion (gesture) thereof in the image based on three-dimensional distance information supplied from the information acquiring device 1. Then, the information processing device 2 causes the control program to execute a processing for controlling a predetermined function (such as switching the channel or adjusting the volume) of the TV 3 in accordance with the detected motion (gesture).
The input/output circuit 32 controls data communication with the information acquiring device 1.
As shown in
In the case where a flat plane (screen) is disposed in a target area, light of DMP light reflected on the flat plane at each dot position is distributed on the CMOS image sensor 124, as shown in
The three-dimensional distance calculator 21b is operable to detect to which position on the CMOS image sensor 124, the light corresponding to each dot is entered, for detecting a distance to each portion (each dot position on a dot matrix pattern) of an object to be detected, based on the light receiving position, by a triangulation method. The details of the above detection technique is disclosed in e.g. pp. 1279-1280, the 19th Annual Conference Proceedings (Sep. 18th-20th, 2001) by the Robotics Society of Japan.
The projection optical system 11 is provided with a laser light source 111, a collimator lens 112, a polarized beam splitter (PBS) 113, a quarter wave plate 114, an aperture 115, a diffractive optical element (DOE) 116, and a photodetector (PD) 117. The light receiving optical system 12 is provided with an aperture 121, an imaging lens 122, a filter 123, and a CMOS image sensor 124.
The laser light source 111 outputs laser light in a narrow wavelength band of or about 830 nm. The collimator lens 112 converts the laser light emitted from the laser light source 111 into parallel light. The PBS 113 reflects laser light entered from the collimator lens 112 side. The position of the laser light source 111 is adjusted in such a manner that laser light is emitted as S-polarized light with respect to a polarization plane of the PBS 113.
The quarter wave plate 114 converts laser light entered from the PBS 113 side into circularly polarized light, and converts laser light (reflected diffracted light on the DOE 116) entered from the aperture 115 side into light in a polarization direction orthogonal to the polarization direction of laser light to be entered from the PBS 113 side. By performing the above operation, laser light (reflected diffracted light on the DOE 116) entered from the aperture 115 side is converted into P-polarized light with respect to the PBS 113, and transmitted through the PBS 113.
The aperture 115 adjusts a light flux cross section of laser light into a predetermined shape (in the embodiment, a circular shape). The DOE 116 has a diffraction pattern on an incident surface thereof. Laser light entered to the DOE 116 through the aperture 115 is converted into laser light having a dot matrix pattern by a diffractive function of the diffraction pattern, and is irradiated onto a target area.
As shown in
The PD 117 receives reflected diffracted light that has been transmitted through the PBS 113. The arrangement of the PD 117 will be described later referring to
Laser light reflected on the target area is entered to the imaging lens 122 through the aperture 121. The aperture 121 limits external light in accordance with the F-number of the imaging lens 122. The imaging lens 122 condenses the light entered through the aperture 121 on the CMOS image sensor 124.
The filter 123 is a band-pass filter which transmits light in a wavelength band including the emission wavelength (about 830 nm) of the laser light source 111, and cuts light in a wavelength band other than the above. The CMOS image sensor 124 receives light condensed on the imaging lens 122, and outputs a signal (electric charge) in accordance with a received light amount to the image signal processing circuit 23 pixel by pixel. In this example, the CMOS image sensor 124 is configured in such a manner that the output speed of signals to be outputted from the CMOS image sensor 124 is set high so that a signal (electric charge) at each pixel can be outputted to the image signal processing circuit 23 with high response from a light receiving timing at each pixel.
The projection optical system 11 and the light receiving optical system 12 are installed on a base member 300. A circuit board 200 is provided on the base member 300. Wirings (flexible substrates) 201 through 203 are respectively connected from the circuit board 200 to the laser light source 111, the PD 117, and the CMOS image sensor 124. A circuit portion of the information acquiring device 1 such as the CPU 21 and the laser driving circuit 22 shown in
As described above, laser light is entered to the DOE 116 as parallel light. Accordingly, out of the reflected diffracted light on the DOE 116, zero order reflected diffracted light which has been reflected on the DOE 116 without diffraction also returns to the aperture 115 substantially as parallel light. Thus, in the case where laser light is entered to the DOE 116 in the manner as shown in
In this embodiment, as shown in
In the case where the DOE 116 is normally operated, a predetermined amount of zero order reflected diffracted light is irradiated onto the light receiving surface 117a. On the other hand, in the case where the DOE 116 is deteriorated by e.g. a change with time, the amount of zero order reflected diffracted light to be irradiated onto the light receiving surface 117a increases or decreases, resulting from a change in diffractive function, and an output signal from the PD 117 increases or decreases accordingly. Thus, it is possible to detect deterioration of the DOE 116 by monitoring an output from the PD 117.
Referring to
Thereafter, in the case where the PD signal is out of the range between the threshold value S1 and the threshold value S2 (S103: YES), it is determined that the DOE 116 is deteriorated (is in an anomaly state), and the laser light source 111 is caused to stop emitting laser light. By performing the above operation, irradiation of DMP light onto the target area is stopped. For instance, in the example shown in
As described above, in the embodiment, as shown in FIG. 4A, the projection optical system 11 is configured in such a manner that the optical path of laser light emitted from the laser light source 111 is bent. This is advantageous in reducing the size of the projection optical system 11 in the height direction (direction perpendicular to the installation plane of the base member 300), and miniaturizing the projection optical system 11.
For instance, in the case where a monitor optical system 118 for detecting deterioration of a DOE 116 is disposed on the output surface side of the DOE 116, as shown in the comparative example of
In contrast, in this embodiment, as shown in
Further, in this embodiment, as described above referring to
The inventors of the present application verified that deterioration (anomaly) of the DOE 116 is detectable based on a PD signal by conducting actual measurement. In the following, the verification is described.
The aperture 115a shapes oval-shaped laser light emitted from the laser light source 111 into laser light of a substantially circular shape. In the measurement, the gap between the collimator lens 112 and a PBS 113 was set to 100 mm, the gap between the PBS 113 and a quarter wave plate 114 was set to 1 mm, the gap between the quarter wave plate 114 and a DOE 116 was set to a value smaller than 1 mm, and the gap between the PBS 113 and the power meter PM was set to 11 mm. The model 47784-K manufactured by Edmund Optics Inc. was used as the PBS 113, the model 46412-K manufactured by Edmund Optics Inc. was used as the quarter wave plate 114, and the model Q8230 manufactured by Advantest Corporation was used as the power meter PM.
The laser light source 111 has an emission wavelength of 830 nm, and is disposed to emit laser light in Y-axis direction in
The DOE 116 has a diffraction pattern on the output surface thereof for uniformly distributing twenty-five thousand dots in a rectangular area of 1.9 m in vertical direction and 2.3 m in horizontal direction on an imaginary plane defined at a forward position (plus Z-axis direction) of the DOE 116 by 2 m. The diffraction pattern is constituted of a multi-step diffractive structure.
At the measurement, the projection optical system shown in
Then, water was allowed to drop onto the laser light output position on the output surface of the DOE 116 in such a manner that a water droplet of a size slightly larger than the spot size of laser light was adhered to the output surface. In this state, laser light of the aforementioned power was emitted, and a light receiving power of the PD 117 was measured at each position i.e. at the offset positions of 0 mm, 1 mm, 2 mm, 3 mm, 4 mm, 5 mm, 6 mm, 7 mm, 8 mm, 9 mm, and 10 mm in the same manner as described above.
Firstly, referring to the graph “before water droplet adhesion”, it is clear that the light receiving power of the PD 117 moderately decreases as the offset value of the PD 117 increases, and that the light receiving power of the PD 117 sharply lowers when the offset value exceeds around 5 mm. In this example, it is presumed that the position where the offset value is 5 mm corresponds to a position where an end of the light receiving surface of the PD 117 in minus Y-axis direction reaches a boundary of the irradiation area of reflected diffracted light. Accordingly, it is clear that reflected diffracted light spreads in left and right directions by a certain range with respect to the center of reflected diffracted light, on a plane including the light receiving surface of the PD 117. It is presumed that such a spreading of reflected diffracted light reflects spreading of laser light directing toward a target area through the DOE 116.
Next, referring to the graph “after water droplet adhesion”, the light receiving power of the PD 117 is substantially kept around 1 mW, regardless of the offset value of the PD 117. Further, it is clear that the light receiving power of the PD 117 is less likely to come close to zero, even if the offset value exceeds 10 mm and more. The above result presumably shows that the irradiation area of reflected diffracted light significantly increases, on a plane including the light receiving surface of the PD 117, as compared with the measurement result obtained “before water droplet adhesion”. Thus, it is presumed that laser light directing toward the target area through the DOE 116 also spreads in a significantly large area, as compared with the measurement result obtained “before water droplet adhesion”.
Comparing between the two graphs shown in
Accordingly, as shown in
In the aforementioned measurement, the value of a detection signal (PD signal) from the PD 117 obtained “after water droplet adhesion” is smaller than the value of a PD signal obtained “before water droplet adhesion” by several orders. However, it is presumed that the value of a PD signal to be obtained in an anomaly state may be considerably larger than the value of a PD signal to be obtained in a normal state, depending on the types of deterioration (anomaly) generated in the DOE 116. In such a case, laser light directing toward a target area from the DOE 116 may be concentratedly irradiated in a small area. Such an anomaly can be detected, as shown in
The embodiment of the invention has been described as above. The invention is not limited to the foregoing embodiment, and the embodiment of the invention may be changed or modified in various ways other than the above.
For instance, in the embodiment, as shown in
Further, in the embodiment, as shown in
Further alternatively, as shown in
Further, in the embodiment, the CMOS image sensor 124 is used as a light receiving element. Alternatively, a CCD image sensor may be used. Further alternatively, the arrangement of the light receiving optical system 12 may also be modified as necessary.
The embodiment of the invention may be changed or modified in various ways as necessary, as far as such changes and modifications do not depart from the scope of the claims of the invention hereinafter defined.
Number | Date | Country | Kind |
---|---|---|---|
2010-155239 | Jul 2010 | JP | national |
2011-088606 | Apr 2011 | JP | national |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2011/061316 | May 2011 | US |
Child | 13731535 | US |