The present invention relates to a motion gesture sensing module and a motion gesture sensing method, in which light is emitted from a light source and the light reflected from a subject is detected to sense relative motion between the subject and the sensing module.
Recently, portable devices such as smart phones, tablet personal computers (PC), media players, electronic readers, and the like have rapidly increased in popularity, and such portable devices have become necessities of modern life. With exponential growth in popularity of the portable device, technology for human-machine interfaces (HMIs) has been variously developed.
Conventional HMIs have been generally realized by a keypad disposed in the portable device. However, technology for a user interface based on a touch sensor has recently been developed and entered widespread use, and technology for a user interface based on a motion sensor for sensing a user's motion has also been developed. In a portable terminal provided with the motion sensor, when a user applies a motion to the portable terminal, the portable terminal senses his/her motion and performs a function corresponding to the motion.
Human-machine interfaces may be classified into a touch-based system, a motion-based system, a vision-based system, and a proximity-based system.
The touch-based system is used by touching a touch panel with a finger or a pen. However, if a user is wearing a glove or his hand is wet or dusty, touch is not properly sensed. In addition, the vision-based system employs a built-in camera and image processing such that a user can perform basic operation for interfacing without touching a device. However, such a vision-based system has a grave shortcoming of consuming a great deal of power.
To solve the problems of such typical interface systems, a proximity-based motion gesture sensor (MGS) system has been investigated. The recently investigated proximity-based motion gesture sensing system includes two light emitting diodes (LEDs) and one infrared (IR) photodiode disposed in a portable device as shown in
The motion gesture sensor system is capable of sensing contactless operation with low power consumption. The intensity of reflected light can vary depending upon distance and angle between a subject and light sources, and motion gesture sensing algorithm may be used to sense simple gestures. The motion gesture sensor system is flexible with regard to height h, but the minimum width w of the sensor system is limited by the distance between two light sources (see
The present invention is conceived to solve such problems in the art, and it is an aspect of the present invention to provide a motion gesture sensing module and a motion gesture sensing method, in which inexpensive light sources and optical detectors are used to accurately sense gestures with low power consumption.
Depending upon one aspect of the present invention, a motion gesture sensing module includes: a light source emitting light; and a light sensor unit including at least two optical detectors sensing light reflected from a subject, wherein each of the optical detectors of the light sensor unit has an individually separated detectable zone.
The motion gesture sensing module may include an optical block disposed in a light receiving path of the light sensor unit and separating a detectable zone of each of the optical detectors.
The optical block may be arranged to increase a detectable zone of each of the optical detectors while decreasing a gray zone in which fields of view (FOVs) of the respective optical detectors overlap.
The optical block may include an inner-wall type optical block disposed between the respective optical detectors, wherein the inner-wall type optical block comprises an upright optical block, an optical block having an extended portion bent at an upper end thereof in a horizontal direction, or an oblique optical block having a horizontal cross-section, the area of which increases upward. In addition, the inner-wall type optical block may have a bottom separated from an upper end of the light sensor unit.
The optical block may include an outer-wall type optical block disposed at an outer circumference of the optical detector, wherein the outer-wall type optical block may be an upright optical block, an optical block having an extended portion bent inward at an upper end thereof in a horizontal direction, or an oblique optical block having a horizontal cross-section, the area of which increases upward.
In the motion gesture sensing module, the light sensor unit may include at least three optical detectors, and at least two optical detectors may be arranged in horizontal or vertical directions to detect relative motion of a subject moving along multiple axes.
The motion gesture sensing module may include an optical block disposed in a light receiving path of the light sensor unit and separating a detectable zone of each of the optical detectors. The optical block may include an inner-wall type optical block disposed between the respective optical detectors, or an outer-wall type optical block disposed at an outer circumference of the optical detector, or both the inner-wall type optical block and the outer-wall type optical block. In addition, the outer-wall type optical block may include a bent optical block having an extended portion on a top thereof in a horizontal inward direction.
In the motion gesture sensing module, the light source and the light sensor unit may be disposed in a package partitioned by a partition wall, and an inner-wall type optical block may be disposed between the optical detectors on the light sensor unit. The inner-wall type optical block may be an upright optical block, an optical block having an extended portion bent at an upper end thereof in a horizontal direction, or an oblique optical block having a horizontal cross-section, the area of which increases upward. The light sensor unit may include an optical sensor chip including at least two optical detectors.
In the motion gesture sensing module, the optical block may include a partition wall of a package on which the light sensor unit is mounted. The partition wall may be an upright partition wall disposed at an outer circumference of the light sensor unit, a partition wall having an extended portion bent inward at an upper portion thereof, or an oblique partition wall having a horizontal cross-section, the area of which increases upward
In the motion gesture sensing module, the light sensing unit may be mounted on the package, and the package may include a partition wall surrounding an outer circumference of the light sensor unit, and a cover connected to the partition wall, formed with at least one light receiving hole and covering the light sensor unit as an optical block. The cover may include an extended portion bent inward at an upper portion of the partition wall.
The optical block may be arranged to increase a detectable zone of each of the optical detectors while decreasing a gray zone in which fields of view (FOVs) of the respective optical detectors overlap.
In addition, the cover formed with at least one light receiving hole may partially cover each of the optical detectors and partially expose each of the optical detectors through the light receiving hole. Further, a boundary of the light receiving hole may be placed over a center of each of the optical detectors.
The light sensor unit may include an optical sensor chip including at least two optical detectors.
The light sensor unit may include at least three optical detectors, at least two of which are arranged in horizontal or vertical directions to detect relative motion of a subject moving along multiple axes.
The motion gesture sensing module may include a package including two accommodation spaces; and a light sensor unit and a light source respectively mounted in the accommodation spaces of the package, wherein the package includes a partition wall surrounding an outer circumference of the light sensor unit, and a cover connected to the partition wall, formed with at least one light receiving hole and covering the light sensor unit as an optical block. At this time, the light sensor unit includes an optical sensor chip including at least two optical detectors. Further, the cover may include an extended portion bent inward at an upper portion of the partition wall. The optical block may increase a detectable zone of each of the optical detectors while decreasing a gray zone in which fields of view (FOVs) of the respective optical detectors overlap. In addition, the cover formed with at least one light receiving hole may partially cover each of the optical detectors and partially expose each of the optical detectors through the light receiving hole. Further, a boundary of the light receiving hole may be placed over a center of each of the optical detectors.
In addition, the light sensor unit may include at least three optical detectors, at least two of which are arranged in horizontal and vertical directions to detect relative motion of a subject moving along multiple axes.
Depending upon another aspect of the present invention, a motion gesture sensing module includes: a light source emitting light; and a light sensor unit including at least two optical detectors sensing light reflected from a subject, in which a plurality of sectional optical blocks is disposed above each of the optical detectors and individually separates a detectable zone of each of the optical detectors. At this time, a direction of a field of view (FOV) is set depending upon shapes of the sectional optical blocks or arrangement of the sectional optical blocks.
Depending upon a further aspect of the present invention, a motion gesture sensing module includes: a light source emitting light; a light sensor unit including at least two optical detectors sensing light reflected from a subject; and a sensor processor transmitting an output of the light sensor unit to a motion determiner, wherein the sensor processor includes an amplifier and a comparator, the amplifier includes a differential circuit to transmit a differential waveform to the comparator, and the comparator is operated based on comparison with the received differential waveform. Here, the comparator may include a hysteresis comparator.
Depending upon yet another aspect of the present invention, there is provided a motion gesture sensing method that is a contactless motion sensing method, in which a light source emits light, light reflected from a subject is received by at least two optical detectors, and outputs of respective optical detectors are compared to determine a motion of a subject. The method includes sensing the motion of the subject by individually separating a detectable zone of each of the optical detectors and receiving the light reflected from the subject. At this time, an optical block disposed in a light receiving path of the optical detector may be used to individually separate the detectable zone of each of the optical detectors and arranged to increase a detectable zone of each of the optical detectors while decreasing a gray zone in which fields of view (FOVs) of the respective optical detectors overlap.
According to the present invention, a motion gesture sensing module which is inexpensive, consumes lower power and has a micro size can be realized using a low-cost light source and optical detector.
In addition, according to the present invention, a motion gesture sensing method capable of accurately sensing a gesture in response to change in quantity of light by a subject can be realized.
Particularly, according to the present invention, the motion gesture sensing module includes at least two optical detectors and an optical block disposed in a light receiving path to divide a detectable zone of each of the optical detectors and to accurately measure change in quantity of light due to relative motion between a subject and a module, thereby sensing the relative motion or gesture between the subject and the module. In addition, the motion gesture sensing module decreases a gray zone in which detection angles of the optical detectors overlap, while increasing the detectable zone, thereby enabling accurate and sensitive sensing of motion and gesture.
Further, the motion gesture sensing module and method according to the present invention can sense not only relative motion or gesture of a subject, but also a spatial touching function, like a click operation of a mouse, and can determine proximity of the subject, thereby providing advantages of performing all functions of an existing proximity sensor (for example, proximity sensing, reading mode, power saving function, and the like). Accordingly, the motion gesture sensing module according to the present invention may be utilized as an input device for various functions in a mobile device, such as cellular phones, tablet PCs, and the like.
Hereinafter, embodiments of the present invention will be described with reference to the accompanying drawings.
It should be understood that the present invention is not limited to the following embodiments and may be embodied in different ways, and that the embodiments are provided for complete disclosure and thorough understanding of the invention by those skilled in the art.
The present invention provides a motion gesture sensing module, which is inexpensive, consumes low power and has a micro size, and a motion gesture sensing method. According to the present invention, the motion gesture sensing module includes at least one light source and a plurality of optical detectors. Light emitted from the light source is reflected from the subject and received by the optical detectors, and sensing results of the respective optical detectors are calculated to obtain a subject's motion or gesture (in this embodiment, the subject's motion or gesture includes relative motion between the sensing module and the subject, i.e. the subject's motion or gesture includes movement of the sensing module with respect to a stationary subject and movement of the subject with respect to the sensing module).
According to the present invention, the motion gesture sensing module and method are realized by emitting light and receiving light reflected from the subject. Light may be emitted from the light source and detected through the optical detectors. Here, infrared light may be generally used as light, without being limited thereto. Further, light having various wavelengths, such as ultraviolet light, visible light, X-rays, and the like as well as infrared light may be used so long as the principle of the present invention can be applied.
According to the present invention, a photodiode (PD) may be used as the optical detector. Alternatively, the optical detector may be realized by various means so long as they can sense light. A light emitting diode (LED) may be generally used as the light source. Alternatively, the light source may be realized by any means so long as they can emit light.
To calculate motion or gesture of a subject through the motion gesture sensing module, there must be a difference between output values (for example, intensity of light), which are sensed in response to the motion or gesture of the subject, of the respective optical detectors. To this end, according to the present invention, various means and methods are used for separating detectable zones (that is, dividing detectable zones) in which a plurality of optical detectors can receive the light. As used herein, the detectable zone refers to an angle or region in which each of the optical detectors can receive light reflected from the subject. The division of the detectable zone for the optical detector means that each of the optical detectors has a corresponding detectable zone for sensing the light reflected from the subject. For example, if there are an optical detector A and an optical detector B, a zone detectable only by the optical detector A is formed separately from a zone detectable only by the optical detector B. As the detectable zones for the plural optical detectors are separated from each other (that is, divided from each other), output values of the optical detectors differ depending upon relative motion between the motion gesture sensing module and the subject, and calculated to sense the motion or gesture of the subject.
According to the present invention, there are provided means and a method for separating the detectable zones for the plural optical detectors. This means and method may be realized in various ways within the scope of the present invention.
A motion gesture sensing module according to one embodiment of the present invention may employ an optical block as one example of the means for separating the detectable zones for the plural optical detectors.
In this embodiment, the optical block serves to separate the detectable zones in which each of the optical detectors can sense light reflected from the subject.
According to one embodiment of the present invention, the motion gesture sensing module includes a plurality of photodiodes (PD), one light emitting diode (LED), and an optical block. Here, the optical block is arranged to separate detectable zones such that that the detectable zones can be respectively assigned to the plurality of photodiodes (PD), and receive infrared light reflected from a subject, thereby sensing motion of the subject relative thereto. With this structure, the motion gesture sensing module can be manufactured, regardless of a distance between two photodiodes for sensing an object's motion, unlike the module shown in
Now, a principle of arranging the optical block according to the present invention will be described with reference to
According to the present invention, a new proximity-based motion gesture sensor including two optical detectors and embedded on a single chip having an off-chip light source will be described. Conventionally, when a subject moves, time delay between light received from light sources is detected, and thus a certain distance between the two light sources is needed for a minimum detection margin. On the other hand, according to the present invention, only one light source is needed since the optical block can separate detectable zones for two optical detectors with regard to light reflected from a subject. Here, if a distance between the two light sources of the conventional system is 40 mm, a distance between the single light source and the proximity sensor of the present sensing system becomes 4 mm, and the form factor is decreased by 1/10.
Basically, a motion gesture is extracted from output data of a proximity sensor in the proximity-based gesture sensor system.
A motion gesture sensing module according to one embodiment of the present invention may be realized by the proximity sensor that includes two optical detectors and a single light source, as shown in
In the present invention, a packaging partition wall for packaging a sensor chip may serve as the optical block, and an additional optical block may be configured, as shown in
A basic configuration of the motion gesture sensing module according to one embodiment of the invention includes two optical detectors in a single package, and a field of view (FOV) of each of the optical detectors is defined as an angle for receiving light reflected from a subject, as shown in
As used herein, the gray zone refers to a region in which the FOVs of two optical detectors overlap. When a subject moves from the left side of the R zone to the right side of the L zone, detection is operated in an opposite way to the proximity sensor data shown in
Here, ho is a height between a subject and an upper end of the package, hpc is a height between the upper end of the package top and an upper end of the chip, θPN is a viewing angle restricted by a near package partition wall, θPF is a viewing angle restricted by a far package partition wall, and Ld is a distance between two optical detectors. Since θPF and θPN are correlation variables determined by the size of the package, LD may be defined again by Equation 2, excluding θPF.
Here, LPD is a distance between the optical detector and the near package partition wall. If left/right swipe and push/pull gesture of the subject are generated within the gray zone, it is impossible to detect this gesture. Here, the length LGZ of the gray zone may be determined by Equation 3.
The detectable distance LD increases as the subject becomes more distant from the chip, but LGZ will increase since LD is caused by Ld/LPD<2 from Equation 2 and Equation 3. If the subject moves at a velocity of vO, the time margin TM is represented by Equation 4.
TM=LD/vO <Equation 4>
In a conventional system employing two light sources, the time margin TM is proportional to a distance between two LEDs (usually, several centimeters). If the proposed optical block is not considered, the time margin TM of the proposed single light source system will be calculated by an equation in terms of a space (smaller than several hundred micrometers) between two optical detectors, and largely decreased, as compared with that of the conventional motion gesture sensor system.
In the proposed configuration, the optical block as shown in
Here, θOB is a viewing angle restricted by the proposed optical block, and θPN and θOB are adjusted by the height and length of the package and the proposed optical block. The length LGZ of the gray zone is obtained by Equation 6.
Since θPN and θOB are independent of Equation 5, the proposed structure may increase LD while LGZ is decreased by simply increasing θOB. As a result, the time margin is increased by a small distance between two optical detectors. The maximum θOB is limited by real dimensions corresponding to the height and length of the optical block.
To properly sense motion, the minimum θOB must be determined by LGZ at a maximum allowable height hOmax of the subject. This is shorter than the length of the subject and operates as in Equation 7.
L
GZ
≦L
O
+ΔL
O <Equation 7>
Here, LO and ΔLO represent the length and motion of the subject, respectively. From Equation 6 and Equation 7, the minimum approximate value of θOB is extracted by Equation 8.
The proposed optical block is shown in
tan θB/tan θPF <Equation 9>
If the foregoing condition is not satisfied, the discussed reverse detection can previously decrease the time margin TM.
Now, various examples of the structure of the motion gesture sensing module according to the present invention will be described based on the system in which a single light source emits light and a plurality of optical detectors receives the light reflected from a subject.
In particular, according to the present invention, various examples will be described with regard to the various structures of the optical block in which the optical block blocks light reflected from the subject and received by the optical detector, in other words, the detectable zones of the respective optical detectors are separated by restricting the FOV of the optical detectors.
First, the motion gesture sensing module according to the present invention may include a single light source for generating light, a light sensor unit including at least two optical detectors for receiving light emitted from the light source and converting the light into electric energy, and an optical block disposed in a light receiving path of the light sensor unit and separating a detectable zone for each of the optical detectors.
Here, the optical block is disposed for blocking some of light reflected from the subject and received by the optical detector, and restricting the FOV of each of the optical detectors, thereby separating the detectable zones. As described in some embodiments, the optical block may be a separate structure disposed in the light receiving path of the optical detector and used only for restricting the FOV. In addition, as described in other embodiments, a part of a package for protecting a built-in light sensor unit may perform functions of the optical block. These various embodiments will be described with reference to the accompanying drawings.
The motion gesture sensing module according to the embodiment of the invention is operated such that light emitted from the light source is reflected from the subject and received by the optical detector. As used herein, the term “light” may be infrared light, without being limited thereto. Alternatively, light may include ultraviolet light, visible light, radio waves, microwaves, X-rays, sound waves, ultrasonic waves, and the like within the scope of the present invention. In the following embodiments, infrared light will be described as the light. However, it will be understood that the present invention is not limited thereto.
The motion gesture sensing module according to the embodiment of the invention receives light reflected from the subject and thus detects relative motion between the subject and the module. Therefore, both when the subject moves with regard to a stationary device disposed with the motion gesture sensing module and when a device disposed with the gesture sending module moves with regard to a stationary subject, these movements can be sensed as the relative motions.
The light source converts electric energy into light energy, and emits the light energy to an approaching subject.
Here, the light source may be realized by a light emitting diode (LED) that emits light by application of electric current. In particular, according to the present invention, the LED may be an infrared LED. In this case, infrared light may have a wavelength of 840 nm or 940 nm, without being limited thereto. Alternatively, light having various wavelengths may be used within the scope of the present invention.
The light sensor unit serves to convert light energy into electric energy. The light sensor unit receives light emitted from the light source and light reflected from the subject, and converts the light into electric energy. Such a light sensor unit may include at least two optical detectors.
The optical detector may be realized by a photodiode for converting light into electric energy. In particular, according to the present invention, the photodiode may be suitable for detecting infrared light.
The optical block is disposed in the light receiving path of the optical detector and is disposed around the light sensor unit, thereby blocking some light.
In particular, if the optical block is disposed around the light sensor unit, the corresponding optical block restricts the FOVs of the optical detectors within the light sensor unit and separates the detectable zones of the optical detectors. Further, the optical block increases the detectable zone while decreasing the gray zone in which the FOVs of the respective optical detectors overlap, thereby accurately sensing the gesture. In other words, the optical block serves to cut off a partial light receiving path of the light reflected from the subject and received by the optical detectors. That is, the optical block is disposed to partially cut off the light receiving path of each of the optical detectors.
In addition, if the optical block 70 is disposed around the light source, the optical block may serve to restrict a radiation angle of the light source. In other words, the optical block may be a structure for partially blocking light emitted from the light source.
Next, various structures of the light source, the light sensor unit and the optical block will be described in detail with reference to exemplary embodiments of the invention.
In the drawings corresponding to the embodiments, like numerals refer to like elements having the same functions within the scope of the present invention.
The motion gesture sensing module according to the first embodiment includes a single light source 11, a light sensor unit 20 including at least two optical detectors 21, and an inner-wall type optical block 71 disposed between the optical detectors 21.
Although
The motion gesture sensing module according to the present invention may also detect motion along multiple axes using at least three optical detectors 21 and inner-wall type optical blocks 71 disposed there between.
Here, the inner-wall type optical block 71 may be composed of an upright optical block 71a, a bent optical block 71b, and an oblique optical block 71c.
First, referring to
The upright optical block 71a has a higher height than the two optical detectors 21 and serves to partially restrict FOVs (θ) of the optical detectors 21. Thus, the upright optical block 71a separates detectable zones of the two optical detectors 21, thereby decreasing the gray zone in which the FOVs (θ) of the optical detectors 21 overlap, while increasing the detectable zones.
Referring to
Here, although the gray zone can be decreased by increasing the height of the upright optical block 71a, the height of the upright optical block 71a may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed. As shown in
Next, referring to
The bent optical block 71b has a shape wherein a straight base disposed between the two optical detectors 21 is bent toward the optical detectors 21 at an upper end thereof, and the extended portion is placed above the two optical detectors 21 and restricts the FOVs (θ) of the optical detectors 21. Here, distal ends of the extended portion of the bent optical block 71b may be placed corresponding to central locations of the optical detectors 21, respectively.
Referring to
Here, as the length of the extended portion bent at the upper end of the optical block 71b increases, each FOV (θ) will be further restricted together with the detectable zones. Therefore, the length of the extended portion may be restricted in consideration of use of the motion gesture sensing module or design of a base device on which the motion gesture sensing module will be disposed.
Next, referring to
The oblique optical block 71c is disposed between the two optical detectors 21 and has a horizontal cross-section, the area of which increases upward, such that lateral sides of the optical block 71c facing toward the opposite optical detectors 21 can become larger upward, thereby forming oblique lateral sides. Therefore, these lateral sides of the optical block are operated to restrict the FOVs (θ) of the optical detectors 21. Here, the oblique optical block 71 chasa higher height than the two optical detectors 21 to restrict the FOVs (θ) of the optical detectors 21. Distal ends of the largest portion at the top of the oblique optical block 71c may be placed corresponding to the central location of the optical detectors 21, respectively.
Referring to
Here, as the largest portion at the top of the oblique optical block 71c increasingly protrudes, each FOV (θ) will be further restricted together with the detectable zones. Therefore, protrusion of the largest portion may be restricted in consideration of use of the motion gesture sensing module or design of a base device on which the motion gesture sensing module will be disposed.
The motion gesture sensing module according to the second embodiment includes a single light source 11, a light sensor unit 20 having at least two optical detectors 21, and outer-wall type optical blocks 72 respectively disposed at outer circumferences of the optical detectors 21.
Although
Here, the outer-wall type optical block 72 may be composed of an upright optical block 72a, a bent optical block 72b and an oblique optical block 72c.
First, referring to
The upright optical block 72a has a higher height than the two optical detectors 21 and serves to restrict the FOV (θ) of the optical detector 21.
Referring to
As a result, as compared with the case where the left and right upright optical blocks 72a are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are separated and increased. As a result, the upright optical blocks 72a respectively disposed at the left and right sides of the optical detectors 21 separate the detectable zones of the optical detectors 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the height of the upright optical block 72a increases, the gray zone will be decreased together with the detectable zones. Therefore, the height of the upright optical block 72a may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed.
Next, referring to
Each of the bent optical blocks 72b placed at opposite sides has a shape wherein a straight base is bent inward (that is, toward the optical detector) at an upper end thereof, and the extended portions are placed above the two optical detectors 21 and restrict the FOVs (θ) of the optical detectors 21. Here, distal ends of the extended portions at the upper ends of the bent optical blocks 72b may be placed corresponding to detection centers of the adjacent optical detectors 21.
Referring to
As a result, as compared with the case where the left and right bent optical blocks 72b are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are separated and increased. As a result, the bent optical blocks 72b respectively disposed at the left and right sides of the optical detectors 21 separate the detectable zones of the optical detectors 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the length of the extended portion bent at the upper end of each of the bent optical blocks 72b increases, the gray zone will be decreased together with the detectable zones. Therefore, the length of the optical block 72a may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed.
Next, referring to
Both the oblique optical blocks 72c each have the horizontal cross-section, the area of which increases upward, such that lateral sides facing inward (that is, toward the optical detectors) can become larger upward, thereby forming oblique lateral sides. Therefore, these lateral sides of the oblique optical blocks are operated to restrict the FOVs (θ) of the optical detectors 21. Here, the largest portion at the top of the oblique optical block 72c may be formed corresponding to the central location of the optical detector 21.
Referring to
As a result, as compared with the case where the left and right oblique optical blocks 72c are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are separated and increased. As a result, the oblique optical blocks 72c respectively disposed at the left and right sides of the optical detectors 21 separate the detectable zone of the optical detector 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the largest portion at the top of the oblique optical block 72c increasingly protrudes, the gray zone will be decreased together with the detectable zone. Therefore, the largest portion may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed.
The motion gesture sensing module according to the third embodiment includes a single light source 11, a light sensor unit 20 provided as a single optical sensor chip 22 having at least two optical detectors 21, and an inner-wall type optical block 71 disposed between the optical detectors 21. Further, the light source 11 and the optical sensor chip 22 are packaged and partitioned by a package partition wall.
Here, a package 80 may include a base 81 on which the light source 11 and the optical sensor chip 22 are mounted, sensor partition walls 82 protruding from outer circumferences of the optical sensor chip 22 to partition an installation region of the optical sensor chip 22, and a light source partition wall 83 protruding to partition an installation region of the light source 11.
Although
Here, the inner-wall type optical block 71 may be composed of an upright optical block 71a, a bent optical block 71b, and an oblique optical block 71c.
First, referring to
The upright optical block 72a has a higher height than the two optical detectors 21 of the optical sensor chip 22 and serves to restrict the FOVs (θ) of the optical detectors 21.
Referring to
Here, although the gray zone can be decreased by increasing the height of the upright optical block 71a, the height of the upright optical block 71a may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed. Preferably, the height of the upright optical block 71a is the same as that of the sensor partition wall 82.
Next, referring to
The bent optical block 71b has a shape wherein a straight base disposed between the two optical detectors 21 is bent toward the optical detectors 21 at an upper end thereof, and the extended portion is placed above the two optical detectors 21 and restricts the FOVs (θ) of the optical detectors 21. Here, distal ends of the extended portion of the bent optical block 71b may be placed corresponding to central locations of the optical detectors 21, respectively.
Referring to
Here, as the length of the extended portion at the upper end of the bent optical block 71b is increased, each FOV (θ) will be further restricted together with the detectable zones. Therefore, the length of extended portion may be restricted in consideration of use of the motion gesture sensing module or design of a base device on which the motion gesture sensing module will be disposed. Preferably, the height of the bent optical block 71b is the same as that of the sensor partition wall 82.
Next, referring to
The oblique optical block 71c is disposed between two optical detectors 21 of the optical sensor chip 22, and has a horizontal cross-section, the area of which increases upward, such that lateral sides of the oblique optical block 71c facing toward the opposite optical detectors 21 can protrude farther upward, thereby forming oblique lateral sides. Therefore, these lateral portions are operated to restrict the FOVs (θ) of the optical detectors 21. Here, the most protruding portion at the top of the oblique optical block 71c may be formed corresponding to the central location of the optical detector 21 of the optical sensor chip 22.
Referring to
Here, as the largest portion at the top of the oblique optical block 71c increasingly protrudes, each FOV (θ) will be further restricted together with the detectable zones. Therefore, protrusion of the largest portion may be restricted in consideration of use of the motion gesture sensing module or design of a base device on which the motion gesture sensing module will be disposed. Preferably, the height of the oblique optical block 71c is the same as that of the sensor partition wall 82.
The motion gesture sensing module according to the fourth embodiment includes a single light source 11, a light sensor unit 20 provided as a single optical sensor chip 22 including at least two optical detectors 21, and a package 80 on which the light source 11 and the optical sensor chip 22 are mounted. Here, the package 80 serves to restrict the FOVs (θ) of the optical detectors 21.
That is, the package 80 may include a base 81 on which the light source 11 and the optical sensor chip 22 are mounted, sensor partition walls 82 protruding from outer circumferences of the optical sensor chip 22 to partition an installation region of the optical sensor chip 22, and a light source partition wall 83 protruding to partition an installation region of the light source 11.
Although
Here, the sensor partition wall 82 may be composed of an upright partition wall 82a, a bent partition wall 82b, an oblique partition wall 82c, and an upper partition wall 82d.
First, referring to
The upright partition wall 82a has a higher height than the two optical detectors 21 of the optical sensor chip 22 and serves to restrict the FOVs (θ) of the optical detectors 21.
Referring to
As a result, as compared with the case where the left and right upright partition walls 82a are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are separated and increased. As a result, the upright partition walls 82a respectively disposed at the left and right sides of the optical detectors 21 of the optical sensor chip 22 separate the detectable zones of the optical detectors 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the height of the upright partition wall 82a increases, the gray zone will be decreased together with the detectable zones. Therefore, the height of the upright partition wall 82a may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed.
Further, only the package structure of the upright partition walls 82a without any separate optical block is sufficient to adjust the FOV (θ) of the optical detector, thereby providing effects of good strength, low cost and miniaturization.
Next, referring to
Each of the bent partition walls 82b placed at opposite sides has a shape wherein a straight base is bent inward (that is, toward the optical detector) at an upper end thereof, and the extended portions are placed above the two optical detectors 21 of the optical sensor chip 22 and restrict the FOVs (θ) of the optical detectors 21. Here, distal ends of the extended portions at the upper ends of the bent partition walls 82b may be placed corresponding to detection central locations of the adjacent optical detector 21.
Referring to
As a result, as compared with the case where the left and right bent partition walls 82b are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are separated and increased. As a result, the bent partition walls 82b respectively disposed at the left and right sides of the optical detectors 21 separate the detectable zones of the optical detectors 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the length of the extended portion bent at the upper end of each of the bent partition walls 82b increases, the gray zone will be decreased together with the detectable zones. Therefore, the length of the extended portion may be restricted in consideration of use of the motion gesture sensing module or design of a base device on which the motion gesture sensing module will be disposed.
Further, only the package structure of the bent partition walls 82b without any separate optical block is sufficient to adjust the FOV (θ) of the optical detector, thereby providing effects of good strength, low cost and miniaturization
Next, referring to
Each of the oblique partition walls 82c has a horizontal cross-section, the area of which increases upward, such that lateral sides of the oblique partition walls facing inward (that is, toward the optical detectors) can increase upward, thereby forming oblique lateral sides. Therefore, these lateral portions are operated to restrict the FOVs (θ) of the optical detectors 21. Here, the largest portion at the top of the oblique partition wall 82c may be formed corresponding to the central location of the optical detector 21.
Referring to
As a result, as compared with the case where the left and right oblique partition wall 82c are not provided, the gray zone in which the FOVs (θ) of the optical detectors 21 overlap is decreased, whereas the detectable zones are increased. As a result, the oblique partition walls 82c respectively disposed at the left and right sides of the optical detectors 21 increase the detectable zones of the optical detectors 21 while decreasing the gray zone, thereby enabling effective detection of sensitive motion.
Here, as the largest portion at the top of the oblique partition wall 82c increasingly protrudes, the gray zone will be decreased together with the detectable zone. Therefore, the largest portion may be restricted in consideration of a connection structure and design of a base device on which the motion gesture sensing module will be disposed.
Further, only the package structure of the oblique partition wall 82c without any separate optical block is sufficient to adjust the FOV (θ) of the optical detector, thereby providing effects of good strength, low cost and miniaturization.
Next, referring to
Here, the upper partition wall 82d serves to cover the optical sensor chip 22 while the optical sensor chip 22 is placed in the package 80, and includes light receiving holes 82e at portions corresponding to the locations of the optical sensor chip 22.
Here, the upper partition wall 82d serves to restrict the FOVs (θ) of the optical detectors 21 in the optical sensor chip 22.
Referring to
With this configuration, only the package structure of the upper partition wall 82d without any separate optical block is sufficient to adjust the FOV (θ) of the optical detector, thereby providing effects of good strength, low cost and miniaturization.
The foregoing embodiments illustrate and describe that motion gesture of a subject moving along a single axis is detected through two optical detectors 21. However, as mentioned above, it should be understood that the present invention may also be applied to detection of motion along multiple axes using at least three optical detectors 21.
First, as described in the first embodiment (see
Referring to
The inner-wall type optical block 71 having a cross-shape has a higher height than the optical detector 21 of the optical sensor chip 22 and serves to restrict the FOV (θ) of each of the optical detectors 21.
With this structure, when three optical detectors are provided, as shown in
In general, leftward and rightward motions of a subject can be sensed by the first optical detector 21a and the second optical detector 21b, and upward and downward motions of the subject can be sensed by the third optical detector 21c and the second optical detector 21b, thereby distinguishably sensing the motion gesture of the subject moving along multiple axes. In particular, the inner-wall type optical block 71 having the cross-shape partitions the detectable zones of the optical detectors, and decreases the gray zone, thereby more sensitively detecting the gesture.
In addition, when four optical detectors are provided as shown in
Here,
First, referring to
Therefore, the first optical detector 21a and the second optical detector 21b can detect the motion gesture of the subject moving in the left and right spaces, and the third optical detector 21c and the second optical detector 21b can detect the motion gesture of the subject in the upper and lower spaces.
Next, referring to
Therefore, the first optical detector 21a and the second optical detector 21b can detect the motion gesture of the subject moving in the left and right spaces, and the third optical detector 21c and the fourth optical detector 21d can detect the motion gesture of the subject in the upper and lower spaces.
Next, referring to
Therefore, the first optical detector 21a and the second optical detector 21b can detect the motion gesture of the subject moving in the left and right spaces, and the third optical detector 21c and the fourth optical detector 21d can detect the motion gesture of the subject in the upper and lower spaces.
Next, referring to
Therefore, the first optical detector 21a and the second optical detector 21b can detect the motion gesture of the subject moving in the left and right spaces, and the third optical detector 21c and the fourth optical detector 21d can detect the motion gesture of the subject in the upper and lower spaces.
It will be understood that such arrangement of the optical detectors and the shapes of the light receiving holes may be changed in various ways in addition to those shown in
Then, four optical operators 21 are arranged as shown in
Referring to
With this structure, the first optical detector 21a has the FOV (θ) biased leftward, thereby detecting the motion gesture of the subject moving in the left space of the motion gesture sensing module.
Further, the second optical detector 21b has the FOV (θ) biased rightward, thereby detecting the motion gesture of the subject moving in the right space of the motion gesture sensing module.
Further, the third optical detector 21c has the FOV (θ) biased upward, thereby detecting the motion gesture of the subject moving in the upper space of the motion gesture sensing module.
Further, the fourth optical detector 21d has the FOV (θ) biased downward, thereby detecting the motion gesture of the subject moving in the lower space of the motion gesture sensing module.
In general, the leftward and rightward motions of the subject can be sensed by the first optical detector 21a and the second optical detector 21b, and the upward and downward motions of the subject can be sensed by the third optical detector 21c and the second optical detector 21b, thereby distinguishably sensing all of the motion gestures of the subject moving along the multiple axes. This is the same as the examples of
Next, a motion gesture sensing module according to a fifth embodiment based on the principle of the present invention will be described with reference to
First, referring to
The package 80 includes a sensor chip accommodating portion 85 open upward for accommodating the optical sensor chip 22 therein, and a light source accommodating portion 86 open upward for accommodating the light source 11 therein.
Here, the sensor chip accommodating portion 85 and the light source accommodating portion 86 are formed to accommodate the optical sensor chip 22 and the light source 11 therein, and have horizontal sizes larger than the horizontal sizes of the optical sensor chip 22 and the light source 11, respectively.
The optical sensor chip 22 may include two optical detectors to sense motion gesture of a subject moving along a single axis, or three or more optical detectors to sense the motion gesture of the subject moving along multiple axes.
The cover 87 serves to cover the upper portion of the package 80 accommodating the optical sensor chip 22 and the light source 11 therein, and is formed with a light emitting hole 87a corresponding to a location of the light source 11 and a light receiving hole 87b corresponding to a location of the optical sensor chip 22.
Here, the light emitting hole 87a has a circular shape and serves as a passage through which light emitted from the light source 11 travels to the outside of the package 80. Preferably, the light emitting hole 87a has a larger diameter than the light source 11 such that light emitted from the light source 11 can be smoothly emitted to the outside of the package 80. An emitting angle of the light source 11 may be adjusted by adjusting the diameter of the light emitting hole 87a, whereby an operation range of the motion gesture sensing module can be adjusted.
In addition, the light receiving hole 87b has a quadrangular shape, and the cover 87 around the light receiving hole 87b acts as an optical block to restrict the FOVs (θ) of the optical detectors 21 within the optical sensor chip 22. Preferably, the cover 87 formed with the light receiving hole 87b partially covers each of the optical detectors while partially exposing each of the optical detectors through the light receiving hole 87b. As shown in
Preferably, the size of the light receiving hole 87b is smaller than that of the optical sensor chip 22. More preferably, the size of the light receiving hole 87b is determined to be more inclined inward (that is, toward the center) than the location of each of the optical detectors 21 of the optical sensor chip 22.
This structure will be described in detail with reference to
In
Therefore, the cover 87 operates like the bent upper end of the bent partition wall 82b described in
As a result, the respective optical detectors 21a, 21b, 21c, 21d have detectable zones at both sides of the opposite optical detector, and the FOVs (θ) overlap to form the gray zone above the corresponding light receiving holes 87b.
Therefore, the gray zone in which the FOVs (θ) of the four optical detector 21a, 21b, 21c, 21d overlap is decreased into a small zone (above the light receiving hole), whereas the detectable zones are increased.
With this structure, only the package 80 and the cover 87 without any separate optical block is sufficient to adjust the FOV (θ) of the optical detector, thereby providing effects of good strength, low cost and miniaturization.
Here, the light sensor unit 20 is realized by one optical sensor chip 22 including at least two optical detectors 21, in which a plurality of sectional optical blocks 73 is disposed above the optical detector 21.
As shown in
In particular, as shown in
That is, in
Here, the detectable zone and detecting direction of the optical detector 21 may vary by changing the cross-section of the sectional optical blocks 73 or the arranging direction of the sectional optical blocks 73 (see
In this structure, a sectional optical block having a relatively low height is used without a separate optical block having a relatively high height, thereby providing advantages in miniaturization of the motion gesture sensing module while enabling more sensitively detection of motion of a subject.
Alternatively, the sectional optical blocks 73 may be disposed to set the detectable zones of at least two optical detectors 21 in at least two directions (that is, leftward, rightward, diagonal and zenithal directions) depending upon arrangement (that is, lengthwise, breadthwise, and diagonal arrangements) of the sectional optical blocks 73.
On the other hand, the basic principle of the present invention is that the respective optical detectors are configured to receive different quantities of light in accordance with locations of subjects. The respective optical detectors receive light reflected from the subject and generate electric energy in proportion to the received quantities of light. Then, as shown in
Thus, the determiner determines detailed upward, downward, leftward and rightward motions of the subject by comparing the qualities of light between the respective optical detectors, thereby sensing a rotational (i.e., clockwise or counterclockwise) direction or touch in space (i.e., click) of the subject based on the motion of the subject.
Here, when the motion gesture sensing module according to the invention is applied to a portable device, the above configuration of the sensor processor must be improved to reduce power consumption. In addition, when the light source is a light emitting diode (LED), the LED consumes tens to hundreds of mA when driven, thereby causing power noise and ground noise. To overcome such noise, the configuration of the sensor processor may be improved, as shown in
Referring to
In
Referring to
On the other hand,
In the sensor processor of
This motion gesture sensing module may include an illumination sensor.
The illumination sensor measures brightness or quantity of light around the corresponding gesture sensing module, and generates an illumination value. Such an ambient illumination value may be compared with a certain reference to automatically control whether to drive or hold the motion gesture sensing module.
The illumination sensor employs a light receiving element including a photodiode to measure an ambient quantity of light such that the determiner or the controller can receive the measured illumination value and determine and control whether to drive or hold the motion gesture sensing module.
In the aforementioned embodiments, the motion gesture sensing module according to the present invention receives input of a control signal corresponding to a user's motion by sensing a spatial motion without contact, instead of user's direct touch, and thus can be optimized as a new input interface for portable communication devices such as smart phones, cellular phones, and the like; and portable information terminals such as personal digital assistants (PDAs), handheld personal computers (PCs), notebook computers, laptop computers, WiBro terminals, MP3 players, MD players, etc.
In particular, the motion gesture sensing module according to the present invention may provide a reading mode for monitoring user’ use of the corresponding device and determining a display state of a display when the sensing module is applied to a display device such as a smart phone.
Here, the reading mode determines whether a user views a screen displayed on the display, thereby determining whether to maintain the display state, i.e. the driving state of the screen.
Basically, while a user views the screen of the display, a distance between the screen and the user is relatively short and there is no sudden motion of the user.
Therefore, in the motion gesture sensing module according to the present invention with the structure wherein at least one light source emits light and the light reflected from the subject is received by at least one optical detector, the reading mode is maintained in accordance with intensity of received light, thereby continuously driving the screen. This is because a distance between the display device (more specifically, the motion gesture sensing module) and a user is relative short while the user is viewing the screen of the display device, and the optical detector can receive light of relatively strong intensity.
Additionally, in the motion gesture sensing module according to the present invention with the structure wherein at least one light source emits light and the light reflected from the subject is received by at least one optical detector, the reading mode is maintained if there is no relative motion of the subject, thereby continuously driving the screen. This is because there is no sudden motion of a user while the user is viewing the screen of the display device.
Although some embodiments have been described above, it should be understood that these embodiments are given by way of illustration only, and that various modifications, variations, and alterations can be made without departing from the spirit and scope of the invention. Therefore, the scope of the invention should be limited only by the accompanying claims and equivalents thereof.
Number | Date | Country | Kind |
---|---|---|---|
1020120030668 | Mar 2012 | KR | national |
1020130018300 | Feb 2013 | KR | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/KR2013/002512 | 3/26/2013 | WO | 00 |