This invention relates generally to transmitters, such as pointing devices, used to interact with other devices and, more specifically, relates to transmitters transmitting an illumination field and receivers receiving the illumination field.
Pointing devices, such as laser pointers, are transmitters that produce an energy beam in the visible wavelengths. Other pointing devices can use infrared (IR) wavelengths. These pointing devices create an energy beam, and are typically produced as a pulse. The energy beam is produced over a particular two- or three-dimensional angle that creates an illumination field over a certain region. The illumination field generally has constant illumination intensity in the region. Laser pointers tend to produce very narrow (e.g., over small angles), relatively high energy beams with longer pulses, while other pointing devices such as IR pointing devices produce wider (e.g., over larger angles), relatively low power energy beams with shorter pulses.
Pointing devices exist that are used to allow a user to interact with a device. For instance, pointing devices can be used for controlling a graphical user interface or a game on a large television (TV) screen. The pointing device, however, can interact with the receiver to perform pointing functions by orienting or changing orientation of the pointing device.
A problem with such pointing devices is that they need acceleration or gravity sensors for detecting the orientation or change of orientation of the device and a wireless connection for transmitting the orientation data to a receiver such as a TV set. These sensors and wireless transmitter add to the bulk, complexity, and cost of the pointing devices. Additionally, the receiver also has to be implemented with a wireless connection for communication with the pointing device.
Nonetheless, accelerometer equipped handheld pointing devices have been introduced where scrolling and pointing on a display of a controlled device is achieved by tilting and moving the pointing device. For example, two types of devices incorporating accelerometers are as follows. One device is a handheld remote controller used for pointing on a stationary device, such as a TV set. The other device is a handheld stand-alone device (like the motion-controlled mobile phone) which can be controlled by tilting the device.
A problem here is that the handheld pointing device cannot be used while walking or used while riding in a moving vehicle. One could mount another accelerometer on the user and have the accelerometer calculate the movement of the pointing device relative to the user, which would alleviate the mentioned problem. This is technically rather complicated to implement, however, and is costly.
Thus, there are problems with current pointing devices and associated receivers.
In an exemplary embodiment of the invention, a method is disclosed that includes transmitting from an emitter a pulse of an energy beam. The beam creates a field with a varying gradient, where the gradient has a direction substantially transverse to a propagation direction of the beam. One or more detectors receive a portion of the field. For a respective one of the one or more detectors, a value is determined corresponding to an illumination level of the portion of the field received by the detector, wherein the value of the field is indicative of relative position between the detector and the emitter.
In another exemplary embodiment, a transmitter includes an emitter adapted to transmit an energy beam, the beam creating a field with a varying gradient. The gradient has a direction substantially transverse to a propagation direction of the beam. The transmitter further includes control circuitry adapted to cause the emitter to transmit the energy beam for a duration.
In another exemplary embodiment, a receiver includes one or more detectors adapted to receive a portion of a first field of a first energy beam, the first field having a first varying gradient having a first direction substantially transverse to a propagation direction of the first beam. The one or more detectors are further adapted to receive a portion of a second field of a second energy beam, the second field having a second varying gradient having a second direction substantially transverse to a propagation direction of the second beam. The receiver further includes detector circuitry coupled to the one or more detectors and adapted to determine values, each value corresponding to a portion of the field received by a respective one of the one or more detectors. The detector circuitry is further adapted to use the values to determine relative position between the respective detector and one or more emitters that emitted the first and second beams.
The foregoing and other aspects of embodiments of this invention are made more evident in the following Detailed Description of Exemplary Embodiments, when read in conjunction with the attached Drawing Figures, wherein:
The inventor has realized that it would be beneficial to provide relative position detecting functionality between a transmitter such as a pointing device and a receiver, so that orientation or change in orientation between transmitter and receiver can be determined with minimal or no sensors and while allowing such systems to be used while walking or used while riding in a moving vehicle. Consequently, certain exemplary embodiments of the disclosed invention provide transmitters, receivers, and systems with relative position detecting functionality for positioning between detectors on receivers and emitters on transmitters. Exemplary embodiments allow the systems to be used while walking or in an automobile.
Referring now to
At a first stage, a first illumination field 30 (see
In a second stage, the pointing device 1 emits a second beam 2 having an illumination gradient 31. Graph 40 shows that the magnitude, F1, of the illumination field 31 goes from high (e.g., at point 33) to low (e.g., at point 33′) along the x-axis in
A detector 4 measures the level of the illumination falling upon the photodiode during the transmission of the illumination field 31. If, for example, the pointing device 1 is pointed to the right as shown, the photodiode detector 4 coincides somewhere nearer the left margin of the illumination field and consequently the level of illumination would be high. If the pointing device 1 is pointed toward the left, the illumination level at the photodiode detector 4 would be low.
The same procedure applies for the third illumination field 32 (
Between the periods when the illumination fields 30-32 are sent, there is typically a period during which the pointing device 1 will not be transmitting. The detector 4 during this time can determine the background illumination level, which is the minimum illumination level of the illumination field at the detector 4.
Because the television 5 has determined the maximum and minimum illumination levels and values of illumination corresponding to an illumination level for an illumination field 31, 32, the television 5 can determine values for a relative position of the detector 4 relative to the pointing device 1, as explained in more detail below.
Turning now to
There are pauses 2051, 2052 between the pulses 2010, 2020, and 2030 of a sequence 2000 and typically a longer pulse 2050 between sequences 2000. The pauses can be used to determine the background illumination level 2070, which should be the same as the lowest illumination levels at points 33′ and 34 at the detector 4 for an illumination field 31, 32, respectively. The pulse 2010 should produce the maximum illumination level at the detector 4, and the maximum illumination level should be the same as the highest illumination levels at points 33 and 34′ at the detector 4 for an illumination field 31, 32, respectively.
A position of the detector in the illumination fields 31, 32 can be expressed as an (x,y) position vector with the origin of coordinates, e.g., in the bottom left corner of the field, as shown in
It should also be noted that the illumination levels 2010, 2020, and 2030 can be used to detect movement. In the latter example, there would not necessarily be an actual determination of an (x,y) vector and instead, movement would be determined through comparison of current values for illumination levels 2020, 2030 with previously determined value for these illumination levels. This is described in more detail below.
The examples of
As another example, the transmitter 2130 is clipped on the clothing of the user and a second transmitter 2120 is clipped on headwear (not shown). Scrolling and zooming on a handheld display (e.g., receiver 2150) could be achieved by moving the hands and a cursor could be controlled by turning the head (e.g., up, down, sideways). In this exemplary embodiment, the detector 2140 would comprise two detectors, one detector corresponding to each of the transmitters 2120, 2130. Each transmitter 2120, 2130 would operate at different wavelengths, and several detectors would operate at corresponding wavelengths. It should be noted that wavelength and frequency are related and will be considered to be equivalent herein (e.g., a range of wavelengths corresponds to a range of frequencies).
A single illumination field such as an illumination field 31, 32 has a Signal-to-Noise Ratio (SNR) that typically gets worse towards the “dark end”(e.g., points 33′, 34, respectively) of the illumination field. However, this reduction in SNR probably does not matter, and the embodiments described above are easy to understand. Nevertheless, should the lower SNR of the dark end of an illumination field, options exist for improving the overall SNR of relative position measurements.
Referring now to
At a first stage, a first illumination field 6 (see
Next, a second illumination field 7 (see
Note that the change in direction of the intensity gradient between illumination fields 6 and 7 occurs when each of the beams 2 are transmitted and not necessarily at reception. In other words, at the detector 4, if the pointing device is being rotated extremely rapidly, the two illumination fields 6, 7 may not have exactly opposite directions of intensity gradients 10, 11, respectively. Nonetheless, the two illumination fields 6, 7 were transmitted with approximately opposite directions of intensity gradients 10, 11, respectively.
The same procedure applies for the third illumination field 8 (
Note that the directions of the intensity gradients change between pulses in this exemplary embodiment. In particular, the intensity gradient is reversed between the pulses shown in
Additionally, the illumination fields 6-9 and their respective intensity gradients 10-13 (and the illumination fields 31 and 32 and their respective intensity gradients 33 and 34) are substantially transverse to a direction, the z direction in
The illumination level at the photodiode detector 4 during reception of an illumination field 6-9 is dependent on not only the position of the detector 4 in a respective intensity gradient 10-13, but also the distance of the pointing device 1 and level of background IR radiation. One technique for generating illumination fields 6-9 is to use four light emitting diodes (LEDs), one for each illumination field. Illumination fields from four LEDs are shown in
The receiver should be synchronized with the pointing device, i.e., the receiver should be able to determine which illumination field is the first illumination field of a sequence and in what order the sequence of illumination fields there will be. This can be accomplished for instance by transmitting the sequence as a burst with pauses in between. There is a pause 550 prior to another sequence 500 of pulses 510, 520, 530, and 540 and pauses 580, 581, 582 between the pulses 510-540.
A calibration field 590 could be created by firing two LEDs simultaneously, so that, e.g., intensity fields 6 and 7 are superimposed. A calibration field 590 at the beginning of each sequence of pulses 510-540 would tell the receiver what is the maximum possible illumination level at the current distance of the pointing device 1. Note that as the illumination fields 6-9 are linear and symmetrical in this example, the resulting calibration field 590 has uniform illumination.
The maximum illumination level 560 at any distance can also be deduced without using a calibration field 590: At any point and any distance, the maximum possible illumination level 560 is equivalent to the sum of illumination levels during 1st and 2nd illumination fields or 3rd and 4th illumination fields, as shown in
The background illumination level 570 can be measured between the fields. To maximize signal-to-noise ratio, it is beneficial to have the transmitter and receiver work at a very narrow bandwidth. It should be noted that it is beneficial, when using the same frequency of transmission for the pulses 510-540, for the pulses 510-540 to be non-overlapping, such that there are pauses 581-582 between pulses 510-540. However, it could be possible when using a single frequency when producing the pulses 510-540 for the pulses 510-540 to overlap, if desired, as long as there is some time period during which one pulse is on while the other pulses are off.
It should be clear to one skilled in the art as to how to calculate the x- and y-coordinates from the measured intensities during the fields and the background and maximum illumination levels. For example, in the configuration of
What is also of interest is how the relative levels of illumination during the illumination fields change between sequences. These changes tell which direction the remote pointing device 1 is moving translationally or rotationally. Consequently, the pointing device is beneficially used either in relative position control mode for translational movement (e.g., like a tabletop mouse) or for rotational movement (e.g., velocity determination like a joystick).
Note that even in absolute position control mode, pointing the pointing device 1 is not like pointing with a laser pointer, which is absolute in its strictest sense. Absolute position control mode attempts to determine the x,y values at which the pointing device 1 resides relative to the detector 4. With a pointing device 1, the ‘gain’(e.g., pointing device movement or pointing device rotation) can be varied freely. In relative position control mode, the gain can be dynamically variable as with a normal tabletop mouse. Relative position control mode attempts to determine movement or rotation of the pointing device I relative to the detector 4.
One way of moving the illumination field across the detector 4 is by rotating the pointing device 1. But, movement can be done also by moving the pointing device 1 translationally, i.e., sideways or up and down. This can be turned into an advantage: Coarse pointing can be performed by rotational movement and fine pointing performed by translational movements. A user would soon be able to perform these movements and realize the results. Note however, that the gain of translational movement is dependent on the distance between pointing device 1 and detector 4 (whereas the gain of rotational movement is independent of the distance). It should be noted that another technique for fine pointing is also described in reference to
Unintentional rotation of the emitter or the receiver about the z-axis (of either the emitter or receiver) can affect pointing in the x- and y-directions. A technique for determining rotation of the emitter or the receiver about the z-axis (of either the emitter or receiver) is shown in
The vector A represents the (x,y) position of the position of the detector a in the illumination fields, as determined by the whole series of intensity gradients (e.g., possibly including illumination fields having a uniform intensity at maximum illumination level) as described in reference to
More specifically, the vector {right arrow over (A)} may be represented as {right arrow over (A)}=Ax{circumflex over (x)}+Ayŷ, where Ax and Ay are scalars indicating (x,y) positions of the detector a relative to an origin, (0,0), of the illumination field. Similarly, the vector {right arrow over (B)} may be represented as {right arrow over (B)}=BX{circumflex over (x)}+ByŶ where Bx and By are scalars indicating (x,y) positions of the detector b relative to an origin, (0,0), of the illumination field. Then, {right arrow over (B)}−{right arrow over (A)}=(Bx−Ax){circumflex over (x)}+(By−Ay)ŷ, and tan(α)=(By−Ay)/(Bx−Ax), where α is the angle between the x axis and the vector {right arrow over (B)}−{right arrow over (A)}.
This information can be used for calculating correction for the (x,y)-position and/or as an extra input. For example, the receiver 2200 could be a stationary device, such as a TV set, and the emitter could be a hand-held remote controller, mainly operated with a tilting action.
For instance, turning to
Returning to
Rotation about y-axis would also shorten the vector |B−A|. Using two detectors 2210, 2220, it is generally not possible to know if a shorter |B−A| is because of distance between the receiver 2220 and detector 2280 or rotation (e.g., of the receiver 2220) about the y-axis. If rotation about x- and y-axes is likely and distance information is required, more detectors should be used.
For example, detectors a, b, c and d (detectors 2210, 2220, 2215, 2225, respectively) can be arranged in a square array on the front face of the receiver 2200. The (x,y)-values for position vectors A, B, C (not shown) and D (not shown) in will form a perspective image of the array. Each possible combination of position and degree of rotation of the receiver 2200 produces a unique set of position vectors A, B, C and D. Consequently, one can develop algorithms which unambiguously give the (x,y,z)-position and (x,y,z)-rotation of the receiver 2200. This is, as long as the receiver 2200 is not rotated more than 90 degrees about the x-and y-axes. There is no need to rotate more, as one would not be able to see a display on the receiver 2200.
Turning now to
In step 1115, the receiver receives the pulses. In step 1120, the receiver determines values of portions of the illumination fields that impinge on one or more detectors. Steps 1125 and 1130 provide an absolute position control mode, which attempts to determine the x,y values at which the transmitter is relative to the detector on the receiver. Note that “absolute” in this case means that particular x,y values are determined for position vectors, but that the values are still relative to a detector on the receiver. In other words, if there are two detectors spaced a large distance apart on a large receiver, each detector would determine a different x,y value for an emitter. Steps 1140-1155 provide a relative position control mode, which attempts to determine translational movement or rotational movement of the transmitter relative to a detector on the receiver. Note that step 1125 can use inputs from multiple detectors (see
In step 1125, the absolute position(s) is (are) determined. The absolute position will typically be given a (x,y), but could be simply x or y. This “absolute” position is based on the relative position of the transmitter relative to the detector. The absolute position, as shown in the equation above, is typically given in percent. In step 1130, the absolute position would be output. Typically, the output would be to a certain function, which would then use the position.
In step 1140, currently determined values for x,y are compared with previous values. If there are any differences (step 1145=YES), the differences are output in step 1150. Typically, this output would be “the transmitter moved in the +y direction” or “the transmitter moved 5% in the +y direction”. Any suitable technique for indicating movement in one or more directions may be used. Note that step 1140 can use inputs from multiple detectors (see
Referring now to
In the example of
The receiver 1230 comprises N detectors 1235-1 through 1235-N, which in combination with a corresponding detector circuitry 1240-1 through 1240-N, produces values 1241-1 to 1241-N of the illumination field seen by individual detectors 1235. The detectors 1235 would typically be photodiodes and corresponding detector circuitries 1240 are known to those skilled in the art. An exemplary detector circuitry is shown in
The receiver circuitry 1245 comprises a relative position detection module 1250, previous values 1255 (if used), and a position function module 1260. Relative position detection module 1250 would perform, using values 1241, steps 1120-1155 of method 1100 of
The position function module 1260 is a module that accepts output 1251 (e.g., from steps 1130, 1150, and 1155 of
Referring now to
Creating intensity gradients can be implemented using separate IR LEDs and optics for each of the four illumination fields. Turning to
The LEDs 1310 can also double as transmitters of digital data to the screen, which would facilitate key presses and the like. By using LEDs 1310 and photodiodes as detectors 1235 working at different wavelengths, the illumination fields (e.g., and digital data) can be emitted simultaneously, making the system faster. In any case, it is beneficial to have the LEDs 1310 and photodiodes as detectors 1235 operate at a narrow bandwidth in order decrease the effect of ambient IR radiation.
It is noted that another, more complex option, is to have the mask 1320 and the cylindrical lens 1340 move into four different locations spaced 90 degrees apart (e.g., 0, 90, 180, and 270 degrees). This is shown in
The detector 1235 can be mounted anywhere on the device to be controlled as long as the detector 1235 is toward the user when the user wishes to interact with the detector by using the transmitter 1210. The detector 1235 does not have to be built-in. Instead, for instance, the detector can also be an enhancement plugged to a port on the receiver 1230 to be controlled. By placing several detectors 1235 (e.g., and associated detector circuitry 1240) around the room, even 360 degree (e.g., spherical) control can be achieved.
The roles of the transmitter 1210 and receiver 1250 can be reversed: the emitter 1300 could be stationary in the room and the detector 1235 could be held by the user. In this case the lateral movement, instead of rotation, of the handheld device could be detected. By having an emitter 1300 and a detector 1235 on both the stationary device and a handheld device, both lateral movement and rotation could be detected.
Turning now to
Referring now to
In this example, the relative position detection module portions 1520 and 1540 implement a single relative position detection module 1250. In other embodiments, the integrated circuit 1530 contains both the relative position detection module portions 1520 and 1540 as a single module. As another example, there could be no discrete circuits as part of receiver circuitry 1500. In still other embodiments, the receiver circuitry can comprise one or more processors, one or more memories, one or more integrated circuits (e.g., containing a processor), and one or more discrete circuits. It should be noted that the control circuitry 1215 can also comprise one or more processors, one or more memories, one or more integrated circuits (e.g., containing a processor), and one or more discrete circuits.
In other exemplary implementations, different types of emitted energy can be used. In principle, the invention can be implemented with any kind of emitted energy beams which can be given an intensity gradient transverse to the direction of propagation, such as: (1) electromagnetic radiation of different wavelengths, such as IR light, visible light, ultraviolet (UV) light (e.g., with visible light you could select the device to be controlled by illuminating the device as if using a torch); and (2) sound (e.g., ultrasound).
As another example, the intensity gradient shown in
Different projected images, other than simple gradients, can also be used. For example, the illumination field projected by the transmitter may be more complicated than mere intensity gradients. Generally speaking, the transmitter projects an image or sets of images on a more or less point-like detector residing in the device being controlled (e.g., the receiver). The device being controlled (e.g., receiver 1230) recognizes position of the detector in the image being projected on the receiver. Or, preferably, the device being controlled detects the direction and velocity of the movement of the image over the detector.
As a first example, consider a system that uses vertical and horizontal gradients (see, e.g.,
Consider, as another example, commercially available digital pens. One such digital pen detects the position of its tip on a special pattern printed on paper. The pattern used on the paper could be projected (e.g., by an IR emitter) as an image with the remote pointing device on a detector resembling that on the Digital Pen. The image would be caused by an intensity gradient that varies, e.g., as a pattern. The image could be a pattern such as a grid, square wave, and logarithmic grids. There are problems with this approach, however. The pointing device would have to project an image of quite a high resolution. In addition, the pattern would have to be in focus at the distance of the detector. The benefit of using a simple, linear gradient as an intensity gradient for an illumination field is that the illumination field (and its corresponding intensity gradient) does not have to be in focus.
Turning now to
An interesting possibility for total hands-free use is to bring an adjustable boom 1620 (e.g., a microphone boom) very close to the lips and provide the boom 1620 with a capacitive touch-key 1630. By pushing the lower lip 1660 outwards a contact is made and a cursor is activated. The method may sound awkward, but the sensitivity of the lips makes it easy for the user to sense if the lip is in contact with the boom or not. Consequently, only very subtle movements, requiring negligible force, are needed for operating the touch-key.
A drawback is that the distance of the boom 1620 from the lips may be difficult to adjust and maintain. There is an alternative solution using a touch key (e.g., capacitive key 1630), which may be awkward but very robust: The user can touch the touch key with his tongue. This system will not look nice, but the system will work and could be useful in some demanding usage contexts. The touch key can be placed in a slight recess to avoid accidental activation.
A benefit from using the disclosed embodiments, instead of an accelerometer in the controlled device, is that the movement is detected relative to the user. This way, the control is less susceptible to interference caused by the user moving about or riding in a vehicle. The control is also versatile because the same effect can be achieved by moving different body parts, e.g., the head or the hands.
It should be noted that the intensity gradients shown in
It should be noted that the various blocks of the logic flow diagram of
In general, the various embodiments of one or both of the transmitter and receiver can include, but are not limited to, cellular telephones, remote controls, pen pointers, personal digital assistants (PDAs), televisions, portable or non-portable computers, image capture devices such as digital cameras, gaming devices, televisions, music storage and playback appliances, Internet appliances, as well as portable or non-portable units or terminals that incorporate combinations of such functions.
The memory(ies) 1420 or other memories may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor-based memory devices, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The processor(s) 1410 may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on a multi-core processor architecture, as non-limiting examples.
Embodiments of the inventions may be practiced in various components such as integrated circuit modules. The design of integrated circuits is by and large a highly automated process. Complex and powerful software tools are available for converting a logic level design into a semiconductor circuit design ready to be etched and formed on a semiconductor substrate. Programs, such as those provided by Synopsys, Inc. of Mountain View, Calif. and Cadence Design, of San Jose, Calif. automatically route conductors and locate components on a semiconductor chip using well established rules of design as well as libraries of pre-stored design modules. Once the design for a semiconductor circuit has been completed, the resultant design, in a standardized electronic format (e.g., Opus, GDSII, or the like) may be transmitted to a semiconductor fabrication facility or “fab” for fabrication.
The foregoing description has provided by way of exemplary and non-limiting examples a full and informative description of the best method and apparatus presently contemplated by the inventors for carrying out the invention. However, various modifications and adaptations may become apparent to those skilled in the relevant arts in view of the foregoing description, when read in conjunction with accompanying drawings and the appended claims. Nonetheless, all such and similar modifications of the teachings of this invention will still fall within the scope of this invention. Furthermore, some of the features of the embodiments of this invention could be used to advantage without the corresponding use of other features. As such, the foregoing description should be considered as merely illustrative of the principles of the present invention, and not in limitation thereof.
Number | Name | Date | Kind |
---|---|---|---|
4745402 | Auerbach | May 1988 | A |
5023943 | Heberle | Jun 1991 | A |
5469193 | Giobbi et al. | Nov 1995 | A |
5734371 | Kaplan | Mar 1998 | A |
6081255 | Narabu | Jun 2000 | A |
6313864 | Tabata et al. | Nov 2001 | B1 |
6333733 | Andersson et al. | Dec 2001 | B1 |
20040200955 | Andzelevich | Oct 2004 | A1 |
20050018958 | Huang et al. | Jan 2005 | A1 |
20050253806 | Liberty et al. | Nov 2005 | A1 |
Number | Date | Country |
---|---|---|
09037357 | Feb 1997 | JP |
10-222293 | Aug 1998 | JP |
Number | Date | Country | |
---|---|---|---|
20070152131 A1 | Jul 2007 | US |