The present invention relates to a remote control, an imaging device, a method and a system for the same, and more specifically to a remote control, an imaging device, a method and a system for the same based on ultrasonic and radio signal ranging in order to realize the functions such as channel selection of TV programs, character input, etc.
With the development of digital TV technology and the increase of digital TV broadcast programs, digital TV has been gradually made entry into our life. An important characteristic of digital TV is that we can choose our favorite programs at any time. However, for the common users who have been accustomed to traditional TV remote control operation, it is not easy to input and specify their favorite programs. Users often need to choose certain function keys from a large number of densely-arranged keys on a remote control. To complete the operation, users unfamiliar with the operation often have to constantly find and confirm the key positions, and then look up the screen to confirm the selection result (for example, the change of TV channels, inputted reservation time, etc.). Meanwhile, as digital TV technology progresses, many new functions require users to input characters, which brings forward a greater challenge to a traditional remote control. All these problems due to a remote control affect seriously the attraction of digital TV to the common users.
In order to solve the above problems, it is an object of the present invention to provide a remote control, a method and a system for the same based on ultrasonic and radio signal ranging such that users are facilitated to utilize remote control to control imaging devices such as TV set, computer or projector.
In an aspect of the present invention provided a remote control comprising an operation means having a plurality of keys, an ultrasonic and radio signal transmitting means for transmitting radio signals and ultrasonic signals while one of the plurality of keys is operated so as to map the position of the remote control into a cursor displayed on a screen, and a control means for controlling the operation means and the ultrasonic and radio signal transmitting means.
According to an embodiment of the present invention, the operation means includes an initializing key, and when the initializing key is pressed, the current position of the remote control is mapped into the central point of the screen.
According to an embodiment of the present invention, the ultrasonic and radio signal transmitting means includes a radio signal transmitting unit for transmitting radio signals under the control of the control means, and an ultrasonic signal transmitting unit for transmitting ultrasonic signals in synchronization with the radio signals under the control of the control means.
In another aspect of the present invention provided an imaging device comprising at least three ultrasonic and radio signal receiving means configured at the predefined position in the same plane as a screen or in the plane parallel to the screen for receiving radio signals and ultrasonic signals transmitted from a remote control, a timing means for starting timing when the ultrasonic and radio signal receiving means receives radio signals and stopping timing when the ultrasonic and radio signal receiving means receives ultrasonic signals so as to obtain a time difference corresponding to the respective ultrasonic and radio signal receiving means, a calculation means for calculating the spatial coordinate of the remote control and the projected coordinate of the spatial coordinate on the screen based on the time difference, and a display means for associating the projected coordinate with the cursor displayed on the screen.
According to an embodiment of the present invention, the calculation means includes and the remote control based on the time difference a distance calculation unit for calculating the distance between the respective ultrasonic and radio signal receiving means and the remote control based on the time difference corresponding to the respective ultrasonic and radio signal receiving means, a coordinate calculation unit for calculating the spatial coordinate of the remote control based on the distance between the respective ultrasonic and radio signal receiving means and the remote control, and a coordinate projection calculation unit for calculating the projected coordinate on the screen based on the spatial coordinate of the remote control.
According to an embodiment of the present invention, the distance calculation unit calculates the distance based on the following expression:
D
i
=T
Di
×V
sound
wherein TDi represents the time taken to transmit ultrasonic signals from the remote control to the respective ultrasonic and radio signal receiving means, and Vsound represents the velocity of ultrasonic wave.
According to an embodiment of the present invention, when the distance between the remote control and the screen increases, the display means expands the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control.
According to an embodiment of the present invention, when the distance between the remote control and the screen decreases, the display means contracts the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control.
According to an embodiment of the present invention, when the distance between the remote control and the screen increases, the display means displays menu in larger font.
According to an embodiment of the present invention, the distance between the remote control and the screen decreases, the display means displays menu in smaller font.
According to an embodiment of the present invention, when the distance between the remote control and the screen suddenly increases, the display means displays menu in larger font.
According to an embodiment of the present invention, the distance between the remote control and the screen suddenly decreases, the display means displays menu in smaller font.
In a further aspect of the present invention provided a remote control system comprising the remote control and the imaging device.
In a further aspect of the present invention provided A remote control method used in a system comprising a remote control and an imaging device, wherein the remote control includes a ultrasonic and radio signal transmitter, and the imaging device is configured with at least three ultrasonic and radio signal receivers at the predefined position in the same plane as the screen or in the plane parallel to the screen, the method comprises the steps of: transmitting simultaneously both radio signals and ultrasonic signals from the ultrasonic and radio signal transmitter, starting timing when the ultrasonic and radio signal receivers receive radio signals and stopping timing when the ultrasonic and radio signal receivers receive ultrasonic signals so as to obtain the time difference corresponding to the respective ultrasonic and radio signal receivers, calculating the spatial coordinate of the remote control and the projected coordinate of the spatial coordinate on the screen based on the time difference, and associating the projected coordinate with the cursor displayed on the screen.
According to an embodiment of the present invention, the step of calculating the spatial coordinate of the remote control and the projected coordinate of the spatial coordinate on the screen based on the time difference includes: calculating the distance between the respective ultrasonic and radio signal receivers and the remote control based on the time difference corresponding to the respective ultrasonic and radio signal receivers, calculating the spatial coordinate of the remote control based on the distance between the respective ultrasonic and radio signal receivers and the remote control, and calculating the projected coordinate on the screen based on the spatial coordinate of the remote control.
According to an embodiment of the present invention, the calculation of the distance is based on the following expression:
D
i
=T
Di
×V
sound
wherein TDi represents the time for transmitting ultrasonic signals from the remote control to the respective ultrasonic and radio signal receivers, and Vsound represents the velocity of ultrasonic wave.
According to an embodiment of the present invention, the method further comprises the step of expanding the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control when the distance between the remote control and the screen increases.
According to an embodiment of the present invention, the method further comprises the step of contracting the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control when the distance between the remote control and the screen decreases.
According to an embodiment of the present invention, the method further comprises the step of displaying menu in larger font when the distance between the remote control and the screen increases.
According to an embodiment of the present invention, the method further comprises the step of displaying menu in smaller font when the distance between the remote control and the screen decreases.
According to an embodiment of the present invention, the method further comprises the step of displaying menu in larger font when the distance between the remote control and the screen suddenly increases.
According to an embodiment of the present invention, the method further comprises the step of displaying menu in smaller font when the distance between the remote control and the screen suddenly decreases.
With the above structure and method of the invention, the operator can intuitively complete relevant control over the imaging device at a distance.
Hereafter detailed description will be made to embodiments of the present invention with reference to accompanying drawings.
As shown in
a) the transmitting node transmits radio synchronization signal and ultrasonic ranging signal simultaneously;
b) the receiving node starts timing when it receives the radio signal, and
records the initial time Ts;
c) the receiving node receives the ultrasonic ranging signal, records the receiving time Te, and then calculates ultrasonic transmission time TD=Te−Ts;
d) calculating the distance D between the transmitting node and the receiving node by the following expression:
D=T
D
×V
sound (1)
wherein Vsound is the velocity of ultrasonic wave.
In other words, the positioning node transmits RF signal and another low-speed signal (for example, ultrasonic wave etc.). The receiving node determines the distance between the positioning node and the receiving node by measuring the time difference between their arrival times.
In order to control an imaging device, it is required to map the spatial position of a remote control onto the screen of the imaging device. In general, to determine the position of a remote control with respect to the screen, it needs to know the positions of at least three nodes in advance, and then determine the spatial position of the remote control according to the positioning algorithm of triangulation. Therefore, if it is possible to accurately measure the distances between the remote control (unknown node) and at least three known nodes, the spatial position of the remote control can be determined.
As shown in
As shown in
As shown in
The imaging device processor 30 includes a timing unit 31 which starts timing when receiving radio signals from the respective ultrasonic and radio signal receivers and stops timing when receiving corresponding ultrasonic signals so as to obtain the time differences corresponding to the four ultrasonic and radio signal receivers respectively, a distance calculation unit 32 which obtains the distances between the four ultrasonic and radio signal receivers and the remote control 40 based on the time differences obtained by the timing unit 31, a coordinate calculation unit 33 which obtains the spatial position of the remote control 40 based on the four distances obtained by the distance calculation unit 32 and the positions of the ultrasonic and radio signal receivers, a coordinate projection calculation unit 34 which calculates the projected position of the remote control on the screen of the imaging device based on the spatial position of the remote control 40, and a screen coordinate display unit 35 which associates the projected position of the remote control on the screen of the imaging device with the cursor, for example, when the remote control moves left at a distance, the cursor is associated with the projected coordinate of the remote control and moved left at a corresponding distance.
In the above embodiment, the advantage lies in integrated processing module and simple implementation of hardware since the timing and calculating processes are carried out in the imaging device processor.
In the remote control's control over the imaging device, after a user presses the cursor key, the following mapping procedure is executed every predefined time, for example, 100 ms.
At S51, radio signal and ultrasonic signal are transmitted simultaneously from the ultrasonic communication part 43 and the radio communication part 44 of the remote control 40;
At S52, the radio signal arrives at the four receivers P1˜P4 provided on the screen and trigger the timing unit 31 in the imaging device processor 30 to start timing;
At S53, the ultrasonic signal arrives at the four receivers P1˜P4 provided on the screen and trigger the timing unit 31 in the imaging device processor 30 to stop timing, and the transmission time ti, i=1, . . . , 4, is calculated by the timing unit 31;
At S54, the distance calculation unit 32 and the coordinate calculation unit 33 provided within the imaging device 50 calculate the coordinate of the remote control by the following expression:
wherein (xi,yi,zi) represents the coordinate of the receiver (known), (x,y,z) represents the coordinate of the remote control to be measured, and V represents the travel speed of ultrasonic wave.
At S55, the coordinate projection calculation unit 34 of the imaging device maps the 3D coordinate of the remote control into the screen, and the coordinate is then converted into the cursor on the screen by the screen coordinate display unit 35.
In the present invention, four ultrasonic and radio signal receivers are provided on the screen so as to establish indeterminate static equation set for solving the 3D coordinate of the remote control 40. According to the preset condition, all the receivers are installed in the same plane, that is, the four receivers lies in the same plane as the screen or in the plane parallel to the screen. Thus, in the indeterminate static equation set, z1, z2, z3 and z4 satisfy the expression as follows:
z1=z2=Z3=Z4 (3)
Therefore, the indeterminate static equation set can be transformed into the following linear matrix equation set:
A residue vector is defined as
r
i=[2(xi−x4)x+2(yi−y4)]−bi,i=1,2,3 (5)
Finding the least-square solution of the above indeterminate static equation (4) can be transformed as finding {right arrow over (x)} to minimize
To minimize F in the above expression is to find the minimum of F:
the above expression is written in the following matrix form:
ATAx=ATb (7)
The vector {right arrow over (x)} solved from the above expression is the least-square solution.
As shown in
As shown in
Then, in the imaging device processor 30, the same operations are carried out respectively in the coordinate calculation unit 33, the coordinate projection calculation unit 34 and the screen coordinate display unit 35. The detailed description will not be repeated here.
Further, when the physical spatial position of the remote control 40 is not located directly in front of the screen, the projection of the remote control will not fall into the screen. In this case, translation between the physical coordinate and the projected coordinate of the remote control is needed to ensure the remote control able to properly control the imaging device.
In the present invention, an initializing key is provided on the remote control 40. When an operator presses this key, the physical spatial coordinate of the remote control is mapped into the origin of the screen. Thus, as shown in
Next, at step S84 the distance calculation unit calculates the distances between the remote control and the respective receivers, and the coordinate calculation unit calculates the coordinate value of the remote control at step S85.
Finally, at step S86, the imaging device processor 30 initializes the coordinate system, that is, maps the current coordinate of the remote control into the central point (origin) of the screen coordinate, and then ends the initializing procedure.
As shown in
In order to eliminate the change in operation due to the distance difference from the operator to the screen, the proportional relation between the moving distance of the screen cursor and the physical moving distance of the remote control can be adjusted using the Z-direction data in the spatial coordinate of the remote control, that is, the physical distance from the remote control to the screen. By expanding the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control at the time of a far operation and contracting the proportion of the moving distance of the screen cursor with respect to the actual moving distance of the remote control at the time of a near operation, the operator can conveniently and correctly control the screen cursor regardless of a far or near operation.
Taking the general case of operating on one side shown in
In
and the result is
AF in the above expression can be a predefine value, for example, 50 cm.
Although the previous analysis discusses only the proportion adjustment along the width direction of the screen, the same principle can be applicable to the proportion adjustment along the height direction of the screen.
Moreover, as the functions of current digital TVs keep growing, the content of operation menu is expanding. As a result, a large number of characters are frequently to be encountered when the menu of a digital TV is under operation. To ensure users to watch TV programs at the time of operation without any interference, some TV manufacturers usually make menu displayed in a translucent form, which further improves the menu definition when the user performs a remote operation. However, if the characters of menu are displayed fixedly in large font, adverse visual effect will be imposed on a near operation.
In the present invention, using the distance from the remote control to the screen, the display proportion of menu can be automatically adjusted by means of the display unit within the imaging device. The menu can be display in larger font when operating the remote control at a distance, while the font of menu can be gradually reduced as the operation distance becomes shorter, thereby providing a convenient and intuitive operation interface for users. Of course, when the remote control held by an operator moves suddenly from a position near the screen to a position far from the screen or from a position far from the screen to a position near the screen, the imaging device can make a response in time and display menu in larger or smaller font. Alternatively, since the configuration of the invention enables to measure the distance between the remote control and the screen, the menu can be display in corresponding font when the distance thereof is shorter than a threshold value or within a predefined range.
Next, at step S114, the item to which the cursor has been moved is highlighted. Then at step S115, the operator presses the selection key to select the highlighted item. Finally, at step S116, the operator presses the exit key, and the menu disappears. The overall operation is completed.
The embodiments of the invention are mentioned above and the scope of the invention is not limited thereto. For any skilled in the art, it is understood that any variation or substitute easily conceivable should be encompassed in the technological scope disclosed in the invention. Thus, the scope of the invention should be defined by the claims.
Number | Date | Country | Kind |
---|---|---|---|
200610019873.2 | Mar 2006 | CN | national |
Filing Document | Filing Date | Country | Kind | 371c Date |
---|---|---|---|---|
PCT/CN07/00645 | 3/1/2007 | WO | 00 | 6/7/2010 |