Patent Grant
7777642
The present invention relates to a integrated remote control system for a plurality of electric appliances; and, more particularly, to a integrated remote control system for a plurality of digital devices, capable of easily selecting and remote-controlling digital devices, e.g., a home network, at a long distance.
A home networking is a technique capable of remote-controlling major digital devices such as electric appliances including a refrigerator, an air conditioner, a microwave oven, a television set and the like through a wire or a wireless network, e.g., wire/wireless Internet, and sharing contents between the digital devices. Such a home networking is regarded as a core element of a market for next generation digital devices.
Once the home network is furnished, the digital devices can be desirably controlled by a mobile terminal or an indicator such as a remote control and the like inside or outside a house. Moreover, the digital devices of the home network enable a connection of a communication network such as Internet and the like, a transmission of motion pictures and a transmission/reception of e-mails inside/outside the house, so that a real cyber home can be created.
The home network technique having such advantages can be divided into a home server, a development and a standardization of a middleware for driving a home server and a development and a standardization of a transmission technique between digital devices. Among them, the most important element is the middleware that is a communication protocol standard for operating each of the digital devices based on a home server.
A current international standard framework of a home network is largely divided into “HAVi” (Home Audio Video interoperability) developed by household appliances enterprises such as Sony, Philips, Panasonic, Hitachi and the like; “UPnP” (Universal Plug and Play) developed by computer enterprises such as Microsoft, Intel and the like; and Sun Microsystem's “Jini” (Java Intelligent Network Infrastructure), and they severely compete with each other to take the initiative for standardization.
Accordingly, there has been increased the importance of the remote control apparatus having a communication protocol standard that is a middleware, such as a home server of a home networking, for remote-controlling a plurality of digital devices.
Recently, there has been suggested an integrated control system for controlling digital devices included in the home network by using an RFID tag. However, such an integrated control system is cost-inefficient because the electric appliances are recognized and controlled by using the RFID tag.
Although there is being developed a technique enabling a remote indicator to recognize information of digital devices included in the home network with the use of tags attached to the corresponding appliances, it has a high recognition error rate due to the circumstances such as a distance, lighting and the like.
It is, therefore, an object of the present invention to provide an integrated control system capable of controlling digital devices included in a home network by using an augmented reality interface.
In accordance with an aspect of the present invention, there is provided an integrated remote control system employing a remote control device for selecting and controlling a plurality of digital devices, each including a bit pattern tag having location information and device information, the remote control device comprising: a display; a light emitting module for emitting light toward the digital devices; a sensor for recognizing the tags of the digital devices; and a controller for analyzing the tags recognized by the sensor to provide the display information of the digital devices on the display and then controlling a digital device selected from the displayed digital devices.
The above and other objects and features of the present invention will become apparent from the following description of preferred embodiments, given in conjunction with the accompanying drawings, in which:
Hereinafter, preferred embodiments of the present invention will be described in detail with reference to the accompanying drawings.
An augmented reality is a user interface technique for improving an understanding and a recognition of a reality by providing to a user a single image obtained by overlapping and composing a real image or an actual screen observed by a user with additional virtual information such as messages and graphics in real-time.
As illustrated in
The remote control device 100 includes a small-sized mobile terminal to be described with reference to
When a user 150 selects (clicks) an image where the actual digital device 200 is projected with the mobile terminal 100, a control interface for driving the selected electric appliance is pop-up displayed. The mobile terminal 100 has therein any one of the international standard frameworks, and the control interface varies according to a framework accommodated in the mobile terminal 100. Such a control interface is used for controlling the selected digital device.
As shown in
Further, the mobile terminal 100 of the present invention has on a rear surface thereof a light emitting module 104 for emitting infrared rays toward a desired digital device, to thereby increase a tag recognition rate.
Although it is not illustrated, the mobile terminal 100 of the present invention further includes a controller providing a control interface. The controller analyzes tags of the digital devices which are inputted by the sensor, i.e., the infrared camera 102, and then outputs information of the corresponding digital devices. Further, when a random digital device is selected from the digital devices outputted to the display, the controller controls the corresponding digital device.
In the mobile terminal 100 of the present invention, if the infrared-ray emitting module 104 is driven after the infrared camera 102 is made to face a plurality of digital devices included in the home network, images of the digital devices are captured by the infrared camera 102, and among them, the display information of unique tags attached to the images are displayed on the display 106. When random tag information is selected from the tag information of the multiple digital devices which is outputted to the display 106 of the mobile terminal 100, a control signal for selecting a digital device having the corresponding tag information is transmitted to a home server of a home network and, then, the selected digital device is driven by a remote controller. For example, when the digital device is made to face the mobile terminal 100 for a specific period of time, the mobile terminal 100 transmits the control signal for selecting the corresponding digital device and then implements a control interface for the selected digital device.
Since an indoor lighting state changes depending on time and place, it is difficult for the combined remote controller 100 in accordance with the present invention to accurately recognize the tags attached to the digital devices. To this end, a retro-reflector image is obtained by using the infrared-ray emitting module 104 attached in addition to the camera 102. As a result, it is possible to recognize the electric appliances by vividly distinguishing the tags from the circumstances.
As illustrated in
Such tags include a plurality of location information tags 202A, 202B, 202C, 202D and 202E arranged in four corners of the digital device and a single device information tag 204. Among the location information tags 202A, 202B, 202C, 202D and 202E, two upper left tags 202A and 202B are arranged in line with a specific gap therebetween so that they can be distinguished from the remaining tags 202C 202D and 202E respectively arranged in a lower left portion, an upper right portion and a lower right portion. The uppermost left tag 202A is used as a reference location information tag.
Based on the reference tag 202A and the tag 202B adjacent thereto, locations of the remaining three location information tags 202C, 202D and 202E can be estimated. The lower left location information tag 202C is arranged at a lower left side while being spaced from the reference tag 202A at a specific distance, and the upper right tag 202D is diagonally positioned with respect to the lower left location information tag 202C. And, the lower right tag 202E is arranged at a lower right side being diagonally with respect to the reference tag 202A. However, a perspective distortion is generated depending on a location of the camera, so that a tag location error range should be allowed. When not all of the five location tags are accurately included in an input image of the camera, the tags whose positions are obtained are used for estimating locations of the remaining location tags.
Meanwhile, the device information tag 204 is arranged at a right side while being spaced from the upper left tag 202A at a half distance of the corresponding tag on a straight line of the upper left and the upper right tag 202A and 202D.
Referring to
The device information tag 302 needs to have an identification value and thus has a tag design of a matrix pattern. For example, the device information tag 302 is formed of ten small quadrilateral retro-reflectors having a quarter size of the location information tag 300. Bit values are determined depending on the existence/nonexistence of the small retro-reflectors. Thus, 1024 electric tags can be identified by ten bit values, which is sufficient for household appliances. Accordingly, device information of a large number of digital devices can be identified by the device information tag 302.
As described in
As described above, in order to easily distinguish the tags, the area of the tags is captured by using an infrared camera having an infrared ray source (infrared ray emitting module) for increasing a brightness of the area. If the image obtained by the infrared camera is binary processed, it is possible to distinguish the tag information from the circumstances. Although there is a chance in which an area not corresponding to tags may be bright due to the lighting or other reflectors, it is different from the tags in shape and thus can be distinguished from the RFID tag.
When a user observes the augmented reality interface implemented in a small-sized terminal, the user can recognize a selected device and a boundary/periphery thereof with the location information tag and the device information tag.
Meanwhile, the digital device controlled by the mobile terminal in accordance with the present invention is a digital device that can be networked according to a lower framework or a conventional remote control digital device.
Referring to
In order to select a designated device among the devices displayed on the display 106 in the integrated remote control device, the integrated remote control device needs to move toward the corresponding device. Accordingly, the corresponding digital device is selected after a preset period of time elapses.
In case of the digital devices having a comparatively large volume, such as a television set, an audio device, a computer and the like, it is easy to attach the RFID tags. On the other hand, in case of small-sized digital devices such as a PDA, a digital camera and the like, there is provided a small space where the RFID tags are attached.
Therefore, in the integrated remote control system of the present invention, tags (having device information) of the digital devices are identified and, then, icons of the digital devices are displayed in a preset virtual space (see reference numeral 406 of
As shown in
As described above, the present invention provides a integrated remote control system for controlling digital devices such as a home network. In such an integrated remote control system, the RFID tags attached to the digital devices are recognized and then outputted to a display. Accordingly, the integrated remote control system can easily select and remote-control the remote digital devices, so that a user can conveniently use the remote control apparatus in a home network and a ubiquitous environment.
While the invention has been shown and described with respect to the preferred embodiments, it will be understood by those skilled in the art that various changes and modification may be made without departing from the scope of the invention as defined in the following claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2006-0074663 | Aug 2006 | KR | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5357094 | Baldwin | Oct 1994 | A |
| 6225938 | Hayes et al. | May 2001 | B1 |
| 6791467 | Ben-Ze'ev | Sep 2004 | B1 |
| 7224903 | Colmenarez et al. | May 2007 | B2 |
| 7415212 | Matsushita et al. | Aug 2008 | B2 |
| 20020140571 | Hayes et al. | Oct 2002 | A1 |
| 20080188959 | Kneissler | Aug 2008 | A1 |
| Number | Date | Country |
|---|---|---|
| 1020030077513 | Oct 2003 | KR |
| Number | Date | Country | |
|---|---|---|---|
| 20080036570 A1 | Feb 2008 | US |
