Interactive electronic display surfaces allow users to exploit the display surface as a mechanism both for viewing content, such as computer graphics, video, etc., as well as inputting information into the system. Many interactive display surfaces are configured to receive input data through a wire coupled communication device such as a controller, a keyboard, a mouse, and the like.
The accompanying drawings illustrate various exemplary embodiments of the present system and method and are a part of the specification. The illustrated embodiments are merely examples of the present system and method and do not limit the scope thereof.
Throughout the drawings, identical reference numbers designate similar, but possibly not identical, elements.
The present exemplary system and method use familiar tokens or physical objects as tools to start and manipulate applications, such as in some embodiments software applications that may be provided by a third party. More specifically, through the use of one or more symbols or other communication mechanisms, software applications present on an interactive display system are started and/or manipulated. Further, a system and a method are disclosed that facilitate optical communication between a system controller or processor and a token or physical object that includes one or more symbols, utilizing the pixels or display surface of an embodiment of a display system, such as interactive display system (10) as a communication medium. The optical communication, along with a feedback methodology, enables the interactive display system and the token having one or more symbols to start and/or manipulate applications. The display surface may be a glass surface configured to display an optical light image generated by an image projection device, such as a digital light projector (DLP), a liquid crystal display (LCD), or any other projection device, in response to digital signals from the controller. The token including one or more symbols may take various forms such as, but not limited to, pointing devices, cellular telephones, game pieces, measuring tools, MP3 players, digital cameras, computer mice, traditional paper manipulation tools, or any other physical object that includes a communication language disposed thereon.
The system detects the presence of a token including one or more symbols on the surface via an optical sensor. Once detected, the system identifies and interprets the one or more symbols or other communication language from the token and automatically starts and manipulates an application associated with the token, as identified by the one or more symbols. Simultaneous with the optical detection, the image projection device may generate a continuous still or moving video or graphic, such as a movie video, a video game, computer graphics, Internet Web pages, etc. on the display surface, in response to the related application.
In the following description, for purposes of explanation, numerous specific details are set forth in order to provide a thorough understanding of the present system and method for representing a specific application toolset with a viewable physical device. It will be apparent, however, to one skilled in the art, that the present method may be practiced without these specific details. Reference in the specification to “one embodiment” or “an embodiment” means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment. The appearance of the phrase “in one embodiment” in various places in the specification may possibly not be referring to the same embodiment.
Referring now to
Continuing with reference to
As shown in
While the interactive display system (10) is described herein in the context of a display device including a DLP (16), the present systems and methods are in no way limited to initiating and manipulating a specific software application (60) using a token including one or more symbols through a display surface (14) and a DLP display device (16). Rather, any number of display devices having an optical sensor configured to detect an object on a display surface may be used to automatically initiate applications according to the present exemplary embodiment including, but in no way limited to, a liquid crystal display (LCD), a plasma display, or a flat panel display. Further, while the above-mentioned display surface (14) is configured to display viewable images in addition to data being transferred via an optical sensor (60), the present systems and methods may be incorporated by a back-view display device that is solely configured to initiate and manipulate software applications with a token (D1-Dn) that includes one or more symbols thereon without regard to the optical transfer of data.
According to the exemplary embodiment illustrated in
One embodiment of a DLP (16) includes a digital micro-mirror device (DMD) configured to vary the projection of light pixels onto the display surface (14). Other embodiments could include, but are in no way limited to, diffractive light devices (DLD), liquid crystal on silicon devices (LCOS), plasma displays, and liquid crystal displays. Additionally, other spatial light modulator and display technologies could be substituted for the DLP (16) without varying from the scope of the present system and method.
Returning again to
As shown in
According to one exemplary embodiment, the one or more symbols (42) used to initiate an application (60) is a 2 dimensional DataMatrix. A DataMatrix is a two or three-dimensional barcode which can store from 1 to approximately 2,000 characters. The symbol is generally quadratic in shape and can range from 0.001 inch per side to over 13.5 inches per side. As an example of density, 500 numeric only characters can be encoded in a 1-inch square using a 24-pin dot matrix printer. These characters, when detected and analyzed by a processor, may then be used to initiate an application (60) resident on an interactive display system.
Alternatively, the one or more symbols (42) formed on the token (D1) may be any type of discrete or continuous bar code that may represent processor recognizable characters including, but in no way limited to, code 3 of 9 barcodes, universal product code (UPC)-A, UPC-E, UPC 5 or 2 digit adder, integer 2 of 5, Code 128 (A, B & C), European article numbering (EAN) 8, EAN-13, health industry bar code (HIBC) (Modulus 10), Coderbar (Codabar), Plessey, Case Code, Code 93, Telepen, Zip, facing identification marking (FIM), portable document format (PDF)-417, LogmarsPostnet, united parcel service (UPS) Maxicode, and the like. Further, the one or more symbols (42) formed on the token may be an array of light emitting diodes (LED).
Returning again to
Once a token is detected (step 500), the interactive display device (10) determines whether the token contains one or more symbols thereon (step 505). According to one exemplary embodiment, the optical sensor (30) in the form of a CCD or CMOS laser scanning system scans the surface of the identified token searching for a 2 dimensional DataMatrix or other symbols. If there are no symbols detected on the token (NO, step 505), the interactive display device (10) terminates its analysis of the token. If, however, symbols are detected on the token (YES, step 505), the symbols are decoded by the interactive display device (10) (step 510). Accordingly, the interactive display device (10) reads the symbols present on the token. According to one exemplary embodiment, the symbols will be decoded to reveal a code which is then processed by the interactive display device (10). The interactive display device (10) compares the received code against a database of codes to discover the applications related to the symbols (step 515), as well as functionality and operational characteristics of each tool as it relates to a number of identified applications.
If an associated application is not identified, the user is notified to that effect (step 525) through the viewing surface, and the interactive display device (10) ends its analysis. If, however, there is an application identified by the symbols (YES, step 515), the interactive display device (10) compares the identified application associated with the symbols (42) to a number of applications accessible by the interactive display device to locate a matching application (step 520). If the identified application is not accessible by the interactive display device (NO, step 520), again the user is notified to that effect (step 525), and the interactive display device (10) ends its analysis. However, if the identified application is accessible by the interactive display device (10) (YES, step 520), the application is initiated by the interactive display device (10) (step 530). Initiation of the identified application may include auto-populating the display surface (14) with a graphical user interface (GUI) associated with the application (60).
Once the identified application is initiated, the interactive display device (10), via the optical sensor, determines if a recognized token manipulation is performed by the identified token (step 535). According to one exemplary embodiment, a number of token motions, positions, and/or configurations correspond with sub applications that may be performed within the identified application itself. In other words, tools that are stored on or within the identified token could be used to manipulate the application. If a recognized token manipulation is detected (YES, step 535), the manipulation is linked with an operation or sub application and that operation is performed by the interactive display device (10) (step 545) and the display surface (14) is again monitored for recognized token manipulations (step 535).
If, however, no token manipulation is recognized (NO, step 535), the interactive display device (10) determines whether the token is still present on the viewing surface (step 540). According to one exemplary embodiment, the optical sensor (30) may perform an image subtraction method or other surface sensing operation to detect the presence of the previously identified token. If the token is still present on the display surface (YES, step 540), the interactive display device will continue to monitor the display surface (14) for a recognized token manipulation (step 535).
If, however, it is determined that the token is not present on the display surface (NO, step 540), the interactive display device (10) will prompt the user for an input indicating a desire to terminate the application (step 550). The user may be prompted in any number of ways including, but in no way limited to, a visual request asking for a confirmation of application termination. If the user indicates a desire not to terminate the application (NO, step 550), the interactive display device (10) monitors for the presence of another token associated with the application being placed on the display surface (step 500). If, on the other hand, the user indicates a desire to terminate the application (YES, step 550), the application is terminated.
While the above-mentioned exemplary method is described in the context of initiating an application (60) on the interactive display device (10) in response to a sensed token symbol (42), the symbol may also initiate firmware applications present in the interactive display device. Additionally, the method illustrated above may cause the sensed token symbol (42) to initiate or modify applications operating in a component communicatively coupled to the interactive display device (10).
In an alternative embodiment, the token (D1) including one or more symbols may be configured to optically communicate with the interactive display system (10) through the display surface (14) as illustrated in
Further,
The external access component (46) of the token (D1) including one or more symbols is configured to allow a user to access data saved in the memory component (44). Accordingly, any number of external access components (46) may be included in the token (D1) bearing one or more symbols including, but in no way limited to, an earphone jack, a speaker jack, an infrared transmitter, a radio frequency transmitter, a speaker, a motion actuator, a light source, a keystone jack, a universal serial bus (USB) port, a serial port, and/or a wireless transmitter. According to one exemplary embodiment, an external access component (46) in the form of a wireless transmitter is configured to transmit data to an external receiving device, such as the controller (18;
As shown in
Two-way communication between the controller (18) and each token (D1, D2, DN) including one or more symbols allows the interactive display system (10) to accommodate simultaneous input from and output to multiple tokens including one or more symbols. Two-way communication between the tokens (D1, D2, DN) including one or more symbols and the controller (18) allows the system to use a feed-back mechanism to establish a unique “handshake” between each token including one or more symbols and the controller. The unique “handshake” can be accomplished in various ways.
In conclusion, embodiments of the present system and method for representing a specific tool set with a viewable device or objects uses, in one embodiment, familiar tokens as tools to start and manipulate applications accessible by a back-view horizontal display unit. More specifically, through the use of one or more symbols or other communication mechanisms present on the token, software applications present on an interactive display system are automatically started and/or manipulated, thereby enhancing the user experience.
The preceding description has been presented only to illustrate and describe exemplary embodiments of the system and method. It is not intended to be exhaustive or to limit the system and method to any precise form disclosed. Many modifications and variations are possible in light of the above teaching. It is intended that the scope of the system and method be defined by the following claims. Where the claims recite “a” or “a first” element of the equivalent thereof, such claims should be understood to include incorporation of one or more such elements, neither having to include nor excluding two or more such elements.