The preferred exemplary embodiments of the present invention will hereinafter be described in conjunction with the appended drawings, where like designations denote like elements.
1.0 Overview
In accordance with the preferred embodiments of the present invention, non-visual access to on-screen menus is provided for remote controlled electronic devices, such as DVD players, digital video recorders (DVRs), video cassette recorders (VCRs), satellite receivers, televisions, etc. A repeater device is interposed between the remote control and the electronic device. The repeater device includes a receiver for receiving a first signal from the remote control and a transmitter for transmitting a second signal, which is based on the first signal, to a receiver of the electronic device. In order to provide consistent accuracy in the case where the first and second signals are infrared (IR) signals, an IR transmitter of the repeater device is preferably located at a fixed position in a line-of-sight of an IR receiver of the electronic device. This arrangement overcomes the prior art's problem of inadequate aim of the remote control with respect to the electronic device. A repeater mechanism causes the repeater device to transmit the second signal and a feedback mechanism causes a non-visual response, such as an audio message and/or Braille message, to be provided to the user. This response may be based on a key pressed on the remote control in the context of a sequence of keys pressed earlier and may inform the user of an action associated with the depressed key and options for additional keystrokes.
The present invention provides persons who are blind or visually impaired with a significantly higher level of access to consumer electronics than has existed before. In accordance with the preferred embodiments of the present invention, no modification of existing consumer electronic devices is necessary to achieve this enhanced level of access. Hence, a potential user is not limited to selecting consumer electronic devices from a market subset, such as talking devices.
2.0 Detailed Description
Referring to the Drawings, wherein like numerals denote like parts throughout the several views,
The electronic device 110 may be any remote controlled electronic device, such as a DVD player, a digital video recorder, a satellite receiver, a television, etc. Although only a single remote controlled electronic device 110 is shown in
As is conventional, the electronic device 110 includes a receiver 111 and the remote control 120 includes a transmitter 121. In the prior art, the remote control's transmitter 121 transmits a signal, typically an infrared (IR) signal, to the electronic device's receiver 111 in response to the user pressing a key on the remote control 121. However, in accordance with the preferred embodiments of the present invention this signal from the remote control's transmitter 121 is intercepted, interpreted by the feedback device 140, and repeated by the repeater device 130. Although the signal transmitted by the remote control's transmitter 121 is shown in
In the case where an IR signal is utilized, the IR signal may be intercepted by suitably positioning of the remote control 120 relative to the electronic device 110, i.e., the remote control's transmitter 121 is not aligned with the electronic device's receiver 111 so that the IR signal is not received at the electronic device's receiver 111 with sufficient strength to be recognized. Alternatively, as discussed below with reference to
Returning now to
In addition to forwarding the IR signal to the electronic device 110, the repeater device 130 passes the signal to the feedback device 140 where the signal is interpreted preferably in light of previous key presses, if any. The feedback device 140 includes an output device, such as a speaker 141 as shown in
The feedback device 130 incorporates an interpretive algorithm for determining the identity of the depressed key based on the signal itself, and preferably an action associated with the depressed key and options for additional keystrokes based on any previous key presses. In other words, the interpretive algorithm includes a model of the electronic device's user interface that allows the feedback device 130 to predict what is shown on a user's on-screen menu based on a series of keys that the user has pressed. Hence, the interpretive algorithm is specific to the particular electronic device 110 in that the interpretive algorithm is provided with knowledge of the menu steps used by the electronic device 110 and how to navigate between the menu steps. The interpretive algorithm may utilize one or more lookup tables, for example, in making its determinations. The interpretive algorithm may be pre-programmed (e.g., the user may select from several pre-programmed interpretive algorithms for different electronic devices), manually programmed, transferred from a recording media, or downloaded over the Internet. Preferably, for more complicated and dynamic user interfaces, such as user interfaces that incorporate electronic program guides, the interpretive algorithm is dynamic so that it may be updated as the situation warrants.
The feedback device 130 also incorporates conventional speech synthesis algorithms, Braille synthesis algorithms and/or Morse code generating algorithms, each of which are well known in the art. After the interpretive algorithm determines the identity of the depressed key, and preferably an action associated with the depressed key and options for additional keystrokes, this information is conveyed to the user by invoking the conventional speech synthesis algorithm, Braille synthesis algorithm and/or Morse code generating algorithm.
For example, if the feedback device 130 utilizes speech synthesis and the user presses the “menu” button on the remote control 120 for controlling a digital video recorder or a VCR, the speaker 141 of the feedback device 130 may announce, “Menu; press 1 for timer check/set, press 2 for mode set, press 3 for tuner preset, or press 4 for clock set.” To accomplish this, the interpretive algorithm of the feedback device 130 determines that the “menu” button has been pressed, determines that menu selection is the action associated with the depressed key, and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which causes the speaker 141 of the feedback device 130 to announce the above recited message. Additionally, the speaker 141 may announce that the user may change “menu” keystroke before the keystroke is forwarded by the repeater device on to the electronic device.
It is important to note that if the user does not receive an announcement from the speaker 141 as expected after pressing one or more buttons on the remote control, then he or she will know that the remote control's transmitter is not adequately aimed at the repeater device's receiver.
Next, if the user presses the “1” button on the remote control 120, the speaker 141 of the feedback device 130 may announce, “Timer check/set; press four numeral keys to designate the month and date of event to be recorded, press the down arrow once for Sunday through Saturday, press the down arrow twice for Monday through Saturday, press the down arrow three times for Monday through Friday, press the down arrow four times for Weekly.” In this case, the interpretive algorithm of the feedback device 130 determines that the “1” key has been pressed, determines that “timer check/set” is the action associated with the depressed “1” key based on the “menu” button having been previously depressed, and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message. Additionally, the speaker 141 may announce that the user may change the “1” keystroke before the keystroke is forwarded by the repeater device on to the electronic device.
If the user then presses the “down arrow” button on the remote control 120 three times, the speaker 141 of the feedback device 130 may announce, “Monday through Friday; press four numeral keys to designate a start time of the event to be recorded on the basis of a twenty-four hour clock.” In this case, the interpretive algorithm of the feedback device 130 determines that the “down arrow” key has been pressed three times, determines that “Monday through Friday” is the action associated with the depressing the “down arrow” key three times based on the sequence of previously pressed keys (i.e., “menu” button followed by the “1” button), and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message. In addition, rather than waiting for the user to complete the series of keystrokes, the speaker 141 of the feedback device may announce the identity of the depressed key after each keystroke to provide the user with more awareness of his or her progress. Additionally, the speaker 141 may announce that the user may change this series of keystrokes before the keystrokes are forwarded by the repeater device on to the electronic device.
If the user then presses the “1”, “4”, “3”, and “0” buttons on the remote control 120, the speaker 141 of the feedback device 130 may announce, “Two Thirty P.M. Start Time; press four numeral keys to designate an end time of the event to be recorded on the basis of a twenty-four hour clock.” In this case, the interpretive algorithm of the feedback device 130 determines that the “1”, “4”, “3”, and “0” keys have been pressed, determines that “Two Thirty P.M. Start Time” is the action associated with the depressing the “1”, “4”, “3”, and “0” keys based on the sequence of previously pressed keys (i.e., “menu” button, then “1” button, and then “down arrow” three times), and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message. Here too, rather than waiting for the user to complete the series of keystrokes, the speaker 141 of the feedback device may also announce the identity of the depressed key after each keystroke to provide the user with more awareness of his or her progress. Additionally, the speaker 141 may announce that the user may change this series of keystrokes before the keystroke are forwarded by the repeater device on to the electronic device.
If the user then presses the “1”, “5”, “3”, and “0” buttons on the remote control 120, the speaker 141 of the feedback device 130 may announce, “Three Thirty P.M. End Time; press three numeral keys to designate a channel of the event to be recorded.” In this case, the interpretive algorithm of the feedback device 130 determines that the “1”, “5”, “3”, and “0” keys have been pressed, determines that “Fifteen Thirty End Time” is the action associated with the depressing the “1”, “5”, “3”, and “0” keys based on the sequence of previously pressed keys (i.e., “menu” button, then “1” button, then “down arrow” three times, and then “1”, “4”, “3” and “0” buttons), and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message. Again, rather than waiting for the user to complete the series of keystrokes, the speaker 141 of the feedback device may also announce the identity of the depressed key after each keystroke to provide the user with more awareness of his or her progress. Additionally, the speaker 141 may announce that the user may change this series of keystrokes before the keystrokes are forwarded by the repeater device on to the electronic device.
If the user then presses the “0”, “0”, and “2” buttons on the remote control 120, the speaker 141 of the feedback device 130 may announce, “Channel Two; press the “Enter” keys to confirm.” In this case, the interpretive algorithm of the feedback device 130 determines that the “0”, “0”, and “2” keys have been pressed, determines that “Channel Two” is the action associated with the depressing the “0”, “0”, and “2” keys based on the sequence of previously pressed keys (i.e., “menu” button, then “1” button, then “down arrow” three times, then “1”, “4”, “3” and “0” buttons, and then “1”, “5”, “3” and “0” buttons), and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message. Here too, rather than waiting for the user to complete the series of keystrokes, the speaker 141 of the feedback device may also announce the identity of the depressed key after each keystroke to provide the user with more awareness of his or her progress. Additionally, the speaker 141 may announce that the user may change this series of keystrokes before the keystrokes are forwarded by the repeater device on to the electronic device.
If the user then presses the “Enter” button on the remote control 120, the speaker 141 of the feedback device 130 may announce, “Confirming Timer Set; the event on channel two will be recorded from two thirty p.m. to three thirty p.m. each day Monday through Friday.” In this case, the interpretive algorithm of the feedback device 130 determines that the “Enter” key has been pressed, determines that “Confirming Timer Set” is the action associated with the depressing the “Enter” key based on the sequence of previously pressed keys (i.e., “menu” button, then “1” button, then “down arrow” three times, then “1”, “4”, “3” and “0” buttons, and then “1”, “5”, “3” and “0” buttons, and then “0”, “0” and “2” buttons), and determines the various further possible keystrokes. The interpretive algorithm of the feedback device 130 passes this information on to the speech synthesis algorithm of the feedback device 130, which announces the above recited message Additionally, the speaker 141 may announce that the user may change the “Enter” keystroke before the keystroke is forwarded by the repeater device on to the electronic device.
The above example is set forth for illustrative purposes and many variations are possible within the scope of the present invention. One skilled in the art will appreciate that the present invention may be applied for providing non-visual access to any remote controlled electronic device that utilizes on-screen menus.
A computer system implementation of a preferred embodiment of the present invention will now be described with reference to
Mass storage interface 304 is used to connect mass storage devices (such as a direct access storage device 312) to computer system 300. One specific type of direct access storage device 312 is a readable and writable CD ROM drive, which may store data to and read data from a CD ROM 314.
Main memory 302 in accordance with the preferred embodiments contains data 316, an operating system 318, a repeater mechanism 320, and a feedback mechanism 321. While the repeater mechanism 320 and the feedback mechanism 321 are shown separate and discrete from operating system 318 in
Computer system 300 utilizes well known virtual addressing mechanisms that allow the programs of computer system 300 to behave as if they have access to a large, single storage entity instead of access to multiple, smaller storage entities such as main memory 302 and DASD device 312. Therefore, while data 316, operating system 318, repeater mechanism 320, and feedback mechanism 321 are shown to reside in main memory 302, those skilled in the art will recognize that these items are not necessarily all completely contained in main memory 302 at the same time. It should also be noted that the term “memory” is used herein to generically refer to the entire virtual memory of the computer system 300.
Data 316 represents any data that serves as input to or output from any program in computer system 300. Operating system 318 is a multitasking operating system known in the industry as OS/400 or IBM i5/OS; however, those skilled in the art will appreciate that the spirit and scope of the present invention is not limited to any one operating system.
The repeater mechanism 320 provides the functionality of the repeater device 130 shown in
Processor 301 may be constructed from one or more microprocessors and/or integrated circuits. Processor 301 executes program instructions stored in main memory 302. Main memory 302 stores programs and data that may be accessed by processor 301. When computer system 300 starts up, processor 301 initially executes the program instructions that make up operating system 318. Operating system 318 is a sophisticated program that manages the resources of computer system 300. Some of these resources are processor 301, main memory 302, mass storage interface 304, display interface 306, network interface 308, I/O device interface 309 and system bus 310.
Although computer system 300 is shown to contain only a single processor and a single system bus, those skilled in the art will appreciate that the present invention may be practiced using a computer system that has multiple processors and/or multiple buses. In addition, the interfaces that are used in the preferred embodiments each include separate, fully programmed microprocessors that are used to off-load compute-intensive processing from processor 301. However, those skilled in the art will appreciate that the present invention applies equally to computer systems that simply use I/O adapters to perform similar functions.
Display interface 306 is used to directly connect one or more displays 322 to computer system 300. These displays 322, which may be non-intelligent (i.e., dumb) terminals or fully programmable workstations, are used to allow system administrators and users (also referred to herein as “operators”) to communicate with computer system 300. Note, however, that while display interface 306 is provided to support communication with one or more displays 322, computer system 300 does not necessarily require a display 322, because all needed interaction with users and processes may occur via network interface 308.
Network interface 308 is used to connect other computer systems and/or workstations to computer system 300 across a network 326. The present invention applies equally no matter how computer system 300 may be connected to other computer systems and/or workstations, regardless of whether the network connection 326 is made using present-day analog and/or digital techniques or via some networking mechanism of the future. In addition, many different network protocols can be used to implement a network. These protocols are specialized computer programs that allow computers to communicate across network 326. TCP/IP (Transmission Control Protocol/Internet Protocol) is an example of a suitable network protocol.
The I/O device interface 309 provides an interface to any of various input/output devices. Three such devices, the repeater device's receiver 131, the repeater device's transmitter 132, and the feedback device's speaker 141, are shown in the exemplary embodiment of
At this point, it is important to note that while this embodiment of the present invention has been and will be described in the context of a fully functional computer system, those skilled in the art will appreciate that the present invention is capable of being distributed as a program product in a variety of forms, and that the present invention applies equally regardless of the particular type of signal bearing media used to actually carry out the distribution. Examples of suitable signal bearing media include: recordable type media such as floppy disks and CD ROMs (e.g., CD ROM 314 of
Also, the signal that is output from the repeater device's receiver is passed to the repeater mechanism (step 430). Next, the repeater device's transmitter transmits an IR signal to the electronic device's receiver (step 435). The IR signal transmitted from the repeater device and received by the electronic device (step 440) is a copy of the original IR signal transmitted from the remote control and received by the repeater device. Accordingly, the electronic device will process the IR signal received from the repeater device just as it would have processed the original IR signal transmitted from the remote control.
The signal that is passed to the repeater mechanism in step 430 is the same signal that is passed to the feedback mechanism in step 415. Accordingly, steps 415-425 and steps 430-440 may be performed simultaneously rather than in the order shown in
One skilled in the art will appreciate that many variations are possible within the scope of the present invention. For example, one skilled in the art will appreciate that although only a single remote controlled electronic device is shown in