This invention relates to a multi-channel timing device, and more particularly to a multi-channel timing device that is controllable by voice and is wirelessly connected to a mobile device such as a smart phone.
The following regular U.S. Patent applications are being filed concurrently, and the entire disclosures of the other applications are incorporated by reference into this application for all purposes:
application Ser. No. 62/280,544, filed Jan. 19, 2016, entitled “TIMING APPARATUS AND METHOD”; and
application Ser. No. 62/280,556, filed Jan. 19, 2016, entitled “NETWORKED MULTI-CHANNEL TIMER”; and
application Ser. No. 62/318,967 filed Apr. 6, 2016, entitled “VOICE CONTROLLED AND PHONE CONNECTED TIMING DEVICE”.
Mechanical and electronic timers have been available for several decades. Early timers were typically packaged as single function timers, useful for timing simple cooking events at home or for timing an experiment in a laboratory as examples.
More recently electronic timers have become available with four or more independent timing channels.
Despite the progress made in timing devices and other electronic devices, there is a need in the art for improved devices as well as improved methods for interfacing with them, to simplify and enhance their human interface, to enable more sophisticated event sequences, to time an event sequence where it is not known ahead of time how many independent timers will be required, or when the number of timers required is a large number, for example six or more, or when hands-free operation of the timing device is desired. There is a further need in the art to pair a timer with a mobile device, taking advantage of the processing power of the mobile device to execute both simple and complex scenarios that can be of great benefit to a user, wherein the timing device is a robust, compact and inexpensive companion device that is well suited for use in messy or otherwise challenging environments such as a kitchen, gymnasium, workshop, classroom or laboratory. It is anticipated that the selling price for a timer of the present invention will be substantially less than for a high-end smart phone.
SUMMARY OF THE INVENTION
According to a first embodiment of the present invention, a dedicated multi-channel timing device is provided comprising a microphone, a speaker, a display screen, a processor, a memory, and a voice chip. The processor and the voice chip may be combined in a single integrated circuit chip. The memory contains instructions that are executable by the processor to facilitate the creation, control and reporting of at least six timed intervals, with each timed interval served by a corresponding timing channel. The display screen is configured to display to the user timing channel information and any other requested information. The microphone and the voice chip and the speaker are configured to enable, in cooperation with the processor and the memory, a spoken dialog between a user and the timing device. The timing device is configured to support the following transactions within the spoken dialog: identifying an available channel for use as a new channel; receiving a duration of a new timed interval to be executed on the new channel; displaying the status of the new channel or any other channel when requested by the user; and, signaling the user via voice or musical notes when the new timed interval expires.
In certain contexts, a timed interval may also be referred to as a timing channel, a timing event, or a timer.
The timing device may further comprise a keypad or a touch screen configurable to receive a user's touch input, the touch input to optionally be used in place of some or all of the voiced inputs.
The voice chip and its associated software enable voice recognition and voice synthesis and the generation of music. The voice recognition is configurable to receive voice input through the microphone, and the voice synthesis and music generation are configurable to provide audio output through the speaker. Within this application, voice recognition may be used interchangeably with speech recognition and voice synthesis may be used interchangeably with speech synthesis.
The maximum number of timed intervals supported by the timing device may be a large number, for example more than nine, limited only by the size of the memory and the speed of the processor.
In another embodiment, the dedicated multi-channel timing device may further comprise a transceiver chip configurable to provide for communications between the timing device and a mobile device. The mobile device may be a smart phone or a laptop for example. The transceiver chip may also be configurable to provide for communications between the timing device and electrical appliances within wireless communications range of the timing device. The display screen and the memory may be expanded to accommodate additional information provided by the mobile device. The wirelessly connected system of a multi-channel timing device and a mobile device is capable of many modes of operation, including the servicing of simple scenarios such as downloading a recipe, or more complex scenarios involving two-way communications and multiple types of information. Preferably certain assets of the timing device are configurable and usable by the mobile device acting as an information source or as a surrogate for the user, the certain assets including the display, the memory, the processor, the voice chip, and the transceiver. Among the possible scenarios, the timing device may be controlled primarily by either the user or the mobile device. The mobile device may be programmed to provide information to the timer such as a recipe in a predetermined format that allows a user to retrieve steps of the recipe one-by-one. Additionally, the mobile device may automatically program the timing channels required to implement a recipe. The mobile device may also provide a backup message such as a text message to a user if a timing channel expires and the user does not hear the associated alert, and accordingly does not clear the channel. A person of ordinary skill in the art will be capable of devising a great many scenarios that take advantage of the processing power of the mobile device, coupled with the simple-to-use and robust nature of the timing device, together with its ability to communicate locally with electrical appliances. All such scenarios are claimed for the present patent.
A method for interacting with a timing device is described in another embodiment of the present invention. The timing device comprises a microphone, a speaker, a display screen, a processor, a memory and a voice chip. The memory contains instructions executable by the processor to facilitate the creation, control, and reporting of a plurality of timed intervals. The voice chip is configurable to recognize and synthesize speech, and to play music. The method includes the steps of: requesting by voice input a new channel for executing a new timed interval; programming the new channel with a duration using voice inputs; monitoring status of the new channel using the display screen; and, responding to a voiced output or a series of musical notes when the duration expires. The method may further include the steps of retrieving a recipe from the memory when requested, and optionally displaying steps of the recipe one by one, as prompted by the user. The status of each individual timing channel is preferably reported using a single line of characters on the display screen. The line of characters may comprise a remaining time if the associated timing channel has not yet expired, or an elapsed time since expiration if it has expired. The method may further include the step of scrolling up or down between the lines of characters via a voice command from a user, to select a channel of interest. An addressed line of characters may be highlighted using an arrow symbol, or a distinctive display format such as a different color or flashing characters. Interrogation, revision, or clearing of a timing channel may be accomplished using the voice inputs or the keypad or touch screen inputs, in combination with information displayed on the display screen or provided by voice outputs.
When a timed interval expires, the method may include acting on an external matter that is typically related to the expired duration.
Within the method, some or all of the voice inputs may be replaced by keypad or touch screen inputs.
During the programming step the user may choose between time-of-day and time-from-now as a format for defining the duration of a timed interval. Other formatting options may also be provided, such as choosing between a 12-hour and a 24-hour clock.
Interrogation, revision, or clearing of a highlighted timing channel may be accomplished using the voice inputs in combination with information displayed on the display screen, and optionally in combination with information provided by voice outputs.
By implementing a rich and intuitive human interface incorporating a visual display, a spoken dialog with optional music enhancements, together with optional touch inputs, a user-friendly system may be provided.
Numerous benefits are achieved by way of the present invention over conventional techniques. For example, apart from the ability to read information on the display screen, user interaction with the timing device is achievable entirely by voice input and output transactions, and this base capability can be augmented using music alerts in combination with visual and other aural alerts or cues. Thus, the user can use the timing device intuitively to control sophisticated event sequences in a hands-free manner. A keypad is not required, and if it is provided, it need not be used. The voice inputs and outputs can be effective in any country and with any spoken language, and they can provide a personalized feel to the device. Embodiments of the present invention provide a compact and versatile multi-channel timer having a small footprint, enabling it to be placed on a window ledge, or occupying a small area of a work surface as examples. Preferably the device is portable; it may fit in a user's pocket for example. The wireless connection to a cooperating mobile device such as a smart phone enables a rich set of scenarios. The smart phone may act as a surrogate for a user, having access to many of the assets of the timing device, including the display, the memory, the processor, the voice chip and the wireless transceiver. The smart phone may also act as an information source, for example providing recipes in a step-by-step format for display on the display screen, or as voiced instructions to the user. The programming facilities of the mobile device may be utilized to customize recipes or event sequences that may then be easily transferred to the timer in a standardized format. In summary, the powerful functions of a smart phone may be combined with dedicated and extensive timing functions provided in a timing device of the present invention. Further, the timing device may be operated in adverse environments such as kitchens, laboratories, classrooms, gymnasiums, and other sites that may be inherently messy, dangerous, or inaccessible. In a hostile environment for example, the relatively inexpensive timer may be dispensable.
Various embodiments of the present invention are described hereinafter with reference to the figures. It should be noted that the figures are only intended to facilitate the description of specific embodiments of the invention. They are not intended as an exhaustive description of the invention or as a limitation on the scope of the invention. In addition, an aspect described in conjunction with a particular embodiment of the present invention is not necessarily limited to that embodiment and may be practiced in other embodiments. Additional embodiments may be achievable by combining the various elements in different ways. For example, among the co-pending applications, various combinations of displays, memories, microphones, keypads, processors, mobile devices, voice chips, electronic appliances and speakers are described, together with many methods of using them. So for example, although commanding by voice is a control option, a simple keypad based timer may be combined with a wireless link to a cooperating mobile device, wherein the full processing power and the human interface of the mobile device can be used to retrieve recipes or other information, or to control some or all aspects of the timing device. An example of the mobile device controlling the timing device would be when the mobile device automatically names and starts timers for each of the steps in a selected recipe, or arranges them according to one of many timing channel formats, perhaps including a prompting sequence for the user. In another area, with regard to timer packaging, any of the described designs may utilize a stainless steel faceplate.
As an example of a timing scenario, consider a cook in a restaurant kitchen making a dinner comprising multiple dishes. The names of the timed events could be “potatoes”, “carrots”, “broccoli”, “roast”, “cheese sauce” and “pie” for example. These names may become signatures of the timed intervals. Each item may be displayed on a single line of the display screen, and they may optionally be voiced by the timing device on interrogation of a channel, or when a timed interval expires.
A key requirement of a multi-channel timing device is a convenient method for assisting the user to track which timing channel is associated with each of the timing events (timed intervals). This becomes more important as the number of channels increases. To date, commercial products appear to have ignored this requirement, or have provided a pen and a white board for the user to write the name of each timing event. However, it may be inconvenient for a user to use a pen while having sticky fingers in the kitchen. The pen may run dry. The white board may accumulate unwanted residues from the cooking process. The eraser may be fragile and may fail over time. Since with several timer channels a user may forget which channel represents which activity, an embodiment of the current invention uses a voiced name as a signature of each channel, and the voiced name is replayed when the channel expires or is interrogated by the user.
In an embodiment of the current invention, the multi-channel timing device may be awakened from sleep mode by the user voicing “WAKE UP”. When the processor is in sleep mode, the timing device is preferably configured such that a minimum number of electronic circuits are active. Thereafter the timer wakes up and is ready for user input, to program a new timing channel for example. In this case the user may voice “NEW CHANNEL”, whereupon the timing device provides a new line number on the first display and waits for a voice input corresponding to the new timer channel. The user may then speak the name of a timed interval into the microphone; a facsimile of this spoken name is stored by the processor in the memory, and a speech-recognized version of the name, achieved using the voice chip, is displayed on the new display line. The user may then enter the duration of the timed interval by voicing “# MINUTES”, where “#” is a number, and the timer displays the number of minutes on the new line and starts counting down on this channel. In this case, the number of minutes has been provided as a parameter to the timer in a “time-from-now” format. Other units and formats for timing intervals may be used. For example, the interval can be voiced in hours and minutes and also displayed in hours and minutes, using a different display format. In this case a user may input “2 hours, 14 minutes and 39 seconds” and this might be displayed as “2:14:39” on the display screen. Also a “time-of-day” format may be used to provide the timer parameter for a given timing channel. In this case, the time-of-day mode would be entered by the user voicing “TIME OF DAY”. Then the user may voice “1 30 PM” as an example of the time for expiration of the current interval. In this time-of-day case, the processor may calculate the time in minutes to achieve the desired expiration time, and initialize the corresponding timer to begin counting down accordingly. In another option for the user, a timer channel may be specified with a STARTING TIME (formatted as time-of-day) and a DURATION (formatted as a timing interval), using a different command set. In yet another option, the user may specify a FINISH TIME for all timing channels to expire, perhaps this time of day corresponding to a predetermined meal time. In this case the processor in the timing device or the processor in the mobile device may be used to synchronize the timing events and program the timing channels accordingly.
To accommodate alternative command and display formats, the display screen may be implemented as a high resolution pixelized display, for increased flexibility in placing characters, symbols and graphics in each display area.
If the timing device is battery powered, the display screen may be implemented using liquid crystal display (LCD) technology for reduced power consumption and extended battery life. Alternatively, the timing device may be connected via a power cord to a power source such as a wall socket, whereupon the device will be continually powered and there will be no need for a “WAKE UP” sequence. In this plugged in case, colored display elements may be used for increased visibility and attractiveness of the displays.
In the “time from now” mode the processor in the timer counts down each of the timed intervals to determine the time remaining for each unexpired timed interval, and displays the set of remaining times on the display screen. The processor also determines when each timed interval expires, corresponding to a remaining time of zero. To notify the user, the spoken name of the expired timed interval may be announced and a corresponding expiration message may be repetitively flashed on the display. Audible tones or tone sequences or music excerpts may be combined with replay of the voiced names at various execution points within the overall implementation of a timing event. This process continues until all of the timed intervals have expired, and the user has responded to each of the expired intervals, and after a following predetermined interval the timer may revert to sleep mode.
After expiration of the duration entered for a timing channel, the timing device preferably begins counting up, to show a user the elapsed time since the timed event ended. Elapsed times may be highlighted using flashing characters, or different colored characters for example, and this may prompt the user to clear the channel after any corresponding actions have been taken.
Timing device 10 includes a microphone port 22 and a speaker output port 23. These are preferably located in a user-facing manner as shown, to provide maximum fidelity and reliability of the speech recognition and speech synthesis capabilities of the timing device. In a preferred embodiment, the microphone has a sensitivity of 44 DB, and a frequency range of 100-16,000 Hz. Timing device 10 may also include a keypad as shown. The PWR key 25 may be used for powering device 10 on and off. The CLR key 26 may be used to clear all timing channels. Used together with voice inputs, the “+” and “−” keys 27 may be used for scrolling between display lines, or for raising and lowering the volume output from the speaker.
In a preferred embodiment, scrolling commands are provided so that a user can navigate to a line of interest displayed on the display screen, the line containing the details of a selected timing channel, highlighted such as by arrow 18 in
Timing device 10 can accommodate a large number of timing channels, limited only by the memory 37, for storing the programmed parameters and instructions corresponding to the channels in use, and the processor 36 for executing the instructions required to implement the various timer operations without delays that might frustrate a user. The scrolling capability described in reference to the display screen 15 of
Event sequencing system 50 draws on the processing power and user interface of the mobile device, coupled with the durability, cost-effectiveness, and sophisticated timing capabilities of the timing device. The durability of system 50 enables it to be used in situations that may be messy such as a kitchen, a gymnasium, a workshop or a classroom. The flexibility of the architecture presented in
While the present subject matter has been described in detail with respect to specific embodiments thereof, it will be appreciated that those skilled in the art, upon attaining an understanding of the foregoing may readily produce alterations to, variations of, and equivalents to such embodiments. Accordingly, it should be understood that the present disclosure has been presented for purposes of example rather than limitation, and does not preclude inclusion of such modifications, variations and/or additions to the present subject matter as would be readily apparent to one of ordinary skill in the art. For example, wireless communications between the multi-channel timing device and the cooperating devices may include communications in either direction and for any purpose. Messages may be sent that include graphics and audio as well as written instructions, and this may be useful to communicate with individuals such as toddlers for example, who do not yet own or know how to operate a smart phone.