Embodiments of the present invention relate to controlling a user alert. In particular, they relate to controlling a user alert using detected bio-signals.
When an event occurs at a portable electronic device such as a mobile telephone, the portable electronic device may alert the user to the event. For example, a mobile telephone may provide an audible alert to inform the user that there is an incoming telephone call.
In some circumstances, a user may have become aware of the alert but be unable to switch off the alert. One example might be when a user is able to hear his telephone ringing while he is driving his car but he is unable to switch off the alert. This can be irritating for the user. Another example might be when a user is in a meeting and his telephone is out of reach.
According to some, but not necessarily all, embodiments of the invention there is provided a method, comprising: obtaining, from at least one detector, a first detection of at least one bio-signal from at least one user; controlling a user output device to initiate a user alert, after obtaining the first detection of the at least one bio-signal; obtaining, from the at least one detector, a second detection of the at least one bio-signal from the at least one user, wherein the second detection is performed after initiating the user alert; and processing the first detection of the at least one bio-signal and the second detection of the at least one bio-signal to determine whether one or more changes in the at least one bio-signal pass a significance test.
According to some, but not necessarily all, embodiments of the invention there is provided an apparatus, comprising: at least one memory storing a computer program comprising computer program instructions; and at least one processor configured to execute the computer program instructions to cause the apparatus at least to perform: obtaining, from at least one detector, a first detection of at least one bio-signal from at least one user; controlling a user output device to initiate a user alert, after obtaining the first detection of the at least one bio-signal; obtaining, from the at least one detector, a second detection of the at least one bio-signal from the at least one user, wherein the second detection is performed after initiating the user alert; and processing the first detection of the at least one bio-signal and the second detection of the at least one bio-signal to determine whether one or more changes in the at least one bio-signal pass a significance test.
According to some, but not necessarily all, embodiments of the invention there is provided an apparatus, comprising: means for obtaining, from at least one detector, a first detection of at least one bio-signal from at least one user; means for controlling a user output device to initiate a user alert, after obtaining the first detection of the at least one bio-signal; means for obtaining, from the at least one detector, a second detection of the at least one bio-signal from the at least one user, wherein the second detection is performed after initiating the user alert; and means for processing the first detection of the at least one bio-signal and the second detection of the at least one bio-signal to determine whether one or more changes in the at least one bio-signal pass a significance test.
According to some, but not necessarily all, embodiments of the invention there is provided a non-transitory computer readable medium comprising computer program instructions that, when executed by at least one processor, cause at least the following to be performed: obtaining, from at least one detector, a first detection of at least one bio-signal from at least one user; controlling a user output device to initiate a user alert, after obtaining the first detection of the at least one bio-signal; obtaining, from the at least one detector, a second detection of the at least one bio-signal from the at least one user, wherein the second detection is performed after initiating the user alert; and processing the first detection of the at least one bio-signal and the second detection of the at least one bio-signal to determine whether one or more changes in the at least one bio-signal pass a significance test.
For a better understanding of various examples of embodiments of the present invention reference will now be made by way of example only to the accompanying drawings in which:
Embodiments of the invention relate to controlling a user alert using detected bio-signals. In particular, bio-signals are detected to determine whether a user has become aware of the user alert. If so, one or more characteristics of the user alert may be altered. For example, if the user alert is an audible alert, the user alert may be muted or the volume of the alert may be reduced.
The Figures illustrate an apparatus 10/20, comprising: at least one memory 14 storing a computer program 16 comprising computer program instructions 18; and at least one processor 12 configured to execute the computer program instructions 18 to cause the apparatus 10/20 at least to perform: obtaining, from at least one detector 26, a first detection of at least one bio-signal from at least one user; controlling a user output device 22 to initiate a user alert, after obtaining the first detection of the at least one bio-signal; obtaining, from the at least one detector 26, a second detection of the at least one bio-signal from the at least one user, wherein the second detection is performed after initiating the user alert; and processing the first detection of the at least one bio-signal and the second detection of the at least one bio-signal to determine whether one or more changes in the at least one bio-signal pass a significance test.
The processor 12 is configured to read from and write to the memory 14. The processor 12 may also comprise an output interface via which data and/or commands are output by the processor 12 and an input interface via which data and/or commands are input to the processor 12.
Although the memory 14 is illustrated as a single component, it may be implemented as one or more separate components, some or all of which may be integrated/removable and/or may provide permanent/semi-permanent/dynamic/cached storage.
The memory 14 stores a computer program 16 comprising computer program instructions 18 that control the operation of the apparatus 10/20 when loaded into the processor 12. The computer program instructions 18 provide the logic and routines that enables the apparatus 10/20 to perform the methods illustrated in
The computer program 16 may arrive at the apparatus 10/20 via any suitable delivery mechanism 40. The delivery mechanism 40 may be, for example, a tangible, non-transitory computer-readable storage medium, a computer program product, a memory device, a record medium such as a Compact Disc, a Digital Versatile Disc or Blu-Ray disc, or any article of manufacture that tangibly embodies the computer program 16. The delivery mechanism 40 may be a signal configured to reliably transfer the computer program 16.
The apparatus 20 illustrated in
In this example, the housing 28 houses: the processor 12, the memory 14, the user output device 22, the user input device 23, the detector 26 and the radio frequency transceiver 24. The elements 12, 14, 22, 23, 24 and 26 are co-located within the housing 28. The elements 12, 14, 22, 23, 24 and 26 are operationally coupled and any number or combination of intervening elements can exist (including no intervening elements).
The processor 12 is configured to receive an input from the detector 26. While the detector 26 is housed within the housing 28 of the apparatus 20 in the
The detector 26 is configured to detect bio-signals. The detector 26 may be any type of detector that is suitable for detecting a bio-signal. A bio-signal is considered to be any type of signal that emanates from a biological being (such as a human being). A bio-signal may, for example, be a bio-electrical signal, a bio-mechanical signal, an aural signal, a chemical signal or an optical signal.
Bio-electrical signals may be electrical currents produced by one or more electrical potential differences across a tissue, organ or cell system such as the nervous system. Bio-electrical signals include signals that are detectable, for example, using electroencephalography, magnetoencephalography, galvanic skin response techniques, electrocardiography and electromyography.
Bio-mechanical signals may, for example, include signals that are detectable using one or more accelerometers or mechanomyography. Aural signals may, for example, include signals that are detectable using a microphone. Chemical signals may, for instance, include signals that are detectable using an oxygenation detector or a pH detector. Optical signals may, for example, include signals detectable using a camera.
The processor 12 is also configured to provide an output to the user output device 22 and to receive an input from the user input device 23. The user input device 23 may, for example, be a keypad or a microphone (in which case it may be the same device as the detector 26). The user output device 22 may, for example, be a display, a loudspeaker or a vibration alert device.
In some embodiments of the invention, the user input device 23 may be integrated with the user output device 22. For example, the user input device 23 and the user output device 22 may be provided by a touch sensitive display.
The processor 12 is configured to receive inputs from and provide outputs to the radio frequency transceiver 24. The radio frequency transceiver 24 is configured to transmit and receive radio frequency signals. The radio frequency transceiver 24 may, for example, be a cellular transceiver that is compatible with one or more cellular protocols such as GSM (Global System for Mobile Communications), IS-95 (Interim Standard 95) or UMTS (Universal Mobile Telecommunications System). Alternatively, the radio frequency transceiver 24 may be a short range transceiver that is compatible with one or more short range protocols, such as Bluetooth protocols or IEEE (Institute of Electrical and Electronic Engineers) protocols. In some embodiments of the invention, the apparatus 20 comprises one or more cellular transceivers and one or more short range transceivers.
The processor 12 may control the detector(s) 26 to obtain the first detection (for example, by activating the detector(s) 26). Alternatively, the processor 12 may obtain the first detection by merely reading the detector(s) 26 at one or more appropriate instances in time, or over one or more appropriate periods of time.
In some embodiments of the invention, the processor 12 is configured to obtain the first detection in response to the occurrence of an event at the apparatus 20. The event is associated with a user alert and may, for example, be an incoming communication from a third party, such as an incoming telephone call or message. Alternatively, the event may be a clock reaching a preset time. For example, a user may have programmed the apparatus 20 to provide a user alert at the preset time (for example, by setting an alarm clock or a reminder system).
Performing the first detection may comprise detecting one or more of any of the types of bio-signal described above. For example, one or more bio-electrical signals, one or more bio-mechanical signals, one or more aural signal signals, one or more chemical signals and/or one or more optical signals may be detected.
At block 200 in
When the user becomes aware of the user alert, bio-signals originating at the user may change. Such changes may, for example, include the following:
(i) when the user notices the user alert he may move position, resulting in a change in the bio-mechanical and optical signals originating from the user;
(ii) the user may, for example, emit an aural signal upon seeing/hearing/feeling the user alert; and
(iii) bio-electrical signals produced by the user may change; for example, the user's skin may produce a galvanic skin response and the user's brain activity may change.
After initiation of the user alert, the detector(s) 26 perform a second detection of the one or more bio-signals that were detected at block 100. At block 300 in
The changes that occur in the detected bio-signals after initiation of the user alert may indicate that the user has become aware of the user alert. At block 400 in
In order to determine whether one or more changes in a bio-signal pass the significance test, the processor 12 may compare one or more values detected in the second detection with one or more values detected in the first detection. That is, rather than determining whether the second detection has a particular form by comparing the second detection with stored, predetermined data, the processor 12 may (merely) analyse whether an significant change has occurred in a bio-signal across a period of time that encompasses the initiation of the user alert.
For example, in order to determine whether a change in a bio-signal passes the significance test, the processor 12 may determine whether the magnitude of that change is above a threshold. Alternatively, if more than one bio-signal is being monitored, the processor 12 may determine whether the magnitudes of multiple changes are each above a threshold in order to determine whether the significance test is passed.
In some embodiments of the invention, after determining that the change(s) in the bio-signal(s) passes/pass the significance test, the processor 12 may alter at least one characteristic of the user alert initiated in block 200. For example, if the user alert comprises an aural alert, the processor 12 may mute the aural alert or reduce the volume of the aural alert. If the user alert comprises a visual alert displayed on a display, the processor 12 may remove the visual alert from display or reduce its prominence on the display. If the user alert comprises a vibratory alert, the processor 12 may control a vibration alert device to cease vibrating.
If the significance test is not passed, the processor 12 may escalate the user alert. For example, it may increase the volume of an audible alert or increase the prominence of a visual alert. Alternatively, the processor 12 may escalate the user alert by adding an audible alert to an existing visual alert, for example.
It may be that the change(s) in the bio-signal(s) which cause(s) the significance test to be passed and the user alert to be altered is/are not produced by the user with the intention of altering the user alert. For example, the change in the bio-signal(s) may be a reflex response from the user (such as a galvanic skin response) which causes the processor 12 to alter the user alert.
An advantage of embodiments of the invention is that user irritation is potentially minimised. For example, in some embodiments of the invention, the processor 12 may autonomously cease a user alert, or reduce an aspect of a user alert in magnitude or prominence in circumstances where it is not possible for the user to do so manually (for instance, when driving a car). Also, advantageously in embodiments of the invention, it is possible for the user alert to be initiated in a reasonably inconspicuous manner and for the user alert to be escalated over time (for example, in respect of an aural alert, increasing in volume) until the processor 12 determines that the user has noticed the user alert.
In some embodiments of the invention, the processor 12 may be configured to learn which change(s) in bio-signal(s) indicate(s) that a user has noticed a user alert and adapt or create a significance test accordingly. The learning process may be, for example, as follows. The processor 12 obtains a first detection of one or more bio-signals prior to the initiation of the user alert. The processor 12 then continues to monitor the bio-signal(s) and obtains a second detection after initiation of the user alert and just before the user deactivates the user alert manually (for example, by providing input at the user input device 23).
The change that occurs in a bio-signal between the first detection (obtained prior to initiation of the user alert) and the second detection (obtained after initiation of the user alert and just prior to manual deactivation of the user alert) can be considered to indicate that the user has noticed the user alert. The processor 12 may then adapt or create a significance test, for subsequent use, that tests whether the aforementioned change has been detected in order to determine whether to alter (for example, deactivate) a future user alert.
In some alternative embodiments of the invention, the processor 12 does not alter the user alert directly after determining that the change(s) in the bio-signal(s) passes/pass the significance test. For example, the processor 12 may require that the user provides a predetermined user input at the user input device 23 before the user alert is altered. Data identifying the predetermined user input may be stored in the memory 14 which enables the processor 12 to match a user input with the required input. This data is indicated in
For instance, consider an example in which the apparatus 20 is a portable electronic device with a user input device 23 in the form of an accelerometer. The processor 12 is configured to use the accelerometer to determine whether the user has tapped the portable electronic device with a digit. If the significance test is passed, the processor 12 enables the user to cease the user alert by tapping the portable electronic device with a digit. If the significance test is not passed, the processor 12 does not enable the user to cease the user alert by tapping the portable electronic device.
In this type of example, bio-signal detection and use of the significance test may advantageously reduce the possibility of the user alert being switched off inadvertently. This is because, if one or more bio-signal changes are not detected which indicate that the user has become aware of the user alert, it is not possible for the user to switch off the user alert by providing the predetermined user input. For instance, in the context of the above example, if the user does not notice the user alert and the device is inadvertently tapped by the user's leg while the device is in the user's pocket, the user alert will not be switched off.
In some further alternative embodiments of the invention, the significance test may form part of a two-part confidence test performed by the processor 12. When the processor 12 performs the confidence test, the significance test described above is performed and the processor 12 enables the user to provide user input to alter the user alert (possibly irrespective of the result of the significance test). The processor 12 decides, on the basis of the results of the significance test and a comparison between the user input received and a stored predetermined user input, whether or not to alter the user input.
For example, if the significance test is inconclusive and the comparison indicates that the received user input is a possible match (but not a good match) for the predetermined user input, the processor 12 may determine that the confidence test has not been passed. However, if the significant test had produced a more conclusive result (and therefore could be considered to have been ‘passed’), the processor 12 may have determined that the confidence test had been passed.
In these embodiments of the invention, the change in the detected bio-signal(s) that is required to pass the significance test may vary depending upon the comparison between the received user input and the stored, predetermined user input.
The processor 12 determines, via a cellular transceiver of the mobile telephone, that there is an incoming telephone call. At block 101 in
At block 201 in
At block 301 in
At block 401 in
Passing the significance test indicates that the user has become aware of the user alert. If the significance test is passed, the processor 12 may control the loudspeaker to reduce the volume of the user alert or it may mute (silence) the user alert. If the significance test is not passed, the processor 12 may control the loudspeaker to increase the volume of the user alert to try to get the user's attention.
The camera of the personal computer is directed towards a group of users. The users may, for example, be seated. The processor 12 determines that a message is about to be received via the network. At block 102 in
At block 202 in
At block 302 in
At block 402 in
For instance, the processor 12 may determine that the significance test is passed if it compares the first and second detections and determines from the comparison that at least one user, from the group of users, got up from his/her seat and came over to view the display more closely after the visual user alert was initiated.
The processor 12 may determine that the significance test is not passed if it compares the first and second detections and determines from the comparison that none of the users have noticed the visual user alert. For example, it may determine that from the comparison that nobody and has got up from his/her seat to view the display more closely after the visual alert was initiated.
References to ‘computer-readable storage medium’, ‘computer program product’, ‘tangibly embodied computer program’ etc. or a ‘controller’, ‘computer’, ‘processor’ etc. should be understood to encompass not only computers having different architectures such as single/multi-processor architectures and sequential (Von Neumann)/parallel architectures but also specialized circuits such as field-programmable gate arrays (FPGA), application specific circuits (ASIC), signal processing devices and other processing circuitry. References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a hardware device whether instructions for a processor, or configuration settings for a fixed-function device, gate array or programmable logic device etc.
As used in this application, the term ‘circuitry’ refers to all of the following:
(a) hardware-only circuit implementations (such as implementations in only analog and/or digital circuitry); and
(b) to combinations of circuits and software (and/or firmware), such as (as applicable): (i) to a combination of processor(s) or (ii) to portions of processor(s)/software (including digital signal processor(s)), software; and memory(ies) that work together to cause an apparatus, such as a mobile telephone or server, to perform various functions); and
(c) to circuits, such as a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation, even if the software or firmware is not physically present.
This definition of ‘circuitry’ applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term “circuitry” would also cover an implementation of merely a processor (or multiple processors) or portion of a processor and its (or their) accompanying software and/or firmware. The term “circuitry” would also cover, for example and if applicable to the particular claim element, a baseband integrated circuit or applications processor integrated circuit for a mobile telephone or a similar integrated circuit in a server, a cellular network device, or other network device.
The blocks illustrated in the
Although embodiments of the present invention have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the invention as claimed. For example, some examples of embodiments of the invention are described in relation to
Features described in the preceding description may be used in combinations other than the combinations explicitly described.
Although functions have been described with reference to certain features, those functions may be performable by other features whether described or not.
Although features have been described with reference to certain embodiments, those features may also be present in other embodiments whether described or not.
Whilst endeavoring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance it should be understood that the Applicant claims protection in respect of any patentable feature or combination of features hereinbefore referred to and/or shown in the drawings whether or not particular emphasis has been placed thereon.
This application is a continuation of and claims priority to U.S. application Ser. No. 12/833,509, filed Jul. 9, 2010, the entire contents of which are hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
4228806 | Lidow | Oct 1980 | A |
5577510 | Chittum et al. | Nov 1996 | A |
5924046 | Martensson | Jul 1999 | A |
6218947 | Sutherland | Apr 2001 | B1 |
6330457 | Yoon | Dec 2001 | B1 |
7016705 | Bahl et al. | Mar 2006 | B2 |
7542379 | Kimel et al. | Jun 2009 | B2 |
20010014616 | Matsuda et al. | Aug 2001 | A1 |
20020077534 | DuRousseau | Jun 2002 | A1 |
20030080872 | Gutta et al. | May 2003 | A1 |
20040209606 | Cleary et al. | Oct 2004 | A1 |
20050064916 | Ozluturk et al. | Mar 2005 | A1 |
20050190065 | Ronnholm | Sep 2005 | A1 |
20060105817 | Naick et al. | May 2006 | A1 |
20060114222 | Araki et al. | Jun 2006 | A1 |
20070173733 | Le et al. | Jul 2007 | A1 |
20080157956 | Radivojevic et al. | Jul 2008 | A1 |
20090111446 | Cui et al. | Apr 2009 | A1 |
20090134972 | Wu, Jr. et al. | May 2009 | A1 |
20090147973 | Gitzinger et al. | Jun 2009 | A1 |
20090157325 | Jung et al. | Jun 2009 | A1 |
20090259138 | Lin et al. | Oct 2009 | A1 |
20100056226 | Bansal et al. | Mar 2010 | A1 |
20100090835 | Liu et al. | Apr 2010 | A1 |
20120007740 | Kangas et al. | Jan 2012 | A1 |
Number | Date | Country |
---|---|---|
2509015 | Sep 2002 | CN |
0 694 283 | Jan 1996 | EP |
1 379 064 | Jan 2004 | EP |
1 522 256 | Apr 2005 | EP |
1 587 286 | Oct 2005 | EP |
1 867 274 | Dec 2007 | EP |
2 224 395 | Sep 2010 | EP |
2-034189 | Feb 1990 | JP |
2000-268275 | Sep 2000 | JP |
2003-018250 | Jan 2003 | JP |
2004-049855 | Feb 2004 | JP |
2004-305330 | Nov 2004 | JP |
2005-151507 | Jun 2005 | JP |
WO 0213672 | Feb 2002 | WO |
WO 2004012033 | Feb 2004 | WO |
WO 2005084538 | Sep 2005 | WO |
WO 2006090371 | Aug 2006 | WO |
WO 2008117145 | Oct 2008 | WO |
WO 2009033374 | Mar 2009 | WO |
WO 2009134205 | Nov 2009 | WO |
WO 2011027266 | Mar 2011 | WO |
Entry |
---|
iMusic vol. 3 (3 CD Set—Classical); [Online]; [Retrieved on Jun. 24, 2011]; Retrieved from the Internet <URL: http://www.luxevivant.com/index.asp?PageAction=VIEWPROD&ProdID=236. |
International Search Report and Written Opinion for International Application No. PCT/IB2011/052951, dated Nov. 29, 2011. |
International Search Report and Written Opinion for International Application No. PCT/IB2011/052952, dated Nov. 29, 2011. |
Ironic Sans: Idea: Motion-detecting cell phone ringer; [Online]; [Retrieved on Jun. 24, 2011]; Retrieved from the Internet <URL: http://www.ironicsans.com/2009/05/idea—motiondetecting—cell—phon.html. |
Microsoft Research using EEG to “read minds in order to tag images” [Online]; [Retrieved on Jun. 24, 2011]; Retrieved from the Internet <URL: http://www.ditii.com/2010/01/20/microsoft-research-using-eeg-to-read-minds-in-order-to-tag-images/. |
Nokia Developer; Arto Holopainen's Blog; “Beyond iPhone: Symbian Device Human body control”; [Online]; [Retrieved on Jun. 24, 2011]; Retrieved from the Internet <URL: http://www.developer.nokia.com/Community/Blogs/blog/arto-holopainens-forum-nokia-blog/2007/08/19/beyond-iphone-symbian-device-human-body-control. |
Office Action for Chinese Application No. 201180033994.1 dated Mar. 16, 2015. |
Über Review; “Top Ten Most Annoying Alarm Clocks”; [Online]; [Retrieved on Jun. 24, 2011]; Retrieved from the Internet <URL: http://www.uberreview.com/2006/03/top-ten-most-annoying-alarm-clocks.htm. |
Extended European Search Report from corresponding European Patent Application No. 11803219.2 dated Apr. 16, 2014. |
Office Action for Chinese Application No. 201180033994.1 dated Sep. 11, 2015. |
Office Action from U.S. Appl. No. 12/833,509, dated Sep. 11, 2012. |
Office Action from U.S. Appl. No. 12/833,509, dated Sep. 26, 2013. |
Final Office Action from U.S. Appl. No. 12/833,509, dated Feb. 7, 2013. |
Final Office Action from U.S. Appl. No. 12/833,509, dated Mar. 10, 2014. |
Notice of Allowance from U.S. Appl. No. 12/833,509, dated Aug. 21, 2014. |
Office Action from U.S. Appl. No. 12/833,519, dated Sep. 20, 2012. |
Notice of Allowance from U.S. Appl. No. 12/833,519, dated Mar. 21, 2013. |
Number | Date | Country | |
---|---|---|---|
20150091730 A1 | Apr 2015 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 12833509 | Jul 2010 | US |
Child | 14567202 | US |