This disclosure generally relates to the field of user experiences. More particularly, the disclosure relates to adjustments to user experiences based on biological responses.
As technology continues to develop at a rapid pace, various systems have been developed to provide users with more realistic and entertaining user experiences. For example, augmented reality (“AR”), virtual reality (“VR”) and Mixed Reality systems generally provide realistic images and/or video that attempt to provide the user with a realistic feel of being present within the user experience. Even though such systems provide an extra sense of realism to enhance the user's entertainment experience, use of such systems often involves a number of adverse effects, e.g., nausea, eyestrain, headaches, motion sickness, etc. As a result, users may reduce their usage time of these systems.
In one aspect, an apparatus has a receiver that receives a biological response of a user to an event that occurs during a user experience. Further, the apparatus has a memory that stores one or more predefined criteria that indicate an expected biological response to the event. In addition, the apparatus has a processor that compares the biological response to the one or more predefined criteria and adjusts the user experience based at least upon the biological response failing to meet the one or more predefined criteria.
In another aspect, a computer program product comprises a non-transitory computer readable storage device having a computer readable program stored thereon. The computer readable program when executed on a computer causes the computer to receive, with a receiver, a biological response of a user to an event that occurs during a user experience. Further, the computer readable program when executed on the computer causes the computer to store, with a memory, one or more predefined criteria that indicate an expected biological response to the event. In addition, the computer readable program when executed on the computer causes the computer to compare, with a processor, the biological response to the one or more predefined criteria. The computer readable program when executed on the computer also causes the computer to adjust the user experience based at least upon the biological response failing to meet the one or more predefined criteria.
In yet another aspect, a process receives, with a receiver, a biological response of a user to an event that occurs during a user experience. Further, the process stores, with a memory, one or more predefined criteria that indicate an expected biological response to the event. In addition, the process compares, with a processor, the biological response to the one or more predefined criteria. The process also adjusts the user experience based at least upon the biological response failing to meet the one or more predefined criteria.
The above-mentioned features of the present disclosure will become more apparent with reference to the following description taken in conjunction with the accompanying drawings, wherein like reference numerals denote like elements and in which:
A configuration for adjusting a user experience based on a biological response of a user to an event in that user experience is provided. Various user experiences may be intended to elicit quite different biological user responses from one another. For example, a VR video game may be intended to elicit excitement (a corresponding increased heart rate) whereas a theme park show may be intended to elicit relaxation (a corresponding decreased heart rate). The configuration detects a deviation of the user's particular biological response to an event in the user experience from the intended biological response and adjusts the user experience so that the user experience is able to elicit a biological response from the user that conforms with the intended biological response. For example, the configuration may detect that the VR video game has elicited an increased heart for the user that is outside a threshold for an acceptable health norm and may adjust the current scene in the VR video game to be less action packed so that the user's heart rate returns to being within the threshold for the acceptable norm. As another example, the configuration may detect that the VR video game has elicited a decreased heart rate (corresponding to boredom) even though the intended biological response was excitement. As a result, the configuration may adjust the VR video game to be more action packed so that the user's heart rate is increased to a level corresponding to excitement.
As illustrated, the experience adjustment system 100 comprises a processor 102, a memory 106, e.g., random access memory (“RAM”) and/or read only memory (“ROM”), a data storage device 108, and various sensors 104. The sensors 104 may sense various biological properties of one or more users that are participating in the user experience. Examples of the sensors 104 include cameras, biometric sensors, infrared (“IR”) head sensors, smart watches, smart glasses, mobile devices, clothes, bracelets, fitness bands, necklaces, drones, and/or any other sensor that may automatically sense biological properties of the user without any manual input from the user. Examples of the sensed biological properties include pulse rate, blood pressure, temperature, pupil dilation, sweat, and galvanic skin response. The sensors 104 may store sensed biological data 112 corresponding to such properties, directly or indirectly, in the data storage device 108 and/or the memory 106.
In one aspect, the sensors 104 are integrated within the experience adjustment system 100. In another aspect, the sensors 104 are not integrated within the experience adjustment system 100 but are in operable communication with the experience adjustment system 100; such operable communication may be direct and/or indirect communication. For example, a sensor 104 may send data directly to the experience adjustment system 100 (e.g., the sensor 104 is in close proximity to the experience adjustment system 100), or data may be aggregated via a cloud service from the sensor 104 (e.g., a remote sensor 104) for retrieval by the experience adjustment system 100. For instance, a sensor 104 may send the sensed biological data to a receiver 109 of the experience adjustment system 100 that may or may not be remotely located from the sensor 104, or the sensor 104 may act as a receiver 109 that is integrated within the experience adjustment system 100.
Further, the data storage device 108 and/or the memory 106 may store predefined criteria 114. Examples of the predefined criteria 114 include various thresholds based upon biological measurements such as pulse rate, blood pressure, temperature, pupil dilation, sweat, brainwave patterns (e.g., via brainwave monitoring), physical disabilities, mental disabilities, color blindness, and/or galvanic skin response. The processor 102 compares the sensed biological data 112 with the predefined criteria 114 to determine if the user's biological response to an event within a user experience is in accord with the expected biological response for that particular event. Examples of expected biological responses include boredom, excitement, discomfort, and health risk. If the predefined criteria 114 are not met, the experience adjustment system 100 performs an adjustment to the user experience so that the user's biological response conforms to the expected biological response.
In one aspect, the data storage device 108 loads experience adjustment code 110 from a computer readable storage device, e.g., a magnetic or optical drive, diskette, or non-volatile memory, DVD, CD-ROM, etc. The experience adjustment code 110 is then operated by the processor 102 in the memory 106 of the experience adjustment system 100 to adjust the user experience if the processor 102 determines that the sensed biological data 112 does not meet the predefined criteria 114 (e.g., a predefined threshold, a standard biological norm, etc.). In another aspect, the data storage device 108 is the computer readable storage device. In yet another aspect, the experience adjustment code 110 is stored in the memory 106 rather than the data storage device 108. As such, the experience adjustment code 110 and associated data structures of the present disclosure may be stored on a computer readable storage device.
If the expected biological response is a comfort level that is not within an accepted health norm, the experience adjustment system 100 may reduce the possibility of a user's discomfort by sensing corresponding biological responses such as the following: motion sickness (dizziness, headaches, nausea, and disorientation), visual problems (double vision, blurred vision, focal difficulty), ocular problems (eye sore, eye pain, and pulled eye muscle), physical problems (neck aches and general discomfort), aural problems (ear pain, ear pressure, hearing loss, and ear ringing), and cognitive problems (difficulty thinking or concentrating). Accordingly, the experience adjustment system 100 extends the amount of time that the user participates in the user experience by reducing the discomfort of the user when the user is uncomfortable and by increasing the excitement of the user when the user is bored.
Further, the experience adjustment system 100 improves the functioning of a computing device by reducing the processing time to provide a customized user experience. In contrast with a manual calibration of a device that provides a user experience, the experience adjustment system 100 automatically senses data that may not even feasibly be determined through manual calibration. For example, the process of a user attempting to provide manual subjective inputs for comfort level is ostensibly more time-consuming than the processor 104 obtaining biotelemetry signals from the user and processing those signals to automatically determine whether or not to perform a user experience adjustment. In other words, the data model stored in the data storage device 108 and/or memory 106, e.g., the sensed biological data 112 and the predefined criteria 114, allows the processor 104 to have increased flexibility to adjust a user experience via data that the user may be unaware of. As a result, the functionality of a computer is improved by providing adjustments to user experiences during pertinent events that affect biological properties of the user, which may be unbeknownst to the user until after the user experiences an unintended effect.
Although the components of the experience adjustment system 100 are illustrated in
Further,
For instance, the head mounted VR device 100 may not have detected any biological response from the user 201 (
As yet another alternative, the processor 102 (
In one aspect, the processor 102 (
The VR example provided in
The configuration for adjusting a user experience based on a biological response may also be used without any type of headset. For example, a user may be watching a motion picture or playing a video game via a media console. Various sensors 104 (
Further, the configuration for adjusting a user experience based on a biological response may also be used in a theme park feature or a theater environment. For example, the processor 102 (
The predefined criteria 114 (
In another aspect, the predefined criteria 114 are based on real-time biological response data of other users that are concurrently participating in the same user experience as the user 201 (
In one aspect, the server 401 receives the group biological data and the sensed biological data 112 (
Instead of the processor 102 (
Alternatively, the server 401 may include the sensed biological data 112 in the entire group biological data. The server 401 may then adjust the user experience for all of the users, i.e., the user 201 and the group of users 402, based upon any user's biological response deviating from the predetermined threshold.
As yet another alternative, the predefined criteria may be defined solely with respect to the user 201 without any analysis of the biological responses of other users. For example, the processor 102 (
Alternatively, the predefined criteria may be based on a combination of any of the foregoing baseline data compilations. For instance, the predefined criteria may be based on a combination of the baseline data of the user 201 gathered through a calibration test and the baseline data of the group of additional users 402 (
In one aspect, the processor 102 (
Various processes may be used to adjust a user experience based on a biological response.
The processes described herein may be implemented in a specialized, general, multi-purpose, or single purpose processor. Such a processor will execute instructions, either at the assembly, compiled or machine-level, to perform the processes. Those instructions can be written by one of ordinary skill in the art following the description of the figures corresponding to the processes and stored or transmitted on a computer readable medium. The instructions may also be created using source code or any other known computer-aided design tool. A computer readable medium may be any medium, e.g., computer readable storage device, capable of carrying those instructions and include a CD-ROM, DVD, magnetic or other optical disc, tape, silicon memory (e.g., removable, non-removable, volatile or non-volatile), packetized or non-packetized data through wireline or wireless transmissions locally or remotely through a network. A computer is herein intended to include any device that has a specialized, general, multi-purpose, or single purpose processor as described above. For example, a computer may be a desktop computer, laptop, smartphone, tablet device, set top box, etc.
It is understood that the apparatuses, systems, computer program products, and processes described herein may also be applied in other types of apparatuses, systems, computer program products, and processes. Those skilled in the art will appreciate that the various adaptations and modifications of the aspects of the apparatuses, systems, computer program products, and processes described herein may be configured without departing from the scope and spirit of the present apparatuses, systems, computer program products, and processes. Therefore, it is to be understood that, within the scope of the appended claims, the present apparatuses, systems, computer program products, and processes may be practiced other than as specifically described herein.
Number | Name | Date | Kind |
---|---|---|---|
7654901 | Breving | Feb 2010 | B2 |
8308562 | Patton | Nov 2012 | B2 |
9132342 | Balachandreswaran et al. | Sep 2015 | B2 |
9179855 | Burdea et al. | Nov 2015 | B2 |
9498705 | May et al. | Nov 2016 | B2 |
9511289 | Bond et al. | Dec 2016 | B2 |
9545567 | Han et al. | Jan 2017 | B2 |
9711056 | Nguyen | Jul 2017 | B1 |
20020097235 | Rosenberg | Jul 2002 | A1 |
20060281543 | Sutton | Dec 2006 | A1 |
20070066916 | Lemos | Mar 2007 | A1 |
20100149073 | Chaum | Jun 2010 | A1 |
20130281798 | Rau et al. | Oct 2013 | A1 |
20140159862 | Yang | Jun 2014 | A1 |
20150268721 | Joo | Sep 2015 | A1 |
20150334808 | Hack | Nov 2015 | A1 |
20160035132 | Shuster et al. | Feb 2016 | A1 |
20160077547 | Aimone | Mar 2016 | A1 |
20160093154 | Bytnar | Mar 2016 | A1 |
20160228771 | Watson | Aug 2016 | A1 |
20170007182 | Samec et al. | Jan 2017 | A1 |
20170055900 | Jain et al. | Mar 2017 | A1 |
Entry |
---|
Negini, Faham, “Play Experience Enhancement Using Emotional Feedback,” A Thesis Submitted to the College of Graduate Studies and Research, Department of Computer Science, University of Saskatchewan, Saskatoon, http://citeseerx.ist.psu.edu/viewdoc/download?doi=10.1.1.883.5546&rep=rep1&type=pdf, 2014. |
Dekker, Andrew, “Please Biofeed the Zombies: Enhancing the Gameplay and Display of Horror Game Using Biofeedback,” Situated Play, Proceedings of DiGRA 2007 Conference, https://s3.amazonaws.com/academia.edu.documents/6145526/073.pdf?AWSAccessKeyId=AKIAIWOWYYGZ2Y53UL3A&Expires=1509990052&Signature=%2BrWi2dtaELj1x9hFOOU3VYYVMYk%3D&response-content-disposition=inline%3B%20filename%3DPlease_biofeed_the_zombies_enhancing_the.pdf, 2007. |
Number | Date | Country | |
---|---|---|---|
20180260026 A1 | Sep 2018 | US |