Patent Grant
10295403
The present application relates to the field of electronic technologies and in particular relates to an information processing method and an electronic device.
In recent years, virtual reality (VR) and augmented reality (AR) technologies have rapidly developed. Some virtual scenarios or virtual-real hybrid scenarios are created by using a virtual reality device or an augmented reality device. Sensory simulations involving vision, hearing, touch, or the like are provided for users to experience a sense of immersion. Often, the virtual scenario constructed by the AR/VR fails to vary with an environment. With respect to users, the physical world and the virtual world still seem relatively independent of each other, thereby affecting user experience.
In one embodiment, a method is disclosed. The method may include determining an environmental parameter of an environment at a location of an electronic device. The method may include identifying a first object of a virtual scenario that relates to the environmental parameter. The method may include generating a display parameter of the first object based on the environmental parameter. The method may include displaying the first object in the virtual scenario based on the display parameter.
In one embodiment, an electronic device is disclosed. The electronic device may include a housing. The electronic device may include a determining unit disposed in the housing. The determining unit may be configured to determine an environmental parameter. The environmental parameter may include a parameter of the environment around the electronic device or another electronic device. The determining unit may include one or more sensors such as the sensors described above. The electronic device may include a memory and a processor disposed in the housing and connected to the memory. The memory may store code executable by the processor. The processor may include one or more processors. The executable code may, in response to being executed by the processor, determine the environmental parameter of an environment at a location of an electronic device. The executable code may, in response to being executed by the processor, identify a first object of a virtual scenario that relates to the environmental parameter. The executable code may, in response to being executed by the processor, generate a display parameter of the first object based on the environmental parameter. The executable code may, in response to being executed by the processor, display the first object in the virtual scenario based on the display parameter.
In one embodiment, a computer program product is disclosed. The program product may include a non-transitory computer readable storage medium that stores code executable by a processor. The executable code may include code to perform determining an environmental parameter of an environment where an electronic device is located. The computer program product may include code to perform identifying a first object in a virtual scenario that relates to the environmental parameter. The computer program product may include code to perform generating a display parameter of the first object based on the environmental parameter. The computer program product may include code to perform displaying the first object in the virtual scenario based on the display parameter.
To describe the technical solutions according to the embodiments of the present invention or the technical solutions in the related art more clearly, accompanying drawings used for describing the embodiments are hereinafter briefly introduced. It is apparent that the accompanying drawings hereinafter are only intended to illustrate some embodiments of the present application.
Embodiments of the present application provide a method and an electronic device. The electronic device may generate a virtual scenario that may vary with the environment where an electronic device is located.
Step S101 Determining an environmental parameter of an environment at a location of an electronic device.
In one embodiment of the present application, an electronic device may include one or more sensors that may determine an environmental parameter. A sensor may include a temperature sensor, a luminance (or light) sensor, a humidity sensor, a wind force sensor, a visual sensor (such as a camera or other image or video capturing device) or the like. A sensor may collect, in real time, information regarding an environment parameter of the environment at the location of the electronic device.
In one embodiment, the electronic device that includes the one or more sensors may be a different device than the electronic device that generates and/or displays the virtual scenario. For example, in one embodiment, a server computer may generate a virtual scenario. The server may communicate data regarding the virtual scenario to a cellular phone. The phone may display the virtual scenario. The server may receive environmental parameter data from a variety of sources. For example, the server may receive environmental data from a weather service, a weather station, or the like. In one embodiment, the cell phone may determine environmental data, for example, a luminance level detected from a camera of the cell phone.
Step S102 Identifying a first object matching of a virtual scenario that relates to the environmental parameter.
In some embodiments, in response to determining the environmental parameter of the environment where the electronic device is located, the method 100 may identify a first object in a virtual scenario that relates to the environmental parameter. An object, such as the first object in a virtual scenario, relating to an environmental parameter may include the object being influenceable by the environmental parameter. The virtual scenario may include the first object. An electronic device may display the first object in the virtual scenario. A first object being influenceable by an environmental parameter may include the environmental parameter being able to change or alter the appearance, behavior, or the like of the first object in the virtual scenario. For example, in one embodiment, the first object may include a flag. Wind may influence the movement speed, direction of movement, or the like of the flag. Thus, the flag is influenceable by the wind.
In one embodiment, the virtual scenario generated by the electronic device may include a scenario generated by a virtual reality device, a scenario generated by an augmented reality device according to a reality scenario collected by a camera, microphone, or other input device. In some embodiments of the present application, the scenario generated by the electronic device may include a two-dimensional (2D) scenario, a three-dimensional (3D) scenario, or the like One of skill in the art may recognize ways that a device may receive input from reality and generate a virtual scenario or a partially virtual-partially real scenario. The term “virtual scenario,” as used herein, may include any of the scenarios described above.
Step S103 Generating a display parameter of the first object based on the environmental parameter.
In one embodiment, the electronic device may generate a display parameter of the first object according to the environmental parameter of the environment where the electronic device is located. A display parameter may include instructions, data, information, or the like that the electronic device may use to generate how the first object should appear, behave, or the like, based on the determined environmental variable. For example, in one embodiment, the first object may include a flag. The environmental parameter may include the wind. The electronic device may determine that the wind is blowing at 3 meters per second (m/s) from the east. The electronic device may generate a display parameter for the flag based on that determination. The display parameter may include instructions, data, or the like that the electronic device may use to display the flag so that the flag in the virtual scenario appears to move in a west direction (since the wind is blowing from the east to the west) and that the flag's extension from its flagpole may correspond with a wind speed of 3 m/s. The display parameter may include transformation vectors or the like.
S104 Displaying the first object in the virtual scenario based on the display parameter.
In some embodiments, in response to generating the display parameter of the first object, the first object may be displayed in the virtual scenario according to the display parameter.
In one embodiment, identifying a first object that relates to the environmental parameter may include selecting the first object influenceable by the environmental parameter from at least one object in the virtual scenario. For example, in one embodiment, the virtual scenario may include multiple objects. Some objects may be influenceable by a certain environmental parameter and some may not. Identifying the first object may include determining which objects (if any) of the multiple objects may relate to the environmental parameter. For example, in one embodiment, the virtual scenario may include a flag, a track, and bleachers as objects. For example, the electronic device may iterate through the objects to determine whether an object is influenceable by wind. Each object may include a property that indicates which environmental parameters influence the object. One of skill in the art will recognize other ways to organize the objects to determine whether a certain environmental parameter may influence the objects.
In one embodiment, identifying a first object of a virtual scenario that relates to the environmental parameter may include generating a first object that is influenceable by the environmental parameter. For example, in one embodiment, a virtual scenario may not include an object influenceable by the environmental parameter. The electronic device may generate an object influenceable by the environmental parameter. The electronic device may generate the object for a variety of reasons, for example, to demonstrate how an environmental parameter of reality may influence an object in the virtual scenario.
For example, in one embodiment, the virtual scenario may include a field and bleachers. The electronic device may determine that it is raining. The electronic device may determine that the field and the bleachers of the virtual scenario are not influenced by the rain. The electronic device may generate a puddle of water and display the puddle in the virtual scenario.
In the embodiments of the present application, identifying the first object may include a variety of forms. In one embodiment, identifying the first object of a virtual scenario that relates to the environmental parameter from the at least one object may include determining, based on a first corresponding relationship between environmental parameters and objects, a first object that corresponds to the environmental parameter from the at least one object.
In one embodiment, the first corresponding relationship between the environmental parameters and the at least one object may include one or more predetermined relationships. In one embodiment, the first corresponding relationship may include one or more relationships generated over time. In response to determining the environmental parameter of the environment where the electronic device is located, the method 100 may identify the first object from multiple objects of the scenario generated by the electronic device.
For example, a virtual scenario may include a red flag on a flagpole, a track, and bleachers. The red flag may wave with the wind when the wind comes. Thus, the red flag may be influenceable by the wind environmental parameter. The virtual scenario may include a first corresponding relationship between the objects of the scenario and the wind environmental parameter. For example, the first corresponding relationship may include that the red flag is influenceable by the wind. The track, bleacher, and flagpole may not be influenceable by the wind environmental parameter. Thus, the flagpole, bleachers, and track may not be included in the first corresponding relationship.
In one embodiment, generating a first object influenceable by the environmental parameter may include determining, based on a second corresponding relationship between environmental parameters and objects, a first object corresponding to the environmental parameter, determining whether the at least one object comprises the first object, and generating the first object in response to the at least one object not comprising the first object.
In one embodiment, the second corresponding relationship between the environmental parameters and the at least one object may include a predetermined relationship. In response to determining the environmental parameter of the environment where the electronic device is located, the method 100 may include generating the first object corresponding to the environmental parameter.
For example, in one embodiment, the electronic device may be configured to detect rains in the environment where the electronic device is located. For example, the electronic device may include a humidity sensor, a light sensor, a weather sensor, a module that may receive weather data, or the like. The electronic device may generate a virtual scenario. The virtual scenario may not include rain. In one embodiment, the method 100 may establish a corresponding relationship between rain in the virtual scenario (for example, as an object) and rain in the environment of the electronic device (for example, as the environmental parameter). The virtual scenario generated by the electronic device may include a playing field, and objects in the scenario may include a track, a flagpole, and bleachers. In response to the electronic device detecting rain in the environment where the electronic device is located, the electronic device may determine whether there is rain in the virtual scenario. In response to determining that there is no rain in the virtual scenario, the electronic device may generate and add rain to the virtual scenario.
In some embodiments, generating the display parameter of the first object may include a variety of forms. In one embodiment, an environmental parameter may include a wind force of the environment where the electronic device is located. Generating the display parameter of the first object based on the environmental parameter may include calculating a display movement direction and a display movement speed of the first object based on the wind force parameter. In one embodiment, the wind force parameter may indicate a wind direction and a wind force value of the environment where the electronic device is located. The display movement direction and display movement speed may be included in the display parameter.
In one embodiment, displaying the first object in the virtual scenario based on the display parameter may include dynamically displaying the first object in the virtual scenario based on the display movement speed in the display movement direction.
In some embodiments, the method 100 may display the first object in the virtual scenario based on the display parameter. For example, in one embodiment, the wind may blow from the east at a speed of 3 m/s. A flag on a flagpole may wave to the west at a speed of 1 m/s. The method may establish a corresponding relationship between wind forces and movement distances and a corresponding relationship between wind directions and movement directions. In response to detecting that the wind blows from the east at a speed of 3 m/s, the flag corners of the red flag in the virtual scenario may wave to the west at a speed of 1 m/s.
In response to the environmental parameter including a luminance of the environment where the electronic device is located, generating a display parameter of the first object based on the environmental parameter may include calculating a display luminance of the first object based on the luminance. Displaying the first object in the virtual scenario based on the display parameter may include displaying the first object in the virtual scenario based on the display luminance.
In one embodiment, the method 100 may include determining the luminance of the first object based on the luminance of the environment where the electronic device is located. In response to the luminance of the environment increasing, the method 100 may generate a display parameter for the first object based on that increased luminance.
In one embodiment, the method 100 may establish a corresponding relationship between the luminance of the environment of the electronic device and the luminance of the first object. For example, the virtual scenario may include a study room. The first object may include a desk. The environment may include a first luminance. In response to the luminance of the environment increasing from the first luminance to a second luminance, the electronic device may detect the second luminance. The method 100 may establish a corresponding relationship between the luminance of the environment and the luminance of the first object in the virtual scenario. In response, the method 100 may generate a display parameter for the desk based on the second luminance and adjust the luminance of the desk in the virtual scenario to the second luminance by displaying the desk based on the display parameter.
In one embodiment, in response to the environmental parameter including a depth of field of the environment where the electronic device is located, generating the display parameter may include calculating a display size of the first object based on the depth of field. Displaying the first object in the virtual scenario based on the display parameter may include displaying the first object in the virtual scenario based on the display size. The display parameter may include the display size.
In some embodiments, in response to identifying the first object, the method 100 may calculating a display size of the first object based on the depth of field of the environment where the electronic device is located. For example, the electronic device may generate a virtual scenario based on a selected image of a tree. In response to the temperature of the environment of the electronic device rising to a predetermined temperature, the electronic device may generate a bird on the tree. In response to the tree being far away from the electronic device, the depth of field of the generated bird is great such that the bird is displayed in the virtual scenario on the tree and may appear small in size. In response to the tree being near to the electronic device, the tree in virtual scenario may be in a place with a small depth of field. In this case, the depth of field of the generated bird may be small, and correspondingly, the bird may appear on the tree with a larger size.
In one embodiment, the Step S101 (determining the environmental parameter of the environment at the location of the electronic device) may include receiving the environmental parameter from a sensor of the electronic device. The sensor may include a wind force sensor, a luminance sensor, a depth of field sensor, or the like.
By using the method 100, in response to the user using the electronic device, the virtual scenario generated by the electronic device may vary with the changes of the environment where the user is located. In this way, the virtual scenario appears closer to reality and user experience is greatly improved.
In one embodiment, the executable code may further include code to select the first object influenceable by the environmental parameter from at least one object of the virtual scenario. The executable code may further include code to generate the first object influenceable by the environmental parameter.
In some embodiments, the executable code may further include code to determine, based on a first corresponding relationship between environmental parameters and objects, an object that corresponds to the environmental parameter.
In one embodiment, the executable code may further include code to determine, based on a second corresponding relationship between environmental parameters and objects, an object corresponding to the environmental parameter. The code may include code to determine whether the at least one object includes the first object. The code may include code to generate the first object in response to the at least one object not including the first object.
In one embodiment, the executable code to generate the display parameter of the first object based on the environmental parameter may include, in response to the environmental parameter including a wind force of the environment where the electronic device is located, code to calculate a display movement direction and/or a display movement speed of the first object based on the wind force. The wind force may indicate a wind direction and/or a wind force value of the environment where the electronic device is located.
In one embodiment, the executable code to generate the display parameter of the first object based on the environmental parameter may include, in response to the environmental parameter including a luminance of the environment where the electronic device is located, code to calculate a display luminance of the first object based on the luminance. The luminance parameter may include a light level, luminance, or the like of the environmental where the electronic device is located.
In one embodiment, the executable code to generate the display parameter of the first object based on the environmental parameter may include, in response to the environmental parameter including a depth of field of the environment where the electronic device is located, code to calculate a display size of the first object based on the depth of field of the environment.
In one embodiment, the code to display the first object in the virtual scenario based on the display parameter may include code to dynamically display the first object based on the display movement speed or display movement direction of the wind parameter, display the first object based on the display luminance, or display the first object based on the display size.
In one embodiment, the determining unit 202 may include a sensor. The sensor may include a wind force sensor, a luminance sensor, a depth of field sensor, or the like.
In one embodiment, the electronic device 300, the determining unit 301, the identifying unit 302, generating unit 303, and/or displaying unit 304 may include functionality, behavior, components, or the like described herein. The various units of the electronic device 300 may execute one or more steps of the method 100. The units may include executable code as described herein that may carry out various functions. The units may include hardware, software, or a combination of both. For example, the determining unit 301 may include one or more sensors as described above. The identifying unit 302 and/or generating unit 303 may include a memory and a processor. The displaying unit 304 may include a display screen or the like. One of skill in the art will recognize other forms the units may include.
In one embodiment, computer program instructions may be provided to a general computer, a dedicated computer, an embedded processor, or one or more processors of another programmable data processing device to generate a machine. The machine may enable the computer or the processors of other programmable data processing devices to run the instructions to implement an apparatus for implementing specific functions in at least one process in the flow diagrams and/or at least one block in the block diagrams.
In one embodiment, the computer program instructions may be stored in a computer-readable memory capable of causing a computer or other programmable data processing devices to work in a specific mode. The instructions stored in the computer-readable memory may generate a product comprising an instruction apparatus. The instruction apparatus may implement specific functions in at least one process in the flow diagrams and/or at least one block in the block diagrams.
The computer program instructions, in one embodiment, may be loaded on a computer or other programmable data processing devices. The computer or the other programmable data processing devices may run a series of operations or steps to implement processing of the computer. The instructions, in response to being run on the computer or the other programmable data processing devices, may implement the specific functions in at least one process in the flow diagrams and/or at least one block in the block diagrams.
In certain embodiments, the computer program instructions may correspond to the information processing methods according to the embodiments of the present application. The instructions may be stored in storage medium such as an optical disk, a hard disk, a U disk, or the like. The computer program instructions corresponding to the information processing methods stored in the storage medium, in response to being read or run by an electronic device, may cause the electronic device to perform one or more the following steps.
In one embodiment, the computer program product may include code to perform determining an environmental parameter of an environment where an electronic device is located. In one embodiment, the computer program product may include code to perform identifying a first object in a virtual scenario that relates to the environmental parameter. The computer program product may include code to perform generating a display parameter of the first object based on the environmental parameter. The computer program product may include code to perform displaying the first object in the virtual scenario based on the display parameter.
In one embodiment, in response to the code performing the step of identifying the first object that relates to the environmental parameter, the program product may include code to perform selecting the first object in the virtual scenario that is influenceable by the environmental parameter from at least one object in the virtual scenario, or generating the first object in the virtual scenario that is influenceable by the environmental parameter.
In some embodiments, the code to perform selecting the first object that is influenceable by the environmental parameter from the at least one objects may include code to perform determining, based on a first corresponding relationship between environmental parameters and objects, that the first object corresponds to the environmental parameter.
In one embodiment, the code to perform generating the first object that is influenceable by the environmental parameter may include code to perform determining, based on a second corresponding relationship between environmental parameters and objects, that the first object corresponds to the environmental parameter. The code may perform determining whether the at least one objects includes the first object. The code may include code that performs generating the first object in response to the at least one object not including the first object.
In some embodiments, generating the display parameter of the first object based on the environmental parameter may include code to perform one or more of the following.
The code may include code to perform, in response to the environmental parameter including is a wind force of the environment where the electronic device is located, calculating a display movement direction and a display movement speed of the first object based on the wind force. The code may include code to perform, in response to the environmental parameter including a luminance of the environment where the electronic device is located, calculating a display luminance of the first object based on the luminance. The code may include code to perform, in response to the environmental parameter including a depth of field of the environment where the electronic device is located, calculating a display size of the first object based on the depth of field.
In one embodiment, code to perform displaying the first object in the virtual scenario based on the display parameter may include code to perform dynamically displaying the first object in the virtual scenario based on the display movement speed in the display movement direction, displaying the first object in the virtual scenario based on the display luminance, or displaying the first object in the virtual scenario based on the display size. In one embodiment, the code to perform determining an environmental parameter of an environment at a location of an electronic device may include code to receive the environmental parameter from a sensor. The sensor may include a wind force sensor, a luminance sensor, a depth of field sensor, or the like.
Those skilled in the art will understand that the embodiments may be described as illustrating methods, systems, or computer program products. Therefore, hardware embodiments, software embodiments, or a combination of hardware and software embodiments may be used to illustrate the present disclosure. In addition, the present disclosure may further employ a computer program product, which may be implemented by at least one non-transitory computer-readable storage medium with runnable program code stored thereon. The non-transitory computer-readable storage medium may include, but is not limited to a disk memory, a CD-ROM, an optical memory, or the like.
The present application may be described based on the flow diagrams and/or block diagrams of the method, device, system, or computer program product. It should be understood that each process and/or block in the flow diagrams and/or block diagrams, or a combination of the processes and/or blocks in the flow diagrams and/or block diagrams may be implemented using computer program instructions.
Although some embodiments of the present disclosure are described, those skilled in the art may make modifications and variations to these embodiments based on the basic inventive concept of the present disclosure. Therefore, the described embodiments and other modifications and variations may fall within the protection scope subject to the appended claims.
It is apparent that a person skilled in the art may make various modifications and variations to the present disclosure without departing from the spirit and scope of the present disclosure. Such modifications and variations fall within the scope defined by the claims of the present disclosure and equivalent technologies thereof. The present disclosure is intended to cover such modifications and variations.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2016 1 0203119 | Mar 2016 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20130044054 | Lee et al. | Feb 2013 | A1 |
| 20130222427 | Heo et al. | Aug 2013 | A1 |
| 20140002421 | Lee et al. | Jan 2014 | A1 |
| 20140002492 | Lamb | Jan 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 102735100 | Oct 2012 | CN |
| 102981810 | Mar 2013 | CN |
| 103888754 | Jun 2014 | CN |
| 104076914 | Oct 2014 | CN |
| 104977785 | Oct 2015 | CN |
| Number | Date | Country | |
|---|---|---|---|
| 20170287223 A1 | Oct 2017 | US |
