The present disclosure relates to the computer field, and in particular to a display method, a display terminal and a non-transitory computer readable storage medium.
In recent years, the integration of artificial intelligence (AI) and Internet of Things (IoT) has become a trend. “AI+IoT” is AIoT, which refers to the integration of artificial intelligence technology and the Internet of Things in practical applications, that is, the intelligent Internet of Things. AIoT technology has been applied in the TV field, which can realize the interconnection of various home appliances and realize smart home life. However, when the existing AIoT screen information appears, the TV program currently being watched by the user is often paused, thereby affecting the normal viewing of the user.
The present disclosure provides a display method, a display terminal and a non-transitory computer readable storage medium, aiming to solve the problem that the TV program currently being watched by the user will be paused when the AIoT screen information appears.
In order to achieve the above objective, the present disclosure provides a display method, including the following operations:
In an embodiment, the operation of obtaining description information fed back by a corresponding smart terminal according to the wake-up signal includes:
In an embodiment, the operation of obtaining the description information fed back by the smart terminal after receiving the user instruction includes:
In an embodiment, after the operation of determining an object sending the wake-up signal, the display method further includes:
In an embodiment, the at least two non-overlapping areas further include a menu display area;
In an embodiment, after the operation of obtaining status information of other associated smart terminals except the smart terminal that feeds back the description information, the display method further includes:
In an embodiment, after the operation of displaying the AIoT display information in another area of the at least two non-overlapping areas, the display method further includes:
In an embodiment, after the operation of detecting whether feedback information sent by an input device or a user is received, the display method further includes:
Besides, in order to achieve the above objective, the present disclosure further provides a display terminal, including: a communication module, a memory, a processor, and a computer program stored in the memory and executed by the processor, the computer program, when executed by the processor, performs the operations of the display method as described above.
Besides, in order to achieve the above objective, the present disclosure further provides a non-transitory computer readable storage medium. A computer program is stored in the non-transitory computer readable storage medium, the computer program, when executed by a processor, performs the operations of the display method as described above.
The present disclosure provides a display method, including: after receiving wake-up signal, obtaining description information fed back by a corresponding smart terminal according to the wake-up signal, and generating AIoT display information of the display terminal including the description information; and dividing a display area of the display terminal into at least two non-overlapping areas, displaying a current playback screen of the display terminal in one area of the at least two non-overlapping areas, and displaying the AIoT display information in another area of the at least two non-overlapping areas. When displaying AIoT information, the display area is divided into at least two non-overlapping areas, one area of which displays the TV program being played on the TV, while the other area displays the AIoT information. When the AIoT information appears, it will not affect the TV program currently being played, and the AIoT information will not cover the TV program currently being played, and will not affect the normal viewing of the user.
It should be understood that the specific embodiments described herein are only used to explain the present disclosure, and are not intended to limit the present disclosure.
As shown in
The display terminal includes a communication module 10, a memory 20, a processor 30 and other components in a hardware structure. In the display terminal, the processor 30 is respectively connected to the memory 20 and the communication module 10. A computer program is stored in the memory 20, and the computer program is executed by the processor 30. When the computer program is executed, the operations of the following method embodiments are implemented.
The communication module 10 can be communicated with external communication device via a network. The communication module 10 can receive requests sent by the external communication device, and can also send requests, instructions, and information to the external communication device. The external communication device can be a user terminal or other system server or the like.
The memory 20 can be used to store software programs and various data. The memory 20 can mainly include a program storage area and a data storage area. The program storage area can store an operating system, an application program required by at least one function (for example, obtaining an initial current value corresponding to a current light intensity value of TV and a target current value corresponding to a target light intensity value in the light intensity adjustment request), or the like. The data storage area can include a database, and the data storage area can store data or information according to the use of the display terminal. In addition, the memory 20 can include a high-speed random access memory, and can also include a non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other volatile solid-state storage devices.
The processor 30 is the control center of the display terminal, which utilizes various interfaces and lines connect each part of the entire display terminal. By running or executing the software programs and/or modules stored in the memory 20, and calling the data stored in the memory 20, various functions and processing data of the display terminal are executed, and then the display terminal is monitored as a whole. The processor 30 can include one or more processing units. In an embodiment, the processor 30 can integrate an application processor and a modem processor. The application processor mainly deals with the operating system, user interface and application programs, and the modem processor mainly deals with wireless communication. It can be understood that the above-mentioned modem processor may not be integrated into the processor 30.
Although not shown in
Based on the above hardware structure, various embodiments of the method of the present disclosure are proposed.
As shown in
Operation S10, after receiving a wake-up signal, obtaining description information fed back by a corresponding smart terminal according to the wake-up signal, and generating AIoT display information of the display terminal including the description information.
In this embodiment, AIoT refers to the combination of artificial intelligence technology and Internet of Things technology. With the development of artificial intelligence technology, traditional Internet of Things devices will tend to be intelligent, thus forming the artificial intelligence Internet of Things (AIoT), making the “Internet of Everything” evolve to the “Intelligent Internet of Everything”. In the AIoT era, “voice+screen” has become the entrance and center of the intelligent Internet of Things. For smart homes in the AIoT era, because of the family's public nature (family sharing), a “public screen” is needed to become the entrance and center of the whole house's intelligent Internet of Things. In the era of AIoT smart homes, all “public screens” (screens of home TVs, range hoods, or the like) in the whole house are empowered to realize multi-screen interconnection. Each “public screen” in the home is the entrance to the AIoT ecosystem, and any “public screen” can realize voice interaction with smart devices in the whole house. The smart large screen in the living room at the core of the house will be the most perfect “public screen” in the family.
In this embodiment, the display terminal can be a TV or an associated smart terminal with display function. Both the user and the associated smart terminal can send a wake-up signal to the display terminal. When the wake-up signal is detected, the wake-up signal sent by the outside world is received, and the description information fed back by the corresponding smart terminal is obtained according to the wake-up signal. The corresponding smart terminal can be the display terminal itself that receives the wake-up signal or the associated smart terminal that sends the wake-up signal. It is necessary to further obtain the description information fed back by the corresponding smart terminal according to the wake-up signal, and then generate the AIoT display information containing the description information. The description information is obtained through the wake-up signal, and then the AIoT display information is generated, thereby further presenting the AIoT display information to the user.
Operation S20, dividing a display area of the display terminal into at least two non-overlapping areas, displaying a current playback screen of the display terminal in one area of the at least two non-overlapping areas, and displaying the AIoT display information in another area of the at least two non-overlapping areas.
In this embodiment, when displaying the AIoT information, the display area of the current display terminal needs to be divided into at least two areas that do not affect each other and do not overlap each other. It can be understood that the display area of the TV is divided into at least two non-overlapping areas, the current TV program being played by the TV is displayed in one area of the at least two non-overlapping areas, and the AIoT display information is displayed in the other area of the at least two non-overlapping areas. In fact, the current TV program is scaled down without affecting the clarity. The scaled down TV program can still be viewed normally without affecting the picture quality, and then the scaled down TV program is displayed in a divided display area.
In this embodiment, after receiving wake-up signal, the description information fed back by the corresponding smart terminal according to the wake-up signal is obtained, and the AIoT display information of the display terminal including the description information is generated; and the display area of the display terminal is divided into at least two non-overlapping areas, the current playback screen of the display terminal is displayed in one area of the at least two non-overlapping areas, and the AIoT display information is displayed in another area of the at least two non-overlapping areas. By dividing the display area, the TV program being played and the AIoT display information are displayed together in two non-overlapping display areas. When the AIoT display information is presented to the user, the TV program being played will not be affected, and the AIoT display information will not cover the TV program being played when it appears, and will not affect the normal viewing of the user.
In an embodiment, the display method of a second embodiment of the present disclosure is provided based on the display method of the first embodiment of the present disclosure. In this embodiment, as shown in
In this embodiment, either the user or the associated smart terminal can send the wake-up signal. After receiving the wake-up signal, it is necessary to further determine whether the object sending the wake-up signal is the user or the associated smart terminal. The user can send the wake-up signal directly through voice. For example, when the user wants to check the weather forecast, the user can input voice to check the weather or weather forecast. When the object sending the wake-up signal is the user, the user instruction is obtained from the wake-up signal. The user instruction at this time is to check the weather and determine the smart terminal that needs to be awakened according to the user instruction. When the user needs to check the weather, the corresponding smart terminal that needs to be awakened is the TV itself, and the TV feeds back description information after receiving the user instruction. The TV receives the user instruction to check the weather and feeds back the weather forecast for the user. The text information of the weather forecast can be presented to the user during the feedback, and the voice broadcast can also be carried out.
In this embodiment, the instruction input by the user includes an action instruction and a non-action instruction. For example, when the user instruction is a weather forecast, the TV only needs to call the local content to present the weather content to the user, and the user instruction is the non-action instruction. In an embodiment, the smart terminal that needs to be awakened is the TV itself, and the description information fed back by the TV is obtained after receiving the user instruction. For example, when the user instruction is to open the curtain, the TV needs to send the instruction to the associated smart terminal that controls the curtain to close, and the user instruction is the action instruction. In an embodiment, the smart terminal that needs to be awakened is an associated smart terminal that controls the closing of the curtain, and the description information fed back by the associated smart terminal that controls the closing of the curtain is obtained after receiving the user instruction. It can be understood that the user instruction that can be completed by the TV itself is the non-action instruction, and the TV needs to send the instruction to the associated smart terminal, and the smart terminal completes the instruction, and the user instruction at this time is the action instruction.
In an embodiment, as shown in
In this embodiment, the user or the associated smart terminal can send the wake-up signal. After receiving the wake-up signal, it is necessary to further determine whether the object sending the wake-up signal is the user or the associated smart terminal. When the object sending the wake-up signal is the associated smart terminal, it means that the associated smart terminal has completed a user-specified event at this time, and the user needs to be reminded that the event has been completed. The prompt information of the associated smart terminal is obtained, and the prompt information is used as the description information fed back by the smart terminal that sends the wake-up signal. For example, the washing machine has finished washing, the washing machine sends the wake-up signal to the TV, and the TV obtains the prompt information of the washing machine. The prompt information fed back by the washing machine can be that the clothes have been washed, please dry them as soon as possible, or the like, and can also include the instructions for use or maintenance of the washing machine and the instructions for drying and maintaining clothes. The prompt information of washing feedback is used as the description information.
In this embodiment, after receiving the wake-up signal, the object sending the wake-up signal is determined. When the object sending the wake-up signal is the user, the user instruction is obtained from the wake-up signal. The user instruction includes the action instruction and the non-action instruction. It is determined whether the awakened smart terminal is the TV itself or the associated smart terminal according to the user instruction, so as to obtain the description information fed back by the TV or the associated smart terminal after receiving the user instruction, and generate AIoT display information based on the description information. When it is determined that the object sending the wake-up signal is the associated smart terminal, the prompt information of the associated smart terminal is obtained, and the prompt information is used as the description information fed back by the associated smart terminal. The AIoT display information can be generated according to the description information, so that the AIoT display information including the description information is presented to the user, making the way for the user to obtain the information more convenient and faster.
In an embodiment, the display method of a third embodiment of the present disclosure is provided based on the display method of the second embodiment of the present disclosure. In this embodiment, as shown in
In this embodiment, the smart terminal to be awakened can be further determined according to the user instruction. When the user instruction is the action instruction, the smart terminal that needs to be awakened is the associated smart terminal. For example, the action instruction is to open the curtain, and the smart terminal that needs to be awakened at this time is the associated smart terminal that controls the closing of the curtain, and obtains the execution status information of the associated smart terminal that controls the closing of the curtain after receiving the user instruction and the recommendation information related to the user instruction. The execution status information can be that the curtain is about to be opened or the curtain is being opened or the curtain has been opened. The execution status information changes with the state of the curtain. Or, the execution status information can directly display that the curtain has been opened when the curtain is opened. The recommendation information related to the user instruction can recommend information that is highly related to the user instruction. For example, the user instruction is to open curtains, and the recommendation information can be outdoor ultraviolet intensity, weather, or the like. According to the current outdoor ultraviolet intensity or weather, it is further recommended that the user needs to bring an umbrella in the recommendation information, and the execution status information and the recommendation information associated with the user are integrated into the description information fed back by the associated smart terminal.
According to the user instruction, the smart terminal that need to be awakened can be further determined. When the user instruction is the non-action instruction, the smart terminal that needs to be awakened is the TV itself. For example, if the user instruction is to check the weather, the TV obtains the local application—the weather app according to the user instruction, and receives the description information fed back by the weather app. The description information at this time can include the highest temperature, the lowest temperature, the current temperature, the humidity, the rainfall probability, the visibility, the ultraviolet index of the day.
In this embodiment, it is determined whether the awakened smart terminal is the TV itself or the associated smart terminal according to the user instruction. When the awakened smart terminal is the TV itself, the local application is obtained and the description information fed back by the local application is received. When the smart terminal that needs to be awakened is the associated smart terminal, the execution status information of the smart terminal after receiving the user instruction and the recommendation information associated with the user instruction are obtained. The execution status information and the recommendation information are integrated into description information, and the description information including the execution status information and the recommendation information is further added to the AIoT display information and presented to the user, to make AIoT display information content more conform to user needs, and make the information content obtained by users more comprehensive and specific.
In an embodiment, the display method of a fourth embodiment of the present disclosure is provided based on the display method of the first embodiment of the present disclosure. In this embodiment, the at least two non-overlapping areas further include a menu display area.
As shown in
In this embodiment, the display area is divided into at least two non-overlapping areas. The divided display area also includes the menu display area. For example, as shown in
In this embodiment, in addition to sorting by time urgency, icon sorting can also be sorted by relevance. Specifically, after determining the first icon, the information associated with it is searched for according to the description information of the associated smart terminal corresponding to the first icon. For example, as shown in
In an embodiment, as shown in
In this embodiment, the smart terminal sending the feedback description information is the TV itself or the associated smart terminal. After obtaining the status information of other associated smart terminals except the smart terminal that feeds back the description information, the status information of each other associated smart terminal is associated with its corresponding icon, and each icon in the menu display area is associated with its status information. After the sorted icons are displayed in the menu display area, whether there is the movement instruction in the menu display area is detected. When the movement instruction corresponding to the menu display area is detected, the corresponding pointed icon is determined after the corresponding completion of the movement instruction. The cursor can be used to point to the icon, or the pointed icon can be set to blink or set a different color to distinguish it from other icons. When determining the pointed icon after completion of the movement instruction response, the status information associated with the pointed icon is obtained, and the AIoT display information in the area where the AIoT display information is displayed is replaced with the new AIoT display information that includes the status information. For example, as shown in
In an embodiment, the display method of a fifth embodiment of the present disclosure is provided based on the display method of the first embodiment of the present disclosure. In this embodiment, as shown in
In this embodiment, after the AIoT display information is presented to the user, it is detected whether the feedback information sent by the user through the remote control is received or the feedback information sent by the user through voice. When receiving the feedback information sent by the user through the remote control or the feedback information sent by the user through voice, the display area divided by the display terminal is restored to the initial state. The initial state is the state before the display area is divided. In fact, the TV programs broadcast on the TV are enlarged in equal proportions, the division of the display area is canceled, and the TV programs are displayed on the full screen. When the AIoT display information contains prompt information, in order to confirm that the user has seen the prompt information, when receiving the feedback information, it means that the user has already seen the prompt information at this time, and the division of the display area is canceled, so that the TV display interface is restored to the state before the division. After confirming that the user has viewed the AIoT display information, the initial state of the display area is restored to ensure that the user does not miss the prompt information.
In an embodiment, as shown in
In this embodiment, after the AIoT display information is presented to the user, it is detected whether the feedback information sent by the user through the remote control or the feedback information sent by the user through voice is received. When no feedback information from the user through the remote control or from the user through voice is received, the display time corresponding to the AIoT display information is obtained. The display time is set by the system or by the user. It is determined whether the display time corresponding to the AIoT display information has reached the preset display time. When the corresponding display time has reached the preset display time, the display area divided by the display terminal is restored to the initial state. The initial state is the state before the display area is divided. In fact, the TV programs broadcast on the TV are enlarged in equal proportions, the division of the display area is canceled, and the TV programs are displayed on the full screen. For example, when the user views the weather, the AIoT display information does not contain prompt information. After the weather information is displayed and broadcast for the preset display time, it will automatically exit and restore the full screen. When the AIoT display information does not contain prompt information, the user does not need to confirm. When the preset display time is reached, the display area is automatically restored to the state before the division, which can reduce user operations.
The present disclosure further provides a non-transitory computer readable storage medium. A computer program is stored in the non-transitory computer readable storage medium. The non-transitory computer readable storage medium can be the memory in the display terminal of
In the present disclosure, the terms “first”, “second”, “third”, “fourth” and “fifth” are only used for descriptive purposes, and cannot be understood as indicating or implying relative importance. For those of ordinary skill in the art, the specific meanings of the above-mentioned terms in the present disclosure can be understood according to specific circumstances.
In the description of this specification, the description of the terms “one embodiment”, “some embodiments”, “example”, “specific example”, and “some examples”, or the like, means that a specific feature, structure, material, or characteristic described in conjunction with the embodiment or example is included in at least one embodiment or example of the present disclosure. In this specification, the schematic representations of the above terms do not necessarily refer to the same embodiment or example. Moreover, the described specific features, structures, materials or characteristics can be combined in any one or more embodiments or examples in a suitable manner. In addition, those skilled in the art can combine the different embodiments or examples and the features of the different embodiments or examples described in this specification without contradicting each other.
Although the embodiments of the present disclosure have been shown and described above, the scope of the present disclosure is not limited thereto. It can be understood that the above-mentioned embodiments are exemplary and cannot be understood as a limitation of the present disclosure. Those of ordinary skill in the art can make changes, modifications and substitutions to the above-mentioned embodiments within the scope of the present disclosure, and these changes, modifications and substitutions should all be covered by the scope of the present disclosure. Therefore, the scope of the present disclosure shall be subject to the scope of the claims.
Number | Date | Country | Kind |
---|---|---|---|
201910872151.9 | Sep 2019 | CN | national |
This application is a continuation application of International Application No. PCT/CN2020/114387, filed on Sep. 10, 2020, which claims priority to Chinese Patent Application No. 201910872151.9, filed on Sep. 16, 2019, the entire disclosures of which are incorporated herein by reference.
Number | Name | Date | Kind |
---|---|---|---|
20190122121 | Yu | Apr 2019 | A1 |
20200007357 | Kim | Jan 2020 | A1 |
20220272409 | Lee | Aug 2022 | A1 |
Number | Date | Country |
---|---|---|
102360266 | Feb 2012 | CN |
103607626 | Feb 2014 | CN |
105302423 | Feb 2016 | CN |
105357571 | Feb 2016 | CN |
106658115 | May 2017 | CN |
106681584 | May 2017 | CN |
109688445 | Apr 2019 | CN |
110164441 | Aug 2019 | CN |
110620948 | Dec 2019 | CN |
2955815 | Dec 2015 | EP |
2012029064 | Feb 2012 | JP |
2016150121 | Sep 2016 | WO |
Entry |
---|
Examination Report issued in counterpart Indian Patent Application No. 202127052536, dated Apr. 25, 2022. |
Supplementary European Search Report issued in counterpart European Patent Application No. 20864649.7, dated Jan. 3, 2023. |
First Office Action issued in counterpart Chinese Patent Application No. 201910872151.9, dated Feb. 2, 2021. |
International Search Report and Written Opinion issued in corresponding PCT Application No. PCT/CN2020/114387, dated Dec. 8, 2020. |
Notification to Grant Patent Right for Invention issued in counterpart Chinese Patent Application No. 201910872151.9, dated Apr. 8, 2021. |
Yang, The color TV market turns to the era of smart “screen” AIoT is the way to break the game? China Electronic News, Issue 60, China, dated Aug. 23, 2019. |
Number | Date | Country | |
---|---|---|---|
20220086522 A1 | Mar 2022 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/CN2020/114387 | Sep 2020 | US |
Child | 17533481 | US |