Patent Application
20230082852
This application is based on and claims priority under 35 U.S.C. § 119 to Indian Patent Application No. 202141040783, filed on Sep. 8, 2021, in the Indian Patent Office, the disclosure of which is incorporated by reference herein in its entirety.
This disclosure generally relates to computing systems and in particular relates to control of Internet of Things (IoT) devices by a mobile device.
With an increase in number of Internet of Things (IoT) devices in a Smart Home environment, an overhead of changing settings of the IoT device becomes cumbersome. There are many steps required to change the settings in the IoT device. For example, to change a particular setting of the IOT device, either a plugin of the IOT device needs to opened through a dedicated application or a third party software application is needed to change the settings of the IOT device. Regardless, five or more steps (e.g., taps) are typically required to access and change a given setting.
Additionally, setting control methods according to the related art require that, for every IoT device, a separate application must be opened for changing the settings of the IoT device.
Provided are a method and system for enhanced control of Internet of Things (IoT) devices by a mobile device.
Additional aspects will be set forth in part in the description which follows and, in part, will be apparent from the description, or may be learned by practice of the presented embodiments.
In accordance with an aspect of the disclosure, there is provided a method comprising detecting, by a processor of a mobile device, a plurality of user actionable buttons present in a quick-setting menu of the mobile device; detecting, by the processor, one or more Internet of Things (IoT) devices within a pre-defined proximity of the mobile device; and mapping, by the processor, a plurality of operation control parameters of each of the one or more IoT devices that are detected with one or more user actionable buttons of the plurality of user actionable buttons present in the quick setting menu of the mobile device to allow control, through the quick-setting menu, of the one or more IoT devices by the one or more user actionable buttons.
In accordance with another aspect of the disclosure, there is provided a system comprising an ultra wide-band (UWB) sensor configured to detect one or more IoT devices within a pre-defined range of a mobile device, and a processor communicatively coupled to the UWB sensor. The processor is configured to identify one or more operation control parameters of each IoT device of the one or more IoT devices that are detected by the UWB sensor; identify user actionable buttons in a quick setting menu of the mobile device; and map the one or more operation control parameters of the one or more IoT devices that are detected by the UWB sensor onto one or more user actionable buttons of the user actionable buttons in the quick setting menu to allow user access of the one or more IoT devices from the quick setting menu.
In accordance with another aspect of the disclosure, there is provided a method comprising detecting, by a processor of an ultra wide-band (UWB) based mobile device, a selection of a quick setting control on the UWB based mobile device while the UWB based mobile device is pointed toward at least one Internet of Things (IoT) device in an IoT environment; determining, by the processor, at least one operational state for the at least one IoT device, the at least one operational state being linked with at least one functionality of the quick setting control that is selected; and modifying, by the processor, a current state of the at least one IoT device to the at least one operational state that is determined
The above and other aspects, features, and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:
As discussed above, in the related art, there are many steps required to change the settings in an IoT device. For example, to change a particular setting of the IOT device, either a plugin of the IOT device needs to opened through a dedicated application or a third party software application is needed to change the settings of the IOT device. Regardless, five or more steps (e.g., taps) are typically required to access and change a given setting.
Take, for example, an operation to change a setting to bring the IoT Device to a state of Disconnected Connectivity (e.g., Flight Mode), for example in a situation in which guests are visiting and an owner of the Smart-Home IoT device wants the Smart-Home IoT device to act as a simple device. There are a lot of process steps involved, as illustrated in
Step 1: IoT Device (e.g., TV) connected to Wi-Fi, connected to Bluetooth, connected to an IoT Cloud.
Step 2: Guest Arrives. User Want Television to behave as a Normal TV without Connectivity.
Step 3: Select settings (e.g., upper right corner) in SmartThings app.
Step 4: Select change device Wi-Fi network option in settings.
Step 5: Select Device.
Step 6: IoT Device (e.g., TV) disconnected from Wi-Fi, disconnected from Bluetooth, disconnected from IoT Cloud.
Accordingly, the related art provides a device control method that is applied to a mobile terminal by which a user will be able to control the device using an external application. The related art thus mandates that for every device a separate application will be opened for controlling.
In accordance with various embodiments, there is provided a method of enhanced Smart Home control in an IoT environment. The method comprises detecting a plurality of user actionable buttons present in a quick-setting menu of a mobile device, detecting one or more IoT devices within a pre-defined proximity of the mobile device and mapping a plurality of operation control parameters of each of the detected IoT devices with one or more user actionable buttons within the quick-setting menu of the mobile device for allowing user-access of the IoT devices through the actionable buttons in the quick-setting menu.
In accordance with various embodiments, there is also provided a method for Smart Home control using a ultra-wideband (UWB) based mobile device. The method comprises detecting user selection of a quick setting control on the UWB based mobile device while pointing the mobile device toward at least one IoT device in an IoT environment, determining at least one operational state for the at least one IoT device linked with at least one functionality of the selected quick-setting control, and modifying the current state of IoT device to the determined at least one operational state of the IoT device.
In the description that follows to the extent possible like reference numerals have been used to represent like elements in the drawings. Further, those of ordinary skill in the art will appreciate that elements in the drawings are illustrated for simplicity and may not have been necessarily drawn to scale. For example, the dimensions of some of the elements in the drawings may be exaggerated relative to other elements to help to improve understanding of various aspects of the embodiments. Furthermore, one or more elements may have been represented in the drawings by conventional symbols, and the drawings may show only those specific details that are pertinent to understanding the embodiments so as not to obscure the drawings with details that will be readily apparent to those of ordinary skill in the art having the benefits of the description herein.
Reference will now be made to various embodiments illustrated in the drawings and specific language will be used to describe the same. It will nevertheless be understood that no limitation of the scope of the present disclosure is thereby intended, such alterations and further modifications in the illustrated system, and such further applications of the principles of the present disclosure as illustrated therein being contemplated as would normally occur to one skilled in the art to which the present disclosure relates.
It will be understood by those skilled in the art that the foregoing general description and the following detailed description are exemplary and explanatory of the present disclosure and are not intended to be restrictive thereof. Throughout the patent specification, a convention employed is that in the appended drawings, like numerals denote like components.
Reference throughout this specification to “an embodiment”, “another embodiment” or similar language means that a particular feature, structure, or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Thus, the appearances of the phrase “in an embodiment”, “in another embodiment” and similar language throughout this specification may, but do not necessarily, all refer to the same embodiment.
Various embodiments will be described below in detail with reference to the accompanying drawings.
Further, the method comprises detecting one or more IoT devices within a pre-defined proximity of the mobile device (step 104). The capability of the detected IoT devices in the predefined proximity is extracted, especially in a case in which the capability information of the detected IoT device is absent within the built-in storage of the mobile device. Accordingly, the built-in storage is updated with the extracted capability information. Similar capabilities of multiple IoT devices out of the extracted capabilities are correlated through a capability co-relator module.
The method further comprises mapping a plurality of operation control parameters of each of the detected IoT devices with one or more user actionable buttons within the quick-setting menu of the mobile device (step 106). The mapping allows user-access of the IoT devices through the actionable buttons in the quick-setting menu. Using a UWB sensor in the mobile device, the one or more IoT devices within the predefined proximity of the mobile device are detected. Such devices are pointed at by the user through the mobile device. That is, the user points the mobile device at each of the IoT devices within the pre-define proximity of the mobile device. Thereafter, one or more user actionable buttons are reconfigured in the quick setting menu of the mobile device as at least one control button for operating upon the detected IoT devices within the predefined proximity of the mobile device. The reconfiguring comprises mapping the operation control parameters of the detected IoT devices in the predetermined proximity with one or more user actionable buttons within the quick control menu of the mobile device for allowing user-access of the IoT devices through the actionable buttons in the quick control menu. The mapping corresponds to an intuitive mapping for mapping the actionable buttons with the device capabilities.
In some embodiments, the method may further comprise displaying a virtual layout display on the mobile device to render designated quick setting menu items acting as the actionable buttons, wherein such virtual layout display may be a reusage of an existing user interface (UI) correspond to the quick setting menu. It is noted that in some embodiments, the displaying the virtual layout display may be omitted.
In some embodiments, the method may further comprise enabling control of a selected IoT device from the quick control menu when the mobile device is pointed towards the selected IoT device. The control may be enabled based on the steps of determining an inclination between an axis of a UWB transmitter of the mobile device and a reflected signal from the IoT device. The determined inclination may be used for determining the IoT device directed at by the mobile device. Thereafter, the action command may be parsed from the mobile device for converting into a device action resource identifier (URI) of the determined IoT device for, in turn, controlling the determined IoT device. It is noted that in some embodiments, the enabling the control of the selected IoT device may be omitted.
Accordingly to yet another embodiment, the method is provided for smart home control using a UWB based mobile device.
As described above with reference to
Step 302 illustrates raw data collection. Using the UWB data from the mobile phone (e.g., a smart phone), all the UWB enabled IoT devices within the UWB range are sent to a device identifier module (described later) and a Device Data Abstraction Module 308. In the example illustrated in
Step 304 illustrates the device data abstraction module 308 fetching the device data from the IoT cloud and updating the Storage module 310 periodically so that pre-computation may be done for devices which are within the range of the mobile device and the in range device data tables may be updated. Identification of device data from the IoT cloud may be done using Serial Numbers (S/Ns) in the form of device and device type of devices in range.
Step 306 illustrates the storage module 310. A data translated to representational form by Device Data Abstraction module 308 acts as input to the storage module 310. Storage module 310 is used by other modules to get access to data and perform actions as and when requested. The storage module 310 coordinates the data flow between the sample data tables provided as follows.
A “Within Range data table” (i.e., In Range Devices database) stores data related to devices which are within range. Such table is generated dynamically in the background. The below example represents an example of the “Within Range data table” at an instance of time.
A “Phone Controller data table” (i.e., Phone Controller database) stores all the possible quick panel action items of the Quick Panel & various phone configurations of the mobile device. For example, in the example illustrated in
At step 502, a Capability extractor Module 510 checks if capability already exists in Device Capability Table or not (as accessed from in the storage module 310). The Capability extractor Module 510 checks the device capability database for cache data and extracts and updates the capability of a device in database. The capability extractor module 510 accordingly extracts the capabilities of all the identified in-range devices (e.g., TV has Wi-Fi, Power, Light has Power, Brightness). In other words, the Capability extractor Module 510 obtains the information in the in-range database. A device capability Table gets updated with new data. The Capability extractor Module 510 also checks whether a single device or multiple devices have been identified. In case of multiple devices, the capabilities result is forwarded to a Capability Co-relator Module 512.
At step 504, the capability co-relator module 512 identifies the intersection between devices having various capabilities and maps the capabilities with the devices. (e.g., Power—TV, Light, Wi-Fi—AC, TV). More specifically, the Capability Co-relator Module 512 finds capabilities according to:
where n is the number of devices in range.
At step 506, the correlated capabilities from step 504 are stored in a device combination mapper table.
At step 508, an integrator module or mapping module 514 takes the input (i.e., phone controller table) from the phone controller database and integrates the phone controller table with the capability-device mapping from step 506, such that potential quick panel items will be filtered on which action can be taken for the scanned devices. The results are stored in Mobile Quick panel icon Capability table.
As illustrated in
An intuitive mapper module 604 maps the icons to device-capabilities in an intuitive fashion based on the output of a Generic Function Modulator. For example, in scenarios controlling a Bulb, the Flashlight Capability is not the same as Bulb-Switch On/Off. In those cases, a generic-function modulator generates that Flashlight has On/Off functionality corresponding to a generic light. Such intuitive mapping plus one-to-one mapping can help in covering more icons in the quick panel. The intuitive mapper module 604 is however not used if every capability of device matches 1:1 with the mapper module. The intuitive mapper is however used, for example, in cases where some capabilities of a device (like TV Power, KIDS Mode) are not mapped directly to Main functionality on Quick Panel and may get missed.
As indicated in
The capability processor of
An Icon Processor is used to extract the generic function from the quick panel icon. For example, an icon of sound is related to a capability of sound (see, e.g.,
At step 902, a Device Identifier module 908 uses UWB data and filters only IoT devices to which the mobile device is pointing towards. The IoT devices the mobile device is pointing towards may be determined based on the directional capability of the UWB such that the mobile device discards all the devices towards which the mobile device is not pointed but that were scanned as within the range. Once the device (or) group of devices is successfully elicited, the control flows to a Virtual Layout Aggregator.
At step 904, a virtual layout aggregator 910 creates a virtual layout for display to the user where only available quick panel items will be enabled and the rest will be disabled based on data stored in the icon capability table. The virtual layout aggregator 910 uses the Icon Capability Table which is updated in the Integrator Module/Mapping module 514 in the background. In an example, C_03_Icon Table as shown in
At step 906, an action identifier module 912 parses the user action command and converts the user action command into a device action resource URI. The device action resource URI is published on the relevant devices based on the capability—device mapping result from the capability co-relator module 512 and success/failure notification will be sent to the mobile device based on the result of the action.
In
In
In a networked deployment, the computer system 2500 may operate in the capacity of a server or as a client user computer in a server-client user network environment, or as a peer computer system in a peer-to-peer (or distributed) network environment. The computer system 2500 may also be implemented as or incorporated across various devices, such as a personal computer (PC), a tablet PC, a personal digital assistant (PDA), a mobile device, a palmtop computer, a laptop computer, a desktop computer, a communications device, a wireless telephone, a land-line telephone, a web appliance, a network router, switch or bridge, or any other machine capable of executing a set of instructions (sequential or otherwise) that specify actions to be taken by that machine. Further, while a single computer system 2500 is illustrated, the term “system” shall also be taken to include any collection of systems or sub-systems that individually or jointly execute a set, or multiple sets, of instructions to perform one or more computer functions.
The computer system 2500 may include a processor 2502 (e.g., a central processing unit (CPU), a graphics processing unit (GPU), or both). The processor 2502 may be a component in a variety of systems. For example, the processor 2502 may be part of a personal computer or a workstation. The processor 2502 may be one or more processors, digital signal processors, application-specific integrated circuits, field-programmable gate arrays, servers, networks, digital circuits, analog circuits, combinations thereof, or other now known or later developed devices for analyzing and processing data. The processor 2502 may implement a software program, such as code generated manually (i.e., programmed).
The computer system 2500 may include a memory 2504, such as a memory 2504 that may communicate and be accessed via a bus 2508. The memory 2504 may include, but is not limited to, computer-readable storage media such as various types of volatile and non-volatile storage media, including but not limited to random access memory, read-only memory, programmable read-only memory, electrically programmable read-only memory, electrically erasable read-only memory, flash memory, magnetic tape or disk, optical media and the like. In one example, memory 2504 may include a cache or random access memory for the processor 2502. In alternative examples, the memory 2504 may be separate from the processor 2502, such as a cache memory of a processor, the system memory, or other memory. The memory 2504 may be an external storage device or database for storing data. The memory 2504 may be operable to store instructions (or program code) executable by the processor 2502. The functions, acts or tasks illustrated in the figures or described may be performed by the programmed processor 2502 for executing the instructions stored in the memory 2504. The functions, acts or tasks are independent of the particular type of instructions set, storage media, processor or processing strategy and may be performed by software, hardware, integrated circuits, firmware, micro-code and the like, operating alone or in combination. Likewise, processing strategies may include multiprocessing, multitasking, parallel processing and the like.
As shown, the computer system 2500 may or may not further include a display 2510, such as a liquid crystal display (LCD), an organic light-emitting diode (OLED), a flat panel display, a solid-state display, a cathode ray tube (CRT), a projector, a printer or other now known or later developed display device for outputting determined information. The display 2510 may act as an interface for the user to see the functioning of the processor 2502, or specifically as an interface with the software stored in the memory 2504 or the drive 2516.
The computer system 2500 may include a ultra wide band (UWB) sensor. The UWB sensor may sense devices within a threshold proximity of the computer system 2500.
Additionally, the computer system 2500 may include an input device 2512 configured to allow a user to interact with any of the components of system 2500. The computer system 2500 may also include a disk or optical drive 2516. The disk drive 2516 may include a computer-readable medium 2522 in which one or more sets of instructions 2524, e.g. software, can be embedded. Further, the instructions 2524 may embody one or more of the methods or logic as described. In a particular example, the instructions 2524 may reside completely, or at least partially, within the memory 2504 or within the processor 2502 during execution by the computer system 2500.
The present disclosure contemplates a computer-readable medium that includes instructions 2524 or receives and executes instructions 2524 responsive to a propagated signal so that a device connected to a network 2526 may communicate voice, video, audio, images, or any other data over the network 2526. Further, the instructions 2524 may be transmitted or received over the network 2526 via a communication port or interface 2520 or using a bus 2508. The communication port or interface 2520 may be a part of the processor 2502 or maybe a separate component. The communication port 2520 may be created in software or maybe a physical connection in hardware. The communication port 2520 may be configured to connect with a network 2526, external media, the display 2510, or any other components in system 2500, or combinations thereof. The connection with the network 2526 may be a physical connection, such as a wired Ethernet connection or may be established wirelessly as discussed later. Likewise, the additional connections with other components of the system 2500 may be physical or may be established wirelessly. The network 2526 may alternatively be directly connected to the bus 2508.
The network 2526 may include wired networks, wireless networks, Ethernet AVB networks, or combinations thereof. The wireless network may be a cellular telephone network, an 802.11, 802.16, 802.20, 802.1Q or WiMax network. Further, the network 826 may be a public network, such as the Internet, a private network, such as an intranet, or combinations thereof, and may utilize a variety of networking protocols now available or later developed including, but not limited to TCP/IP based networking protocols. The system is not limited to operation with any particular standards and protocols. For example, standards for Internet and other packet-switched network transmissions (e.g., TCP/IP, UDP/IP, HTML, and HTTP) may be used.
The present disclosure provides an intelligent intuitive way of Contextual Mapping & Association of IoT Device Services to a User Mobile Panel. In an IoT environment, the present disclosure provides detecting a selection of a quick setting control panel and based on the selection changing the state of an IoT device which changing is analogous to actions normally taken on a mobile device. In an IoT environment, based on the mobile device pointing at multiple devices, the present disclosure provides detecting a selection of a quick setting control panel and taking a joint action on the IoT devices which is analogous to actions normally taken on a mobile device.
Quick Panel Controls are designed to control commonly used settings/controls using one TAP access which is a common feature across all mobile devices compared to 3-4 steps required to control any common used capability (Wifi Change, DND Mode, Power Saving Mode) from any IoT app.
While specific language has been used to describe the various embodiments, any limitations arising on account of the same are not intended. As would be apparent to a person in the art, various working modifications may be made to the embodiments as taught herein.
The drawings and the forgoing description give examples of embodiments. Those skilled in the art will appreciate that one or more of the described elements may well be combined into a single functional element. Alternatively, certain elements may be split into multiple functional elements. Elements from one embodiment may be added to another embodiment. For example, orders of processes described herein may be changed and are not limited to the manner described herein.
Moreover, the actions of any flow diagram need not be implemented in the order shown; nor do all of the acts necessarily need to be performed. Also, those acts that are not dependent on other acts may be performed in parallel with the other acts. The scope of embodiments is by no means limited by these specific examples. Numerous variations, whether explicitly given in the specification or not, such as differences in structure, dimension, and use of material, are possible. The scope of embodiments is at least as broad as given by the following claims.
Benefits, other advantages, and solutions to problems have been described above with regard to specific embodiments. However, the benefits, advantages, solutions to the problem and any component(s) that may cause any benefit, advantage, or solution to occur or become more pronounced are not to be construed as a critical, required, or essential feature or component of any or all the claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202141040783 | Sep 2021 | IN | national |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/KR2022/007411 | May 2022 | US |
| Child | 17858597 | US |
