The subject matter of the present disclosure refers generally to a system and method for managing home appliances in the homeplace via a computing device, display, and machine learning technique.
Smart home appliances have become increasingly prevalent in modern households, offering convenience, energy efficiency, and enhanced functionality. These devices, ranging from smart thermostats and refrigerators to connected washing machines and ovens, are designed to simplify daily tasks and improve overall home management. Many smart appliances can be controlled remotely via smartphone apps, allowing users to monitor and adjust settings from anywhere. Despite their advantages, current smart home appliance systems often suffer from several limitations. One significant drawback is the lack of seamless integration between different brands and types of appliances. Users frequently find themselves juggling multiple apps and interfaces to control various devices, leading to a fragmented and frustrating experience. Additionally, while individual appliances may collect data on their usage and performance, this information is typically siloed within each device's ecosystem, preventing users from gaining comprehensive insights into their home's overall efficiency and patterns of use.
Another challenge faced by existing smart home systems is the limited ability to learn from user behavior and adapt to changing needs. Most appliances operate based on pre-programmed settings or manual adjustments, failing to leverage the potential of advanced analytics to optimize performance and energy consumption. This lack of intelligent adaptation means that users may not be realizing the full benefits of their smart appliances in terms of convenience and efficiency. Furthermore, current systems often fall short in providing proactive maintenance recommendations and predicting potential issues before they occur. Users are typically left to react to appliance malfunctions or inefficiencies, rather than being able to address problems preemptively. This reactive approach can lead to increased downtime, higher repair costs, and unnecessary inconvenience for homeowners.
Accordingly, there is a need in the art for a system and method that links multiple smart appliances, tracks their performance, and analyzes their data using machine learning techniques
A system and method for managing home appliances using machine learning techniques is provided. In one aspect, the present invention is a system linking one or more smart appliances into a cohesive network. In another aspect, the present invention is a system for displaying data relating to appliances on a display or plurality of displays. In still another aspect, the present invention is a method of managing a plurality of display windows showing content relating to appliances. In yet another aspect, the present invention is a method of applying machine learning techniques to manage and analyze smart home data. Generally, the present invention addresses the need for a system and method to collect, analyze, and display smart appliance data using artificial intelligence.
The system comprises a computing device with a user interface, one or more home appliances, a display operably connected to the computing device and home appliances, a processor operably connected to the computing device, and a non-transitory computer-readable medium coupled to the processor with instructions stored thereon. The home appliances linked by this system further comprise at least one sensor that is configured to transmit data about the appliance to the control board. The system allows users to manage appliances of a premises via the display and computing device. Users can access and control various appliance functions through a unified interface, which may present data in multiple display windows. The system collects and analyzes data from connected smart appliances, including usage patterns, performance metrics, and environmental data.
Machine learning techniques may be employed to optimize appliance performance, predict maintenance needs, and provide personalized recommendations. For appliance performance optimization, the system may analyze usage patterns, energy consumption, and operational data to fine-tune settings for maximum efficiency. This could involve adjusting refrigerator temperatures based on usage habits, optimizing washing machine cycles for different types of loads, or modifying HVAC operations to balance comfort and energy savings. Predictive maintenance is another key feature enabled by machine learning. By analyzing historical performance data, error codes, and usage patterns, the system can anticipate when an appliance is likely to require maintenance or is at risk of failure. This proactive approach can help prevent unexpected breakdowns, extend appliance lifespans, and schedule maintenance at convenient times for the user.
Personalized recommendations extend beyond basic suggestions. The system may learn user preferences over time and combine this knowledge with external data sources to provide highly tailored advice. For example, it might suggest energy-saving measures based on local utility rates and weather forecasts or recommend specific appliance settings based on a user's daily routines. The application of artificial intelligence to control display layouts and organize windows improves the system's ability to adapt its user interface dynamically. Similarly, the ability to predict appliance failures goes beyond simple maintenance scheduling. By analyzing subtle changes in performance metrics, power consumption, or even sounds produced by appliances, the system can potentially identify impending failures before they occur, allowing for preemptive repairs or replacements.
The invention incorporates advanced security features, including multi-factor authentication and permission-based access control. It may utilize various input methods, including voice commands and gesture controls, and can integrate with multiple types of displays. By centralizing data collection and analysis, the system offers comprehensive insights into home efficiency and usage patterns. This allows users to make informed decisions about appliance use and energy consumption, potentially leading to cost savings and improved home management. These capabilities extend beyond basic smart home functions, offering potential applications in commercial settings such as restaurants, school cafeterias, and community kitchens. It may also assist in inventory management, meal planning, and long-term resource allocation in these contexts.
The foregoing summary has outlined some features of the system and method of the present disclosure so that those skilled in the pertinent art may better understand the detailed description that follows. Additional features that form the subject of the claims will be described hereinafter. Those skilled in the pertinent art should appreciate that they can readily utilize these features for designing or modifying other structures for carrying out the same purpose of the system and method disclosed herein. Those skilled in the pertinent art should also realize that such equivalent designs or modifications do not depart from the scope of the system and method of the present disclosure.
These and other features, aspects, and advantages of the present disclosure will become better understood with regard to the following description, appended claims, and accompanying drawings where:
In the Summary above and in this Detailed Description, and the claims below, and in the accompanying drawings, reference is made to particular features, including method steps, of the invention. It is to be understood that the disclosure of the invention in this specification includes all possible combinations of such particular features. For instance, where a particular feature is disclosed in the context of a particular aspect or embodiment of the invention, or a particular claim, that feature can also be used, to the extent possible, in combination with/or in the context of other particular aspects of the embodiments of the invention, and in the invention generally.
The term “comprises”, and grammatical equivalents thereof are used herein to mean that other components, steps, etc. are optionally present. For instance, a system “comprising” components A, B, and C can contain only components A, B, and C, or can contain not only components A, B, and C, but also one or more other components. Where reference is made herein to a method comprising two or more defined steps, the defined steps can be carried out in any order or simultaneously (except where the context excludes that possibility), and the method can include one or more other steps which are carried out before any of the defined steps, between two of the defined steps, or after all the defined steps (except where the context excludes that possibility). As will be evident from the disclosure provided below, the present invention satisfies the need for a system and method for managing home appliances of a homeplace.
As depicted in
Search servers may include one or more computing entities 200 designed to implement a search engine, such as a documents/records search engine, general webpage search engine, etc. Search servers may, for instance, include one or more web servers designed to receive search queries and/or inputs from users 405, search one or more databases 115 in response to the search queries and/or inputs, and provide documents or information, relevant to the search queries and/or inputs, to users 405. In some implementations, search servers may include a web search server that may provide webpages to users 405, wherein a provided webpage may include a reference to a web server at which the desired information and/or links are located. The references to the web server at which the desired information is located may be included in a frame and/or text box, or as a link to the desired information/document. Document indexing servers may include one or more devices designed to index documents available through networks 150. Document indexing servers may access other servers 110, such as web servers that host content, to index the content. In some implementations, document indexing servers may index documents/records stored by other servers 110 connected to the network 150. Document indexing servers may, for instance, store and index content, information, and documents relating to user accounts and user-generated content. Web servers may include servers 110 that provide webpages to clients 105. For instance, the webpages may be HTML-based webpages. A web server may host one or more websites. As used herein, a website may refer to a collection of related webpages. Frequently, a website may be associated with a single domain name, although some websites may potentially encompass more than one domain name. The concepts described herein may be applied on a per-website basis. Alternatively, in some implementations, the concepts described herein may be applied on a per-webpage basis.
As used herein, a database 115 refers to a set of related data and the way it is organized. Access to this data is usually provided by a database management system (DBMS) consisting of an integrated set of computer software that allows users 405 to interact with one or more databases 115 and provides access to all of the data contained in the database 115. The DBMS provides various functions that allow entry, storage and retrieval of large quantities of information and provides ways to manage how that information is organized. Because of the close relationship between the database 115 and the DBMS, as used herein, the term database 115 refers to both a database 115 and DBMS.
The bus 210 may comprise a high-speed interface 308 and/or a low-speed interface 312 that connects the various components together in a way such they may communicate with one another. A high-speed interface 308 manages bandwidth-intensive operations for computing device 300, while a low-speed interface 312 manages lower bandwidth-intensive operations. In some preferred embodiments, the high-speed interface 308 of a bus 210 may be coupled to the memory 304, display 316, and to high-speed expansion ports 310, which may accept various expansion cards such as a graphics processing unit (GPU). In other preferred embodiments, the low-speed interface 312 of a bus 210 may be coupled to a storage device 250 and low-speed expansion ports 314. The low-speed expansion ports 314 may include various communication ports, such as USB, Bluetooth, Ethernet, wireless Ethernet, etc. Additionally, the low-speed expansion ports 314 may be coupled to one or more peripheral devices 270, such as a keyboard, pointing device, scanner, and/or a networking device, wherein the low-speed expansion ports 314 facilitate the transfer of input data from the peripheral devices 270 to the processor 220 via the low-speed interface 312.
The processor 220 may comprise any type of conventional processor or microprocessor that interprets and executes computer readable instructions. The processor 220 is configured to perform the operations disclosed herein based on instructions stored within the system 400. The processor 220 may process instructions for execution within the computing entity 200, including instructions stored in memory 304 or on a storage device 250, to display graphical information for a graphical user interface (GUI) on an external peripheral device 270, such as a display 316. The processor 220 may provide for coordination of the other components of a computing entity 200, such as control of user interfaces 411, 511, 711, applications run by a computing entity 200, and wireless communication by a communication interface 280 of the computing entity 200. The processor 220 may be any processor or microprocessor suitable for executing instructions. In some embodiments, the processor 220 may have a memory device therein or coupled thereto suitable for storing the data, content, or other information or material disclosed herein. In some instances, the processor 220 may be a component of a larger computing entity 200. A computing entity 200 that may house the processor 220 therein may include, but are not limited to, laptops, desktops, workstations, personal digital assistants, servers 110, mainframes, cellular telephones, tablet computers, smart televisions, streaming devices, or any other similar device. Accordingly, the inventive subject matter disclosed herein, in full or in part, may be implemented or utilized in devices including, but are not limited to, laptops, desktops, workstations, personal digital assistants, servers 110, mainframes, cellular telephones, tablet computers, smart televisions, streaming devices, or any other similar device.
Memory 304 stores information within the computing device 300. In some preferred embodiments, memory 304 may include one or more volatile memory units. In another preferred embodiment, memory 304 may include one or more non-volatile memory units. Memory 304 may also include another form of computer-readable medium, such as a magnetic, solid state, or optical disk. For instance, a portion of a magnetic hard drive may be partitioned as a dynamic scratch space to allow for temporary storage of information that may be used by the processor 220 when faster types of memory, such as random-access memory (RAM), are in high demand. A computer-readable medium may refer to a non-transitory computer-readable memory device. A memory device may refer to storage space within a single storage device 250 or spread across multiple storage devices 250. The memory 304 may comprise main memory 230 and/or read only memory (ROM) 240. In a preferred embodiment, the main memory 230 may comprise RAM or another type of dynamic storage device 250 that stores information and instructions for execution by the processor 220. ROM 240 may comprise a conventional ROM device or another type of static storage device 250 that stores static information and instructions for use by processor 220. The storage device 250 may comprise a magnetic and/or optical recording medium and its corresponding drive.
As mentioned earlier, a peripheral device 270 is a device that facilitates communication between a user 405 and the processor 220. The peripheral device 270 may include, but is not limited to, an input device and/or an output device. As used herein, an input device may be defined as a device that allows a user 405 to input data and instructions that is then converted into a pattern of electrical signals in binary code that are comprehensible to a computing entity 200. An input device of the peripheral device 270 may include one or more conventional devices that permit a user 405 to input information into the computing entity 200, such as a controller, scanner, phone, camera, scanning device, keyboard, a mouse, a pen, voice recognition and/or biometric mechanisms, etc. As used herein, an output device may be defined as a device that translates the electronic signals received from a computing entity 200 into a form intelligible to the user 405. An output device of the peripheral device 270 may include one or more conventional devices that output information to a user 405, including a display 316, a printer, a speaker, an alarm, a projector, etc. Additionally, storage devices 250, such as CD-ROM drives, and other computing entities 200 may act as a peripheral device 270 that may act independently from the operably connected computing entity 200. For instance, a streaming device may transfer data to a smartphone, wherein the smartphone may use that data in a manner separate from the streaming device.
The storage device 250 is capable of providing the computing entity 200 mass storage. In some embodiments, the storage device 250 may comprise a computer-readable medium such as the memory 304, storage device 250, or memory 304 on the processor 220. A computer-readable medium may be defined as one or more physical or logical memory devices and/or carrier waves. Devices that may act as a computer readable medium include, but are not limited to, a hard disk device, optical disk device, tape device, flash memory or other similar solid-state memory device, or an array of devices, including devices in a storage area network or other configurations. Examples of computer-readable mediums include, but are not limited to, magnetic media such as hard disks, floppy disks, and magnetic tape; optical media such as CD ROM discs and DVDs; magneto-optical media such as optical discs; and hardware devices that are specially configured to store and perform programming instructions, such as ROM 240, RAM, flash memory, and the like.
In an embodiment, a computer program may be tangibly embodied in the storage device 250. The computer program may contain instructions that, when executed by the processor 220, performs one or more steps that comprise a method, such as those methods described herein. The instructions within a computer program may be carried to the processor 220 via the bus 210. Alternatively, the computer program may be carried to a computer-readable medium, wherein the information may then be accessed from the computer-readable medium by the processor 220 via the bus 210 as needed. In a preferred embodiment, the software instructions may be read into memory 304 from another computer-readable medium, such as data storage device 250, or from another device via the communication interface 280. Alternatively, hardwired circuitry may be used in place of or in combination with software instructions to implement processes consistent with the principles as described herein. Thus, implementations consistent with the invention as described herein are not limited to any specific combination of hardware circuitry and software.
In the embodiment depicted in
A mobile computing device 350 may include a processor 220, memory 304 a peripheral device 270 (such as a display 316, a communication interface 280, and a transceiver 368, among other components). A mobile computing device 350 may also be provided with a storage device 250, such as a micro-drive or other previously mentioned storage device 250, to provide additional storage. Preferably, each of the components of the mobile computing device 350 are interconnected using a bus 210, which may allow several of the components of the mobile computing device 350 to be mounted on a common motherboard as depicted in
The processor 220 may execute instructions within the mobile computing device 350, including instructions stored in the memory 304 and/or storage device 250. The processor 220 may be implemented as a chipset of chips that may include separate and multiple analog and/or digital processors. The processor 220 may provide for coordination of the other components of the mobile computing device 350, such as control of the user interfaces 411, 511, 711, applications run by the mobile computing device 350, and wireless communication by the mobile computing device 350. The processor 220 of the mobile computing device 350 may communicate with a user 405 through the control interface 358 coupled to a peripheral device 270 and the display interface 356 coupled to a display 316. The display 316 of the mobile computing device 350 may include, but is not limited to, Liquid Crystal Display (LCD), Light Emitting Diode (LED) display, Organic Light Emitting Diode (OLED) display, and Plasma Display Panel (PDP), holographic displays, augmented reality displays, virtual reality displays, or any combination thereof. The display interface 356 may include appropriate circuitry for causing the display 316 to present graphical and other information to a user 405. The control interface 358 may receive commands from a user 405 via a peripheral device 270 and convert the commands into a computer readable signal for the processor 220. In addition, an external interface 362 may be provided in communication with processor 220, which may enable near area communication of the mobile computing device 350 with other devices. The external interface 362 may provide for wired communications in some implementations or wireless communication in other implementations. In a preferred embodiment, multiple interfaces may be used in a single mobile computing device 350 as is depicted in
Memory 304 stores information within the mobile computing device 350. Devices that may act as memory 304 for the mobile computing device 350 include, but are not limited to computer-readable media, volatile memory, and non-volatile memory. Expansion memory 374 may also be provided and connected to the mobile computing device 350 through an expansion interface 372, which may include a Single In-Line Memory Module (SIM) card interface or micro secure digital (Micro-SD) card interface. Expansion memory 374 may include, but is not limited to, various types of flash memory and non-volatile random-access memory (NVRAM). Such expansion memory 374 may provide extra storage space for the mobile computing device 350. In addition, expansion memory 374 may store computer programs or other information that may be used by the mobile computing device 350. For instance, expansion memory 374 may have instructions stored thereon that, when carried out by the processor 220, cause the mobile computing device 350 perform the methods described herein. Further, expansion memory 374 may have secure information stored thereon; therefore, expansion memory 374 may be provided as a security module for a mobile computing device 350, wherein the security module may be programmed with instructions that permit secure use of a mobile computing device 350. In addition, expansion memory 374 having secure applications and secure information stored thereon may allow a user 405 to place identifying information on the expansion memory 374 via the mobile computing device 350 in a non-hackable manner.
A mobile computing device 350 may communicate wirelessly through the communication interface 280, which may include digital signal processing circuitry where necessary. The communication interface 280 may provide for communications under various modes or protocols, including, but not limited to, Global System Mobile Communication (GSM), Short Message Services (SMS), Enterprise Messaging System (EMS), Multimedia Messaging Service (MMS), Code Division Multiple Access (CDMA), Time Division Multiple Access (TDMA), Personal Digital Cellular (PDC), Wideband Code Division Multiple Access (WCDMA), IMT Multi-Carrier (CDMAX 0), and General Packet Radio Service (GPRS), or any combination thereof. Such communication may occur, for example, through a transceiver 368. Short-range communication may occur, such as using a Bluetooth, WIFI, or other such transceiver 368. In addition, a Global Positioning System (GPS) receiver module 370 may provide additional navigation- and location-related wireless data to the mobile computing device 350, which may be used as appropriate by applications running on the mobile computing device 350. Alternatively, the mobile computing device 350 may communicate audibly using an audio codec 360, which may receive spoken information from a user 405 and covert the received spoken information into a digital form that may be processed by the processor 220. The audio codec 360 may likewise generate audible sound for a user 405, such as through a speaker, e.g., in a handset of mobile computing device 350. Such sound may include sound from voice telephone calls, recorded sound such as voice messages, music files, etc. Sound may also include sound generated by applications operating on the mobile computing device 350.
The system 400 may comprise a power supply, which may be any source of power that provides the system 400 with the required energy. In a preferred embodiment, the power supply may be a stationary power source that has been installed in a way such that it is fastened in place, such as a 3-prong wall outlet. In a preferred embodiment, the stationary power source is connected to the wiring system of a premises. In another preferred embodiment, the power supply may be a mobile power source, such as a battery pack. In a preferred embodiment, mobile power source does not need to be connected to the wiring system of a premises to provide power to the system but may be capable of connecting to the wiring system of said premises to provide power to a system connected thereto. In another preferred embodiment, the system 400 may comprise multiple power supplies configured to supply power to the system 400 in different circumstances. For instance, the system 400 may be directly plugged into a stationary power source, which may provide power to the system 400 so long as the system does not move out of range of said stationary power source, as well as connected to a mobile power source, which may provide power to the system 400 when the system 400 is not connected to a stationary power source or in situations where the stationary power source ceases to provide power to the system 400.
The system 400 may comprise a power supply, which may be any source of power that provides the system 400 with the required energy. In a preferred embodiment, the power supply may be a stationary power source that has been installed in a way such that it is fastened in place, such as a 3-prong wall outlet. In a preferred embodiment, the stationary power source is connected to the wiring system of a premises, such as a house or a building. In another preferred embodiment, the power supply may be a mobile power source, such as a battery pack, gas-powered generator, and fuel cell. In a preferred embodiment, the mobile power source does not need to be connected to the wiring system of a premises to provide power to the system but may be capable of connecting to the wiring system of said premises to provide power to a system connected thereto. In another preferred embodiment, the system 400 may comprise multiple power supplies configured to supply power to the system 400 in different circumstances. For instance, the system 400 may be directly plugged into a stationary power source, which may provide power to the system 400 so long as the system does not move out of range of said stationary power source, as well as connected to a mobile power source, which may provide power to the system 400 when the system 400 is not connected to a stationary power source or in situations where the stationary power source ceases to provide power to the system 400. In yet another preferred embodiment, a plurality of solar charging panels may be operably connected to a battery of the system, which may then supply power to the system either directly or via the wiring of the premises. As such, the system 400 may be configured to receive power in a variety of ways without departing from the inventive subject matter described herein.
The system 400 generally comprises a computing device 410 having a user interface 411, one or more home appliances 407, display operably connected to said computing device and said home appliances 407, processor 220 operably connected to said computing device, home appliance 407, and display, and non-transitory computer-readable medium (CRM) 416 coupled to said processor 220 and having instructions stored thereon. Some preferred embodiments, the system may further comprise a camera 905 operably connected to computing devices 410, displays 316, home appliances 407, and/or secondary security devices, wherein said camera is configured to collect image data that may be used in the various manners as described herein. In one preferred embodiment, a database 115 may be operably connected to the processor 220, and the various data of the system 400 may be stored therein, including, but not limited to, user data 430A, image data 430B, application data 430C, and appliance data 430D. In some preferred embodiments, the displays 316 may further comprise a display user interface 316A having a plurality of display windows 417 configured to present the various data of the system 400 therein, wherein control boards 409 of the displays 316 may be configured to receive the various data of the system and arrange the plurality of display windows 417 within the display user interface. In yet another preferred embodiment, a wireless communication interface may allow the processors 220 of the system 400 to receive and transmit the various data of the system therebetween.
Though some embodiments may mention a single computing device 410 of a user 405, one with skill in the art will recognize that multiple computing devices 410 of multiple users may be used without departing from the inventive subject matter described herein. Additionally, though some embodiments may refer to a single display, one with skill in the art will recognize that multiple displays may be linked together in a way that creates a “single” display that may be used in a manner not departing from the inventive subject matter described herein. For instance, four OLED televisions may be linked together in way that creates a multi-display that the system may use as a “single” display. Additionally, one with skill in the art will recognize that a plurality of displays may be controlled by a single control board, and the single control board may manage the plurality of display windows 417 about the display user interfaces of the plurality of displays. In yet another preferred embodiment, two or more control boards of two or more displays may be operably connected to one another and manage the plurality of display windows 417 about the display user interfaces of the plurality of displays in collaboration with one another. Accordingly, one with skill in the art will recognize that displays may be used in combination with one or more control boards and one or more computing devices in a number of ways without departing from the inventive subject matter described herein.
Generally, the system is designed to allow users to manage appliances of a premises via a display and computing device operably connected to one another and at least one home appliance 407. Users may operably connect to displays via computing devices and select data and/or applications to be presented within a display user interface of the display. In a preferred embodiment, a user may present application data obtained by home appliances 407 via a display located on the premises or a display not located on the premises, wherein the user may manipulate their computing device to control image data and applications presented within the display windows 417 of the display user interface, wherein the image data and applications may at least partially comprise application data. For instance, a user in the homeplace may use a secondary security means to associate a computing device of the user with a display within the homeplace. The user may then manipulate the user interface of the computing device in a way that causes the display to present image data and/or applications within the display windows 417 of the display user interface as chosen by the user via the user interface.
In a preferred embodiment, a control board 409 of a display 316 receives user data 430A, image data 430B, application data 430C, and/or appliance data 430D from a computing entity 200 and/or one or more home appliances 407. The control board 409 may then present said user data 430A, image data 430B, application data 430C, and/or appliance data 430D via the display 316 in the display user interface 316A. In another preferred embodiment, the display may be configured to receive user data 430A, image data 430B, application data 430C, and/or appliance data 430D via a server and/or database when selected by a user via the user interface of the computing device and/or the display user interface of the display. In a preferred embodiment, the user data 430A, image data 430B, application data 430C, and/or appliance data 430D is streamed/mirrored/transmitted from the computing entity 200, server, and/or database to the control board 409, wherein the control board 409 inserts said streamed/mirrored/transmitted user data 430A, image data 430B, application data 430C, and/or appliance data 430D into the display user interface 316A. In a preferred embodiment, image data is streamed/mirrored from the computing entity 200, server, and/or database to the control board 409. Alternatively, the control board 409 may manipulate the user data 430A, image data 430B, application data 430C, and/or appliance data 430D and/or display windows 417 of the display user interface 316A based on commands received from an input device.
In one preferred embodiment, the display user interface 316A may also comprise a control window, which may provide a user 405 with options to control the layout of the display user interface 316A. For instance, a user 405 may choose a layout that separates the display user interface 316A into multiple windows arranged in a particular way. In some embodiments, the control window may allow a user to alter the size and orientation of a display window of the display user interface. Alternatively, an input device having a plurality of layouts thereon may be used to manipulate the layout of the display user interface 316A. The input device may be connected to the system 400 via a wired or wireless connection. In a preferred embodiment, the input device transmits a computer readable signal containing instructions to the control board 409, which the control board 409 uses to manipulate data presented via the display user interface 316A.
In a preferred embodiment, a user 405 logs into a user profile of the system before accessing the various features of a display, allowing the system to verify the identity of the user. A user interface 411 of a computing device 410 allows a user to input login credentials and/or commands. A processor 220 operably connected to said computing device and said display 316 sends the login credentials and/or commands to a control board of said display via a computer readable signal, wherein said login credentials and/or commands of said computer readable signal allow access to said display should they be associated with a user profile having sufficient permission levels. A user may then manipulate the user interface of the computing device in a way that allows said user to choose various data and/or applications of the system to be presented on the display for review. In some preferred embodiments, a user 405 may be required to use a secondary security method to access a display to present the various data and/or applications of the system. For instance, a user 405 may be required to use a camera of their computing device 410 to scan a predefined pattern, such as a bar code or a QR code, that is presented on a display 316, which may associate that user with a particular display.
In one preferred embodiment, displays of the system may be configured for remote communication. Preferably, a first user uses a secondary security method to link a first computing device to a first display and a second user uses a secondary security method to link a second computing device to a second display. Once connected, the users may select the various data of the system which they would like to be presented within a display window of the displays. For instance, a user may use a secondary security method to associate a display within or not within the homeplace with their computing device and user profile. Home appliance repair services may be logged into a second display of the system, potentially granting access to the various data of the system. When a user manipulates the system to access home appliance repair services, the first display and second display may be configured to operably connect, allowing the user and the home appliance repair services to communicate. In a preferred embodiment, communication is facilitated via a communication window 418. Once connected, home appliance repair services may be allowed to access content of the user profile associated with the user. Additionally, the user may present data within display windows 417 of the display user interface to better inform home appliance repair services as to a reason they have been contacted by the user. For instance, the user may choose an appliance application to be displayed within the display user interface, wherein the appliance application may provide error codes of a malfunctioning home appliance 407. The displays are preferably operably connected to one another in a way such that data presented within the display windows 417 of each display is the same. However, though the same data may be presented within the display windows 417 of operably connected displays, the display windows 417 may or may not be organized in the same manner within the display user interfaces of the displays. In a preferred embodiment, each control board of a display controls how the content is organized within display windows 417 of the display user interface.
Home appliances 407 may be positioned about a premises in a way such that they may assist with the management of a household and transmit appliance data to the processor 220. A home appliance 407 may be defined as an electronic appliance configured to assist with household functions, environmental/energy awareness, failure predictions, and maintenance reminders. Appliance data may be defined as data pertaining to the usage and function of a particular appliance. Household functions may be defined as tasks that are traditionally required to maintain a household, including, but not limited to, cooking, cleaning, and food preservation. For instance, a smart cooking appliance may transmit appliance data pertaining to food prepared therein, including, but not limited to, date, nutrition information, and recipe instructions. For instance, a smart vacuum may transmit appliance data to the processor pertaining to the upkeep of a floor of a premises, including date of operation, time of operation, area vacuumed, or any combination thereof. For instance, a smart refrigerator may transmit appliance data to the processor pertaining to the estimated freshness of consumables stored therein.
Environmental/energy awareness may be defined as knowledge provided by a home appliance 407 to inform a user of environmental impact and/or energy usage of a premises, including, but not limited to, water usage, energy usage, and greenhouse gas emissions. For instance, a heating, ventilation, and air conditioning (HVAC) system may be configured to transmit appliance data to the processor, wherein said appliance data may pertain to the amount of energy used to heat/cool a premises over a period of time. For instance, a water purifying system may be configured to transmit appliance data to the processor, wherein said appliance data may pertain to the amount of water processed at the premises. For instance, a natural gas oven, natural gas stovetop, and natural gas fireplace may transmit appliance data to the processor, wherein said appliance data may pertain to the amount of natural gas consumed over a period of time as well as an estimated amount natural gas and CO2 released into the atmosphere by said home appliances 407. Failure predictions may be defined as a forecast pertaining to the remaining life of an appliance before failure. For instance, a water heater may transmit appliance data to the processor pertaining to estimated failure date, wherein estimated failure date may be based on estimated lifespan, detected function errors, and performance decreases over time. Maintenance reminders may be defined as notices to a user pertaining to scheduled upkeep of a home appliance 407 in order to maintain and preserve the home appliance 407. For instance, a washing machine and/or dryer may transmit appliance data to the processor pertaining to a preconfigured maintenance schedule.
In a preferred embodiment, the system 400 collects appliance data comprising electricity usage from all smart appliances 407 linked via the system 400. In another preferred embodiment, these data regarding electricity usage are analyzed using machine learning techniques to identify patterns of consumption. By utilizing such a function, a user 405 may assess which of their appliances consume unacceptable amounts of electricity and take steps to mitigate the consumption. For instance, if a user 405 finds that most of their smart kitchen appliances consume extensive amounts of electricity even while idle, the user might elect to unplug said appliances or use a smart switch of a circuit board to prevent the flow of electricity into the appliance when not in use and/or during certain periods of time. Alternatively, if small loads of laundry are found to consume more electricity than large loads of laundry to wash the same number of clothing items, the user 405 could adjust their laundry behaviors accordingly. In yet another preferred embodiment, the system 400 might suggest actions to mitigate electricity consumption by home appliances 407 from either a preprogrammed list or a list generated using artificial intelligence.
In still another preferred embodiment, the system 400 is authorized by a user 400 to share data on electricity or water consumption with an external institution. Examples of such an external institution include but are not limited to power companies, water treatment facilities, local governments like townships and cities, state governments, the federal government, homeowners' associations, universities, nonprofit research or charitable institutions, and other groups desiring to track electricity or water consumption. This information could be used to track patterns of power consumption on a population level. The external institution might utilize these data and patterns to craft one or more policies, recommendations, prices, or other action items that influence or attempt to influence electricity or water consumption by users. For instance, a local government experiencing a drought might track water consumption and identify reduced water usage by smart dishwashers compared with washing by hand. Accordingly, the local government might then put forward an initiative to save water by asking residents to use dishwashers over handwashing. Alternatively, a city trying to save power might notice that smart window-mounted air-conditioning units consume less power than central air conditioning in apartments. The city could then put forward a recommendation for residents to use window air-conditioning units in place of an apartment building's central air. By these means, adoption of the system 400 would benefit not merely its users 405 but society at large.
In some preferred embodiments, the system 400 may further comprise a secondary security device. Devices that may act as the secondary security device may include, but are not limited to, biometric devices, key cards, wearables, or any combination thereof. In a preferred embodiment, devices that may act as the biometric devices include but are not limited to contact biometric devices, such as fingerprint scanners and hand geometry scanners, and/or non-contact biometric devices, such as face scanners, iris scanners, retina scanners, palm vein scanners, and voice identification devices. In some embodiments, the secondary security device may be operably connected to the computing device 410 and/or display 316 in a way such that it is in direct communication with the computing device 410 and/or display 316 and no other computing device 410 and/or display 316. For instance, the secondary security device in the form of a facial recognition camera may be securely and directly connected to a control board 409 of the display 316 such that a user 405 must biometrically scan their face prior to the system allowing access to the various data of the system. In some preferred embodiments, biometric data associated with a user is saved in a user profile as user data, which the system uses to verify a user's identity. For instance, secondary security devices may be securely and directly connected to a first computing device and a second computing device in a way such that both a first user of the first computing device and a second user of the second computing device must biometrically scan thumbprints prior to the system allowing the first user and second user to access data and applications of the system in a way that allows said first user and said second user to manage home appliances 407 of a premises.
In a preferred embodiment, key cards and wearables preferably comprise a secure transmitter configured to transmit login credentials to the computing device and/or control board of the display. Wearables having a secure transmitter include clothing and accessories, such as shirts, pants, jackets, belts, shoes, wristbands, watches, glasses, pins, nametags, etc., that have said transmitter attached thereto and/or incorporated therein. The secure transmitter preferably contains login credentials in the form of a unique ID, which may be conveyed to a computing device and/or control board of a display 316 in the form of a computer readable signal. Unique IDs contained within the computer readable signal that has been broadcast by the transmitter may include, but are not limited to, unique identifier codes, social security numbers, personal identification numbers (PINs), etc. For instance, a computer readable signal broadcast by a secondary security device in the form of a wrist band may contain information that will alert the control board of the display 316 that a particular user 405 is within a certain range, which may cause the system 400 to allow a user to access home appliance controls of the system.
Types of devices that may act as the transmitter include, but are not limited, to near field communication (NFC), Bluetooth, infrared (IR), radio-frequency communication (RFC), radio-frequency identification (RFID), and ANT+, or any combination thereof. In an embodiment, transmitters may broadcast signals of more than one type. For instance, a transmitter comprising an IR transmitter and RFID transmitter may broadcast IR signals and RFID signals. Alternatively, a transmitter may broadcast signals of only one type of signal. For instance, identification (ID) cards may be fitted with transmitters that broadcast NFC signals containing unique IDs associated with a particular user, wherein displays equipped with NFC receivers must receive said NFC signals containing unique IDs before access to one or more home appliance features of the display user interface may be granted.
Use of secondary security devices may be used solely or in addition to secondary security methods of the system, allowing the system to have flexible multifactor identification. Simultaneous use may be beneficial to prevent unauthorized access to the various data and/or home appliance features of the system. For instance, a user may use both a secondary security method and a biometric scanner for identification purposes before allowing a user to access the various features of the system. In another preferred embodiment, the system may use a secondary security method for identification purposes and a key card or wearable for activating other features of the display, such as features that allow users to turn on/off home appliances 407, program automatic operation of home appliances 407, and schedule maintenance for home appliances 407. For instance, a user may use a secondary security method to allow the system to identify a user and associate a computing device of the user with a display. The user may then scan an ID card having a secure transmitter, such as a driver license, to cause the display to open a maintenance scheduler. In some preferred embodiments, home appliances 407 may transmit appliance data and/or image data to the system where it may be presented within one or more display windows 417.
In a preferred embodiment, the various data of the system 400 may be stored in user profiles 430. In a preferred embodiment, a user profile 430 is related to a particular user 405. A user 405 is preferably associated with a particular user profile 430 based on a username. However, it is understood that a user 405 may be associated with a user profile 430 using a variety of methods without departing from the inventive subject matter herein. Types of data that may be stored within user profiles 430 of the system 400 include, but are not limited to, user data 430A, image data 430B, application data 430C, and appliance data 430D. Some preferred embodiments of the system 400 may comprise a database 115 operably connected to the processor 220. The database 115 may be configured to store user data 430A, image data 430B, application data 430C, and appliance data 430D within user profiles 430 and/or separately. As used herein, user data 430A may be defined as personal information of a user 405 that helps the system 400 identify the user 405 and their interests. Types of data that may be used by the system 400 as user data 430A includes, but is not limited to, a user's name, username, social security number, phone number, email address, physical address, gender, age, or any combination thereof.
As used herein, image data 430B may be defined as photographic or trace objects that represent the underlying pixel data of an area of an image element, which is created, collected, and stored using image constructor devices, such as a camera. For instance, the system may use image data obtained via a scanning device and/or a secondary security device to confirm the identity of a user. For instance, image data containing appliance data may be transmitted to the display and presented to users where it may be reviewed/manipulated by the user. For instance, application data may be transmitted to the display from the computing device, server, and/or database to the control board so that it may manipulate an application presented within the plurality of display windows 417 of the display as image data.
Application data may be defined as instructions that cause a display application of the display to perform an action. In one preferred embodiment, the system may determine whether a user application of the computing device is compatible with a display application of the display. If it is determined that the display application and user application are compatible, application data may be transmitted to the display from the computing device in lieu of image data. The display application is controlled by the control board of the display and inserted into a display window of the display user interface. Instructions input into a compatible user application are transmitted to the control board from the computing device and are used by the control board to perform actions of the display application, reducing the amount of data transferred between the computing device and display. For instance, a home appliance 407 operably connected to the computing device may transmit appliance data to a user application version of an appliance application of the computing device. A display application version of the appliance application and the user application version of said appliance application may be compatible in a way such that a user may open the user application version on their computing device and subsequently instruct the system (via the user interface) to present the user application version in a display window of the display user interface. The processor of the control board may then determine if the display application version of the appliance application is compatible with the user application version of the appliance application. If the display application version and user application version are compatible, the control board may open the display application version of the appliance application locally and manipulate it via instructions received from the computing device as appliance data is received or actions are taken via the user application version. If the display application version and user application version are not compatible, the control board may receive image data of the user application version of the appliance application and present it within a display window of the display user interface. Accordingly, one with skill in the art will understand that user data 430A, image data 430B, application data 430C, and appliance data 430D may be used by the system multiple ways to carry out various functions of the system without departing from the inventive subject matter described herein.
As previously mentioned, some preferred embodiments of the display 316 may further comprise a control board 409. The control board 409 comprises at least one circuit and microchip. In another preferred embodiment, the control board 409 may further comprise a wireless communication interface, which may allow the control board 409 to receive instructions from an input device controlled by a user 405. In a preferred embodiment, the control board 409 may control the plurality of display windows 417 of the display user interface 316A. The microchip of the control board 409 comprises a microprocessor and memory. In another preferred embodiment, the microchip may further comprise a wireless communication interface in the form of an antenna. The microprocessor may be defined as a multipurpose, clock driven, register based, digital-integrated circuit which accepts binary data as input, processes it according to instructions stored in its memory, and provides results as output. In a preferred embodiment, the microprocessor may receive the various data of the system from a server 110 and/or database 115 via the wireless communication interface.
As mentioned previously, the system 400 may comprise a user interface 411. A user interface 411 may be defined as a space where interactions between a user 405 and the system 400 may take place. In an embodiment, the interactions may take place in a way such that a user 405 may control the operations of the system 400. A user interface 411 may include, but is not limited to operating systems, command line user interfaces, conversational interfaces, web-based user interfaces, zooming user interfaces, touch screens, task-based user interfaces, touch user interfaces, text-based user interfaces, intelligent user interfaces, brain-computer interfaces (BCIs), and graphical user interfaces, or any combination thereof. The system 400 may present data of the user interface 411 to the user 405 via a display 316 operably connected to the processor 220. A display 316 may be defined as an output device that communicates data that may include, but is not limited to, visual, auditory, cutaneous, kinesthetic, olfactory, and gustatory, or any combination thereof.
In some preferred embodiments, the user interface and/or display user interface may comprise additional controls that allow users of the system to manipulate how the various data of the system is presented within the display windows 417. In a preferred embodiment, access to these features is based on permission levels of the user. For instance, the system may be configured in a way such that a user may only fast forward and rewind video of a sporting event should they have the appropriate permissions. For instance, the system may be configured in a way such that a user may zoom in and zoom out of image data only if they have a permission level that grants that feature. In one preferred embodiment, users may only select data to be presented within display windows 417 of the system should the user have appropriate permission levels.
In a preferred embodiment, the control board 409 of the display 316 receives image data from the computing device, server 110, and/or database 115 and may then present said image data 430D via at least one display window of the display user interface 316A of a display 316, as illustrated in
Information presented via a display 316 may be referred to as a soft copy of the information because the information exists electronically and is presented for a temporary period of time. Information stored on the non-transitory computer-readable medium 416 may be referred to as the hard copy of the information. For instance, a display 316 may present a soft copy of visual information via a liquid crystal display (LCD), wherein the hardcopy of the visual information is stored on a local hard drive. For instance, a display 316 may present a soft copy of audio information via a speaker, wherein the hard copy of the audio information is stored in RAM. For instance, a display 316 may present a soft copy of tactile information via a haptic suit, wherein the hard copy of the tactile information is stored within a database 115. Displays 316 may include, but are not limited to, cathode ray tube monitors, LCD monitors, light emitting diode (LED) monitors, gas plasma monitors, screen readers, speech synthesizers, haptic feedback equipment, virtual reality headsets, speakers, and scent generating devices, or any combination thereof.
The database 115 may be operably connected to the processor 220 via wired or wireless connection. In a preferred embodiment, the database 115 is configured to store user data 430A, image data 430B, application data 430C, and appliance data 430D within user profiles 430. Alternatively, the user data 430A, image data 430B, application data 430C, and appliance data 430D may be stored within user profiles 430 on the non-transitory computer-readable medium 416. The database 115 may be a relational database such that the user data 430A, image data 430B, application data 430C, and appliance data 430D associated with each user profile 430 within the plurality of user profiles 430 may be stored, at least in part, in one or more tables. Alternatively, the database 115 may be an object database such that user data 430A, image data 430B, application data 430C, and appliance data 430D associated with each user profile 430 of the plurality of user profiles 430 may be stored, at least in part, as objects. In some instances, the database 115 may comprise a relational and/or object database and a server 110 dedicated solely to managing the user data 430A, image data 430B, application data 430C, and appliance data 430D in the manners disclosed herein.
In a preferred embodiment, the system 400 may use artificial intelligence (AI) techniques to perform functions of the system. In one preferred embodiment, AI techniques may be used to control the number of display windows 417 presented within the display user interface. In another preferred embodiment, AI techniques may be used to organize the plurality of display windows 417 within the display user interface. In yet another preferred embodiment, AI techniques may be used to evaluate application data collected by the system to determine an operation schedule for home appliances 407 operably connected to the system. In yet another preferred embodiment, AI techniques may be used by the system to determine when maintenance should be scheduled for a home appliance 407. In yet another preferred embodiment, AI techniques may be used by the system to determine when a home appliance 407 may fail and inform a user when a replacement home appliance 407 may be needed. In yet another preferred embodiment, AI techniques may be used by the system to determine recipes that may be prepared based on food items on hand and cooking home appliances 407 available. The term “artificial intelligence” and grammatical equivalents thereof are used herein to mean an intelligence method used by the system 400 to correctly interpret and learn from data of the system 400 or a plurality of systems in order to achieve specific goals and tasks through flexible adaptation. Types of intelligence methods that may be used by the system 400 include, but are not limited to, machine learning, neural network, computer vision, or any combination thereof.
The system 400 preferably uses machine learning techniques to perform the methods disclosed herein, wherein the instructions carried out by the processor 220 for said machine learning techniques are stored on the non-transitory computer-readable medium 416, server 110, and/or database 115. Machine learning techniques that may be used by the system 400 include, but are not limited to, classification algorithms, neural network algorithm, regression algorithms, decision tree algorithms, clustering algorithms, genetic algorithms, supervised learning algorithms, semi-supervised learning algorithms, unsupervised learning algorithms, deep learning algorithms, or other types of algorithms. More specifically, machine learning algorithms can include implementations of one or more of the following algorithms: support vector machine, decision tree, nearest neighbor algorithm, random forest, ridge regression, Lasso algorithm, k-means clustering algorithm, boosting algorithm, spectral clustering algorithm, mean shift clustering algorithm, non-negative matrix factorization algorithm, elastic net algorithm, Bayesian classifier algorithm, RANSAC algorithm, orthogonal matching pursuit algorithm, bootstrap aggregating, temporal difference learning, backpropagation, online machine learning, Q-learning, stochastic gradient descent, least squares regression, logistic regression, ordinary least squares regression (OLSR), linear regression, stepwise regression, multivariate adaptive regression splines (MARS), locally estimated scatterplot smoothing (LOESS) ensemble methods, clustering algorithms, centroid based algorithms, principal component analysis (PCA), singular value decomposition, independent component analysis, k nearest neighbors (kNN), learning vector quantization (LVQ), self-organizing map (SOM), locally weighted learning (LWL), apriori algorithms, eclat algorithms, regularization algorithms, ridge regression, least absolute shrinkage and selection operator (LASSO), elastic net, classification and regression tree (CART), iterative dichotomiser 3 (ID3), C4.5 and C5.0, chi-squared automatic interaction detection (CHAID), decision stump, M5, conditional decision trees, least-angle regression (LARS), naive bayes, gaussian naïve bayes, multinomial naïve bayes, averaged one-dependence estimators (AODE), bayesian belief network (BBN), bayesian network (BN), k-medians, expectation maximisation (EM), hierarchical clustering, perceptron back-propagation, hopfield network, radial basis function network (RBFN), deep boltzmann machine (DBM), deep belief networks (DBN), convolutional neural network (CNN), stacked auto-encoders, principal component regression (PCR), partial least squares regression (PLSR), sammon mapping, multidimensional scaling (MDS), projection pursuit, linear discriminant analysis (LDA), mixture discriminant analysis (MDA), quadratic discriminant analysis (QDA), flexible discriminant analysis (FDA), bootstrapped aggregation (bagging), adaboost, stacked generalization (blending), gradient boosting machines (GBM), gradient boosted regression trees (GBRT), random forest, or even algorithms yet to be invented.
In a preferred embodiment, the system may determine maintenance for a home appliance 407 using a machine learning technique. In one preferred embodiment, machine learning techniques may be used to schedule maintenance for a home appliance 407. For instance, the system may obtain audio data from a user and process it using natural language processing (NLP) to discern if an appliance is not functioning optimally. For instance, the system may use semi-supervised learning to create a maintenance schedule for home appliances 407 based on application data pertaining to how often said home appliance 407 is used. In another preferred embodiment, the system may use machine learning techniques to assist with household functions within a homeplace. For instance, the system may use decision tree, supervised learning to create a cleaning schedule for smart appliances, such as smart vacuums, washing machines, and dish washers based on user data concerning a work/sleep schedule of users within a household and/or appliance data of home appliances 407 operably connected to the system. This may be used in conjunction with user scheduled operation of home appliances 407 for optimal management of household functions about a household.
In a preferred embodiment, the system's intelligent management of consumable supplies extends beyond basic inventory tracking. By leveraging artificial intelligence and advanced sensors, the system can provide a comprehensive analysis of food consumption patterns and optimize household resource management. For example, the smart refrigerator's internal camera might not only capture image data 430B of the contents but also employs computer vision algorithms to identify specific food items, assess their freshness, and estimate remaining quantities. This granular level of detail allows the AI to make nuanced decisions about when to suggest replenishment. Similarly, the system's predictive capabilities could go beyond simple reordering. By analyzing historical consumption data, the system 400 may anticipate seasonal variations in eating habits and adjust recommendations accordingly. For instance, it might suggest stocking up on barbecue supplies before a holiday weekend or increase the frequency of produce deliveries during periods when the household tends to eat more salads. The AI can also correlate consumption patterns with external factors such as weather forecasts, local events, or even TV schedules that might influence eating habits. For example, it might recommend ingredients for soup or hot chocolate when cold weather is predicted or suggest snack foods before a major sporting event.
In non-household settings, the aforementioned capabilities for tracking consumption become even more valuable. In a preferred embodiment in a restaurant kitchen, the smart refrigerator could help chefs optimize their ingredient ordering by tracking usage rates of various components and suggesting menu adjustments based on available supplies. In another preferred embodiment installed in a school cafeteria, the system could assist in menu planning by ensuring nutritional guidelines are met while minimizing food waste. The system's ability to track food quality is particularly crucial in these professional settings. By monitoring expiration dates and storage conditions, it can help ensure food safety compliance and reduce the risk of foodborne illnesses. In community or church kitchens, where donations may arrive sporadically, the system can help organizers efficiently manage and distribute perishable items. Furthermore, in all these settings, the system's data collection and analysis capabilities can provide valuable insights for long-term planning and resource allocation. By identifying trends in food consumption and waste, organizations can make informed decisions about purchasing, menu design, and even equipment investments.
In yet another preferred embodiment, the system may monitor appliance data to determine when a home appliance 407 may be nearing the end of its operational lifespan. For instance, a home appliance 407 configured to clean floors of the household may be operably connected to the processor in a way that transmits appliance data thereto. Based on error codes received from the home appliance 407 pertaining to operation malfunctions as well as the number of hours the home appliance 407 has operated, the system may use unsupervised learning to estimate when the home appliance 407 will fail and recommend potential replacements should the home appliance 407 fail. These potential replacements might be sorted by price, rating, number of online reviews, recall status, status as used, another parameter, or a combination of parameters. Similarly, location data could be used to suggest nearby locations at which replacements for a food item or home appliance 407 could be purchased. In some preferred embodiments, the system may collect and process appliance data pertaining to food items and recommend recipes that a user may prepare. For instance, the system may collect appliance data from a smart refrigerator pertaining to the smart refrigerators contents. The system may use supervised learning to recommend recipes to a user based on the food items and home cooking appliances available to the user. In another preferred embodiment, favored recipes may be flagged by the user as desirable, prompting the system 400 to save the recipe, while disfavored recipes are not suggested again. The system 400 may use machine learning to recommend new recipes based on their similarity to a favored recipe, while avoiding recommendations that are similar to a disfavored recipe. The system 400 performing such a function is recommended for home kitchens, but it could also be used in other installations wherein foods must be prepared from eclectic or inconsistent ingredients. For instance, a system 400 comprising a smart fridge, several smart food preparation appliances like a smart oven, and a smart pantry could be installed in a food pantry or soup kitchen, which cannot always control the contents of their donations and must prepare filling meals for many people.
In a preferred embodiment, the system 400 utilizes machine learning techniques to create sophisticated and tailored plans that go beyond simple appliance maintenance schedules. By utilizing smart appliances 407 equipped with cameras, the system may collect image data 430B. This data is then processed using machine learning algorithms to analyze and understand how individuals use different spaces within the home. The system's ability to correlate space usage patterns with data from cleaning appliances allows for a more nuanced approach to household management. For example, it can determine that a heavily trafficked area like the kitchen may require more frequent cleaning than a rarely used guest room. This analysis enables the system 400 to extrapolate recommendations for when and how often specific areas need to be cleaned, as well as which smart appliance is best suited for the task. In another preferred embodiment, the system 400 can display cleaning reminders on one or more displays 316 throughout the home. These reminders are not generic but are tailored to the specific needs of each space based on its usage patterns and the capabilities of available smart appliances.
The incorporation of facial recognition technology further enhances the system's capabilities. In yet another preferred embodiment, by identifying and tracking individual users within the home, the system can create even more personalized usage analytics. This feature allows the system to distinguish between different family members' habits and preferences, leading to more accurate and individualized recommendations. These detailed usage analytics are made available to users 405, empowering them to make informed decisions when establishing cleaning routines or assigning household chores. For instance, if the system detects that one family member frequently uses the home office, it might suggest more regular cleaning for that space. In a preferred embodiment, the system 400 can autonomously design cleaning schedules that closely align with the individual usage patterns of each space. For instance, the users might request a cleaning schedule where each person cleans a space proportional to the degree in which they use the space. In such an embodiment, cleaning tasks are optimized not just for frequency, but also for timing. For example, the system might schedule vacuum cleaning of the living room shortly after peak usage hours, ensuring the space is consistently maintained without disrupting the family's routine.
In a preferred embodiment, the system 400 may use more than one machine learning technique to determine when to schedule maintenance of a home appliance 407. For instance, a system 400 comprising a microphone may use a combination of NLP and reinforcement learning to discern which home appliance repair services a user prefers. If the system 400 determines that appliance data indicates that a home appliance 407 is in need of maintenance, the system may automatically schedule maintenance for the home appliance 407 using the user's preferred home appliance repair services. In another preferred embodiment, the system 400 may actively monitor a user's presence within the household and determine when a home appliance 407 should be activated to perform a household function. For instance, the system 400 may use deep learning and NLP to discern the presence of a user within a household by processing image data and audio data obtained from a camera and microphone connected to the system. When the system determines that a user is no longer present within the household, the system may cause home appliances 407 to carry out household functions.
In a preferred embodiment, the machine learning techniques comprise instructions configured to create a trained machine learning techniques from at least some training data and according to an implementation of the machine learning techniques, wherein the training data serves as a baseline dataset that may act as the foundational data of the machine learning techniques. The instructions of the machine learning techniques dictate how the machine learning techniques gain knowledge from the various data sources of the system and may comprise various types of programable instructions that include, but are not limited to, local commands, remote commands, executable files, protocol commands, selected commands, or any combination thereof. The instructions of the machine learning techniques may vary widely, depending on a desired implementation. In a preferred embodiment, instructions may include streamed-lined instructions that instruct the machine learning techniques on how to train the system, possibly in the form of a script (e.g., Python, Ruby, JavaScript, etc.). In another preferred embodiment, the instructions may include data filters or data selection criteria that define requirements for desired results sets created from the various data of the system as well as which machine learning algorithm is to be used.
Training of the machine learning techniques may be supervised, semi-supervised, or unsupervised. In some preferred embodiments, the machine learning systems may use NLP to analyze data (e.g., audio data, text data, etc.). For instance, the system may process audio data of a user to determine that floors of a house need cleaning. Based on comments of the user, as determined by NLP, the system may determine how often a user prefers their floors to be cleaned and create a cleaning schedule for home appliances 407 of the system. Training of the machine learning techniques may result in baseline machine learning techniques that may serve as AI techniques for performing the various functions of the system in the manners described herein. Baseline machine learning techniques may further be configured to act as passive models or active models. A passive model may be described as a final, completed machine learning model that uses only the baseline data set to establish behavior of the baseline machine learning technique. An active model may be described as a plasticity machine learning model that is dynamic in that it may be updated using both the baseline dataset and data outside of the baseline data set.
In a preferred embodiment, the system may use a passive model to allow for a high degree of control as to how the system manages user interfaces and display windows 417 in the manners described herein. For instance, a passive model may be configured via a private dataset to provide each user of the system with the same scheduled maintenance/cleaning recommendations regardless of data obtained by the system, which may be especially useful for users having user profiles with little data from which the machine learning techniques may learn from. In some preferred embodiments, the system may be configured to begin as passive models until a threshold amount of user data has been acquired. Once the threshold amount of user data has been acquired, the system may cause the machine learning techniques to switch to active models, allowing the system to make recommendations to a user that better parallel historical preferences of the user. For instance, a system may be configured to recommend a baseline maintenance/cleaning schedule until seven day's worth of appliance data has been obtained. Once seven days of appliance data has been obtained, the machine learning techniques of the system may switch to an active machine model for that particular user and recommend maintenance/cleaning schedules as determined by the active machine model.
In some embodiments, an active machine model may be updated in real-time, daily, weekly, bimonthly, monthly, quarterly, or annually using the various data (e.g., to update model instructions, shifts in time, new/corrected private data sets, user data, patient data, etc.), of the system. In some preferred embodiments, the passive machine model may also be updated as new/updated private data sets become available. In a preferred embodiment, machine learning techniques comprise metadata that describe the state of the passive/active model with respect to its updates. The metadata may include attributes describing one or more of the following: a version number, date updated, amount of new data used for the update, shifts in model parameters, convergence requirements, or other information. Because each user of the system may potentially have a unique machine learning technique associated with their user profile due to the personal nature of user data associated with each user profile, such information allows for identifying distinct passive/active models within the system that may be separately managed.
To prevent un-authorized users from accessing other user's information, the system 400 may employ a data security method. As illustrated in
In an embodiment, user roles 810, 830, 850 may be assigned to a user 405 in a way such that a requesting user 805, 825, 845 may view user profiles 430 containing ser data 430A, image data 430B, application data 430C, and appliance data 430D via a user interface 411. To access the data within the database 115, a user 405 may make a user request via the user interface 411 to the processor 220. In an embodiment, the processor 220 may grant or deny the request based on the permission level 800 associated with the requesting user 805, 825, 845. Only users 405 having appropriate user roles 810, 830, 850 or administrator roles 870 may access the data within the user profiles 430. For instance, as illustrated in
The subject matter described herein may be embodied in systems, apparatuses, methods, and/or articles depending on the desired configuration. In particular, various implementations of the subject matter described herein may be realized in digital electronic circuitry, integrated circuitry, specially designed application specific integrated circuits (ASICs), computer hardware, firmware, software, and/or combinations thereof. These various implementations may include implementation in one or more computer programs that may be executable and/or interpretable on a programmable system including at least one programmable processor, which may be special or general purpose, coupled to receive data and instructions from, and to transmit data and instructions to, a storage system, and at least one peripheral device.
These computer programs, which may also be referred to as programs, software, applications, software applications, components, or code, may include machine instructions for a programmable processor, and may be implemented in a high-level procedural and/or object-oriented programming language, and/or in assembly machine language. As used herein, the term “non-transitory computer-readable medium” refers to any computer program, product, apparatus, and/or device, such as magnetic discs, optical disks, memory, and Programmable Logic Devices (PLDs), used to provide machine instructions and/or data to a programmable processor, including a non-transitory computer-readable medium that receives machine instructions as a computer-readable signal. The term “computer-readable signal” refers to any signal used to provide machine instructions and/or data to a programmable processor. To provide for interaction with a user, the subject matter described herein may be implemented on a computer having a display device, such as a cathode ray tube (CRD), liquid crystal display (LCD), light emitting display (LED) monitor for displaying information to the user and a keyboard and a pointing device, such as a mouse or a trackball, by which the user may provide input to the computer. Displays may include, but are not limited to, visual, auditory, cutaneous, kinesthetic, olfactory, and gustatory displays, or any combination thereof.
Other kinds of devices may be used to facilitate interaction with a user as well. For instance, feedback provided to the user may be any form of sensory feedback, such as visual feedback, auditory feedback, or tactile feedback; and input from the user may be received in any form including, but not limited to, acoustic, speech, or tactile input. The subject matter described herein may be implemented in a computing system that includes a back-end component, such as a data server, or that includes a middleware component, such as an application server, or that includes a front-end component, such as a client computer having a graphical user interface or a Web browser through which a user may interact with the system described herein, or any combination of such back-end, middleware, or front-end components. The components of the system may be interconnected by any form or medium of digital data communication, such as a communication network. Examples of communication networks may include, but are not limited to, a local area network (“LAN”), a wide area network (“WAN”), metropolitan area networks (“MAN”), and the internet.
The implementations set forth in the foregoing description do not represent all implementations consistent with the subject matter described herein. Instead, they are merely some examples consistent with aspects related to the described subject matter. Although a few variations have been described in detail above, other modifications or additions are possible. In particular, further features and/or variations can be provided in addition to those set forth herein. For instance, the implementations described above can be directed to various combinations and subcombinations of the disclosed features and/or combinations and subcombinations of several further features disclosed above. In addition, the logic flow depicted in the accompanying figures and/or described herein do not necessarily require the particular order shown, or sequential order, to achieve desirable results. It will be readily understood to those skilled in the art that various other changes in the details, devices, and arrangements of the parts and method stages which have been described and illustrated in order to explain the nature of this inventive subject matter can be made without departing from the principles and scope of the inventive subject matter.
This application claims priority to U.S. Provisional Application Ser. No. 63/609,257, filed on Dec. 12, 2023, in which application is incorporated herein in its entirety by reference.
| Number | Date | Country | |
|---|---|---|---|
| 63609257 | Dec 2023 | US |