The present application claims the benefit of nonprovisional application Ser. No. 18/207,935, filed Jun. 9, 2023.
This specification describes example implementations related to blenders and, more particularly, and implementations including controlling the texture of food items being processed by blenders.
As used herein, a “food processor” is not limited to being a specific type of small appliance commonly referred to as a food processor, but rather, is a kitchen and/or laboratory appliance used to blend, mix, crush, purée, chop, grind, cut, comminute and/or emulsify food, beverages and other substances, for example, during one or more cycles, and may include, but is not limited to, a blender, a mixer, a juicer, a grinder, a frother, a micro puree machine, other types of devices for processing food, and any suitable combination of the foregoing. A food processor may include a container with a rotating blade powered by a motor. Current blenders may include a microprocessor configured to control operations of the blender related to processing food items to create blended food items such as smoothies, ice creams, or whipped cream. Existing blenders may include computer-controlled programs or recipes that implement particular operational sequences of the motor and mixing blades that are specific to particular food items. Unfortunately, such operational sequences are typically fixed and do not account for different conditions or consistencies of food item ingredients being processed, leading to variable and inconsistent outcomes in the characteristics of processed food items. Accordingly, there is a need for more adaptable processing of food items to ensure more consistent and accurate food item outcome conditions, such as an expected texture of the food item being processed.
The application, in various implementations, addresses deficiencies associated with more accurately and consistently blending food items.
This application describes illustrative systems, methods, and devices that enable a blender to detect the values of physical properties (e.g., sense conditions) associated with processing a food item, analyze the values, and determine how to further process the food item based on the analyzed values. For example, various blending ingredients to create a smoothie (e.g., the blended ingredients constituting a food item) may be added to a blender container. The blender may receive an input from a user via a user interface to process the ingredients, which may include executing a predefined processing sequence for a smoothie. A microcontroller may then control execution of the processing, including executing computer program instructions, to automatically process the ingredients, for example, according to the predefined processing sequence. During a period when processing the blending ingredients, i.e., mixing the ingredients, the microcontroller may receive a series of motor signals based on power consumption of the motor sensed by one or more sensors, analyze the motor signals and, based on this analysis, adjust processing of the blending ingredients, e.g., to realize a desired and/or expected condition for the blended ingredients, e.g., a desired and/or expected texture for a smoothie. The microcontroller may utilize machine learning (ML) and/or artificial intelligence (AI) techniques to more adaptively and accurately analyze the detected values and control production of a desired and/or expected condition for the blended ingredients. The microprocessor may analyze other electronic signals such as, without limitation, temperature of a mixing vessel or current signals associated with a heating element and based on one or more of those signals and/or the motor signals, adjust processing of the blending ingredients.
In one aspect, a food processor is disclosed. The food processor may include a motor coupled to a drive shaft and configured to rotate the drive shaft. The food processor may further include a blade assembly coupled to the drive shaft. The blade assembly may be configured to process a food item while being rotated by the drive shaft. The food processor may include other processing components including one or more heating elements. One or more processing components of the food processor may be controllable by a controller of the food processor, for example, a motor or heating element, and may be referred to herein as controllable components. While several implementations are described herein using the example of a motor as the controllable component, it should be appreciated that the invention is not so limited, and other controllable components may be used in certain implementations, in addition to or as an alternative to a motor.
The food processor may further include a monitoring device configured to detect values of one or more physical properties associated with processing food items, for example, at least one of a current and voltage associated with operation of the motor, over a first time period, and output a first series of signals representing the values over the first time period. The food processor may include a memory configured to store a plurality of known food item vectors in a multi-dimensional feature space. Each of the plurality of known food item vectors may be associated with a type of food item. The food processor may further include a controller (e.g., microprocessor) configured to control operations of the motor. Several implementations are described herein using the example of a microprocessor as the controller, but the invention is not so limited. Other types of controllers can be used.
In some implementations, a microprocessor of the food processor may receive a first series of motor signals, determine values of one or more predefined features based on the motor signals, and construct a vector of these determined values (i.e., a detection vector) as described in more details elsewhere herein. The microprocessor may further compare a position of the detection vector with the positions of the plurality of known food item vectors in the multi-dimensional feature space, each food item vector corresponding to a respective food item. The microprocessor may further identify one or more types of food items associated with food item being processed, represented by the detection vector, by determining which one or more of the plurality of known food item vectors is closest to the detection vector in the multi-dimensional feature space.
The microprocessor then may control the execution of one or more actions based on the determination of the closest one or more food item vectors. In one implementation, the microprocessor, based on the identified food item, continues to rotate the motor for a second period of time. The second period of time may be between 0 seconds and 30 seconds. In some implementations, the second period of time is 15 seconds.
In one implementation, the first period of time is 15 seconds. In some implementations, the comparison and identifying of the food item is based on a K-NN classification. According to another implementation, the monitoring device may include at least one of a current sensor and voltage sensor.
In one implementation, the type of food item includes one of a apple-peanut-butter, beat-ginger-smoothie, chocolate-peanut-butter-oat, maple-almond-butter, cinnamon-coffee-smoothie, citrus smoothie, essentially green smoothie, triple-green smoothie, tropical smoothie, smoothie of any type, extract, sauce, ice cream, pudding, nut butter, whip cream, margarita, pomegranate-cashew berry, strawberry-banana, strawberry-limeade, and a frozen drink. In some implementations, each of the features are selected from the group including: a peak in a plot of a time series pattern and/or data, a drop in a plot of the time series data, a standard deviation of a plot of the series data, and a steady state power consumption in a plot of the time series data, a standard deviation of the time series data (which as described herein represents a detected property value over a period of time) or a subset of the time series data (i.e., for values detected during a subset of the time period); an average value of the time series data or subset thereof; a value at a particular point in time during the period of time represented by the time series data; a difference between a value at a first point in time and a value at a second point in time during the period of time represented by the time series data; a momentum of the data represented by the time series data or a subset thereof; a gradient of a curve representing the time series data or a subset thereof; other features; or any suitable combination of the foregoing.
In one aspect, a food processor includes a controllable component coupled to one or more components configured to process one or more food items. The food processor also includes a monitoring device configured to detect at least one property associated with the processing of the one or more food items during a first period of time, where a first series of detection signals are generated from the at least one property detected over the first period of time. A memory is configured to store a first plurality of food item vectors, where each food item vector defines values for a plurality of features in a multi-dimensional feature space and each of the first plurality of food item vectors is associated with a type of food item. A controller is configured to control operations of the controllable component. The controller receives the first series of detection signals and calculates a detection vector based on the first series of detection signals. The detection vector defines feature values for a plurality of features in the multi-dimensional feature space. The controller identifies one or more types of food items associated with the detection vector by determining a position of the detection vector in the multi-dimensional feature space relative to positions of one or more of the first plurality of food item vectors, respectively, in the multi-dimensional feature space. The controller then determines one or more actions based at least in part on the identified one or more types of food items and controls operation of the controllable component based at least in part on the determined one or more actions.
The controller, based on the identified one or more types of food items, may continue to operate the controllable component for a second period of time. The controllable component may include a motor and the operating the motor may include rotating the motor. The controller may identify the food item based, at least in part, on performing a K-NN analysis. The monitoring device may include a current sensor, voltage sensor, motor speed sensor, pressure sensor, and/or temperature sensor.
The controller may calculate and/or generate a detection vector by calculating the one or more feature values defining the detection vector. A first of the one or more feature values may include a gradient of a curve defined by the first series of detection signals. The controller may detect the at least one property associated with processing the one or more food items during a first period of time by detecting at least one of a current and voltage associated with operation of the controllable component over the first time period. The controller may detect at least one property associated with the processing of the one or more food items by determining a type and/or size of the one or more components. The controller may be configured to control the controllable component based at least in part on the type and/or size of one of the components.
The controller may be configured to identify the one or more types of food items associated with the detection vector by determining which one of the first plurality of food item vectors is closest to the detection vector in the multi-dimensional feature space. The controller may be configured to identify the one or more types of food items associated with the detection vector by determining the position of the detection vector in the multi-dimensional feature space with respect to positions of two or more of the first plurality of food item vectors in the multi-dimensional feature space.
The controller may be configured to control the operation of the controllable component based on applying a weight factor to each of the two or more of the first plurality of food item vectors, where the weight factor is based on a distance of a food item vector from the detection vector, a frequency of determining a type of food item, and/or a type of container used during food processing. The controller may be configured to classify a first subset of the one or more food item vectors as a first category of food items and control the controllable component based at least in part on determining that the position of the detection vector in the multi-dimensional feature space is within a first area of the multi-dimensional feature space associated with the first category of food items.
The controller may classify a first subset of the one or more food item vectors as a first category of food items based on the detection vector and control the controllable component based at least in part on determining that the position of the detection vector in the multi-dimensional feature space is within a first area of the multi-dimensional feature space associated with the classification of the first category of food items. The controller may be configured to classify a second subset of the one or more food items vectors as a second category of food items; and control the controllable component based at least in part on determining that the position of the detection vector in the multi-dimensional feature space is within a second area of the multi-dimensional feature space associated with the second category of food items Each of the features may include a peak value detected for the at least one property in the first series of signals, a drop between values detected for the at least one property in the first series of signals, a standard deviation of values detected for the at least one property in the first series of signals, and/or a value detected for the at least one property at a particular point in time in the first series of signals.
Another aspect includes a method for processing food items via a controllable component configured to process one or more food items including: operating the controllable component for a first period of time; detecting, via a monitoring device, at least one property associated with the processing of the one or more food items during the first period of time, where a first series of detection signals are generated from the at least one property detected over the first period of time; storing, in a memory, a first plurality of food item vectors, each food item vector defining values for a plurality of features in a multi-dimensional feature space, each of the first plurality of food item vectors being associated with a type of food item; calculating a detection vector based on the first series of detection signals, where the detection vector defines feature values for a plurality of features in the multi-dimensional feature space; identifying one or more types of food items associated with the detection vector by determining a position of the detection vector in the multi-dimensional feature space relative to positions of one or more of the first plurality of food item vectors, respectively, in the multi-dimensional feature space; determining one or more actions based at least in part on the identified one or more types of food items; and controlling operation of the controllable component based at least in part on the determined one or more actions.
The method may include continuing to operate the controllable component for a second period of time based on the identified one or more types of food items. The controllable component may include a motor where operating the motor includes rotating the motor. Identifying the food item may be based, at least in part, on performing a K-NN analysis. Identifying the one or more types of food items associated with the detection vector may include determining which one of the first plurality of food item vectors is closest to the detection vector in the multi-dimensional feature space.
In a further aspect, a non-transitory computer-readable storage medium storing instructions including a plurality of food processing instructions associated with a food processing sequence which when executed by a computer cause the computer to perform a method for processing food items using a food processor via a controllable component configured to process one or more food items, where the method includes: operating the controllable component for a first period of time; detecting, via a monitoring device, at least one property associated with the processing of the one or more food items during the first period of time, where a first series of detection signals are generated from the at least one property detected over the first period of time; storing, in a memory, a first plurality of food item vectors, where each food item vector defines values for a plurality of features in a multi-dimensional feature space, each of the first plurality of food item vectors being associated with a type of food item; calculating a detection vector based on the first series of detection signals, the detection vector defining feature values for a plurality of features in the multi-dimensional feature space; identifying one or more types of food items associated with the detection vector by determining a position of the detection vector in the multi-dimensional feature space relative to positions of one or more of the first plurality of food item vectors, respectively, in the multi-dimensional feature space; determining one or more actions based at least in part on the identified one or more types of food items; and controlling operation of the controllable component based at least in part on the determined one or more actions.
Any two or more of the features described in this specification, including in this summary section, may be combined to form implementations not specifically described in this specification.
At least part of the systems and processes described in this specification may be configured or controlled by executing, on one or more processing devices, instructions that are stored on one or more non-transitory machine-readable storage media. Examples of non-transitory machine-readable storage media include read-only memory, an optical disk drive, memory disk drive, and random access memory. At least part of the test systems and processes described in this specification may be configured or controlled using a computing system comprised of one or more processing devices and memory storing instructions that are executable by the one or more processing devices to perform various control operations.
The details of one or more implementations are set forth in the accompanying drawings and the following description. Other features and advantages will be apparent from the description and drawings, and from the claims.
The application, in various implementations, addresses deficiencies associated with blending one or more food items. The application includes illustrative devices, systems, and methods that enable efficient and reliable sensory features regarding the state of a food processor, such as a blender.
This application describes illustrative systems, methods, and devices that enable a blender to sense conditions associated with processing a food item and determine when the food item satisfies expected characteristics of a processed outcome of the food item. These example methods, devices, and systems may have advantages in dynamically sensing cavitation and solidification of blending ingredients in areas of the blending jar remote from the blade configuration at the bottom of the blending jar. For example, some implementations can work by sensing features from a blender within the first 15 seconds, and then identifying which data points are closest in distance. Based on which points are closest, example processes can then calculate a weighted average of the times that can be used for the program time based on what is being blended.
The blender 100 may be considered a traditional type of blender, which has a removable lid 110 at the top end of the blender jar 108 into which ingredients may be added to the blender jar 108, where the blender jar 108 is coupled at its bottom end to the motorized base 104. However, other types of blenders may be used, for example, a single-serve blender, which has a smaller capacity than a traditional blender, and may have a lid or cap including a blade assembly at an end of the blender jar (i.e., container or cup) through which ingredients are introduced into the blender jar before coupling the cap to it, where the blending assembly including the blender jar coupled with the cap including the blade assembly then may be flipped to couple the cap to the blending base.
Electronic controls, such as user interface 212 of
In some implementations of
In some implementations of
In some implementations, values for a plurality of features can be generated based on the time series data, and these feature values can be represented as a detection vector. As described in more detail elsewhere herein, such features may include: a standard deviation of the time series data (which as described herein represents a detected property value over a period of time) or a subset of the time series data (i.e., for values detected during a subset of the time period); an average value of the time series data or subset thereof; a value at a particular point in time during the period of time represented by the time series; a difference between a value at a first point in time and a value at a second point in time during the period of time represented by the time series data; a momentum of the data represented by the time series data data or a subset thereof; a gradient of a curve representing the time series data data or a subset thereof; other features; or any suitable combination of the foregoing.
In some implementations, a detected food item is initially classified as a class of food item based on the time series data, for example, based on one or more feature values determined therefrom; and the subsequent processing of the time series data and/or feature values is based on this initial classification, as described in more detail elsewhere herein. For example, the controller 202 can initially classify a food item as being a type of nut butter, or a type of dough, in which case subsequent processing is handled in certain way; whereas if the food item is initially classified as a food item that is not a type of nut butter or type of dough, subsequent processing is handled in a different way. In some implementations, controller 202 classifies a first subset of food item vectors as a first category of food items and controls the controllable component, e.g., motor, based at least in part on determining that the position of the detection vector in the multi-dimensional feature space is within a first area of the multi-dimensional feature space associated with the first category of food items. For example, various types of nut butter may be members of the first subset of food item vectors and, therefore, have their food item vectors in the first area of the multi-dimensional feature space, while non-nut butter food items and/or frozen drink food items may be members of a second subset of food item vectors and, therefore, have their food item vectors in a second area of the multi-dimensional feature space. The classification of a detected food item and the subsequent processing may employ any of a variety of known or later developed techniques, and may employ one or more known or later developed technologies to implement such techniques, for example, using any of a variety of ML and/or neural networks.
The controller 202 can be further configured to determine one or more closest food types to the detected food item based on determined feature values. For example, this determination can include the selection of a subset of multi-dimensional feature vectors based on a determined capacity of the blending jar 108 (e.g., a data sets for 28-ounce or 64-ounce capacity) and comparing the detection vector against the subset of multi-dimensional feature vectors. In some instances, each such feature vector represents and/or is otherwise associated with a food type, such as a margarita, type of smoothie and/or another type of food item, and such vectors may be referred to herein as “food item vectors.” Such comparison may include determining which one or more food item vectors are closest in the multi-dimensional feature space to the detection vector, e.g., who are the nearest neighbors. This determination may use any of a variety of known or later developed techniques, for example, a K-Nearest Neighbors Algorithm (KNN), and may employ one or more known or later developed technologies to implement such techniques, for example, any of a variety of neural networks. For example, controller 202 can identify the food type associated with the detection vector as being a particular type of beverage, juice, frozen beverage, smoothie, butter, shake, cream, sauce, soup, frosting, whipped topping, other type of food, or any suitable combination of the foregoing.
Controller 202 can then determine additional controller 202 actions based on determine one or more closest food types, for example, add additional blending time for the detected food time. For example, an additional blending time may be associated with each food item vector, and the additional time for the detected food item may be determined by calculating a combined (e.g., weighted average) of the additional blending times associated with the determined one or more closest food items. For example, for each of the one or more closest food items, the weight of its additional time may be proportion to the determined proximity of its food item vector to the detected vector in the multi-dimensional feature Controller 202 then can control an action being taken, for example, by sending one or more signals to the motor 214 (e.g., via a switch connected to motor 214) to control the continuing of blending for the additional blending time, or stopping the motor, for example, if the additional blending time=0 seconds . . .
As also shown in
Control system 200 may include a processing element, such as controller and/or processor 202, that contains one or more hardware processors, where each hardware processor may have a single or multiple processor cores. In one implementation, the processor 202 includes at least one shared cache that stores data (e.g., computing instructions) that are utilized by one or more other components of processor 202. For example, the shared cache may be a locally cached data stored in a memory for faster access by components of the processing elements that make up processor 202. Examples of processors include but are not limited to a central processing unit (CPU) and/or microprocessor. Controller and/or processor 202 may utilize a computer architecture base on, without limitation, the Intel® 8051 architecture, Motorola® 68HCX, Intel® 80X86, and the like. The processor 202 may include, without limitation, an 8-bit, 12-bit, 16-bit, 32-bit, or 64-bit architecture. Although not illustrated in
Persons of ordinary skill in the art are aware that software programs may be developed, encoded, and compiled in a variety of computing languages for a variety of software platforms and/or operating systems and subsequently loaded and executed by processor 202. In one implementation, the compiling process of the software program may transform program code written in a programming language to another computer language such that the processor 202 is able to execute the programming code. For example, the compiling process of the software program may generate an executable program that provides encoded instructions (e.g., machine code instructions) for processor 202 to accomplish specific, non-generic, particular computing functions.
After the compiling process, the encoded instructions may be loaded as computer executable instructions or process steps to processor 202 from storage 208, from memory 204, and/or embedded within processor 202 (e.g., via a cache or on-board ROM). Processor 202 may be configured to execute the stored instructions or process steps in order to perform instructions or process steps to transform the electronic control system 200 into a non-generic, particular, specially programmed machine or apparatus. Stored data, e.g., data stored by a data store and/or storage device 208, may be accessed by processor 202 during the execution of computer executable instructions or process steps to instruct one or more components within control system 200 and/or other components or devices external to system 200.
User interface 212 can include a display, positional input device (such as a mouse, touchpad, touchscreen, or the like), keyboard, keypad, one or more buttons, or other forms of user input and output devices. The user interface components may be communicatively coupled to processor 202. When the user interface output device is or includes a display, the display can be implemented in various ways, including by a liquid crystal display (LCD) or a cathode-ray tube (CRT) or light emitting diode (LED) display, such as an OLED display.
Sensor(s) 206 may include one or more sensors that detect and/or monitor at least one property associated with the processing of one or more food items by system 100 and/or physical properties (i.e., environmental conditions) within or surrounding system 100 and/or 200, such as within or surrounding, for example, blending container or jar 108 of
Sensors 206 may also include one or more safety and/or interlock switches that prevent or enable operation of certain components, e.g., a motor, when certain conditions are met (e.g., enabling activation of motor 214 when lid 110 is attached to container 108). Persons of ordinary skill in the art are aware that electronic control system 200 may include other components well known in the art, such as power sources and/or analog-to-digital converters, not explicitly shown in
In some implementations, control system 200 and/or processor 202 includes an SoC having multiple hardware components, including but not limited to:
A SoC includes both the hardware, described above, and software controlling the microcontroller, microprocessor and/or DSP cores, peripherals and interfaces. Most SoCs are developed from pre-qualified hardware blocks for the hardware elements (e.g., referred to as modules or components which represent an IP core or IP block), together with software drivers that control their operation. The above listing of hardware elements is not exhaustive. A SoC may include protocol stacks that drive industry-standard interfaces like a universal serial bus (USB).
Once the overall architecture of the SoC has been defined, individual hardware elements may be described in an abstract language called RTL which stands for register-transfer level. RTL is used to define the circuit behavior. Hardware elements are connected together in the same RTL language to create the full SoC design. In digital circuit design, RTL is a design abstraction which models a synchronous digital circuit in terms of the flow of digital signals (data) between hardware registers, and the logical operations performed on those signals. RTL abstraction is used in hardware description languages (HDLs) like Verilog and VHDL to create high-level representations of a circuit, from which lower-level representations and ultimately actual wiring can be derived. Design at the RTL level is typical practice in modern digital design. Verilog is standardized as Institute of Electrical and Electronic Engineers (IEEE) 1364 and is an HDL used to model electronic systems. Verilog is most commonly used in the design and verification of digital circuits at the RTL level of abstraction. Verilog may also be used in the verification of analog circuits and mixed-signal circuits, as well as in the design of genetic circuits. In some implementations, various components of control system 200 are implemented on a printed circuit board (PCB).
The time series power values form a curve 303. A time=0 is the motor is initially energized—i.e., electrical current is provided to the motor. As illustrated, the power initially spikes from 0 watts to over 600 watts. This initial spike is a manifestation of a phenomena called “inrush current”, also referred to as “locked rotor current.” Inrush current is the excessive current flow experienced within a motor and its conductors during the first few moments following the energizing (switching on) of the motor. The peak value of this spike, the time it takes to reach the peak value, and the rate at which the power consumption reaches and recedes from this peak value all may be impacted by the load the food item imposes on the motor. As such, the peak value of this spike, which is also the peak value of the entire curve 303, the time it takes to reach the peak value, and the rate at which the power consumption reaches and recedes from this peak value, may be indicative of the type of food being processed. Graph 304 illustrates a subset of the curve 303 of time series property values, from 0-5 seconds. Graph 302 illustrates a subset of the curve 303 of time series property values, from around 5 seconds through about 15 seconds, in which only a subset of the vertical axis is shown, representing a sub-range of the power consumption values shown in graph 302 and 304.
As illustrated in graphs 304 and 306 of
The time period of detection, features for which values are determined, and the particular times and sub-periods for which these feature values are determined, may vary, and are not limited to those illustrated and described herein. In some implementations, these parameters and their values are selected based on testing and empirical data from which the parameters that are optimal for generating feature values to distinguish between food items can be determined.
In some implementations, controller 202 and/or food analyzer 308 can classify the processed food item based on one or more of the feature values determined from the time series data, e.g., the time series property values, for example if one or more food items derived from ingredients 106 includes a nut-butter. Food analyzer 308 may be implemented as a software program or function, hardware function, firmware functions, or a combination thereof. In some implementations, controller 202 implements food analyzer 308 as computer-implemented program, function, and/or routine. This classification can occur via one or more neural networks, such as a multi-layer perception (MLP) classifier. In some implementations, this classification can include classifying the one or more food items derived from ingredients 106 as nut-butter or another thicker food type. Determining certain properties/features of one or more food items being processed, as illustrated in graphs 302, 304, and 306, can further include controller and/or processor 202 first sensing, for example, the food processor container type, size, or other related attributes. This data can provide classification and/or categorization information, which can aid controller 202 and/or processor in assigning one or more actions to accommodate the relevant component. For example, controller 202 may instruct motor 214 to perform differently depending upon the size of the blending container 108. For example, these actions and/or performances may include controller 202 directing more or less current and/or power to motor 214, directing more or less current and/or power to a heating element, directing different drive shaft rotation speeds, and/or adjusting an amount of time or periods when the motor is rotating.
As shown in
This set of feature values, which can be determined via the detected time series data and/or patterns shown in graphs 302, 304, and 306 of
As shown in
In some implementations, the following array holds the program time (ti) associated with each data point (e.g., time to be added), with the same number of rows as the above data array:
According to
where x is the raw detection vector data, u is the mean value of the detection vector data, e.g., mean value of current or wattage, S is the standard deviation of the detection vector data, and Xscaled is the scaled detection vector data.
In some implementations, scaling to use int8_t may not have a dramatic effect on the results of the food type analyzer 308; therefore, it may be important to ensure a new data point remains within the target range.
Additionally, in
where j=1, m=number of iterations, xj=Object A vector point first coordinate value, yj=Object B vector point first coordinate value, p=order (via integer value) between two points, dBC=Bray-Curtis distance, and dM=Mikoswki distance. For Bray-Curtis, which can measure the distance between points A and B, if all coordinates are positive, its value is between 0 and 1. If both Objects are in the 0 coordinates, such as (0,0), however, the Bray-Curtis distance may be undefined. The normalization can be done using the absolute difference divided by the summation. For p≥1, the Minkowski distance is a metric as a result of the Minkowski inequality. When p<1, the distance between (0,0) and (1,1) is 21/p>2, but the point (0,1) is at a distance 1 from both of these points. Since this violates the triangle inequality, for p<1, it is not a metric. However, a metric can be obtained for these values by simply removing the exponent of 1/p. The resulting metric is also an F-norm.
According to the example implementation of
where d=distance between two Objects/vector points, z=number of distance calculations between two respective Objects/vector points, and w=weight. At this time, the output from food type analyzer 308 is returned and represented in the easternmost region of graph 302 of workflow 300, illustrated as “Added Time.”.
In some implementations, a special sensor chip can sample, detect, and/or monitor power by sampling the voltage on a terminal/lead of the motor. A controller, such as controller and/or processor 202 of
A nearest neighbor analysis, which may be similar or different to the KNN analysis discussed in
In some implementations, controller 202 identifies one or more types of food items associated with a detection vector by determining a position of the detection vector, e.g., detection vector 402, in the multi-dimensional feature space 400 relative to positions of some or all of food item vectors (e.g., food item vectors 410, 412, 426, and 428), respectively, in the multi-dimensional feature space 400. Controller 202 may determine one or more actions based at least in part on the identified one or more types of food items. Controller 202 may control an operation of a controllable component, e.g., motor 214, based at least in part on the determined one or more actions. In some implementations, controller 202 determines one or more actions based at least in part on the area, e.g., area 416 or area 418, where a detection vector is located in the feature space 400. For example, detection vector 406 is located in area 416 which may be associated with a nut butter group or subset of food items, while detection vector 402 is located in area 418 which may be associated with a non-nut butter and/or drink group or subset of food items. Controller 202 may control an operation of a controllable component, e.g., motor 214, based at least in part on the determined one or more actions associated with a group or subset of food items.
In one implementation, a microcontroller and/or microprocessor, such as controller and/or processor 202, receives a series of signals from motor 214 from one or more sensors, such as sensor 206. Processor 202, via food type analyzer 308, determines a power consumption timeseries pattern of the motor 214 over the first time period. Processor 202 identifies a plurality of timeseries pattern features associated with the timeseries pattern and then calculates a detection vector, e.g., detection vector 402, based on the plurality of time-series pattern features. Depending upon the underlying feature values from the time series which result in detection vector 402, an initial classification of food type, such as nut butter in area 416 or drink in area 418, can include an MLP classification resulting in a KNN or non-KNN analysis. These classification events can aggregate over time to more effectively and efficiently inform additional classifications. Controller 202 and/or food type analyzer 308 compares a position of the detection vector 402 with the positions of some or all of the plurality of food item vectors in the multi-dimensional feature space 400. Controller 202 and/or food type analyzer 308 identifies the food item associated with detection vector 402 by determining which one of the plurality of food item vectors is closest to detection vector 402 in the multi-dimensional feature space 400, such as food item vector 410 at distance 420 from detection vector 402. If food item vector 410 is associated with a smoothie, controller 202 and/or food type analyzer 308 determines that food item being processed is a smoothie. Controller 202 may then determine how much longer motor 214 and mixing blades should rotate, e.g., a second period of time. In one implementations, controller 202 determines the second time period based on one or more of the closest food item vectors such as, for example, food item vectors 410, 412, 424, and/or 426. In some implementations, controller 202 determines the second time period based on a combined weighted average of extra time depending upon one or more determinations associated with each of the food item vectors being used to identify the detection vector (e.g., food item vectors 410, 412, 426, and 428), until motor 214 is stopped to realize a more accurate and/or consistent smoothie.
In another instance, controller 202 and/or food type analyzer 308 receives a series of motor 214 signals from one or more sensors, such as sensor 206. Controller 202, via food type analyzer 308, determines a power consumption time-series pattern and/or data set of the motor 214 over the first time period. Controller 202 identifies a plurality of time-series pattern features associated with the time-series pattern and then calculates a detection vector, e.g., detection vector 404, based on the plurality of time-series pattern features. In some implementations, calculating a detection vector includes determining a time series pattern from the detected signals, with the time series pattern including a gradient of power curve, e.g., curve 303. Controller 202 and/or food type analyzer 308 compares a position of the detection vector 404 with the positions of the plurality of known food item vectors in the multi-dimensional feature space 400. Controller 202 and/or food type analyzer 308 identifies the type of food item associated with detection vector 404 by determining which one of the first plurality of food item vectors is closest to detection vector 404 in the multi-dimensional feature space 400. In this instance, the closest know food item vector is vector 412. If known food item vector 412 is associated with whip cream, controller 202 and/or food type analyzer 308 determines that food item being processed is whip cream. The processor 202 may then determine how much longer motor 214 and mixing blades should rotate, e.g., a second period of time, until motor 214 is stopped to realize a more accurate and/or consistent whip cream.
In some implementations, an additional series of motor signals corresponding to processing a food item can be detected to more accurately identify and/or confirm the type of food item being processed. For example, after controller 202 classifies a type and/or first subset of food item vectors, as a nut butter, one or more sensors, such as sensor 206, may continue sensing for an additional period of time, e.g., 15 seconds, and provide an additional series of motor 214 signals to controller 202 and/or food type analyzer 308. Based on analyzing this additional series of motor signals, controller 202 may operate motor 214 to rotate the mixing blades of blade assembly 102 for an additional period of time. These additional series of motor 214 signals may include a power consumption and/or motor current trend over multiple increments or periods of time, such as over multiple 100 ms time segments, that are output from sensor 206 and analyzed by controller 202 and/or food type analyzer 308. Based on its analysis, controller 202 and/or food type analyzer 308 may determine and/or confirm the identity and/or classification of a food item and, thereby, determine that additional processing of the food item is necessary. This determination may be based on, for example, if the power consumption trend of motor 214 as detected every 100 ms trends in an increasing or decreasing direction or is greater than or equal to a threshold rate of increase or decrease, or is greater than or equal to a threshold increase from a minimum recorded value.
In some instances, in
In some implementations, controller 202 is configured to identify one or more types of food items, such as a type of nut butter associated with detection vector 408 and a type of frozen drink associated with detection vector 402, based on applying a weight factor to some or all of the food item vectors in feature space 400, such as food item vectors 410 and 412. In some implementations the weight factor is based on at least one of: a distance of a food item vector from the detection vector, a type of food item associated with a food item vector, a frequency of determining a type of food item, and a type of container used during food processing, within multi-dimensional feature space 400. For example, a weight factor can be measured and/or assigned on a scale of 0.0-1.0, or any other reasonable weighted scaled metric, that may be used to adjust a value of one or more features of a food item vector and/or shift the position of a food item vector in the multi-dimensional feature space 400, to effect identification of the type of food item by controller 202. In some implementations, each of the food item vectors can be associated with a known type of food item such as food item vector 410 which may be associated with a margarita drink. Further, some or all of the food item vectors may be used by controller 202 to identify a food item associated with a detection vector. As previously discussed, a first plurality of food items vectors can be based on retrieving data related to the one or more food items (e.g., food item vectors 410, 426, and 428), that, based on the one or more components, can be used to identify a food item associated with a particular detection vector (e.g., detection vector 402) as being associated with a margarita drink) in order to determine blending conditions, such as time period of blending by operating motor 214, speed of motor 214 at certain time periods, temperature of a food item at certain times and/or periods, pressure in a blending and/or mixing chamber such as jar 108, and so on. Each food item vector can define values for multiple features.
Process 600 also includes detecting, via a monitoring device such as sensor(s) 206, at least one property associated with the processing of one or more food items during a first period of time, where a first series of detection signals are generated from the at least one property detected over the first period of time (Step 604). Process 600 includes storing, in a memory such as memory 204 and/or data storage 208, a plurality of food item vectors (e.g., food item vectors 410, 412, 426, and 428), where each food item vector defines values for a plurality of features in a multi-dimensional feature space 400, such that each of the plurality of food item vectors is associated with a type of food item (Step 606). Then, calculating, by controller 202 and/or food item analyzer 308, a detection vector, e.g., detection vector 402, based on the series of detection signals, where the detection vector defines feature values for a plurality of features in the multi-dimensional feature space 400 (Step 608). Controller 202 and/or food item analyzer 308 identifies one or more types of food items associated with the detection vector, e.g., detection vector 402, by determining a position of the detection vector in the multi-dimensional feature space relative to positions of one or more of a plurality of food item vectors (e.g., food item vectors 410, 426, and 428), respectively, in the multi-dimensional feature space (400) (Step 610). For example, food item vector 410 may be associated with a margarita drink. Food item vectors 426 may be associated with another type of frozen drink, while food item vector 428 may be associated with a peanut butter.
In one implementation, controller 202 may determine that detection vector 402 is associated with a margarita drink based on food item vector 410 being closest to detection vector 402. Controller 202 may identify the type of food item associated with detection vector 402 based on the position of detection vector 402 in relation to one or more of the known food item vectors in feature space 400. Controller 202 and/or food item analyzer 308 may then determine one or more actions based at least in part on the identified one or more types of food items (Step 612). Controller 202 may control operations of the controllable component, e.g., motor 214, based at least in part on the determined one or more actions. For example, the one or more actions may include controller 202 continuing to operate the controllable component for a second period of time based on the identified one or more types of food items. Controller 202 and/or analyzer 308 may identify a food item based at least in part on performing a K-NN analysis. Controller 202 may determine a how much longer motor 214 and one or more components, such as mixing blades, should rotate, e.g., a second period of time, until motor 214 is stopped to realize a more accurate and/or consistent smoothie.
In some implementations, the second period of time is between 0 seconds and 30 seconds. In some implementations, the second period of time is 15 seconds. In some implementations, the first period of time is 15 seconds. Further, identifying the food item can be based, at least in part, on a K-NN classification. Further, calculating a detection vector can include determining a time series pattern from the detection signals, where the time series pattern includes a gradient of power curve. In some implementations, the type of food item identified via processes 500 and 600 includes one of a apple-peanut-butter smoothie, beat-ginger-smoothie, chocolate-peanut-butter-oat, maple-almond-butter, cinnamon-coffee-smoothie, citrus smoothie, essentially green smoothie, triple-green smoothie, tropical smoothie, smoothie of any type, extract, sauce, ice cream, pudding, nut butter, whip cream, margarita, pomegranate-cashew berry, strawberry-banana, strawberry-limeade, and a frozen drink.
Elements of a computer include one or more processors for executing instructions and one or more storage area devices for storing instructions and data. Generally, a computer will also include, or be operatively coupled to receive data from, or transfer data to, or both, one or more machine-readable storage media, such as mass storage devices for storing data, such as magnetic, magneto-optical disks, or optical disks. Non-transitory machine-readable storage media suitable for embodying computer program instructions and data include all forms of non-volatile storage area, including by way of example, semiconductor storage area devices, such as EPROM (erasable programmable read-only memory), EEPROM (electrically erasable programmable read-only memory), and flash storage area devices; magnetic disks, such as internal hard disks or removable disks; magneto-optical disks; and CD-ROM (compact disc read-only memory) and DVD-ROM (digital versatile disc read-only memory).
Elements of different implementations described may be combined to form other implementations not specifically set forth previously. Elements may be left out of the systems described previously without adversely affecting their operation or the operation of the system in general. Furthermore, various separate elements may be combined into one or more individual elements to perform the functions described in this specification.
Other implementations not specifically described in this specification are also within the scope of the following claims.
Number | Date | Country | |
---|---|---|---|
Parent | 18207935 | Jun 2023 | US |
Child | 18208100 | US |