Patent Grant
10730397
At their core, robotic floor cleaners integrate at least two primary functional systems: (1) a cleaning mechanism, which cleans the floor in the area where it is placed or moved across, and (2) a mobile robotic platform, which autonomously moves the cleaning mechanism across the floor to different places. Both of these functional systems must work adequately for the robot to be effective at cleaning.
While both functional systems set requirements and constraints on the design of the overall robot, the challenge of developing a mobile robotic platform that can autonomously move around in nearly an infinite variety of highly unstructured environments (e.g. people's homes) tends to be the dominant consideration and has had a significant effect on the design of home cleaning robots to this date.
In terms of robotic floor cleaners currently available, the constraint is so great that the vast majority of units manufactured to this date follow the same general form factor. The mobile robot platform is contained within a shell having a circular base, similar in shape to hockey puck but much larger than that. Two independently controlled drive wheels are set within the circle on opposite sides of the robot. The wheels are along the center axis of the circle bisecting the forward and rear halves of the robot.
In addition, the mobile robot platform has one or more caster wheels for support at the forward and/or rear ends of the robot to provide lateral stability and act as part of the robot's suspension. Some designs use only one caster in the front, but distribute the weight to be heavier in the front to keep the robot from tipping backward.
The circular shape makes the robot much easier to navigate around obstacles and along walls. With the wheels fully nested within the circle and placed along the center axis, the robot can effectively turn in place to change its heading without the sides of the robot hitting any exterior obstacles.
The cleaning robot design also allows contact sensors (e.g., located on a bumper) and proximity sensors (IR sensors) to be placed along the outer sides of the robot to detect obstacles and follow along walls and furniture. In some designs, the bumper may extend outside the boundary of the circular base as a means for feeling for walls and obstacles as the robot turns. The current cleaning robot design also includes drop sensors beneath the robot for detecting drop offs in the floor before the robot drives over a hazard.
Examples following this design framework include robot vacuum cleaners such as Eletrolux®'s Trilobite®, iRobot®'s Roomba®, Yujin's iClebo, Samsung®'s Hauzen® robots, as well as floor scrubbing robots such as iRobot®'s Scooba® robot. The downside of the presently available solution for the mobile robotic platform is that the current configurations limit the size, reach and effectiveness of the cleaning mechanism.
In the typical robotic floor cleaner approach, the primary cleaning mechanism (such as a vacuum or beater brush) is designed to fit entirely within the footprint of mobile robot platform. Given that the dominant platform shape is circular for most robotic floor cleaners, the cleaning apparatus necessarily has be narrower than the robot itself, cover a smaller area of the floor relative to the size of the overall robot, and is not able to directly reach all the way to walls and into corners. This is particularly sub-optimal for cleaning mechanisms such as vacuums, brushes and other devices, which tend to be rectangular in shape and don't match well with the geometry of a circle.
To compensate for this limitation, designers of the robotic cleaners have added an “edge cleaning” feature in the form of a small side spinning brush that reaches out from the side of the robot. The small side spinning brush attempts to draw debris into the path of the cleaning apparatus, although this has limited effectiveness and often needs to be replaced due to wear.
The typical placement of the wheels and casters to support a circular robot platform places additional constraints on the cleaning mechanism. As one limitation, the cleaning mechanism can not extend to an area where there is a wheel or caster, further limiting its size and configuration. Additionally, the robot usually requires a more complex suspension system to keep the cleaning mechanism in contact with the floor to be effective in cleaning, while at the same time maintain primary contact between the floor and the wheels and casters in order for the robot to be effective in driving over the floor surface and over small obstacles.
A number of variations on the typical robot floor cleaner configuration have been proposed in an attempt to reduce the constraints on the cleaning apparatus and increase its effectiveness, but these solutions still prioritize the mobility and function of the robotic platform over the function of the cleaning mechanism itself.
Products with a non-circular shape, such as The Shaper Image®'s oval shaped eVac™ robotic vacuum, have been introduced to the market. In this oval-shaped robotic vacuum, the front leading edge was flattened to allow the vacuum to reach parallel to the wall in front of the robot, but the cleaning mechanism was still nested within the shell of the cleaning robot and did not extend to the sides.
Other robotic cleaner designs have been disclosed which combine a mobile robot platform with a cleaning apparatus that is partially or fully extending past the footprint of the mobile robot platform. These examples include a robot with a flexible tail extending outside the shell of the cleaning robot, Proctor and Gamble, (“P&G”), robots with a trailing clearing module (S C Johnson and Minolta), as well as a cleaning module that is movable relative to the mobile robot platform. (Minolta)
U.S. Pat. No. 6,779,217, assigned to P & G, discloses a mobile robot platform which utilizes the standard circular design, but also includes a flexible “appendage” in the form of a triangular tail, where the triangular tail holds a cleaning cloth. The advantage of this design is that it can reach into corners with the extended tail, as well as clean along the edges of furniture and walls. However, the extended reach of its cleaning abilities works only when the cleaning robot turns in place to “sweep” along the radius of the turn. While the “appendage” approach provides a beneficial supplementary function for catching extra dirt and dust, this approach does not overcome the limitation of the primarily cleaning mechanism being placed within the footprint of the mobile robot platform. For example, if the cleaning robot drives along the side of a wall, it will still not clean a majority of the gap between the primary cleaning mechanism and the wall, and will only do so in the limited area where the cleaning robot makes a turn.
S C Johnson, in U.S. application Ser. No. 10/218,843, disclosed a configuration which combines a circular mobile robot platform with a trailing external cleaning pad that could hold a cleaning cloth or other material. This cleaning robot design allows the external cleaning pad to be as wide as the cleaning robot, and provides that the edges of the cloth can extend past the width of the pad to reach along walls and into corners. The drive system and sensors for the robotic cleaner would be in the front circular section as part of the mobile robot platform. The limitation of this design is the larger size and longer shape of the combined form factor, which limits how well the robot would be able to navigate in tighter spaces. This robotic cleaner configuration would have the advantage of the standard circular design for turning along walls and, to some extent, maintain the benefits of being able to bump and turn to get around forward obstacles. However, the extended length of the cleaning robot would provide challenges for turning in tighter spaces, as well as for getting in and out of cluttered environments, such as between chair and table legs which are clustered together. The extra length of the trailing pad would prevent the cleaning robot from navigating into spaces a robot with just the circular section could enter.
In U.S. Pat. No. 5,894,621, Minolta disclosed a similar robotic cleaner configuration of a cleaning pad trailing the mobile robot platform, where the pad would be larger than the robot body to allow greater access to walls and side cleaning. However, this configuration would still have the same limitations of navigating in tight spaces given the overall length and distance from the wheels to the cleaning pad.
In U.S. Pat. No. 5,720,077, Minolta disclosed another cleaning robot design where the cleaning mechanism is external to the mobile robot platform. The cleaning robot expands its reach by making both (1) the cleaning mechanism's position adjustable to the mobile cleaning robot and (2) making the mobile robot platform drive wheels change the primary axis of direction, relative to the cleaning mechanism, in order to drive it in different orientations. This robotic cleaner design offers a greater degree of flexibility for cleaning in different spaces, but comes at a price of significantly more cost and complexity. Specifically, this robotic cleaner design includes more moving parts and more sensors to judge situational conditions and control the position of the cleaning mechanism, so this will likely result in a physically larger robot. While this may be appropriate for a commercial robotic cleaner for large office and commercial spaces, this disclosed cleaning robot design would not fit the requirements of a consumer robotic cleaner needing to clean in tight spaces, such as around a kitchen table that is positioned close to one or more walls, which also includes a number of chairs, as well as in places deep under low furniture.
The cleaning pattern and navigation strategy of consumer robots is also an area in need of improvement. The vast majority of current consumer cleaning robots on the market utilize a random or semi-random navigation scheme for controlling the robot's driving behavior. This is primarily because in the past there has not been an effective and low-cost navigation solution that can track the robot's position and guide it to intelligently cover the desired area for cleaning the floor.
Instead, cleaning robots normally rely on a relatively simple set of behaviors and algorithms that combine driving, obstacle detection and avoidance, wall following and random variables in an attempt to “bounce” the robot around the floor space. The rationale is that over enough time, the robot will reach all locations in the cleanable area just through the process of randomly exploring the room.
This approach has several major limitations. First, the robot must clean for very long periods of time to reach full coverage of a room or other designated area of a home. As noted in U.S. Pat. No. 6,076,025, the rate of new area covered drops significantly the longer the robot operates. Because the robot has little to no prior knowledge of where it has cleaned, it continues to clean over areas that it has already cleaned before as opposed to focusing on areas to it has not yet reached. As more area of the room or area of the home is covered, the random method works against the robot, as the robot spends proportionally more and more time cleaning areas it has already cleaned. For a typical large room or area in a home, the robot runs out of battery power before it's able to reach all locations in the target area.
In U.S. Pat. No. 6,076,025 (“the '025 patent”) assigned to Honda, Honda discloses an enhanced approach by having the robot periodically clean in an outward spiral pattern during the course of randomly navigating through a room. This approach has the benefit of filling in more area in different locations and improving the efficiency curve relative to a pure random approach, but the same core dynamic exists in terms of making the robot becoming increasing inefficient as more of the room is covered.
As another limitation, cleaning strategies that are described as random or semi-random do not normally result in a random distribution of cleaning coverage across a typical room or area of a home. In a completely empty room where there are only walls and not interior obstacles, each area of the floor will have an equal chance of being cleaned within a certain amount of time. So on any given run, one part of the room is just as likely as another part of the room to get cleaned. As more runs are made or repeated, the odds increase that a specific part of the room will be cleaned.
However, rooms and areas in homes are not empty, and instead have a variety of interior obstacles which the robot must navigate around. Additionally, these obstacles are not randomly dispersed. Rather, large obstacles, namely furniture, are clustered together and form uneven barriers of entry for a robot to navigate through. A common example includes a dinning table and chairs, which create a “forest” of furniture legs concentrated in a certain area of a room. Another common example is a living room furniture set, such as a long couch, coffee table, side chairs and side tables clustered in a pattern, such as U-shape or L-shape configuration.
In theory, the random approach gives infinite opportunities for the robot to find openings in the room between obstacles by hitting them in all points along their perimeter at virtually all angles. However, this process takes time for enough permutations to take place and for a large percent of those permutations, the robot may be frequently blocked and/or deflected away from areas occupied by these obstacles. The net result is that the robot following a random approach is “corralled” away from dense or blocked areas, and tends to stay into more open spaces. This often causes the robot to significantly over-clean some areas of the room or areas of the home while under cleaning other areas. In other words, a random and/or semi-random guided robot can systematically avoid and under-clean certain areas, over and over. This results in poor cleaning of those areas, inefficient use of energy, as well as excess wear on the robot and potentially of the floor covering in the over-cleaned areas.
These limitations of a random or semi-random approach, the general low efficiency in reaching all areas of the floor, and the systematic pattern of repeatedly missing certain parts of the floor area, are counter-productive to the primary cleaning function of the robot. This is especially true for robotic cleaners which use a consumable material for cleaning that has a limited period of use. As an example, for robotic cleaners such as described in this invention which uses a wet cleaning pad, the dispersion of fluid on the floor would be concentrated in certain areas of the room, possibly to the point of pooling and leaving streaks and residue spots on the floor. At the same time, the pad dries up as it cleans, meaning areas that are not reached until later will not be wet or cleaned at all.
To address these limitations, companies have proposed and in a few instances developed robots which use a systematic or semi-systematic cleaning strategy. These robots generally follow some pre-defined cleaning behavior or pattern, such as crossing the floor in parallel rows, to provide a more even and controlled method of cleaning the floor area. For example, Samsung U.S. Pat. No. 7,480,958 discloses these types of robots.
For open areas of a room, a parallel row pattern can be much faster at covering a large amount of area in much less time than a random approach. These patterns can also have the benefit of using the driving pattern to probe for open areas amidst obstacles that lie in the path of the rows. In the case of a robot cleaning in a pattern of parallel rows, the ends of the rows provide an opportunity to probe for open spaces between obstacles in a fast and systematic way. For example, if the direction of the rows is roughly perpendicular to a boundary formed by a cluster of furniture, then the robot has the opportunity to attempt to pass into openings in the cluster on each returning pass. By controlling the spacing on the rows and using heuristics for when to attempt to follow around an obstacle, the robot can be much more methodical about finding spaces in between obstacles that a random approach would initially miss.
The challenge with systematic cleaning patterns is that the structure of the pattern may be too rigid to adapt enough for successfully covering all areas in a complex environment. While a random cleaning strategy over time will allow the robot to find its way almost everywhere just by chance, although not efficiently or with equal success, a systematic strategy alone can not guarantee full coverage. The problem is the pattern generally has one preferred direction and follows rules about which way to proceed when it has multiple directions to select from. So in the example of the parallel rows, the robot may end up cleaning on side of a kitchen aisle, but miss the other side.
To make structured patterns work in unstructured environments, more capabilities have to be added to the system to track the robot's position, keep a map of where it has cleaned and identify areas that have not been reached. To date, very few systems have been developed that would be suitable for a home cleaning robot. As one example, the Samsung® Hauzen® vacuum cleaning robot uses a camera to create a map of where it cleans to provide some of these functions, but this product requires complex image recognition software and more expensive sensors and internal computing hardware built into the robot. To date, this product is significantly more expensive than even the premium version of the leading models for robotic floor cleaners, and accounts for a very small share of the market. Evolution Robotics® has alternative vSLAM® localization system utilizing a camera and visual pattern recognition to construct a map of the environment, recognize where the robot is, and guide the robot, but this system too requires generally more processing and memory than is on the current generation of cleaning robots. Evolution's patents disclosing vSLAM localization system information include U.S. Pat. Nos. 7,272,467; 7,177,737; 7,162,338; 7,145,478; 7,135,992 and 7,015,831. For the vast majority of robots sold to consumers, random or semi randomly cleaning remains to be the standard.
In an embodiment of the invention, the cleaning robot solves a current problem of extending cleaning reach, while achieving reliable cleaning robot mobility by using a unique configuration where the cleaning apparatus (e.g., the cleaning pad which holds the cleaning cloth) forms a major part of the mobile robot platform and overall body. In this embodiment of the invention, the cleaning apparatus (1) is located at the front of the cleaning robot to reach any part of the cleaning path travelled, (2) fully extends along the forward leading edge and sides of the cleaning robot to enable the cleaning cloth to reach to walls, along furniture, into corners and under low objects, (3) provides a large surface at the bottom side of the cleaning pad for maximizing the floor area covered by the cleaning cloth, (4) maintains maximum contact between the cleaning cloth and floor by utilizing the cleaning pad itself as primary suspension point for the robot, and (5) minimizes the size of the drive portion of the cleaning robot relative to the size of the cleaning pad, to enable the overall robot to be small and capable of maneuvering in tight spaces a larger robot could not reach.
In this embodiment, the cleaning robot is designed utilizing the cleaning mechanism (or apparatus) as the base module in the mobile robotic platform, and then optimizing the remaining elements to complement the function of the cleaning apparatus.
This robotic cleaner configuration has additional advantages, which include, but are not limited to: (6) providing a form factor where the front of the robotic cleaner mimics the cleaning pad found on conventional manual cleaning mops that use an attachable cleaning cloth; (7) being compatible with standard size cleaning cloths sold for manual cleaning mops widely available on the market; (8) providing users an immediately familiar design that communicates its function; and (9) closely following a normal use pattern for attaching and removing cleaning cloths.
In an embodiment of the invention, a primary cleaning mechanism or assembly is a cleaning pad holding a dry or wet cleaning cloth. In alternative embodiments of the invention, the function of the cleaning mechanism (or apparatus) is changed, but the core cleaning robot configuration remains the same. In one alternative embodiment of the invention, a forward cleaning mechanism is included having a powered rotating brush and dust collection bin, which is in a rectangular form like the cleaning pad described in this invention. In this embodiment of the invention, the cleaning mechanism has one or more rotating brushes along the front leading edge, and one or more dust bins located behind the cleaning brushes in front of the wheels of the cleaning robot.
In another embodiment of the invention, the cleaning mechanisms or assemblies are detachable and swappable, so that a cloth cleaning pad holder can be removed from the robot and replaced with a compatible cleaning module that features, for example, the powered rotating brush and collection bin. In this embodiment, the compatible cleaning module may have both a physical interface for locking and unlocking with the rest of the cleaning robot, as well as an electrical interface for providing power from the cleaning robot to the compatible cleaning module, as well as provide any data communication between sensors located on the cleaning module and the robot's main computing unit.
In another embodiment of the invention, the cleaning assembly may support an automatic cloth changing function to allow the robot to operate for longer periods of time before requiring action from the user. In one embodiment of this function, the user may load multiple cleaning cloths onto the robot cleaning assembly, and the robot can mechanically remove a cleaning cloth to change to a fresh one. The trigger for removing a cleaning cloth may include but is not limited to: duration of cleaning time for a given cloth, amount of area covered with a given cloth, and/or sensing of the amount of dirt built up on a cloth, such as through utilizing a reflective light sensor position near the cloth. The user may have options for setting when and under what conditions the cloth is removed. The main body of cleaning robot may include cleaning cloth software, located in memory in a microcontroller or in a separate memory, that identifies when a cleaning cloth needs to be removed. Alternatively, the cleaning assembly may include a sensor which is connected to the microcontroller in the main robot body that identifies an amount of dust built up on a cloth and transfers such information to the microcontroller.
The mechanism for removing a cleaning cloth by the robot may include but is not limited to: having a motorized hook on the robot, such as a hook or set of hooks on a tread that rotates over an area of the cloth to grab the outer cloth and pull it back into a storage area on the robot, leaving a fresh cloth exposed to continue cleaning. In another embodiment of the invention, the cleaning robot may drive to an external pad changing device, where the robot drives to physically dock with the pad changing device, and the pad changing device includes a mechanical hook or set of hooks that make contact with outer cloth to remove it, either through powered rotation of the hooks to pull the cloth off, through a process of have the robot drive back away from the device as the hook or hooks on the pad changing device statically pull the cleaning cloth of the cleaning pad, or a combination of the two systems.
In another embodiment of the invention, the cleaning mechanism may include a cleaning cloth which is stored on a roll, where the cleaning cloth is fed from out of the roll, transitions across the bottom surface of the cleaning pad, and into a collection mechanism. In an embodiment of the invention, the collection mechanism may be a rotating dowel, which pulls on the cleaning cloth as it turns, and advances the cloth roll so that the section of the cloth that has been exposed to floor surface beneath the pad may advances to allow a new clean section of the cloth to be used. This mechanism allows the robot to roll a section of cleaning cloth as it becomes dirty off the pad and replace it with a clean section. In embodiments of this invention, the trigger for advancing the cloth may include but is not limited to duration of cleaning time for a given section or area of the cloth, amount of area covered with a given section or area of the cloth, and/or sensing of the amount of dirt built up on a section or area of the cloth, such as through utilizing a reflective light sensor position near the section of the cloth exposed to the floor. The user may have options for setting when and under what conditions the cloth is advanced. In an embodiment of the invention, the cleaning cloth roll may be attached by the user as a roll that loads into the cleaning mechanism, where the user feeds the roll onto a collecting spool included in the cleaning mechanism. In an embodiment of the invention, the cleaning cloth roll may be packaged within a cartridge with contains both the original roll and a collection spool for advancing the cloth material and rolling up the used material, along with mechanical and/electrical connections which allow the robot to control and advance the roll.
Embodiments of the invention as well as additional embodiments using alternative cleaning mechanisms or modules are disclosed below.
In an embodiment of the invention, the cleaning assembly 11 is not removable (or detachable) from the main robot body 12, but the cleaning assembly 11 may slide out forward a few centimeters from the robot drive body 12, like a drawer. In this embodiment of the invention, the cleaning assembly 11 may be pulled away from the robot drive body 12, and a user may drape one end of the cleaning cloth around the rear of the cleaning assembly 11 and lock it into the rear cloth holders (e.g., 19c and 19d of
In another embodiment of the invention, the cleaning assembly may open a gap up between the cleaning assembly and a robot shell in a different type of configuration than sliding out, but with the same effect of creating a gap for attaching and removing the cleaning cloth. This embodiment of the invention may include having the cleaning assembly pull out at an angle relative to the robot shell, such as in a direction that combines downward and forward movement relative to the shell rather than strictly forward movement relative to the shell. In another embodiment of the robotic cleaner, the cleaning assembly may swing open from the rear of the cleaning assembly, with the cleaning assembly pivoting at a forward point near the front of the shell, and the rear of the cleaning assembly drops below the level of the wheels to open up a gap for attaching and removing the cleaning cloth along the rear of the cleaning assembly.
In an embodiment of the invention, the cleaning assembly 11 is comprised on a hard, flat plastic top 16 and a soft rubber bottom pad 17 for holding the cleaning cloth to the floor. The soft rubber bottom pad 17 extends around the bottom and lower edge of the plastic top 16 to provide a surface for the cleaning cloth to wrap around the sides. The soft rubber bottom pad 17 also provides a flexible edge for when the robotic cleaner makes contact with walls, furniture and other obstacles. This configuration of the cleaning assembly 11 is similar to the standard placement of cleaning cloths on manual mops, and provides all the of same cleaning advantages provided by exposing a broad bottom surface area as well as side edges as part of the cleaning cloth. For example, it allows the cleaning assembly 11 to reach into corners, along walls, under and around furniture and other objects.
As illustrated in
Returning to
The robot drive body is covered by a shell 29 (in
The shell 29 may also provide a critical function relative the cleaning assembly 26, in that in closes off any open gaps or catch points between cleaning assembly 26 and the rest of robotic cleaner 20 when the cleaning assembly 26 is in the closed position. If open gaps were exposed, the robotic cleaner 20 may catch on wires or other objects and get tangled. As illustrated in
If the cleaning assembly is in the closed position, the cleaning assembly and shell are rigid relative to one another and form a unit that moves together. If the cleaning assembly is lifted, the shell moves with the cleaning assembly. This robotic cleaner configuration also applies weight and stability to the cleaning pad. For example, if the cleaning robot drives into an obstacle and a force pushes on the cleaning assembly in a direction where it would push the front of the cleaning assembly down and the rear of the cleaning assembly up, the weight of the shell and the resistance of the spring holding the shell over a rear drive assembly of the robotic cleaner would provide leverage for counter-acting that force.
In another embodiment of the robotic cleaner, the cleaning assembly may be designed to freely pivot in one or more directions relative to the shell. The cleaning assembly may freely pivot relative to the shell because there is no rigid connection between the cleaning assembly and the shell. Rather, the two components (i.e., shell and cleaning assembly) would be joined by a pivot joint that provides the desired movement in one or more directions. In this configuration of the robotic cleaner, a gap around the top and the rear of the cleaning assembly with relation to the shell would be present, to allow space for the cleaning assembly to move, such as to tilt up and down (or move side-to-side). In this embodiment of the robotic cleaner, a flexible gasket or skirt on a surface of the shell around or near the cleaning assembly may close off the gap, while still allowing the cleaning assembly to move, and this may present the gap from becoming a catch point for dust or other debris.
If the cleaning assembly and shell lock or close together, a robotic cleaner drive system including the two wheels is designed to move independently relative to the cleaning assembly and the shell. This configuration allows the wheels to maintain contact with the floor regardless of the cleaning assembly position. To achieve this freedom of movement and maintain all three areas on contact on the floor, the drive system may be connected to the shell and cleaning pad through a pivot joint assembly.
Also connected to the pivot joint 91 is a center bracket 93 which connects to the drive box 95. The drive box 95 is connected to the left and right wheels 96 and 97, to form the inner drive assembly. The internal motor assemblies supporting the wheels 96 and 97 (e.g. motor, gearbox and drive shaft) in an embodiment of the invention, are mounted rigidly to the drive box 95, allowing for strong traction and stability when travelling over the floor.
This configuration, in combination with the pivot joint 91, allows the drive assembly to lift up and down relative to the cleaning assembly (as would be seen from a side view), as well as roll relative to the cleaning assembly 94 (as would be seen from a rear view.) This mechanical configuration provides a simple but highly effective gravity based suspension system, where the any one of the 3 areas of contact (i.e., wheels 96 and 97 or cleaning assembly 94) on the floor can lift or fall relatively freely without impacting the other areas of contact.
In this embodiment of the invention, the shell is locked with the motion of the cleaning assembly, and room is provided within the shell to allow for movement of the drive assembly. A spring 98 provides support for the shell in the rear of the robotic cleaner over the drive box 95. In an embodiment of the invention, the spring 98 is set along center axis of the robot so that the shell can “float” over the drive assembly without putting much resistance on the ability of the wheels 96 and 97 to move up and down within the shell. The broad width of the cleaning assembly 94 over the floor provides additional stability to the shell, so while the drive box 95 and wheels 96 and 97 may twist within the shell, the shell itself stays very level because it is stabilized by the cleaning assembly 94.
In this embodiment of the invention, the shell can compress over the drive box 95 when pressed down from a force external to the robotic cleaner. This has two advantages. First, the shell may lower down if the robotic cleaner travels under low clearance furniture and this may avoid the robotic cleaner getting wedged in place. In addition, a limit or contact switch 99 may provide detection if the shell compresses below a certain safety point, triggering the robotic cleaner to reverse its course before it gets wedged.
The ability of the shell to compress on the rear spring 98 also provides room for the shell to drop if the shell is stepped on or has something dropped on top of it. In an embodiment of the invention, a rubber pad is placed along the bottom of the shell at the rear handle 24 (see
A post at the back of the drive box can fit into a slotted guide rail along the rear inner shell (in front of a handle recess) for keeping the drive box aligned in place along the cleaning robot axis. This post and rail may also provide a drop limit for setting how far the drive box and wheels can fall away from the shell. In an embodiment of the invention, the post can be set so that it compresses that spring with some tension when the shell is in its level position, providing for a firmer hold on the shell, but still provide some degree of freedom in the drive assembly. In another embodiment of the invention, the post and rail can be set with adequate clearance, so that in the level position, the shell is lightly resting on the spring, and the drive box has free room to drop without interference.
In another embodiment of the invention, the placement of the post and/or bottom limit may be adjustable by the user through a mechanical interface, such as a sliding switch with different preset positions. By using a sliding switch with different preset positions, a user may adjust the tension and freedom of movement of the robotic cleaner to optimize the suspension for their environment. In addition, in an embodiment of the invention, one or more limit switches may be used to detect if the wheels have dropped as an added safety measure to turn the motors off if a wheel loses contact with the floor surface or detect that the user has lifted the robot up.
In addition to mechanical design of the robotic cleaner, the sensory system is also important to allow the cleaning pad to be fully exposed and not fit within the traditional designs of robotic floor cleaners.
In an embodiment of the invention, one specific design consideration is that the cleaning cloth of the cleaning assembly fully cover the leading edge of the cleaning assembly. The cleaning assembly and cleaning cloth are designed to have the cleaning cloth make full contact with walls and objects in its path, and thus there is no room for mechanical devices such as bumpers or feelers obstructing the cleaning cloth. Further, it is difficult for there to be proximity sensors placed in the cleaning assembly in any way where the cloth may cover them. This also applies for ease of use, so that the users do not have to work around any mechanisms when placing the cloth on the cleaning assembly.
By comparison, traditional robotic cleaners use simple contact sensing devices to detect obstacles, such as a bump sensor, mounted on the leading edge of the main robot body. Additionally, the same robots may also use one or more IR distance sensor or other type of proximity sensor placed along the leading edge of the robot to detect obstacles in the robots path and help avoid them. This placement of sensors along the leading edge of the robot is a very common design, and is in part one of the factors that drives these standard robots to place the cleaning mechanism within the robot body, so that its design and operation does not interfere with the sensors.
In the cleaning mechanism-centered approach described herein, alternative sensors or sensing techniques may be utilized to detect obstacles or drops in surface levels. For bump detection (or detection of obstacles), the robot's main controller (MCU) may detect increases in the motor current, which generally means that the robotic cleaner has hit an obstacle and the wheels are generating additional load on the motors while attempting to still move the robotic cleaner on its desired course. In an embodiment of the invention, a current sensor may transmit this information to the MCU. For wet cleaning application, where the wheels may slip too easily due to loss of traction, in order for enough current load to be detected, an accelerometer may be added to supplement the robotic cleaning system to detect changes in movement without relying on the wheels. The accelerometer may transmit information to the MCU. In both embodiments of the invention, the sensing function is delivered by internal systems within the robot, thus minimizing the external constraints on the robot's exterior design.
In another embodiment of the robotic cleaner, a gyroscope may be used to enhance the functionality of the robotic cleaner while maintaining its non-traditional design. Most traditional robotic cleaners include some type of edge cleaning behavior, often referred to as wall following. In wall following, the traditional configuration was to use side mounted IR proximity sensors to allow the robot to follow parallel with the wall, but just slightly away from the wall, to minimize bumping with the wall. In these traditional robotic cleaners, the bumping could trigger the robot's mechanical bump sensor as well as mark up the wall and furniture over extended periods of contact.
In the robotic cleaner described herein, where the cleaning pad is fully exposed and set to be wider than the shell of the robot, the function for edge cleaning requires that the cleaning robot purposely engages and rubs along the wall with the cleaning cloth wrapped around the sides of the cleaning pad, rather than avoiding the wall at a distance. In one embodiment of the invention, a gyroscope may be used to help perform this function, whereby when the cleaning robot makes contact with the wall, turns in one direction, and then drives with slightly more speed on the wheel opposite the wall, causing the side of the cleaning pad near the wall to plow in toward the wall and drive along it while cleaning. In this embodiment of the invention and under these conditions, the gyroscope may be used to help determine that the cleaning robot is maintaining a straight heading along the wall even through the wheels are purposely slipping to keep pressure against the wall.
In another embodiment of the robotic cleaner, the same approach may be used to clean along furniture and around obstacles, where the edge may not be a straight line. When the edge is not a straight line, the same plowing technique is used to hug along the furniture or obstacle, and the gyroscope provides information about the robot's amount of turn to the microcontroller (MCU) that allows the MCU to compare the estimated turn from the wheels tachometers and, and if there is a difference within a certain threshold, determine the presence of surface providing a resisting force.
In another embodiment of edge cleaning, the robotic cleaner may leverage the flat shape of the leading edge of the cleaning pad to align perpendicularly with walls and other straight surfaces such as area rugs, and the gyroscope is used to then turn the robot 90 degrees to clean in a direction parallel with the wall or the area rug.
In another embodiment, the gyroscope can support the robotic cleaner functionality by also supplementing the bump detection system, (especially on a wet surface). The gyroscope may indicate that the robotic cleaner may be twisting when one side of the pad hits an obstacle. The information from the gyroscope may be provided to the microcontroller (MCU) which would instruct the drive assembly to operate and have the cleaning robot to avoid the obstacle. This would allow the wheels to continue to spin and drive the cleaning robot to skid around the obstacle if desired. In a similar application, the gyroscope may indicate that the robot is not turning when it gets blocked by an obstacle on a turn, and the wheels are continuing to spin.
In another embodiment, the microcontroller (MCU) may make use of the robot's geometry in combination with the gyroscope to determine the general location of an obstacle. As one example, by having a straight and wide leading edge to the front of the robot (as the cleaning pad and cleaning assembly provide), and having the wheels nested in narrower than the width of the cleaning pad, the robot will experience different rotational forces when it hits an obstacle based on the location of the obstacle. For example, if the cleaning robot drives into a chair leg where the right side of the cleaning pad makes contact with the chair leg, the placement of the wheels will create a tendency for the opposite side of the robot to rotate forward and the right side is held back by the chair leg. If the cleaning robot hits the chair leg on the opposite side of the pad, the rotational force with be in the opposite direction. And if the robot hits the chair leg in the middle of the cleaning pad, the rotation force will be centered and canceled out. By measuring the degree of turn when contacting an obstacle, the gyroscope may allow the microcontroller (MCU) to estimate the position of the obstacle relative to the robot, and use that as input to plan a path around the obstacle or perform other maneuvers. This approach provides the benefit of what would normally require a segmented bumper or multiple proximity sensors in the front of the robot to determine obstacle location, without the need to use such sensors and keep the leading edge of the cleaning assembly free of obstructions. In embodiments of the invention, a similar method may be used to detect obstacles along the sides or rear of the cleaning robot based on the resisting rotational force created by the contact with the obstacle. In embodiments of the invention, back current from the motors, wheel tachometer input, accelerometer input and/or other sensors feedback regarding the cleaning robot's motion may be incorporated to assist in detecting contact with an obstacle and/or to help in measuring the direction of the resistance force from the obstacle.
In an embodiment of the invention illustrated in
Because the weighted object 101 is mounted toward the middle of the cleaning assembly relative to the points where the cleaning cloth wraps around the forward and rear edges of the cleaning pad, the natural play (or travel) in the cloth material allows the weighted object 101 to drop even when the user wraps the pad tightly on top. In an embodiment of the invention, a small amount of flexible material may be permanently affixed over the drop sensor 101 and 102 to provide a sealed barrier for preventing fluid from a wet cleaning pad or dust from seeping into the cleaning assembly through the opening around the drop sensor 101 and 102.
The drop sensors 136 are designed to detect sudden drops in the front of the robotic cleaner such as stairways and other types of ledges. In an embodiment of the invention, the drop sensors 136 may also detect if the cleaning assembly is lifted up from the floor, such as if the robot drives onto the edge of a rug or other low object, as a means to avoid driving onto those areas. A motor control module 133 is an electronics assembly or circuitry for controlling torque, speed and direction of rotation of the DC motor. The motor control module may be an H-Bridge which is utilized for controlling a brushed DC motor. The current sensor 134 may provide current feedback to a control algorithm for the DC motor. In an embodiment of the invention, the control software may be located in memory in the microcontroller 130. The encoder 134e provides speed and direction of rotation feedback for the control algorithm of the DC motor. The user interface buttons 135 are located on the robotic cleaner. The user interface buttons 135 include buttons for power on/off and cleaning mode selection. The LEDs 135a are light emitting diodes for providing visual feedback to a user. The LEDs may provide feedback on battery status, charging status and cleaning mode types.
The robotic cleaner may include a buzzer 135b. The buzzer is a speaker for providing audio feedback to the user.
In an embodiment of the invention, a robotic cleaner may include a gyroscope 137. The gyroscope 137 may sense changes in the robotic cleaner's orientation. In an embodiment of the invention, the robotic cleaner may include a sweep generator 137b. The sweep generator 137b is a circuit that provides a calibration circuit for an analog-to-digital converter. In an embodiment of the invention, the robotic cleaner may include a 2D accelerometer 138. The 2D accelerometer 138 is a sensor for measuring sudden changes in robot velocity. The 2D accelerometer may measure changes in velocity in two directions. The 2D accelerometer 138 assists in detecting bumping into obstacles and detecting robot kidnapping, e.g., when a robotic cleaner is picked up and moved by the user. The 2D accelerometer provides any detected change in velocity information to the MCU 131. For example, when a robotic cleaner bumps into an obstacle, the velocity of the robotic cleaner changes rapidly and the 2D accelerometer detects these changes. Similarly, if a user picks up a robotic cleaner, the accelerometer may detect a slowly changing velocity (or acceleration) caused by gravity and the user motion.
In an embodiment of the invention, the robotic cleaner may include a NorthStar® sensor 139. The NorthStar® sensor provides absolute position of the robotic cleaner relative to one or more infrared spots projected onto the ceiling or other surfaces above the robot by one or more external projecting devices and supplies this information to the MCU 130 for utilization by navigation software. In an embodiment of the invention, NorthStar® sensor may also detect and track the position of a line-of-sight infrared beacon or beacons powered by one or more external devices. In an embodiment of the invention, a wide spot NorthStar® point source infrared LED 139a may be located on the robotic cleaner in combination with the NorthStar® sensor 139. The refection from the wide spot NorthStar® point source infrared LED 139a as measured by the NorthStar® sensor may provide information about the environment such as proximity and direction to walls, furniture and other large objects. In an embodiment of the invention, a narrow spot NorthStar® focused infrared LED 139b may located on the robotic cleaner in combination with the NorthStar sensor 139. The reflection from a narrow spot NorthStar® point source LED 139b as measured by the NorthStar® sensor may detect when the robotic cleaner is driving under low hanging surfaces such as chairs, beds, sofas and tables. In an embodiment of the invention, the sensor readings from the wide spot LED 139a and/or narrow spot LED 139b may be used to identify specific locations within a room or area of a home either by the value of the measurements themselves, or in combination with other sensory data relative to a location within a room or area of a home.
The cleaning module 207 may house left and right battery bays 205. The proximity sensors 206 may be an option and may be utilize for forward, side and downward views.
An embodiment of the invention may include a robotic cleaner and a docking station according to an embodiment of the invention. The docking station may include a NorthStar® Room Projector, a foldable ramp, a pad removing strip, a used pad storage well, a secondary navigation beacon and charging connectors. The pad removing station takes used pads off of the cleaning module of the robotic cleaner. The charging connectors may dock with a rear section of the robotic cleaner.
The robotic cleaner may also include a front mounted retractable sensor bumper or bumpers 225.
The following section describes the design and functions of cleaning robot platform. This robotic cleaner platform can executed in a variety of embodiments, which include but are not limited to: a cleaning robot with a single purpose cleaning mechanism, a single cleaning robot with two or more cleaning mechanisms, and cleaning robot which is compatible with a variety of detachable cleaning accessories, or a combination of the above. An embodiment of a robotic cleaner shown as an example in includes:
1) Front cleaning module for holding a cleaning material directly to the floor surface (such as a disposable cloth or pad) where the module may be attached to the main chassis of the robot, with or without a flexible joint to allow maximum contact with the floor.
2) A battery pack located in the front cleaning module to provide power to the robot, as well as level apply weight to the cleaning module to for increase the amount of pressure applied to they floor surface by cleaning cloth or pad
3) Two powered wheel assemblies connected to the robot chassis (with or without suspension) position behind the front cleaning module
4) A main chassis holding all of the components together
5) A NorthStar® positioning sensor placed near the front cleaning module to provide positioning information
6) A main control board with microprocessor, memory and I/O into all of the electrical components for controlling the robotics functions and behaviors
7) Software that runs on the microprocessor to perform all functions and behaviors
8) Wheel or motor encoders that track the movement of each wheel on the robot and use that information to help control its path and calculate its movement
9) Circuitry that enables the microprocessor to measure the current of the motors, as a means of detecting when the robot has made contact with an obstacle through some part of its shell without the need for a mechanical bumper, proximity sensor or other electronic device (although those systems could be optionally employed)
10) A shell that covers the body of the robot
11) Buttons, lights and/or other means of user interface that enable the user to turn the robot on and off, select programs and understand its status
Additional sensors may integrated with the robot based on the desired functionality, which is described in more detail below.
The robotic cleaner may include additional modular options. Additional modular options for an embodiment of the robotic cleaner may include but is not limited to:
1) Detachable wheels for changing to different drive surfaces.
2) Sensor modules for adding additional components.
3) Detachable and/or updatable main processor and/or memory for updating the cleaning programs and capabilities of the robot.
4) Detachable front cleaning module, that is connected by a mechanical release, magnetic connection, electrical connections and/or other mechanisms to provide the user one or more functions, which may include but are not limited to:
a) Enabling the user to detach the cleaning module from the robot body to make it easier for the user to clean the module and/or change out cleaning materials used in connection with the cleaning module, such as a pad, cloth, sponge, brush, canister, solution and/or other cleaning component, and then reattach the cleaning module to with refreshed materials.
b) Enabling the user to detach the cleaning module and reattach the module in an alternative position or positions, to adapt the cleaning module for different tasks and/or surfaces, and/or make more efficient use of the cleaning materials. One embodiment includes is not limited to allowing the user to turn the cleaning module 180 degrees so that the cleaning surface that was facing the rear of the robot is now facing the front, for cases where dirt and/or other material may tend to build up on the forward most area of the pad.
c) Enabling the user to detach the cleaning module to plug it into a charging device to recharge the batteries, without having to connect the entire robot.
d) Enabling the user to detach the cleaning module to replace it with either a new but similar replacement cleaning module and/or replace it with a functionally different cleaning module that is compatible with the robot body, but provides additional and/or different capabilities for cleaning. Embodiments of these accessories include but are not limited to:
i) a cleaning module that holds a stationary cleaning material, such as a cloth, pad, sponge or other material.
ii) a cleaning module that may include a powered mechanical cleaning device, such as a motorized brush, duster, buffer, vacuum, fluid or steam cleaning apparatus, motorized pad, cloth or sponge, and/or other powered device, either by itself or in combination with another powered device, stationary cleaning material, and/or waste collection bin for gather material from the floor.
iii) a cleaning module that may dispense cleaning solutions and/or fluids, apply steam for cleaning, use sprays, foaming solution and/or other dispensable material for cleaning.
iv) a cleaning module that includes an air and/or floor surface freshening device, a cleaning module that includes a secondary drive system and/or unpowered wheels to provide more support, traction and payload capacity if needed for the modules' function, a cleaning module that uses two or more of the approve systems in combination.
5) Leveraging the ability to have detachable modules for different cleaning tasks to provide other supporting functions, which can include but are not limited to:
a) adjusting form factor of the cleaning device to optimize for performance while maintaining a standard robot body.
b) adjusting the number of batteries or power source located within the cleaning module to match it with the specific requirements of the cleaning mechanism.
including stored software, data, instructions and/or control electronics in the cleaning module that the robot can utilize to update and/or adapt its available programs to match the functions of the cleaning module.
c) including enhanced sensors, drive mechanism, and/or other systems that expand the robot's capabilities and/or enhance its performance.
Some of the robotic cleaner configurations utilize expanded sensor capabilities. Design executions of the robot and/or cleaning module may additional sensor configurations for enhance performance, where embodiments of the additional sensor configurations include but are not limited to:
1) The placement of one or more drop-off sensors on the robot and/or cleaning module to detect and help the robot avoid, stairs, ledges and other drop off areas.
2) The placement of one or more mechanical bump sensors on the robot to detect contact with objects.
3) The placement of one or more proximity sensors for measure distance to walls, objects and/or other obstacles to avoid them without the need to make contact and/or engage in specific navigation and/or cleaning behaviors such as wall following.
4) The placement of one or more light emitting optical flow sensors to provide additional measure for relative ground motion and/or provide an alternative means for detection drop off areas, detecting when the robot has been picked up, detecting if and/or tracking how the robot has been manually moved.
5) The placement of NorthStar signal emitting projectors on the robot itself to utilize NorthStar's capabilities to provide additional information on the surrounding environment and/or expand the operation of the robot, which may include but is note limited to:
a) Detecting when the robot is under a table or other object that may be obstructing its direct view of the main navigation signals from a NorthStar room project.
b) Detecting the presence, proximity and/or general location of walls and/or other objects.
c) Detecting user gestures through reflection of the projected light off of their body and/or movement near the sensor.
d) Any combination of the above systems.
One option for a design execution of the robot cleaner addresses the problem of placing the cleaning module, material and/or mechanism in the front of the robot, to enable it the module and reach all the way to walls and edges around obstacles, while at the same time wanting to detect obstacles and/or avoid falling over edges and stairs. In a conventional cleaning robot, sensor mechanisms are placed in front in maximize detection of obstacles and hazards. These sensors usually include a bumper sensor, IR or sonar proximity sensors and/or IR drop-off sensors. The cleaning mechanism is traditionally placed behind these sensors, limiting how far it reaches when the robot comes into contact with a wall, obstacle and/or other hazard.
As an alternative embodiment, a possible design that can be integrated in this base configuration is a retractable drop-off, wall and/or obstacle detection system. This option can be used independently and/or integrated with the use of other sensors placed in other locations of the robot, such as on the sides and/or the back of the robot to provide additional capabilities and/or protection. This system can consist of but is not limited to the following design:
One or more bumpers than extend over the front edge of cleaning module and/or over the sides of the cleaning module, where the bumpers retract over the cleaning module and/or get pushed in (such as through a spring and/or other tensor mounted mechanism) when they come into physical contact with wall, object and/or obstacle, and return to their neutral position when the robot moves away from the obstacle.
Where when pushed in, the bumpers allow the cleaning module and associated cleaning material and/or mechanism make full contact with the floor to the edge of the wall, objects and/or other obstacles, and/or if needed, may make contact to clean the vertical base of the wall and/or other objects as well.
The bumpers include one or more sensors that, when the bumpers are extended, the sensors can see past the edge of the cleaning module and be used for one or more of the following tasks, which include but are not limited to:
1) Drop-off detection to prevent the robot from driving over a ledge and/or down the stairs through the use of one or more sensors focused on the floor area in the path of the robot.
2) One embodiment can include but is not limited to where the drop-off sensor or sensors can also be used to detect if the robot has been lifted off from the ground and change its operation mode accordingly.
3) Motion tracking, where one or more optical motion tracking sensors directed toward the floor, which can track the robot's movement over the floor surface.
4) One embodiment can include but is not limited to a system that has at least two sensors, mounted on opposite sides of the robot to track both the forward and backward motion, but also the turning motion of the robot. This information can be used independently when the other positioning information is not available to estimate the robots' location and/or can be fused with information from other positioning sensors and navigation systems to enhance the estimate of the robots' position.
5) Embodiments of the sensor system can also include the function but not be limited to where the same sensor or sensors can also be used to detect if the robot has been lifted off from the ground and change its operation mode accordingly. Obstacle detection in the path of the robot, such as for travelling forward and/or turning.
6) Wall and side object detection, enabling the robot to align itself to walls and/or other contours formed by objects and engage in classic wall following behaviors, which can include but are note limited to:
7) Cleaning along the edges of walls
8) Cleaning along the perimeter of furniture and other objects
Aligning its systematic path to the outline of walls and barriers in a room, where one embodiment can include but is not limited to the patterns shown in
9) Engaging in perimeter following behaviors to navigate back to another location in a room when position information is not available or reliable.
10) Mapping the boundaries of the room and/or area.
11) Beacon and/or other object detection that can be used to help the robot dock and/or perform operations which require the robot to align the cleaning module to another device.
12) One embodiment can include but is not limited driving onto a docking ramp and stopping over a specific area marked with a pattern and/or reactive material, where the placement of the robot in that location on the ramp is part of performing a maintenance, self-cleaning and/or other operational function.
13) Bump detection, where the change in position of the bumper or bumpers provides indication of contact with a wall, obstacle and/or object.
Embodiments can include but are not limited to contact switch mechanisms which detect the change in position and/or retraction of the bumper.
Other embodiments can include but are not limited to use of the function of the integrated sensor, to detect that the bumper has been pushed in. Examples include using the change in readings from an edge detection sensor, proximity detection sensor, motion tracking sensor and/or other sensor to detect that the sensor is in the retracted position, as well as any combination of the above approaches.
Where the placement of the bumpers and integrated sensors in the neutral position provides for protection of having the robot go too far over an edge before being able to correct its path. Embodiments of this sensor system can include but are not limited to:
1) Placing sensors capable of edge detection either in parallel with the outer most point of the rear wheels (measured from the perpendicular distance from the center axis that travels back to front through the robot), or extended further out to the sides than the wheels are.
In an embodiment of the invention, the cleaning module is designed to be wider than the wheel base, so sensor placement could either be on the sides of the cleaning module, and/or on the front leading edge on the left and right sections of the cleaning module that extend past the wheel base.
Another embodiment for drop-off detection can include but is not limited to having the drop-off sensor built into the underside of the cleaning module in the desired regions needed to protect the robot from falling over edges and/or down stairs, but modifying the sensor design to work in the specific conditions of the cleaning mechanism, such as being able to function when covered by a cleaning pad, cloth or other material.
In one embodiment where the robot has a cleaning cloth or pad attached to the base of the cleaning module for cleaning floors, the drop off sensors could project a signal through the cloth or pad material, and be calibrated to account for the disruption of the signal passing back and forth through the material, and using a range of thresholds, detect when the sensor was travelling over a drop-off area. This calibration could be pre-calculated and/or dynamically adjusted based on environmental conditions and/or the specific material used for the cleaning task. In one embodiment, this could be performed as an auto diagnostic, which may or may not involve having the robot drive around to calibrate, and/or having the robot travel to controlled environment such as on a base station, that allowed it to calibrate thresholds for the presence and/or absence of contact with the floor. Another embodiment can include but is not limited to using the sensor readings to also assess the amount of dirt and/or other material built up on the cloth or pad, and/or the amount of dirt and/or material being picked up in a specific areas of the floor, in order to enhance the robot's cleaning performance and/or provide user feedback.
Additional embodiments of robotic cleaners may include different product concepts or design elements that can be use used in combination with systematic and/or non-systematic localization systems to enable intelligent cleaning. The range of possible embodiments includes but is not limited to the concepts, functional elements and/or design elements listed below, or combinations thereof.
Key Functional Attributes may include low-cost mobile robots, each designed for a specific cleaning task or select set of task (simple but effective cleaning mechanisms & accessories), which are fast, agile, lightweight, quiet and have super smart navigation and control system for systematic cleaning
The design attributes may include an open/organic design. Aspects of the robotic cleaning device should echo the functional elements of everyday household cleaning products and appliances to help communicate purpose and function to consumers.
Additional design attributes may include that 1) the robotic cleaner should appear much less bulky than existing robotic cleaning products on the market, such as Roomba® (less mass); 2) the robotic cleaner be much more sportier, faster, agile, (e.g., if Roomba® is a minivan, the robots described herein are sports cars); 3) it is ideal for the robotic cleaner to stay low to the ground for clearance and reach; and 4) that the active cleaning function for each robot is a “hero” feature (takes prominent focus).
For effective coverage, the robot may need to be as large as 10 to 12 inches in width for medium-scale robots. Small-sized robots would emphasize speed and ability into tight spaces. The drive system for the robotic cleaners may be placed in rear, an should feel smaller in proportion (e.g., have a narrower footprint). The drive system may have either two rear wheels or two tank treads that fit within the curved boundary. The drive system of the robotic cleaner may be driven by off-the self batteries (e.g. 4-8 AA) and may be rechargeable.
Structure can extend on sides to provide part of forward structure as well (fenders)—such as for mounting stair and wall detection IR sensors. Some designs of the robotic cleaner may connect front and back on some of the robots with flexible joint/swivel, e.g. for reaching into corners with the pad cleaner. Any external edges of the robot made of solid plastic should be curved to avoid catching on objects as robot turns. The robotic cleaner may have ways for front cleaning devices to be flexible, at least on leading corners, e.g., making the ends for cleaning pad holder be flexible rubber so the pad lifts up as it rubs along something
Other components of the design for a robotic cleaner may include: 1) NorthStar navigation sensor would go on high-point on top of drive system; 2) the robotic cleaner has power leads for docking with recharging station, which are most likely towards rear of chassis, and possibly underneath.
Medium-sized robots or robotic cleaners may include, but are not limited to: a floor sweeper, a dry pad cleaner, a web pad cleaner, a combination vacuum with dry pad cleaner, a robotic floor polisher/buffer, and a robotic floor scrubber.
The Floor sweeper may include a rotating brush with rear bin. The floor sweeper is:
1) Designed for 1st level of cleaning
2) Brushes up dust bunnies, pet hair, small debris
3) Designed to work on hard wood floors, tile floors and short length carpeting
4) May or may not have cloth or pad to be used in combination with the sweeping mechanism, where brush can be placed in front with the cloth or pad grabbing remaining dirt
Two executions of the floor sweeper may be implemented including a horizontal roller brush or two counter rotating brushes.
F1: The Horizontal roller brush includes features such as:
1) Can incorporate front roller brush, that may or may not extend beyond the frame of the robot (show one with exaggerated size to emphasize function)
2) Extend beyond the frame would improve reach for getting to the bottom of walls and underneath furniture
3) Apply a lot of surface area contact where ever they reach
4) Roller brush could be disposable or reusable and/or washable
5) Robot chassis and drive system exists behind the brush in one scenario
6) Semi-circular rear body is probably the most pragmatic for navigation, but a more square-like shape can be an option.
F2: Two counter rotating brushes (street cleaner style) configuration may, as in F1, include a brushing mechanism that can extend beyond the sides for the robot for maximum reach.
Accessories for the floor sweeper include:
F3: A Docking station which may:
1) Recharges batteries
2) Empties dust bin into larger stationary container (such as having vacuum in station)
3) Vacuum can also self clean the duster brush or brushes.
F4: One embodiment can include but is not limited to:
1) The duster robot drives into the dock. (e.g., maybe backs in). It cradles under a nozzle that goes right over a port at the top of the dust bin—which lets the station suck out the dirt from the dust bin into a larger container.
2) The docking station may be designed so that the robot could also drive forward into the dock, and use the vacuum to clean the brush as well.
3) If there is a cloth or pad, some sort of catching mechanism underneath on the docking station right below the cloth or pad. When the robot reverses out, the dirty pad gets pulled off and then the vacuum sucks that into the storage bind as well.
Another medium robotic cleaner is a dry pad cleaner for hardwood and tile floors. The dry pad cleaner may include features such as:
1) Designed for 2nd level cleaning
2) Uses cloth-like pad for collecting smaller particles, dirt and dust
3) Should include some forward feeler/bumper for detecting and avoiding driving onto carpet
There may be three executions of the dry pad cleaner:
D1: A first design is a Basic design with single fixed pad on front
1) This design looks like mop with drive mechanism behind
D2: A second design includes the same rear chassis but with auto-changing pad multiple pads on roller/belt mechanism
D3: A third design puts a Swiffer® pad underneath the body robot, so that it picks up the dirt the roller misses.
1) If it was on the square version, it could go towards the back—with the wheels in the middle.
2) Building on that approach, one idea would be to let the user load a small stack of pads into the back. (maybe 5 or 8 in a spring loaded tray—that's mounted upside down) That way they can just pull out a dirty one and have a clean one underneath ready to go. (or make removal automatic at the docking station). If there is a stack, can showcase that by having the side or rear corners transparent as well, where the user sees the stack and how many are left.
Accessories for the dry pad robotic cleaner may include:
D4: Drive-on docking station elements and option
1) Low ramp-based shape—robot drives in and up, backups to exit
2) Recharges batteries
3) Static brushes catches extra bits of dust from cleaning pad and drops debris in bin (such as when robot drives on and exits off)
4) For robot with multiple pads, can grab and tear dirty pad off to expose clean one. Mechanisms can include: a) Mechanism on docking station that has teeth or other elements that grab and pull the pad off while the robot is parked on the station (which can be driven by its own motor, or powered by the wheels of the robot when it is parked on the docking station; b) Static and/or retracting directional teeth or other gripping elements that are built into the docking station, designed to allow the robot drive up onto the station, and then engage and hold the cloth or pad when the robot backs out of the docking station; c) Automatic pulling and/or flipping mechanism for moving the dirty cloth or pad out of the way and/or into a storage area, to make room for the robot to repeat the process when the next dirty cloth or pad needs to be exchanged
5) Alternatively, the docking station and robot can be designed so the robot can push the dirty cloth or pad into a storage/waste bay once the pad is removed, where one embodiment can include but is not limited to having the robot back out, turn and back into the docking station, where a bumper or edge provides a surface on the robot for shoveling the pad off the docking station and into a storage bay.
The robotic cleaner may also be a combination vacuum with dry pad cleaner for cleaning hardwood and tile floors. The combination vacuum with dry pad cleaner is:
1) Designed for 1st and 2nd level cleaning
2) Uses vacuum to get larger debris first
3) Uses cloth-like pad for collecting smaller particles, dirt and dust
One execution of the combination vacuum with dry pad cleaner is: V1: Combination of design D1 of the dry pad cleaner with a vacuum in front of pad
The medium sized robotic cleaner may also be a wet pad cleaner for hard surface floor. The wet pad cleaner is:
1) Designed as alternative for mopping
2) Different floor surfaces would have different cleaning solutions, such as:
3) Kitchen and bath tile cleaner
4) Hard-wood floor cleaner
There may be two executions of the wet pad cleaner:
1) W1: Absorbent pad with on-board sprayer with a single pad design that includes cleaning solution stored in on-board reservoir (or swappable bottle). This design includes a forward spraying jet that dispenses solution. This design also should include mechanism to prevent accidental spray on carpet/on to wall, over edge of floor (e.g. embodiment could be to have low feelers or an extended bumper in front of pad to detect for changes in the floor surface.)
W2: Same concept as design W1, but with auto-changing pad
W3: Similar concept as designs W2 and W1, but with a steam based cleaning system integrated to help loosen more dirt and other target material from the floor which, depending on temperature and the heated solution used, helps kill germs and/or sterilize the surface, plus re-absorb dirt, material and fluid from floor surface through absorbent pad material, a suction device, and/or other means. Accessories for the medium sized wet pad cleaner may be:
1) W4: Drive-on charging, drying station. The basic implementation could be similar to dry pad cleaner accessory D3, but with drip pan underneath for catching any excess wetness & letting pad(s) dry out after cleaning is complete
2) W5: Mini tower beacon that is used to set boundary for cleaning area (such as at the boarder at a doorway). This may be a tall, thin free standing device that could look something like a street light fixture/or very thin desk lamp. This may be 12 to 18 inches tall, with top for placing two diodes about 8 inches apart (could be U shape with two vertical posts, or T shaped)
An embodiment of the invention may be a robotic floor scrubber which is designed for deeper wet cleaning of durable hard surface floors (especially kitchens and baths). One execution of the robotic floor scrubber is:
S1: A robotic floor scrubber may be a combination of wet pad auto-changing pad (W2) with scrubbing brushes in front. Robot sprays cleaning fluid in front and systematically scrubs back and forth. The robot wipes up area & soaks up solution with pad. One embodiment would be to have pads on other end of robot—where robot turns 180 degrees and goes over area with its pad. An alternative embodiment is to have scrubbing mechanism to be relatively compact and placed just in front of pad, so robot absorbs cleaning solution as it drives forward
Another embodiment of the medium robotic cleaner may be a robotic floor polisher/buffer which is designed as finishing step as means for adding protective coating/enhancing shine of hard floor surfaces
One execution of the robotic floor polisher buffer may include:
1) B1: Floor unit with high speed buffing pads. The buffing pads may be either a pair of counter rotating pads (like F2 configuration) or other design (such as horizontal rollers with pads wrapped around them). The robotic floor polisher/buffer includes waxing, polishing liquid reservoir and spray dispenser and soft pads that both polish and absorb excess liquid.
There also may be micro robotic cleaners which are smaller than the medium robotic cleaner. In other words, micro robots are small robots for smaller tasks. The micro robots may be half to one third the size of medium-scale robots. The micro robots may have different configuration of NorthStar®, where the sensor is placed in center base unit and beacons are on the robotic cleaner. The micro robot may or may not need to auto-dock. Examples of the micro robots include, but are not limited to:
Table Top Robotic Cleaner
The table top robotic cleaner may be designed to clean up dinning tables, coffee tables, small floor areas (e.g. spot cleaning).
One execution of the table top robotic cleaner includes:
T1: Mini version of F1 or F2 (rotating brush and bin) for collecting crumbs, etc. with a pad added
1) Has edge detection to keep from falling off the table
2) Small pad would provide for cleaning/dusting/polishing
Mini Wet Floor Robotic Cleaner
The mini wet floor robotic cleaner is designed to clean up small bathrooms, spots in kitchen or spills. The mini wet floor robotic cleaner gets in corners and behind things.
Two executions of the mini wet floor robotic cleaner include:
MW1: Simple wet pad cleaning robot
1) Pad is most likely in fixed position (non-changing)—almost like a wet pad version of D1
2) Flairs up on sides of pad to clean along walls and other edges as it drives
MW2: Mini version of S1 (scrubbing brushes) but without sprayer
1) The cleaning robot just has brushes and an absorbent pad
Other accessories for the mini wet floor robotic cleaner include:
MW3: Portable cleaning base station.
1) Base station holds warm water, cleaning solution, and reservoir for capturing during water
2) Robot drives up and base station rinses out pad and applies fresh solution on to pad
3) Base station has NorthStar®, tracks the position of one or more robots
4) User should be able to pick base station up by handle and plug it into the wall for recharging when needed
Mini Dry Floor Robotic Cleaner/Duster
The mini dry floor robotic cleaner/duster is designed to get into hard to reach places (behind furniture) and cover corners and base boards
Two executions of the mini dry floor robotic cleaner/duster:
MD1: Brush based cleaner. The brush based cleaner:
1) Has rotating brushes that get at both the floor and sides (such as base boards)
2) Could include a pad or disposable duster material
3) Has tank drive and streamlined design to avoid getting hooked on cords or stuck on things.
4) Can incorporate front roller brush, that may or may not extend beyond the frame of the robot cleaner (show one with exaggerated size to emphasize function)
5) Extends beyond the frame would improve reach for getting to the bottom of walls and underneath furniture
6) Applies a lot of surface area contact where ever they reach
7) Roller brush could be disposable or reusable and/or washable
8) Robot chassis and drive system exists behind the brush in one scenario
9) Semi-circular rear body is probably the most pragmatic for navigation, but a more square-like shape can be an option.
The goal of the navigation system described in this invention is to provide the full benefits of systematic cleaning in unstructured environments, but at a significantly lower cost to make the products affordable to the mass consumer market.
In an embodiment of the invention, this goal is achieved by cleaning in a region by region approach, where the robot systematically cleans one section of a room or an area of a home at a time though the use of a local map and local sensory position system, and then moves on to clean additional regions. The reduced size of the region allows for lower cost sensors to be used, where the size of the region is set so the robot is able to track its position through the region before the normal accumulation the noise and drift from the sensors causes the robot to lose its position.
In an embodiment of the invention, the system supports the use of dry and/or wet consumable cleaning cloths, where the regional cleaning approach enables the robot to use of the cloth to clean in a even progression through the room, so that if the user changes the cloth during the cleaning process, the fresh clean cloth is generally used to clean new areas of the floor, as opposed to clean areas already covered.
In an embodiment of the invention, the robot uses a global positioning system in combination with the local positioning system, to arrange the regions to ensure good overall coverage of the room or area of the home, so that target areas set by the system are reached. As with the local positioning system, the sensors for the global positioning system are cost optimized so that the range, accuracy and reliability of the global system is effective enough for being able to provide adequate overlap of the local regions, but is not required to maintain highly accurate global position by itself throughout the full room or area of the home.
These functions are accomplished by using a cleaning strategies and software algorithms that work with a unique combination of low cost sensors and components.
In an embodiment of the invention, the combination of sensors and components includes any or all of the following elements: a low cost IR-base global localization sensor mounted on the cleaning robot; a low cost IR projector built as a separate physical device from the robot which projects an IR light spot (or spots) which the robot can detect; wheel tachometers which are connected to the drive motors of the robot; motor current sensing connected to the drive motors of the robot for sensing when the robot has contacted obstacles through feedback detected in the resistance on the wheels; and a gyroscope mounted on the robot. An example of the NorthStar® system and its potential functions is described in NorthStar patent application Ser. No. 11/090,621, filed Mar. 25, 2005, Additional capabilities and configurations are also described in Robotic Game patent application Ser. No. 12/234,565, filed Sep. 19, 2008.
The system may include a variety of configurations for the IR projector. Embodiments can include but are not limited to a battery powered unit, a wall pluggable unit, or a combination of a wall pluggable unit which is also battery operated. The projector has one or more IR LEDs that project IR spots on the ceiling which the NorthStar sensor can detect to localize its position. In an embodiment of the invention, the projector may have three, four, five, or more spots at different frequencies pointed at different directions to expand the range for detecting the signal, where the sensor may also localizes on at least the two of the spots to determines its location. Utilizing this approach, the sensor may select different spots which provide better location information, such as by selecting spots that have an optimal orientation relative to its position for calculating the robots location, and/or selecting the spots based if their signal intensity to provide for the best signal to noise ratio. In an embodiment of the invention, two or more IR projectors may be used to expand the range of coverage by projecting IR spots at different IR frequencies in different areas of the room or home, including but not limited covering different rooms or areas in the home to enable room-to-room cleaning and navigation.
In an embodiment of the invention, the cost of sensors and components is so reduced that none of the sensors or components provide enough reliable information by themselves to provide the full solution, but when used in combination with each other and the cleaning strategy, the overall system can deliver system cleaning that is far more effective than random cleaning robots, and as effective or more effective as more complex and expensive navigation systems.
Alternative sensors may be used in alternative embodiments, which may include but are not limited to: accelerometer for another means of detecting with the robot has made contact with obstacles; IR proximity sensors for detecting obstacles and following along walls and obstacles, drop sensors for detecting if the robot is about to go over a ledge, and/or other sensors that may support the navigation of the robot, such as referenced herein.
In an embodiment of the invention, the local cleaning behavior can be implemented in the following configuration. The robot uses a gyroscope and wheel tachometers to track its location within a local map of the region, where the tachometers enable the robot to plot its position on the map based on distance travelled, and the gyroscope enables the robot to correct for the drift in tachometry as the robot turns to provide better accuracy of the robot's direction and position in the local map. Detection of obstacles and other location-based sensory information may be included in the local map for us in plotting areas to clean, path planning around obstacles, exploring for new regions and uncovered areas, and closing off areas marked as completed.
In an embodiment of the invention, the robot initially cleans following a rank pattern of parallel rows progressing across the room in one direction. The robot utilizes the gyroscope to make even 180 degree turns and maintain the parallel orientation of the rows, where the angle is close enough between rows so that the rows overlap and minimize any gaps not covered between the rows. As the robot turns from one row the next row, the alternation between left and right turns helps counteract internal gyroscope drift and extend that pattern for a longer period of time (and thus larger area.) The robot uses wheel tachometry for measuring the length of the rows, and with correction from the gyroscope and detection of obstacles from other sensors, builds a map of the region.
In embodiments of the invention, the robot may be programmed to clean along a row and then turn onto the next row until one or more events occur, which may include: reaching an obstacle; reaching a maximum row length; attempting to follow around an obstacle or obstacles until the robot has travelled a minimal amount of distance along the row; attempting to follow around an obstacle or obstacle based on the position relative to the prior row; attempting to follow around an obstacle until a maximum number of obstacles are hit; and/or reaching and end boundary of the target region with the robot's internal local map.
In an embodiment of the invention, the robot can make a full sweep though the region, and then use algorithms that identify areas that have not yet been cleaned in the local map to have the robot navigate to those areas and clean them and update the map while localization is still reliable. The robot may also close of any frontiers determined to be blocked by obstacles as non-cleanable areas. Boundaries along the perimeter of the cleaning region which are not blocked off by obstacles may also be stored on the map and used later in determining adjacent regions to clean.
In embodiments of the invention, the robot sets limits for the maximum length of the rows and the number of rows allowed within a region so attempted area of coverage stays within the tolerance allowed for accumulated error and drift from the combined readings and corrections of the sensors. The limits can be set through a number of means, which include but are not limited to: fixed value for either the length of the row and/or the number of the rows; a dynamic setting to one or both of the dimensions based on the environment, such as if the robot detects the cleanable area to be narrow and wide, and thus able to be completed with more rows, but at shorter lengths; a measure of time or area traveled; and/or though feedback on the sensor drift through comparison of the values with other sensors, where the cleaning region size grows until the accumulated error reaches a threshold.
In an embodiment of the invention, once completing one region, the robot would re-localize its position using readings from the global positioning system (e.g. Evolution Robotics' NorthStar positioning system) and then plan the location for the next regional area of cleaning. This processing may include uploading data from the locally mapped area in the region to a global map, which fills in as the robot cleans more regions in the room.
In an embodiment of the invention, the global positioning system may track the progress of robot while it is cleaning the local region as a parallel process. In cases where the global positing system is determined to have a minimal level of reliability for that region, gaps of a certain size found in the global map may be copied down onto the local map to have the robot revisit and re-clean those areas if needed to provide for redundancy in the system.
In an embodiment of the invention, re-localization may be accomplished thorough a number of means in cases where access to reliable global position information is limited or not immediately available at the robot's current location. An example may include but is not limited to returning to a specific reference point (or one of many available reference points) where the robot can re-calibrate its position, plot the target location for the next cleaning region, and drive to that region to begin the next regional pattern. In the case where the global positioning system is used, the robot homes on the signal provided from the global positioning system until it reaches an area where it can plot a course to a reference point.
In the minimal case, the reference point may be in close range to a charging station or some other form of “home base” for the robot to use as starting location. The robot may use one or more emitted signals to home back to the charging base, and if needed, position itself relative to the base where its position and orientation are estimated to be at a high confidence level.
In an embodiment of the invention, the robot may also re-localize using information from the gyroscope, odemetery and other sensors are used to test for the reliability of a global positioning system, to dynamically determine when the global system is providing accurate enough information on which to re-localize. As one example, the local sensors provide readings for several samples over a certain time, and when the change in the global position reading matches the estimated change from the local sensors, then the robot can re-localize. As a fall back method, the robot may use the global localization system to return to a “safe point” where it has high certainty of its relative position without the need for additional or new validation from other sensors.
In an embodiment of the invention, the robot may clean in a regional method using a local map and input from local sensors (gyroscope and tachometers, etc.), and move from region to region without the use of global positioning system either for part or all of its operation during a cleaning run. In embodiments of the invention, upon the completion of one cleaning region, the robot may move to a new location to begin a new cleaning region through a number of means, which include but are not limited to: driving to an estimated location within the existing regional based on the local map and sensors, and begin cleaning a new region that extends outside the area of the existing cleaning region; driving to an estimated location outside the existing region based on use of the local sensors to reposition the robot and then begin a new cleaning region; and/or driving to a random location relative to the existing cleaning region and then begin a new cleaning region.
In embodiments of the invention, a number of techniques can be used to expand the regional area of cleaning and/or more efficiently organize the placement of regions based on the environment. In the case of using a low-cost global positioning system which may have limited range or only certain patches of coverage in a room, the regional cleaning pattern can be combined with periodic re-localization to allow for the regional pattern to run longer and over a larger area. As one example, if the center area of a room has a good global localization signal (such as emitted from an IR spot projector or other point source) the robot can align the cleaning pattern (such as parallel rows) so that the robot is passing in and out of the global area of coverage in the course of travelling through one or more of the rows (such as on the middle or at one of the ends of the row.) By recalibrating its position when the robot is in the global area of coverage, the robot can essentially re-set the drift to zero or some lower value, and rely on the local sensor to continue the cleaning pattern. This process can also be performed ad hoc, when ever a reliable global position signal is found.
In an embodiment of the invention, strategies for arranging the cleaning patterns may be used to further improve coverage of the regions and or entire area. As an example of a technique, the robot may do two or more passes over the same region or set of regions to ensure more though cleaning. This may include changing the primary direction of the systematic pattern between the passes to expose different frontiers between the passes and possibly extend into areas missed on the first pass. Examples may include but are limited to: having the robot clean the area in one direction in a single session, and then start over an redo the entire area in a different direction (either perpendicular or some other angle), where the room or area may be divided into different regions based the pattern and environment; have the robot do two passes over each region each time the robot is run, in either a perpendicular or other angle; or vary the angle in paired set, so that the robot pick a new angle on each cleaning, and then follows with a pass on a perpendicular angle. The benefit of these approaches is that they additional passes will likely remove additional dirt in the areas that are covered more than once—and possibly make the cleaning function work better across different grains in the floor surface—while providing much more even coverage than a random approach.
In an alternative embodiment of the invention, the regions can be more flexible and emergent based on the discovered areas. One example may include using mapping to expose open frontiers in global map after the first pass of a systematic cleaning pattern. The robot can then use that information to clean into the frontiers, and where new areas are discovered, repeat the systematic cleaning pattern and frontier selection process.
In any of the embodiments described above, the robot may also use perimeter cleaning (including wall following and obstacle following) to close off frontiers in the area covered by a systematic pattern, as well as initiates another area of systematic cleaning in new areas discovered. The perimeter cleaning could be done as a process within a region before the region is marked as finished, as a process across regions after multiple regions are visited, or as a combination of both within and between regions based on the size of obstacles found and the length the robot can travel along the wall without going to far from its target location.
New approaches, methods, designs, technologies and solutions for integrating localization, positioning and navigation systems to provide new and unique benefits and capabilities for mobile robotic-enabled products that need to operate in everyday environments. For illustration purposes, the specific embodiments described and illustrated in this document are described primarily in the context of mobile floor cleaning robots, where the benefits and capabilities represent a significant advance in performance over random, semi-random methods for floor cleaning and/or other methods employed by leading consumer robotic floor cleaning products on the market. A description of possible embodiments of robotic cleaning devices that could utilize localization, positioning and navigation systems includes but is not limited the products, concepts and designs described in the drawings.
The scenarios described herein using an infrared-based localization system, but may easily be enabled by devices that use other means for localization, including but not limited to devices that utilize visual pattern recognition, visible light detection, laser reflection, odemetery, optical navigation sensing, inertial sensing, thermal detection, motion detection, sound detection, radio wave detection, physical contact detection, proximity detection, magnetic field detection, electrical field detection, or any combination thereof. One embodiment of an infrared-based localization system would include the NorthStar® system from Evolution Robotics, which is cited in prior applications, namely U.S. patent application Ser. No. 11/090,621, filed Mar. 25, 2005, which is hereby incorporated by reference herein.
For the purposes of these descriptions, the application of localization, positioning and/or navigation systems includes but is not limited to: the ability to determine the position of one or more devices, objects, locations and/or boundaries within a physical space along one or more dimensions; the ability to provide partial information on the relative position of one or more devices, objects, locations and/or boundaries from one or more other points that is useful in the performance of an application; the ability to make estimates of position of one or more devices, objects locations and/or boundaries that are useful in the performance of an operation; the ability to guide one or more mobile devices and/or objects along a planned and/or unplanned course through one or more physical spaces; the ability to navigate between two or more objects, devices, locations, and/or boundaries within a physical space where information on the points between the devices, objects, locations and/or boundaries may or may not be available; the ability to store position information, identification and/or other indication of location of one or more devices, objects, locations, boundaries, paths, and/or areas of coverage for retrieval and use at a later point in time; the ability to map one or more represented locations, devices, objects, boundaries, paths, and/or areas of coverage for use in the performance of an application; the ability to detect and/or discover position information about one or more physical environments that is used to adapt and/or enhance the performance of one or more tasks within those environments; the ability to use position information to help identify and/or classify one or more environments to adapt the performance of one or more tasks within those environments; and/or the ability to directly and/or indirectly control one or more devices using the one or more of the above abilities and/or other abilities related to localization, positioning and/or navigation.
The implementation of the localization system may take a variety of embodiments, but can still enable the functions described herein. Examples of embodiments of the localization system include:
1) The placement of a sensor (or set of sensors or integrated sensory system) on a robot or robot-enabled device, which enables the robot or robotic-enabled device to derive relevant position information, where other objects and/or devices that emit one or more signals may or may not be used for helping derive position information.
2) The placement of a sensor (or set of sensors or an integrated sensory system) on a robot or robot-enabled device, which enables the robot or robotic-enabled device to derive relevant position information through passive and/or active measurements of its environment, through measurement of position by one or more systems at a single point of time and/or through integration of measurements taken by one or more systems from a series of measurements over time, and/or in conjunction with the control of movements, execution of navigational patterns and/or performance of location related behavior. One embodiment of this approach includes but is not limited to the vSLAM® system from Evolution Robotics, which is cited through U.S. Pat. No. 7,015,831, filed Mar. 21, 2006, U.S. Pat. No. 7,135,992, filed Nov. 14, 2006, and U.S. Pat. No. 7,145,478, filed Dec. 5, 2006, which are hereby incorporated by reference herein. Another embodiment can include but is not limited to the use of one or more proximity sensors in combination with one or more path following behaviors that guide the movement of the robot or robotic-enabled device relative to the physical characteristics of the environment. One example of this approach would be to have a robot that included one or more proximity sensors that measured distance to walls, objects and/or other fixed boundaries within a setting, and engage a path following behavior where robot followed the contours of the walls, objects and other boundaries in a repeated series of cycles or laps around the environment, with the robot initially following the perimeter of the area and shifted its position inward as measured by the proximity sensor(s) upon each completion of a lap, so that it progressively moved to the center of the area until it reached the center and/or covered most of the of area within the perimeter. (See
3) The placement of a sensor (or set of sensors or integrated sensory system) on a central device, which detects and provides position information of one or more robots, robot-enabled devices and/or other devices and relays that information and/or sends commands back to one or more robots or robotic-enabled devices, which may or may not emit a signal or signals that help the sensor determine their position.
4) The placement of a sensor (or set of sensors or integrated sensory system) among one or more independent devices, where the data from the sensor(s) is relayed to one or more robots, robotic-enabled devices and/or other devices.
5) Any combination of the above approaches—or other method for reading and reporting position information and/or identification of robots, robotic-enabled devices and/or other devices.
6) Any use of the above approaches, with the added integration of a 3rd party platform or device, such as a video game system (e.g. Nintendo® Wii®, X-Box 360®, Play Station 3®, etc.), handheld game system (PSP, Nintendo® DS®, etc), mobile phone, smart phone, PDA, mp3 device, television, computer, or Internet enabled game system (e.g. online games), to help incorporate the position information, identify devices, transfer information, provide calculations, plan paths, monitor task performance and completion, pass information gathered from one operation to a later operation, update reference data sets and/or behaviors, enable user interface, and/or otherwise assist in operations related to the localization of one or more robot and/or robotic enabled devices.
The sensor or sensors used by the localization system may be any component, set of components or integrated system that help provide the identification and/or any related position information of the various game objects. These sensor components and systems can include but are not limited to: infrared sensors; cameras, imagers and/or other visual sensors; laser range finders or other laser sensors, infrared detectors and/or emitters; wheel encoders or other odemetery sensors; optical navigation sensors; accelerometers, tilt sensors, gyroscopes, or other position and/or inertial sensors; thermal sensors; motion sensors; microphones, ultrasonic sensors and/or other sound sensors; RFID sensors and/or other radio sensors; contact sensors; proximity sensors; magnetic sensors; electrical field sensors; and/or any combination thereof. The system may take the raw reading from the sensors and/or involve processing of the raw sensor values either as part of the sensing device, as part of another processing device, or as a combination of processes.
Devices and/or objects can be designed to provide means for the sensors to detect them, through active and/or passive methods, as part of the localization system. Active methods can include but are not limited to the placement of beacons on one or more devices that emit a signal the sensors can detect and use to derive the identification and/or relative position information of the object. Beacons can include but are not limited to: infrared light emitters, infrared spot projectors, other visible or non-visible light emitters, laser emitters, thermal emitters, sound and sound wave emitters, motion emitters or devices that control the motion of objects, RFID or other radio emitters, magnetic emitters, electric field emitters, or any combination thereof. Passive methods can involve any approach where the sensors can detect one ore more object or devices without the need for a signal to originate from the object or device. These methods can include but are not limited to visual recognition of one or more objects or devices or a pattern on the object, reflected light detection of the object, recognition of the physical shape or construction of the object, recognition of motion of the object, or any combination thereof.
Additional examples of such and other embodiments, techniques and/or applications for employing a localization system may be found in Evolution Robotics' application for U.S. patent application Ser. No. 12/234,543, filed Sep. 19, 2008, which is hereby incorporated by reference herein.
The use of localization system to enhance the performance and capabilities of a robot or robotic-enabled device in tasks such as floor care and other localization-related applications as described earlier includes but are not limited to:
1) The ability to use position information to clean a floor systematically by controlling the location and/or path of a robot; executing coverage and/or cleaning patterns relative to the floor surface to ensure good and even coverage; executing customized coverage and/or cleaning patterns relative to the floor surface based on user input; optimizing coverage and/or cleaning patterns adapted to environmental conditions, the location of obstacles, different types of floor surfaces (e.g. carpeting vs. hardwood vs. tile, etc.) and/or other location specific information; keeping track of cleaned and un-cleaned areas and/or explored and unexplored areas; and/or a combination of the above methods. Embodiments of coverage and cleaning patterns using position information can include but are not limited to:
a) Paths involving one or more rectilinear patterns, which could include but are not limited to where a robot cleans as it travels in a row-like pattern from one side of the room to the other (see
b) Cases where a robot cleans with a contour-following method using the walls and/or edge of a room (and/or other objects and boundaries) to help define its path and engages in systematic adjustments in navigation to cover the floor surface, where one embodiment can include but is not limited to driving parallel to the edges of a room and/or objects and shifting some distance inward upon the completion of each completed lap until it reaches the center of the area or the closest it can get to the center of the area. (
c) Cases where a robot cleans a room in smaller sub-sections, using one or more systematic “micro” patterns to clean within a section, where a section can be defined by physical boundaries, virtual boundaries, user defined boundaries and/or boundaries that adapt to the environmental conditions, and then replicates that pattern on other sections until all of the open areas of the floor is reached using a “macro” pattern to define and/or navigate between the subsections. (
d) Cases where the robot follows an overall row-like, spiral or other pattern to its path as it cleans but executes a variety of smaller patterns within each segment of the path to provide deeper cleaning with multiple passes along the path. (
e) Cases the robot cleans in a semi-random pattern in a specific section of the floor, but uses tracking of areas covered to intermittently relocate its position to uncovered areas and/or stay within a certain boundary, and then moves onto new sections of the floor once its has achieved adequate coverage, where one embodiment can include but is not limited to applying avoidance behaviors to navigate away from covered areas to probabilistically guide itself to uncovered areas (
f) Cases where the robot cleans using one of the above methods and/or other variations and completes by cleaning around the edges of the room and/or around objects in the room.
g) Cases where the robot uses a cleaning pattern to consistently push any remnant matter and/or fluid towards a specific area of the floor to concentrate it one or more specific locations for user, the robot, and/or other device to collect. (
h) Cases where the robot follows one or more of the above cleaning methods and/or other variations, but engages in multiple cycles where it varies its activity for different stages in the cleaning process, such as removing dirt first with one system and applying a protective finish with a second system as just one embodiment; and/or any combination of the above approaches.
The ability for a robot and/or robots to clean with one of the above methods and/or other variations where the robot returns to one or more stations that allow it to refresh its cleaning mechanism (which may include) but is not limited to:
1) unloading collected dirt, fluid, consumables and/or waste material, 2) taking on new cleaning materials, fluids and/or consumables, and/or recharging its batteries) and/or returns to clean where it last left off or continue to new areas as needed; the robot cleans with one of the above methods and refreshes it owns cleaning mechanism(s) based on area covered, time of operation and/or other means; and/or any combination of the above methods. One embodiment can be similar to the method exhibited above in
2) The ability to use position information to navigate to one or more base stations, with or without direct line of sight a base station, from within the same room/zone and/or from outside of a room/zone, where the robot may or may not engage path planning techniques to develop optimized routes to one or more base stations. One embodiment can include but is not limited where a station includes a position signal emitter that enables the robot to automatically learn the physical location of the station and/or allow the robot to automatically recalibrate the physical location of the station if the station is moved from its original point.
3) The ability to clean randomly or semi-randomly in areas where position information is not locally available, is only intermittently available and/or is less reliable, while being able to navigate back to an area where position information is available. (
4) The ability to clean with some degree of systematic coverage in areas where position information is not locally available, is intermittently available and/or is less reliable, by making estimates of the position of those areas by their boundary relative to one or more known areas and/or through the use of other measures or estimates of changes in distance, orientation and/or relative position from one or more known positions (such as but not limited to control of motors and/or wheels, feedback from motors, odometer readings, accelerometer readings, compass sensor readings, gyroscope sensor reading, proximity sensor readings, bump sensor readings, optical flow sensor reading, vision based sensor readings, sonic based sensors readings, measurement of signal intensity of a faint, reflected and/or multipath signal, and/or other systems that provide indication of relative position.) In one embodiment related to the scenario shown in
5) The ability to use position information to travel from room-to-room and/or zone-to-zone while maintaining abilities to clean the combined area systematically, where the robot may or may not engage path planning techniques, mapping of obstacles and/or open areas, and/or user input on paths to develop optimized routes between locations in different rooms and/or zones.
6) The ability to travel from room-to-room and/or zone-to-zone where position information may or may not be continuously available in transitional areas between rooms and/or zones, where the robot may employ one or more methods for transitioning in areas where position information is not locally available, is intermittently available and/or is less reliable, by making estimates of the position of those areas by their boundary relative to one or more known areas and/or through the use of other measures or estimates of changes in distance, orientation and/or relative position from one or more known positions (such as but not limited to random and/or semi-random exploration, control of motors and/or wheels, feedback from motors, odometer readings, accelerometer readings, compass sensor readings, gyroscope sensor reading, proximity sensor readings, bump sensor readings, optical flow sensor reading, vision based sensor readings, sonic based sensors readings, measurement of signal intensity of a faint, reflected and/or multipath signal, and/or other systems that provide indication of relative position.)
7) The ability to expand the range of coverage and/or increase the accuracy of the position estimate through the placement of one or more mobile devices to a known location that provides a secondary system of one or more reference points for the robot to derive its relative position. One embodiment could include a system where the robot itself temporarily places one or more mobile devices and/or objects at known positions, and uses those devices and/or objects to obtain and/or enhance position information for specific region, and may or may not have the ability to retrieve the devices in order to repeat the process in additional areas.
8) The ability to use detection of the original source of one or more emitted signals and/or reflections of one or more emitted signals to navigate around obstacles and/or through open pathways (such as but not limited to doorways, hallways, paths around furniture, etc.) where direct detection of the original emitted signal(s) may or may not be available and/or may not be strong enough to provide immediate and/or reliable absolute local position information.
9) The ability to use faint detection of one or more emitted signals and/or reflections from far away from the originating point of one or more signals in combination with exploring behaviors to progressively move toward areas where the signal(s) are stronger and/or eventually progress to an area where the signals(s) are strong enough to acquire local position information.
10) The ability to use position information to enable users to train and/or provide other inputs to the robot for helping define areas, paths, behaviors, priorities and/or techniques for cleaning, either by boundary, areas of focus (e.g. spot cleaning) specific paths to follow, patterns to execute, sequence of coverage, areas to avoid, and/or areas to ensure not to miss. One embodiment can include but is not limited to a device and/or configuration which enables the user to control the movement and/or other actions of the robot during the training period, where the robot records the positioning information and/or other user input related to the desired cleaning behavior for those locations. Embodiments of this approach can include but are not limited to: a pointing device that enables the user to direct the robot where to go, which may or may not include the means to input additional commands to the robot that assign different cleaning behaviors for the location; a device which the user to holds and/or wears that the robot can follow as the user moves through the environment; a device that controls the robot with an RF controller or other type remote control; a device that remotely controls another mobile robot or device that the robot can track; and/or a configuration where the user manually moves the robot around in the desired areas as it records its location and/or desired cleaning behaviors. Another set of embodiments can involve devices and/or configurations where the robot observes the movement of a second device is that is manually or remotely controlled, and the robot records the motion of the second device to learn location information for cleaning. The training for the above systems may or may not include a multi-room and/or multi-zone memory system, whereby the trained information can be tied to specific rooms and/or zones, where the robot can access the trained information when it detects and/or is instructed that it is in a certain room/zone. Another set of embodiments can include but is not limited to physical placement of one or more devices and/or object the robot can detect and integrate with its positioning system adapt its cleaning behavior, such as but not limited to devices that define a boundary, define a direction to follow, define an area to avoid, define an area to focus on for deeper cleaning, define an area to use a specific type of cleaning mode (such as steam cleaning only on certain carpeted areas as just one possible example.)
11) The ability to use positioning information to have a robot learn areas through exploration where it tracks position information and integrates learning of the environment (such as but not limited to: obstacle detection, types floor surfaces, areas of higher concentration of dirt, pathways between areas, user input regarding the environment, and/or other means) to adapt its cleaning routines and/or other operations to optimize performance for that environment.
12) The ability to use positioning information to integrate user input through the physical positioning of the robot to influence how the robot cleans and/or make cleaning more efficient and/or effective for a specific area.
a) One embodiment can include but would not be limited to having the user place the robot in corner of a room (such as the bottom right corner) as a starting point and combining that placement with a behavior where the robot cleans from one corner to the other following a right to left progression.
b) Another embodiment can include the user placing the robot in multiple locations to train it on boundaries of the room, areas to cover, desired starting point and/or direction for cleaning, and/or patterns to use to while cleaning.
13) The ability to integrate location identification connected to the position information, such as input regarding the type of room it is in, such as a kitchen, dinner room, other type of room, to optimize which behavior(s) and/or algorithm(s) the robot selects to attempt to clean the room based on one more models of configurations and conditions likely for that type of room.
a) One embodiment can be using the selection of a room ID of a NorthStar projector (e.g. by its frequency or other means) to indicate the type of room, by which the NorthStar sensor on the robot is immediately aware upon detection of the signal and room ID. In that scenario, if for example the room ID indicated the room was a dinning room, the robot could select behavior(s) and/or algorithm(s) designed to detect the location of a primary table, pursue primary cleaning path around the full perimeter of table, and engage routines for cleaning beneath the table where it expects to come into contact with the legs of the table and chairs.
14) The ability to have position information transferred from one device another to optimize the performance of the system, through means which can include but is not limited to containing all or part of the localization system into a modular detachable device (such as a “robotic brain”) that can be connected to a variety of robots, robotic-enabled devices and/or non-robotic devices, so that position information and/or other learning from the operation of the module in conjunction with one or more robots, robotic-enabled devices and/or non-robotic devices can be utilized when the module is later used in conjunction with another robot or robotic-enabled device, as is described in Transferable Intelligent Control Device, application Ser. No. 12/234,543, filed Sep. 19, 2008, which is hereby incorporated by reference herein.
a) Another embodiment can include but is not limited to where the means for transforming information is primarily digital rather than physical, so that position information and/or other learning from the operation from one or more robots, robotic-enabled devices and/or non-robotic devices can be shared by electronic means (such as through wired communication, wireless communication, use of electronic data storage device, download through a computing platform, and/or other means) with other robots or robotic-enabled devices, in cases where the robots or devices operate within the same environment but may or may not perform similar tasks.
b) Another embodiment could involve the same approach described above, but where the learning is not limited to a specific environment, but may provide for more generalized leaning and/or application of localization-related behaviors across multiple robots and robotics enabled devices in different environments, by abstracting descriptions of environments and identifying which behaviors or combination of behaviors performed most successfully and/or predicting which behaviors may best perform given the new environment, specific robot or robotic-enabled device platform, desired user goals, and/or other situational conditions. Description of this technique is disclosed in U.S. Pat. No. 6,889,118, issued May 3, 2005, which is hereby incorporated by reference herein.
17) The ability to use position information and/or one or more of the abilities described above to coordinate behavior across two or more robots and/or cooperatively perform one or more tasks, which can include but is not limited to designating specific tasks for each robot, designating areas for each robot, and/or sharing information of tasks performed and/or areas covered in order to have the robots operate as an integrated system rather than independent devices.
The invention may be implemented in hardware or software, or a combination of both (e.g., programmable logic arrays). Unless otherwise specified, the algorithms included as part of the invention are not inherently related to any particular computer or other apparatus. In particular, various general purpose machines may be used with programs written in accordance with the teachings herein, or it may be more convenient to construct more specialized apparatus (e.g., integrated circuits) to perform particular functions. Thus, the invention may be implemented in one or more computer programs executing on one or more programmable computer systems each comprising at least one processor, at least one data storage system (which may include volatile and non-volatile memory and/or storage elements), at least one input device or port, and at least one output device or port. Program code is applied to input data to perform the functions described herein and generate output information. The output information is applied to one or more output devices, in known fashion.
Each such program may be implemented in any desired computer language (including machine, assembly, or high level procedural, logical, or object oriented programming languages) to communicate with a computer system. In any case, the language may be a compiled or interpreted language.
Each such computer program is preferably stored on or downloaded to a storage media or device (e.g., solid state memory or media, or magnetic or optical media) readable by a general or special purpose programmable computer, for configuring and operating the computer when the storage media or device is read by the computer system to perform the procedures described herein. The inventive system may also be considered to be implemented as a computer-readable storage medium, configured with a computer program, where the storage medium so configured causes a computer system to operate in a specific and predefined manner to perform the functions described herein.
A number of embodiments of the invention have been described. Nevertheless, it will be understood that various modifications may be made without departing from the spirit and scope of the invention. For example, some of the steps described above may be order independent, and thus can be performed in an order different from that described. Accordingly, other embodiments are within the scope of the following claims.
This application is a continuation application of and claims priority under 35 U.S.C. § 120 to U.S. application Ser. No. 12/976,786, filed Dec. 22, 2010, which is a continuation of and claims priority under 35 U.S.C. § 120 to U.S. application Ser. No. 12/429,963, filed Apr. 24, 2009, which claims the benefit under 35 U.S.C. § 119(e) of U.S. Provisional Application No. 61/125,684, filed Apr. 24, 2008, entitled “Application of Localization, Positioning & Navigation Systems for Robotic Enabled Mobile Products” the disclosures of each of which are hereby incorporated by reference in their entireties herein.
| Number | Name | Date | Kind |
|---|---|---|---|
| 5402051 | Fujiwara et al. | Mar 1995 | A |
| 5440216 | Kim | Aug 1995 | A |
| 5720077 | Nakamura et al. | Feb 1998 | A |
| 5815880 | Nakanishi | Oct 1998 | A |
| 5841259 | Kim et al. | Nov 1998 | A |
| 5894621 | Kubo | Apr 1999 | A |
| 5940927 | Haegermarck et al. | Aug 1999 | A |
| 5959423 | Nakanishi et al. | Sep 1999 | A |
| 5991951 | Kubo et al. | Nov 1999 | A |
| 5998953 | Nakamura et al. | Dec 1999 | A |
| 6012618 | Matsuo | Jan 2000 | A |
| 6076025 | Ueno et al. | Jun 2000 | A |
| 6098239 | Vosbikian | Aug 2000 | A |
| 6119057 | Kawagoe | Sep 2000 | A |
| 6142252 | Kinta et al. | Nov 2000 | A |
| 6299699 | Porat et al. | Oct 2001 | B1 |
| 6327741 | Reed | Dec 2001 | B1 |
| 6338013 | Ruffner | Jan 2002 | B1 |
| 6459955 | Bartsch et al. | Oct 2002 | B1 |
| 6463368 | Feiten et al. | Oct 2002 | B1 |
| 6481515 | Kirkpatrick et al. | Nov 2002 | B1 |
| 6574536 | Kawagoe | Jun 2003 | B1 |
| 6580246 | Jacobs | Jun 2003 | B2 |
| 6687571 | Byrne et al. | Feb 2004 | B1 |
| 6741054 | Koselka et al. | May 2004 | B2 |
| 6742613 | Erlich et al. | Jun 2004 | B2 |
| 6771217 | Liu et al. | Aug 2004 | B1 |
| 6779217 | Fisher | Aug 2004 | B2 |
| 6810305 | Kirkpatrick | Oct 2004 | B2 |
| 6889118 | Murray, IV et al. | May 2005 | B2 |
| 6901624 | Mori et al. | Jun 2005 | B2 |
| 6938298 | Aasen | Sep 2005 | B2 |
| 7013528 | Parker et al. | Mar 2006 | B2 |
| 7015831 | Karlsson et al. | Mar 2006 | B2 |
| 7113847 | Chmura et al. | Sep 2006 | B2 |
| 7135992 | Karlsson et al. | Nov 2006 | B2 |
| 7145478 | Goncalves et al. | Dec 2006 | B2 |
| 7162338 | Goncalves et al. | Jan 2007 | B2 |
| 7177737 | Karlsson et al. | Feb 2007 | B2 |
| RE39581 | Stuchlik et al. | Apr 2007 | E |
| 7225552 | Kwon et al. | Jun 2007 | B2 |
| 7272467 | Goncalves et al. | Sep 2007 | B2 |
| 7320149 | Huffman et al. | Jan 2008 | B1 |
| 7346428 | Huffman et al. | Mar 2008 | B1 |
| 7480958 | Song et al. | Jan 2009 | B2 |
| 7720554 | DiBernardo et al. | May 2010 | B2 |
| 7827643 | Erlich et al. | Nov 2010 | B2 |
| 8961695 | Romanov et al. | Feb 2015 | B2 |
| 20020002751 | Fisher | Jan 2002 | A1 |
| 20020011813 | Koselka et al. | Jan 2002 | A1 |
| 20020116089 | Kirkpatrick, Jr. | Aug 2002 | A1 |
| 20020175648 | Erko et al. | Nov 2002 | A1 |
| 20030229421 | Chmura et al. | Dec 2003 | A1 |
| 20040031113 | Wosewick et al. | Feb 2004 | A1 |
| 20040143930 | Haegermarck et al. | Jul 2004 | A1 |
| 20040168148 | Goncalves et al. | Aug 2004 | A1 |
| 20040244138 | Taylor et al. | Dec 2004 | A1 |
| 20050010330 | Abramson | Jan 2005 | A1 |
| 20050021186 | Murray et al. | Jan 2005 | A1 |
| 20050156562 | Cohen | Jul 2005 | A1 |
| 20050162119 | Landry et al. | Jul 2005 | A1 |
| 20050209736 | Kawagoe | Sep 2005 | A1 |
| 20050213082 | DiBernardo et al. | Sep 2005 | A1 |
| 20050217061 | Reindle | Oct 2005 | A1 |
| 20050229340 | Sawalski et al. | Oct 2005 | A1 |
| 20050278888 | Reindle et al. | Dec 2005 | A1 |
| 20050289527 | Illowsky et al. | Dec 2005 | A1 |
| 20060085095 | Reindle et al. | Apr 2006 | A1 |
| 20060095169 | Minor et al. | May 2006 | A1 |
| 20060238157 | Kim et al. | Oct 2006 | A1 |
| 20060288519 | Jaworski et al. | Dec 2006 | A1 |
| 20060293794 | Harwig et al. | Dec 2006 | A1 |
| 20060293809 | Harwig et al. | Dec 2006 | A1 |
| 20070016328 | Ziegler | Jan 2007 | A1 |
| 20070061040 | Augenbraun et al. | Mar 2007 | A1 |
| 20070097832 | Koivisto et al. | May 2007 | A1 |
| 20070213892 | Jones et al. | Sep 2007 | A1 |
| 20080009965 | Bruemmer et al. | Jan 2008 | A1 |
| 20080104783 | Crawford et al. | May 2008 | A1 |
| 20080133052 | Jones et al. | Jun 2008 | A1 |
| 20080155768 | Ziegler et al. | Jul 2008 | A1 |
| 20080174268 | Koo | Jul 2008 | A1 |
| 20080183349 | Abramson | Jul 2008 | A1 |
| 20080184518 | Taylor | Aug 2008 | A1 |
| 20090081923 | Dooley et al. | Mar 2009 | A1 |
| 20090082879 | Dooley et al. | Mar 2009 | A1 |
| 20090133720 | Van Den Bogert | May 2009 | A1 |
| 20100198443 | Yabushita et al. | Aug 2010 | A1 |
| 20100235033 | Yamamoto et al. | Sep 2010 | A1 |
| 20100241289 | Sandberg | Sep 2010 | A1 |
| 20150128996 | Dooley | May 2015 | A1 |
| Number | Date | Country |
|---|---|---|
| 2402250 | Oct 2000 | CN |
| 2538268 | Mar 2003 | CN |
| 1759797 | Apr 2006 | CN |
| 1765595 | May 2006 | CN |
| 1768692 | May 2006 | CN |
| 1927549 | Mar 2007 | CN |
| 2897132 | May 2007 | CN |
| 102083352 | Oct 2014 | CN |
| 10242257 | Apr 2003 | DE |
| 1912104 | Apr 2008 | EP |
| 2313191 | Nov 1997 | GB |
| 2006209644 | Aug 2006 | JP |
| 20060095657 | Sep 2006 | KR |
| 0182766 | Nov 2001 | WO |
| 0191623 | Dec 2001 | WO |
| 0191624 | Dec 2001 | WO |
| 0239868 | May 2002 | WO |
| 0416146 | Feb 2004 | WO |
| 2007085030 | Jun 2007 | WO |
| Entry |
|---|
| European Search Report in European Patent Application No. 17182837.9, dated Jun. 5, 2018, 7 pages. |
| Partial European Search Report in European Patent Application 17182837, dated Jan. 11, 2018, 17 pages. |
| State Intellectual Property Office of People's Republic of China; Office Action dated Oct. 11, 2013, from related application Chinese Patent Application No. CN 200980124250.3. |
| Office action dated Jun. 8, 2012, from related application U.S. Appl. No. 12/976,786, filed Dec. 22, 2010, 13 pgs. |
| European Patent Office; Notification of Transmittal of the International Search Report and the Written opinion of the International Searching Authority, or the Declaration, the International Search Report, and the Written Opinion of the International Searching Authority; dated Sep. 10, 2009; Rijswijk, The Netherlands, 19 pages, PCT/US2009/041728. |
| The International Bureau of WIPO; Notification Concerning Transmittal of International Preliminary Report on Patentability; International Preliminary Report on Patentability, and Written Opinion of the International Searching Authority; dated Nov. 4, 2010; Geneva, Switzerland, 14 pages, PCT/US2009/041728. |
| Number | Date | Country | |
|---|---|---|---|
| 20170297455 A1 | Oct 2017 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61125684 | Apr 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12976786 | Dec 2010 | US |
| Child | 15642226 | US | |
| Parent | 12429963 | Apr 2009 | US |
| Child | 12976786 | US |
