The present invention relates to a robotic vacuum cleaner system which makes use of a fiducial mark or marks on a robotic vacuum cleaner charging station for diagnostic purposes.
Robotic vacuum cleaners often use fiducial marks to navigate themselves back to their docking or charging stations. It would be useful, however, to expand the uses of the fiducial marks.
The inventors of the present invention have realized that the fiducial marks on a robotic vacuum cleaner charging station may be used for more than just guiding the robotic vacuum cleaner back to the robotic vacuum cleaner charging station after a cleaning operation. In particular, the present invention provides a robotic vacuum cleaner which is able to use the fiducial marks on an associated robotic vacuum cleaner charging station for diagnostic purposes. Specifically, a first aspect of the present invention provides a robotic vacuum cleaner system comprising: a robotic vacuum cleaner comprising a camera; and a processor comprising: a fiducial mark detecting module; a diagnostics module; and an alert generation module, wherein: the camera is configured to obtain an image of the surroundings of the robotic vacuum cleaner, and to transmit the obtained image to the processor; and the fiducial mark detecting module is configured to: receive the image of the surroundings from the camera; and detect a fiducial mark on a robotic vacuum cleaner charging station in the image; the diagnostics module is configured to determine whether the image of the fiducial mark has predetermined expected characteristics, based on the image of the fiducial mark and additional information received by the diagnostics module; and if the diagnostics module determines that the image of the fiducial mark does not have the predetermined expected characteristics, the alert generation module is configured to generate an alert.
By comparing the characteristics or properties of an image of a fiducial mark obtained by the camera, it is possible to diagnose possible issues with the robotic vacuum cleaner, the robotic vacuum cleaner charging station, or the surrounding environment, specifically when the characteristics do not match an expectation. This is explained in more detail later in the application. In the present application, the term “fiducial mark” is used to refer to a mark on a robotic vacuum cleaner charging station which may be used as a reference, and which is easily identifiable in an image, or in image data. More detailed characteristics of the fiducial marks are set out later in this application. Fiducial marks are typically used for navigation of robotic vacuum cleaners, but the inventors of the present invention have realized that the same fiducial marks may be used for diagnostic purposes.
The modules of the processor which are referred to above may be implemented as physical hardware modules. Alternatively, the modules may be implemented as functional, software modules, e.g. modules which are implemented in code. The alert may comprise a visual alert, e.g. a light, or flashing light. Alternatively, or additionally, the alert may comprise an audio alert, such as a sound which is played, e.g. a beep or buzz. In some cases, the robotic vacuum cleaner may comprise the processor, so that all of the processing steps discussed in this application take place on the robotic vacuum cleaner itself. Alternatively, the processor may be located on an external device such as a client device (e.g. a smartphone or other personal computing device), or a cloud computing server to which the robotic vacuum cleaner is configured to transmit the obtained information in order to determine e.g. the location and the presence/characteristics of the fiducial mark. The generated alert may be emitted from the robotic vacuum cleaner itself or by e.g. a user's personal computing device, so that the user is made aware of an issue even when not with the robotic vacuum cleaner during its cleaning operation.
It should be noted that the robotic vacuum cleaner system may comprise more than one camera. Furthermore, the one or more cameras may be configured to obtain a plurality of images. For example, at a given time, each camera of a plurality of cameras may be configured to obtain a respective image. Alternatively, each camera may be configured to obtain one or more respective images. Throughout this application, when it is stated that a given operation is executed e.g. based on “an obtained image”, or “the obtained image”, it should be understood that the same operation may be executed based on a plurality of obtained images too.
Herein, the “expected characteristics” of the image of the fiducial mark may comprise its location within the obtained image of the surroundings, and its shape within the obtained image of the surroundings (which is an indication of the orientation of the robotic vacuum cleaner relative to the fiducial mark, and therefore of the robotic vacuum cleaner charging station). The “expected characteristics” may also comprise the size of the fiducial mark within the obtained image of the surroundings, thereby providing an indication of the relative distance between the robotic vacuum cleaner and the fiducial mark on the robotic vacuum cleaner charging station. The “additional information” may comprise any information which defines or informs what the expected characteristics are at a given time. For example, the additional information may comprise the information that the robotic vacuum cleaner is being charged by or engaged with the robotic vacuum cleaner charging station, the location of the robotic vacuum cleaner at the time, a stage of a cleaning operation, or a time. It should be stressed that this is by no means an exhaustive list, though.
In cases where the expected characteristics refer to the location, shape, size, or other geometric characteristics of the fiducial mark within the obtained image, the diagnostics module may be configured quantitatively to determine a deviation from the expected characteristic or characteristics in question. In these cases, “expected characteristics” may be used interchangeably with e.g. “expected properties”, or “expected parameter values”, where the parameters define measurable properties of the image of the fiducial mark. Then, the diagnostics module may be configured to compare the determined deviation with a predetermined threshold deviation, which may be stored in a memory of the robotic vacuum cleaner. If it is determined that the determined deviation exceeds the predetermined threshold deviation, then the diagnostics module may be configured transmit instructions to the alert generation module, the instructions being configured to cause the alert generation module to generate an alert. In some, cases the diagnostics module of the processor may be configured to determine a deviation from the position of a fiducial mark in an obtained image and the expected position of the fiducial mark. Then, the diagnostics module may be configured to determine whether the deviation exceeds the predetermined threshold deviation (which may be stored in e.g. a memory of the robotic vacuum cleaner), and if so, the alert generation module may be configured to generate an alert, as outlined above.
In some cases, the robotic vacuum cleaner may be configured to engage with a robotic vacuum cleaner charging station in order to charge. In some cases, the robotic vacuum cleaner system may further comprise the robotic vacuum cleaner charging station, but it should be noted that in a broad example, the robotic vacuum cleaner system does not comprise the robotic vacuum cleaner charging system. Both arrangements are equally valid aspects of the invention.
The processor may comprise a charging detection module configured to determine when the robotic vacuum cleaner is being charged. Alternatively, or additionally, the robotic vacuum cleaner may comprise an engagement detection module configured to detect when the robotic vacuum cleaner is engaged with a robotic vacuum cleaner charging station (regardless of whether the device is charging, e.g. because the power to the robotic vacuum cleaner charging station is switched off). When the robotic vacuum cleaner is engaged with the robotic vacuum cleaner charging station, all things being well, the fiducial marks on the robotic vacuum cleaner charging station should be in a predetermined location, relative to the robotic vacuum cleaner. Any deviation from this predetermined relative location may be an indicator that there is a fault with the robotic vacuum cleaner charging station, that the robotic vacuum cleaner is improperly aligned with the robotic vacuum cleaner charging station, or that the robotic vacuum cleaner charging station has been improperly assembled. This kinds of faults or misalignments preferably give rise to an alert. In order to achieve this, when either the charging module detects that the robotic vacuum cleaner is being charged by the robotic vacuum cleaner charging station or the engagement detection module detects that the robotic vacuum cleaner is engaged with the robotic vacuum cleaner charging station, the diagnostics module may be configured to determine whether the fiducial marks are located in an 20 expected position in the image.
If, when the robotic vacuum cleaner is in a charging position, or otherwise engaged with a robotic vacuum cleaner charging station, and the fiducial detection module or the diagnostics module determines that the fiducial marks are either not present in the image received from the camera or are not present in an expected location in an image received from the camera, the robotic vacuum cleaner may be configured to generate an alert indicating that the robotic vacuum cleaner is improperly assembled, e.g. that the backplate of the charging station is not properly connected to the rear engagement region of the dock.
In a particular arrangement, the robotic vacuum cleaner charging station is separable into two or more components. In such cases, detection by the diagnostics module of the processor that the image of the fiducial mark does not have the expected characteristics may be indicative of the fact that the components of the robotic vacuum cleaner charging station have not been properly assembled.
Specifically, when the robotic vacuum cleaner is in a charging position (e.g. as detected by the charging detection module), or otherwise engaged with a robotic vacuum cleaner charging station (e.g. as detected by the engagement detection module), and the fiducial detection module or the diagnostics module determines that the fiducial marks are either not present in the image received from the camera or are not present in an expected location in an image received from the camera, the robotic vacuum cleaner may be configured to generate an alert indicating that the backplate of the charging station is not properly connected to the rear engagement region of the dock.
We now discuss the characteristics of the separable robotic vacuum cleaner charging station in more detail. The robotic vacuum cleaner charging station may comprise a dock and a planar backplate, wherein the black plate is separably connected to an engagement portion of the dock by means of engagement between a first connector on the engagement portion and a second connector on the backplate. Specifically, the engagement portion may comprise a front engagement region having a first electrical contact configured to engage with a complementary second electrical contact on the robotic vacuum cleaner. The dock may further comprise a base arranged, in use, to contact a floor. The backplate is preferably planar, having a front surface comprising the second connector, and a rear surface. The fiducial marks are preferably located on the planar backplate, preferably on the front surface thereof. Preferably, there are two fiducial marks on the backplate. The fiducial marks preferably include a pattern of black and white regions. Preferably, the fiducial mark includes four square regions arranged into a larger square, the four square regions alternately coloured black and white. The backplate is preferably rectangular (or square shaped), with a top edge of the backplate arranged in use to be parallel to the floor. In such cases, a first fiducial mark is preferably located at a first top corner of the backplate, and a second fiducial marks is preferably located at a second top corner of the backplate, the first top corner opposite the second top corner.
As discussed, the robotic vacuum cleaner charging station may be separable into the dock and the backplate. Herein, “separably” means that it is possible to separate the backplate from the dock. The term may be used interchangeably with e.g. “reversibly”, “removably”, “detachably”. Even though the connection is separable, it is preferred that there is some kind of locking engagement which enables the two components to be fixed together. The locking engagement may be provided by e.g. a frictional force between the first connector and the second connector, which can be overcome with a sufficient separating force.
Herein, the term “connector” is used to refer to a feature which enables the joining of two components together. The first connector and the second connector are preferably complementary to each other. Herein, “complementary” means that the first connector and the second connector are preferably engaged, or engageable with, each other. In other words, when the two components are connected, they are locked or held in place, or otherwise secured together, albeit reversibly (i.e. not permanently). In some cases, the first connector may be a first mechanical connector and the second connector may be a second mechanical connector, i.e. the connectors may be engageable with each other by virtue of their geometry, and optionally moving features. Alternatively, or additionally, the first connector may be a first magnetic connector and the second connector may be a second magnetic connector, i.e. the connectors may be engageable with each other as a result of an attractive magnetic force between the two. In some cases, the connectors may be mechanical and magnetic. Other mechanisms of engagement between the first connector and the second connector are also envisaged: the invention is not limited only to mechanical and magnetic engagement. The first connector may comprise a recess, and the second connector may comprise a projection. Alternatively, the first connector may comprise a projection and the second connector may comprise a recess. In each case, the recess may be configured to receive the projection.
The rear engagement region of the dock may comprise a plurality of first connectors, and the front surface of the backplate may comprise a plurality of second connectors, wherein the backplate is separably connected to the engagement portion of the dock by means of engagement between each first connector with a respective second connector. As with the plurality of electrical contacts, engagement by means of a plurality of connectors ensures a more stable engagement, and may act to limit undesirable rotation, which could cause damage to the connectors. In implementations in which there are a plurality of first connectors and a plurality of second connectors, all of the first connectors may comprise projections, and all of the second connectors may comprise recesses, configured to receive the projections. Or, all of the first connectors may comprise recesses, and all of the second connectors may comprise projections, the recesses configured to receive the projections. In other cases, the plurality of first connectors may comprise a mixture of projections and recesses, with the plurality of second connectors comprising a complementary mixture of projections and recesses.
The backplate of the robotic vacuum cleaner charging station is planar. Herein, the term “planar” may mean that the entirety of the backplate is planar or substantially planar, or flat. The term may also encompass a component, a significant majority of which is planar or substantially planar. It is required that the backplate have a front surface and a rear surface. The terms “front” and “rear” herein refer to the location of the surface when the robotic vacuum cleaner charging station is in normal use. In a usage configuration, the base (specifically, a lower surface of the base) is preferably facing downwards and engaged with a floor of the building. In some implementations, the base may be separable from the engagement portion in a similar manner to the backplate being separable from the backplate.
In use, and when the backplate is engaged with the dock by virtue of engagement between the first connector and the second connector, the plane of the backplate is preferably perpendicular or substantially perpendicular to the base. Preferably, the plane of the backplate is vertically or substantially vertically upright when the base is engaged with the floor as outlined above. In such cases, the rear surface of the backplate is preferably arrange, in use, to contact a vertical wall, e.g. an internal wall of a building. However, in some cases, the robotic vacuum cleaner charging station need not be up against a wall. The surfaces of the backplate are referred to as a “front surface” and a “rear surface”. In the context of the invention, a “forward” direction is the direction out of the plane of the backplate towards the dock (i.e. out from the front surface), and a “backward” or “rear-facing” direction is the opposite (or substantially opposite) direction. The term “lateral” may be used to refer to sideways (i.e. left-right) directions.
A robotic vacuum cleaner charging station is a component which may be connected to a robotic vacuum cleaner in order to charge its battery. Accordingly, the dock may be configured to receive a supply of electrical current, for example from the mains electricity, or from an external battery. The dock is may be configured to receive the electric current via a wire, cable, or other electrical connector. In other cases, the robotic vacuum cleaner may comprise its own power supply, e.g. a battery, preferably a rechargeable battery. In order to operate as a robotic vacuum cleaner charging station, it must be able to convey the electrical current to the robotic vacuum cleaner itself. Accordingly, the first electrical contact may be configured to convey electrical current to the robotic vacuum cleaner is engaged with the complementary second electrical contact, thereby charging the robotic vacuum cleaner. It should be noted that the robotic vacuum cleaner charging station of the first aspect of the invention preferably does not include the robotic vacuum cleaner itself, and therefore the complementary second electrical contact preferably does not form part of the invention. In later aspects of the invention, kits and systems are provided which do include the robotic vacuum cleaner.
The rear engagement region may comprise or be in the form of a planar wall arranged to face the front surface of the backplate. Or, when the dock is engaged with the backplate, the planar wall of the front engagement portion may face the front surface of the backplate. The presence of two planar surfaces facing each other helps to minimize the overall form factor of the assembled robotic vacuum cleaner charging station. In such cases, the dock may be configured to receive the supply of electrical current via a cable from an external power source, and the planar rear wall of the rear engagement portion may include a groove arranged to receive the cable. By providing a groove in which the cable may reside when the robotic vacuum cleaner charging station is assembled, it is possible to ensure that the front surface of the backplate and the planar wall forming the rear of the rear engagement portion rest flush against one another, again reducing the form factor of the assembled robotic vacuum cleaner charging station. Alternatively, the front surface of the backplate may include the groove, with equivalent benefits achieved. Preferably, the groove extends to one or both of the lateral edges of the planar wall of the rear engagement portion. In this way, the cable can emerge from a side of the assembled robotic vacuum cleaner charging station, while the two planar faces are flush together. In other cases, the backplate may have a hole formed therein, the hole preferably formed in a location corresponding to a location of a charging port on the rear engagement portion, so that an electrical connector at one end of the cable may be connected to a charging port on the rear engagement port even when the robotic vacuum cleaner charging station is assembled.
The groove may comprise one or more cable-retaining features configured to prevent the cable from inadvertently exiting the groove. The cable-retaining features may be features of the geometry of the groove, or may comprise e.g. lips, clips, hooks, or other formations arranged to keep the cable in place in the groove.
The front engagement region of the dock may comprise a plurality of first electrical contacts, configured to engage with a respective plurality of second electrical contacts on the robotic vacuum cleaner. The use of a plurality of electrical contacts ensures improved stability when the robotic vacuum cleaner is engaged with the charging station, which itself may reduce the risk of damage to the electrical contacts of either the robotic vacuum cleaner or the charging station. Preferably, front engagement region includes two first electrical contacts configured to engage with two respective electrical contacts on the robotic vacuum cleaner. The robotic vacuum cleaner charging station may comprise a front-facing planar surface, and the first electrical contact or the plurality of first electrical contacts may be located on the front-facing planar surface. The plane of the front-facing planar surface is preferably perpendicular to a plane of the base of the dock, such that it is vertical or substantially vertical in use. In implementations in which there are two electrical contacts, the two electrical contacts are preferably laterally spaced from each other, with a first electrical contact being located near a first lateral edge of the planar wall, and a second electrical contact being located at a second lateral edge of the planar wall, the first lateral edge being opposite the second lateral edge.
We now discuss some structural features of the robotic vacuum cleaner charging station which enable it to engage with the robotic vacuum cleaner. At a high level, in addition to the electrical contacts, the robotic vacuum cleaner charging station (specifically, the front engagement region thereof) is preferably shaped to conform to the robotic vacuum cleaner. The front engagement region may further comprise a laterally extending recess arranged to receive a front portion of the robotic vacuum cleaner. Herein, “laterally-extending” should be understood to mean that the recess runs in a lateral direction as explained earlier. Preferably, the laterally extending recess extends across the full lateral extent of the front engagement region, i.e. it has no side walls. The laterally-extending recess preferably has a constant cross-section, i.e. it may be prismatic. The cross-section may be quadrant-shaped, or substantially quadrant-shaped, where “quadrant” is used herein to refer to a quarter-circle, or a quarter-ellipse. The geometry of the front portion of the robotic vacuum cleaner is preferably complementary to the geometry of the laterally-extending recess, i.e. an inversion thereof, so that the front portion of the robotic vacuum cleaner is configured to rest closely or tightly in the laterally-extending recess. Such conforming geometry may enable a more stable engagement between the first electrical contact(s) and the second electrical contact(s), and may also aid in docking of the robotic vacuum cleaner with the robotic vacuum cleaner charging station. In the above, the plurality of first connectors may consist of two first connectors, and the plurality of second connectors may consist of two second connectors.
In some implementations, the base may extend past a rear wall of the engagement portion. The portion of the base which extends past may form a lip or ledge. In such cases, the first connector (or plurality thereof) may be located on this portion. Rather than being on a front surface of the backplate, in these cases, a bottom surface of the backplate may comprise include the second connector (or plurality thereof). As above, the first and second connectors may comprise one or more projections and complementary recesses. In these cases, in order to assemble the robotic vacuum cleaner, the backplate may be engaged with the lip or ledge in a vertical direction. This may be advantageous in that it would prevent the two components from becoming inadvertently separated by movement in a forward-backward direction.
The processor may further comprise a location detection module, which is configured to determine the location of the robotic vacuum cleaner in the building. In some cases, the location determination module may be configured to determine the location of the robotic vacuum cleaner in the building based on one or more obtained images from the camera(s). The location determination unit may be used in combination with the fiducial marks to enable the robotic vacuum cleaner to navigate back to the robotic vacuum cleaner charging station after a cleaning operation has been completed, or when e.g. a rechargeable power source of the robotic vacuum cleaner is running low. For example, the robotic vacuum cleaner may comprise a memory storing a map of a floor of the building, the map including an indication of the location of the charging station, and a motion system. The processor may further comprise a navigation module, and in a return operation, the navigation module may be configured to determine a route back from a current location of the robotic vacuum cleaner towards the charging station, and to generate instructions, which when received by the motion system, cause it to move the robotic vacuum cleaner towards the charging station. The location determination module may be further configured to determine, based on a determined location of the robotic vacuum cleaner and the map of the floor of the building, when the robotic vacuum cleaner is located within a predetermined threshold distance of the charging station. And, the fiducial detection module may be configured to detect the presence of the one or more fiducial marks on the charging station when it is determined that the robotic vacuum cleaner is within the predetermined threshold distance of the charging station. The predetermined threshold distance may be, for example, 0.5 to 2 metres.
The fiducial mark or marks may have a diagnostic purpose in this context, as well as detecting whether or not the robotic vacuum cleaner charging station is correctly assembled.
When it is determined that the robotic vacuum cleaner is located within the predetermined threshold distance of the robotic vacuum cleaner charging station, the one or more cameras may be configured to obtain one or more images of the surroundings of the robotic vacuum cleaner in its location. Thereafter, the fiducial detection module may be configured to detect whether the fiducial mark on the robotic vacuum cleaner charging station is present in an image obtained by the camera(s). Alternatively, or additionally, the fiducial detection module (or, indeed, the diagnostics module) may be configured to determine whether the fiducial marks are in an expected location or have an expected shape in the obtained one or more images. Specifically, if the fiducial marks are not present, or are in an unexpected location (or an unexpected orientation), then this may be an indication that the robotic vacuum cleaner charging station has been moved, or obscured by another item. In the positive case, when it is determined that the fiducial marks are present in the image obtained by the one or more cameras, the fiducial detection module is configured to determine relative position information indicating a position of the robotic vacuum cleaner relative to the charging station; and the navigation module is configured to: determine a route from the current location of the robotic vacuum cleaner to a charging position in which the robotic vacuum cleaner is engaged with the charging station, based on the relative position information, and generate instructions, which when received by the motion system, cause it to move the robotic vacuum cleaner to the charging position.
In the converse case, however, when it is determined that the fiducial mark is not present in the obtained one or more images, or doesn't have the expected characteristics (e.g. location, shape, size, or other geometric feature), the navigation module may be configured to identify an alternative position within the predetermined threshold distance of the charging station. The navigation module may be further configured to determine a route from the current location of the robotic vacuum cleaner to the alternative position within the predetermined threshold distance of the charging station. The navigation module may be further configured to generate instructions, which when received by the motion system, cause it to move the robotic vacuum cleaner to the alternative position within the predetermined distance threshold of the charging station. And, when it is determined that that robotic vacuum cleaner is located at the alternative position within the predetermined threshold distance of the charging station, the one or more cameras may be configured again to obtain one or more images of the surroundings of the robotic vacuum cleaner in its location. Thereafter, the fiducial detection module may again be configured to detect whether the fiducial mark on the robotic vacuum cleaner charging station is present in an image obtained by the camera(s). Alternatively, or additionally, the fiducial detection module (or, indeed, the diagnostics module) may again be configured to determine whether the fiducial marks are in an expected location or have an expected shape in the obtained one or more images. Then, if the fiducial marks are again not present, or are in an unexpected location (or an unexpected orientation), then this may be an indication that the robotic vacuum cleaner charging station has been moved, or obscured by another item. In this case, the process may be repeated until the robotic vacuum cleaner has maneuvered into a position in which it is determined that the fiducial mark is present in an image obtained by the one or more cameras, and the image thereof has the expected characteristics. This process of selecting an alternative position and reassessing whether the fiducial mark is present and/or assessing whether the image thereof has the expected characteristics may be performed a predetermined number of times. After that, if a positive determination is not made, the alert generation module may be configured to generate an alert. Alternatively, the robotic vacuum cleaner, the processor may be configured to cause the robotic vacuum cleaner to shut down, or to enter a low power mode.
In some cases, the alert may be generated after a single determination that the fiducial marks are absent, or the image thereof doesn't display the expected characteristics. Alternatively put, when it is determined (e.g. by the fiducial detection module or the diagnostics module) that the fiducial mark is not present in the one or more obtained images, or when it is determined (again, e.g. by the fiducial detection module or the diagnostics module) that the image (or portion of the image) of the fiducial mark does not have the expected characteristics, the alert generation module may be configured to generate an alert. As discussed previously, in order to cause the alert generation module to generate the alert, the processor (e.g. the diagnostics module or fiducial detection module) may be configured to generate and transmit instructions to the alert generation module, the instructions configured to cause the alert generation module to generate the alert.
The diagnostic processes carried out based on the fiducial mark may take place during a return operation, i.e. when the robotic vacuum cleaner is returning to the robotic vacuum cleaner charging station after a cleaning operation. Alternatively, however, the process may take place at the beginning of a cleaning operation. Specifically, at the start of a cleaning operation, when the robotic vacuum cleaner is located in the charging position in which it is engaged with the robotic vacuum cleaner charging station (or shortly after), the fiducial detection module (or the diagnostics module) may be configured to determine either whether a fiducial mark is present in one or more images obtained by the one or more cameras, or whether the obtained image of a fiducial mark has the expected characteristics (as explained previously, with reference to location, shape, size etc.). If the result of the determination is a negative one, i.e. if the fiducial detection module (or the diagnostics module) determines either that a fiducial mark is not present in one or more images obtained by the one or more cameras, or that the obtained image of a fiducial mark does not have the expected characteristics, the alert generation module of the robotic vacuum cleaner may be configured to generate an alert as outlined previously. In some cases, the robotic vacuum cleaner will then not carry out the cleaning operation. Alternatively, the robotic vacuum cleaner may be configured still to carry out the cleaning operation.
The first aspect of the invention relates to a robotic vacuum cleaner system. A second aspect of the invention provides a method, which may be executed by the robotic vacuum cleaner system of the first aspect of the invention. Specifically, the second aspect of the invention may provide a diagnostic method performed by a robotic vacuum cleaner system, the method comprising: obtaining an image of surroundings of a robotic vacuum cleaner; detecting a fiducial mark on a robotic vacuum cleaner charging station in the obtained image; determining whether the image of the fiducial mark has predetermined expected characteristics, based on the image of the fiducial mark and additional information; and if it is determined that the image of the fiducial mark does not have the predetermined expected characteristics, generating an alert. The optional features which have been set out above with reference to the first aspect of the invention apply equally well to the second aspect of the invention, except where clearly incompatible, or where context clearly dictates otherwise. It should be stressed that in all cases, the device features may well be converted to method features. We set out some of the key features below, but it should be noted that this is by no means an exhaustive list.
Obtaining an image of the surroundings of the robotic vacuum cleaner may comprise obtaining a plurality of images.
The step of determining may comprise determining quantitatively a deviation of a value of characteristic of the fiducial mark from the obtained image from an expected value of the characteristic; comparing the determine deviation to a predetermined deviation threshold; and if it is determined that the determined deviation exceeds the predetermined threshold deviation, generating the alert.
The method may further comprise determining that the robotic vacuum cleaner is engaged with and/or being charged by a robotic vacuum cleaner charging station. Then, if it is detected that the fiducial marks are either not present in the obtained image or do not have the expected characteristics, the generated alert may indicate that a robotic vacuum cleaner charging station is not properly assembled. The discussion of the structure of the robotic vacuum cleaner charging station, set out in respect of the first aspect of the invention, applies equally well here.
The method may further comprise determining the location of the robotic vacuum cleaner in the building based on the obtained image(s). The method may further comprise determining a route back from a current location of the robotic vacuum cleaner towards the robotic vacuum cleaner charging station, and generating instructions which when received by a motion system of the robotic vacuum cleaner, cause the motion system to move the robotic vacuum cleaner towards the robotic vacuum cleaner charging station.
The method may further comprise determining when the robotic vacuum cleaner is located within a predetermined threshold distance of the charging station. In such cases, when it is determined that the robotic vacuum cleaner is located within a predetermined threshold distance of the robotic vacuum cleaner charging station, the method may further comprise detecting the presence of the fiducial mark(s). The method may also further comprise, when it is determined that the robotic vacuum cleaner is located within the predetermined threshold distance of the robotic vacuum cleaner charging station, obtaining an image of the surroundings of the robotic vacuum cleaner in that location, and determining whether the fiducial mark is present in an obtained image. Additionally, or alternatively, the method may further comprise determining whether the fiducial marks are in an expected location or have expected shape in the obtained one or more images.
When it is determined that the fiducial marks are present in the image obtained by the one or more cameras, the method may comprise determining relative position information indicating a position of the robotic vacuum cleaner relative to the robotic vacuum cleaner charging station. The method may further comprise determining a route from the current location of the robotic vacuum cleaner to a charging position in which the robotic vacuum cleaner is engaged with the charging station, based on the relative position information. The method may further comprise generating instructions, which when received by the motion system, cause it to move the robotic vacuum cleaner to the charging position.
In the converse case, however, when it is determined that the fiducial mark is not present in the obtained one or more images, or doesn't have the expected characteristics (e.g. location, shape, size, or other geometric feature), the method may further comprise identifying an alternative position within the predetermined threshold distance of the charging station. The method may then further require determining a route from the current location of the robotic vacuum cleaner to the alternative position within the predetermined threshold distance of the charging station. As before then method may further comprise generating instructions, which when received by the motion system, cause it to move the robotic vacuum cleaner to the alternative position within the predetermined distance threshold of the charging station. And, when it is determined that that robotic vacuum cleaner is located at the alternative position within the predetermined threshold distance of the charging station, the method may again further comprise obtaining one or more images of the surroundings of the robotic vacuum cleaner in its location. Thereafter, the method may comprise detecting whether the fiducial mark on the robotic vacuum cleaner charging station is present in the obtained image(s). Alternatively, or additionally, the method may further comprise determining whether the fiducial marks are in an expected location or have an expected shape in the obtained one or more images. Then, if the fiducial marks are again not present, or are in an unexpected location (or an unexpected orientation), then this may be an indication that the robotic vacuum cleaner charging station has been moved, or obscured by another item. In this case, the process may be repeated until the robotic vacuum cleaner has maneuvered into a position in which it is determined that the fiducial mark is present in an obtained image, and the image thereof has the expected characteristics.
This process of selecting an alternative position and reassessing whether the fiducial mark is present and/or assessing whether the image thereof has the expected characteristics may be performed a predetermined number of times. After that, if a positive determination is not made, the method may proceed to generating an alert. Alternatively, the method may further comprise shutting down the robotic vacuum cleaner, or entering a low power mode.
In some cases, the alert may be generated after a single determination that the fiducial marks are absent, or the image thereof doesn't display the expected characteristics. Alternatively put, when it is determined (e.g. by the fiducial detection module or the diagnostics module) that the fiducial mark is not present in the one or more obtained images, or when it is determined (again, e.g. by the fiducial detection module or the diagnostics module) that the image (or portion of the image) of the fiducial mark does not have the expected characteristics, the method may comprise generating an alert at that point. Generating an alert may comprise generating and transmitting instructions to an alert generation module, the instructions configured to cause the alert generation module to generate the alert.
The method of the second aspect of the invention may take place at the beginning of a cleaning operation. Specifically, at the start of a cleaning operation, when the robotic vacuum cleaner is located in the charging position in which it is engaged with the robotic vacuum cleaner charging station (or shortly after), the method may comprise determining either whether a fiducial mark is present in one or more images obtained by the one or more cameras, or whether the obtained image of a fiducial mark has the expected characteristics (as explained previously, with reference to location, shape, size etc.). If the result of the determination is a negative one, i.e. if it is determined either that a fiducial mark is not present in one or more images obtained by the one or more cameras, or that the obtained image of a fiducial mark does not have the expected characteristics, the method may then comprise generating an alert as outlined previously. In some cases, the robotic vacuum cleaner will then not carry out the cleaning operation. Alternatively, the robotic vacuum cleaner may still carry out the cleaning operation.
The invention includes the combination of the aspects and preferred features described except where such a combination is clearly impermissible or expressly avoided.
Embodiments of the present invention will now be described with reference to the accompanying drawings, in which:
Aspects and embodiments of the present invention will now be discussed with reference to the accompanying figures. Further aspects and embodiments will be apparent to those skilled in the art. All documents mentioned in this text are incorporated herein by reference.
The dock 102 comprises the base 106 and engagement portion 108. In the example shown, the base 106 is planar. In the example shown in
At each end of the front surface 124 is an electrical contact 128a, 128b. These electrical contacts 128a, 128b are in the form of elongate projections, which are approximately rectangular, having rounded front corners. They are arranged to be received by corresponding recesses on the robotic vacuum cleaner (discussed in more detail with reference to
The backplate 104 is a substantially rectangular component with rounded corners 152a, 152b, 152c, 152d, having a front surface 153 and a rear surface (not visible). Near each of the top two corners 152a, 152b is a fiducial mark 154a, 154b, in the form of four squares arranged in a 2×2 formation to form a larger square, with the squares alternately coloured black and white for maximum contrast. Close to lateral edges 156a, 156b, and approximately halfway up the front surface 153 there are second connectors 158a, 158b, in the form of elongate projections. In order to assemble the robotic vacuum cleaner charging station 100, the second connectors 158a, 158b are inserted into first connectors 130a, 130b, thereby joining the backplate 104 to the dock 102. The backplate 104 also includes a hole 160. The hole 160 enables a light on the back of the dock 102 to be visible when the backplate 104 is connected.
We now discuss the engagement of the charging station 100 with robotic vacuum cleaner 200.
To illustrate the advantages of the present invention,
Having discussed the structural aspects of the robotic vacuum cleaner system including the robotic vacuum cleaner 200 and the robotic vacuum cleaner charging station 100, we now discuss the functional aspects.
The robotic vacuum cleaner 200 comprises a camera 2001, a client device interface module 2002, a processor 2004, and a memory 2006. The processor 2004 may comprise several functional modules including: a fiducial detection module 2008, a diagnostics module 2008, an alert generation module 2010, an engagement detection module 2014, a charging detection module 2016, a location determination module 2018, and a navigation module 2020. The operation of each of these modules is discussed later in this application. The memory 2006 of the robotic vacuum cleaner 200 may store data representing: a floor map 2022, a threshold deviation 2024, and expected characteristics 2026.
The client device 300 may comprise: a robotic vacuum cleaner interface module 3002, a processor 3004, and a display component 3006.
We now discuss the operation of the components shown in
The features disclosed in the foregoing description, or in the following claims, or in the accompanying drawings, expressed in their specific forms or in terms of a means for performing the disclosed function, or a method or process for obtaining the disclosed results, as appropriate, may, separately, or in any combination of such features, be utilised for realising the invention in diverse forms thereof.
While the invention has been described in conjunction with the exemplary embodiments described above, many equivalent modifications and variations will be apparent to those skilled in the art when given this disclosure. Accordingly, the exemplary embodiments of the invention set forth above are considered to be illustrative and not limiting. Various changes to the described embodiments may be made without departing from the spirit and scope of the invention.
For the avoidance of any doubt, any theoretical explanations provided herein are provided for the purposes of improving the understanding of a reader. The inventors do not wish to be bound by any of these theoretical explanations.
Any section headings used herein are for organizational purposes only and are not to be construed as limiting the subject matter described.
Throughout this specification, including the claims which follow, unless the context requires otherwise, the word “comprise” and “include”, and variations such as “comprises”, “comprising”, and “including” will be understood to imply the inclusion of a stated integer or step or group of integers or steps but not the exclusion of any other integer or step or group of integers or steps.
It must be noted that, as used in the specification and the appended claims, the singular forms “a,” “an,” and “the” include plural referents unless the context clearly dictates otherwise. Ranges may be expressed herein as from “about” one particular value, and/or to “about” another particular value. When such a range is expressed, another embodiment includes from the one particular value and/or to the other particular value. Similarly, when values are expressed as approximations, by the use of the antecedent “about,” it will be understood that the particular value forms another embodiment. The term “about” in relation to a numerical value is optional and means for example +/−10%.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2203730.3 | Mar 2022 | GB | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/GB2023/050480 | 3/2/2023 | WO |