Patent Application
20250040986
The present invention relates to an apparatus configured to control a treatment device configured to perform a treatment operation on a body part of a subject. The present invention relates further to a computer-implemented method of controlling such a treatment device, and to a system comprising such an apparatus and such a treatment device.
Techniques for removal of unwanted hairs include shaving, electrolysis, plucking, laser and light therapies (known as photoepilation) and injection of therapeutic anti-androgens. Light-based technologies are also used in other types of dermatological treatments, including hair growth reduction and treating acne.
Through the use of an appropriate configuration of the light energy, i.e. in terms of wavelength, intensity and/or pulse duration (if the light is to be pulsed), selective heating of the hair root and subsequent temporary or permanent damage to the hair follicle can be achieved. Home-use photoepilation devices, for example the Philips Lumea device, use intense pulsed light (IPL) from high intensity light sources, e.g. Xenon flash lamps that produce high output bursts of broad spectrum light.
A photoepilation treatment is characterized by the user of the photoepilation device treating relatively small areas of the skin for the purpose of hair removal. The photoepilation treatment uses intense light to heat melanin in hair and hair roots, which puts the hair follicles into a resting phase, preventing hair re-growth. For effective use of this technology for hair removal, the user must treat the skin completely without leaving any gaps. Since this effect is only of limited duration, treatment has to be repeated on a regular basis: typically once every 4 to 8 weeks in the maintenance phase after an initial period of about two months in which treatment is performed once every two weeks.
Photo-epilation is currently done by the user by careful ‘step and flash’ mode or automated ‘slide and flash’ mode. ‘Step and flash’ mode for the treatment on the skin requires focus for a careful placement of the device for the next treatment spot to avoid missed spots. The user is not given any feedback for the placement of the device after the previous treated area. Concentration and quite precise manual coordination are required in the placement of the device for the next spot. This can be a rather slow process which leads to low efficacy and/or discomfort as the user perceives pain sensation as he anticipates the arrival of the pulse. Furthermore, the user also feels discomfort to step and flash as he/she needs to focus on the treatment. On the other hand, ‘slide and flash’ mode has the advantage of automatically flashing at a fixed time (2-3.5s), however there is burden to the user to move the device in a controlled manner such that it is not too slow as to overtreat areas, and not too fast as to miss spots, and this speed should be maintained during the entire treatment.
WO 2021/130052 A1 discloses an apparatus for use with a treatment device for providing feedback to a user on a treatment operation performed on a body part of a subject. The treatment device is configured to apply light pulses to skin of the body part to perform the treatment operation, wherein a light pulse applied to the skin treats an area of the skin. The apparatus comprises a processing unit configured to receive a first measurement signal from a first sensor, the first measurement signal comprising information about positions and/or movements of the treatment device over time. For a light pulse previously applied by the treatment device to the body part during the treatment operation, the first measurement signal is processed to estimate a previous treatment position as a position of the treatment device relative to the body part when the light pulse was generated. For the previously applied light pulse and based on the estimated previous treatment position, a previous treatment area is estimated for the light pulse corresponding to the area of skin of the body part that the light pulse was applied to when the treatment device was at the previous treatment position. The first measurement signal is processed to estimate a current position of the treatment device relative to the body part. Based on the estimated current position of the treatment device, a current treatment area corresponding to an area of skin that the treatment device would apply a light pulse to while in the current position is estimated. A feedback control signal for a feedback unit is generated, wherein the feedback control signal is configured to cause the feedback unit to generate feedback indicating whether the current treatment area corresponds, or substantially corresponds, to a previous treatment area.
It is an object of the present invention to overcome the disadvantages of the different modes of operation of a treatment device, in particular to adapt the operation of the treatment device to various speeds of movement of the treatment device over the skin, while obtaining optimal treatment coverage (i.e. avoid overtreatment and avoid missed areas).
In a first aspect of the present invention an apparatus configured to control a treatment device is presented. The treatment device is configured to perform a treatment operation on a body part of a subject, wherein the treatment device is configured to apply light pulses to skin of the body part to perform the treatment operation, wherein a light pulse applied to the skin treats a treatment area of the skin, the treatment area having a known or estimated width in a movement direction of the treatment device. The apparatus comprises a processing unit configured to:
In a second aspect of the present invention another apparatus configured to control a treatment device is presented. The treatment device is configured to perform a treatment operation on a body part of a subject, wherein the treatment device is configured to apply light pulses to skin of the body part to perform the treatment operation, wherein a light pulse applied to the skin treats a treatment area of the skin, the treatment area having a known or estimated width in a movement direction of the treatment device. The apparatus comprises a processing unit configured to:
In a further aspect of the present invention a system is presented comprising:
In yet further aspects of the present invention, there are provided corresponding methods, a computer program which comprises program code means for causing a computer to perform the steps of the methods disclosed herein when said computer program is carried out on a computer, as well as a non-transitory computer-readable recording medium that stores therein a computer program product, which, when executed by a processor, causes the methods disclosed herein to be performed.
Preferred embodiments of the invention are defined in the dependent claims. It shall be understood that the claimed methods, system, computer program and medium have similar and/or identical preferred embodiments as the claimed apparatus, in particular as defined in the dependent claims and as disclosed herein.
Applying the right speed when using the device in step and flash mode is difficult. When moving too slow, the treatment takes longer and there is a risk of overlapping. When moving too fast, there is a risk of missing parts of the skin that will not be treated. Furthermore, step and flash mode may take too long time and cause discomfort to the user as the user needs to focus on placing the device right next to the treated area. To counter such problems the present invention enables the treatment device to be moved (i.e. to glide) like in a shaving motion, with variable speed (i.e., there is no need of a constant speed or a constant movement distance in a step and flash mode), and treat the skin without missing spots and without overtreated spots. This helps the user to make the treatment more easy and comfortable. Furthermore, the user needs to focus only on moving the treatment device and does not need to care about the next pulse emission (also called flash herein) for skin treatment. A gliding motion is easier to do for the user but it may also reduce the perceived pain sensation since there is less concentration on the flash. Overall, the present invention enables an optimal treatment and gives the user the flexibility to use the treatment device at any desired speed.
According to the present invention the treatment area can be tracked and the flashing can be automated to avoid missed spots and overtreatment in a treatment strip (comprising multiple treatments areas). Further, the overall power consumption of the device can be improved by flashing only when required (i.e., by flashing in a deterministic manner). Thus, large areas (like legs, back, chest) can be treated in an efficient way by treating one or more treatment strips in a way that avoids any missed spots and, as optionally provided in an embodiment, placing these strips next to each other.
According to the first aspect of the present invention, this is achieved by controlling the flashing such that the size of gaps between treated treatment areas, i.e., the distance of a current treatment area from a previous treatment area in the movement direction of the treatment device, is either zero (without overlap between two adjacent treatment areas) or an integer multiple of the width of the treatment area. In other words, it is controlled, during movement of the treatment of the treatment device over the skin, when to flash and when not to flash. Thus, untreated treatment areas that have not been flashed in a first stroke (i.e. a first directional movement of the treatment device over a certain portion of skin covering a number of treatment areas) are then flashed in a second (and, optionally, even further) stroke(s) over the same portion of skin, preferably in alternating opposite direction(s). The width of the treatment area is (at least roughly) known or estimated due to the fixed size of the aperture for the emitted light in the treatment device. Even if the speed of movement changes during a stroke or from one stroke to another stroke, it can thus be ensured that the desired portion of skin is substantially homogenously treated without having (substantial or any) overlaps and without having (substantial or any) gaps between neighboring treatment areas.
According to the second aspect of the present invention, the desired effect is achieved by setting the integer multiple of the width of the treatment area in advance based on a pre-set speed (e.g. low, medium, high) of the treatment device and to control the flashing based on the distance that the treatment device has moved during treatment, such that flashing occurs when the determined distance corresponds to the set integer multiple of the width of the treatment area. Like according to the first aspect, it is controlled when to flash and when not to flash so that the desired arrangement of the treated and untreated treatment areas, as described above, is resulting. A certain portion of the skin can thus be treated without overtreatment or no treatment at all of any spots.
According to an embodiment the processing unit is configured to determine the integer multiple based on an initial movement speed of the treatment device, in particular a measured or pre-set movement speed of the treatment device and the known or estimated width of the treatment area. The initial movement speed may e.g. be selected by a user from a menu of available speeds (such as low, medium, high), in which the user intends to move the treatment device over the skin. The speed can be used to make an initial determination of the integer multiple of the width of the treatment area and thus to determine initially, at which positions (provided the treatment device is moved according to the initial movement speed) pulses shall be emitted for treatment.
Further, the processing unit may be configured to determine a number of strokes needed to treat a first portion of skin. For instance, if a high movement speed is used, the gaps between treated treatment areas in a first stroke may be larger since there may be sufficient time needed for powering in between two subsequently emitted pulses. Photoepilation devices also feature different treatment head attachments of various aperture sizes. This together with the total area of a specific treatment region. e.g. upper lip, legs, armpit, may be used as well to determine the number of strokes and/or the size and/or number of gaps between treated treatment areas in a first stroke. Thus, depending of the speed of movement it may be computed in advance, how many strokes may be needed to completely cover a certain portion of skin.
In another embodiment the processing unit is further configured to adjust the integer multiple and/or the number of strokes upon determining that a current movement speed of the treatment device is different from the initial movement speed. Thus, preferably the movement speed and/or the distance moved during a certain time period is measured and used to re-calculate the initially determined integer multiple and/or number of strokes to ensure that the desired portion of skin is covered in the best way and/or in the minimum time.
The processing unit may further be configured to determine if the current treatment area overlaps with the previous treatment area, in particular by determining if a light pulse has been previously applied to the current treatment area, and generate the pulse control signal if the distance has been determined to be zero or an integer multiple of the width of the treatment area and if the current treatment area has been determined not to overlap with the previous treatment area. This additional check ensures avoiding overtreatment of skin areas.
The processing unit may further be configured to determine if the treatment device is ready to apply a light pulse, in particular if a light source of the treatment device has sufficient energy to apply a light pulse, and generate the pulse control signal if the distance has been determined to be zero or an integer multiple of the width of the treatment area and if the treatment device has been determined to be ready to apply a light pulse. This additional check contributes to minimizing the time needed for treatment of a certain portion of skin.
In another embodiment the processing unit is configured to generate a guidance signal for a feedback unit, wherein the guidance signal is configured to cause the feedback unit to generate guidance indicating into which direction and/or at which treatment area the treatment device shall be moved. This helps the user to correctly and fully cover a desired portion of skin.
The processing unit may hereby be configured to:
The guidance signal may e.g. be configured to cause the feedback unit to generate guidance indicating that the treatment device shall be moved in the second stroke over a second portion of the skin that is parallel and adjacent to the first portion of the skin if there are no untreated treatment areas between treated treatment areas in the first portion of the skin. A larger portion of skin may thus be treated in smaller portions that are arranged adjacent to each other and that are treated in a way like a lawn is mowed, wherein each portion may be treated by one or more strokes.
The processing unit may further be configured to compute a map indicating treated treatment areas to which a light pulse has been previously applied and untreated treatment areas to which a light pulse has not been previously applied and generate the guidance signal for the feedback unit based on the computed map. Optionally, the map may be visualized to the user so that the user can see which areas still have to be treated.
A possible way to determine the position of a treatment area is provided in an embodiment according to which the processing unit is configured to:
The processing unit may further be configured to determine movement direction and/or speed and/or orientation of the treatment device, and generate the guidance signal for the feedback unit, wherein the guidance signal is configured to cause the feedback unit to generate guidance indicating into which direction and/or at which treatment area the treatment device shall be moved and/or if and how the speed of movement of the treatment device shall be changed. This supports the user in the correct movement of the treatment device.
The processing unit may optionally be configured to generate the guidance signal for controlling the feedback unit to generate visible and/or audible guidance, in particular guidance in the form of audible instructions and/or in the form of a graphical representation of instructions and/or the computed map and/or previous treatment areas and the current treatment area and/or a pattern or line. For instance, a visual guidance (lines, arrows, text, etc.) may be displayed on the skin. In an example a line may be displayed along which the treatment device shall be moved.
The guidance signal may e.g. be a display control signal. For the feedback unit different implementations are possible. For instance, the feedback unit may be a display screen and the display control signal includes a plurality of images or a video sequence of the body part on which the graphical representation is overlaid, or the feedback unit may be a projector and the display control signal is configured to cause the projector to project the graphical representation onto the body part of the subject, or the feedback unit may be configured to display the graphical representation as part of an augmented reality display of the body part.
In the apparatus of the second aspect, the processing unit may be configured to set a number of strokes needed for treating a first portion of skin based on the set integer multiple of the width of the treatment area. Thus, it may be computed in advance, how many strokes may be needed. The user may be informed in advance or during treatment of this number.
Further, in the apparatus of the second aspect, the processing unit may be configured to re-calculate the integer multiple of the width of the treatment area and/or the number of strokes if the speed of movement of the treatment device changes or is different from the pre-set speed. Thus, even if the user changes the speed of movement during treatment, the aims of avoiding overtreatment and of avoiding missed spots can be achieved.
These and other aspects of the invention will be apparent from and elucidated with reference to the embodiment(s) described hereinafter. In the following drawings
As described herein, the treatment device 2 is operated or used by a ‘user’, and the treatment device 2 is used on a body of a ‘subject’. In some cases the user and the subject is the same person. i.e. the treatment device 2 is held in a hand and used by a user on themselves (e.g. used on the skin on their leg). In other cases the user and the subject are different people. e.g. the treatment device 2 is held in a hand and used by a user on someone else. In either case, it is difficult for a user to achieve complete coverage of a body part and/or avoid over-treating certain areas of the body part since there are little or no user-perceptible changes to the skin on applying or shortly after applying a light pulse.
The exemplary treatment device 2 comprises a housing 4 that includes at least a handle portion 5 and a head portion 6. The handle portion 5 is shaped to enable the user to hold the treatment device 2 with one hand. The head portion 6 is at a head end 8 of the housing 4, and the head portion 6 is to be placed into contact with the subject in order for the treatment operation to be performed on the body or skin of the subject at the position that the head portion 6 is in contact with the body or skin.
The treatment device 2 is for performing a treatment operation using light pulses. Thus, in
In the exemplary embodiment shown in
Although not shown in
The one or more light sources 12 can generate light pulses of any suitable or desired wavelength (or range of wavelengths) and/or intensities. For example, the light source 12 can generate visible light, infra-red (IR) light and/or ultraviolet (UV) light. Each light source 12 can comprise any suitable type of light source, such as one or more light emitting diodes (LEDs), a (Xenon) flash lamp, a laser or lasers, etc. The light source(s) 12 can provide light pulses with spectral content in the 560-1200 nm range for a duration of around 2.5 ms, as these wavelengths heat melanin in the hair and hair root by absorption, which puts the hair follicles in a resting phase, preventing hair regrowth.
The one or more light sources 12 are configured to provide pulses of light. That is, the light source(s) 12 are configured to generate light at a high intensity for a short duration (e.g. less than 1 second). The intensity of the light pulse should be high enough to effect the treatment operation on the skin or body part adjacent the aperture 10.
The illustrated treatment device 2 may optionally include two skin contact sensors 14, 16 positioned on or in the head portion 6 that are used to determine whether the head portion 6 is in contact with the skin. The skin contact sensors 14, 16 measure a parameter that is indicative of whether the head portion 6 is in contact with skin, and generate respective measurement signals that comprise a time-series of measurements of the parameter. The measurement signals can be processed to determine if the head portion 6 is in contact with skin. Typically a skin contact sensor is used in a treatment device 2, particularly a photoepilator, to make sure that the treatment device 2 is correctly in contact with skin before a light pulse is generated to avoid the light pulse being directed into the eyes of the user or subject.
In some embodiments the parameter can be capacitance, and so the skin contact sensors 14, 16 can measure capacitance via a respective pair of electrical contacts or electrodes on the surface of the head portion 6, with the measured capacitance being indicative of whether there is skin contact. In alternative embodiments, the parameter can be an intensity or level of light, and so the skin contact sensors 14, 16 can be light sensors that measure an intensity or level of light incident on the light sensor, with the measured intensity or level being indicative of whether there is skin contact (e.g. less/no light could indicate skin contact as the skin obscures the light sensors 14, 16, and vice versa). In other alternative embodiments, the parameter can be a measure of contact pressure, and so the skin contact sensors 14, 16 can measure contact pressure via respective pressure sensors or mechanical switches, with the measured contact pressure being indicative of whether there is skin contact.
The illustrated treatment device 2 may include an optional skin tone sensor 18 positioned on or in the head portion 6 that can be used to determine a skin tone of the skin that the head portion 6 is in contact with. The skin tone sensor 18 can measure a parameter that is indicative of the skin tone of the skin, and generate a measurement signal that comprises a time-series of measurements of the parameter. The measurement signal can be processed to determine the skin tone of the skin that the head portion 6 is in contact with. Typically a skin tone sensor is used in a treatment device 2, particularly a photoepilator. to make sure that the light pulse has an intensity that is appropriate for the type of skin being treated, or even to prevent a light pulse being generated if the skin type is unsuitable for light pulses (e.g. darker skin which has a much higher melanin content).
In some embodiments the optional skin tone sensor 18 can be a light sensor and the parameter measured by the light sensor can be an intensity or level of light at a particular wavelength or multiple wavelengths reflected from the skin. The measured intensity or level of reflected light at a particular wavelength(s) can be indicative of the skin tone. The measured intensity or level of reflected light can be based on the concentration of melanin in the skin, and thus the measured intensity or level can indicate the melanin concentration. The melanin concentration can be derived, for example, from measurements of light reflection at 660 nm (red) and 880 nm (infrared) wavelengths.
The illustrated treatment device 2 also includes a user control 20 that can be operated by the user to activate the treatment device 2 so that the head portion 6 performs the required treatment operation on the body of the subject (e.g. the generation of one or more light pulses by the one or more light source(s) 12). The user control 20 may be in the form of a switch, a button, a touch pad, etc.
As noted above, one or more sensors may be used to provide information on positions (including orientations) and/or movements of the treatment device over time so that suitable feedback can be determined, and in some embodiments the one or more sensors can be part of or be in the treatment device 2. In the case of the sensor(s) being one or more movement sensors, such as an accelerometer, gyroscope, etc., the one or more movement sensors can be part of e.g. inside, the treatment device 2 (and as such are not shown in
A system according to the present invention generally comprises a treatment device. e.g. as shown in
As noted above, the one or more sensors 44 can be one or more movement sensors 44, such as an accelerometer, a gyroscope, an air pressure sensor (that can be used for measuring altitude changes, a magnetometer, etc., that measure the movements of the treatment device 2 and output a measurement signal representing those movements. The one or more movement sensors 44 may be part of or in the treatment device 2. In the case of the one or more movement sensors 44 comprising an accelerometer, the accelerometer 44 can generate a measurement signal that contains a plurality of acceleration measurement samples representing the movements of the treatment device 2 at a plurality of time instants. The accelerometer 44 may be an accelerometer that measures accelerations in three dimensions, and the measurement signal generated by the accelerometer 44 can include respective measurement signals representing the accelerations in each of the three dimensions. For example, the accelerometer 44 can output respective measurement signals for each of an x-axis, y-axis and z-axis of a Cartesian coordinate system.
The one or more sensors 44 can also include or alternatively be an imaging unit 44 (e.g. a camera or an event camera) that obtains a plurality of images or a video sequence. An event camera is an imaging sensor in which each pixel of the sensor independently indicates changes in brightness as they occur. The plurality of images (including images formed from brightness indications from an event camera) or video sequence are output as a measurement signal, and the measurement signal (images/video sequence) can be processed using imaging processing techniques to identify movements of the treatment device 2. In some embodiments, the imaging unit 44 is attached to or part of the treatment device 2, in which case the images/video sequence can be processed to extract the movements of the treatment device 2 based on movements of objects (e.g. body parts or skin) visible in the images/video sequence. In other embodiments the imaging unit 44 can be separate from the treatment device 2. e.g. an imaging unit 4 in the apparatus 44, or in a separate device such as a smart phone, smart watch, tablet, personal digital assistant (PDA), laptop, desktop computer, smart mirror, etc. In this case, the imaging unit 44 may be able to observe both the treatment device 2 and the body part from a distance. An imaging unit 44 may include any suitable components for capturing an image, for example a charge-coupled device (CCD) and one or more lenses and/or mirrors. In some embodiments, the imaging unit 44 is a camera, such as a digital camera (e.g. thermal. RGB or monochrome camera), or an event camera. As noted above, in some embodiments, the one or more sensors 44 can comprise one or more movement sensors and an imaging unit.
The apparatus 42 comprises a processing unit 46 that generally controls the operation of the apparatus 42 and enables the apparatus 42 to perform the method and techniques described herein. The processing unit 44 may further be configured to receive a measurement signal from a sensor 44, process the measurement signal to determine the feedback to be provided about the treatment operation, and provide a feedback control signal to the feedback unit 45. Thus the processing unit 46 can be configured to receive the measurement signal from the one or more sensors 44 either directly in embodiments where the sensor(s) 44 are part of the apparatus 42, or via another component in embodiments where the sensor(s) 44 are separate from the apparatus 42. In either case, the processing unit 46 can include or comprise one or more input ports or wires for receiving the measurement signal. The processing unit 46 can also include or comprise one or more output ports or wires for outputting the feedback control signal.
The processing unit 46 can be implemented in numerous ways, with software and/or hardware, to perform the various functions described herein. The processing unit 46 may comprise one or more microprocessors or digital signal processors (DSPs) that may be programmed using software or computer program code to perform the required functions and/or to control components of the processing unit 46 to effect the required functions. The processing unit 46 may be implemented as a combination of dedicated hardware to perform some functions (e.g. amplifiers, pre-amplifiers, analog-to-digital convertors (ADCs) and/or digital-to-analog convertors (DACs)) and a processor (e.g., one or more programmed microprocessors, controllers, DSPs and associated circuitry) to perform other functions. Examples of components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, DSPs, application specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), hardware for implementing a neural network and/or so-called artificial intelligence (AI) hardware accelerators (i.e. a processor(s) or other hardware specifically designed for AI applications that can be used alongside a main processor) and/or hardware specifically designed for simultaneous localisation and mapping (SLAM) techniques.
The processing unit 46 may optionally comprise or be associated with a memory unit 48. The memory unit 48 can store data, information and/or signals (including image(s)) for use by the processing unit 46 in controlling the operation of the apparatus 42 and/or in executing or performing the methods described herein. In some implementations the memory unit 48 stores computer-readable code that can be executed by the processing unit 46 so that the processing unit 46 performs one or more functions, including the methods described herein. In particular embodiments, the program code can be in the form of an application for a smart phone, tablet, laptop, computer or server. The memory unit 48 can comprise any type of non-transitory machine-readable medium, such as cache or system memory including volatile and non-volatile computer memory such as random access memory (RAM), static RAM (SRAM), dynamic RAM (DRAM), read-only memory (ROM), programmable ROM (PROM). erasable PROM (EPROM) and electrically erasable PROM (EEPROM), and the memory unit can be implemented in the form of a memory chip, an optical disk (such as a compact disc (CD), a digital versatile disc (DVD) or a Blu-Ray disc), a hard disk, a tape storage solution, or a solid state device, including a memory stick, a solid state drive (SSD), a memory card, etc.
In the embodiment shown in
Although not shown in
The processing unit 46 may be configured to generate a guidance signal for the feedback unit 45, wherein the guidance signal is configured to cause the feedback unit to generate guidance indicating into which direction and/or at which treatment area the treatment device shall be moved. The feedback unit 45 may further generate feedback whether the current treatment area corresponds, or substantially corresponds, to a previous treatment area. The feedback may generally be any of, or any combination of, visual, audible and tactile. Thus the feedback unit 45 may comprise any one or more output component(s), including but not limited to a display unit (such as a display screen, a display screen/transparent panel used for providing an augmented reality (AR) display or a projector, such as a pico-projector or micro-electromechanical system (MEMS) pico-projector), one or more lights or light elements, one or more loudspeakers, and one or more vibrating elements. In a preferred embodiment, the feedback unit 45 is a display unit and the feedback is a graphical display comprising graphical representations of instructions and/or a computed map of treatment areas and/or previous treatment areas and the current treatment area and/or a pattern or line. For instance, a visual guidance (lines, arrows, text, etc.) may be displayed on the skin, or areas of skin that have previously been treated with a light pulse and an area that would be treated with a light pulse according to the current location of the treatment device 2 may be displayed.
In some embodiments, the feedback unit 45 is attached to or part of the treatment device 2. In other embodiments, the feedback unit 45 is part of the apparatus 42. In these embodiments the feedback unit 45 may be part of, or make use of, any of the output components of user interface components of the apparatus 42. In further embodiments, the feedback unit 45 can be separate from the treatment device 2 and the apparatus 42, for example in a separate device such as a smart phone, smart watch, tablet, personal digital assistant (PDA), laptop, desktop computer, smart mirror, etc.
It will be appreciated that a practical implementation of an apparatus 42 may include additional components to those shown in
In a typical light-based treatment the user of the treatment device 2 needs to manually position the treatment device 2 on the skin. A light pulse is either triggered manually or automatically. However, there are little or no user-perceptible changes to the skin or hairs on applying a light pulse or shortly after applying a light pulse, so it is difficult for a user to achieve complete coverage of a body part and/or avoid over-treating certain areas of the body part by repeating a light pulse on an area of skin that has already been treated.
To illustrate a typical treatment coverage.
Thus, as illustrated in
In a first step 101 a position of a current treatment area 62b is estimated. The current treatment area 62b corresponds to an area of skin that the treatment device would apply a light pulse to while at the current treatment position. In a second step 103 the distance D, in movement direction M of the treatment device, of the current treatment area 62b from a previous treatment area 62a is determined. The previous treatment area corresponds to an area of skin that the treatment device applied a previous light pulse to while at a previous treatment position. In a third step 105 it is determined if the distance D is zero or an integer multiple of the width W of the treatment area in movement direction M (also called stroke direction) of the treatment device. In a fourth step 107 a pulse control signal is generated for controlling the treatment device to generate and apply a light pulse to the current treatment area 62b of the skin if the distance D has been determined to be zero or an integer multiple of the width W of the treatment area.
Thus, as illustrated in
The method 100 illustrated in
The size of a treatment area will depend on the size of the aperture 10 in the treatment device 2. In some embodiments the size of the aperture 10 is fixed or predetermined, and the processing unit 46 can make use of information on the size of the aperture 10 (e.g. the dimensions of the aperture 10), and optionally other information that may affect the size of the area of skin that the light pulse is applied to, such as relative positions of the aperture 10 and light source(s) 12, to determine the size of the treatment area. Alternatively, the processing unit 46 can determine the size of the aperture 10 by analyzing an image of the aperture 10 (e.g. if, before use, an image of the aperture 10 is obtained using an imaging unit).
As noted above, in some embodiments the treatment device 2 may have a plurality of different attachments that can be used for treating different parts of the body. These attachments may have different sized apertures 10 to change the size of the area of skin treated with each light pulse. In this case, when determining the size of the previous treatment area, the processing unit 46 can make use of information on the size of the aperture 10 (e.g. the dimensions of the aperture 10), and optionally other information such as relative positions of the aperture 10 and light source(s) 12), that was used when that light pulse was applied.
In some embodiments, the attachment that is in use on the treatment device 2 can be detected by the apparatus 42, for example by processing one or more images or a video sequence of the treatment device 2 to identify the attachment on the treatment device 2. In one example, before use of the treatment device 2, an image of the aperture 10 is obtained an imaging unit that is separate from the treatment device 2, and the processing unit 46 can determine the size of the aperture 10 by analyzing the image of the aperture 10. The size of the aperture 10 can be determined by extracting the dimensions of the window/aperture 10 using processing techniques such as edge detections and (rectangle) shape fitting.
Alternatively, the apparatus 42 can receive a signal indicating the attachment that is attached to the treatment device 2. The treatment device 2 can provide the signal in response to detecting the type of attachment that is attached to the treatment device 2. The treatment device 2 can detect the type of attachment in a number of different ways. e.g. automatically based on signals exchanged between the body of the treatment device 2 and the attachment, or based on a user setting input to the treatment device 2 indicating the type of attachment attached or the type of body part to be treated. As another option, different attachments may have apertures 10 with different colors, and the apparatus 42 can identify the attachment that is in use by observing the color of the light pulse when it is applied to the body part. Once the attachment is identified or otherwise known, information on the size of the aperture 10 associated with the identified attachment is obtained. e.g. from memory unit 48, and used to determine the size of the treatment area.
In step 201, a first measurement signal is received from sensor 44. The first measurement signal comprises information about positions and/or movements of the treatment device 2 over time. As noted above, the first measurement signal may be a signal from a movement sensor 44, or the first measurement signal may be a signal representing a plurality of images or a video sequence. In some embodiments, step 201 may comprise receiving a first measurement signal from a first sensor 44. e.g. a movement sensor 44, and a measurement signal from another sensor 44. e.g. an imaging unit.
In step 201 the first measurement signal can be received directly from the sensor 44, for example in real-time or near real-time as the measurement signal is generated by the sensor 44. Alternatively, the first measurement signal may have been previously generated by the sensor 44 and stored for subsequent analysis, for example in the memory unit 48, in a memory unit associated with the treatment device 2 or sensor 44, or in a remote database, in which case step 201 can comprise the processing unit 46 obtaining or retrieving the first measurement signal from the storage location (e.g. from memory unit 48, etc.). In these alternative embodiments, to provide the feedback to the user at a suitable time to enable the user to complete the treatment operation the first measurement signal should be obtained or retrieved shortly (e.g. no longer than a few seconds) after the first measurement signal is generated.
In step 203, for a light pulse previously applied by the treatment device 2 to the body part during the treatment operation, the processing unit 46 processes the first measurement signal to estimate the position of the treatment device 2 relative to the body part when this light pulse was generated or applied. This estimated position is referred to as a ‘previous treatment position’.
In embodiments where the sensor 44 is one or more movement sensors, such as an accelerometer, the first measurement signal is a movement measurement signal and step 203 comprises processing the movement measurement signal to identify the movements and positions of the treatment device 2 relative to the body part. Techniques for processing measurements from movement sensors to determine movements and positions of the device in which the movement sensor(s) 44 are housed are known in the art, and will not be described further herein.
In embodiments where the sensor 44 is an imaging unit and the first measurement signal is a plurality of images or a video sequence, step 203 comprises processing the images or video sequence to identify the movements and positions of the treatment device 2 relative to the body part. In embodiments where the imaging unit 44 is attached to the treatment device 2, the processing unit 46 can process the images or video sequence to identify skin features and/or body part features in the images or video sequence, and monitor the movement of those skin features and/or body part features in the images or video sequence. The determined movement of those skin features and/or body part features in the images or video sequence corresponds to the movements of the treatment device 2 relative to the body part. The imaging unit 44 is fixed in or on the treatment device 2, and the relationship between the aperture 20 and the field of view of the imaging unit 44 will be known, which enables the processing unit 46 to determine the previous treatment position. i.e. the position of the treatment device 2 relative to the body part when a light pulse was applied. Techniques for processing the images or video sequence to identify skin features and/or body part features are generally known in the art of imaging processing, although some further details are provided below.
In alternative embodiments where the imaging unit 44 is separate from the treatment device 2 and is able to observe both the treatment device 2 and the body part from a distance, in step 203 the processing unit 46 can process the images or video sequence to identify the treatment device 2 and skin features and/or body part features, and monitor their relative positions over time. Techniques for processing the images or video sequence to identify a treatment device 2 and skin features and/or body part features are generally known in the art of imaging processing, although some further details are provided below.
In embodiments where the one or more sensors 44 comprises one or more movement sensors and an imaging unit, step 203 can comprise processing a first measurement signal from one of the movement sensor(s) and the imaging unit along with a second measurement signal from the other one of the movement sensor(s) and the imaging unit to estimate the position of the treatment device 2 relative to the body part.
In some embodiments, for example in the above embodiments where the one or more sensors 44 comprises one or more movement sensors and an imaging unit, step 203 can comprise using Simultaneous Localisation And Mapping (SLAM) techniques to determine the position of the treatment device 2 relative to the body part.
In step 203, having processed the first measurement signal to estimate the movements and/or positions of the treatment device 2 relative to the body part over time, a previous treatment position is determined as the estimated position of the treatment device 2 relative to the body part at the time that the light pulse was generated or applied.
In step 205, for the light pulse evaluated in step 203 and based on the previous treatment position determined in step 203, the processing unit 46 estimates the area of skin of the body part that the light pulse was applied to. This estimated area is referred to as the ‘previous treatment area’ for the light pulse applied when the treatment device 2 was at the previous treatment position. The previous treatment position will generally have a known relationship with the position of the aperture 20 of the treatment device 2. This enables step 205 to determine the appropriate area of the skin on the body part that the light pulse was applied to. For example, if previous treatment positions are estimated as the geometric centre of the aperture 20, then the previous treatment area can be centred on the relevant previous treatment position. The orientation of the treatment device 2 when the light pulse was applied is used to determine the orientation of the previous treatment area on the skin. Referring to
Steps 203 and 205 may be performed for a plurality of (or all) previous light pulses in the treatment operation. In preferred embodiments, steps 203 and 205 are performed when, or shortly after, a light pulse is applied to the body part or even continuously during movement of the treatment device. As such, steps 203 and 205 may be performed in response to determining that a light pulse has been applied by the treatment device 2 to the body part. The processing unit 46 may determine that a light pulse has been applied to the body part in one (or more) of a number of different ways. In embodiments where the apparatus 42 is part of the treatment device 2, the processing unit 46 can receive a signal from the light source(s) 12, or from control circuitry for the light source(s) 12, indicating that a light pulse has been generated. Alternatively, where the apparatus 42 is separate from the treatment device 2, the processing unit 46 can receive a signal from the treatment device 2 indicating that a light pulse has been generated. As another alternative, where the sensor 44 is an imaging unit, or an imaging unit is otherwise provided in the system 40, the images or video sequence from the imaging unit can be processed to identify a light pulse.
For example.
In step 207 the processing unit 46 processes the first measurement signal to estimate a current position of the treatment device 2 relative to the body part. The processing in step 207 can be the same as used in step 203 by the processing unit 46 to estimate the position of the treatment device 2 relative to the body part when a light pulse was generated or applied.
In step 209, based on the current position of the treatment device 2 estimated in step 207, the processing unit 46 estimates the area of skin of the body part that a light pulse would be applied to in the current position of the treatment device 2. This estimated area is referred to as the ‘current treatment area’. The processing in step 209 can be the same as used in step 205 by the processing unit 46 to estimate the area of skin of the body part that a previous light pulse was applied to. As in step 205, in step 209 the size of the aperture 10 can be taken into account when estimating the size of the current treatment area.
As an optional step used in embodiments of the present invention, the processing unit 46 generates a feedback control signal for the feedback unit 45. The feedback control signal (or guidance signal) is generated so that it causes the feedback unit 45 to generate feedback (or guidance) indicating into which direction and/or at which treatment area the treatment device shall be moved, e.g. one or more of:
The method may further comprise providing the generated feedback control signal to the feedback unit 45 so that the feedback is provided to the user. As noted above, the feedback unit 45 may be configured to provide any combination of visual, audible and tactile feedback to indicate whether or not the treatment device 2 is at a position where a light pulse has previously been applied. The user of the treatment device 2 would be able to use these indications to determine whether to trigger a light pulse at the current position of the treatment device 2, which can help the user to improve the coverage of the treatment operation over the skin of the subject.
As an example, the feedback control signal could cause a red light (e.g. on the treatment device 2) to be illuminated if it is determined that at the current position no light pulse shall be emitted or cause a green light (e.g. on the treatment device 2) to be illuminated if it is determined that at the current position a light pulse shall be emitted. As another example, the red/green light can be replaced with (or accompanied by) haptic feedback (e.g. vibrations of the treatment device 2). As another example, the red/green light can be replaced with (or accompanied by) audible feedback (e.g. a noise, audible message, etc.).
In a preferred embodiment, the feedback unit 45 is a display unit, such as a display screen, a transparent panel used for providing an AR display or a projector. In these embodiments, the feedback signal is a display control signal, that causes the display unit to generate a graphical display comprising graphical representations overlaid on the body part.
In embodiments where the display unit is a transparent panel used for providing an AR display, the transparent panel can be positioned in the line of sight of the user, so that it is directly between the user and the body part being treated, enabling the user to view the body part through the transparent panel. In some embodiments the transparent panel is one or both lenses in a pair of glasses. The graphical representations of the previous treatment areas and the current treatment area can be projected or displayed on the transparent panel, so that they are overlaid on the correct positions of the body part from the point of view of the user. In this way the user is presented with an AR view of the body part that can enable them to more easily see the previously treated areas on the body part.
In embodiments where feedback is to be provided during use of the treatment device 2 (e.g. as the treatment device 2 is moved over the body part and light pulse(s) are applied), steps 201-209 can be performed generally continuously. That is, in step 201 a measurement signal can be received generally continuously (e.g. according to a sampling rate of the sensor 44, or according to a transmission rate (e.g. packet rate) from the sensor 44 to the apparatus 42), and steps 203-209 can be performed generally continuously to update the feedback to be provided to the user.
In embodiments using SLAM technology where the sensor 44 is an imaging unit that is attached to the treatment device 2 and the processing unit 46 processes the images or video sequence to identify skin features and/or body part features in the images or video sequence in steps 203 and 205, the processing unit 46 can use one or more of a number of different techniques to process the images or video sequence. In some embodiments, skin features can be detected using feature detection algorithms such as Shi-Tomasi corner detection methods and/or scale-invariant feature transform (SIFT) methods. Alternatively. AI-based feature detection techniques that are optimised for skin features can be used. To estimate the movement of the treatment device 2 over time, the position of the detected skin features in the images or video sequence can be tracked over time by matching skin features between sequential images or sequential video frames. The movement of the treatment device 2 relative to the body part can be determined by calculating the homography between two sets of features of two sequential images or video frames. A homography determines the relationship between two imaging unit positions and orientations when viewing the same planar surface. Thus, as mentioned, this operation may use SLAM technology: while treating/moving, the skin area is mapped and a history of flashed skin areas is kept.
Over time, there may be a drift in the computation of the position of the current treatment position due to the accumulation of errors in the measurements and/or processing techniques. To reduce or avoid this drift, the detecting and movement tracking of skin features can be extended beyond two images or video frames so that skin features are tracked over multiple images or video frames.
Depending on the body part shown in the image(s), image processing techniques suitable for tracking position of skin features on non-planar surfaces, such as SLAM, can be used for the homography computation.
In some embodiments, the treatment device 2 may be configured to automatically trigger a light pulse. In this case the apparatus 42 can be configured to automatically trigger the treatment device 2 to generate a light pulse. In some embodiments, one or more further conditions may be applied for triggering the light pulse, such as the treatment device 2 is in contact with skin, and/or the toane of the skin the treatment device 2 is in contact with is suitable to receive a light pulse. If a light pulse can be applied at the current position of the treatment device 2, the processing unit 46 can determine an actuation signal to actuate the light source(s) 12, or that causes the treatment device 2 to actuate the light source(s) 12.
In an embodiment of the disclosed apparatus and method a reference skin map of the treatment region may be generated prior to a treatment session. This may be done by capturing a series of image frames of a skin portion while gliding the treatment device with camera directed onto the treatment region, recording accelerometer and gyroscope data associated to each image frame, and generating a reference skin map of the treatment region.
In an embodiment of the disclosed apparatus and method the flashing may be controlled automatically during a single- or multi-stroke treatment in a skin treatment strip. This may be done by capturing an image of skin area adjacent to the treatment area, computing the position and orientation of the treatment device based on the captured skin area image and the IMU data, defining the location and orientation of the treatment area being treated in reference to the reference skin map of the treatment region, and enabling the flashing when the location is within a pre-defined location. The pre-defined locations may be computed based on optimizing the treatment in a skin treatment strip such that minimal overlap between treatment regions occur during single- or multi-stroke treatment.
In an embodiment of the disclosed apparatus and method user guidance may be provided to a user during sliding of the treatment device during treatment along the first and subsequent skin treatment strips. This may be done by capturing image of a skin area adjacent to the treatment area, computing the position and orientation of the treatment device based on the captured skin area image and the IMU data, defining the location and orientation of the treatment area being treated in reference to the reference skin map of the treatment region, and providing visual guidance, e.g. a laser projection on skin, to a user for guidance of the sliding direction such that minimal overlap between treatment strips occurs during a treatment session.
As mentioned already. SLAM (either video based or speckle based) technology may be used to locate the treated treatment areas and untreated treatment areas. The present invention ensures that only the untreated treatment areas are flashed as described above. The strip is filled with automatic pulses even when the guiding speed is not constant. In such a scenario the following steps may be executed.
The treatment starts somewhere at the edge of the treatment region to be treated. SLAM technology maps the area adjacent to the area to be treated (both forward and backward directions) and measures the distance. A gliding motion is started by the user (generally at any speed). SLAM technology provides knowledge if the current treatment area is an integer number of widths of a treatment area away from a previous treated treatment area. When the flash lamp capacitor is charged and the current treatment area is an integer number of treatment areas away from the previous treated treatment area, the a flash will occur. In the reverse direction some or all of the untreated treatment areas are ‘filled up’. This is repeated until the entire ‘strip’ is treated. Neither the back and forth speeds nor the speed of a single stroke do necessarily have to be the same.
To avoid treatment strip deviation between strokes, the user can be guided by a laser line during each stroke. To treat an adjacent strip without gaps between the strips (comparable to lawn mowing), the user may be guided as well.
For lateral repositioning for a second ‘strip’ a line (with laser, or flashing), or LEDs indicating right or left, demarcating the previous scan, may be used. This allows the user to repeat the previous scans, now laterally, adjacent to the previous scan. All the user has to do is follow the line; pulses are applied automatically.
In another embodiment, the speed guidance can be given by audio signal. Even though it is perfectly fine to treat subsequent strips at different speeds, it may be preferred by the user to do each strip in the same number of trips. A ‘speed’ guidance (using audio, or light) will warn if a user is about to depart from the preferred speed
In another embodiment, AI based feedback may be given. After, or even during, a treatment, tips are given about the coverage that may be reached if a slower or faster speed is used. Using AI, the patterns that were treated at which speed, indications may be given on how the user best treats at which speed. For example, many users may find it more comfortable to go at a higher speed in one direction than another. With AI, this preference could be ‘learned’ or noticed at least after which the sounds (or other indications) for speed guidance’ are matching this preference.
In summary, with the present invention overtreatment and undertreatment are substantially reduced or even avoided. Further, total treatment time may be considerably reduced. The treatment can proceed at a fast speed since it is only limited by the device (charging time); no time is lost at trying to place the device at the right spot. Due to the reduced impact on the skin, irritation could potentially be reduced. Additional benefits may be increased efficiencies, reduced power consumption, optimal treatment and flexibility to use the device at any desired speed.
While the invention has been illustrated and described in detail in the drawings and foregoing description, such illustration and description are to be considered illustrative or exemplary and not restrictive; the invention is not limited to the disclosed embodiments. Other variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the claimed invention, from a study of the drawings, the disclosure, and the appended claims.
In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single element or other unit may fulfill the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage.
A computer program may be stored/distributed on a suitable non-transitory medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems.
Any reference signs in the claims should not be construed as limiting the scope.
| Number | Date | Country | Kind |
|---|---|---|---|
| 21213384.7 | Dec 2021 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2022/083643 | 11/29/2022 | WO |
