Patent Application
20200375466
This disclosure relates to an apparatus for obtaining images for use in determining one or more properties of skin of a subject, and to a method and system for determining one or more properties of skin of a subject from images of a skin sample.
In the skincare field, it is useful to determine properties of the skin of a subject. These properties can be used to adapt or personalise the operation of a personal care device, such as a shaver or skin cleansing device to the skin type of the subject, or be used to adapt a skin care routine to the skin type of the subject.
Although the subject could manually input their properties to a personal care device or skin care routine or coaching application (app), e.g. based on their personal knowledge of their skin, it is desirable to obtain objective measurements of these skin properties, preferably in an unobtrusive, or largely unobtrusive, way. As such, techniques have been developed for determining properties of the skin of a subject in which images of the skin of a subject are obtained, and the images analysed to determine values of the properties. Some of these techniques require the skin to be illuminated using one or more light sources, but the optimum arrangement of the light sources required to measure a particular skin property can differ from the optimum arrangement of light sources required for measuring a different skin property.
Therefore, there is a need for improvements in systems, apparatuses and methods for determining properties of skin of a subject.
According to a first specific aspect, there is provided an apparatus for obtaining images for use in determining one or more properties of skin of a subject, the apparatus comprising an image sensor unit for generating an image of a skin sample, wherein the skin sample corresponds to an area of skin of the subject within a field of view, FOV, of the image sensor unit when the skin of the subject is spaced a predetermined working distance from the image sensor unit; a first light arrangement comprising one or more light sources for illuminating the skin of the subject; and a second light arrangement comprising one or more light sources for illuminating the skin of the subject. The one or more light sources in the first light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the first light arrangement that is specularly reflected by a skin sample at the predetermined working distance is incident on the image sensor unit; and the one or more light sources in the second light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the second light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit.
In some embodiments, the one or more light sources in the first light arrangement and the one or more light sources in the second light arrangement are arranged in a plane.
In some embodiments, the image sensor unit comprises an image sensor that is arranged in generally the same plane as the one or more light sources in the first light arrangement and the one or more light sources in the second light arrangement.
In some embodiments, the FOV of the image sensor unit is defined by one or more FOV angles, and wherein the one or more light sources in the first light arrangement are spaced from the image sensor unit in the direction of the plane by a distance that is equal to or less than 2*D*tan(θmin/2) where D is the predetermined working distance, and θmin is a smallest one of the one or more FOV angles.
In some embodiments, the FOV of the image sensor unit is defined by one or more FOV angles, and wherein the one or more light sources in the second light arrangement are spaced from the image sensor unit in the direction of the plane by a distance that is greater than 2*D*tan(θmax/2) where D is the predetermined working distance, and θmax is a largest one of the one or more FOV angles.
In some embodiments, each of the one or more light sources in the first light arrangement are spaced from the image sensor unit by a distance that is in the range of 3-7 millimetres.
In some embodiments, each of the one or more light sources in the second light arrangement are spaced from the image sensor unit by a distance that is in the range of 7-15 millimetres.
In some embodiments, the first light arrangement comprises a plurality of light sources. In some embodiments, the first light arrangement comprises at least three light sources arranged generally equidistant from the image sensor unit.
In some embodiments, the second light arrangement comprises a plurality of light sources. In some embodiments, the second light arrangement comprises at least three light sources arranged generally equidistant from the image sensor unit.
In some embodiments, the apparatus further comprises a first polarising filter arranged with respect to the image sensor unit such that the polarising filter polarises light incident on the image sensor unit. In these embodiments, the apparatus can further comprise a respective second polarising filter for each light source in the second light arrangement that is for polarising the light emitted by the light source in the second light arrangement, wherein a polarising direction of the second polarising filter is orthogonal to a polarising direction of the first polarising filter. In these embodiments, the apparatus can further comprise a third light arrangement comprising one or more light sources for illuminating the skin of the subject; wherein the one or more light sources in the third light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the third light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit. In these embodiments, the third light arrangement comprises a plurality of light sources. In these embodiments, the third light arrangement can comprise at least three light sources arranged generally in a ring around the image sensor unit. In these embodiments, each of the one or more light sources in the second light arrangement are spaced from the image sensor unit by a distance that is in the range of 7-11 millimetres, and each of the one or more light sources in the third light arrangement are spaced from the image sensor unit by a distance that is in the range of 11-15 millimetres.
According to a second aspect, there is provided a system for determining one or more properties of skin of a subject, the system comprising an apparatus according to the first aspect or any embodiment thereof; a control unit configured to receive images generated by the image sensor unit; and process the received images to determine one or more properties of the skin of the subject.
In some embodiments, the control unit is configured to process images generated by the image sensor unit when the one or more light sources in the first light arrangement are illuminating the skin of the subject to determine one or more first skin properties; and process images generated by the image sensor unit when the one or more light sources in the second light arrangement are illuminating the skin of the subject to determine one or more second skin properties.
In some embodiments, the control unit is further configured to selectively control the first light arrangement to illuminate the skin of the subject and to determine one or more first skin properties from a received image; and selectively control the second light arrangement to illuminate the skin of the subject and to determine one or more second skin properties from a received image.
In some embodiments, the one or more first skin properties are one or more of oiliness, gloss and skin texture.
In some embodiments, the one or more second skin properties are one or more of skin texture, colour, pigmentation, presence of spots and presence of hairs.
In some embodiments, the control unit is configured to process images generated by the image sensor when the one or more light sources in the third light arrangement are illuminating the skin of the subject to determine one or more third skin properties. In these embodiments, the one or more third skin properties includes skin texture.
In some embodiments, the control unit is further configured to output a signal representing the determined one or more properties of skin of the subject.
According to a third aspect, there is provided a method of determining one or more properties of skin of a subject, the method comprising illuminating the skin of the subject using a first light arrangement comprising one or more light sources; generating a first image of a skin sample using an image sensor unit when the first light arrangement is illuminating the skin of the subject, wherein the skin sample corresponds to an area of skin of the subject within a field of view, FOV, of the image sensor unit when the skin of the subject is spaced a predetermined working distance from the image sensor unit; illuminating the skin of the subject using a second light arrangement comprising one or more light sources; generating a second image of the skin sample using the image sensor unit when the second light arrangement is illuminating the skin of the subject; and processing the first image and second image using a control unit to determine one or more properties of the skin of the subject. The one or more light sources in the first light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the first light arrangement that is specularly reflected by a skin sample at the predetermined working distance is incident on the image sensor unit, and the one or more light sources in the second light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the second light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit.
In some embodiments, the method comprises processing the first image to determine one or more first skin properties; and processing the second image to determine one or more second skin properties.
In some embodiments, the one or more first skin properties are one or more of oiliness, gloss and skin texture. In some embodiments, the one or more second skin properties are one or more of skin texture, colour, pigmentation, presence of spots and presence of hairs.
In some embodiments, the method further comprises the steps of illuminating the skin of the subject using a third light arrangement comprising one or more light sources; generating a third image of the skin sample using the image sensor unit when the third light arrangement is illuminating the skin of the subject, and processing the third image to determine one or more third skin properties. The one or more light sources in the third light arrangement are spaced from the image sensor unit and arranged such that light emitted by the light sources in the third light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit. In these embodiments, the one or more third skin properties includes skin texture.
In some embodiments, the method further comprises the step of outputting a signal representing the determined one or more properties of skin of the subject.
According to a fourth aspect, there is provided a system for determining values of a plurality of properties of skin of a subject, the system comprising a control unit; and an apparatus for obtaining images for use in determining the values of the plurality of properties of skin of the subject. The apparatus comprises an image sensor unit for generating an image of a skin sample, wherein the skin sample corresponds to an area of skin of the subject within a field of view, FOV, of the image sensor unit when the skin of the subject is spaced a predetermined working distance from the image sensor unit; a first light arrangement comprising a plurality of light sources that are spatially distributed around an optical axis of the image sensor unit for illuminating the skin of the subject from a respective plurality of directions; a second light arrangement comprising one or more light sources for illuminating the skin of the subject. The plurality of light sources in the first light arrangement are spaced from the optical axis of the image sensor unit and arranged such that light emitted by the light sources in the first light arrangement that is specularly reflected by a skin sample at the predetermined working distance is incident on the image sensor unit; and the one or more light sources in the second light arrangement are spaced from the optical axis of the image sensor unit and arranged such that light emitted by the light sources in the second light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit. The control unit is configured to selectively control each of the light sources in the first light arrangement to individually illuminate the skin of the subject; receive a respective plurality of first images from the image sensor unit, each first image being obtained by the image sensor unit when a respective light source in the first light arrangement is illuminating the skin; process each first image to determine a respective initial value for a first skin property and combine the determined initial values to determine a value for the first skin property; selectively control the second light arrangement to illuminate the skin of the subject; receive one or more second images generated by the image sensor unit, each second image being obtained by the image sensor unit when the second light arrangement is illuminating the skin of the subject; and process the one or more received second images to determine a value for one or more second skin properties.
In some embodiments, the plurality of light sources in the first light arrangement and the one or more light sources in the second light arrangement are arranged in a plane.
In some embodiments, the plurality of light sources in the first light arrangement and the one or more light sources in the second light arrangement are spaced from the skin of the subject by less than the predetermined working distance.
In some embodiments, the first light arrangement comprises at least three light sources arranged generally equidistant from the optical axis of the image sensor unit.
In some embodiments, the second light arrangement comprises a plurality of light sources. For example the second light arrangement can comprise at least three light sources arranged generally equidistant from the optical axis of the image sensor unit. In these embodiments, the control unit can be configured to selectively control the plurality of light sources in the second light arrangement to illuminate the skin of the subject at the same time.
In some embodiments, the first skin property is one of oiliness, gloss and skin texture. In embodiments where the first skin property is oiliness, the control unit can be configured to process each first image to determine a respective initial value for oiliness based on one or more parameters including an amount of specular reflection from the skin sample, a distribution, granularity and/or intensity of specular reflection from the skin sample, a roughness or texture of the skin, principal component analysis of the image, a histogram shape encoding of texture maps and contrast in the image.
In some embodiments, the second skin property is one of skin texture, colour, redness, pigmentation, pores, presence of spots and presence of hairs.
In alternative embodiments, the apparatus further comprises a first polarising filter arranged with respect to the image sensor unit such that the polarising filter polarises light incident on the image sensor unit. In these embodiments the apparatus can further comprise a respective second polarising filter for each light source in the second light arrangement that is for polarising the light emitted by the light source in the second light arrangement, wherein a polarising direction of the second polarising filter is orthogonal to a polarising direction of the first polarising filter. In these embodiments the second skin property can be one of colour, redness, spots and pigmentation. In these embodiments the apparatus can further comprise: a third light arrangement comprising one or more light sources for illuminating the skin of the subject; wherein the one or more light sources in the third light arrangement are spaced from the optical axis of the image sensor unit and arranged such that light emitted by the light sources in the third light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit; wherein the control unit is further configured to: selectively control the third light arrangement to illuminate the skin of the subject; receive one or more third images generated by the image sensor unit, each third image being obtained by the image sensor unit when the third light arrangement is illuminating the skin of the subject; and process the one or more received third images to determine values for one or more third skin properties. In these embodiments the third light arrangement can comprise a plurality of light sources. In these embodiments the third light arrangement can comprise at least three light sources arranged generally equidistant from the optical axis of the image sensor unit. In these embodiments the control unit can be configured to selectively control the plurality of light sources in the third light arrangement to illuminate the skin of the subject at the same time. In these embodiments the third skin property can be one of pores and blackheads.
In some embodiments, the apparatus further comprises an impedance sensor for measuring an impedance of the skin of the subject; and the control unit is further configured to receive impedance measurements from the impedance sensor, and to process the received impedance measurements to determine a hydration level of the skin.
In some embodiments, the control unit is further configured to output a signal representing the determined value of the first skin property and/or the determined value of the second skin property.
In some embodiments, the control unit is comprised in the apparatus. In alternative embodiments, the control unit is separate from the apparatus.
According to a fifth aspect, there is provided a method of determining values of a plurality of properties of skin of a subject, the method comprising: illuminating the skin of the subject using a first light arrangement comprising a plurality of light sources, wherein the skin of the subject is illuminated individually by the plurality of light sources; generating a respective first image of a skin sample using an image sensor unit when each of the light sources in the first light arrangement is illuminating the skin of the subject, wherein the skin sample corresponds to an area of skin of the subject within a field of view, FOV, of the image sensor unit when the skin of the subject is spaced a predetermined working distance from the image sensor unit; illuminating the skin of the subject using a second light arrangement comprising one or more light sources; generating one or more second images of the skin sample using the image sensor unit when the second light arrangement is illuminating the skin of the subject; processing, using a control unit, each first image to determine a respective initial value for a first skin property and combining the determined initial values to determine a value for a first skin property; and processing, using the control unit, the one or more second images to determine a value for one or more second skin properties; wherein the plurality of light sources in the first light arrangement are spatially distributed around an optical axis of the image sensor unit to illuminate the skin of the subject from a plurality of directions, and the plurality of light sources are arranged such that light emitted by the light sources in the first light arrangement that is specularly reflected by a skin sample at the predetermined working distance is incident on the image sensor unit; wherein the one or more light sources in the second light arrangement are spaced from the optical axis of the image sensor unit and arranged such that light emitted by the light sources in the second light arrangement that is specularly reflected by a skin sample at the predetermined working distance is not incident on the image sensor unit.
Various embodiments of the methods according to the third and fifth aspects are also envisaged that correspond to the various embodiments of the apparatus and systems according to the first, second and fourth aspects.
These and other aspects will be apparent from and elucidated with reference to the embodiment(s) described hereinafter.
Exemplary embodiments will now be described, by way of example only, with reference to the following drawings, in which:
The system 1 determines the skin properties by analysing images of the skin of the subject. The system 1 comprises an apparatus 2 for obtaining images of a skin sample and a control unit 3 for processing or analysing the images of the skin sample obtained by the apparatus 2 to determine one or more skin properties. Therefore, the apparatus 2 comprises an image sensor unit 4 that is for generating an image or a series of images of a skin sample. The image sensor unit 4 can comprise an image sensor 6 that responds to incident light to produce an image. The image sensor 6 may be, for example, a CCD (charged coupled device) based sensor, or a CMOS (complementary metal-oxide semiconductor) based sensor, similar to the types of image sensors used in digital cameras. Those skilled in the art will be aware of other types of image sensor that could be used. The image sensor 6 or image sensor unit 4 may be configured or capable of obtaining individual images of the skin of a subject, or a video sequence of the skin of a subject.
Although
The image sensor unit 4 has a field of view (FOV) defined by the range of angles of light that can be detected by the image sensor unit 4. The FOV of an exemplary image sensor unit 4 is illustrated in
It will be appreciated that the FOV of an image sensor unit 4 can be defined or controlled by optical components, such as lenses and apertures. As noted above, the image sensor unit 4 may comprise one or more lenses for focussing or otherwise influencing light that is incident towards the image sensor unit 4. In addition to one or more lenses, or alternatively, the image sensor unit 4 (or more generally the apparatus 2) can include an aperture plate that has an aperture of a defined size positioned in front of the image sensor unit 4 or image sensor 6 to restrict the field of view of the image sensor unit 4 or image sensor 6.
The control unit 3 is provided to process or analyse the images obtained or generated by the apparatus 2, and in some implementations the control unit 3 can control the operation of apparatus 2, for example controlling or commanding the apparatus 2 to obtain one or more images. The control unit 3 can be configured to execute or perform the methods described herein.
In some implementations, the control unit 3 can be part of the apparatus 2, i.e. the image sensor unit 4 and the control unit 3 can be part of the same device, for example a handheld device, that can be placed close to or on to skin of a subject. In this case, the control unit 3 can be connected or coupled to the apparatus 2 (and in particular the image sensor unit 4) in order to receive the images.
In other implementations, the control unit 3 can be in a separate device to the apparatus 2. For example, the apparatus 2 can be a handheld device that can be placed close to or on to the skin of a subject, and the control unit 3 can be part of a separate, second, device, for example a smartphone, tablet computer, laptop, desktop computer, server, etc. In the case of a smartphone or tablet computer, the control unit 3 may execute an application (app) in order to analyse the obtained images to determine the one or more skin properties. In these implementations, the system 1 can further comprise interface circuitry (not shown in
In either implementation (i.e. whether the control unit 3 is part of the apparatus 2 or separate from the apparatus 2), the apparatus 2 can be in the form of, or part of, a personal care device, such as (but not limited to) a shaver, a skin cleansing device or a skin treatment device.
In some embodiments (irrespective of whether the control unit 3 and the apparatus 2 are part of the same device), the system 1 can comprise interface circuitry for enabling a data connection or data exchange with other devices, including any one or more of servers, databases, and user devices. This interface circuitry can be used to communicate determined measurements of skin properties from the system 1 to another device, for example a server or data storage facility.
The control unit 3 can be implemented in numerous ways, with software and/or hardware, to perform the various functions described herein. The control unit 3 may comprise one or more microprocessors or digital signal processor (DSPs) that may be programmed using software or computer program code to perform the required functions and/or to control components of the control unit 3 to effect the required functions. The control unit 3 may be implemented as a combination of dedicated hardware to perform some functions (e.g. amplifiers, pre-amplifiers, analog-to-digital convertors (ADCs) and/or digital-to-analog convertors (DACs)) and a processor (e.g., one or more programmed microprocessors, controllers, DSPs and associated circuitry) to perform other functions. Examples of components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, DSPs, application specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).
The control unit 3 may comprise or be connected to a memory unit (not shown in
To enable the image sensor unit 4 to obtain images of the skin of the subject and to enable the control unit 3 to process the images to determine one or more skin properties, the apparatus 2 further comprises a first light arrangement 10 that comprises one or more light sources 12 and a second light arrangement 14 that comprises one or more light sources 16. As described in more detail below, as different skin properties require different lighting or illumination conditions in order for the property to be determined by the control unit 3, the light source(s) 12 in the first light arrangement 10 and the light source(s) 16 in the second light arrangement 14 are spaced different distances from the image sensor unit 4 to provide appropriate lighting conditions for measuring respective skin properties. The spacing of the light sources 12, 16 is described in more detail below.
Each of the light source(s) 12 in the first light arrangement 10 and the light source(s) 16 in the second light arrangement 14 are for emitting light towards the skin of a subject when the apparatus 2 is placed on or close to a subject, thereby illuminating the skin of the subject. In particular, the first light arrangement 10 and second light arrangement 14 are for illuminating an area of skin of the subject within the field of view of the image sensor unit 4. Each of the light sources 12, 16 can be the same type of light source, or one or more of the light sources 12, 16 can be different from the other light sources 12, 16. A light source 12, 16 may be a light emitting diode (LED), a resonant cavity light emitting diode (RCLED), a vertical cavity surface emitting laser (VCSELs), an edge emitting laser, or any other suitable type of semiconductor light source. Alternatively or in addition, in some embodiments, a light source 12, 16 can be, for example, an organic light emitting diode (OLED), a passive-matrix OLED (PMOLED), an active-matrix OLED (AMOLED), or any other organic material based light source. Alternatively or in addition, in some embodiments, a light source 12, 16 can be, for example, a solid state light source. Those skilled in the art will be aware of other types of light source that could be used in the apparatus 2.
Although each of the first light arrangement 10 and the second light arrangement 14 may comprise one light source 12, 16, preferably each of the first light arrangement 10 and the second light arrangement 14 comprise a plurality of light sources 12, 16. In some embodiments, the first light arrangement 10 comprises two light sources 12, but in other embodiments the first light arrangement 10 comprises three, four, or more than four, light sources 12. In some embodiments, the second light arrangement 14 comprises two light sources 16, but in other embodiments the second light arrangement 14 comprises three, four, or more than four, light sources 16. In some embodiments, the first light arrangement 10 has the same number of light sources as the second light arrangement 14, but in other embodiments the first light arrangement 10 has a different number of light sources to the second light arrangement 14. Where the first light arrangement 10 and/or the second light arrangement 14 comprise multiple light sources 12, 16, the light sources 12, 16 in each arrangement may arranged around the image sensor unit 4 to provide uniform, or generally uniform, illumination to the skin. For example, the light sources 12, 16 for a particular arrangement 10, 14, may be provided in a ring around (e.g. equidistant or substantially equidistant from) the image sensor unit 4 to provide uniform illumination to the skin. Where a light arrangement comprises multiple light sources, the light sources in the arrangement may be configured to operate together, i.e. each of the light sources in the arrangement can emit light at the same time. That is, the control unit 3 can be configured to control the light sources in the arrangement so that they all emit light at the same time. Alternatively, the light sources in the arrangement may configured to operate sequentially or individually, i.e. each of the light sources in the arrangement can be controlled by the control unit 3 to emit light one at a time, with respective images being obtained when each of the light sources is emitting light. In some embodiments, a light arrangement may be controllable to switch between a mode in which all of the light sources are emitting light at the same time, and a mode in which the light sources emit light one at a time. That is, the control unit 3 can be configured to selectively operate the light sources in an arrangement in a first mode so that they all emit light at the same time and a second mode so that they emit light individually.
In some embodiments, the light sources 12, 16 in the first light arrangement 10 and the second light arrangement 14 are configured to emit white light. In some embodiments, any of the light sources 12, 16 in the first light arrangement 10 and the second light arrangement 14 can be configured to emit visible light, including but not limited to, white light, red light, green light and blue light. The colour of light emitted by the light sources 12, 16 in the first light arrangement 10 and the second light arrangement 14 may depend on the skin properties to be measured by the apparatus 2. In some embodiments, the light source(s) 12 in the first light arrangement 10 can be configured to emit visible light of any colour (including white light). In some embodiments, the light source(s) 16 in the second light arrangement 14 can be configured to emit visible light of any colour (including white light), ultraviolet (UV) light, and/or infrared (IR) light. In some embodiments, the colour of the light emitted by the light sources 12, 16 in the first light arrangement 10 and/or the second light arrangement 14 can be controllable, for example according to a particular skin property to be measured.
The light sources 12, 16 in the first light arrangement 10 and second light arrangement 14 can emit light that is unpolarised. In some embodiments, which can depend on the skin parameters to be measured by the apparatus 2, a polariser or polarising filter can be provided for each light source(s) 16 in the second light arrangement 14 that acts to polarise the light emit by the light source(s) 16 in the second light arrangement 14 before it is incident on the skin of the subject. These polariser(s) or polarising filter(s) are referred to herein as second polariser(s) or second polarising filter(s), and polarises light passing through the second polariser or second polarising filter in a second polarising direction. It will be appreciated that the second polariser(s) or second polarising filter(s) can be a separate component to the light source(s) 16 in the second light arrangement 14, or they can be integral to the light source(s) 16 in the second light arrangement 14. In some embodiments where polariser(s) or polarising filter(s) are provided for the light source(s) 16 in the second light arrangement 14, the light source(s) 12 in the first light arrangement 10 do not have polariser(s) or polarising filter(s).
In embodiments where a first polariser or first polarising filter is positioned in the light path from a skin sample to the image sensor unit 4, the first polarising filter and the second polarising filter(s) for the light source(s) in the second light arrangement 14 can be ‘crossed’ so that most of the light from the light source(s) in the second light arrangement 14 is not incident on the image sensor unit 4 (i.e. only light from the light source(s) in the second light arrangement 14 whose angle of polarisation is altered by reflection from the skin of the subject is able to pass through the first polarising filter and reach the image sensor unit 4/image sensor 6). Thus, the first polarising filter can be arranged so that the first polarising direction is orthogonal to the second polarising direction of the second polarising filter(s).
In some embodiments, the apparatus 2 can further comprise a third light arrangement 18 that comprises one or more light sources 20. The third light arrangement 18 can be provided for measuring other skin properties that cannot be measured (or that cannot be measured as reliably) using the light source(s) 12 in the first light arrangement 10 and the light source(s) 16 in the second light arrangement 14. In particular embodiments, the third light arrangement 18 is provided where the light from the second light arrangement 14 is polarised using the second polarisers or second polarising filters. In these embodiments, the light source(s) 20 in the third light arrangement 18 do not have polariser(s) or polarising filter(s).
Similar to the first light arrangement 10 and the second light arrangement 14, each of the light source(s) 20 in the third light arrangement 18 are for emitting light towards the skin of a subject when the apparatus 2 is placed on or close to a subject, thereby illuminating the skin of the subject. In particular, the third light arrangement 18 is for illuminating an area of skin of the subject within the field of view of the image sensor unit 4. The light source(s) 20 can be the same type of light source as the light sources 12, 16 in the first light arrangement 10 and the second light arrangement 14, or the light sources 20 can be different to the other light sources 12, 16. A light source 20 may be a LED, a RCLED, a VCSEL, an edge emitting laser, or any other suitable type of semiconductor light source. Alternatively or in addition, in some embodiments, a light source 20 can be, for example, an OLED, a PMOLED, an AMOLED, or any other organic material based light source. Alternatively or in addition, in some embodiments, a light source 20 can be, for example, a solid state light source. Those skilled in the art will be aware of other types of light source that could be used in the apparatus 2.
Although the third light arrangement 18 may comprise one light source 20, preferably the third light arrangement 18 comprises a plurality of light sources 20. In some embodiments, the third light arrangement 18 comprises two light sources 20, but in other embodiments the third light arrangement 18 comprises three, four, or more than four, light sources 20. In some embodiments, the third light arrangement 18 has the same number of light sources as the first light arrangement 10 and/or the second light arrangement 14, but in other embodiments the third light arrangement 18 has a different number of light sources to the first light arrangement 10 and the second light arrangement 14. Where the third light arrangement 18 comprises multiple light sources 20, the light sources 20 in each arrangement may arranged around the image sensor unit 4 to provide uniform, or generally uniform, illumination to the skin. For example, the light sources 20 may be provided in a ring around (e.g. equidistant from or substantially equidistant from) the image sensor unit 4 to provide uniform illumination to the skin. As noted above with respect to the first light arrangement 10 and the second light arrangement 14, the control unit 3 may be configured to control the light sources 20 in the third light arrangement 18 so that they emit light at the same time, and/or control the light sources 20 in the third light arrangement 18 so that they emit light sequentially or individually.
In some embodiments, the light source(s) 20 in the third light arrangement 18 are configured to emit white light. In some embodiments, any of the light source(s) 20 in the third light arrangement 18 can be configured to emit visible light, including but not limited to, white light, red light, green light and blue light. The colour of light emitted by the light source(s) 20 in the third light arrangement 18 may depend on the skin properties to be measured by the apparatus 2. In some embodiments, the light source(s) 20 in the third light arrangement 18 can be configured to emit visible light of any colour (including white light), infrared (IR) light, and/or ultraviolet (UV) light.
The first light arrangement 10, the second light arrangement 14 and (if present) the third light arrangement 18 can be controlled by the control unit 3. For example, the control unit 3 can control the activation or deactivation of a particular light arrangement or particular light source(s) in a light arrangement according to a particular skin property to be measured.
In some embodiments, the apparatus 2 can comprise a user interface (not shown in
In some further embodiments, the apparatus 2 can also determine a skin property such as hydration level, and the apparatus 2 can further comprise an impedance sensor for measuring the impedance of the skin. The impedance sensor may be positioned so that it measures the impedance of a part of the skin that is different to the skin sample, e.g. skin that is adjacent to the skin sample. The impedance sensor can comprise two or more electrodes that are to be placed in contact with the skin, with the impedance being measured by applying a current to the skin through the electrodes.
It will be appreciated that a practical implementation of an apparatus 2 may include additional components to those shown in
As noted above, different skin properties require different lighting conditions in order for the property to be determined by the control unit 3 from an acquired image, and so the light source(s) 12 in the first light arrangement 10, the light source(s) 16 in the second light arrangement 14 and the light source(s) 20 in the third light arrangement 18 (if present) are spaced different distances from the image sensor unit 4 to provide appropriate lighting conditions for measuring respective skin properties. In particular, to measure some skin properties, such as gloss and oiliness, it is desirable for light to be specularly reflected from the skin sample towards the image sensor unit 4 so that the acquired image shows a bright spot (or ‘hotspot’). Skin texture can also be measured using an image acquired when light is specularly reflected from the skin sample towards the image sensor unit 4. For other skin properties, such as the skin colour, redness, skin pigmentation, pores, the presence of spots (such as black heads and white heads) and the presence of hairs, it is desirable for the acquired image to be generated using diffuse light, and so light should not be specularly reflected from the skin sample towards the image sensor unit 4 (and therefore the acquired image will not show a bright spot or ‘hotspot’ corresponding to the light source). Skin texture can also be measured using an image acquired using diffuse light. Preferably, in obtaining images for measuring skin colour, redness, skin pigmentation, the presence of spots (such as black heads and white heads) and/or the presence of hairs, the light incident on the skin should be polarised, and the apparatus 2 should include the first polariser arranged orthogonally to the polarisation of the light incident on the skin.
Therefore, embodiments provide that the light source(s) 12 in the first light arrangement 10 are arranged with respect to the image sensor unit 4 so that light emitted by the light source(s) 12 in the first light arrangement 10 towards a skin sample at some predetermined or desired working distance from the image sensor unit 4 is specularly reflected by the skin sample and incident on the image sensor unit 4. Thus, specular reflection(s) will be visible in the image or images obtained by the image sensor unit 4. In this way, an image or images acquired when the first light arrangement 10 is used to illuminate the skin sample can be processed or analysed by the control unit 3 to determine skin properties such as gloss, oiliness and texture. Embodiments also provide that the light source(s) in the second light arrangement 14 are arranged with respect to the image sensor unit 4 so that light emitted by the light source(s) 16 in the second light arrangement 14 towards the skin sample at the predetermined or desired working distance from the image sensor unit 4 that is specularly reflected by the skin sample is not incident on the image sensor unit 4. Thus, specular reflection(s) will not be visible in the image or images obtained by the image sensor unit 4. In this way, an image or images acquired when the second light arrangement 14 is used to illuminate the skin sample can be processed or analysed by the control unit 3 to determine skin properties such as skin colour, redness, skin pigmentation, the presence of spots (such as black heads and white heads), the presence of hairs and skin texture.
A cross-section through an apparatus 2 is shown in
As described above, the image sensor unit 4 has a field of view 7 defined by one or more angles, and in
Two light sources 12 for the first light arrangement 10 are shown in
Two light sources 16 for the second light arrangement 14 are also shown in
In embodiments where a third light arrangement 18 is provided, similar to the second light arrangement 14, the light source(s) 20 forming the third light arrangement 18 can be spaced from the image sensor unit 4 (as measured in the plane that is parallel to the plane of the skin sample 34) by a distance that is more than the width wss of the skin sample 34. In some embodiments, the light source(s) 20 forming the third light arrangement 18 can be spaced from the image sensor unit 4 by a similar distance to the light source(s) 16 forming the second light arrangement 14. In other embodiments, the light source(s) 20 forming the third light arrangement 18 can be spaced from the image sensor unit 4 by a greater distance than the light source(s) 16 forming the second light arrangement 14. In other embodiments, the light source(s) 20 forming the third light arrangement 18 can be spaced from the image sensor unit 4 by a smaller distance than the light source(s) 16 forming the second light arrangement 14 (although still greater than wss).
It will be appreciated that the exemplary spacing of the light sources 12, 16 described above is based on the light sources 12, 16 being in the same plane as each other, and in the same plane as the image sensor unit 4. If the light sources 12, 16 are in a different plane to the image sensor unit 4 (for example if the light sources 12, 16 are a distance from the skin 30 that is different to the distance from the image sensor unit 4 to the skin 30), then the requirements on the distance between the light sources 12, 16 and the image sensor unit 4 will need to be adjusted accordingly in order to provide that light from the first light arrangement 10 is specularly reflected by the skin sample 34 to the image sensor unit 4 and light from the second light arrangement 14 that is specularly reflected by the skin sample 34 is not incident on the image sensor unit 4. An exemplary embodiment where the light arrangements are positioned between the skin 30 and the image sensor unit 4 is described below with reference to
In some embodiments, the distance R1 between the light sources 12 of the first light arrangement 10 is at least 4 millimetres (mm), or another distance in the range of 3-7 mm. In some embodiments, the distance R2 between the light sources 16 of the second light arrangement 14 is at least 8 mm, or another distance in the range of 7-15 mm. In some embodiments, the distance R3 between the light sources 20 of the third light arrangement 18 is at least 8 mm, or another distance in the range of 7-15 mm. In some embodiments, the distance R2 between the light sources 16 of the second light arrangement 14 is at least 8 mm, or another distance in the range of 7-11 mm and the distance R3 between the light sources 20 of the third light arrangement 18 is at least 12 mm, or another distance in the range of 11-15 mm.
In a specific implementation where the working distance D is 60 mm and the field of view of the image sensor unit 4 defines a skin sample 34 that has dimensions of 12 mm*9 mm, the light sources 12 of the first light arrangement 10 should be less than 9 mm from the image sensor unit 4, and this provides an angle of incidence of the light from the first light arrangement 10 from the skin sample 34 on to the image sensor unit 4 (as measured with respect to an optical axis of the image sensor unit 4) of no more than 8.5° (based on the smallest dimension of the field of view of 9 mm), and in a particular embodiment the light sources 12 of the first light arrangement 10 are spaced from the image sensor unit 4 to provide an angle of incidence of light of 5.5°. The angle of incidence should therefore be at least 8.5° for light emitted by the light source(s) 16 in the second light arrangement 14 and/or the light source(s) 20 in the third light arrangement 18 (where those light sources 16 are offset with respect to the shortest dimension of the image sensor unit 4) and at least 14 for light emitted by the light source(s) 16 in the second light arrangement 14 and/or the light source(s) 20 in the third light arrangement 18 if those light sources are offset diagonally from the image sensor 6 (given that the largest dimension of the field of view is 15 mm—the length from corner to corner of the skin sample 34 in the FOV).
In another specific implementation where the working distance D is 20 mm and the field of view of the image sensor unit 4 defines a skin sample 34 that has dimensions of 10 mm*7.5 mm, the light sources 12 of the first light arrangement 10 should be less than 7.5 mm from the image sensor unit 4, and this provides an angle of incidence of the light from the first light arrangement 10 from the skin sample 34 on to the image sensor unit 4 (as measured with respect to an optical axis of the image sensor unit 4) of no more than 20 (based on the smallest dimension of the field of view of 7.5 mm). The angle of incidence should therefore be at least 200 for light emitted by the light source(s) 16 in the second light arrangement 14 and/or the light source(s) 20 in the third light arrangement 18 (where those light sources 16, 20 are offset with respect to the shortest dimension of the image sensor unit 4) and at least 32° for light emitted by the light source(s) 16 in the second light arrangement 14 and/or the light source(s) 20 in the third light arrangement 18 if those light sources are offset diagonally from the image sensor 6 (given that the largest dimension of the field of view is 12.5 mm—the length from corner to corner of the skin sample 34 in the FOV).
Generally, the light source(s) 12 in the first light arrangement 10 are spaced from the image sensor unit 6 by a distance that is equal to or less than
2*D*tan(θmin/2)
where D is the predetermined working distance, and θmin is a smallest FOV angle of the image sensor unit 4. In the example shown in
In addition, the light source(s) 16 in the second light arrangement 14 and light source(s) 20 in the third light arrangement 18 are spaced from the image sensor unit 4 by a distance that is greater than:
2*D*tan(θmax/2)
where D is the predetermined working distance, and θmax is a largest FOV angle of the image sensor unit 4. In the example shown in
As noted above, the lighting or illumination conditions required to measure a particular skin property varies depending on the skin property itself. These lighting or illumination conditions include whether there is specular reflection from the relevant light arrangement 10, 14, 18 in the FOV 7 of the image sensor unit 4, the polarisation of light incident on the image sensor unit 4 and the colour of the emitted light. The conditions can also relate to the light source-image sensor distance, the angle of incidence, the emitted light divergence angle, the polarisation of the light incident on the image sensor 6, the number of light sources, the homogeneity of illumination, whether there should be hotspots (specular reflection) in the field of view of the image sensor unit 4, whether the light sources should be operated sequentially (individually) or simultaneously, etc. For instance, for measuring skin oiliness or gloss, light that is specularly reflected from the skin sample 34 to the image sensor unit 4 has to be within the field of view 7 of the image sensor unit 4 and multiple light sources have to be sequentially or individually enabled or activated to average out the effect of shadowing resulting from illuminating the skin sample 34 from different angles/directions (i.e. from different spatial locations). However, the optimal illumination conditions for measuring skin colour, redness or spots (where spots are identified by their colour) require polarised light and homogenous illumination, and specular hot spots must not be in the FOV 7.
By providing multiple light arrangements 10, 14 in separate positions with respect to the field of view of the image sensor unit 6, it is possible to realise the right illumination conditions for measuring different types of skin parameters within a single apparatus 2.
Table 1 below summarises several lighting or illumination conditions that can be used to measure various different skin properties. It will be appreciated that the information contained in Table 1 is merely exemplary, and variations to one or more of the lighting or illumination conditions is possible.
In Table 1, parallel or sequential refers to whether the light sources in a light arrangement should be operated together (i.e. parallel) or one at a time (i.e. sequentially or individually). In the latter case, multiple images (or a video sequence) may be required to reliably determine the skin parameter, with each of the multiple images being obtained when a different one of the light sources in the light arrangement is being operated. As skin is anisotropic, reflections from the skin can differ based on the position of the light source relative to the image sensor unit 4, and so a measure for the skin property (e.g. gloss or oiliness) is preferably derived from an average of the multiple images (although a single image obtained using a single light source 12 can be used if desired). The use of multiple images provides a more stable value for the skin property, and is less susceptible to the orientation of the apparatus 2 on the skin, which can help provide consistency between successive measurements of the skin property, without sacrificing sensitivity of the measurement. Thus, the control unit 3 can selectively control each of the light sources 12 in the first light arrangement 10 to individually illuminate the skin of the subject, and the image sensor unit 4 can acquire a respective image when each of the light sources 12 is active. The control unit 3 can process each of these images to determine a respective initial value for a skin property (e.g. gloss, oiliness, shine and/or texture), and then combine the initial values (e.g. by averaging, such as the mean, mode or median) to determine a value for the skin property.
In some embodiments, shine can be determined as the amount (e.g. intensity) of specular reflection from the skin sample 34. The skin parameter oiliness can represent how oily the skin sample appears, and is influenced by the shine of the skin, the sweatiness of the skin, and the amount of sebum on the skin. Oiliness can be determined from each image based on one or more parameters, including the amount (e.g. intensity) of reflection, the distribution, granularity and/or intensity of specular reflection from the skin sample 34, a roughness or texture of the skin, principal component analysis of the image, a histogram shape encoding of texture maps, and contrast in the image.
The polarisation column indicates whether a polariser is required at a light source (L), at the image sensor unit 4 (S) or both (S+L). The light source divergence (otherwise referred to as the level of collimation of the emitted light) indicates the desired divergence of the light source used to measure the particular skin property. Thus, it can be seen that the light source(s) 12 in the first light arrangement 10 preferably have a wide divergence (e.g. the light source(s) 12 emit light at the same or similar intensity across a wide angle (or even in all directions) and the light source(s) in the second light arrangement 14 should have a narrow or wide divergence, depending on the skin property to be measured. An example of a light source that can provide a narrow divergence (i.e. only emitting light across a narrow angle) is a laser-based light source or a light source with a lens arrangement to provide collimated light. Where a light arrangement is required to provide light that can have both wide and narrow divergence, e.g. in the case of the second light arrangement 14 in Table 1, the light arrangement can comprise multiple light sources that have different divergence properties (e.g. LEDs with different collimation angles, or light sources with different lens arrangements), and the appropriate light source(s) can be operated when a particular skin property is to be measured. The RGB detector channel refers to a capture mode of the image sensor 6. In particular, the image sensor 6 can be controlled to capture images in colour (i.e. RGB mode), or in one or more colour channels (i.e. in red (R), green (G) and/or blue (B) mode).
The skin parameter redness can be measured using the second light arrangement 14, with all light sources 16 being operated at the same time to evenly illuminate the skin sample 34. The redness can be determined based on the redness values of pixels in the acquired image (e.g. the value of the R component for each pixel). For example the redness can be determined as the average of the redness values for all of the pixels in the acquired image. A measure of colour contrast can also be used to determine the redness.
The skin parameter pores and/or blackheads (which can be considered as clogged or blocked pores) can be measured using the third light arrangement 18, with all light sources 20 being operated at the same time to evenly illuminate the skin sample 34. As light from this light arrangement 18 does not specularly reflect to the image sensor unit 4, pores and blackheads can be identified by differences in contrast in the acquired image. Image analysis (for example using a ‘machine learning’ trained algorithm) can be used to identify pores/blackheads and quantify their number and/or their size. Image analysis can also distinguish between pores and blackheads.
In this exemplary apparatus 2, the light arrangements 10, 14, 18 are arranged in a plane that is between the image sensor unit 4 and the skin 30. That is, the image sensor unit 4 is spaced the predetermined working distance D from the skin 30 as in the earlier embodiments, but the light arrangements 10, 14, 18 are positioned less than distance D to the skin 30. The distance between the light arrangements 10, 14, 18 and the skin is denoted DLA->S and the distance between the image sensor unit and the light arrangements 10, 14, 18 is denoted DISU->LA. By positioning the light arrangements closer to the skin 30 than the image sensor unit 4, the apparatus 2 can be made more compact, as the light sources can be closer to the optical axis of the image sensor unit 4 while achieving the specular or non-specular illumination of the skin sample as appropriate for the particular light arrangement. In this exemplary apparatus 2, the light sources for the light arrangements 10, 14, 18 are disposed on a circuit board 40, and the circuit board 40 has an aperture or hole 42 through which the image sensor unit 4 is able to view the skin sample 34. The light sources of the light arrangements 10, 14, 18 are arranged around the aperture 42. In this exemplary apparatus 2, the field of view of the image sensor unit 4 (as represented by lines 32) is such that it is narrower than the aperture 42, but in other embodiments, the aperture 42 could help define the size of the skin sample visible to the image sensor unit 4 through the aperture 42.
The light sources 12 in the first light arrangement 10 are each spaced from the image sensor unit 4 (and specifically spaced from the optical axis of the image sensor unit 4) by a distance R1 so that specular reflections of the light on the skin sample are incident on the image sensor unit 4. The light sources 16 in the second light arrangement 14 and two of the light sources 20 of the third light arrangement 18 are each spaced from the image sensor unit 4 (and specifically spaced from the optical axis of the image sensor unit 4) by a distance R2. R2 is greater than R1 so that specular reflections on the skin sample of the light from these light sources is not incident on the image sensor unit 4. The other two light sources 20 in the third light arrangement 18 are spaced from the optical axis of the image sensor unit 4 by a distance R3, which in this embodiment is between R1 and R3, so that specular reflections on the skin sample of the light from these light sources is not incident on the image sensor unit 4. In alternative implementations, all of the light sources 16, 20 of the second and third light arrangements 14, 18 can be spaced the same distance from the optical axis of the image sensor unit 4.
In particular embodiments, DLA->S is 24 mm, or another distance in the range 20-60 mm, and DISU->LA is 34 mm or 34.7 mm, or another distance in the range of 10-40 mm. In these embodiments, the predetermined working distance D can be 58 mm or 58.7 mm, or another distance in the range 30-100 mm. The field of view of the image sensor unit 4 can be such that, at a distance 58.7 mm from the skin 30, the skin sample 34 has width wss=11.45 mm (or about 11.5 mm or about 11 mm) and length lss=8.6 mm (or about 9 mm). The distance R1 can be 5.5 mm, or another distance in the range 1-6 mm. The distance R2 can be 8.75 mm or about 9 mm. The distance R3 can be 7 mm. Alternatively, R2 and/or R3 can be any distance greater than 7 mm.
With the exemplary apparatus 2 shown in
A method of operating the system 1 to determine one or more properties of the skin 30 of a subject is illustrated in
In step 101, the skin of the subject is illuminated using the first light arrangement 10. This step can comprise the control unit 3 controlling the light source(s) 12 in the first light arrangement 10 to emit light. In embodiments where the first light arrangement 10 comprises multiple light sources 12, this step can comprise the skin being illuminated by all of the light sources 12 at once, or the skin being selectively illuminated by the light sources 12 one at a time.
In step 103, a first image of a skin sample 34 is generated using the image sensor unit 4. The first image is generated while the first light arrangement 10 is illuminating the skin 30. As described above, the skin sample 34 corresponds to an area of the skin 30 that is within the FOV of the image sensor unit 4 when the skin 30 is spaced a predetermined working distance D from the image sensor unit 4.
In step 105, the skin of the subject is illuminated using the second light arrangement 14. This step can comprise the control unit 3 controlling the light source(s) 16 in the second light arrangement 14 to emit light. In embodiments where the second light arrangement 14 comprises multiple light sources 16, this step can comprise the skin being illuminated by all of the light sources 16 at once, or the skin being illuminated by the light sources 16 one at a time.
In step 107, a second image of skin sample 34 is generated using the image sensor unit 4. The second image is generated while the second light arrangement 14 is illuminating the skin 30.
Next, in step 109, the first image and the second image are processed by the control unit 3 to determine one or more properties of the skin of the subject. As noted above, the skin property to be determined depends on the light arrangement used to illuminate the skin sample 34.
Techniques for determining the various skin properties mentioned above from images of a skin sample 34 are known to those skilled in the art, and therefore further details are not provided herein.
In particular embodiments of the method, the method is for determining values of multiple skin properties, with a first skin property being determined from images obtained when the skin sample is illuminated with light from the first light arrangement 10 and a second skin property being determined from images obtained when the skin sample is illuminated with light from the second light arrangement 14. The first light arrangement 10 comprises multiple light sources 12 and the control unit 3 controls the light sources 12 to illuminate the skin sample individually (i.e. one at a time), and the image sensor unit 4 obtains a respective image when each of the light sources 12 is active. These images are referred to as ‘first’ images. The second light arrangement 14 includes one or more light sources 16, and the image sensor unit 4 obtains one or more images when the light source or light sources 16 are active together. This or these images are referred to as ‘second’ images.
To determine a value for the first skin property (e.g. oiliness, shine, gloss or texture), the control unit 3 processes each first image to determine a respective initial value for the first skin property, and then combines the determined initial values to determine a value for the first skin property. The combination can be an average, e.g. mean, mode or median. To determine a value for the second skin property (e.g. colour, redness, pigmentation, texture, pores, blackheads, etc.), the control unit 3 processes the one or more second images to determine a value for the second skin property.
In embodiments where the apparatus 2 comprises a third light arrangement 18, the control unit 3 can selectively control the third light arrangement 18 to illuminate the skin sample 34 when a third skin property is to be determined (e.g. pores or blackheads). Where the third light arrangement 18 comprises multiple light sources 20, the control unit 3 can control the light sources 20 to illuminate the skin sample 34 at the same time. The image sensor unit 4 obtains one or more images when the light sources 20 are active. This or these images are referred to as ‘third’ images. The control unit 3 processes the third image(s) to determine values for the third skin property.
In embodiment where the apparatus 2 also comprises an impedance sensor for measuring impedance of the skin of the subject, the control unit 3 can control the impedance sensor to measure impedance, and process the impedance measurements to determine a measure of the hydration level of the skin.
There is therefore provided an improved system, apparatus and method for obtaining images for use in determining properties of skin of a subject. In general, the first light arrangement 10 enables skin properties to be measured that require specular reflection in the image (e.g. oiliness, shine, gloss, texture), the second light arrangement 14, with cross-polarisation with the image sensor unit 4, enables skin properties relating to colour to be measured without specular disturbances (e.g. colour, colour variety, pigmentation, presence of hair), and the third light arrangement 18 enables skin properties relating to the skin structure to be measured without specular disturbances (e.g. pores, blackheads).
Variations to the disclosed embodiments can be understood and effected by those skilled in the art in practicing the principles and techniques described herein, from a study of the drawings, the disclosure and the appended claims. In the claims, the word “comprising” does not exclude other elements or steps, and the indefinite article “a” or “an” does not exclude a plurality. A single processor or other unit may fulfil the functions of several items recited in the claims. The mere fact that certain measures are recited in mutually different dependent claims does not indicate that a combination of these measures cannot be used to advantage. A computer program may be stored or distributed on a suitable medium, such as an optical storage medium or a solid-state medium supplied together with or as part of other hardware, but may also be distributed in other forms, such as via the Internet or other wired or wireless telecommunication systems. Any reference signs in the claims should not be construed as limiting the scope.
| Number | Date | Country | Kind |
|---|---|---|---|
| 18158913.6 | Feb 2018 | EP | regional |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2019/054721 | 2/26/2019 | WO | 00 |
