Patent Application
20180202927
This relates generally to light sensors included in electronic devices and methods for measuring one or more signals using the light sensors. More specifically, this disclosure relates to a UV-IR spectrometer and methods for detecting light-based shielding.
Overexposure to ultraviolet (UV) radiation can be associated with a variety of health conditions. Risks for some of the health conditions can correspond to a person's natural sensitivity to UV exposure and the lifetime UV exposure from both sunlight and artificial sources (e.g., tanning beds and tanning lamps). In addition, physical characteristics (e.g., hair color, eye color, and/or skin color) can be correlated with the risk of skin-related health conditions. Protective measures (e.g., staying indoors or in the shade during peak times during the day, and use of protective clothing) can be taken to reduce the risks of UV overexposure to the skin. Protective measures can also include the application of sunscreen to potentially exposed areas of skin. Although sunscreen can be characterized based on sun protection factor (SPF), the efficacy of the sunscreen as applied to the user's skin may differ based on, for example, the breakdown of one or more active ingredients in the sunscreen can break down, the user's skin sensitivity, the sunscreen's water-resistance.
The application of sunscreens prior to sun exposure may help to block UV radiation using a combination of one or more active ingredients. Inorganic particles (e.g., titanium dioxide or zinc oxide) may act as a physical sunblock to physically deflect UV light by forming a physical barrier that reflects or scatters UV rays. Organic components (e.g., avobenzone, octyl methoxycinnamate (OMC) or oxybenzone) may act to absorb UV rays/radiation so that they are not absorbed by the skin. These organic ingredients can slowly break down and release the energy from the absorbed UV rays as heat. Sun Protection Factor (SPF) is a metric that indicates how well the sunscreen protects against UVB radiation. The SPF number refers to roughly how long it will take for average person's skin to turn red (e.g., how long you can stay in the sun before getting sunburn), and is a multiplication factor that indicates how much longer a sunscreen lotion augments the skin's natural ability to resist sunburn. For example, sunscreen with an SPF of 15 will prevent skin from getting red for approximately 15 times longer than usual. That is, if a person's skin starts to burn after 10 minutes of sun exposure, sunscreen with SPF 15 will increase that time period by a factor of 15, and prevent sunburn for about 150 minutes, or 2.5 hours. However, the identified SPF may not be accurate, and may be affected by other factors, including water-resistance. Although sunscreen lotions labeled as being capable of blocking both UVB and UVA radiation, there is currently no standard metric that indicates UVA blocking efficacy.
Disclosed herein is a UV-IR spectrometer for mobile and/or wearable devices. The UV-IR spectrometer may be a sunscreen detector that is configured to identify the degree of sunscreen coverage in exposed areas of the skin of a user or subject and may provide information about regions that may be at elevated UV exposure risk. The sunscreen detector may be configured to indicate areas of skin or entire body parts where sunscreen protection is missing or inadequate. Based upon the detected sunscreen coverage, the detector may provide notifications or instructions to the user about where to apply or re-apply sunscreen, and/or how much and how often to apply sunscreen.
For example, the detector may be configured to identify exposed skin based upon infrared light reflection, and the degree of reflected or absorbed ultraviolet light detected in the exposed skin areas to determine the degree sunscreen coverage. The sunscreen detector may also identify exposure risk relating to the user's physical attributes, their anticipated sun exposure, and activity. In some variations, the detector may make recommendations relating to use of sunscreen having a minimum SPF, and/or recommendations relating to the frequency of application.
The UV-IR spectrometer may comprise a controller that is configured to provide notifications to the user of insufficient UV light protection, encouraging the user to re-apply sunscreen. For example, the UV-IR spectrometer may be used when sunscreen is initially applied and may alert the user if the quantity of lotion or skin coverage of the lotion is insufficient. The spectrometer may also be used to remind the user to re-apply sunscreen after the initial application, so that the user can re-apply new sunscreen before the older sunscreen has depleted its UV blocking capabilities. This UV-IR spectrometer may provide the user with actionable information so that they can proactively protect their skin in order to help prevent skin-related health conditions.
One variation of a UV-IR spectrometer that may be a sunscreen detector may comprise an illumination system configured to emit UV spectrum light and IR spectrum light, a sensor system configured to detect UV spectrum light and IR spectrum light at a sensor field, and a controller configured to receive a UV signal and an IR signal from the sensor system and to output a first output signal when the IR signal is above an IR threshold and the UV signal is below a UV threshold. The illumination system may comprise a UV illumination field and an IR illumination field and the sensor field may be located within the UV illumination field and the IR illumination field. The sensor system may comprise an optic to limit the sensor field. The optic may be a fiber-optic faceplate, or a diffraction optic, or a low numerical-aperture hole array. The sensor field may have an effective field of view in the range of 5 degrees to 180 degrees, or 15 degrees to 135 degrees, or 30 degrees to 90 degrees, for example. In other embodiments, the sensor field may be characterized as an area in the range of 0.1 to 1500 cm2 at a distance of 5 cm from the sensor system, and in some variations, the sensor field may have an area in the range of 0.5 to 20 cm2 at a distance of 5 cm, or 1 to 15 cm2 at a distance of 5 cm from the sensor system. In some variations, the sunscreen detector may comprise a sensor module, and the illumination system and the sensor system may be located on the sensor module. The sensor module may be located in a portable multifunction device, such as a cell phone, or a watch, including but not limited to a band of a watch. The controller may be configured to overlay a graphic corresponding to the sensor field onto a camera image. For example, the graphic may be a first graphic corresponding to the first output signal. The controller may be further configured to output a second output signal when the IR signal is above an IR threshold and the UV signal is above a UV threshold, and the graphic may be a second graphic corresponding to the second output signal. The controller may also be configured to output a third output signal when the IR signal is below an IR threshold, and the graphic may be a third graphic corresponding to the third output signal. Optionally, the illumination system may be further configured to emit visible light. Some variations of a sunscreen detector may also comprise a distance sensor system configured to detect an object distance of an object in the sensor field from the distance sensor system. For example, the distance sensor system may be a Doppler sensor system.
Also disclosed herein is a method for detecting sunscreen coverage. One variation of such a method may comprise positioning a sunscreen detector over a target skin region, where the sunscreen detector comprises an illumination system configured to emit UV spectrum light and IR spectrum light, a sensor system configured to detect UV spectrum light and IR spectrum light at a sensor field located within the UV illumination field and the IR illumination field, and a controller configured to receive a UV signal and an IR signal from the sensor system, moving the sunscreen detector across the target skin region, emitting and sensing UV spectrum light and IR spectrum light, outputting a first output signal when the IR signal is above an IR threshold and the UV signal is below a UV threshold, and generating an alert based on the first output signal. Some variations may optionally comprise displaying an instruction to apply sunscreen over the target skin region or acquiring an image that includes the target skin region and displaying a composite image that comprises a graphic of the sensor field overlaid over the image. The sensor system may comprise an optic to limit the sensor field. The optic may be, for example, a fiber-optic faceplate, or a diffraction optic, or a low numerical-aperture hole array. The sensor field may have an effective field of view in the range of 5 degrees to 180 degrees, or 15 degrees to 135 degrees, or 30 degrees to 90 degrees, for example. In other embodiments, the sensor field may be characterized as an area in the range of 0.1 to 1500 cm2 at a distance of 5 cm from the sensor system, and in some variations, the sensor field may have an area in the range of 0.5 to 20 cm2 at a distance of 5 cm, or 1 to 15 cm2 at a distance of 5 cm from the sensor system. In some variations, the sunscreen detector may comprise a sensor module, and the illumination system and the sensor system may be located on the sensor module. The sensor module may be located in a cell phone, or a watch, or in a band of a watch. The controller may be configured to overlay a graphic corresponding to the sensor field onto a camera image. For example, the graphic may be a first graphic corresponding to the first output signal. The controller may be further configured to output a second output signal when the IR signal is above an IR threshold and the UV signal is above a UV threshold, and the graphic may be a second graphic corresponding to the second output signal. The controller may also be configured to output a third output signal when the IR signal is below an IR threshold, and the graphic may be a third graphic corresponding to the third output signal. Optionally, the illumination system may be further configured to emit visible light.
In some variations, a method for detecting sunscreen coverage may optionally comprise calibrating a UV-IR spectrometer that may be a sunscreen detector. Calibrating the sunscreen detector may comprise scanning a skin region that has no sunscreen to acquire a baseline skin UV spectrum light measurement and a baseline skin IR spectrum light measurement. In further variations, calibrating the sunscreen detector may comprise placing the sunscreen detector against a skin region that has no sunscreen, acquiring a first measurement comprising a UV spectrum light level and an IR spectrum light level, pulling the sunscreen detector away from the skin region, acquiring a plurality of measurements while pulling the sunscreen detector away from the skin region, each of the measurements comprising a UV spectrum light level, an IR spectrum light level, and a distance between the detector and the skin region, and calculating, using the controller, the UV threshold and IR threshold based on the plurality of measurements. The sunscreen detector may be pulled away from the skin surface to a separation distance in the range of about 1 in to about 18 in, or about 3 in to about 10 in, or about 3 in to about 7 in. In some variations, the controller may be configured to determine melanin levels in the skin region based on the plurality of measurements. Calculating the UV threshold and IR threshold may comprise calculating the ratio of UV spectrum light level of each of the plurality of measurements to the UV spectrum light level of the first measurement. Optionally, a calibration method may comprise using the controller to generate a calibration curve based on the first measurement and the plurality of measurements.
Described herein is a device that detects the UV light that may be reflected by a user-selected region. The UV-IR spectrometers described herein may be sunscreen detectors and incorporated in mobile and/or wearable devices. The UV-IR spectrometer may be used to scan the user's skin and based on the detected UV light values (which may be UV reflectance values), determine whether the user should apply sunscreen, and/or should apply additional sunscreen, and/or whether the scanned skin region is at risk for UV light exposure. The UV-IR spectrometer may comprise an illumination system having a UV light source, a sensor system having a UV sensor, and a controller in communication with the illumination and sensor systems. Optionally, the illumination system may also have an infrared (IR) light source, and the sensor system may have an IR sensor. The illumination and sensor systems may be located on a wearable or mobile device, while the controller may be located on a separate device, for example, a computer or a separate wearable or mobile device. Alternatively, the illumination system, sensor system and controller may all be located on the same wearable or mobile device. For example, the UV-IR spectrometer may be located on a wrist-worn device (e.g., a watch, wrist-band, or bracelet), an article of clothing (e.g., hat, glasses), or a smart phone or tablet. In some variations, the illumination and sensor systems may be located on the wrist-worn device, an article or clothing or a smart phone, while the controller may be located on a tablet, laptop, or desktop computer. In some variations, the UV-IR spectrometer may be integrated with these other devices, but in other variations, the UV-IR spectrometer may be in a separate module that is attachable by a user to a wearable or mobile device. For example, the UV-IR spectrometer may comprise an adaptor configured to attach to a port (e.g., a USB port) of a computing device. In some variations, the UV-IR spectrometer may have a dedicated controller distinct from the controller of the wearable or mobile device and the controller of other computing devices (e.g., tablet, laptop, desktop computer, remote server, etc.). The spectrometer controller may perform spectrometer-specific methods and/or may perform general computing methods. Any of the methods described below may be performed by the spectrometer controller, the wearable or mobile device controller, the computing device controller, and/or a combination of two or more of these controllers. For example, methods for IR depth mapping may be performed by the spectrometer controller while methods for generating user notifications may be performed by the wearable or mobile device controller. Analysis and interpretation of scan data, calibration data, including light level threshold computation, IR depth mapping, user notification methods, and storage of data of any kind may be performed by one or more of the controllers described above.
Although the following description uses terms “first,” “second,” etc. to describe various elements, these elements should not be limited by the terms. These terms are only used to distinguish one element from another. For example, a first light source could be termed a second light source, and, similarly, a second light source could be termed a first light source, without departing from the scope of the various described variations. The first light source and the second light source are both light sources, but they are not the same light source.
The terminology used in the description of the various described variations herein is for the purpose of describing particular variations only and is not intended to be limiting. As used in the description of the various described variations and the appended claims, the singular forms “a”, “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items. It will be further understood that the terms “includes,” “including,” “comprises,” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The term “if” may be construed to mean “when” or “upon” or “in response to determining” or “in response to detecting,” depending on the context. Similarly, the phrase “if it is determined” or “if [a stated condition or event] is detected” may be construed to mean “upon determining” or “in response to determining” or “upon detecting [the stated condition or event]” or “in response to detecting [the stated condition or event],” depending on the context.
Variations of electronic devices, user interfaces for such devices, and associated processes for using such devices are described. In some variations, the device is a portable communications device, such as a mobile telephone, an internet-enabled telephone such as a smartphone, or a wearable communications device, such as a wristband, watch, clip, headband, earphone or ear piece, internet-enabled eyewear, or any computing device, portable or otherwise, such as a personal calendaring device, electronic reader, tablet, desktop, or laptop computers, etc. Any of these devices may also contain other functions, such as personal digital assistant (PDA) and/or music player functions. Optionally, any of the above-listed electronic devices may comprise touch-sensitive surfaces (e.g., touch screen displays and/or touchpads). Alternatively or additionally, the electronic devices may include one or more other physical user-interface devices, such as a physical keyboard, a mouse, and/or a joystick.
In some variations, device 100 may have one or more input mechanisms 106 and 108. Input mechanisms 106 and 108, if included, can be physical. Examples of physical input mechanisms may include push buttons and rotatable mechanisms. In some variations, device 100 may have one or more attachment mechanisms. Such attachment mechanisms, if included, can permit attachment of device 100 with, for example, hats, eyewear, earrings, necklaces, shirts, jackets, pockets, collars, bracelets, watch straps, chains, trousers, belts, shoes, socks, purses, backpacks, undergarments, and so forth. These attachment mechanisms may permit device 100 to be worn by a user.
Input mechanism 108 may be a microphone, in some examples. Personal electronic device 100 can include various sensors, such as GPS sensor 132, accelerometer 134, directional sensor 140 (e.g., compass), gyroscope 136, motion sensor 138, and/or a combination thereof, all of which can be operatively connected to I/O section 114. Embodiments with a UV-IR spectrometer, described in greater detail below, may include an UV sensor 142 and/or an IR sensor 144.
Memory 118 of personal electronic device 100 can be a non-transitory computer-readable storage medium, for storing computer-executable instructions, which, when executed by one or more computer processors 116, for example, can cause the computer processors to perform the techniques described herein. The computer-executable instructions can also be stored and/or transported within any non-transitory computer-readable storage medium for use by or in connection with an instruction execution system, apparatus, or device, such as a computer-based system, processor-containing system, or other system that can fetch the instructions from the instruction execution system, apparatus, or device and execute the instructions. A “non-transitory computer-readable storage medium” can be any medium that can tangibly contain or store computer-executable instructions for use by or in connection with the instruction execution system, apparatus, or device. The non-transitory computer-readable storage medium can include, but is not limited to, magnetic, optical, and/or semiconductor storages. Examples of such storage include magnetic disks, optical discs based on CD, DVD, or Blu-ray technologies, as well as persistent solid-state memory such as flash, solid-state drives, and the like. Personal electronic device 100 is not limited to the components and configuration of
Attention is now directed towards variations of additional device modules and associated processes that may be implemented on an electronic device, such as device 100.
A UV-IR spectrometer may be a sunscreen detector configured to determine whether a user should apply sunscreen based on detected UV light measurements. In some variations, a UV-IR spectrometer may be configured to detect IR light measurements, and may optionally use the IR light measurements in conjunction with the UV light measurements to determine whether a user should apply sunscreen. The UV-IR spectrometer may generate an alert and/or message to the user with its sunscreen recommendation, which may include whether sunscreen is to be applied, and optionally, the amount and strength (e.g., SPF) of the sunscreen. The sunscreen detector may also prompt the user to apply sunscreen to a particular location. One variation of a UV-IR spectrometer or sunscreen detector 200 is depicted in
In addition to receiving data from the sensor system, the controller may issue commands to the illumination and sensor systems. For example, the controller may issue a series of commands to the illumination system and the sensor system as part of a calibration procedure. The calibration procedure may be automatically initiated upon powering on the UV-IR spectrometer, or user-initiated as desired. The controller may also notify the user if the UV-IR spectrometer is improperly used. For example, the controller may notify the user if the movement of the UV-IR spectrometer across the region of interest is not continuous, irregular (e.g., the distance between the spectrometer and the skin surface is not substantially constant during the scan), too fast, etc. The controller may also be configured to store user identification data, as well as time-based UV and IR data associated with that user. Based on the stored data, a computer-implemented method on the controller may be executed to remind the user of the time of the last sunscreen application and prompt the user to reapply sunscreen before the sun protection ability of the previously applied sunscreen is depleted. A computer-implemented method in the controller may also be configured to recognize when the user is in an elevated UV environment (e.g., outdoors) based on the detected UV sensor data and prompt the user to apply sunscreen to exposed skin regions. Optionally, the controller may have a computer-implemented method that includes steps to map UV and IR data onto image data to form a composite image. Areas with high UV reflectance may be annotated in the image by an outline or pseudo-coloring or shading. For example, UV and IR data may be mapped onto the image of a child, and areas where the UV reflectance is high (i.e., where sunscreen may need to be applied and/or skin regions having an elevated risk of UV exposure) may be outlined and/or shaded and/or colored.
In one variation of a UV-IR spectrometer or sunscreen detector, the illumination system may comprise an UV light source and an IR light source. The UV light source may be a LED that emits light having a peak wavelength or otherwise sufficient intensity in the range of about 290 nm to about 320 nm (e.g., in the UVB range). Applying a specific wavelength of UV light may also help the UV-IR spectrometer to provide an absolute measurement of the amount of UV light that is reflected or absorbed by the target skin surface. Optionally, a UV-IR spectrometer may comprise a UV light source that emits light at two wavelength bands. For example, a UV light source may comprise a first LED that is configured to emit light in the UVB range (e.g., from about 290 nm to about 320 nm) and a second LED that is configured to emit light in the UVA range (e.g., from about 320 nm to about 400 nm). A UV light source capable of emitting light in the UVA and UVA bands separately may allow a user to determine the efficacy of a particular sunblock under different UV light conditions. For example, a user may be able to determine if a particular sunblock and/or level of sunblock coverage blocks UVA light better than it blocks UVB light (or vice versa), or if such sunblock and/or coverage level blocks both bands of UV light approximately equally. The IR light source may be a LED that emits light having a peak wavelength or otherwise sufficient intensity in the range of about 850 nm to about 950 nm. Illumination with IR may help the UV-IR spectrometer to track the presence and/or location of a body part in the field of view. The reflectance of IR light from the target skin helps the sunscreen detector to identify the difference between a well-protected body region in a field of view and no body part in the scanning field (since both scenarios would present with low UV reflectance). A well-protected body region may include a body region that is covered by clothing (e.g., shirt sleeves, scarves, towels, robes, and the like), and/or adequately covered by sunscreen, and in some variations, IR illumination and detection may be used to distinguish between UV protection provided by textiles (e.g., clothing) and sunscreen lotion. The intensity of the UV and IR light sources may be in the range of about 0.001 W/cm2 to about 0.5 W/cm2, about 0.02 W/cm2 to about 0.2 W/cm2, or about 0.2 W/cm2 to about 0.3 W/cm2 for example, at a distance of 5 cm from the sensor system. The intensity of the UV and/or IR sources may be selected to provide a baseline reflectance level in a variety of natural or artificial ambient light conditions, while also generating minimal, if any, risk of skin damage or irritation from one or more of the light sources. In some variations, the UV light source may be pulsed so that UV light exposure risks to the user are reduced or mitigated. For example, the UV light source may be pulsed at duty cycle where the light pulse activated long enough for a measurement to be procured, but is deactivated for the rest of the cycle. For example, the UV light source may be pulsed at a frequency from about 1 Hz to about 1 kHz (e.g., from about 1 Hz to about 10 Hz, from about 10 Hz to about 25 Hz, from about 24 Hz to about 75 Hz, from about 74 Hz to about 100 Hz, from about 100 Hz to about 120 Hz, from about 115 Hz to about 200 Hz, from about 190 Hz to about 400 Hz, from about 350 Hz to about 600 Hz, from about 580 Hz to about 800 Hz, from about 799 Hz to about 1 kHz, etc.) with a duty cycle from about 1% to about 99% (e.g., from about 1% to about 30%, from about 29% to about 50%, from about 49% to about 75%, from about 70% to about 90%, from about 85% to about 99%, from about 1% to about 10%, from about 24% to about 50%, from about 45% to about 70%, from about 60% to about 80%, etc.). The illumination field of the UV light source and the IR light source may be similar or the same, and at least a portion of the illumination fields of the UV and IR light sources overlap. The illumination fields of the UV and IR light sources may be circular, rectangular, or any desired shape, and may have an illumination area from about 0.1 cm2 to about 1500 cm2 when the UV-IR spectrometer is located about 5 cm from the skin. The area of the overlap between the illumination field of the UV light source and the IR light source may from about 0.1 cm2 to about 1500 cm2 when the UV-IR spectrometer is located about 5 cm from the skin, or from about 0.5 cm2 to about 20 cm2 when the UV-IR spectrometer is located about 5 cm from the skin, or from about 1 cm2 to about 15 cm2 when the UV-IR spectrometer is located about 5 cm from the skin.
Optionally, an illumination system may comprise a visible light source that is configured to outline or otherwise indicate to the user the region of the UV and IR illumination fields that overlap. One variation of a UV-IR spectrometer or sunscreen detector 220 with an illumination system 222 comprising a visible light source 223 is depicted in
The UV, IR and visible light sources described above may be pulsed or may provide a continuous illumination during the scan period. For example, the UV and IR light sources may be alternately pulsed (e.g., when the UV light source is activated, the IR light source is not activated and vice versa, pulsed out-of-phase), and/or they may be simultaneously pulsed (e.g., pulsed in-phase). The optional visible light source may be continuously activated or pulsed in-phase or out-of-phase with the UV and/or IR light sources.
One variation of a sensor system may comprise an optic and one or more light sensors configured to detect UV and IR light. The amount of UV and IR light detected by the sensor module may be used to determine whether any sunscreen has been applied to the target skin region, and if any sunscreen has been applied, whether the sunscreen coverage and quantity is sufficient for safe sun exposure. The detected UV and IR light levels may also be used to determine whether the scanned skin region is at risk for UV exposure. The detected UV light indicates how much UV light has been reflected from the target skin region and the detected IR light may confirm the presence of the target skin region, and may also be used to determine how far the UV-IR spectrometer is from the skin. For example, the IR channel may provide data to the controller to compute the proximity of the spectrometer to the target skin region, and optionally, the controller may alert the user as to whether the target skin region is in the range of the UV-IR spectrometer. In some variations, a sensor system may comprise a single light sensor that has one or more filters (e.g., mosaic filters and the like) disposed over the light-sensitive portion of the sensor, which may allow the sensor to simultaneously detect different wavelength light (e.g., UV and IR light, UV, IR and visible light, IR and visible light, UV and visible light, etc.). In other variations, a sensor system may comprise a first UV light sensor, a second IR light sensor, and an optional third visible light sensor. Using multiple, separate LEDs and detectors for IR and UV light may help increase the accuracy of the UV-IR spectrometer, since it may help reduce the cross-talk between the IR and UV channels. A sensor system with relatively fewer components (such as the examples described herein) may have a substantially smaller form factor and may consume less power than a sensor system with more components, and accordingly may be suitable for integration into mobile devices and/or wearable devices.
One example of a sensor module 208 is depicted in
The optic of a sensor system may be configured to define the field-of-view (FOV) of the sensor system, and may have a lens-based or lens-less design. In some variations, the optic may reduce the FOV such that it is smaller than the illumination fields of the UV and IR light sources. The FOV of the sensor system may also be smaller than the area of the overlap between the UV and IR illumination fields. For example, the sensor system FOV may have an area from about from about 0.1 cm2 to about 1500 cm2 when the UV-IR spectrometer is located about 5 cm from the skin, or from about 0.5 cm2 to about 20 cm2 when the UV-IR spectrometer is located about 5 cm from the skin, or from about 1 cm2 to about 15 cm2 when the UV-IR spectrometer is located about 5 cm from the skin. As with the illumination fields of the illumination system, the FOV of the sensor system may have any shape, such as circular, rectangular, or any desired shape. The FOV of the sensor system may include at least a portion of the overlap region between the UV illumination field and the IR illumination field, and in some variations, may substantially encompass the entire overlap region, for example, the FOV may be coincident with at least about 20%, 30%, 40%, 50%, 60%, 70%, 80%, 90% or 100% of the overlap region between the UV illumination field and the IR illumination field. In some variations, the effective FOV of the sensor system may be from about 5 degrees to about 180 degrees, or from about 15 degrees to about 135 degrees, or from about 30 degrees to about 90 degrees. In some variations, the FOV of the sensor system may be coincident with the overlap region, but smaller than the overlap region. Optionally, the FOV of the sensor system may have a similar size and shape to the illumination field of the visible light source. Field-reducing optics may include a fiber-optic faceplate 302 as depicted in
As briefly described above, the amount of IR light reflected from the skin may be used to compute the proximity of the UV-IR spectrometer to the target skin. For example, based on the amount of IR light detected by the sensor system, the controller may be configured to calculate the distance between the UV-IR spectrometer and the target skin, and if the distance is outside of a pre-determined working range of the sensor system, the controller may generate a pointing error alert and notify the user to adjust the position of the spectrometer. In some variations, the controller may use IR depth mapping methods to calculate the distance between the spectrometer and the target skin. For example, if the amount of IR light falls below a first pre-determined threshold and/or the controller calculation indicates that the distance is too far, the controller may alert the user to improper scanning due to the target skin region not being located within the FOV of the UV-IR spectrometer, or the user holding the UV-IR spectrometer too far from the target skin region. If the amount of IR light is above a second pre-determined threshold and/or the controller calculation indicates that the distance is too close, the controller may alert the user to improper scanning due to the user holding the spectrometer too close to the target skin region. The controller may also calculate the change in the distance over time (e.g., over the duration of the scan), and if the distance fluctuates beyond a certain threshold, the controller may also generate an alert to the user. These cues may help a user to position the UV-IR spectrometer such that the distance from the spectrometer to the target skin region is within the working range of the spectrometer, and/or to help the user position the spectrometer at a relatively consistent and/or constant distance away from the skin region during the scan.
The UV and IR light data collected by the sensor system may be communicated to the controller, which has one or more computer-implemented methods that interpret the data and provides instructions to the user based on the analyzed data. The controller may also have one or more calibration protocols, which will be described below. One example of a computer-implemented method that may be stored and executed in the non-transitory computer-readable media of a controller is functionally represented in Table 1 and depicted in
Optionally, the controller may have a plurality of UV and/or IR light thresholds, and may provide a different set of notifications and indications based on each of the thresholds. For example, a controller may have a computer-implemented method stored in non-transitory computer-readable media that has two or more UV light thresholds or levels, where each UV light threshold represents a different degree of UV light protection or risk level. As previously described, these UV light thresholds may be determined by user-input and/or computed by the controller based on data collected during a calibration protocol. In some variations, the controller may recommend applying sunscreen lotions of varying SPF values based on whether the measured UV light levels exceed certain of these UV light thresholds. For example, a computer-implemented method may three UV light thresholds: low, medium and high. If a measured UV light level is at or above the high threshold, the controller may generate a notification to the user that recommends the use of sunscreen lotion having an SPF value of 45 or more. If a measured UV light level is at or above the medium threshold but below the high threshold, the controller may generate a notification to the user that recommends the use of sunscreen lotion having an SPF value of 30 or more. If a measured UV light level is at or above the low threshold but below the medium threshold, the controller may generate a notification to the user that recommends the use of sunscreen lotion having an SPF value of 15 or more. Optionally, a computer-implemented method may also include steps that include a plurality of IR light thresholds.
The controller of a UV-IR spectrometer or sunscreen detector may be programmed with a calibration sequence or protocol that may be automatically initiated when the detector is powered on, or may be initiated as desired by a user. For example, the calibration sequence may be initiated based on user command when the user moves from an indoor space to an outdoor space (or any circumstance that results in changes in ambient light levels), and/or when the detector is used to scan different users, and/or when different body parts are to be scanned. Calibrating the UV-IR spectrometer under these circumstances may help the controller to account for the different reflective properties of different parts of the body, skin variability affecting UV absorption (e.g., pigment/melanin content, moisture content, sweat content, etc.). A calibration sequence may comprise steps to be completed by the user (e.g., a manual calibration protocol where some or all of the steps require user participation) and/or may comprise steps executed by the UV-IR spectrometer (e.g., a self-calibrating calibration protocol where some or all of the steps are executed by the controller). Alternatively, a calibration protocol may not require the user to take any steps beyond initiating the calibration protocol. Examples of calibration protocols that comprise user executed and/or controller executed steps are described below.
In some variations, a calibration protocol may comprise the steps depicted in
Some variations may have a self-calibrating protocol. A self-calibrating protocol may allow the UV-IR spectrometer of the portable or wearable device to be used with different people without the person manually performing calibration steps. In addition to the light measurements that are acquired and stored during the calibration protocols described above, a calibration protocol may also prompt the user for information that may be used for identification and/or adjusting light threshold values and/or formulating recommendations on when to apply sunscreen and how much. For example, the calibration protocol may query the user regarding skin type, SPF of sunscreen to be used, age, gender, anticipated sun exposure time, etc. In some variations, such data may also be used to help select or adjust UV and IR thresholds used in the scan protocol described and depicted in
Although the data collected during the calibration protocols described above may be used for analyzing scan data, the data may also be used for assessing the skin of a user. For example, the calibration protocols may be used to measure the intrinsic ability of the skin to absorb or reflect UV light, and may be used to compute the melanin levels in, or the UV sensitivity of the user's skin. In addition to the calibration steps described above, some skin assessment protocols may also include steps to determine the susceptibility of skin to the effects of UV light. “Tolerance” to UV light may be a measure of the skin's intrinsic ability to scatter and/or reflect and/or absorb UV light, and may vary from individual to individual. In some variations, a skin assessment protocol may comprise keeping the UV-IR spectrometer or sunscreen detector at a set distance away from the target skin, and then incrementing the amount of UV light applied by the spectrometer to the skin and measuring how much UV light is reflected to the detector. Such data may be used to compute a user's UV sensitivity factor, which may then in turn affect the analysis of future scan data acquired by the spectrometer. The UV sensitivity factor may be, for example, calibrated with respect to the Fitzpatrick scale. This factor, in combination with other characteristics of the user's skin, may be included in a computer-implemented method that determines whether the user has sufficient sun protection and/or whether sunscreen should be applied. These calibration protocols may be repeated over a period of time and allow the spectrometer to track and gradual changes in the user's skin. For example, a sudden increase in skin melanin levels and an accompanying increase in detected IR light levels may indicate that the user has been subject to excessive UV exposure. The spectrometer may alert the user of this condition and encourage the user to modify their behavior to help prevent the onset of sunburn, and/or reduce the severity of sunburn.
The UV and IR light data acquired during one or more calibration procedures and/or scan procedures, along with the user skin characteristics may be transmitted to the controller of the mobile and/or wearable device with which the UV-IR spectrometer is integrated. The controller may store this data in non-transitory computer-readable media (“memory”). Optionally, this data may be accessible to other applications and computer-implemented methods stored on the memory. The accessibility of this data to other computer-implemented methods may be determined by privacy preferences set by the user. The computer-implemented methods may be generated by the manufacturer of the mobile and/or wearable device, or may be generated by a third-party entity. In some variations, the computer-implemented methods may be created by a developer using an app toolkit.
The UV-IR spectrometer or sunscreen detector may be integrated into a mobile or wearable device, such as any of the portable or wearable devices described above, or may be in a separate module that is releasable attached to a mobile or wearable device, such as any of the portable or wearable devices described above. For example, a UV-IR spectrometer may be built into the housing or body of a camera phone (e.g., a smart phone), and the location of the UV-IR spectrometer may be such that the illumination system and the sensor system are located next to the camera of the phone. In some variations, the UV-IR spectrometer may not have a UV light source, and may be configured to measure UV light from the sun that is reflected off the target skin region. The controller for the UV-IR spectrometer may also be in communication with the phone camera, and in conjunction with the phone controller, generate a composite image of the target body region with the measured UV light levels. In some variations, a composite image of the target body region may include indicia that outline the FOV of the sensor system. This composite image may be displayed to a user in real-time, which may help the user to point the UV-IR spectrometer at the desired target skin region by moving the mobile device so that the target skin region so that it is within the outline of the FOV of the sensor system. In this variation, the UV-IR spectrometer need not be moved across the target skin region during a scan sequence. Optionally, the composite image may comprise arrows that instruct the user to move the mobile device with UV-IR spectrometer in a particular direction, and/or provide feedback about the scan speed. Such composite image may be derived from either or both the forward-facing camera of the phone (e.g., to acquire images of the arms, legs, face) and the back-facing camera of the phone (e.g., to acquire images of the back). The composite image may be displayed on the phone, or may be streamed to a wearable device, e.g., a wristband or watch, for viewing by the user. In some variations, the controller may have an edge recognition algorithm that identifies edges in a visual scene captured by the camera, and may then advise the user to move the UV-IR spectrometer away from that edge so that the FOV of the sensor system is directed over the target skin region.
In some variations, the composite image may comprise a 2-D map of the target body part showing regions or spots where not enough sunscreen has been applied. The composite image may comprise a still photo, over which real-time measured UV data is overlaid. Areas of the still photo for which UV light data has been acquired may be outlined, and the magnitude of the UV light data may be represented by a fill color or pattern within the outline. The fill color or pattern may be a color scale and/or variable-intensity map, and/or a variable-density pattern map. For example, the color scale may be such that areas with adequate UV light protection may be green while areas with inadequate protection may be red, with intermediate levels of protection spectrally represented by colors between red and green. The variable-intensity map may be monochromatic, and regions having adequate UV light protection may be represented with a saturated (e.g., black, or dark) shaded region, while regions with inadequate protection may be represented with a much less saturated or white shaded region. The variable-density pattern map (patterns may include hashes, slashes, cross-hatches, dots, speckles, etc.) may represent areas of adequate coverage with high-density patterns, and areas of inadequate coverage with low-density patterns. Alternatively or additionally, the composite image may have a toggle between a first viewing mode that displays the measured UV light data, and a second viewing mode that displays where the user should apply sunscreen. For example, in the first view, the still photo may have a plurality of shaded areas with varying degrees of saturation that reflects the amount of detected UV light, and in the second view, only areas where sunscreen application is required is shaded (i.e., areas that are adequately protect from UV light are not shaded in this second view).
In some variations, the UV-IR spectrometer may be located within the body of a band or wrist-worn device (e.g., a fitness tracker and/or a watch). The band or wrist-worn device may not have a native camera unit. For example, a UV-IR spectrometer may be integrated with a watch and enclosed in the housing of the watch body, or it may be located within the wrist band. The UV-IR spectrometer may be any of the spectrometers or detectors described herein. In some variations, a. UV-fit spectrometer located in a watch or on a wrist band may comprise a visible light source (e.g., an LED) as described above, which may help to guide the user as the spectrometer is scanned over a target skin region. The illumination field of the visible light source may coincide with the overlap of the illumination field of the UV light source, and/or infrared light source, and/or FOV of the sensor system. As the visible light shines on a particular skin region, the controller of the UV-IR spectrometer outputs a visual indication to the watch that conveys to the user whether sufficient sunscreen was applied to the illuminated skin region. In some variations, the UV-IR spectrometer may generate a status sound or beep as it is moved across the target body region, which the pitch or frequency of the sound may vary according to the amount of UV light that is absorbed or reflected at a particular location. Alternatively or additionally, the UV-IR spectrometer may have one or more indicator lights that may change color or pulse frequency according to the amount of UV light detected by the sensor. The indicator lights may be LEDs located on an external surface of the UV-IR spectrometer that is visible to a user, and/or the indicator lights may be displayed on the display of the wearable device.
A user may utilize the UV-IR spectrometer or sunscreen detector before, during, and/or after exposure to the sun. UV and/or IR data acquired prior to sun exposure may be used to calibrate the UV-IR spectrometer, and/or may also be used in a computer-implemented method to generate recommendations to the user regarding the SPF, quantity, and application frequency of sunscreen. Scanning the skin during sun exposure may allow a user to determine whether the ability of their sunscreen to protect against UV rays has been depleted, and accordingly, the UV-IR spectrometer may advise the user to re-apply sunscreen. Scanning the skin during sun exposure may also inform a user as to the efficacy of one sunscreen as compared to another. After sun exposure, a user may scan their skin in order to gauge whether they have been exposed to excessive UV rays. Post-exposure scans may also advise a user of early phase or onset of sunburn, so that the user may take early action to treat the symptoms of sunburn.
One example of a method of using any of the UV-IR spectrometers or sunscreen detectors described herein to scan a user's skin is depicted in the flow diagram of
Scan steps in the method depicted in
Although the variations herein have been described in relation to certain examples, various additional variations and alterations to the described examples are contemplated within the scope of the invention. Thus, no part of the foregoing description should be interpreted to limit the scope of the invention as set forth in the following claims. For all of the variations described above, the steps of the methods need not be performed sequentially. The foregoing description, for purpose of explanation, has been described with reference to specific variations. However, the illustrative discussions above are not intended to be exhaustive or to limit the invention to the precise forms disclosed. Many modifications and variations are possible in view of the above teachings. The variations were chosen and described in order to best explain the principles of the techniques and their practical applications. Others skilled in the art are thereby enabled to best utilize the techniques and various variations with various modifications as are suited to the particular use contemplated.
Although the disclosure and examples have been fully described with reference to the accompanying drawings, it is to be noted that various changes and modifications will become apparent to those skilled in the art. Such changes and modifications are to be understood as being included within the scope of the disclosure and examples as defined by the claims.
In some variations, the technologies described above may include the acquisition of information from a variety of sources, which may or may not include personalized information that may identify some aspect of the user, or which could be used with additional information to uniquely identify the user or some aspect of user behavior. This information may include, for example, email addresses, phone numbers, physical addresses, demographic data, search history, location information, biometric information, health information, and other user-related information.
In certain embodiments described herein, the use of personalized or user-related information may be used to provide certain functionality or other useful features to the users. This may include providing content to the user that is tailored or targeted at subject matter that may be greater interest, based upon location or search history, for example. Thus, in some variations, the personalized or user-related information may be utilized to determine or adjust the nature or scope of content provided to the user, in addition to other user benefits as contemplated in view of the above.
In the various embodiments described herein, the use and/or control of the personalized or user-related information, including but not limited to biometric data and health information, will managed or handled in accordance to well-established user privacy policies and practices of the appropriate jurisdictions. This includes the receipt, transmission, storage, analysis, aggregation and disclosure of such information. The management of this information by the appropriate entities will be in accordance with privacy policies and practices that are generally known to comply with or exceed the established policies and practices, as recognized for the relevant industry or government requirements for data privacy and data security. For example, personalized information from users may be collected for reasonable and permitted uses and may not be shared or sold outside of such uses. Also, the receipt, storage and use of such information will occur only after receiving the informed consent of the users. The procedures for securing and safeguard the personalized user information will be implemented so that others accessing the information will also comply with the data privacy and security policies and practices. The access and use of such information will be such that adherence to well-known privacy policies and practices may be determined or certified by third parties.
In view of the above, in some embodiments, one or more uses may selectively limit or restrict the use of certain personalized information and biometric for related product features or services. This may occur through hardware and/or software controls provided to the user. In one example, the user may selectively turn on or turn off location information that may be used to provide user-specific content. In a further example, the user is able to selectively set the degree of precision or detail in the information collected, e.g. the general location via wireless connectivity points selectable by the user, or by zip code or city, for example. In another example, in the delivery of advertising content to a user, the various embodiments may be configured to permit the user to opt-out or opt-in to the collection of user information, either during the initial registration of the product, or at others times via a control setting.
In still other examples, the user may be prompted to enter manual location information or other information to provide targeted content delivery, while in other examples, it is contemplated that the various product features and services may be also provided without the need or use of personalized user information. Thus, where no personalized user information is provided or permitted for use, the content may be provided generically, or otherwise determined or derived based upon non-personal, generic or publicly available information, without rendering that feature or service unavailable to the user.
A sunscreen detector is disclosed. In some examples, the sunscreen detector can comprise: an illumination system configured to emit UV light, included in a UV illumination field, and IR light, included in an IR illumination field; a sensor system, the sensor system configured to: detect at least a portion of the UV light and the IR light at a sensor field located within the UV illumination field and the IR illumination field, generate a UV signal associated with the detected UV light, and generate an IR signal associated with the detected IR light; and a controller configured to: receive the UV signal and the IR signal from the sensor system, compare the UV signal to a UV threshold, compare the IR signal to an IR threshold, and output a first output signal when the IR signal is above the IR threshold and the UV signal is below the UV threshold. Additionally or alternatively, in some examples, wherein the sensor system comprises an optic to limit the sensor field. Additionally or alternatively, in some examples, the sensor field has an area in the range of 0.1 to 1500 cm2 at a distance of 5 cm from the sensor system. Additionally or alternatively, in some examples, the sensor field has an area in the range of 5 to 20 cm2 at a distance of 5 cm from the sensor system. Additionally or alternatively, in some examples, the controller is further configured to: overlay a graphic corresponding to the sensor field onto a camera image, and output a second output signal when the IR signal is above the IR threshold and the UV signal is above the UV threshold, wherein the graphic is a second graphic corresponding to the second output signal. Additionally or alternatively, in some examples, the controller is further configured to: overlay a graphic corresponding to the sensor field onto a camera image, and output a third output signal when the IR signal is below the IR threshold, wherein the graphic is a third graphic corresponding to the third output signal. Additionally or alternatively, in some examples, the illumination system is further configured to emit visible light. Additionally or alternatively, in some examples, further comprising a distance sensor system configured to detect a distance of an object in the sensor field from the distance sensor system.
A method for detecting sunscreen coverage is disclosed. The method can comprise: positioning a detector over a target skin region; moving the detector across the target skin region; emitting UV light and IR light; detecting at least a portion of the emitted UV light and the emitted IR light at a sensor field located within a UV illumination field and an IR illumination field; generating a UV signal indicative of the detected UV light; generating an IR signal indicative of the detected IR light; receiving the UV signal and the IR signal from the sensor system; comparing the IR signal to an IR threshold value; comparing the UV signal to a UV threshold value; outputting an output signal based on the comparisons; and generating an alert based on the output signal. Additionally or alternatively, in some examples, the method further comprises: displaying the alert, the alert including an instruction to apply sunscreen over the target skin region, when the IR signal is above the IR threshold and the UV signal is above the UV threshold value. Additionally or alternatively, in some examples, the method further comprises: acquiring an image that includes the target skin region; and displaying a composite image that comprises a graphic of the sensor field overlaid over the image. Additionally or alternatively, in some examples, the output signal includes an indication that the target skin region has sufficient sunscreen coverage when the IR signal is above the IR threshold and the UV signal is below the UV threshold. Additionally or alternatively, in some examples, the output signal includes an indication that the target skin region is to be re-measured when the IR signal is below the IR threshold. Additionally or alternatively, in some examples, the method further comprising: emitting visible light towards the target skin region to guide the moving of the detector. Additionally or alternatively, in some examples, the method further comprising: calibrating the detector, the calibration comprising: scanning a skin region that has no sunscreen to acquire a baseline UV light measurement and a baseline IR light measurement; and scanning a reflective surface to acquire a reference UV light measurement and a reference IR light measurement. Additionally or alternatively, in some examples, the method further comprises: calibrating the detector, the calibration comprising: placing the detector against a skin region that has no sunscreen, acquiring a first measurement comprising a UV light level and an IR light level, pulling the detector away from the skin region, acquiring a plurality of measurements while pulling the detector away from the skin region, each of the plurality of measurements comprising a UV light level, an IR light level, and a distance between the detector and the skin region; and calculating the UV threshold and the IR threshold based on the plurality of measurements. Additionally or alternatively, in some examples, the detector is pulled back over a distance of about 1 in to about 18 in. Additionally or alternatively, in some examples, the controller is configured to determine melanin levels in the skin region based on the plurality of measurements. Additionally or alternatively, in some examples, calculating the UV threshold and IR threshold comprises calculating a ratio of the UV light level of each of the plurality of measurements to the UV light level of the first measurement. Additionally or alternatively, in some examples, the method further comprises determining one or more of a presence and location of the target skin region based on the IR signal.
This application is a continuation of U.S. application Ser. No, 15/271,002 filed Sep. 20, 2016, which claims benefit of U.S. Provisional Patent Application Ser. No. 62/233,133 filed Sep. 25, 2015, the entire disclosures of which are incorporated herein by reference for all purposes.
| Number | Date | Country | |
|---|---|---|---|
| 62233133 | Sep 2015 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15271002 | Sep 2016 | US |
| Child | 15845937 | US |
