This disclosure relates generally to the field of use of mobile devices for situational awareness applications, such as ultra-violet (UV) radiation sensing. Specifically, the disclosure relates to UV sensing components integrated with mobile devices.
UV radiation sensing has various applications in diverse fields, such as health monitoring and healthcare, forensic sciences, security and authentication, environmental hazard detection and/or purification, antique evaluation and restoration etc. In imaging applications UV wavelengths let surface artifacts appear in greater clarity, and allow visualization of smaller features than those which can be seen using visible light. In case of health monitoring and care, it is well known that while a moderate amount of UV exposure is beneficial, as UV radiation helps in production of vitamin D, melanin etc., overexposure to UV radiation can potentially cause health problems, starting from erythema (redness of skin, indicating skin damage) to severe health hazards, such as skin cancer, genetic mutations etc. Medical data shows that skin cancer caused by UV from sunlight is one of the most prevalent forms of cancer in the United States and worldwide. Therefore, there is a clear need for UV exposure meters.
Various commercial UV sensors are available currently. A popular form of UV exposure meter comprises sensors mounted on wearable accessories, such as wrist/arm bands, watches, belts, jewelry, clothing etc. UV sensors may comprise photodiodes, photocathodes, and/or photomultipliers. Each sensor may measure a portion of the UV spectrum such as UVA, UVB, or UVC, or some combination of them. Sensor readings from multiple sensors may be fused to mimic the erythema action curve, or detect when they are greater than the minimum erythema dose. The UV sensor may have a Teflon diffuser to emulate the ideal cosine response expected when human skin is exposed to UV radiation at various angles of incidence. Some examples of these sensor configurations can be found in an article, titled, “Sundroid: Solar Radiation Awareness with Smartphones,” by Fahrni et al., presented in UbiComp, 2011 conference, which is incorporated herein by reference. Smartphone/mobile device accessories, such as, add-on device jackets with UV sensors, have also been introduced recently. These accessories communicate UV measurement data to mobile devices like smartphones, tablets, notebooks, laptops etc. for further processing of data, displaying the results to the user, and/or receiving user input or input from other devices.
The state-of-the-art UV sensors are typically not integrated well into the internal circuitry of the mobile devices like smartphones, tablets etc. However, there are smartphone/tablet applications (“apps”) providing access to wide-area UV data maintained by government organizations (such as the Environmental Protection Agency (EPA)). These data are obtained from large scale fixed UV sensors deployed for agricultural sector and/or weather prediction which may also be broadcast via public media. While this solution is useful, it has certain drawbacks. Because the sensors are non-local, if the user is unable to access the internet, data related to personal safety (such as data indicating UV overexposure) will not be accessible. This is a fundamental limitation of non-local sensors. Furthermore, it is difficult to have real-time, accurate local UV measurement data with non-local sensors. In other words, as information is not local in nature, and specifically does not relate to the user of the mobile device, any “alert” that is generated would have to be generic and may not relate to the actual UV radiation user is exposed to.
As mobile devices like smartphones become the device of choice not just for communications and data consumption, but also for photography and health and fitness monitoring, it makes sense to integrate local sensors or cameras for detection of UV radiation into the mobile devices. Some existing references, such as U.S. Pat. No. 7,526,280, entitled “Service implementing method and apparatus based on an ultraviolet index in a mobile terminal,” focus on using smartphones for UV detection service, but do not provide any detail of how the mobile device physically integrates the sensing mechanism with other system components.
In the description that follows, like components have been given the same reference numerals, regardless of whether they are shown in different embodiments. To illustrate an embodiment(s) of the present disclosure in a clear and concise manner, the drawings may not necessarily be to scale and certain features may be shown in somewhat schematic form. Features that are described and/or illustrated with respect to one embodiment may be used in the same way or in a similar way in one or more other embodiments and/or in combination with or instead of the features of the other embodiments.
In accordance with various embodiments of this disclosure, what is proposed is an electronic device and system for UV radiation detection and processing. UV sensing can be used in various applications, including security, forensics, lighting (e.g., fluorescent lamps), therapy (e.g., photochemotherapy, phototherapy), pest control, pet care (e.g., aquarium light), scientific analysis of materials (e.g., spectrophotometry; chemical marker), environmental purification, sanitary compliance, electronic manufacturing (e.g., photolithography, epoxy curing, manufacturing UV solar cells), food processing, safety detection (e.g., fire detection), non-destructive testing and re-use of components (e.g., erasing current data from non-volatile memory). The present detailed description section discloses integration of UV sensors in smartphones or other similar portable electronic devices (such as, personal digital assistant, electronic book reader, laptop computer, notebook computer, smart cameras, personal multimedia players, personal entertainment consoles etc.). Since these devices are carried by users for communication, entertainment, computing, information gathering, electronic transaction or other purposes anyway, additional functional integration, such as UV sensing to the existing electronic devices makes sense as an alternative to having to carry a separate gadget only for UV-sensing. By way of example, the present patent application describes how portable electronic devices with integrated UV sensor measure UV radiation to mitigate overexposure risks, which may include aesthetic and/or health issues, such as blemishes, skin damages, skin cancer etc.
As described in the background section, publicly available UV measurement data can be accessed by communicating with a remote server (such as EPA server). However, compared to the delayed, averaged, wide area measurement data obtained from public resources, data obtained from local sensors integrated with mobile devices are likely to be much more accurate and faster.
Placement of the sensor on the mobile device is not a trivial task as the sensor must be sufficiently exposed to sunlight for UV sensing. The mobile device itself may be carried in a pocket, purse, or be otherwise partially occluded. Therefore sensors need to be placed to enhance the possibility of collecting at least some amount of sunlight even when the mobile device is not held in the most advantageous position for UV sensing. Angle of incidence of sunlight is another vital factor in sensing. Sensitivity to angle of incidence of direct sunlight onto the sensor has been characterized in literature, such as the Sundroid article by Fahrni et al, mentioned in the “background” section. In a typical scenario, total UV exposure is a sum of direct sunlight UV and reflections from the local environment. Ideally, the UV sensor needs to receive direct and reflected sunlight irrespective of the position or orientation of the device. Especially in a configuration, where sensor is placed locally rather than distributed on the body of the mobile device, sensor positioning in conjunction with special light capturing lenses, such as wide angle, spherical or rotatable lenses (as will be elaborated further below) becomes important. The light capturing lenses may be specifically tailored for UV spectrum.
The present application discloses device and system embodiments that address mobile device integration considerations for various categories of UV sensors, including cameras, photodiodes, and chemical sensors. The UV sensors may use the functionalities of the existing in-built sensors in conventional mobile devices, and/or integrate additional components specific to UV sensing.
These and other features and characteristics, as well as the methods of operation and functions of the related elements of structure and the combination of parts and economies of manufacture, will become more apparent upon consideration of the following description and the appended claims with reference to the accompanying drawings, all of which form a part of this specification, wherein like reference numerals designate corresponding parts in the various figures. It is to be expressly understood, however, that the drawings are for the purpose of illustration and description only and are not intended as a definition of the limits of claims. As used in the specification and in the claims, the singular form of “a”, “an”, and “the” include plural referents unless the context clearly dictates otherwise.
In an aspect of the present disclosure, built-in existing sensors in the mobile devices can be used to detect UV radiation from sunlight. Some high-end mobile devices already have sensors for wavelength bands beyond the visible light band to enhance the situational awareness functionality of smart mobile devices. For example, infra-red sensors (IR sensors) may be integrated with mobile devices as a proximity sensor. However, for integrating UV sensors into smart mobile devices, some special considerations need to be addressed.
If the UV sensors are to be housed inside enclosures, the enclosures or at least a portion thereof must be transparent at critical UVA, UVB, UVC wavelength bands that can potentially cause harm. Non-limiting examples of transparent glasses include quartz or silica glass. Non-limiting examples of transparent plastics include pure Plexiglass (“PMMA”, poly-methyl-meth-acrylate), Poly-ethylene, DuPont's Teflon™, wax-paper, mineral oil trapped between multiple sheets of plastic, etc. A UV camera to be integrated with smart mobile device need to use UV transparent quartz lens, as regular glass blocks most of the harmful UV radiation.
To match the generated response to a reference curve, an appropriate diffuser (such as a Teflon diffuser) may be incorporated into the design of the component 106. In other words, the bandpass optical component 106 may have a UV filter and a diffuser. For example, the generated response of the component 106 can be correlated with the sensitivity of known erythema action curve (such as described in U.S. Pat. No. 6,426,503) that simulates the critical exposure levels that affect human skin, when an appropriate diffuser is included in the component 106. Persons skilled in the art would understand that though erythema response is used as an illustrative case of target response, other types of targeted responses may also be obtained based on the sensor components and calibration.
To elaborate on the calibration of data to follow a certain response, it is to be understood that the cosine angular sensitivity of detected UV radiation refers to skin absorption. If N number of rays of incident waves with intensity Ei (i=1, 2, . . . , N) and incident angles of ai fall on the skin, the total skin absorption is given by: E=Σ Ei cos ai. A photodiode may be integrated with the camera as a UV sensor. However, since a photodiode current doesn't follow this cosine response, a cosine diffuser needs to be used in front of the sensor to calibrate the measurement. A diffuser by nature is not transparent and cannot be put in front of a camera while capturing images, because image will be blurred as well. Therefore, a diffuser included in the component 106 can slide in front of the camera when required, and can be removed when the camera is capturing images.
Rather than using the UV bandpass optical component 106 while capturing sunlight, the UV filtering can be done at a later stage during electronic/optoelectronic post-processing. Removing the need for an external optical component increases light capturing efficiency of a regular camera lens.
In an embodiment, an on/off switch may control whether a physical UV filtering optical filter and/or a diffuser should be used to send only UV light for UV-specific data processing, calibration, or, whether the spectral separation would be carried out in a later digital post-processing stage in a UV processing module.
In some embodiments, instead of using a rotating camera, a spherical camera may be used to avoid moving parts. Non-limiting examples of spherical cameras include cameras offered by PointGrey Research Inc., which can procure image data for more than 80% of a 360 degree spherical field of view with appropriate software for data processing.
UV processing circuit 332 may have an analog filter 322, a digitizer module 324 that converts the filtered analog signal to digital signal, and an UV bandpass filter 326, that separates UV data from the rest of the spectral components captured by the camera 304 to extract UV measurement raw data 330. The raw data 330 is then processed further, and UV exposure level is determined by comparing with known data. Appropriate graphical indications may be presented to the user to make him/her aware whether the UV radiation level is safe, unsafe, or reaching towards an unsafe threshold.
Persons skilled in the will appreciate in view of the present disclosure that an important aspect regarding UV exposure may not just be the exposure to current/instantaneous UV radiation levels, but an overall (integrative) radiation level over a specific temporal window, and the processing circuit in
For maximum angular exposure, the UV sensors should be integrated at the edges or sides of the device.
In the example embodiment shown in
In other embodiments, the photodiodes may be integrated with other components of the phone close to the surface, such as an RF antenna or touchscreen, which are disposed on or near the external surface of a mobile device. For example, in
In addition to or instead of placing the photodiodes along the external surface of a mobile device, photodiode sensors may be integrated with a core system-on-chip (SoC) included in the internal circuitry of the mobile device. Placing photodiodes only on the SoC may be an economic solution, because standard semiconductor manufacturing techniques may be used to integrate the photodiodes with the SoC, though it may pose constraints on design of the housing, because the SoC needs to be aligned to an UV transparent window, or internal optical components may be necessary to direct light onto the photodiode integrated with the SoC. Also footprint of the SoC itself may become larger. Integration of the sensor in the SoC would require the die to be enclosed in a UV transparent package. In an embodiment, a cosine diffusing material may be used for the package itself, and/or or a window on the package.
In some embodiments, the SoC may be part of a core processing or computing unit of UV-sensing-enabled mobile electronic device 102, and is configured to receive and process input data and instructions, provide output and/or control other components of device 102 in accordance with embodiments of the present disclosure. Such a SoC is referred to as core SoC, examples of which are shown in
As understood by persons skilled in the art, the UV data processing functionality can be easily integrated with the computational and storage (memory) elements already existing in a smart mobile device. The memory of UV-sensing-enabled electronic device 102 may be a dynamic storage device coupled to the bus infrastructure and configured to store information, instructions, and programs, to be executed by processors of the SoC and/or other processors (or controllers) associated with device 102. It is to be noted that on-board DRAM memory integrated as System In Package (SIP) with the core SoC is typical in mobile devices, in contrast to existing PC architecture. Device 102 may also include read only memory (ROM) and/or other static storage devices coupled to the bus infrastructure and configured to store static information and instructions for processors of SoC and/or other processors (or controllers) associated with device 102.
While the above discussed embodiments focused on collection of UV light and processing of UV data using discrete UV sensors (e.g., modified cameras or photodiodes), another type of distributed UV sensor is envisioned by the present disclosure based on UV sensitive chemical sensors. This aspect of the disclosure is particularly suited for providing a clear visual indication of UV exposure level. Chemical sensor based mobile UV detection may be implemented by coating the housing of a mobile device with UV sensitive chemicals that change color prominently in response to UV absorption. As shown in
Persons skilled in the art will appreciate that the quantified results may be presented in graphical form (e.g., color bars/histograms etc. with or without numerical data) in a user-friendly manner. For example, overexposure may be indicated as ‘red’, when safe exposure may be indicated as ‘green’, while intermediate color codes indicating various levels of exposure so that the user may make an informed decision. Also, an audio alert may be built into some embodiments.
For more sophisticated sensing, data processing and information presentation, the UV sensitive housing/jacket may be combined with other UV sensing mechanisms, such as, cameras, UV photodiodes etc., as discussed above in the present disclosure.
It is to be noted that UV detection with smartphones would be most effective when the sensors are exposed to the environment in which the UV radiation is being measured. If a user is indoors, UV detection may not be very essential except for reflected UV. Even when the user himself/herself is outdoors, if the smartphone is inside a pocket, purse or other enclosure, and local measurement by an individual smartphone may not be able to provide accurate data. When an enclosure is detected (for example, by comparing actual readings to what is expected based on the time of day and/or historical data at or near the detected location, or by estimating visible light received) a smartphone may be enabled to find alternative data sources, such as the data from the internet and/or from other UV sensors detected within a local environment. A detachable miniature UV sensing module with Bluetooth connectivity to the smartphone is an example of external UV sensor that can be used for improving UV measurement accuracy when the smartphone itself is occluded. The miniature module may be detached from the smartphone and temporarily mounted on hats, sunglasses, or other wearable items to collect UV data.
It will be rather apparent to those skilled in the art after reading this detailed disclosure that the foregoing detailed disclosure is intended to be presented by way of example only and is not limiting. For example, though the disclosure often mentions health monitoring as the illustrative area of application, UV sensors and associated circuitry discussed herein may be applicable in others areas, including, but not limited to, security, forensics, astronomy, pest control, sanitary compliance, air/water purification, authentication, chemical markers, fire detection, reading illegible papyri and manuscripts, etc. Having local UV radiation measurement/awareness can be utilized as input to build smart buildings, smart cars etc. For example, if excess UV radiation level is detected, ‘smart windows’ in smart buildings and/or smart cars may be activated automatically to improve overall wellness of the occupants. This may be done by activating a UV-absorbing screen/shade.
Some of the applications, such as UV photography, security, forensics, lighting, therapy, pest control, scientific analysis of materials (e.g., spectrophotometry; chemical marker), environmental purification, non-destructive testing etc. may require UV radiation as well as sensing. Though the present disclosure primarily elaborates examples with integrated UV sensors, certain embodiments can include both UV radiation source and UV sensors integrated with the smart mobile devices. Examples of UV radiation sources include UV lamp and/or flash.
A further embodiment may include a localized UV sensor block where the device casing/housing is built in such a way as to funnel the UV radiation to the UV detector/photodiode, for example, by use of optical fiber/micro mirrors, etc.
In one embodiment, it is possible to harvest UV energy to charge the electronic device using a specialized photovoltaic cell/sensor that will simultaneously charge the device battery while indicating UV specific exposure levels. For example, by optically funneling UV energy to an UV specific sensor/cell and the rest of the light energy to a different region of the mobile device containing a photovoltaic cell, a dual voltage charger/sensor may be created. The photovoltaic cell may be used to charge a battery of the mobile device. In an embodiment, standard photovoltaic cells may be interlaced with UV-specific sensors. When it is expected that a user of the mobile device would optimally position the device to capture solar radiation, then both the UV detection feature and solar charging feature would be benefited.
Various alterations, improvements, and modifications of the systems and embodiments may occur and are intended for those skilled in the art, though not expressly stated herein. These alterations, improvements, and modifications are intended to be suggested by this disclosure, and are within the spirit and scope of the exemplary aspects of this disclosure.
Moreover, certain terminology has been used to describe embodiments of the present disclosure. For example, the terms “one embodiment,” “an embodiment,” and/or “some embodiments” mean that a particular feature, structure or characteristic described in connection with the embodiment is included in at least one embodiment of the present disclosure. Therefore, it is emphasized and should be appreciated that two or more references to “an embodiment” or “one embodiment” or “an alternative embodiment” in various portions of this specification are not necessarily all referring to the same embodiment. Furthermore, the particular features, structures or characteristics may be combined as suitable in one or more embodiments of the present disclosure. In addition, the term “logic” is representative of hardware, firmware, software (or any combination thereof) to perform one or more functions. For instance, examples of “hardware” include, but are not limited to, an integrated circuit, a finite state machine, or even combinatorial logic. The integrated circuit may take the form of a processor such as a microprocessor, an application specific integrated circuit, a digital signal processor, a micro-controller, or the like.
Furthermore, the recited order of method, processing elements, or sequences, or the use of numbers, letters, or other designations therefore, is not intended to limit the claimed processes and methods to any order except as can be specified in the claims. Although the above disclosure discusses through various examples what is currently considered to be a variety of useful aspects of the disclosure, it is to be understood that such detail is solely for that purpose, and that the appended claims are not limited to the disclosed aspects, but, on the contrary, are intended to cover modifications and equivalent arrangements that are within the spirit and scope of the disclosed aspects.
Similarly, it should be appreciated that in the foregoing description of embodiments of the present disclosure, various features are sometimes grouped together in a single embodiment, figure, or description thereof for the purpose of streamlining the disclosure aiding in the understanding of one or more of the various inventive aspects. This method of disclosure, however, is not to be interpreted as reflecting an intention that the claimed subject matter requires more features than are expressly recited in each claim. Rather, as the following claims reflect, inventive aspects lie in less than all features of a single foregoing disclosed embodiment. Thus, the appended claims are hereby expressly incorporated into this detailed description.
Number | Name | Date | Kind |
---|---|---|---|
5548661 | Price | Aug 1996 | A |
5927603 | McNabb | Jul 1999 | A |
6426503 | Wuest | Jul 2002 | B1 |
6452188 | Chubb | Sep 2002 | B1 |
7526280 | Jung et al. | Apr 2009 | B2 |
8275413 | Fraden | Sep 2012 | B1 |
8368035 | Seibel | Feb 2013 | B2 |
8760494 | Twede | Jun 2014 | B1 |
9042967 | Dacosta | May 2015 | B2 |
9235733 | Birdwell | Jan 2016 | B2 |
20030134668 | Mekuria | Jul 2003 | A1 |
20040027474 | Aoyama et al. | Feb 2004 | A1 |
20040078219 | Kaylor et al. | Apr 2004 | A1 |
20050275839 | Robinson | Dec 2005 | A1 |
20050288038 | Kim | Dec 2005 | A1 |
20060054782 | Olsen et al. | Mar 2006 | A1 |
20060181776 | Sandhu | Aug 2006 | A1 |
20070004449 | Sham | Jan 2007 | A1 |
20070108389 | Makela et al. | May 2007 | A1 |
20080029708 | Olsen | Feb 2008 | A1 |
20090091621 | Chen | Apr 2009 | A1 |
20110261355 | Hannel et al. | Oct 2011 | A1 |
20120085932 | Themelis | Apr 2012 | A1 |
20120254633 | Vilhauer et al. | Oct 2012 | A1 |
20120267511 | Kozlowski | Oct 2012 | A1 |
20130194459 | Kanemitsu | Aug 2013 | A1 |
20130206962 | Barr et al. | Aug 2013 | A1 |
20130286236 | Mankowski | Oct 2013 | A1 |
20130322711 | Schultz et al. | Dec 2013 | A1 |
20130327671 | Ciurczak | Dec 2013 | A1 |
20140056172 | Lee et al. | Feb 2014 | A1 |
Number | Date | Country |
---|---|---|
2006-349625 | Dec 2006 | JP |
3133260 | Jul 2007 | JP |
10-0722974 | May 2007 | KR |
10-2010-0134926 | Dec 2010 | KR |
Entry |
---|
Machine level English translation of KR20070000259A. |
International Search Report/Written Opinion, mail date Oct. 11, 2013, PCT/ISA/210, PCT/ISA/220, and PCT/ISA/237, total of 13 pages. |
Fahrni et al., Sundroid: Solar Radiation Awareness with Smartphones, UbiComp'11, Sep. 17-21, 2011, total of 10 pages. |
Zenith Transmission Diffusers, Pro-Lite Technology, http://www.pro-lite.co.uk/File/Zenith—Transmission—Diffusers.php, total of 2 pages. |
Ultraviolet, from Wikipedia, the free encyclopedia, http://en.wikipedia.org/wiki/Ultraviolet, total of 30 pages. |
TrendHunter Tech, 14 Sun Safety Accessories, http://www.trendhunter.com/slideshow/sun-safety-accessories, total of 13 pages. |
DoCoMo Goes Crazy with BMI, UV, Breath Analyzer and Radiation Detection Smartphone ‘Jackets’, http://www.mobilemag.com/2011/10/10/docomo-goes-crazy-with-bmi-uv-breath-analyzer-and-radiation-detection-smartphone-jackets, total of 3 pages. |
EPA UV Index, http://www.epa.gov/enviro/mobile, total of one page. |
Libelium, Libelium World, Articles: Sensor Networks to protect people from Ultraviolet Radiation in the summer, Jun. 30, 2010, http://www.libelium.com/libeliumworld/articles/101811811515, total of 5 pages. |
Ultraviolet photography, from Wikipedia, the free encyclopedia, http://en.wikipedia.org/wiki/Ultraviolet—photography, total of 4 pages. |
AnandTech—Apple iPhone 4S: Thoroughly Reviewed, http://www.anandtech.com/show/4971/apple-iphone-45-review-att-verizon/11, total of 8 pages. |
MIT Media Lab, Camera Culture, http://www.media.mit.edu/research/groups/camera-culture, total of 4 pages. |
LAPIS Semiconductor, UV Sensor ML8511, http://www.lapis-semi.com/en/semicon/sensor/m18511.html, total of 3 pages. |
Digitimes Supply Chain Window, DTF 2012 Ultra Mobile & Ecosystem Forum, Developments and trends of optical sensor technology and mobile product applications, http://www.digitimes.com/supply—chain—window/story.asp?datepublish=2012/07/10&pages=VL&seq=202, total of 4 pages. |
Gurunandan Krishnan et al., Towards a True Spherical Camera, SPIE Digital Library, Feb. 16, 2010, http://spiedl.org/terms, SPIE-IS&T/vol. 7240, total of 13 pages. |
CAVE, True Spherical Camera, http://www.cs.columbia,edu/CAVE/projects/sphercam, total of 2 pages. |
UV Penetration and Plastic, Ask a scientist, DOE Office of Science, http://www.newton.dep.anl.gov/askkasci/eng99/eng99272.htm, total of 4 pages. |
Fused quartz, from Wikipedia, the free encyclopedia, http://en.wikipedia.org/wiki/Fused—quartz, total of 6 pages. |
MedGadget, Ultraviolet Dosimeter Wristbands to Help Prevent Overexposure to Sunlight, Aug. 13, 2012, http://www.medgadget.com, total of 6 pages. |
Point Grey 360 Spherical Vision Camera Systems, http://www.ptgrey.com/products/spherical.asp, total of 2 pages. |
Number | Date | Country | |
---|---|---|---|
20140092238 A1 | Apr 2014 | US |