HIGH-ACCURACY TEMPERATURE SCREENING IN DYNAMIC AMBIENT CONDITIONS

Abstract

A system for screening persons' temperatures comprises an imaging device configured to generate imagery data, including infrared image data, of a first scene and a second scene. The system receives imagery data from the first scene, identifies persons in the scene using the imagery data, and determines each person's temperature. The system further compares the persons' temperatures to a threshold and indicates a person should be directed to the second scene if the person's temperature is above a threshold. Subsequently, the system determines and compares the person's temperature in the second scene and provides an indication if the person's temperature exceeds a second threshold. Further, a confidence factor can be associated with determinations of persons' temperatures.

Description

BACKGROUND

Many different thermometers and temperature sensors exist for invasively determining the internal temperatures of persons. Detecting that a person has an elevated internal temperature may help determine whether the person has an infectious disease. Some temperature sensors, such as oral thermometers, must physically contact a person in order to determine their internal temperature. However, infectious diseases may be spread to persons through physical contact or being in close proximity to a person with an infectious disease. Other temperature sensors may be used which do not contact individual persons and may be used to determine temperatures of more than one person at a time. However, such non-contact temperature sensors are often not as accurate as contact temperature sensors at determining the internal temperature of a person.

BRIEF SUMMARY

Systems and methods for non-invasively identifying individuals within a temperature screening area that have internal core temperatures outside of a range of approved temperatures are described herein. During a temperature screening process, individuals may enter the temperature screening area with different subject conditions and from different environments with different ambient conditions. The different environments with different ambient conditions may correspond to environments with different temperatures, humidity, and air flow (e.g., wind or air conditioning). In at least one example, the temperature screening area may comprise a hotel lobby and the different environments with different ambient conditions may include a first environment with a first temperature (e.g., a restaurant adjacent to the hotel lobby) and a second environment with a second temperature less than the first temperature (e.g., a cold-weather outdoor environment adjacent to the hotel lobby). The different subject conditions may correspond to individual-specific conditions such as the presence of facial obstructions (e.g., a face mask, scarf, or long hair covering a portion of an individual's face), the presence of sweat (e.g., sweat on an individual's face due to exercise prior to entering the temperature screening area), and an individual's circumstances with respect to their circadian rhythm or sleep-wake cycle (e.g., how long the individual has been awake). During a temperature screening process, the temperatures of skin surface regions of individuals (e.g., exposed facial regions) may be tracked over time using one or more thermal imaging devices (e.g., a thermal imaging camera) as the individuals are moving within the temperature screening area. The different temperatures of a particular skin surface region (e.g., a cheek region of an individual's face) over time may correspond with a temperature-time sequence (i.e., a temperature-vs-time sequence) for the particular skin surface region. Different temperature-time sequences for different skin surface regions of an individual may be generated as the individual moves around the temperature screening area.

One or more temperature-time sequences for one or more skin surface regions of an individual within the temperature screening area may be used to estimate an internal core temperature for the individual. In at least one example, a first temperature-time sequence for a first facial region (e.g., a forehead region of the individual's face) may be used to extrapolate an asymptotic surface temperature for the first facial region, and an internal core temperature for the individual may be determined by applying a location-dependent temperature offset to the asymptotic surface temperature for the first facial region. In another example, a first temperature-time sequence for a first facial region (e.g., a forehead region of the individual's face) may be used to determine an asymptotic surface temperature for the first facial region and a second temperature-time sequence for a second facial region (e.g., a cheek region of the individual's face) may be used to determine an asymptotic surface temperature for the second facial region. A first estimated internal core temperature for the individual may be determined via application of a first temperature offset to the asymptotic surface temperature for the first facial region and a second estimated internal core temperature for the individual may be determined via application of a second temperature offset to the asymptotic surface temperature for the second facial region. The first temperature offset and the second temperature offset may be acquired from a lookup table or database that stores mappings of temperature offsets for various exposed surface regions of an individual. In at least one embodiment, an internal core temperature for the individual may be calculated by averaging the first estimated internal core temperature and the second estimated internal core temperature. In some cases, in response to detecting that the internal core temperature for the individual is outside of an approved range of temperature values (e.g., has exceeded a maximum internal core temperature), a higher-accuracy temperature screening process may be performed for the individual or an indication that the internal core temperature for the individual has exceeded an approved range of temperature values may be displayed.

One issue that prevents the large-scale deployment of temperature screening processes in environments with dynamic ambient conditions is that accurate non-invasive temperature screenings may require a prohibitive amount of time. For example, performing an accurate temperature screening for individuals entering and moving freely within a hotel lobby may require the individuals to remain within the hotel lobby for at least 15 minutes to equilibrate to the temperature of the hotel lobby. According to some embodiments, the technical benefits of the systems and methods disclosed herein (that is, for non-invasively identifying individuals within a temperature screening area that have elevated internal core temperatures greater than a maximum approved temperature) may include improved temperature screening throughput for a given temperature screening accuracy, improved temperature screening accuracy with a minimal impact on temperature screening throughput, reduced energy consumption when performing temperature screening processes, and/or the ability to manufacture high-accuracy temperature screening systems using lower-cost hardware components (e.g., using a combination of thermal imaging cameras of different price ranges).

BRIEF DESCRIPTION OF THE SEVERAL VIEWS OF THE DRAWINGS

FIG. 1 is an example diagrammatic view of a temperature scanner system according to an aspect of the present disclosure.

FIG. 2 is an example diagrammatic view of another embodiment of a temperature scanner system according to an aspect of the present disclosure.

FIG. 3 is an example conceptual illustration of persons in a first target scene and second target scene as captured by an imaging device according to an aspect of the present disclosure.

FIG. 4 is an example flow diagram of a method of scanning temperatures of persons according to an aspect of the present disclosure.

FIG. 5 is an example flow diagram of another method of scanning temperatures of persons according to an aspect of the present disclosure.

FIG. 6 depicts an embodiment of a computing device in communication with two capture devices, such as two different thermal imaging cameras.

FIG. 7A depicts a flowchart describing an embodiment of a process for identifying individuals that have exposed skin surface temperatures outside of a range of approved temperatures.

FIG. 7B depicts a flowchart describing another embodiment of a process for identifying individuals that have exposed skin surface temperatures outside of a range of approved temperatures.

FIG. 8A shows an example facility having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process.

FIG. 8B shows a temperature screening system with components that can be used to determine a core temperature of a subject or individual.

FIG. 9A shows a process flow diagram for determining a core temperature of a subject accounting for variability in and equilibration process of the subject in an environment.

FIGS. 9B and 9C show example temperature-time data that can be used to determine whether an accurate core temperature of a subject can be determined.

FIGS. 10A and 10B show example facilities having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process.

FIG. 10C shows an example data set that can be used to monitor subjects.

FIG. 10D shows another example facility having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process.

FIGS. 10E and 10F provide example display configurations for monitoring a plurality of subjects at a checkpoint.

FIG. 10G shows a process flow diagram showing a plurality of techniques for determining whether an accurate temperature can be determined.

FIG. 11A depicts an embodiment of temperature-time data sequence corresponding with temperatures of a first facial region of a first individual, a temperature fitting function associated with a forehead region of a person with a first body type, and a temperature fitting function associated with a cheek region of a person with the first body type.

FIG. 11B depicts an embodiment of temperature-time data sequence corresponding with temperatures of a first facial region of a second individual, a temperature fitting function associated with a forehead region of a person with a second body type, and a temperature fitting function associated with a cheek region of a person with the second body type.

FIG. 12A depicts a flowchart describing an embodiment of a process for performing temperature screening of individuals within a dynamic environment.

FIG. 12B depicts a flowchart describing another embodiment of a process for performing temperature screening of individuals within a dynamic environment.

DETAILED DESCRIPTION

Technology described herein improves an automated temperature screening of individuals within a dynamic environment. As individuals enter and move freely within a temperature screening area, individuals with temperature anomalies, such as individuals with estimated internal core temperatures greater than a threshold temperature, may be identified using a temperature screening approach that has both high-throughput and high-accuracy. During a high-throughput screening process, the temperatures of exposed skin surface regions of individuals (e.g., exposed forehead and cheek regions) may be tracked over time as an individual is within the temperature screening area. As an individual may over time turn away from an image capturing device or an obstruction may appear that prevents the image capturing device from capturing an exposed skin surface region of the individual, the high-throughput screening process may continuously monitor and track the exposed skin surface region and then determine and store a temperature for the exposed skin surface region when a sufficient number of pixels for the exposed skin surface region are captured. The image capturing device may include sensors or cameras for capturing thermal images and color images of the exposed skin surface region.

The determined temperatures of one or more exposed skin surface regions of an individual may be used to calculate an internal core temperature for the individual, which may then be compared with an approved range of temperature values in order to determine whether the individual has an internal core temperature that is outside of the approved range of temperature values. In at least one embodiment, a first exposed skin surface region may comprise a forehead region of the individual and a second exposed skin surface region may comprise a cheek region of the individual. Estimates of the internal core temperature for the individual may be computed by applying a first temperature offset to a first temperature of the first exposed skin surface region and applying a second temperature offset to a second temperature of the second exposed skin surface region. The first temperature offset and the second temperature offset may be acquired from a lookup table, for example, based on the locations of the exposed skin surface regions on the individual. In some cases, an average internal core temperature may be computed from the two internal core temperature estimates. In response to detecting that an individual has an internal core temperature that is outside of the approved range of temperature values, a non-invasive higher-accuracy temperature screening process may be performed for the individual.

In some cases, the higher-accuracy temperature screening process may cause an orientation adjustment and/or an optical adjustment (e.g., optically zooming in) to a thermal imaging device such that a field of view of the thermal imaging device captures a targeted exposed skin surface region of the individual, such as an exposed forehead region of the individual. The higher-accuracy temperature screening process may also display information to cause the individual to be moved into a particular screening area or within a particular distance of the thermal imaging device, display information to cause the individual to change an orientation of their body or to look towards the thermal imaging device, and/or display information to cause the individual to remove obstructions to capturing temperature information for the targeted skin surface region (e.g., displaying instructions to remove glasses, face coverings, and ear muffs). The optics of the thermal imaging device may be adjusted such that an image of a facial region of the individual may be captured with at least a minimum number of pixels for the region. As an example, the thermal imaging device may capture an image of the inner canthus region (or an eye tear duct region) of the individual with at least 4×4 pixels covering the inner canthus region of the individual. In at least one embodiment, the minimum number of pixels for the region may be set based on an average walking speed for the individual and/or a distance between the individual and the thermal imaging device.

Some technical benefits of selectively applying the higher-accuracy temperature screening process to individuals that are identified as having an internal core temperature that is outside of an approved range of temperature values include increased temperature screening throughput for a given temperature screening accuracy and increased temperature screening accuracy for a given temperature screening throughput. Temperature screening throughput may refer to the rate at which individuals pass through a temperature screening area within a specified period of time (e.g., a system may perform temperature screening and allow up to thirty individuals to pass through the temperature screening area per minute). Temperature screening accuracy may refer to the proximity of a determined surface temperature to the actual surface temperature. In at least one example, the temperature screening accuracy may be set such that the determined surface temperature using a temperature screening process is within one-half of a degree of the actual surface temperature. In another example, the temperature screening accuracy may be set such that the estimated internal temperature of an individual is within one degree of the actual internal temperature of the individual.

During the high-throughput screening process, a temperature window may be specified corresponding with an approved range of temperature values. The temperature window may correspond with a temperature range that is greater than a low threshold temperature and less than a high threshold temperature. For example, the temperature window may comprise a range of temperatures between 94 degrees Fahrenheit and 101 degrees Fahrenheit. In response to detecting that a surface temperature of an exposed skin surface region (or regions) of an individual is either less than the low threshold temperature (e.g., is less than 94° F.) or greater than the high threshold temperature (e.g., is greater than 101° F.), a high-accuracy temperature screening process may additionally be performed to determine a second surface temperature for the same region (or a smaller portion of the region) of the individual. The high-accuracy temperature screening process may determine the second surface temperature using a high-resolution thermal imaging camera that captures at least a threshold number of pixels for the region of the individual. A thermal image with an increase in the number of pixels for the region of the individual (e.g., an inner canthus of the individual) may determine a surface temperature with improved accuracy. The region of the individual may comprise a facial region (e.g., a portion of the individual's face), a forehead region of the individual, a cheek region of the individual, an ear region of the individual, a neck region of the individual, an inner eye region of the individual, an orbital region of the individual (e.g., a portion of the individual's face around the individual's eyes or between the individual's eyes), or a temporal region of the individual (e.g., a region between an individual's eye and ear), for example.

During the high-throughput screening process, a first image capturing device including a thermal imaging camera or image sensor may determine a surface temperature for a targeted region of an individual. In some embodiments, during the high-accuracy temperature screening process, a second image capturing device including a higher-resolution thermal imaging camera or image sensor may determine a second surface temperature for the targeted region or for a sub-region of the targeted region. The sub-region of the targeted region may comprise a portion of the targeted region. In at least one example, during the high-throughput screening process, a surface temperature for an individual's orbital region may be determined; subsequently, during the high-accuracy temperature screening process, a second surface temperature may be determined for a sub-region or portion of the individual's orbital region, such as an inner canthus, eye tear duct, or a facial region between the individual's eye and nasal bridge. In some cases, the thermal imaging information acquired during the high-throughput screening process may be insufficient to determine a surface temperature for a targeted sub-region of the region. For example, the thermal images captured during the high-throughput screening process may cover the targeted sub-region with only 2×2 pixels, while the thermal images captured during the high-accuracy screening process may cover the targeted sub-region with at least 4×4 pixels.

In some embodiments, during the high-accuracy temperature screening process, an individual may be positioned within a field of view of a thermal imaging device in response to detecting that the surface temperature of an exposed skin surface region exceeds a temperature threshold. The individual may be positioned within the field of view of the thermal imaging device by either moving the individual into the field of view of the thermal imaging device or by adjusting an orientation of the thermal imaging device. In at least one example, out of a set of thermal imaging cameras, the thermal imaging camera that is reoriented may comprise the thermal imaging camera within the set of thermal imaging cameras that is closest to the individual or that has the best view or least obstructed view of the individual's exposed skin surface region (e.g., the reoriented camera may comprise the thermal imaging camera that has the ability to capture the highest number of pixels covering the individual's face or exposed skin surface region). A technical benefit of configuring or reorienting the thermal imaging camera that is closest to the individual or the thermal imaging camera that has the least obstructed view of the individual's face or targeted skin surface region is that temperature information with higher resolution and higher reliability may be obtained.

In some embodiments, during the high-throughput temperature screening process, as the temperatures of exposed skin surface regions of individuals are tracked over time, corresponding temperature measurement confidence values may be determined based on a distance between an individual and a thermal imaging device and/or a walking speed of the individual when temperature information for a skin surface region was captured. Temperature information for various regions of an individual and corresponding temperature measurement confidence values may be updated over time as the individual moves around the temperature screening area. The resolution and reliability of temperature information may be improved when the individual is closer to a thermal imaging device and when the individual is moving at a slower rate within the temperature screening area. A technical benefit of storing temperature measurement confidence values along with the temperature information for tracked regions of an individual is that the accuracy and reliability of the temperature screening may be increased. In some cases, the temperature threshold for determining whether an individual has an elevated internal core temperature may be adjusted based on the temperature measurement confidence values. For example, if the temperature measurement confidence value for a first surface temperature of an exposed skin surface region of an individual is less than a threshold confidence value (e.g., is less than 0.7), then the maximum approved temperature within the temperature window may be reduced by one degree. The high-throughput temperature screening process may perform region detection and tracking for individuals within the temperature screening area and determine a temperature measurement confidence factor for each region based on the distance to the individual, the direction they are looking, the walking speed of the individual, and the presence of facial obstructions (e.g., glasses).

In some embodiments, the amount of time to perform an accurate temperature screening of individuals within a dynamic environment may be reduced by tracking one or more skin surface regions of the individuals and extrapolating asymptotic surface temperatures for the one or more skin surface regions of the individuals before the one or more skin surface regions actually reach their asymptotic surface temperatures. The dynamic environment may comprise a temperature screening area (e.g., a hotel lobby or an entrance to grocery store). In some cases, the temperatures of the one or more skin surface regions of the individuals (e.g., orbital regions and temporal regions of a person's face) within the dynamic environment may be tracked over time using one or more thermal imaging devices (e.g., a thermal imaging camera) as the individuals are moving within the environment. Temperatures and corresponding time stamps for when the temperatures were captured may be used to generated temperature-time sequences (or a temperature-vs-time sequences) for the one or more skin surface regions of the individuals. As an individual moves around the environment, different exposed skin surfaces may be captured by the one or more thermal imaging devices. An asymptotic surface temperature for a region of the one or more skin surface regions may be determined when temperature-time data points for a corresponding temperature-time sequence are deemed sufficient to determine the asymptotic surface temperature for the region.

In at least one embodiment, the temperature-time sequence may be sufficient to determine the asymptotic surface temperature for the region if a fitting error between the temperature-time sequence and a temperature fitting function for the region is less than a threshold error value. In other embodiments, the temperature-time sequence may be sufficient to determine the asymptotic surface temperature for the region if the temperature-time sequence has at least a threshold number of data points (e.g., at least ten temperature-time data points within a two minute time interval) and that a rate of change for a subset of the data points in the temperature-time sequence is below a threshold rate of change (e.g., the rate of change for the at least ten temperature-time data points is less than one degree within the two minute time interval).

In some embodiments, during a temperature screening process, individuals may enter a temperature screening area with different subject conditions and from different ambient conditions and move freely around the temperature screening area. Over time, for each individual within the temperature screening area, the temperature screening process may capture or acquire temperature-time information (e.g., from one or more thermal cameras) and generate and store temperature-time sequences corresponding with one or more skin surface regions of an individual. In response to detecting that at least a threshold number of asymptotic surface temperatures (e.g., at least two surface temperatures) corresponding with the one or more skin surface regions of the individual may be generated or extrapolated with at most a threshold amount of temperature error (e.g., a temperature error of less than half a degree), an internal core temperature for the individual may be estimated and transferred to a computing device or an electronic display. The temperature offset applied to a particular asymptotic surface temperature for a particular skin surface region of the individual may be determined based on a location of the particular skin surface region on the individual or from a lookup table or database that stores mappings of temperature offsets for various exposed surface regions of an individual. In some cases, the temperature offset may depend on a height, weight, mass, and/or surface area of an individual.

In at least one embodiment, an asymptotic surface temperature for a region of an individual may be extrapolated using a temperature profile fitting function (or temperature fitting function) for the region. In at least one example, a cheek region of an individual with a first surface area and a first height may be mapped to a first temperature fitting function that specifies a temperature over time trajectory for the cheek region. In another example, a forehead region of an individual with a first surface area and a first height may be mapped to a second temperature fitting function different from the first temperature fitting function that specifies a temperature over time trajectory for the forehead region. Different skin surface regions of an individual may equilibrate with an ambient temperature at different rates due to variations in skin tissue density and/or distance from an individual's nose or mouth. The asymptotic surface temperature for a region may be extrapolated using a temperature fitting function when at least a threshold number of temperature-time data points for a temperature-time sequence have a curve fitting error that is less than a threshold error value. In at least one example, the determination of whether a goodness-of-fit between the threshold number of temperature-time data points and the temperature fitting function for the region is sufficient to extrapolate an asymptotic surface temperature for the region may depend on a goodness-of-fit measure, such as having an R-squared value greater than 0.9. Some approaches for determining whether a set of temperature-time data points for a temperature-time sequence is sufficient to extrapolate an asymptotic surface temperature for a skin surface region may take into account the rate of change of the temperature-vs-time sequence and/or how well the temperature-vs-time sequence fits a temperature fitting function with at least a threshold number of data points over a given time period.

A technical benefit of identifying a temperature fitting function for a targeted region of an individual based on a location of the targeted region and/or a distance that the targeted region is from the individual's nose or mouth and extrapolating an asymptotic surface temperature for the targeted region of the individual using the temperature fitting function is that accurate non-invasive temperature screening may be performed with a reduced equilibration time. A technical benefit of identifying a temperature fitting function for a targeted region based on an estimated surface area of the individual, an estimated height or weight of the individual, and/or an amount of air flow within an environment is that an accuracy of an extrapolated asymptotic surface temperature for the targeted region may be increased.

The amount of heat transfer between an exposed skin surface and the environment may be proportional to the temperature difference between the temperature of the exposed skin surface and the ambient temperature of the environment. As the temperature difference decreases over time as an individual equilibrates with the ambient temperature of the environment, the rate of heat transfer may also decrease causing a decrease in the rate of change of the temperature of the exposed skin surface. In some cases, a set of temperature-time data points for a temperature-time sequence used for detecting that a curve fitting error for the set of temperature-time data points is less than a threshold error (e.g., has an R-squared value greater than 0.8) may be selected as the most recent set of temperature-time data points for a temperature-time sequence (e.g., the eight most recent temperature-time data points within the temperature-time sequence). In other cases, the set of temperature-time data points for a temperature-time sequence that is used for detecting that a curve fitting with a particular temperature fitting function is sufficient may comprise a set of five temperature-time data points that are spaced apart in time by at least 30 seconds.

Upon detection that an individual has been within a temperature screening area for more than a threshold period of time (e.g., for more than 3 minutes) and that a temperature-time sequence for the individual has not been deemed sufficient to extrapolate an asymptotic surface temperature for an exposed skin surface region of the individual, an indication directing the individual to a particular area (e.g., a holding area with increased air flow) may be displayed. In some cases, an individual may be directed into a holding area to temporarily equilibrate via an electronic message to a portable computing device, such as a mobile phone, used by the individual.

FIG. 1 is an example diagrammatic view of a temperature scanner system. The example of FIG. 1 includes a high-throughput screening area 102 and a high-accuracy screening area 104. In some embodiments, the high-throughput screening area 102 can be considered a first target scene while the high-accuracy screening area 104 can be considered a second target scene. First and second target scenes may be separate, including abutting, or overlapping. FIG. 1 also includes a first access gate 106 located at the end of the high-throughput screening area 102 and a second access gate 108 located at the end of the high-accuracy screening area 104. FIG. 1 further includes an imaging device 110 (e.g., a camera) which has a field of view as shown by lines 112 and 114. Within the field of view of imaging device 110 is an external temperature reference source (ETRS) 116. Additionally, a plurality of persons 118,120 are located within the field of view of the imaging device 110. As illustrated by the arrows 122, a person 118 can move from a high-throughput screening area 102 to a high-accuracy screening area 104. The example of FIG. 1 further includes indicators 124 and 126 next to access gates 106, 108, respectively. FIG. 1 also includes a processor 128 connected to imaging device 110 and an exit 130 located leftward of the high-accuracy screening area 104.

Continuing with the example of FIG. 1, persons 118 are directed to enter high-throughput screening area 102. High-throughput screening area 102 can be any area in which one or more persons 118 are located and can include the area within the field of view of imaging device 110 as defined by lines 112 and 114. In the example of FIG. 1, high-throughput screening area 102 is divided from other areas, such as high-accuracy screening area 104, by barriers (e.g., walls). In some examples, high-throughput screening area 102 is not separated by any physical barriers from any other areas. In some such examples, high-throughput screening area 102 is distinguished from the high-accuracy screening area via a divided field of view of imaging device 110. For example, the persons 118 are within high-throughput screening area 102 as they are located in one half of the imaging device's field of view. Persons 118 which are within high-throughput screening area 102 can be located any distance away from imaging device 110 but are preferably close enough to imaging device 110 such that imaging device 110 can identify them as persons. High-throughput screening area 102 can include multiple persons 118 which can be stationary or moving through the high-throughput screening area 102 as shown by arrows 132. Persons 118 can move or be directed to move toward imaging device 110 such that the imaging device 110 can screen them. Persons 118 can be in any configuration within high-throughput screening area 102 such as in single file, side-by-side, or in groups. In some examples, persons 118 can be in a substantially single file line generally facing imaging device 110 and spaced apart some distance from each other. In some examples, persons 118 can be in a configuration in which their facial features are most easily detectable by imaging device 110.

In FIG. 1, high-throughput screening area 102 includes a portion of ETRS 116. In some examples, high-throughput screening area 102 can include a separate ETRS used only in high-throughput screening area 102. ETRS 116 is located within the field of view of imaging device 110 as shown by lines 112 and 114. In some examples, persons 118 within high-throughput screening area 102 move or are directed to move to be in line with ETRS 116 such that they are approximately the same distance from imaging device 110 as ETRS 116 is from imaging device 110.

Continuing with FIG. 1, persons 118 can be directed to move to high-accuracy screening area 104 from high-throughput screening area 102 (e.g., as shown by arrow 122). In some examples, persons 118 can be directed directly to high-accuracy screening area 104 without going through or being in high-throughput screening area 102. In some examples, persons can be directed from the high-throughput screening area 102 to the high-accuracy screening area 104 at random. High-accuracy screening area 104 can be any area in which a person 120 is located and can be within the field of view of imaging device 110 as defined by lines 112 and 114. In the example of FIG. 1, high-accuracy screening area 104 is divided from other areas, such as high-throughput screening area 102, by barriers (e.g., walls). In some examples, high-accuracy screening area 104 is not separated by any physical barriers from any other areas. In some such examples, high-accuracy screening area 104 is distinguished from the high-throughput screening area via divided field of view of imaging device 110. Person 120, which is within high-accuracy screening area 104, can be located any distance away from imaging device 110, but is preferably close enough to imaging device 110 such that imaging device 110 can identify person 120 as a person. In some examples, more than one person can be located within high-accuracy screening area 104. In some examples high-accuracy screening area 104 has fewer persons within the area than high-throughput screening area 102. Person 120 can be moving but is preferably stationary while in high-accuracy screening area 104. In some examples, person 120 can be oriented in such a way that their facial features are easily detectable by imaging device 110.

High-accuracy screening area 104 includes a portion of ETRS 116. In some examples, high-accuracy screening area 104 can include a separate ETRS used only in high-accuracy screening area 104. In some examples, person 120 can be stationary and can be located in line with ETRS 116 such that person 120 is approximately the same distance from imaging device 110 as ETRS 116 is from imaging device 110.

FIG. 1 includes access gates 106, 108. Access gates 106, 108 control access for persons for passing through to the other side of the barrier on which access gates 106, 108 are located. Access gates 106, 108 can be entrances to a building or entrances to another space separated from high-throughput screening area 102 and high-accuracy screening area 104. For example, access gates can be located inside of a building separating one portion of the building from another portion of the building. In some examples, walls separate high-throughput screening area 102 and high-accuracy screening area 104 from other spaces, with access gates 106, 108 being the only entrance to the other spaces. Access gates 106, 108 can be controlled access gates and can be opened/closed and/or locked/unlocked selectively. Access gates 106, 108 can be powered and include automatic opening/closing devices which can open/close access gates 106, 108. In some configurations, access gates 106, 108 can be locked, unlocked, opened, or closed by receiving a signal (e.g., from processor 128). In FIG. 1, access gate 106 can be controlled separately from access gate 108. In some configurations, access gates 106 and 108 can be controlled substantially together. In some examples, access gates 106, 108 are controlled by an operator which can selectively open or close the doors. While two access gates are shown in FIG. 1, fewer than two access gates can be used and, in some examples, no access gates are used. It can be advantageous to include access gates as it can prevent persons from passing through the temperature scanner system without being scanned. In FIG. 1, access gate 106 corresponds to high-throughput screening area 102 and access gate 108 corresponds to high-accuracy screening area 104. In such a configuration, persons can enter access gate 106 from high-throughput screening area and be distant from any other persons entering access gate 108 from high-accuracy screening area 104. This configuration can be advantageous as physical interaction between persons can be minimized, possibly reducing the spread of microorganisms from one person to another.

Continuing with FIG. 1, imaging device 110 can be configured to detected imagery and generate corresponding imagery data of a target scene. Imaging device 110 can include thermal imaging components that can be used to detect heat patterns across a scene, including an object or objects being screened. Such components in an imaging device can detect infrared (IR) radiation given off by the scene and convert the IR radiation into an IR image indicative of the heat patterns. For example, in some embodiments, imaging device 110 includes an array of infrared sensors which can comprise pixels. For example, each infrared sensor within the array of infrared sensors can be an individual infrared pixel. In some examples, the imaging device 110 can also capture visible light from the scene and convert the visible light into a visible light image. In other examples, a separate imaging device can capture visible light from the scene. In the example of FIG. 1, imaging device 110 can detect and convert IR radiation into multiple IR images in a short time frame (e.g., 24 pictures per second), effectively creating a video in infrared. In some examples, imaging device 110 can also capture visible light into multiple visible light images in a short time frame and effectively create a visible light video. Depending on the configuration of the imaging device, imaging device 110 can include IR optics to focus the IR radiation on an IR sensor and visible light optics to focus the visible light on a visible light sensor. In some configurations, both IR optics and visible light optics can be used simultaneously with imaging device 110.

In some operations, imaging device 110 detects heat patterns in a scene by receiving energy emitted in the infrared-wavelength spectrum from the scene and processing the IR energy to generate an IR (e.g., thermal) image. In some operations, imaging device 110 can generate a visible light image of the same scene by receiving energy in the visible light-wavelength spectrum and processing the visible light energy to generate a visible light image.

In some examples, imaging device 110 collects or captures the IR energy and visible light energy substantially simultaneously so that the visible light image and the IR image generated by the imaging device 110 are of the same scene at substantially the same time. In such examples, the IR image generated by imaging device 110 can be indicative of localized temperatures within the scene at a particular period of time while the visible light image generated by the imaging device 110 can be indicative of the same scene at the same period of time. In other examples, imaging device 110 can capture IR energy and visible light energy from a scene at different periods of time.

In the example of FIG. 1, imaging device 110 can generate multiple IR and visible light images of multiple scenes within the field of view of imaging device 110. In FIG. 1, a first target scene can be high-throughput screening area 102 and a second target scene can be high-accuracy screening area 104. In some examples, the first target scene can be high-accuracy screening area 104 and the second target scene can be high-throughput screening area 102. In operation, imaging device 110 can generate IR and visible light images and/or video of the first target scene and the second target scene substantially simultaneously.

Imaging device 110 is located such that its field of view, as defined by lines 112 and 114, includes both high-throughput screening area 102 and high-accuracy screening area 104. In FIG. 1, imaging device 110 is located and directed such that it directly faces the high-throughput screening area 102 and high-accuracy screening area 104. In this configuration, the field of view of imaging device 110 is approximately evenly split between high-throughput screening area 102 and high-accuracy screening area 104. This can be advantageous as the imaging device 110 can have persons from both the high-throughput screening area 102 and high-accuracy screening area 104 in frame at the same time. In some embodiments, imaging device 110 is configured to have the person in the high-accuracy screening area 104 be in focus when the person is being screened while persons in the high-throughput screening area 102 are not as in-focus. However, in some examples, imaging device 110 is located at an angle relative to high-throughput screening area 102 and high-accuracy screening area 104 such that one of the screening areas has a larger portion of the field of view of imaging device 110 than the other screening area.

Imaging device 110 is located at a height at which it can view and identify the heads of the persons 118 and is preferably at a similar height to the heads of the persons 118. This can be advantageous as less distortion can be present in images generated by imaging device 110. In some examples, imaging device 110 can have an adjustable height such that it can adjust to the heights of the persons 118 and keep their heads in an optimal view. However, in some examples, imaging device 110 can be located at a height substantially above persons 118 and can thereby allow imaging device 110 to avoid interference or obstructions (e.g., from other person's heads). In some examples, imaging device 110 is located at an angle relative to the high-throughput screening area 102 and high-accuracy screening area 104. The angle can be a horizontal or vertical angle with respect to a ground surface. For example, imaging device 110 can be located at a height substantially higher than the heads of persons 118 and can have a downward vertical angle such that it can view the heads of persons 118. Imaging device 110 can be attached to supports such as a tripod or to a wall or to other objects so that it can be located to have the high-throughput screening area 102 and high-accuracy screening area 104 within its field of view. Other supporting mechanisms are contemplated.

In FIG. 1, indicators 124, 126 are in communication with processor 128. Indicators 124, 126 can be anything that provides an indication that something has occurred. In FIG. 1, indicators 124, 126 are visual indicators which provide visual feedback when processor 128 provides a signal to one or more of the indicators 124,126. In such an example, a person 118 can be notified that a condition has been met, such as a high temperature reading, which is discussed further herein. In the example of FIG. 1, indicator 124 can be used to indicate a condition has been met within high-throughput screening area 102 while indicator 126 can be used to indicate a condition has been met within high-accuracy screening area 104. While indicator 124 is located in the high-throughput screening area 102, and indicator 126 is located in the high-accuracy screening area 104, indicators 124, 126 can be located in any location. In some examples, one or more indicators are located remotely, separate from the screening areas. Being located remotely can allow an operator to monitor the indicators without being exposed to the persons. By using multiple indicators, it can be more easily determined if a person from the high-throughput screening area 102 or if a person from the high-accuracy screening area 104 has met a condition. In some examples, indicators 124, 126 are auditory indicators which can provide auditory feedback, such as a chime or beep, when processor provides a signal to them. In some examples, indicators 124, 126 are visual and auditory indicators. Indicators 124, 126 need not be separate from processor 128 and in some examples, indicators 124, 126 are visual indicators on a display of a computer which includes processor 128. In one such example, an operator of the temperature scanner system can be alerted by an indicator which shows a condition (e.g., elevated temperature of a person) has been met. The display and operator can be located remotely from the high-throughput screening area and the high-accuracy screening area. In some examples, indicators 124, 126 can indicate multiple conditions with different indications. In one such example, indicator 124 can indicate a first condition has been met (e.g., an elevated temperature of a person) and can also indicate a second condition, different from the first condition, has been met (e.g., a normal temperature of a different person). Other indicators are contemplated such as a display connected to imaging device 110 and configured to provide various notifications, alerts, and indications to persons being screened. A person of ordinary skill in the art will appreciate this disclosure is not limited to the example indicators and methods of indication described herein.

Continuing with FIG. 1, imaging device 110 is in communication with processor 128. Processor 128 can be any type of processor (e.g., FPGA, ASIC) and can receive images, image data, imagery data, and/or temperature data from imaging device 110. In some examples, processor 128 is a computer or a computer processor of a computer (e.g., a laptop). Processor 128 can include memory that stores program instructions and related data that, when executed by processor 128, cause imaging device 110 and processor 128 to perform the functions attributed to them in this disclosure. Processor 128 can further include memory for storing data received from imaging device 110 and from other sources. For example, processor can store IR light image data and visible light image data received from imaging device 110 in memory.

Processor 128 can be directly connected to imaging device 110 using a wire, but it some examples, processor 128 can be connected wirelessly to imaging device 110. In some such examples, processor 128 is located remotely from imaging device 110 and in some examples, processor 128 can be a processor in a remote server. In some such examples, imaging device 110 can be configured to send image data through the internet or other remote protocols to the remote processor. A remote processor can be advantageous as it does not need to occupy the same space as imaging device 110 and can be more powerful than a local processor. In some examples, more than one processor can be in communication with imaging device 110 and perform the same or different functions as the other processors.

In operation, processor 128 can receive imagery data, which can include IR light image data and visible light image data of a first target scene (e.g., the high-throughput screening area 102) from imaging device 110. Additionally, processor 128 can receive imagery data, which can include IR light image data and visible light image data of a second target scene (e.g., the high-accuracy screening area 104) from imaging device 110. In some examples, processor 128 can receive imagery data from both the first target scene and second target scene substantially simultaneously from imaging device 110. In some such examples, imaging device 110 can generate imagery data, including IR light image data and visible light image data, substantially simultaneously and send the data to processor 128. In some embodiments, the infrared image data of the imagery data can be indicative of temperatures in the target scene. Further, in some embodiments, processor 128 can interpret the received IR light image data and assign temperatures corresponding with the IR light image data. Alternatively, in some examples, imaging device 110 assigns temperatures corresponding with the IR light image data and communicates the temperatures to processor 128. Processor 128 can additionally interpret the received visible light image data and use the data for various functions as is described further herein. The temperatures can correspond to the surface temperatures of objects such as persons 118.

As discussed above, a first target scene, which can be high-throughput screening area 102, can include multiple persons such as persons 118. Image data representative of the first target scene can thus include image data associated with multiple persons. Processor 128 can analyze the image data received from imaging device 110 and correlate specific portions of the image data with specific persons 118. For example, a first and second person can be located in high-throughput screening are 102 with imaging device 110 generating image data of the scene that includes the first and second person. Processor 128 can use algorithms and other techniques to determine that a specific portion of visible light imaging data is associated with the first person and that a different portion of the visible light imaging data is associated with the second person. Processor 128 can then determine temperatures associated with IR light image data and correlate specific portions of the temperatures with the first person and different specific portions of the temperatures with the second person. In some examples, processor can perform the process described above substantially simultaneously for multiple individuals in the high-throughput screening area 102. In some examples, processor 128 identifies persons in a target scene using a portion of the imagery data which can include IR image data and/or visible light image data. For example, processor 128 can identify a person using the visible light image data and can subsequently map a portion of the IR image data with the portion of the visible light image data that is representative of the person. In some such examples, processor 128 can determine the temperature of the person. In some examples, processor 128 can identify persons using IR image data.

In some examples, processor 128 can receive visible light image data of a first target scene and visible light image data of a second target scene from imaging device 110. Processor 128 can analyze the visible light image data received from imaging device 110. For example, processor 128 can use image analysis to correlate patterns of pixels (e.g., pixel regions) with objects and/or persons in order to identify the objects and/or persons. Additionally or alternatively, in some examples, processor 128 can use facial recognition and/or facial detection techniques to determine what, if any, portion of an image contains facial features associated with persons. Image analysis and facial recognition techniques can consist of various algorithms, equations, and steps and can include using multiple images, portions of images, or other systems which determine if a person is present in the image and/or if facial features are present in the image. For example, processor 128 can analyze visible light image data and determine if portions of the visible light image data correspond to persons 118 or to other objects. Processor 128 can further use tracking techniques to track the location of persons and/or facial features within an image and/or in multiple images over time. For example, processor 128 can receive visible light image data comprising multiple images per second from a target scene, determine that the image data includes a person, determine that the person has facial features, and can further track the person through each image over time.

Furthermore, in some examples, processor 128 can use facial recognition, facial detection, or other techniques to store and compare facial features or other identifying features of persons. In some examples, this can allow processor to determine if a person has been imaged before and if the person has gone from the high-throughput screening area 102 to the high-accuracy screening area 104 or from high-accuracy screening area 104 to high-throughput screening area 102. Additionally, in some examples, persons can be identified at a much later point in time, such as during a subsequent temperature screening. This information can be used to track individual person's temperatures and their change in temperature over long periods of time (e.g., over days, weeks, or longer). In some examples, information about the identified individual can be stored for other uses such as for calibration or other uses which can increase the accuracy of the temperature scanner system.

Using the techniques described above, or other techniques, processor 128 can determine the temperature of a person, or multiple persons, using imaging device 110. The temperature can be determined continuously, at intervals over time, or at a single point in time. The temperature can be a direct temperature (e.g., surface temperature) determined from the IR light image data, however in some examples, the temperature can be an indirect temperature. In some such examples, the indirect temperature can be correlated with a direct temperature but can include adjustments such as offsets from the direct temperature. For example, a direct temperature of a person can be determined using the IR light image data as described above. However, the direct temperature may need to be adjusted to be more accurate or require an adjustment to reflect the difference between the surface temperature of the person and an internal temperature of the person. An external temperature reference source (ETRS) can be used for adjusting the direct temperature as described further herein. Other manipulations of the temperature can be done and are contemplated.

Although a person can have multiple temperatures associated with them, in some examples, processor 128 determines the highest temperature associated with the person and can compare it to a temperature threshold. In other examples, processor 128 determines the lowest temperature associated with the person and can compare it to a different temperature threshold. Further, in some examples, processor 128 determines a temperature of a specific area of a person and, in some examples, processor 128 determines an average temperature of person for comparing to a threshold temperature. Other temperatures locations and types associated with a person are contemplated. Preferably, temperatures closely correlated with an internal temperature of the person are used for comparing to a temperature threshold.

A temperature threshold can be any temperature or range of temperatures. In some examples, multiple temperature thresholds are used. In some examples, the temperature threshold can be a temperature for a human (e.g., 98.6° F.) or a range of a normal temperatures for a human (e.g., 97.7° F. — 99.5° F.). In some examples, the temperature threshold can be an abnormal temperature for a human (e.g., 100+° F.). In some examples, the temperature threshold can be fixed while in other examples, the temperature threshold can be adjusted as is described further herein.

FIG. 2 is an example diagrammatic view of a second embodiment of a temperature scanner system according to an aspect of the present disclosure. FIG. 2 includes a high-throughput screening area 202 and a high-accuracy screening area 204. FIG. 2 also includes a first access gate 206 located at the end of the high-throughput screening area 102 and a second access gate 208 located at the end of the high-accuracy screening area 204. Furthermore, FIG. 1 includes a first imaging device 210 with a field of view as shown by lines 212 and 214 and a second imaging device 216 with a field of view as shown by lines 218 and 220. Within the field of view of first imaging device 210 is an ETRS 222 and within the field of view of the second imaging device 216 is another ETRS 224. Second imaging device 216 includes a backdrop 226 within its field of view. FIG. 2 includes a processor 228 in communication with first imaging device 210 and second imaging device 216 as shown by 230. Indicators 232 and 234 are also included in the example of FIG. 2. Within the field of view of first imaging device 210 are persons 236 which can be stationary or moving as shown by arrows 238. Within the field of view of second imaging device 216 is another person 240.

Continuing with the example of FIG. 2, in operation, one or more persons 236 can enter a high-throughput screening area 202 which is within the field of view of first imaging device 210 as shown by lines 212 and 214. High-throughput screening area 202 can be considered a first scene. The persons 236 can move generally toward first imaging device 210 and can pass ETRS 222. First imaging device 210 can collect IR energy and in some examples, visible light energy, from the first scene while persons are in the field of view of first imaging device 210. First imaging device 210 can be configured to detect imagery of a first scene and generate corresponding imagery data of the first scene. In some embodiments, the generated imagery data includes generated IR light image data of the first scene from the collected IR energy. In some examples, the generated imagery data includes generated visible light image data of the first scene from the visible light energy. First imaging device 210 can communicate with processor 228 by sending and receiving data which can include imagery data such as IR light image data and visible light image data. In some examples, first imaging device 210 determines temperatures associated with objects or portions of objects within the first scene using the IR light image data and communicates the temperatures with processor 228. In some examples, processor 228 receives IR light image data from first imaging device 210 and determines temperatures associated with objects within the first scene. Processor 228 can use temperatures, IR light image data, and visible light image data to determine temperatures of persons 236 including temperatures associated with portions of the persons 236 (e.g., facial temperatures). If a temperature of a person does not exceed a temperature threshold, processor 228 can operate first access gate 206 and allow the person to pass through. If a temperature of a person exceeds a threshold temperature, processor 228 can communicate with indicator 232 such that indicator 232 indicates that the temperature of the person exceeds the threshold temperature.

Further, in the operation of example FIG. 2, if the temperature of the person exceeds the threshold, the person can move to high-accuracy screening area 204 and be positioned in front of backdrop 226 and in line with ETRS 224. In some examples, a person can be directed to high-accuracy screening area 204 regardless of if the person has a temperature exceeding the threshold (e.g., at random). High-accuracy screening area 204 is within the field of view of second imaging device 216. Second imaging device 216 can have a field of view as defined by lines 218 and 220. In the example of FIG. 2, the field of view of second imaging device 216 is smaller (e.g., narrower) than the field of view of first imaging device 210. In some examples, the field of view of second imaging device 216 is the same or larger than the field of view of first imaging device 210. Using a smaller field of view for second imaging device 216 can be advantageous as it can produce less image distortion and have greater accuracy than an imaging device with a larger (e.g., wider) field of view. In the example of FIG. 2, the first imaging device 210 and the second imaging device 216 have fields of view which are separated from each other such that a person cannot be in both fields of view at the same time (e.g., adjacent). However, in some examples, first imaging device 210 and second imaging device 216 can have overlapping fields of view. It can be advantageous to have overlapping fields of view as processor 228 can use both first imaging device 210 and second imaging device 216 to track persons moving from primarily one field of view to the other field of view.

In some examples, the first imaging device 210 can have a first depth of field and the second imaging device 216 can have a second depth of field. In some such examples, the first imaging device 210 with the first depth of field can receive infrared image data at a first range of distances from the first imaging device 210. Further, in some such examples, the second imaging device 216 with the second depth of field can receive infrared image data at a second range of distances from the second imaging device 216. In some examples, the second depth of field is smaller than the first depth of field, and in some examples, the second range of distances is smaller than the first range of distances. A larger depth of field with a larger range of distances can allow the first imaging device to receive more infrared image data from a scene which includes multiple persons. However, a smaller depth of field with a smaller range of distances can allow the second imaging device to receive more focused infrared image data which can also be more accurate. In some examples, the depth of field of the first imaging device and the second imaging device can be adjusted. In some examples, the second imaging device has a higher resolution than the first imaging device.

Additionally, in some examples, second imaging device 216 can have a shorter minimum focus distance and a longer lens effective focal length than first imaging device 210. A shorter minimum focus distance and longer lens effective focal length can allow objects such as a person to be in focus at a distance closer to the imaging device. It can be advantageous to have objects such as a person be closer to second imaging device 216 as image data, such as IR light image data which corresponds to temperatures of the objects, can be more accurate than if objects are further away from the second imaging device 216. In FIG. 2, ETRS 224 and backdrop 226 are also within the field of view of second imaging device 216. Backdrop 226 can increase the accuracy and/or consistency of IR light image data received by second imaging device 216 as it can reduce noise generated by other heat sources and/or provide a constant background for imaging. ETRS 224 and backdrop 226 can also increase the accuracy of IR light image data received by second imaging device 216 and the accuracy of the temperature associated with the IR light image data as is described further herein. Thus, in some embodiments, the determined temperature in the high-accuracy screening area is more accurate than the determined temperature in the high-throughput screening area.

Continuing with the operation of FIG. 2, once a person 240 is within high-accuracy screening area 204 and in the field of view of second imaging device 216, second imaging device can receive IR light energy and in some examples, visible light energy, representative of the scene which includes person 240. Second imaging device 216 can generate IR light image data and in some examples, visible light image data from the received energy. From the IR light image data and optionally, visible light image data, second imaging device can determine temperatures associated with the scene. In some examples, processor 228 determines the temperatures associated with the scene from the IR light image data and optional visible light image data. Processor can receive the temperatures of the scene, including the temperatures associated with person 240, and determine if they exceed a temperature threshold. For example, processor can receive temperatures of the scene, determine the highest temperature within the scene that is associated with person 240, and compare it to the temperature threshold. If the temperature or temperatures associated with person 240 do not exceed the temperature threshold, processor 228 can operate second access gate 208 and allow person 240 to pass through. If the temperature or temperatures associated with person 240 exceeds the temperature threshold, processor 228 can provide a signal to indicator 234 which provides visual or other indication that the temperature associated with person 240 exceeds the temperature threshold. Additionally, in some examples, if the temperature or temperatures associated with person 240 exceed the temperature threshold, processor 228 can provide an indication that the one or more persons should be directed to a physical screening area (e.g., screening with an oral thermometer).

The configuration of the temperature scanner system of FIG. 2 can be advantageous because it uses multiple imaging device (e.g., 210, 216) to determine temperatures of persons. In such a configuration, different imaging devices can be used with the first imaging device 210 used in high-throughput screening area 202 being able to determine temperatures quickly with the second imaging device 216 used in high-accuracy screening area 204 being able to determine temperatures more accurately than first imaging device 210.

FIG. 3 is an example conceptual illustration of persons in a first field of view 302 and a second field of view 304 as captured by one or more imaging devices according to an aspect of the present disclosure. The illustration of persons in the first field of view 302 and second field of view 304 includes pixel measurements 306, 308, 310, 312, and 314. FIG. 3 further includes persons 316 with heads and faces 318 and individual person 320 located in the second field of view 304. An ETRS 322 is also included and located in the second field of view 304. The first field of view can be a high-throughput screening area and the second field of view can be a high-accuracy screening area.

As shown in FIG. 3, multiple persons 316 can be located within the first field of view 302 as captured by one or more imaging devices (e.g., 110 of FIG. 1). As previously described, in operation, the one or more imaging devices can generate imagery data including image data representative of the persons 316 shown in the first field of view 302 while a processor can analyze the imagery data. Analyzing the imagery data can include using facial detection or recognition on the imagery data to determine if there are persons within the first field of view and/or where a person's head and/or face might be located within the image captured by the imaging device. As shown in the first field of view 302, persons 316 can be identified as a person and can be further identified as having a head and/or face 318. In some embodiments, the persons 316 can be identified as persons by the system identifying the persons' heads and/or faces. The processor can determine if a face is in the field of view 302 at different distances from the imaging device with the persons stationary or moving relative to the imaging device. In some examples, the processor can determine if a face is in the image even if the person is not facing the imaging device. Persons can generally move toward the imaging device and become larger in the field of view 302 and the processor can track the movements of the persons 316 along with their head and/or faces 318.

In some examples, within the first field of view 302, the processor, in combination with the imaging device, can further identify one or more specific portions of persons 316. In some examples, a specific portion is the face 318 of the persons. However, in some examples, the processor can identify portions of the face such as an eye or portion of the eye. In some examples, the processor can determine a temperature associated with a specific portion of the person and in some examples, the processor can further track the temperature of the specific portion of the person over time (e.g., while the person is moving). In some examples, the processor can have a higher accuracy when determining the temperature of a specific portion of the face (e.g., eye tear duct/inner canthus) than an entire face of the person.

In some examples, within the second field of view 304, the processor, in combination with the imaging device, can further identify one or more specific portions of the person 320. In some examples, a specific portion is the face of the person 320. However, in some examples, the processor can identify portions of the face such as an eye or forehead. In some examples, the processor can determine a temperature associated with a specific portion of the person and in some examples, the processor can further track the temperature of the specific portion of the person over time (e.g., while the person is moving). In some examples, the processor can have higher accuracy when determining the temperature of a specific portion of the face (e.g., eye tear duct/inner canthus) than an entire face of the person.

Continuing with the example of FIG. 3, the second field of view 304 can include a person in the high-accuracy screening area and captured by one or more imaging devices. In the second field of view, image data representative of an individual person 320 is displayed. A processor, in combination with the one or more imaging devices, can determine facial features of the individual person 320. Additionally, the processor and imaging devices can determine a temperature of the individual person 320 as previously described. In some examples, for the temperature of the individual person 320 to be considered a high-accuracy reading, a specific size of the head and/or face of the individual person 320 is required. For example, one such size requirement is shown in FIG. 3 by elements 310 and 312. Element 310 can be a minimum number of pixels corresponding to the height of the individual person's head and/or face and element 312 can be a minimum number of pixels corresponding to the width of the individual person's head and/or face. In some such examples, the pixels correspond to individual infrared sensors of an infrared sensor array of an imaging device. For example, a person's head can take up a number of pixels of the infrared sensor array. In some examples, a head and/or face of a person in a second target scene (e.g., high-accuracy screening area 104) is represented by more pixels than the head and/or face of a person in the first target scene (e.g., high-throughput screening area 102). In some examples, element 310 is at least 240 pixels and element 312 is at least 180 pixels. In some examples, the number of pixels can be higher or lower. Further, in some examples, a minimum number of pixels corresponding to the height of the entire image of the individual person (e.g., 308) and a minimum number of pixels corresponding to the length of the entire image of the individual person (e.g., 314) can be required for accuracy. For example, element 308 can be 320 pixels minimum and element 314 can be 240 pixels, although these pixel counts may be transposed if the imaging device is switched from portrait mode, as shown, to landscape mode. Certain standards, such as IEC 80601-2-59 or ISO/TR 13154, may require a 320×240 minimum pixel count. Other pixel counts (e.g., 480×320) for accuracy may be used.

As depicted in FIG. 3, a first region 319 may comprise a facial region of the individual person 320 located between the individual's eyes and a second region 321 may comprise a cheek region of the individual person 320. A first surface temperature for the first region 319 may be determined using an average temperature for pixels within a thermal image corresponding with the first region 319. A second surface temperature for the second region 321 may be determined using an average temperature for pixels within the thermal image corresponding with the second region 321. A first temperature offset may be acquired and used to estimate a first internal core temperature and a second temperature offset may be acquired and used to estimate a second internal core temperature. In at least one example, an internal core temperature may be computed as an average of the first internal core temperature and the second internal core temperature. In another example, an internal core temperature may be determined as the highest temperature out of the first internal core temperature and the second internal core temperature.

While persons' head and/or faces have been described as being used, other parts of persons may be used to identify, track, and/or determine the accuracy of a temperature reading of the persons. For example, in some embodiments, the system uses a person's head to identify the person and uses the person's head to track the person throughout a target scene.

Continuing with FIG. 3, an ETRS 322 is included in second field of view 304. ETRS 322 is an external temperature reference source which can help an imaging device and/or a processor determine a temperature of objects in a scene. ETRS 322 of FIG. 3 is active, but in some examples, ETRS can be passive. ETRS 322 can have a temperature sensor connected to the surface (e.g., control plate) of the ETRS measuring the temperature of the ETRS. Further, ETRS 322 can have control circuitry to maintain the temperature of the surface of the ETRS at substantially a constant level. In some examples, the surface of the ETRS has known parameters such as emissivity. By using the temperature and the known parameters of the surface, the imaging device and/or the processor can correlate IR light image data corresponding with the ETRS with the known temperature from the temperature sensor. This can help calibrate and increase the accuracy of the determined temperature of persons within the same field of view. Additionally, in some examples, the temperature of the ETRS can be set approximately to a threshold temperature (e.g., elevated temperature) which can further increase accuracy because it can minimize any response and/or gain error contributions from the imaging device.

In some examples, multiple ETRS are used to further increase the accuracy. In some examples, a single ETRS can be used between multiple scenes (e.g., the ETRS of FIG. 1). In further examples, an ETRS can be used only for a high-accuracy screening area while no ETRS is used for a high-throughput screening area. In some examples, when using an ETRS, it can be more accurate to have the subject (e.g., a person) be at the same distance from the imaging device as the ETRS is from the imaging device. In these examples, the temperature of the ETRS is mostly unaffected by any other sources and the IR light received by the imaging device travels substantially the same distance to the imaging device from both the ETRS and the subject. This configuration can reduce atmospheric interference on the temperature reading of the subject. In some examples, the ETRS is behind the subject so that the subject does not substantially affect the temperature of the ETRS (e.g., by breathing on it).

In some examples, imagery, temperatures, and other data (e.g., a confidence factor) can be displayed on a display. Imagery data can include visible light imagery and/or infrared light imagery. In some such examples, the display can display information about each individual person proximate to the imagery of said person. In some examples, the display is monitored by an operator such that if a person has a temperature above the threshold, the operator can notify the person, and if a person has a temperature below the threshold, the operator can allow access through access gates. However, in some examples, the display is not actively monitored by an operator and displays information to any person such as the persons being screened. More than one display can be used, however in some examples, one display is used which incorporates one or more imaging devices. For example, FIG. 3 can be an example view of a display as it displays multiple fields of view from multiple imaging devices and can also be an example view of a display as it displays a single field of view from a single imaging device.

As previously discussed herein, one or more imaging devices in communication with a processor can determine the temperature of one or more persons in a target scene. However, in some examples, a confidence factor is included with the determining of the temperature of one or more persons. A confidence factor, as used in this disclosure, is a measurement of certainty/uncertainty. For example, the confidence factor can be a determination of the likelihood that something, such a measurement, value, or series of values, is accurate. In at least one example, a large uncertainty range can indicate a lower confidence factor while a small uncertainty range can indicate a higher confidence factor. The confidence factor can be an additional step in determining the temperature of one or more persons and can be used to increase the accuracy of any temperature determinations of the persons. In some examples, the confidence factor can be associated with an image or series of images which can include IR light image data and/or visible light image data. In some examples the confidence factor can be associated with a temperature or series of temperatures which can be determined from IR light image data and optionally, visible light image data. In operation, a confidence factor is determined by a processor (e.g., processor 228 of FIG. 2) and can be compared to a threshold. In some examples, more than one confidence factor can be used with each confidence factor comprising multiple other factors.

The confidence factor can include many individual factors which are specific to the determination being done. In some examples, the confidence factor can have individual factors related to the specific properties of an image such as the clarity, blurriness, brightness, darkness, and contrast. In some examples, the confidence factor can be weighted. In some examples, the confidence factor can take into account multiple images over a period of measurement. In some such examples, the confidence factor can include an analysis of the multiple images (e.g., average amount of clarity and/or brightness). In one such example, a first confidence factor can be assigned to a first image (e.g., frame) of a plurality of images (e.g., a video) and a second confidence factor can be assigned to a second image of the plurality of images. Each of the first and the second confidence factors can be weighted based on distance from the person to the imaging device and an overall confidence factor can be aggregated from the first and second confidence factors. An overall confidence factor (e.g., aggregated confidence factor) can be compared and used in any case where an individual confidence factor is used (e.g., compared to a threshold). In some examples, the confidence factor can have individual factors related to the objects within the image such as the number of persons or properties of the persons. For example, a confidence factor can include the likelihood that a person has one or more obstructions on their face which interfere with the temperature determination. Some examples of obstructions include hair, glasses, hats, and masks. These obstructions could affect the accuracy of the temperature determination of the person. In some other examples, a confidence factor can include the distance between a person whose temperature is being determined and the imaging device generating the image data of the person. Because the distance can affect the temperature determination of the person, a confidence factor can be assigned to the temperature determination which takes into account that smaller distances from an imaging device generally produce more accurate temperature determinations than larger distances from an imaging device. In some examples, a confidence factor can include the direction a person is facing and a speed at which the person is moving. The confidence factor can include any number of the factors above and other factors not listed.

In some example operations, a relatively low confidence factor can be associated with/assigned to a temperature reading of a person's face due to the temperature reading of their face being below a threshold. The temperature reading being below a threshold could indicate that some obstruction is located on the person's face and the relatively low confidence factor can reflect that it is likely some obstruction is preventing a more accurate temperature reading. In such a case, an initial confidence factor can be 100% and is subsequently lowered by 20% to be 80% due to the person's temperature being below a threshold. In some other example operations, a relatively low confidence factor can be associated with/assigned to a temperature reading of a person's face due to the person not looking toward the imaging device. The relatively low confidence factor can thus reflect the likelihood that the temperature reading of the person's face is accurate due to the positioning of the person's face. In such a case, an initial confidence factor can be 100% and is subsequently lowered by 30% to be 70% due to the person not looking toward the imaging device. Other factors are contemplated, and different factors can have different impacts on the confidence factor. For example, a person not looking toward the imaging device as well as their temperature being below a threshold could lower the confidence factor from 100% to 50% with each factor contributing to the decrease in the confidence factor. In some examples, factors add together to decrease the confidence factor as described above, while in some examples, factors can be combined in a non-linear fashion. One such example of a non-linear combination is that one factor contributes to a decrease of 10% in the confidence factor by itself and another factor contributes to a decrease of 15% by itself. However, when both factors are present, the confidence factor can decrease by 50%. Other examples of confidence factors, other combinations of factors, and other contributions of the factors to the confidence factor are contemplated and this disclosure is not limited to the examples above.

In some examples, the confidence factor can change over time. In some such examples, the confidence factor can change over time based on the temperature determination changing over time. A processor can change the confidence factor over time based on information or factors which were not previously used in the confidence factor. For example, the confidence factor associated with a temperature determination of a person can increase continuously as a person gets closer to an imaging device as the imaging device can receive more IR light from the person and/or the imaging device can obtain finer details of the person. It can be advantageous to continually update a confidence factor as it can increase the accuracy of determinations such as a temperature determination.

In some example operations, a confidence factor can change as the imaging device receives images. In one such example operation, a confidence factor can be associated with/assigned to a first image in which the person's face is blurred due to their head motion. Subsequently, the confidence factor can be updated to reflect a second image in which the person's face is clear (e.g., not blurred). In some examples, the updating can be an aggregate of individual confidence factors associated with/assigned to a temperature reading, while in some examples, the updating can be a running average. Other methods of analysis and updating of the confidence factor are contemplated.

In some examples, the confidence can be compared to a threshold by a processor. If the confidence factor does not exceed a threshold, the processor can perform an additional action, such as providing a signal that the confidence factor did not exceed the threshold. In some examples in which a confidence factor is based on the accuracy of the determined temperature of a person, the confidence factor not exceeding its threshold, the determined temperature exceeding a threshold, or a combination thereof, can be used to indicate the person needs further screening. For example, a person can have a temperature determined in a high-throughput screening area which is within an acceptable range, however, an associated confidence factor can be lower than a threshold, indicating that the determined temperature is not sufficiently accurate. In such an example, the person can be directed to a high-accuracy screening area for further temperature determination.

FIG. 4 is an example flow diagram of a method of scanning temperatures of person according to an aspect of the present disclosure. The method starts with 402, in which an imaging device detects imagery and generates corresponding imagery data of a first target scene. In some examples, the first target scene can include one or no persons. The method continues with step 404 in which the imaging device sends imagery data of the first target scene, including infrared image data, which is indicative of temperatures, to one or more processors. Next, in step 406, the one or more processors identifies persons in the first target scene using imagery of the scene and determines a temperature of each person identified. In some examples, the method continues with step 410, however, in some examples, optional step 408 is performed. In step 408, the processor assigns a confidence factor to the determined temperature of each person identified. In some embodiments, the confidence factor is assigned based on imagery data of the first target scene. From optional step 408, the method can either continue with step 410 or, optionally, to step 412. In step 410, the one or more processors compare the determined temperature of each person identified to a first threshold. If the determined temperature of at least one person exceeds the first threshold, the one or more processors is configured to provide an indication that the at least one person should be directed to a second target scene. From step 410, the method can either continue with step 414 if the determined temperature of at least one person exceeds the first threshold, or optionally, with step 412, regardless of the result of the comparison. In optional step 412, the one or more processors compare an aggregated confidence factor to a threshold confidence factor and if the determined confidence factor of at least one person is below the threshold, the processor provides an indication that the at least one person should be directed to a second target scene. From 412, the method continues with step 414 if the aggregated confidence factor is below the threshold. In step 414, the imaging device generates imagery data of the second target scene with the imagery data including infrared image data of the second target scene. Next, in step 416, the imaging device sends the imagery data of the second target scene, including infrared image data, which is indicative of temperatures, to the one or more processors. In step 418 of the example of FIG. 4, the one or more processors determine a temperature of the at least one person in the second target scene, compares the temperature to a second threshold, and provides an indication of the temperature of the at least one person relative to the second threshold. While the steps above are described as happening sequentially, in some examples, some steps of the method can be done simultaneously and, in some examples, some steps can happen before or after other steps. For example, the second imaging device can generate IR image data of the second target scene before, after, or during when the first imaging device generates IR image data of the first target scene.

FIG. 5 is an example flow diagram of another method of scanning temperatures of person according to an aspect of the present disclosure. The method starts with step 502, in which one or more persons are identified in a first target scene. Next, in step 504, an imaging device configured to detect IR energy generates IR image data of the one or more persons in a first scene. Further, in step 506, a temperature reading of each person identified is determined based at least on the IR image data. Next, in step 508, the temperature of each person identified is compared to a threshold. In the case that each person identified has a temperature below a threshold, each person is allowed through an access gate as in step 510. In the case that at least one of the one or more persons has a temperature reading above the threshold, the method continues with step 512. In step 512, an indication is provided that the at least one person should be directed to a second target scene. Continuing with step 514, the imaging device generates IR image data of the at least one person in the second target scene. Next, in step 516, a temperature reading of the at least one person is determined based at least on the IR image data. Further, in step 518, the determined temperature of the at least one person is compared to a second threshold. In the case that the temperature of the at least one person is not above the threshold, the at least one person is allowed through the access gate as in step 510. If, however, the temperature of the at least one person is above the threshold, the process continues with step 520. In step 520, an indication is provided which indicates the temperature of the at least one person is above the threshold. In some optional embodiments, the method can continue with denying entry to the at least one person through the access gate as in step 522. While the steps above are described as happening sequentially, in some examples, some steps of the method can be done simultaneously, and in some examples, some steps can happen before others. For example, the comparison of step 508 can be happening simultaneously with the comparison of step 518.

In some examples of the system for screening persons for elevated temperatures, processes for adjusting the determining of temperature readings can be included. In some such examples, a processor, which determines the temperatures of the persons in the target scene, can adjust the determined temperatures based on previous determinations. For example, a processor can determine the temperatures of persons in a first target scene using IR image data of the first target scene. The processor can later adjust and determine the temperatures of persons in the first target scene, however, the temperatures determined later can be higher and/or lower than they would have been if the processor had not adjusted. In at least one example, the temperatures of the persons all exceed the threshold and the processor adjusts such that the temperatures of the same persons no longer exceed the threshold. In some examples, the adjustment can be temporary (e.g., for a determined amount of time) while in some examples, the adjustment can be permanent until subsequent adjustment.

In some examples, the determined temperature readings of the second scene are used to adjust the determining of temperature readings of the first scene. For example, if determined temperatures of a majority of individuals in the second scene do not exceed a threshold, the processor can be adjusted to change its determination of temperatures of individuals in the first scene. In this example “false positives,” where an individual is directed to a second scene due to their temperature exceeding a threshold in the first target scene, can be reduced. Further, in some examples, the temperature of individual persons relative to an average temperature of a plurality of persons is used to adjust the system. In some such examples, the processor can determine if a temperature of a person is different than previous temperatures of persons. In some examples, adjustment can be done while the system for screening persons is active (e.g., continuous adjustment). Further, adjustment, as described above, can be applied to the threshold in addition to or in lieu of adjusting the determining of the temperature. In some examples, directing random persons to go from the high-throughput screening area to the high-accuracy screening area can aid in adjusting various portions of the screening system including the threshold. The random directing of persons to the high-accuracy screening area can prevent large variations between the first scene and second scene temperatures and can increase accuracy of both. In some examples, the directing of person to the high-accuracy screening area is not random and can vary based on a number of factors including the number of persons and the frequency of which persons are required to go through the high-accuracy screening area. In some examples, the threshold can be adjusted in response to outdoor temperatures. Adjusting the threshold for outdoor temperature can be advantageous as persons can have increased/decreased temperatures for a period of time after entering a screening area from the outside. It can also be advantageous to adjust temperature determinations and/or thresholds because persons can have a range of temperatures which can be considered “normal” (e.g., one person has a higher “normal” temperature than another person). Additionally, it can be advantageous to adjust temperature determinations and/or thresholds because portions of the system, including the imaging device(s) used to generate IR image data, can be subject to unintentional changes (e.g., temperature changes) over time.

In some examples of the system for screening persons for elevated temperatures, data, which can include IR image data, temperature data, and confidence factor data, can be correlated between data obtained from a high-throughput area and data obtained from a high-accuracy area. In some such examples, a processor can correlate and/or analyze the data. The processor can use the data to determine various aspects of the system. For example, if the imaging device of the high-throughput area identifies an individual person with a temperature exceeding a threshold, the imaging device of the high-accuracy area can identify if the same individual is in the high-accuracy area (e.g., facial recognition). The data can then be linked for later use such as for adjustment of the system. In such an example, the system can determine that a person has been through the high-accuracy area before allowing the person through an access gate. In some examples, the data from the high-throughput area and data from the high-accuracy area are correlated such that the process of assigning a confidence factor in the high-throughput area is updated during operation. Other examples of using correlated data are contemplated including using the correlated data to adjust the temperature determinations of the imaging devices and using the correlated data to adjust the threshold. A person having ordinary skill will appreciate that the disclosure is not limited to the examples above.

In further examples of the system for screening persons for elevated temperatures, data (e.g., IR image data) can be used from both the high-accuracy screening area and the high-throughput screening area for later analysis and updating of algorithms. Algorithms can include algorithms for correlating IR image data with temperatures and algorithms for determining threshold temperatures. For example, machine learning can be used with the data collected by the first imaging device and the second imaging device to adjust later, or in real time, screening parameters of the first imaging device or of the processor. Other methods for analyzing the data and adjusting various parameters of the screening system are contemplated.

FIG. 6 depicts an embodiment of a computing device 680 in communication with a capture device 620 and a capture device 622. The capture device 620 and the capture device 622 may comprise thermal image capturing devices. In some embodiments, capture device 620 and computing device 680 may be integrated together within a common housing. In other embodiments, the capture device 620 may comprise a thermal image capturing device and the computing device 680 may be in communication with the capture device 620 via a wired or wireless networking connection. The capture device 620 may be in communication with the computing device 680 via a networking path 646. The capture device 622 may be in communication with the computing device 680 via a networking path 648. The networking path 646 and the networking path 648 may be formed via one or more networks not depicted that may include a cellular network, a mobile network, a wireless network, a wired network, a secure network such as an enterprise private network, an unsecure network such as a wireless open network, a local area network (LAN), a wide area network (WAN), the Internet, or a combination of networks. Each network of the one or more networks may include hubs, bridges, routers, switches, and wired transmission media such as a wired network or direct-wired connection. In some embodiments, the computing device 680 may comprise a real hardware computing device with real hardware processors and storage devices or a virtual computing device that includes one or more virtual machines. The real hardware storage devices may include non-volatile and volatile storage devices.

In at least one embodiment, the capture device 620 may include one or more image sensors for capturing images. An image sensor may comprise a CCD image sensor or a CMOS image sensor. In some embodiments, capture device 620 may include a thermal image sensor and/or an IR CMOS image sensor. The capture device 620 may include an IR light component 634 for a depth camera, a depth camera 636, an RGB camera 638, and a thermal camera 640. In at least one example, the IR light component 634 may emit an infrared light into a capture area and may then use sensors to detect the backscattered light from the surface of one or more individuals in the capture area using the color and/or IR light sensing components within the capture device 620. In some embodiments, pulsed infrared light may be used such that the time between an outgoing light pulse and a corresponding incoming light pulse may be measured and used to determine a physical distance from the capture device 620 to a particular region on a surface of an individual within the capture area. Capture device 620 may also include optics for producing collimated light and/or for diffusing light (e.g., an optical diffuser for spreading light from an IR light source that generates a narrow beam of light) for illuminating an environment.

As depicted in FIG. 6, the capture device 620 may include a processor 642, which may include a hardware processor or a microprocessor, and a memory 644. The processor 642 may execute instructions stored within memory 644 for tracking regions (or exposed skin surface regions) of individuals within the capture area and determining temperatures for the tracked regions. The memory 644 may include random access memory (RAM), read only memory (ROM), cache, Flash memory, a non-volatile memory, or any other suitable storage component. The capture device 620 may detect a tracked region using captured color images and then determine a temperature for the tracked region using captured thermal images. The capture device 620 may output or transfer temperature information for the tracked regions to the computing device 680.

As depicted in FIG. 6, computing device 680 includes a processor 691, a memory 692, a network interface 686, and a temperature tracking engine 694 all in communication with each other. Network interface 686 allows computing device 680 to connect to one or more networks and/or one or more capture devices, such as capture devices 620 and 622. Network interface 686 may include a wireless network interface and/or a wired network interface. Processor 691 allows computing device 680 to execute computer readable instructions stored in memory 692 in order to perform processes discussed herein. Processor 691 may include one or more processing units, such as one or more CPUs and/or one or more GPUs. Memory 692 may comprise one or more types of memory (e.g., RAM, SRAM, DRAM, ROM, EEPROM, or Flash). Memory 692 may comprise a hardware storage device or a data storage device. The processor 691 and memory 692 may be configured to allow the computing device 680 to acquire thermal image information, color image information, and/or depth information from one or more capture devices and to process the acquired image information to track temperatures for regions of individuals within a temperature screening area. The image information may be used by the processor 691 to track one or more regions of an individual over time, determine temperatures for the one or more regions, and determine temperature measurement confidence values corresponding with the determined temperatures. The temperatures for the one or more regions and the temperature measurement confidence values may be stored within memory 692 or using a lookup table located on a data storage device. In at least one example, the computing device 680 may track a forehead region of an individual and a temporal region of the individual and store temperature data for the tracked regions on a periodic basis (e.g., every minute).

The temperature tracking engine 694 includes a skeletal tracking engine 690 and a region tracking engine 688. The skeletal tracking engine 690 may leverage a skeletal model of a human to help recognize body parts (e.g., arms, hands, and faces). The region tracking engine 688 may track one or more regions of an individual using image information acquired from capture devices 620 and 622. The region tracking engine 688 may use thermal image information, color image information, and/or depth information in order to detect a particular facial region of an individual and determine a surface temperature for the particular facial region. In the event that the particular facial region is determined to be obstructed due to people or objects within an environment blocking a view of the particular facial region, due to the individual facing away from a capture device, or due to the presence of a wearable obstruction to the particular facial region (e.g., a face mask), the region tracking engine 688 may delay storing temperature information for the particular facial region until reliable temperature information for the particular facial region is acquired.

FIG. 7A depicts a flowchart describing an embodiment of a process for identifying individuals that have exposed skin surface temperatures outside of a range of approved temperatures. In at least one embodiment, the process of FIG. 7A may be performed by a computing device, such as the computing device 680 in FIG. 6. In another embodiment, the process of FIG. 7A may be performed by a processor, such as processor 128 in FIG. 1 or processor 228 in FIG. 2. In some embodiments, the process or portions of the process of FIG. 7A may be performed using one or more virtual machines and one or more virtual storage devices.

In step 702, a first set of images corresponding with a first field of view (e.g., of a first imaging device) is acquired. In some cases, the first field of view may correspond with a field of view of a first imaging device, which may correspond with capture device 620 in FIG. 6, imaging device 110 in FIG. 1, or first imaging device 210 in FIG. 2. The first set of images may include color images and thermal images. In step 704, a facial region of a person within the first field of view of a first imaging device is identified using the first set of images. In step 706, a first surface temperature associated with the facial region of the person is determined. In at least one example, the facial region of the person may correspond with a forehead region of the person and the first surface temperature may be derived from a thermal image that includes at least a threshold number of pixels covering the forehead region of the person. Each pixel in a thermal image may correspond with a temperature value for the pixel.

In step 708, a temperature measurement confidence value for the first surface temperature is determined. In at least one example, if it is detected that the person is within a threshold distance (e.g., within thirty feet from the first imaging device), then the temperature measurement confidence value for the first surface temperature may be set to 1.0; otherwise, if it is detected that the person is not within the threshold distance, then the temperature measurement confidence value for the first surface temperature may be reduced to a value less than 1.0 based on the distance between the first imaging device and the person. In another example, if it is detected that the person was moving or walking when the first set of images were captured and a speed of movement is less than a threshold speed (e.g., is less than 3 miles per hour), then the temperature measurement confidence value for the first surface temperature may be set to 1.0; otherwise, if it is detected that the speed of movement for the person at the time that the first set of images were captured is greater than or equal to the threshold speed, then the temperature measurement confidence value for the first surface may be set to a value less than 1.0 (e.g., to 0.7) based on the speed of movement.

In step 710, it is detected that the first surface temperature exceeds a first temperature threshold (e.g., is greater than 99 degrees Fahrenheit) based on the first surface temperature and the temperature measurement confidence value. In at least one example, if the temperature measurement confidence value is greater than 0.9 and the first surface temperature exceeds the first temperature threshold (e.g., the first surface temperature exceeds 99 degrees Fahrenheit), then it may be detected that the first surface temperature exceeds the first temperature threshold. If the temperature measurement confidence value is less than 0.7, then the corresponding surface temperature may be deemed to be unreliable and not used for determining whether the first surface temperature has exceeded the first temperature threshold.

In step 712, the person is positioned within a second field of view (e.g., of a second imaging device different from the first imaging device) in response to detecting that the first surface temperature exceeds the first temperature threshold. In some cases, both the first field of view and the second field of view may be captured using the same imaging device. An imaging device may correspond with capture device 622 in FIG. 6. In some cases, the first field of view may be wider than the second field of view. A reduced field of view or a narrower field of view may improve the accuracy of a temperature screening by capturing a greater number of pixels of a targeted region of the person. An imaging device may reduce its field of view in order to capture a greater number of pixels of a targeted region of the person. The second imaging device may acquire or capture higher resolution thermal images compared with the first imaging device. The second imaging device may adjust an optical zoom of the second imaging device in order to capture at least a threshold number of pixels covering the facial region of the person.

In step 714, a second set of images corresponding with the second field of view of a second imaging device is acquired while the person is within the second field of view of the second imaging device. In step 716, a second surface temperature associated with the facial region of the person is determined using the second set of images. In at least one embodiment, the second surface temperature may correspond with a portion of the facial region less than the entire facial region. For example, if the facial region of the person comprises a forehead region of the person, then the portion of the facial region may comprise a small region between the eyes of the person.

In at least one embodiment, a number of pixels for the facial region of the person captured by the first set of images may comprise a first number of pixels and the number of pixels for the facial region of the person captured by the second set of images may comprise a second number of pixels greater than the first number of pixels. The second surface temperature associated with the facial region of the person may be determined by averaging temperature values for the pixels covering the facial region or by averaging the three highest temperature values for the pixels covering the facial region. In step 718, the second surface temperature associated with the facial region of the person is outputted. The second surface temperature may be transmitted to another computing device, such as a mobile computing device or smart phone. The second surface temperature may be displayed using an electronic display. In some embodiments, an internal core temperature for the person may be estimated using the second surface temperature.

FIG. 7B depicts a flowchart describing another embodiment of a process for identifying individuals that have exposed skin surface temperatures outside of a range of approved temperatures. In at least one embodiment, the process of FIG. 7B may be performed by a computing device, such as the computing device 680 in FIG. 6. In another embodiment, the process of FIG. 7B may be performed by a processor, such as processor 128 in FIG. 1 or processor 228 in FIG. 2. In some embodiments, the process or portions of the process of FIG. 7B may be performed using one or more virtual machines and one or more virtual storage devices.

In step 732, a first surface temperature associated with a region of a person (or a person) is determined. The region of the person may comprise a facial region or another region of the person's body, such as an exposed arm region or an exposed leg region. Along with the first surface temperature, a temperature measurement confidence value for the first surface temperature may be determined and stored. The temperature measurement confidence value may be determined based on a number of pixels covering the region of the person. In one example, the temperature measurement confidence value may comprise the number of pixels covering the region divided by 16. The temperature measurement confidence value may correspond with a confidence score or a reliability score for the first surface temperature. In at least one example, if a walking speed or a movement of the person at the time that the first surface temperature was captured was greater than a threshold speed, then the temperature measurement confidence value may be divided in half or set to 0.5; otherwise, the temperature measurement confidence value may be set to 1.0.

In step 734, it is detected that the first surface temperature exceeds a first temperature threshold based on the first surface temperature and the temperature measurement confidence value. It may be detected that the first surface temperature exceeded the first temperature threshold if the first surface temperature is greater than the first temperature threshold and the temperature measurement confidence value for the first surface temperature is greater than 0.7. In one embodiment, it may be detected that the first surface temperature exceeds the first temperature threshold (e.g., is greater than 99° F.) and that the temperature measurement confidence value exceeds a confidence value threshold (e.g., is greater than 0.7).

In some cases, an imaging device may be adjusted or reoriented in response to detecting that the first surface temperature exceeds a first temperature threshold and that the temperature measurement confidence value for the first surface temperature exceeds a confidence value threshold. In other cases, an imaging device may be adjusted or reoriented in response to detecting that the first surface temperature exceeds a first temperature threshold or that the temperature measurement confidence value for the first surface temperature is below a confidence value threshold.

In some embodiments, it may be determined whether an orientation of an imaging device should be adjusted or reoriented. In at least one embodiment, if the person is within a threshold distance of the imaging device, then the orientation of the imaging device will be adjusted to capture the region of the person. In another embodiment, if a speed of the person is less than a threshold speed, then the orientation of the imaging device will be adjusted to capture the region of the person.

In some embodiments, an imaging device may not be adjusted, reconfigured, or reoriented to position the person within a field of view of the imaging device if the person is redirected or moved to a designated location in front of the imaging device or otherwise positioned within the field of view of the imaging device.

In step 736, it is determined whether the person should be redirected or otherwise moved into a field of view of an imaging device. If it is determined that the person should be redirected into the field of view of an imaging device, then step 738 is performed. In step 738, an indication that the person should be directed or moved into the field of view of the imaging device is transmitted. In step 740, the indication that the person should be directed or moved into the field of view of the imaging device is displayed. In at least one example, the indication that the person should be directed into the field of view of the imaging device may be displayed by displaying textual instructions and/or symbols on a display screen. The display screen may comprise a display of a portable electronic device or a smart phone used by the person.

If it is determined that the imaging device should be adjusted or that the person should not be redirected into the field of view of the imaging device, then step 742 is performed. In step 742, the imaging device is adjusted such that the person is positioned within a field of view of the imaging device. The adjustment may comprise an orientation adjustment and/or an optical adjustment (e.g., adjusting an optical zoom) of the imaging device. In step 744, a second surface temperature associated with the region of the person is determined using a second set of images corresponding with the field of view of the imaging device. In step 746, the second surface temperature associated with the region of the person is outputted. In at least one embodiment, the second surface temperature associated with the region of the person may be transmitted to another computing device or displayed using an electronic display.

In some embodiments, the second surface temperature may be used to estimate or compute an internal core temperature for the person. A temperature offset may be determined from a lookup table based on a location of the region of the person and applied to the second surface temperature to compute the internal core temperature for the person. The second surface temperature associated with the region of the person may be determined by averaging temperature values for all pixels covering the region or by averaging the three highest temperature values for pixels covering the region of the person. The region may comprise an inner canthus region or an eye tear duct region of the person.

In some embodiments, it may be detected that a first surface temperature associated with a first region of the person has exceeded a first temperature threshold and then after positioning the person within a second field of view of a second imaging device, it may be detected that a second surface temperature associated with a second region of the person different from the first region of the person has exceeded a second temperature threshold. The regions of the person to which surface temperatures are determined before and after the second imaging device has been repositioned or reoriented may comprise the same region of the person or different regions of the person.

In some embodiments, upon detecting that a first surface temperature exceeds a first temperature threshold, the orientation of the imaging device and the optics of the imaging device may be adjusted such that the person is positioned within a field of view of the imaging device. The field of view may allow for a higher resolution of a target region of the person and/or for higher confidence scores for temperatures associated with the target region of the person. As a person walks within the field of view of the imaging device, the person walks closer to the imaging device, the relative speed of the person may slow down allowing for higher confidence scores for temperatures associated with the target region of the person.

FIG. 8A depicts an embodiment of a facility (or environment) having an entry area and a screened area separated by a checkpoint through which subjects (or individuals) are not permitted to pass unless having undergone a temperature screening process. In the illustrated example, subjects 830, 832, 834, 836, 838, and 840 are in or around facility 800, which includes an entry area 810 and screened area 820 separated by checkpoint 815. As shown, subjects 830 and 832 are outside of the facility 800, with subject 830 entering the facility via door 805. Subject 834 is standing idly within the entry area 810, while subjects 836, 838, and 840 are in a queue 850 in the entry area 810 to pass through checkpoint 815. In some cases, the facility may correspond with a hotel lobby or an entrance area within a grocery or retail store.

As discussed elsewhere herein subjects within the entry area 810 and outside of the facility 800 may have a variety of surface temperatures and relationships between their corresponding surface and core temperatures. For example, subject 830 entering facility 800 may have spent less time outside of the facility 800 than subject 832, who remains outside of the facility 800, and may have a surface temperature comparatively less affected by the environment outside of the facility than subject 832.

The facility 800 includes an infrared sensing device 860, shown as being positioned near the checkpoint 815 and subject 836 who is positioned at the front of the queue 850 closest to the checkpoint 815. In some examples, infrared sensing device 860 can be used to receive infrared (IR) radiation from a subject (e.g., subject 836) and provide temperature information representative of a surface temperature of the subject (e.g., a surface temperature of a facial region of the subject). In various examples, infrared sensing device 860 can include an infrared spot thermometer configured to provide a single temperature value associated with a target scene observed by the spot thermometer. In some examples, infrared sensing device 860 includes a temperature gun-style infrared sensing device in which the device is aimed at a subject for which a temperature measurement is to be taken.

In some examples, infrared sensing device 860 can include an infrared imaging tool having a plurality of infrared sensing elements, such as a plurality of bolometers. In some examples, each bolometer of a plurality of bolometers can be configured to absorb infrared energy focused through an infrared lens assembly and increase in temperature in response to the absorbed energy. The electrical resistance of each bolometer may change as the temperature of the bolometer changes. With each detector element functioning as a sensor pixel, a two-dimensional image or picture representation of the infrared radiation can be generated by translating the changes in resistance of each detector element into a time-multiplexed electrical signal that can be processed for visualization on a display or storage in memory (e.g., of a computing device). An infrared imaging tool can be configured to provide infrared image data representative of a scene.

As discussed elsewhere herein, in some cases, a surface temperature of a subject (e.g., of subject 836) may not provide enough information to determine a core temperature of the subject. The subject may have been standing in queue 850 for a long time (e.g., sufficiently long to become equilibrated to the environment of the entry area 810), or may have just recently entered the facility 800 from outside, which may be substantially warmer or colder than the inside of the facility 800.

FIG. 8B depicts an embodiment of a temperature screening system including components that can be used to determine a core temperature of a subject. The system includes a processor 870. Processor 870 may be implemented as one or more processors, such as one or more microprocessors, digital signal processors (DSPs), application specific integrated circuits (ASICs), field programmable gate arrays (FPGAs), programmable logic circuitry, or the like, either alone or in any suitable combination. Processor 870 may also include memory that stores program instructions and related data that, when executed by processor 870, enables processor 870 to perform the functions attributed to them in this disclosure. Memory may include any fixed or removable magnetic, optical, or electrical media, such as RAM, ROM, CD-ROM, magnetic disks, EEPROM, or the like. Memory may also include a removable memory portion that may be used to provide memory updates or increases in memory capacities. A removable memory may also allow data to be easily transferred to another computing device or removed. Processor 870 may also be implemented as a System on Chip that integrates some or all components of a computer or other electronic system into a single chip.

The temperature screening system of FIG. 8B includes an infrared sensing device 876 in communication with the processor 870. Infrared sensing device 876 can include a device such as infrared sensing device 860 in FIG. 8A. In some embodiments, wherein the infrared sensing device 876 includes an infrared imaging tool having a plurality sensors, such as bolometers, processor 870 is configured to measure the change in resistance of each bolometer by applying a current (or voltage) to each bolometer and measure the resulting voltage (or current) across the bolometer. Based on these data, the processor 870 can determine the amount of infrared energy emitted by different portions of a target scene. In some such examples, changing resistance by the bolometers as detected at the processor corresponds to the infrared imaging tool providing infrared image data to the processor.

The temperature screening system of FIG. 8B includes an imaging tool 880 configured to provide image data representative of a scene to the processor 870. In some cases, functionality of the imaging tool 880 is performed by the infrared sensing device 876, providing infrared image data to processor 870. In other examples, imaging tool 880 is separate from the infrared sensing device 876, and can include, for example, a visible light camera module, an infrared camera module, or other imaging tools. In some embodiments, the scene represented by the image data provided by the imaging tool 880 is the same as or otherwise overlaps a scene represented by infrared image data provided by the infrared sensing device 876. In some embodiments, systems can include an infrared camera module and a visible light camera module.

The temperature screening system of FIG. 8B includes an ambient temperature sensor 878 in communication with the processor 870. Ambient temperature sensor 878 can be configured to provide information to the processor 870 indicative of the ambient temperature of an environment, for example, of entry area 810 in FIG. 8A. Ambient temperature sensor 878 can include one or more thermocouples, thermistors, resistance temperature devices (RTDs) or other temperature sensing devices. In some embodiments, an infrared sensing device (e.g., 876) can be used to detect the surface temperature of an object in thermal equilibrium within the environment in order to determine the ambient temperature of the environment. In some embodiments, a plurality of temperature sensing devices may be placed at different locations within the entry area 810 and/or outside the facility 800 of FIG. 8A.

The temperature screening system of FIG. 8B includes a memory 872 in communication with processor 870. The processor can be configured to store information in memory 872, such as temperature information representative of a surface temperature of a subject, information representative of the ambient temperature of an environment, or the like. Memory 872 can store image data or graphical representations of data received or generated by the processor 870. Additionally or alternatively, in some examples, memory 872 can include instructions for causing processor 870 to perform one or more processes, such as those described herein. In various examples, memory 872 can include any fixed or removable magnetic, optical, or electrical media, such as RAM, ROM, CD-ROM, hard or floppy magnetic disks, EEPROM, or the like. Memory may also include a removable memory portion that may be used to provide memory updates or increases in memory capacities. In some embodiments, memory 872 can be integrated with processor 870, for example, including operating instructions for the processor 870.

In some embodiments, processor 870 may be configured to generate a display to visually present information, such as image data or other visual indications of data. The temperature screening system may include a display device 874 in communication with processor 870, and processor 870 can be configured to provide a generated display to the display device 874. In some examples, the display device 874 is a dedicated display, such as a monitor or television. In some embodiments, display device 874 can include a device such as a smartphone or tablet, for example, carried by a user tasked with screening subjects.

While various components are shown as being in communication with processor 870, communication can be accomplished via wired or wireless communication. In some embodiments, one or more components can be physically coupled to the processor 870 to facilitate communication therewith, such as via one or more wires, fiber optic cables, or the like. Additionally or alternatively, in some examples, one or more components can be in wireless communication with the processor 870, such as via Bluetooth, Wi-Fi, or the like.

In some embodiments, one or more components of the system shown in FIG. 8B can be included into a single device. For example, in some embodiments, processor 870 may be included within an infrared sensing device 876 that includes imaging tool 880 capabilities, a memory 872 and a display device 874. Various combinations are possible. In some cases, when the infrared sensing device 876 is an infrared imaging tool with a plurality of sensors, the infrared sensing device may include an External Temperature Reference Source (ETRS) within the field of view of the infrared imaging tool. By using the temperature and the known parameters of the surface of the ETRS, the infrared sensing device 876 and/or the processor 870 can correlate IR light image data corresponding with the ETRS with temperature information obtained by the infrared sensing device 876. This can help calibrate and increase the accuracy of the determined surface temperature of living beings (or individuals) within the field of view of the infrared imaging tool.

As described elsewhere herein, in some cases, an infrared sensing device (e.g., 876) can provide a surface temperature of a subject, but if the subject has not equilibrated to the environment, the surface temperature may not be a reliable indicator of a core temperature. Monitoring a subject's surface temperature over time may provide information that can be used to determine whether a subject's core temperature can be accurately determined using surface temperature measurements.

FIG. 9A depicts an embodiment of a process flow diagram for determining a core temperature of a subject accounting for variability in an equilibration process of the subject in an environment. The process of FIG. 9A includes receiving temperature information representative of a surface temperature of a subject at a plurality of times during step 900. Such receiving temperature information can be performed using an infrared sensing service (e.g., 876 in FIG. 8B) detecting a one-dimensional spot temperature or a two-dimensional IR image. In some examples, the temperature information from a two-dimensional IR image includes a maximum temperature determined within a particular region. For instance, in some embodiments, the temperature information representative of a surface temperature of a subject comprises a maximum temperature value from within a two-dimensional infrared image representation of a face of a subject. Such a value may occur, for example, at a canthus of the subject.

The process of FIG. 9A includes aggregating a set of temperature-time data including the surface temperature of the subject at the plurality of times during step 910. Aggregating the set of temperature-time data can include, for example, collecting and storing the surface temperatures at the plurality of times such that a plurality of the surface temperatures can be analyzed together as described herein.

The process further includes determining a figure of merit indicating if a core temperature of the subject can be accurately determined from the data set during step 920. In some examples, the figure of merit represents whether an accurate equilibrium surface temperature of the subject can be determined, which can reflect whether an accurate core temperature can be determined from the temperature-time data. For example, the figure of merit can include a subject stability figure of merit that indicates whether the subject has sufficiently equilibrated to the environment such that the most recent surface temperature measurement is approximately equal to an equilibrium surface temperature. In other examples, the figure of merit represents whether the set of temperature-time data can be accurately fit to a fitting function for predicting an equilibrium temperature, even if the equilibrium temperature has not yet been reached. Such a determination can be made, for example, using a sum of squares analysis comparing a fitting function to the temperature-time data. In some examples, if an accurate equilibrium surface temperature can be determined from the temperature-time data, an accurate core temperature can similarly be determined based on the accurate equilibrium surface temperature. In some examples, determining the core temperature of the subject based on the temperature-time data during step 960 includes determining an equilibrium surface temperature based on the temperature-time data. In other examples, the temperature-time data can be used to calculate the core temperature without explicitly calculating the equilibrium surface temperature.

In the illustrated process of FIG. 9A, the figure of merit can be compared to a threshold during step 930. If the figure of merit does not meet the threshold, the subject may continue to be monitored until an accurate equilibrium surface temperature and/or core temperature can be determined from the temperature-time data. In some examples, the subject can be directed to a holding area during step 940 to allow the subject to further equilibrate to the environment. Additionally or alternatively, in some examples, a speed of a queue in which subjects await screening/entry to a screened area (e.g., 820 in FIG. 8A) can be throttled during step 950 in order to provide subjects within the queue more time to equilibrate to the environment prior to making a determination as to whether a core temperature can accurately be determined from aggregated temperature-time data. Similarly, in some cases, if a figure of merit suggests an accurate equilibrium surface temperature or core temperature can be determined from the temperature-time data, queue speed can be increased. Queue speed adjustment can be performed based on analysis of temperature-time data of a single subject or based on an analysis of temperature-time data of a plurality of subjects. For example, in some cases, if a plurality of subjects consistently reveal figures of merit that do not meet a threshold (e.g., a streak of a predetermined number of subjects or a predetermined percentage of subjects, such as greater than 50% of a given number of subjects), queue speed can be throttled accordingly. Similarly, in some cases, if a plurality of subjects reveal figures of merit that do meet a threshold (e.g., a streak of a predetermined number of subjects or a predetermined percentage of subjects, such as greater than 50% of a given number of subjects), queue speed can be increased accordingly.

If the figure of merit meets the threshold, the core temperature of the subject can be accurately determined, and the process involves determining an equilibrium surface temperature of the subject based on the temperature-time data during step 960. In some embodiments, determining the equilibrium surface temperature comprises utilizing most-recent received temperature information as an equilibrium surface temperature. In other examples, determining the equilibrium surface temperature comprises utilizing one or more statistical algorithms, look-up tables, and/or curve-fitting techniques to analyze the temperature-time data and determine an equilibrium surface temperature (e.g., by extrapolating temperature-time data beyond the most recent received temperature information).

The process of FIG. 9A further comprises determining a core temperature of the subject during step 970. In some examples, determining the core temperature utilizes additional data, such as ambient temperature information, for example, using an ambient temperature sensor (e.g., 878 in FIG. 8B). In some examples, determining the core temperature comprises utilizing a determined equilibrium surface temperature to determine the core temperature, for example, using the equilibrium surface temperature and a body mode offset (or a temperature offset). Determining a core temperature based on an equilibrium surface temperature and ambient temperature can be performed using a lookup table, algorithm, or the like. In some embodiments, data for a lookup table can be generated empirically, for example, by allowing subjects to fully equilibrate at a variety of ambient conditions, measuring an equilibrium surface temperature and a core temperature (e.g., via a clinical oral thermometer or other core temperature measurement device) for the subject, and correlating a surface temperature, ambient temperature, and core temperature to generate a lookup table. In some embodiments, additional information is included in determining a body mode offset, such as the type of infrared sensing device used to acquire temperature information and the portion of the subject from which infrared radiation was received (e.g., a canthus, forehead, etc.). In an example embodiment, a body mode offset associated with a surface temperature of a subject's canthus is approximately 1.0° C. for an ambient environment temperature of roughly 20° C.

In some examples, an equilibrium surface temperature need not explicitly be calculated, and the temperature-time data itself can be used (e.g., in combination with ambient temperature information) to determine a core temperature. For example, in some embodiments, an algorithm or lookup table can be used to determine a core temperature using ambient temperature information and one or more data points in the temperature-time data.

With respect to FIGS. 8A and 8B, temperature-time data can be generated using infrared sensing device 860 and a processor (e.g., 870) in communication therewith receiving temperature information therefrom, for example, representative of a surface temperature of subject 836 at a plurality of times. The process of FIG. 9A can be performed with respect to subject 836 to determine whether the subject's core temperature can be accurately determined, and, if so, determine the subject's core temperature. Subject 836 may be granted or denied entry to screened area 820 at checkpoint 815 based on the subject's core temperature.

In some embodiments, systems may present various indicia to a user based on the results of the process of FIG. 9A. For instance, in some embodiments, a processor can be configured to provide information on a display device, such as an indication as to whether a subject's core temperature can be accurately measured and/or if so, a core temperature of the subject. The user can use such information to guide subject's subsequent action, such as granting the subject access to a screened area.

FIGS. 9B and 9C depict examples of temperature-time data that can be used to determine whether an accurate core temperature of a subject can be determined. FIG. 9B shows temperature-time data including surface temperatures T₁, T₂, T₃, T₄, and T₅ measured at times t₁, t₂, t₃, t₄, and t₅, respectively, as the temperature evolves over time following curve 980. In some embodiments, a figure of merit corresponds to a rate of temperature change, such as determining the rate of temperature change between the most recently captured data points in the temperature-time data. In some such examples, if the difference in surface temperature between two points in time is below a predetermined threshold (e.g., if the difference in surface temperature between two points in time is less than 0.2° C. per minute), the temperature is changing slowly enough that a reliable surface temperature and/or core temperature can be determined. For example, with respect to FIG. 9B, at time t₃, the difference in measured surface temperature between the most recent data points is T₃−T₂, which may be above a threshold to determine an equilibrium surface temperature or core temperature. However, at time t₅, the difference in measured surface temperature between the most recent data points is T₅−T₄, which is significantly smaller than T₃−T₂ and may be below the threshold. Thus, by time t₅, the subject's surface temperature may have equilibrated to the point of being able to accurately determine the surface temperature and/or core temperature of the subject. In some examples, if, at t₅, a rate of temperature change (e.g., T₅−T₄/t₅−t₄) is sufficiently small, T₅ can be considered an equilibrium surface temperature and used to determine a core temperature (e.g., using an algorithm or lookup table along with ambient temperature information).

FIG. 9C shows a different set of temperature-time data. In the example of FIG. 9C, temperatures T₆, T₇, T₈, T₉, and T₁₀ are measured at times t₁, t₂, t₃, t₄, and t₅, respectively. Fitting function 990 (e.g., a temperature fitting function) represents a curve fit to the temperature-time data. Fitting function 990 of FIG. 9C is an exponential function, though other fitting functions may be used. In some examples, a figure of merit represents how well the fitting function 990 fits the temperature-time data, such as by R-square and/or residual sum of squares analysis. In various examples, such analysis can be performed on the entire set of temperature-time data or on a most-recent subset of the temperature-time data (e.g., a predetermined number of most-recent data points or a predetermined amount of time worth of the most-recent data points).

In some examples, if the fitting function sufficiently fits the temperature-time data (e.g., the residual sum of squares is below a predetermined threshold), then the temperature-time data can be extrapolated to determine an equilibrium surface temperature based on the fitting function. The equilibrium surface temperature can be used to determine a core temperature of the subject. In some cases, using the equilibrium surface temperature to determine the core temperature need not involve explicitly identifying or outputting the equilibrium surface temperature value prior to determining the core temperature as described elsewhere herein.

Processes such as those described with respect to FIGS. 9A-9C can be performed, for example, via one or more processors (e.g., processor 870 in FIG. 8B). Surface temperature measurements using an infrared sensing device can provide a real-time surface temperature measurement of the subject without requiring the infrared sensing device itself to acclimate to an environment (unlike a contact temperature sensor like an oral thermometer, which changes temperature and must itself equilibrate to its environment). However, as described herein, in some cases, a subject itself must equilibrate to an environment and its measured surface temperature may change over time as it does so (as shown in FIGS. 9B-9C). Because a contact temperature sensor such as an oral thermometer accounts for its own temperature changes, it can be programmed with precise information regarding its own thermal characteristics or how it responds to various thermal environments. Because a thermometer itself is what acclimates to its environment to measure temperature, its characteristics such as mass, surface area, specific heat, and the like will be consistent between uses. However, as described elsewhere herein, the degree to which various subjects must equilibrate to an environment can depend on the subject's prior behavior and environments. Additionally, subjects with different mass, surface area, and clothing may equilibrate differently from one another. Accordingly, while an infrared sensing device can be used to acquire an instantaneous surface temperature of a subject, the equilibration of the subject to the environment can be accounted for by using temperature-time data as described herein.

Returning to FIG. 8A, as described elsewhere herein, infrared sensing device 860 can be used to collect temperature information representative of the surface temperature of, for example, subject 836 at a plurality of times to aggregate temperature-time data for subject 836. Various configurations are possible to facilitate aggregating temperature-time data for one or more subjects in an area (e.g., entry area 810).

FIG. 10A depicts an embodiment of a facility having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process. Similar to the facility depicted in FIG. 8A, the facility 800 shown in FIG. 10A includes an entry area 810 separated from a screened area 820 by a checkpoint 815. Door 805 provides an entry to the entry area 810 from outside the facility 800. Subjects 836, 838, 840 are shown in a queue 850 at checkpoint 815. Subject 834 is shown within a holding area 812 within the entry area 810.

As depicted, the facility 800 includes a plurality of infrared sensing devices 860, 862, 864 positioned proximate to queue 850 and generally along a pathway from the door 805 to the checkpoint 815. In some embodiments, one or more of a plurality of infrared sensing devices 860, 862, 864 can be used to provide temperature information to a system processor representative of a surface temperature of a subject at a point in time. For example, subject 836 may pass by infrared sensing devices 864, 862, 860 in order while traveling from the door 805 to checkpoint 815. Data from each of the infrared sensing devices representative of a surface temperature of a given subject (e.g., 836) can be aggregated as a set of temperature-time data associated with the subject, which can be used as described herein to determine whether an accurate equilibrium surface temperature of the subject can be determined from the temperature-time data.

Each of a plurality of infrared sensing devices (e.g., 864, 862, 860) can be positioned anywhere within the entry area 810. The infrared sensing devices can include, for example, staffed or automated stations at which subjects stop for screening in order to be screened a plurality of times to generate the temperature-time data associated therewith. In some such examples, staff at the staffed stations can manually log temperature information for the subject, for example, using a handheld infrared sensing device. In some examples, a subject may enter identifying information into an automated infrared sensing device and the infrared sensing device can provide temperature information representative of the subject's surface temperature automatically. In other examples, subjects may visit the infrared sensing devices and manually initiate measurement of his or her own surface temperature, for example using a fixed stationary infrared sensing device.

Temperature data may be associated with a particular subject based on a unique user identifier, such as a number or other identifier assigned to the subject. Such identifier may be entered along with temperature information collected at a given infrared sensing device in order to accumulate temperature-time data over time. In other examples, facial recognition or other automated recognition technology may be used to aggregate temperature information acquired at different times and to associate a set of temperature-time data with a particular subject. In some such examples, infrared image data representing a subject's face can be analyzed at a plurality of times, for example, at one or more infrared sensing devices. Facial recognition can be performed using the infrared image data, or can be done using other image data, such as visible light image data. A maximum temperature value from the infrared image data may be used as temperature data associated with the subject at a given time, and associated with the user within the system based on the facial recognition.

In some examples, a subject (e.g., 840) may enter queue 850. Upon reaching checkpoint 815, temperature-time data associated with the subject can be analyzed to determine whether an accurate equilibrium surface temperature can be determined based on the temperature-time data. If so, a core temperature of the subject can be determined such as described herein, and the subject can be admitted or denied access to screened area 820 based on the determined core temperature. If not, the subject may be directed to holding area 812 so that additional temperature information can be acquired for the subject. As shown in the illustrated example, an infrared sensing device 866 is included in the holding area 812 and can be used to collect additional temperature information associated with the subject. In some cases, the infrared sensing device 866 within the holding area 812 may comprise a higher resolution infrared camera compared with an infrared camera associated with infrared sensing device 864.

In some embodiments, a station including an infrared sensing device (e.g., 860, 862, 864, or 866) can include a display and can indicate to a subject at the station or a person staffing the station whether an accurate equilibrium surface temperature for the subject can be determined based on the temperature-time data associated with the subject.

FIG. 10B depicts an embodiment of a facility having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process. Similar to the facility in FIG. 10A, the facility 800 shown in FIG. 10B includes an entry area 810 separated from a screened area 820 by a checkpoint 815. Door 805 provides an entry to the entry area 810 from outside the facility 800. Subjects 836, 838, 840 are shown in a queue 850 at checkpoint 815. Subject 834 is shown within a holding area 812 within the entry area 810.

The facility 800 of FIG. 10B includes infrared sensing devices 890, 894. In the illustrated example, infrared sensing devices 890, 894 comprise infrared camera modules having fields of view 892, 896, respectively. Thus, infrared sensing devices 890, 894 can be configured to provide infrared image data that includes a two-dimensional representation of some or all of entry area 810. The location and pointing of infrared sensing devices 890 and 894 as shown in FIG. 10B is an example only. It will be clear to those skilled in the art that other locations might be chosen, such as the other corners of the entry area 810. There could also be fewer or more infrared sensing devices installed in order to provide optimal coverage of the entry area 810.

Infrared sensing devices 890, 894 can be configured to provide infrared image data to one or more processors (e.g., processor 870 in FIG. 8B). The one of more processors can be configured to determine, from the infrared image data provided by a given infrared sensing device, temperature information associated with each of the subjects within the field of view of the infrared sensing device. The one or more processors can be configured to determine a surface temperature of one or more subjects within the field of view of infrared sensing devices 890, 894 at each of a plurality of times to aggregate a set of temperature-time data associated with the subject.

In some embodiments, the one or more processors can be configured to track subjects through an area, such as through the entry area 810. Tracking can be performed in a variety of ways, for example, by assigning each subject a retroreflective tag or other item that can be detectable by an infrared sensing device. Tracking can also be performed by identifying subjects using track descriptors unique to each subject. Other tracking processes are possible. Probabilistic tracking techniques can also be used. Tracking a subject through a space allows the system to aggregate temperature information representative of a surface temperature for a given subject even if the subject moves throughout the entry area 810. In some cases, tracking further includes tracking a particular measurement surface of each subject, such as tracking a subject's face through a scene, and in some cases, tracking a maximum surface temperature of the subject's face through the scene.

In some embodiments, one or more processors (e.g., processor 870 in FIG. 8B) is configured to track one or more subjects within the scene while receiving temperature information associated with a surface temperature of such subjects. In some examples, a single set of received data (e.g., IR image data) can be used to track a subject and determine a surface temperature associated therewith. The one or more processors can receive temperature information for a subject at a plurality of times while tracking the subject within the entry area 810 such that the one or more processors can aggregate temperature-time data associated with the subject and perform one or more analyses described herein using the temperature-time data.

In some examples, the one or more processors are in communication with a display such that the one or more processors can output information associated with a subject on the display. For example, with respect to FIG. 10B, as subject 836 approaches checkpoint 815, a user may view information regarding the subject on a display (e.g., at a display station proximate to the checkpoint 815 or a tablet or smartphone held by the user), such as an indication as to whether an accurate equilibrium surface temperature can be determined, or a determined core temperature. The user can then direct subject 836 accordingly, such as admitting the subject into the screened area 820, performing a core temperature screening, directing the subject to remain in the entry area 810, or directing the subject to a holding area 812 to allow for the subject to equilibrate further to the environment.

In some embodiments, one or more processors in communication with infrared sensing devices 890 and 894 are configured to aggregate temperature-time data regarding surface temperature for each of one or more subjects within a field of view of the infrared sensing devices.

FIG. 10C shows an example data set that can be used to monitor subjects. The data set in FIG. 10C includes data for each of a plurality of subjects (N total subject), having respective subject IDs 1, 2, . . . , N. Subject IDs can be assigned to subjects, for example, by a tracking system and can include a variety of types of identifying information, such as numerical identifiers, track descriptors, or the like. In some embodiments, a subject may be assigned an ID upon entry into an entry area.

The data set of FIG. 10C includes, for each subject, a set of temperature-time data, an indication of whether an accurate equilibrium surface temperature or core temperature can be determined, and, if so, a core temperature measurement. A system including such a data set, for example, in a system memory (e.g., memory 872 in FIG. 8B) can provide information about a subject to a user, such as a user monitoring a checkpoint and selectively granting access to subjects based on the subject's core temperature and denying access to those whose equilibrium surface temperature or core temperature cannot be accurately determined. In some embodiments, a user can query a data set such as that shown in FIG. 10C to determine whether to admit a subject through a checkpoint into a screened area. In other examples, a user can query a data set to determine whether a subject's equilibrium surface temperature or core temperature can be accurately determined, and, if so, proceed to initiate a measurement of the subject's core temperature.

In some embodiments, a temperature screening system can be configured to collect data into a data set such as that shown in FIG. 10C using any variety of techniques for collecting temperature information at a plurality of times for a given subject, such as via techniques described herein. Subjects may be tracked within an entry area while remaining within a field of view of one or more infrared sensing device (e.g., via infrared sensing devices 890, 894 in FIG. 10B). Additionally or alternatively, subjects may stop at one or more temperature sensing devices (e.g., at pre-set stations) to have a surface temperature checked and logged in a data set as being associated with the subject (e.g., at infrared sensing devices 860, 862, 864 in FIG. 10B).

The data shown in the data set of FIG. 10C is an illustrative example. Temperature screening systems can also collect additional data, beyond that shown in the data set of FIG. 10C. In some embodiments, temperature screening systems may not automatically generate all of the information included in the data set of FIG. 10C. For instance, in some embodiments, systems can collect temperature information over time to aggregate temperature-time data associated with one or more subjects, and a determination of whether an accurate equilibrium surface or core temperature of a subject can be determined from the temperature-time data is made when a user queries the data set.

In an example embodiment described with respect to FIG. 10B, a subject approaches checkpoint 815 and a user queries a data set such as that shown in FIG. 10C to determine whether an accurate equilibrium surface temperature or core temperature of the subject can be determined from the temperature-time data associated with the subject. The user may query the data set via, for example, a workstation positioned proximate to the checkpoint 815 or via a device such as a smartphone or tablet.

In some examples, temperature-time data associated with a user can be aggregated while a user waits at an infrared sensing device.

FIG. 10D depicts an embodiment of a facility having an entry area and a screened area separated by a checkpoint through which subjects are not permitted to pass unless having undergone a screening process. Similar to the facility in FIG. 10B, the facility 800 shown in FIG. 10D includes an entry area 810 separated from a screened area 820 by a checkpoint 815. Door 805 provides an entry to the entry area 810 from outside the facility 800. Subjects 836, 838, 840 are shown near checkpoint 815. Subject 834 is shown within a holding area 812 within the entry area 810.

In the illustrated example of FIG. 10D, checkpoint 815 includes a plurality of infrared sensing device 860, 862, 864 positioned nearby. Each of subjects 836, 838, 840 is aligned with a corresponding one of the plurality of infrared sensing devices (860, 862, 864, respectively). In the example of FIG. 10D, a plurality of subjects can be screened simultaneously via the plurality of infrared sensing devices. Queues can form at each of the plurality of infrared sensing devices for scanning subjects at a faster rate. In some cases, subjects (e.g., subject 836) remains positioned proximate to a corresponding infrared sensing device (e.g., infrared sensing device 860) as temperature-time data associated with the subject is aggregated and until an accurate equilibrium surface temperature of the subject can be determined from the temperature-time data. Once an accurate equilibrium surface temperature of the subject can be determined, a core temperature of the subject can be determined to dictate whether the subject is granted access to screened area 820. In some cases, if an accurate equilibrium surface temperature of a subject cannot be determined, the subject is directed away from an infrared sensing device for further equilibration in the entry area 810 (e.g., in holding area 812).

FIGS. 10E and 10F provide example display configurations for monitoring a plurality of subjects at a checkpoint. FIG. 10E shows a display 1900 showing subjects 1902, 1904, 1906. Such subjects may be positioned proximate respective infrared sensing devices (e.g., 860, 862, 864 in FIG. 10D) or a single infrared sensing device (e.g., capable of providing two-dimensional infrared image data) from which one or more processors can receive temperature information representative of a surface temperature of a corresponding subject. In some embodiments, an imaging tool (e.g., 880 in FIG. 8B) can be used to provide image data to one or more processors to provide a visual representation of a subject. In other examples, while an image of subjects 1902, 1904, 1906 are shown on display 1900, the display can provide information regarding the subject without showing a visual representation of the subject.

The display 1900 in FIG. 10E includes a status box 1912, 1914, 1916 corresponding to each subject 1902, 1904, 1906, respectively. In the example of FIG. 10E, the status box includes information regarding whether an accurate equilibrium surface temperature for the subject can be determined (“Yes” or “No” in the top line) as well as instructions for how the subject should be analyzed going forward (e.g., with instructions provided in the bottom line of the status box).

In the illustrated example, one or more processors determined that an accurate equilibrium surface temperature for subject 1902 could not be determined (“No” in the top line of status box 1912), and instruct a user to hold the subject 1902 at the infrared sensing device for further data collection and/or subject equilibration (“Hold” in the bottom line of status box 1912). With respect to subjects 1904, 1906 one or more processors determined that an accurate equilibrium surface temperature for the subjects could be determined (“Yes” in the top line of status boxes 1914, 1916) and instructs a user to proceed to measure a core temperature of the subjects (“Measure” in the bottom line of status boxes 1914, 1916). In some such examples, a user may initiate a core temperature measurement, for example, using an equilibrium surface temperature (e.g., a most recent data point in the temperature-time data or an extrapolated equilibrium temperature based on a fitting function) and a body mode offset.

FIG. 10F shows a display 1920 showing subjects 1922, 1924, 1926. Such subjects may be positioned proximate respective infrared sensing devices (e.g., 860, 862, 864 in FIG. 10D) from which one or more processors can receive temperature information representative of a surface temperature of a corresponding subject. The display 1920 in FIG. 10F includes a status box 1932, 1934, 1936 corresponding to each subject 1922, 1924, 1926, respectively. In the example of FIG. 10F, the status box includes information regarding whether an accurate equilibrium surface temperature for the subject can be determined (“Yes” or “No” in the top line) as well as, if available, a core temperature value associated with the subject.

In the illustrated example, one or more processors determined that an accurate equilibrium surface temperature for subject 1922 could not be determined (“No” in the top line of status box 1932), and instruct a user to hold the subject 1922 at the infrared sensing device for further data collection and/or subject equilibration (“Hold” in the bottom line of status box 1932). With respect to subjects 1924, 1926 one or more processors determined that an accurate equilibrium surface temperature for the subjects could be determined (“Yes” in the top line of status boxes 1934, 1936). As described elsewhere herein, one or more processers can be configured to, if an accurate equilibrium surface temperature of a subject can be determined, determine a core temperature of the subject. In the example of FIG. 10F, if an accurate equilibrium surface temperature of the subject can be determined, one or more processors can determine a core temperature of the subject (e.g., using the temperature-time data to determine an equilibrium surface temperature and a body mode offset based on an ambient temperature). In the example of FIG. 10F, status boxes 1934 and 1936, corresponding to subjects 1924 and 1926 for which accurate equilibrium surface temperatures can be determined (“Yes in the top line of the status boxes), include core temperature information in the bottom line of the status box. For instance, in the illustrated example, subject 1924 has a determined core temperature of 98.6° F. and subject 1936 has a determined core temperature of 102° F.

Subsequent action can be taken for each of the subjects 1922, 1924, 1926 in FIG. 10F. Subject 1922 can be kept at the corresponding infrared sensing device for further monitoring until an accurate equilibrium surface temperature can be determined or can be directed back into the entry area (e.g., a holding area) to allow the subject to further equilibrate. Subject 1924 may be granted access to a screened area, since the subject's temperature is deemed to be able to be accurately determined and is an appropriate core temperature. Subject 1926 shows a high temperature and may be removed from the facility or otherwise directed to a designated area, but may be denied access to a screened area in view of the high temperature.

Various configurations have been shown herein for acquiring temperature-time data associated with a subject in a space (e.g., in an entry area) in order to determine whether the subject's equilibrium surface temperature and/or core temperature can be accurately measured using the temperature-time data. In various examples, any combination of such configurations can be used. For example, one or more infrared imaging tools having a field of view through which subjects can be tracked as in FIG. 10B can be used in conjunction with one or more stations with local surface temperature measurement devices positioned within an entry area, for example at infrared sensing devices 860, 862, 864 in FIG. 10A. Data can be collected from any combination of infrared sensing devices to aggregate temperature-time data associated with the subject including the surface temperature of the subject at each of the plurality of times.

The temperature-time data from such configurations can be used in a variety of ways to make such a determination, and, if an accurate equilibrium surface temperature and/or core temperature can be determined, systems can use the temperature-time data to determine such temperature(s).

FIG. 10G depicts a process flow diagram showing a plurality of techniques for determining whether an accurate temperature can be determined. The process includes collecting at least two data points representing a subject's surface temperature at different times during step 1000 and determining a surface temperature rate of change based on two data points during step 1010. This can include, for example, analyzing two most recent temperature measurements and determining a rate of temperature change, such as in degrees/second. Consecutively collected data points need not be used for determining a rate of change, and in some cases, a plurality of rates of change using different data points can be calculated and averaged. Similarly, in some embodiments, more than two data points can be used to analyze the variation of temperature over time from a set of temperature-time data. For example, in some embodiments, a standard deviation or span of all or a subset of the temperature-time data can be used to analyze the rate of surface temperature change over time. In some such examples, more recent data is weighed more heavily than earlier data, as a rate of temperature change decrease as the subject approaches equilibrium surface temperature. In other examples, less recent data with a higher rate of change is weighed more heavily than later data.

The determined rate of change can be compared to a threshold during step 1020. If the rate of change is below a threshold, then a most recent surface temperature can be considered approximately equal to an equilibrium surface temperature during step 1030. In this case the method can include determining an equilibrium surface temperature and/or a core temperature for the subject during step 1040.

As noted, in some embodiments, if the rate of change is below the threshold in step 1020, a most recent measurement can be considered an equilibrium surface temperature. Additionally or alternatively, in some cases, determining a core temperature comprises using an equilibrium surface temperature and a body mode offset (e.g., based on an ambient temperature and using an algorithm or lookup table) to determine the core temperature.

In the example of FIG. 10G, if the rate of temperature change is not below the threshold at step 1020, the method includes analyzing and/or acquiring additional temperature information at one or more additional times during step 1050. Acquiring additional temperature information can include receiving temperature information from one or more infrared sensing devices at a time that is more recent than the data used to determine the rate of temperature change in step 1010. In some embodiments, the process includes acquiring additional, more recent temperature information at step 1050, and, after acquiring additional temperature information at step 1050, the process repeats to determine a new surface temperature rate of change during step 1010 and determine if more recent temperature information reveals a rate of change below the threshold at step 1020. The process can continue until a rate of change falls below the threshold and the equilibrium surface temperature is reached.

In some embodiments, if a rate of change determined from two data points is not below the threshold, additional data can be acquired or analyzed (beyond the two data points) to perform additional analysis, such as fitting accumulated temperature-time data to a fitting function. The process of FIG. 10G includes acquiring and/or analyzing additional temperature information during step 1050 (e.g., beyond two data points used to determine a rate of temperature change) and fitting three or more data points to a fitting function during step 1060. The fitting function can include, for example, an exponential function such as shown in FIG. 9C.

The process shown in FIG. 10G includes determining whether enough data is collected or otherwise used to perform an adequate fitting function during step 1070. In some examples, a number of data points being fit and/or a time span over which the data points being fit are compared to various thresholds and if the number of data points or time spanned by the data is below a threshold, then additional data is collected or otherwise added to the analysis at step 1050. In some cases, the threshold time span may comprise at least one or two minutes. After more data is acquired or otherwise analyzed, the updated data can be fit to a fitting function at step 1060.

In addition or alternatively to determining whether enough data is used (at step 1070), the method can include determining whether the fitting function is a good fit to the analyzed data during step 1080. For example, such analysis can include determining how well a fitting function fits the data, such as by a residual sum of square or other analysis. If the fitting function does not fit the data well (e.g., the residual sum of squares is above a threshold), the fit can be considered inadequate or unreliable, for example, for predicting an asymptotic equilibrium surface temperature.

Thus, in various examples, when three or more data points are fit to a fitting function, a figure of merit representing whether an accurate equilibrium surface temperature of the subject can be determined can include a number and/or time span of temperature-time data. Additionally or alternatively, a figure of merit can include a representation of whether a fitting function accurately reflects the temperature-time data.

If a number of data points and/or time span of collected data points is used as a figure of merit, and the number and/or span falls below a threshold, additional data can be collected during step 1050 and the fit repeated during step 1060 with the new data. As shown in FIG. 10G, in some examples, if enough data is collected/used to deem the fit reliable or sufficient at step 1070, the process moves to determining the subject's equilibrium surface temperature and/or core temperature during step 1040 based on the fitting function (e.g., using a temperature asymptote associated with the fitting function). In other examples, even if sufficient data is collected, the process proceeds to determining whether the fitting function sufficiently reflects the temperature-time data at step 1080. If not, additional data is acquired and/or added to the analysis during step 1050 and the fit is repeated during step 1060 with the additional data. If the fitting function provides a sufficiently accurate representation of the temperature-time data (e.g., a residual sum of squares metric is below a threshold), then the process proceeds to determining the subject's equilibrium surface temperature and/or core temperature during step 1040.

As described, in various embodiments, a data threshold (e.g., number of data points and/or time span reflected by data points) as in step 1070, a fit sufficiency threshold (e.g., using a residual sum of squares threshold or the like) as in step 1080, or both can be used to determine whether a subject's equilibrium surface temperature can be accurately determined using the temperature-time data. If the one or both thresholds analyzed in a given embodiment are satisfied, the process can proceed to determining an equilibrium surface temperature and/or a core temperature during step 1040.

The example process shown in FIG. 10G includes both rate of change and fitting function analyses. In some examples, both such processes can be used. For example, a temperature screening system (e.g., via one or more processors) can be configured to determine if a rate of temperature change is below a threshold and, if so, consider a most-recent temperature to be an equilibrium surface temperature. However, if not, the system can fit temperature-time data to a fitting function to determine an asymptotic equilibrium surface temperature. However, in other examples, only a rate of temperature change is analyzed, and temperature-time data can be collected until the rate of temperature change falls below a threshold. In still other examples, fitting the temperature-time data to a fitting function is the only analysis for determining an equilibrium surface temperature or whether an accurate equilibrium surface temperature can be determined. Various combinations of processes and analyses are possible.

As described elsewhere herein, in some embodiments, determining a core temperature includes determining a subject's equilibrium surface temperature and calculating a core temperature using a body mode offset (or a temperature offset). In various embodiments, the determining the core temperature can be performed using an equilibrium surface temperature and body mode offset based on a lookup table or algorithm.

Processes such as those described herein, for example, with respect to FIGS. 9A and 10G, can, in various embodiments, be used to determine whether a given subject's equilibrium surface temperature can be accurately determined and/or in some cases, when (at what point in time) an accurate equilibrium surface temperature can be determined. The subject's core temperature can be determined, for example, using an equilibrium surface temperature and a body mode offset. This can eliminate excess downtime experienced by subjects who may otherwise be forced to wait in an entry area for longer than necessary to equilibrate to ambient conditions. For example, if an equilibrium surface temperature can be determined from a fitting function (e.g., an asymptote of a fitting function to which the temperature-time data is fit), an equilibrium surface temperature and/or a core temperature can be determined using the determined surface temperature even if the subject has not fully equilibrated.

Additionally or alternatively, processes such as those described herein can prevent inaccurate screenings of subjects who have not yet equilibrated to the environment such that an instantaneous surface temperature measurement cannot be reliably used to determine a core temperature. Thus, reliability, safety, and efficiency of a contactless temperature screening system can be increased by analyzing, on a subject-by-subject basis, whether the subject's equilibrium surface temperature can be accurately determined by using temperature-time data representative of subject's surface temperature at a plurality of times. Additionally, using temperature-time data as described herein can account for subjects' surface temperature equilibration to the surrounding environment (e.g., by verifying the subject has equilibrated by looking at a rate of temperature change of the subject or by fitting the temperature-time data to a fitting function) and can be more accurate in determining a surface temperature and/or core temperature when compared to a single surface temperature measurement at a single point in time.

In some examples, temperature screening systems can manage subjects based on whether an accurate equilibrium surface temperature can be determined, such as by directing subjects for which an accurate equilibrium surface temperature cannot be determined to a holding area or otherwise requiring such subjects remain in an entry area for further screening. In some examples, systems can be configured to cause ambient air to flow through an area in which subjects are equilibrating (e.g., entry area 810 in FIG. 10A), such as by one or more fans. Blowing ambient air through the area and onto the subjects in the area may help the subject equilibrate to the area more quickly. In some examples, fitting functions as described herein can account for increased airflow of ambient air through an area. Additional or alternative environmental controls can be used, such as a tent or similar structure to block wind, sunlight, and/or precipitation in the entry area where subjects acclimate.

Various embodiments described herein refer to determining whether an accurate equilibrium surface temperature or an accurate core temperature can be determined. In some cases, such determinations are synonymous. For instance, in some examples, an equilibrium surface temperature is used to determine a core temperature as described herein (e.g., using an equilibrium surface temperature and a body mode offset). In such examples, if the equilibrium surface temperature cannot be accurately determined, then the core temperature similarly cannot be accurately determined. Thus, in some embodiments, whether an accurate core temperature can be determined is analogous to whether an accurate equilibrium surface temperature can be determined. In other examples, temperature-time data can be used to calculate a core temperature without explicitly determining an equilibrium surface temperature, for example, wherein an algorithm for calculating a core temperature uses temperature-time data and a body mode offset without explicitly determining an equilibrium surface temperature. Some such instances utilize the same data and analyses to determine a core temperature as when determining an equilibrium surface temperature even if a surface temperature value is not expressly calculated or presented. In such examples, an inability to accurately determine an accurate equilibrium surface temperature corresponds to an inability to accurately determine a core temperature.

In some embodiments, temperature screening systems (e.g., one or more processors) can be configured to learn or calibrate operation over time. For example, in some embodiments, an equilibrium surface temperature or core temperature for one or more subjects may be measured or estimated based on processes described herein, such as by determining a surface temperature asymptote based on fitting temperature-time data to a fitting function. The subject can then be shunted back into the entry area for further equilibration. A subsequent surface or core temperature can be performed after additional equilibration time in the entry area and compared to the prior measured or estimated value. The system can learn whether an accurate equilibrium surface temperature and/or core temperature was made in the initial measurement or estimation. In some examples, a system can be configured to generate or update one or more thresholds based on such information.

For instance, in an example scenario, at the time of the initial determination of an equilibrium surface temperature, the rate of temperature change was X degrees per second and a most-recent data point was used as an estimated surface temperature. However, after further equilibration and surface temperature analysis, the initial estimated surface temperature was incorrect. In such an instance, a threshold rate of temperature change for determining whether an accurate equilibrium surface temperature can be determined or has been reached should be lower than X. A temperature rate of change of X degrees per second is insufficient to consider a most recent data point of the temperature-time data an accurate equilibrium surface temperature.

Similarly, in another example scenario, at the time of the initial determination, at least three data points from a set of temperature-time data are fit to a fitting function and an asymptotic equilibrium surface temperature is estimated. However, if the estimated asymptotic equilibrium surface temperature is sufficiently different (e.g., more than a threshold amount of difference) from the actual surface temperature measured after further equilibration, the data fit was insufficient to determine an accurate equilibrium surface temperature. In various examples, a fitting parameter associated with the data (e.g., a residual sum of squares or R-square metric) can be considered inadequate for determining an accurate equilibrium surface temperature. Additionally or alternatively, in some examples, the number of temperature-time data points and/or the time span of the temperature-time data used in the fitting is insufficient. Such information can be used to adjust decisions made by the system in future analyses. Various non-limiting examples have been described.

FIG. 11A depicts an embodiment of temperature-time data sequence 1110-1113 corresponding with temperatures of a first facial region (e.g., a cheek region) of a first individual between times t₁ and t₄, a temperature fitting function 1102 associated with a forehead region of a person with a first body type (e.g., with a first height, a first width, and/or a first surface area), and a temperature fitting function 1104 associated with a cheek region of a person with the first body type. The temperature profile of a temperature fitting function may depend on a specific facial region of an individual's face as some regions may warm or equilibrate at a faster rate than other regions. The temperature fitting function 1104 associated with the cheek region of a person with the first body type has an asymptotic surface temperature for the cheek region of temperature T₂. The temperature fitting function 1102 associated with the forehead region of a person with the first body type has an asymptotic surface temperature for the forehead region of temperature T₁.

In some embodiments, for a particular facial region (e.g., a cheek region), a plurality of temperature fitting functions may be stored within a lookup table or database with each temperature fitting function corresponding with a particular asymptotic surface temperature for the particular facial region. In at least one example, a cheek region of a person with a first body type may be associated with a first temperature fitting function corresponding with an asymptotic surface temperature of 99° F., a second temperature fitting function corresponding with an asymptotic surface temperature of 99.5° F., and a third temperature fitting function corresponding with an asymptotic surface temperature of 100° F.

As depicted in FIG. 11A, a subset of the temperature-time data sequence 1110-1113 comprising the temperature-time data points 1111-1113 have satisfied a goodness-of-fit measure with the temperature fitting function 1104 or have been deemed sufficient to extrapolate an asymptotic surface temperature for the first facial region of the first individual as a curve fitting error between the temperature-time data points 1111-1113 and the temperature fitting function 1104 is below a threshold error value. In response to detecting that a portion of the temperature-time sequence 1110-1113 has a sufficient fit with the temperature fitting function 1104, the temperature-time sequence 1110-1113 may be deemed sufficient to determine the asymptotic surface temperature associated with the temperature fitting function 1104 of temperature T₂.

In some embodiments, a computing device, such as computing device 680 in FIG. 6, may acquire a temperature-time sequence for a first facial region of an individual from one or more image capturing devices, such as capture device 620 in FIG. 6. The computing device may acquire a plurality of temperature fitting functions for the first facial region from a lookup table or database and determine a plurality of curve fitting errors for the temperature-time sequence as applied to the plurality of temperature fitting functions. In response to detecting that a first temperature fitting function of the plurality of temperature fitting functions has a curve fitting error below a threshold error or has a goodness-of-fit measure that has been satisfied, such as having an R-squared value greater than 0.9, the computing device may detect that the temperature-time sequence is sufficient to extrapolate the asymptotic surface temperature corresponding with the first temperature fitting function.

FIG. 11B depicts an embodiment of temperature-time data sequence 1130-1133 corresponding with temperatures of a first facial region (e.g., a cheek region) of a second individual between times t₁ and t₄, a temperature fitting function 1122 associated with a forehead region of a person with a second body type different from the first body type (e.g., with a second height, a second width, and/or a second surface area), and a temperature fitting function 1124 associated with a cheek region of a person with the second body type. Therefore, in some embodiments, temperature fitting functions may vary depending on a location of an exposed surface region of an individual, the individual's height and weight, and an estimated surface area for the individual. The temperature fitting function 1124 associated with the cheek region of a person with the second body type has an asymptotic surface temperature for the cheek region of temperature T₄. The temperature fitting function 1122 associated with the forehead region of a person with the second body type has an asymptotic surface temperature for the forehead region of temperature T₃.

As depicted in FIG. 11B, a subset of the temperature-time data sequence 1130-1133 comprising the temperature-time data points 1131-1133 have satisfied a goodness-of-fit measure with the temperature fitting function 1124 or have been deemed sufficient to extrapolate an asymptotic surface temperature for the first facial region of the second individual as a curve fitting error between the temperature-time data points 1131-1133 and the temperature fitting function 1124 is below a threshold error value (or have an R-squared value greater than 0.9). In response to detecting that a portion of the temperature-time sequence 1130-1133 has a sufficient curve fit with the temperature fitting function 1124, the temperature-time sequence 1130-1133 including the temperature-time data points 1131-1133 may be deemed sufficient to determine or identify the asymptotic surface temperature associated with the temperature fitting function 1124 of temperature T₄.

FIG. 12A depicts a flowchart describing an embodiment of a process for performing temperature screening of individuals within a dynamic environment. In at least one embodiment, the process of FIG. 12A may be performed by a computing device, such as the computing device 680 in FIG. 6. In another embodiment, the process of FIG. 12A may be performed by a processor, such as processor 870 in FIG. 8B. In some embodiments, the process or portions of the process of FIG. 12A may be performed using one or more virtual machines and one or more virtual storage devices.

In step 1202, a set of images of an environment is acquired from one or more imaging devices. The one or more imaging devices may include a capture device, such as capture device 620 in FIG. 6. In step 1204, a facial region of a person within the environment is tracked over a first time period using the set of images. In some cases, the facial region of the person may comprise a cheek region, a forehead region, an orbital region of the person's face, or a temporal region of the person's face. In step 1206, a plurality of temperatures corresponding with the facial region of the person during the first time period is acquired. In step 1208, a temperature-time sequence for the facial region of the person is generated using the plurality of temperatures. The temperature-time sequence may comprise a sequence of temperature-time data points, wherein each temperature-time data point corresponds with a determined temperature of the facial region at a particular point in time during the first time period. In step 1210, a temperature fitting function is identified based on the facial region of the person.

In step 1212, an asymptotic surface temperature for the facial region of the person is determined using the temperature fitting function and the temperature-time sequence. In some cases, the asymptotic surface temperature for the facial region of the person may be determined in response to detecting that the temperature-time sequence is sufficient to determine the asymptotic surface temperature for the facial region of the person. In at least one example, it may be detected that the temperature-time sequence is sufficient to determine the asymptotic surface temperature for the facial region of the person if the temperature-time sequence fits the temperature fitting function with a curve fitting error below a threshold error value. In step 1214, a core body temperature (or an internal core temperatures) for the person is determined based on the asymptotic surface temperature for the facial region of the person. In at least one embodiment, the core body temperature may be calculated using a temperature offset associated with the facial region of the person applied to the asymptotic surface temperature determined in step 1212. In step 1216, the core body temperature for the person is outputted. The core body temperature may be outputted by transmitting the core body temperature to a portable electronic device or by displaying the core body temperature using a display.

FIG. 12B depicts a flowchart describing another embodiment of a process for performing temperature screening of individuals within a dynamic environment. In at least one embodiment, the process of FIG. 12B may be performed by a computing device, such as the computing device 680 in FIG. 6. In another embodiment, the process of FIG. 12B may be performed by a processor, such as processor 870 in FIG. 8B. In some embodiments, the process or portions of the process of FIG. 12B may be performed using one or more virtual machines and one or more virtual storage devices.

In step 1232, a plurality of temperatures corresponding with a region of a person during a time period is acquired. In step 1234, a temperature-time sequence for the region of the person is generated using the plurality of temperatures. In step 1236, a temperature fitting function is identified based on the region of the person. In one example, the region of the person may comprise a cheek region and the temperature fitting function may correspond with the temperature fitting function 1104 in FIG. 11A. In step 1238, it is detected that the temperature-time sequence is sufficient to determine an asymptotic surface temperature for the region of the person. In step 1240, the asymptotic surface temperature for the region of the person is determined using the temperature fitting function and the temperature-time sequence. In step 1242, a body mode offset (or temperature offset) is determined based on a location of the region of the person. In one example, a cheek region of the person may be associated with a first body mode offset and a forehead region of the person may be associated with a second body mode offset different from the first body mode offset. In step 1244, a core body temperature for the person is estimated based on the asymptotic surface temperature for the region of the person and the body mode offset determined in step 1242. In step 1246, the core body temperature for the person is outputted. The core body temperature for the person may be outputted by transmitting information associated with the core body temperature to a computing device or by displaying the information associated with the core body temperature.

At least one embodiment of the disclosed technology comprises a temperature screening system including a storage device (e.g., a semiconductor memory) and one or more processors in communication with the storage device. The storage device configured to store a plurality of temperatures corresponding with a facial region of a person during a time period. The one or more processors are configured to generate a temperature-time sequence for the facial region of the person using the plurality of temperatures, identify a temperature fitting function based on the facial region of the person, determine an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence, estimate a core body temperature for the person based on the asymptotic surface temperature for the facial region of the person, and output the core body temperature for the person.

In some cases, the disclosed technology may further include one or more processors configured to estimate a mass or surface area of the person and identify the temperature fitting function based on the mass of the person and/or the surface area of the person. The disclosed technology may further include one or more processors configured to determine a walking speed for the person during the time period and determine a plurality of temperature measurement confidence values corresponding with the plurality of temperatures based on the walking speed for the person during the time period. The one or more processors may also be configured to detect that the temperature-time sequence is sufficient based on the plurality of temperature measurement confidence values corresponding with the plurality of temperatures.

At least one embodiment of the disclosed technology includes acquiring a plurality of temperatures corresponding with a facial region of a person during a time period, generating a temperature-time sequence for the facial region of the person using the plurality of temperatures, identifying a temperature fitting function based on the facial region of the person, determining an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence, estimating a core body temperature for the person based on the asymptotic surface temperature for the facial region of the person, and outputting the core body temperature for the person.

In some cases, the disclosed technology may further include determining the asymptotic surface temperature for the facial region of the person by extrapolating the asymptotic surface temperature for the facial region of the person from the temperature fitting function in response to detecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature for the facial region of the person. The disclosed technology may further include detecting that the temperature-time sequence is sufficient to determine the asymptotic surface temperature for the facial region of the person by computing a fitting error between the temperature-time sequence and the temperature fitting function and detecting the temperature-time sequence is sufficient to determine the asymptotic surface temperature in response to the fitting error being below a threshold error value.

At least one embodiment of the disclosed technology includes acquiring a plurality of temperatures corresponding with a facial region of a person during a first time period, generating a temperature-time sequence for the facial region of the person during the first time period using the plurality of temperatures, determining an amount of surface area for the person, identifying a temperature fitting function based on a location of the facial region of the person and the amount of surface area for the person, determining an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence in response to detecting that the temperature-time sequence is sufficient to determine the asymptotic surface temperature for the facial region of the person, wherein the asymptotic surface temperature for the facial region of the person is greater than any temperature of the plurality of temperatures. The method may further include determining a core body temperature for the person based on the location of the facial region of the person and the asymptotic surface temperature for the facial region of the person and outputting the core body temperature for the person.

In some cases, the disclosed technology may further include determining an air flow within the environment and identifying the temperature fitting function based on the air flow within the environment.

The disclosed technology may be described in the context of computer-executable instructions being executed by a computer or processor. The computer-executable instructions may correspond with portions of computer program code, routines, programs, objects, software components, data structures, or other types of computer-related structures that may be used to perform processes using a computer. Computer program code used for implementing various operations or aspects of the disclosed technology may be developed using one or more programming languages, including an object oriented programming language such as Java or C++, a function programming language such as Lisp, a procedural programming language such as the “C” programming language or Visual Basic, or a dynamic programming language such as Python or JavaScript. In some cases, computer program code or machine-level instructions derived from the computer program code may execute entirely on an end user's computer, partly on an end user's computer, partly on an end user's computer and partly on a remote computer, or entirely on a remote computer or server.

The flowcharts and block diagrams in the figures provide illustrations of the architecture, functionality, and operation of possible implementations of systems, methods, and computer program products according to various aspects of the disclosed technology. In this regard, each block in a flowchart may correspond with a program module or portion of computer program code, which may comprise one or more computer-executable instructions for implementing the specified functionality. In some implementations, the functionality noted within a block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. In some implementations, the functionality noted within a block may be implemented using hardware, software, or a combination of hardware and software.

For purposes of this document, it should be noted that the dimensions of the various features depicted in the figures may not necessarily be drawn to scale.

For purposes of this document, reference in the specification to “an embodiment,” “one embodiment,” “some embodiments,” or “another embodiment” may be used to describe different embodiments and do not necessarily refer to the same embodiment.

For purposes of this document, a connection may be a direct connection or an indirect connection (e.g., via another part). In some cases, when an element is referred to as being connected or coupled to another element, the element may be directly connected to the other element or indirectly connected to the other element via intervening elements. When an element is referred to as being directly connected to another element, then there are no intervening elements between the element and the other element.

For purposes of this document, the term “based on” may be read as “based at least in part on.”

For purposes of this document, without additional context, use of numerical terms such as a “first” object, a “second” object, and a “third” object may not imply an ordering of objects, but may instead be used for identification purposes to identify different objects.

For purposes of this document, the term “set” of objects may refer to a “set” of one or more of the objects.

In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.

Claims

1. A method for temperature screening, comprising: acquiring a plurality of temperatures corresponding with a facial region of a person during a time period;generating a temperature-time sequence for the facial region of the person using the plurality of temperatures;identifying a temperature fitting function based on the facial region of the person;determining an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence;estimating a core body temperature for the person based on the asymptotic surface temperature for the facial region of the person; andoutputting the core body temperature for the person.

2. The method of claim 1, wherein: the determining the asymptotic surface temperature for the facial region of the person includes extrapolating the asymptotic surface temperature for the facial region of the person from the temperature fitting function in response to detecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature for the facial region of the person.

3. The method of claim 2, wherein: the detecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature for the facial region of the person includes computing a fitting error between the temperature-time sequence and the temperature fitting function and detecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature in response to the fitting error being below a threshold error value.

4. The method of claim 2, wherein: the detecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature includes detecting that the temperature-time sequence accumulated a threshold number of data points and that a rate of change for a subset of data points in the temperature-time sequence is below a threshold rate of change.

5. The method of claim 1, wherein: the identifying the temperature fitting function includes acquiring the temperature fitting function from a lookup table based on the facial region of the person and further based on one of a surface area for the person or an air flow within an environment that includes the person.

6. The method of claim 1, further comprising: determining a body mode offset for the facial region of the person,wherein the estimating the core body temperature for the person includes estimating the core body temperature for the person by adding the body mode offset to the asymptotic surface temperature for the facial region of the person.

7. The method of claim 1, further comprising: determining a plurality of temperature measurement confidence values corresponding with the plurality of temperatures; anddetecting the temperature-time sequence being sufficient to determine the asymptotic surface temperature based on the plurality of temperature measurement confidence values corresponding with the plurality of temperatures.

8. The method of claim 7, wherein: the determining the plurality of temperature measurement confidence values includes determining a walking speed of the person and determining the plurality of temperature measurement confidence values based on the walking speed of the person.

9. The method of claim 1, further comprising: acquiring a second plurality of temperatures corresponding with a second facial region of the person during the time period;generating a second temperature-time sequence for the second facial region of the person during the time period using the second plurality of temperatures;identifying a second temperature fitting function based on the second facial region of the person; anddetermining a second asymptotic surface temperature for the second facial region of the person using the second temperature fitting function and the second temperature-time sequence,wherein the estimating the core body temperature for the person includes estimating the core body temperature for the person based on the asymptotic surface temperature and the second asymptotic surface temperature.

10. The method of claim 1, further comprising: acquiring a set of images from one or more imaging devices; andtracking the facial region of the person over the time period using the set of images,wherein the outputting the core body temperature for the person includes displaying the core body temperature for the person,wherein the facial region of the person comprises one of an orbital region or a temporal region of the person,wherein the set of images includes a first set of infrared images, andwherein the asymptotic surface temperature for the facial region of the person is greater than any temperature of the plurality of temperatures.

11. The method of claim 1, further comprising: increasing an air flow in response to detecting that the temperature-time sequence is not sufficient to determine the asymptotic surface temperature for the facial region of the person after a threshold time period has elapsed.

12. The method of claim 1, further comprising: displaying an indication that directs the person into a particular area in response to detecting that the temperature-time sequence is not sufficient to determine the asymptotic surface temperature for the facial region of the person after a threshold time period has elapsed.

13. A system, comprising: a storage device configured to store a plurality of temperatures corresponding with a facial region of a person during a time period; andone or more processors in communication with the storage device, wherein the one or more processors are configured to: generate a temperature-time sequence for the facial region of the person using the plurality of temperatures;identify a temperature fitting function based on the facial region of the person;determine an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence;estimate a core body temperature for the person based on the asymptotic surface temperature for the facial region of the person; andoutput the core body temperature for the person.

14. The system of claim 13, wherein: the one or more processors are configured to estimate a mass of the person and identify the temperature fitting function based on the mass of the person.

15. The system of claim 13, wherein: the one or more processors are configured to determine a walking speed for the person during the time period and determine a plurality of temperature measurement confidence values corresponding with the plurality of temperatures based on the walking speed for the person during the time period, andthe one or more processors are configured to detect that the temperature-time sequence is sufficient based on the plurality of temperature measurement confidence values corresponding with the plurality of temperatures.

16. One or more storage devices containing processor readable code for configuring one or more processors to perform a method for improving temperature screening, wherein the processor readable code configures the one or more processors to: acquire a plurality of temperatures corresponding with a facial region of a person during a time period;generate a temperature-time sequence for the facial region of the person using the plurality of temperatures;estimate an amount of surface area for the person;identify a temperature fitting function based on a location of the facial region of the person and the amount of surface area for the person;determine an asymptotic surface temperature for the facial region of the person using the temperature fitting function and the temperature-time sequence in response to detection that the temperature-time sequence is sufficient to determine the asymptotic surface temperature for the facial region of the person, wherein the asymptotic surface temperature for the facial region of the person is greater than any temperature of the plurality of temperatures;determine a core body temperature for the person based on the location of the facial region of the person and the asymptotic surface temperature for the facial region of the person; andoutput the core body temperature for the person.

17. The one or more storage devices of claim 16, wherein the processor readable code further configures the one or more processors to: determine an air flow within an environment that includes the person during the time period; andidentify the temperature fitting function based on the air flow within the environment.

18. The one or more storage devices of claim 16, wherein the processor readable code further configures the one or more processors to: determine a plurality of temperature measurement confidence values corresponding with the plurality of temperatures; anddetect that the temperature-time sequence is sufficient based on the plurality of temperature measurement confidence values corresponding with the plurality of temperatures.

19. The one or more storage devices of claim 18, wherein the processor readable code further configures the one or more processors to: determine a walking speed of the person; anddetermine the plurality of temperature measurement confidence values based on the walking speed of the person.

20. The one or more storage devices of claim 16, wherein the processor readable code further configures the one or more processors to: determine an ambient temperature of an environment that includes the person during the time period;determine the core body temperature for the person based on the ambient temperature of the environment; anddisplay the core body temperature for the person.