The present invention relates to an imaging system including a light focusing element, and more specifically, a non-linear light focusing element constructed to adjust the pixel distribution in a three-dimensional area of interest such that the imaging system optically captures the area of interest to view objects that are positioned in different locations of the area relative to the imaging system.
Many imaging systems include X-Y aspect ratios that describe the relationship between the width (X) and the height (Y) of the image. The aspect ratios have a specific resolution with a uniform distribution of pixels that describes the relationship between the width of the pixel compared to the height of the pixel. Typically, the lens of existing optical imaging systems (e.g., optical, UV) have a generally uniform pixel distribution, and an image sensor has an aspect ratio that is defined by the total number of pixels in the X-Y plane for the image sensor. The lens distributes the pixels of a captured image onto the image sensor, and a processor may process the captured image to form an image that has a field of view with an aspect ratio (e.g., 4:3 standard, 16:9 standard, etc.). Other imaging systems, such as thermal imaging cameras, may not include a lens or may include a lens constructed of a material other than glass (e.g., germanium, zinc selenide, etc.). The field of view encompasses or includes all the area in front of the imaging system, with objects closer to the imaging system appearing larger than objects farther from the imaging system. The depth of field of existing imaging systems defines the area of the field of view that appears in focus.
To increase the resolution of an image, the number of pixels or pixel density of a camera sensor increases, which increases the cost to manufacture the camera. In some applications, such as surveillance cameras, a relatively small portion of the image is considered an area of interest or the desired field of view. Therefore, sensors with a uniform distribution of pixels may be unable to provide the desired resolution within the area of interest and, at the same time, many pixels that are processed are not useful for identifying objects that are outside the area of interest.
Existing imaging systems cannot separate out or only capture the desired area or frame (e.g., the aisle 32) and eliminate or disregard the undesired area(s) 34 (e.g., the storage racks on each side of the aisle 32, as well as the wall in the distance). Some imaging systems may use motion detection algorithms to block out portions of the image 24 from being monitored. Also, the generally uniform pixel distribution of the lens causes the objects that are positioned relatively close to the imaging system, inside and outside the frame, to appear with a higher resolution than is necessary to view objects in those areas. At the same time, objects relatively far from the imaging system appear with a lower resolution than is necessary to adequately view relevant objects.
The image 24, which is taken by positioning the existing imaging system relative to the aisle 32 to monitor vehicles and people in the aisle to securely monitor the aisle 32, does not adequately provide the ability to readily identify the person 54 and the vehicle 58 in the same image 24. In general, existing imaging system technology produces an image with an object that is close to the imaging system in a form that is larger and with a higher resolution than is necessary to identify the object, and object(s) that is farther from the imaging system in a form that is smaller and with a lower resolution than is necessary to identify the object(s). The vertical scale of the images taken with typical imaging system technology is not linear, so object(s) farther from the imaging system appear much smaller than object(s) closer to the imaging system.
In one aspect, the disclosure provides an imaging system positioned relative to a three-dimensional area for capturing an image includes an image sensor having an X-Y plane and an aspect ratio defined by the quantity of pixels in the X-Y plane; and a non-linear light focusing element constructed with a profile to form an altered view of a three-dimensional desired zone of the area with a desired pixel distribution. The non-linear light focusing element redirects the pixels of the image sensor from an undesired zone of the area to within a frame that encompasses the three-dimensional desired zone of the area to form the altered view of the desired zone. The image sensor captures the altered view of the desired zone to match the aspect ratio of the image sensor.
In another aspect, a method for capturing an image includes positioning a cameral relative to an area, The camera includes an image sensor having an X-Y plane and an aspect ratio defined by the quantity of pixels in the X-Y plane and a non-linear light focusing element constructed with a profile to form an altered view of a three-dimensional desired zone of the area with a desired pixel distribution. The non-linear light focusing element redirects the pixels of the image sensor from an undesired zone of the area to within a frame that encompasses the three-dimensional desired zone of the area to form the altered view of the desired zone matching the aspect ratio of the image sensor. An image of the altered view of the desired zone is captured using the image sensor.
In another aspect, the imaging system further includes a lens constructed to optically capture the altered view of the desired zone.
In yet another aspect, the lens distributes the pixels of the altered view of the desired to match the aspect ratio of the image sensor.
In yet another aspect, the imaging system further includes a processor configured to process the pixels to store and analyze an adjusted image.
Before any embodiments of the present invention are explained in detail, it should be understood that the invention is not limited in its application to the details or construction and the arrangement of components as set forth in the following description or as illustrated in the drawings. The invention is capable of other embodiments and of being practiced or of being carried out in various ways. The description of specific embodiments is not intended to limit the disclosure from covering all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure. Also, it is to be understood that the phraseology and terminology used herein is for the purpose of description and should not be regarded as limiting.
The reflector 112 is a highly polished surface (e.g., a mirror) that is constructed to have a unique profile (e.g., contour, shape, size, etc.) to alter the view that is captured by the image sensor 118. More specifically, the reflector 112 redirects (e.g., condense, expand, etc.) the pixels of the image sensor 118 within a three-dimensional area of interest or desired three-dimensional zone(s) 130 so the imaging system 110 captures objects only in the desired zone(s) 130 (defined by a frame 138) of a three-dimensional area 122. The three-dimensional area 122 may be a fixed or stationary if the imaging system 110 is stationary (e.g., mounted to a wall, ceiling, etc.) or dynamic if imaging system 110 is moving (e.g., mounted to a vehicle, a forklift, etc.). In some embodiments, the imaging system 110 captures a continuous portion or segmented (non-continuous) portions of the area 122 that define the desired zone 130. The imaging system 110 capturing the desired zone(s) 130 of the area 122 may include or encompass capturing a part of the area 122, or the entire area 122. In other words, the desired zone 130 may be a small portion of the overall area 122 or the entirety of the area 122.
The unique profile of the reflector 112 is designed for each specific application (e.g., monitoring a storage facility, etc.) to redirect the pixels of the image sensor 118 to form a desired pixel density within the desired zone 130 without wasting pixels on undesired zone(s) 134 outside of the frame 138. For example, the desired pixel distribution may include a unified pixel density or an uneven pixel distribution within the desired zone(s) 130 depending on the application of the imaging system 110 and the desired output image. As shown in
With reference to
With reference to
In some constructions, the lens 116 can take the form of the non-linear lens described and illustrated in co-pending, co-owned U.S. patent application Ser. No. 62/894,468, filed Aug. 30, 2019, which is incorporated herein by reference in its entirety. The non-linear lens is an exemplary lens 116 that may be used in conjunction with the reflector 112 to capture an image and process the image to the adjusted image 124. The non-linear lens 116 is constructed to have a unique profile (e.g., contour, shape, and/or size) to optically capture an area of interest or desired zone 130 positioned within the field of view of the imaging system 110. For example, the non-linear lens 116 may be a non-spherical type lens that is manufactured with optical clarity via 3D printing or other technology that is suitable for shaping the lens 116 for the application the system 100 will be applied to. The lens 116 may be constructed of one or more elements that cooperatively define the non-linear nature of the lens 116. For example, the lens 116 may be constructed of any combination of elements that are optically clear, reflective, optically liquid materials (e.g., to form a liquid lens), or include microelectromechanical systems (MEMS). The unique profile of the lens 116 is designed for each specific application (e.g., monitoring a roadway at a tollbooth, monitoring a storage facility, etc.) to remap or redistribute the pixel density to form the desired pixel density within the desired zone 130 without wasting pixels on an undesired zone 134 outside of the frame 138. The profile of the non-linear lens 116 may be constructed to take into account the shape or profile of the desired zone(s) 130 (e.g., width, distance, segmented portions) and the height of the imaging system 110 relative to the area 122 that is being monitored. The profile of the non-linear lens 116 expands a captured frame (or altered frame 140) to match or fill the aspect ratio of the image sensor 118. As a result, the non-linear lens 116 and the reflector 112 are used in unison to capture the adjusted image 124 that includes only the desired or monitored zone 130. Additionally, the processor 120 may dynamically change the one or more elements of the lens 116 and/or the reflector 112 to adjust the pixel directions and/or the desired zone(s) captured by the lens 116.
The non-linear reflector 112 and the non-linear lens 116 are examples of non-linear light focusing elements that may be used alone or in combination to achieve the pixel remapping described herein.
With reference to
With reference to
In one example, after the pixels reflects off the reflector 112 and pass through the lens 116 (illustrated by dashed lines), the adjusted image 124 may be orientated in the wrong direction or distorted. As a result, the processor 120 may determine and correct the positioning of the pixels to produce the adjusted image 124 for the user of the processing system. This can include the system 100 redistributing the pixels within the adjusted image 124 to increase the resolution in specific areas of the adjusted image 124. In some constructions, the processor 120 may transmit the adjusted image 124 to a display over a communication network (e.g., wired, or wireless such as Bluetooth®, Wi-Fi™, etc.) for use by personnel assigned to monitor the desired zone 130.
The imaging system 110 may be used to monitor objects (e.g., vehicles, people, people counting, safety, security, etc.) that are in the desired frame 138 of the field of view for many different applications. The desired zone 130 is predetermined by the application to which the system will be applied. As a result, the desired zone 130 and the construction of the reflector 112 may vary based on the placement of the imaging system 110 or the desired zone 130 of the area 122 the imaging system 110 monitors. While the desired zone 130 shown in the drawings is a continuous zone, it will be appreciated that the desired zone for a particular application may include disjointed or unconnected portions of the area(s) to be monitored.
The reflector 112 is constructed to condense the pixels within the aisle 132 so the imaging system 110 monitors the aisle 132 without capturing the undesired zone(s) 134 (in this example, undesired zone 134 includes the storage racks on each side of the aisle 132 and the wall in the distance). The desired zone 130 is bounded by a frame 138 that includes a continuous section of the aisle 132 with the person 154 and the vehicle 158.
After the reflector 112 is constructed and positioned relative to the aisle 132 and the imaging system 110, the reflector 112 redirects the pixels from the undesired zone(s) 134 (in this example, the storage racks) to form a desired pixel distribution within the aisle 132. The imaging system 110 captures the frame 138 so that the pixels in the altered frame 140 match or fit the aspect ratio of the image sensor 118. As a result, the person 154 and vehicle 158, which are in different portions of the area 122, are both visible while monitoring of the aisle 132. While the example described in detail herein relates to monitoring the person 154 and vehicle 158 in the aisle 132, it will be appreciated that the system can monitor any number of vehicles, objects, and/or people in the desired frame 138 for any application. Also, the system 100 is applicable to various applications and should not be construed to apply only to storage facility monitoring.
The angular view 226 defines extents of the image that are visible by the imaging system 110. For example, the angular view 226 includes a shallow area 242, a deep area 246, and a middle area 250 positioned between the shallow and deep area 242, 246. The angular view 226 is bounded by the floor 232 and a set upper limit (e.g., illustrated with line 234) that converges at an angular vantage point 244 in the deep area 246 of the image. The angle 236 of the imaging system 110 and the upper limit 234 of the imaging system 110 may adjusted to encompass a larger or smaller area of the floor 232.
The imaging system 110 is pointed or directed at the reflector 112, which condenses the pixels to form a desired pixel distribution on the rectangular pattern of the floor 232. The reflector 112 is uniquely constructed for each specific height 228 of the image sensor 118. The reflector 112 redirects the pixels from the undesired zone(s) 134 (in this example, outside a rectangular pattern of the floor) within the desired zone 130 to form the desired pixel distribution. The imaging system 100 captures a final image of the floor consistent with the above description of
While the example described in detail herein relates mounting the imaging system 110 on a ceiling to capture a rectangular pattern on the floor 232, it will be appreciated that the system can capture any pattern (e.g., circular, triangular, etc.) to monitor a desired area of the floor 232 or other areas. Also, the system 100 is applicable to various applications be mounted on any surface and can capture a desired image for any application.
The imaging system 310 captures the paths 336, 340, 344, 348 of the intersection 332 (i.e. the desired zones 330 in this example) without wasting pixels on the undesired zone(s) 334 surrounding the intersection 332. The reflector 312 redirects the pixels of the image sensor 318 within the paths 336, 340, 344, 348 so each path 336, 340, 344, 348 has a desired pixel distribution consistent with what is described with regard to
For example, the lens 316 (illustrated with dashed lines in
The embodiment(s) described above and illustrated in the figures are presented by way of example only and are not intended as a limitation upon the concepts and principles of the present disclosure. As such, it will be appreciated that variations and modifications to the elements and their configurations and/or arrangement exist within the scope of one or more independent aspects as described.
The present application claims priority to U.S. Provisional Application 62/897,975, filed Sep. 9, 2019, the entire contents of which are hereby incorporated by reference.
Number | Name | Date | Kind |
---|---|---|---|
1919022 | Hillman | Jul 1933 | A |
3178274 | Duncan et al. | Apr 1965 | A |
3620603 | White | Nov 1971 | A |
4653877 | Hamanishi | Mar 1987 | A |
4741605 | Alfredsson et al. | May 1988 | A |
4944584 | Maeda et al. | Jul 1990 | A |
4995714 | Cohen | Feb 1991 | A |
5144483 | Cohen | Sep 1992 | A |
5936666 | Davis | Aug 1999 | A |
6215519 | Nayer et al. | Apr 2001 | B1 |
6927922 | George et al. | Aug 2005 | B2 |
6947223 | Gruhlke | Sep 2005 | B2 |
7061693 | Zalevsky | Jun 2006 | B2 |
7162153 | Harter, Jr. et al. | Jan 2007 | B2 |
7221399 | Fujita et al. | May 2007 | B2 |
7253948 | Sander | Aug 2007 | B2 |
7548691 | Tanida | Jun 2009 | B2 |
7554750 | George et al. | Jun 2009 | B2 |
7626769 | Olmstead et al. | Dec 2009 | B2 |
7646404 | Liu et al. | Jan 2010 | B2 |
7719568 | Hung et al. | May 2010 | B2 |
7812295 | Zalevsky et al. | Oct 2010 | B2 |
7876980 | Chiba et al. | Jan 2011 | B2 |
7898746 | George et al. | Mar 2011 | B2 |
7965314 | Miller et al. | Jun 2011 | B1 |
8018489 | McCutchen | Sep 2011 | B2 |
8029705 | Bhalakia et al. | Oct 2011 | B2 |
8068154 | Jacob | Nov 2011 | B2 |
8125718 | Edwards | Feb 2012 | B2 |
8139896 | Ahiska et al. | Mar 2012 | B1 |
8248458 | Schowengerdt et al. | Aug 2012 | B2 |
8368875 | Kludas et al. | Feb 2013 | B2 |
8390932 | Jia et al. | Mar 2013 | B2 |
8469565 | Yatsuda | Jun 2013 | B2 |
8576326 | Kawamura | Nov 2013 | B2 |
8619362 | Portney | Dec 2013 | B2 |
8690353 | Hung et al. | Apr 2014 | B2 |
9007432 | Chuang et al. | Apr 2015 | B2 |
9057871 | Uchida et al. | Jun 2015 | B2 |
9148632 | Harding et al. | Sep 2015 | B2 |
9237338 | Maguire, Jr. | Jan 2016 | B1 |
9270878 | Ono | Feb 2016 | B2 |
9375136 | Webb et al. | Jun 2016 | B2 |
9615029 | Stahl | Apr 2017 | B2 |
9681043 | Chen et al. | Jun 2017 | B2 |
9686452 | Jones | Jun 2017 | B2 |
9703018 | Dobschal | Jul 2017 | B2 |
9720089 | Katz et al. | Aug 2017 | B2 |
9723292 | Ono | Aug 2017 | B2 |
9854147 | Cheng | Dec 2017 | B2 |
9928707 | Naylor | Mar 2018 | B2 |
20040001149 | Smith | Jan 2004 | A1 |
20080122922 | Geng | May 2008 | A1 |
20090002523 | Maekawa | Jan 2009 | A1 |
20090073254 | Li et al. | Mar 2009 | A1 |
20100177160 | Tocher et al. | Jul 2010 | A1 |
20110164108 | Bates et al. | Jul 2011 | A1 |
20140104389 | Dharmatilleke | Apr 2014 | A1 |
20150109513 | Nayar et al. | Apr 2015 | A1 |
20160247398 | Carlsson | Aug 2016 | A1 |
20190007610 | Evans et al. | Jan 2019 | A1 |
20190011610 | Zalevsky et al. | Jan 2019 | A1 |
20200374457 | Yatsuri et al. | Nov 2020 | A1 |
Number | Date | Country |
---|---|---|
2015165610 QA | Sep 2015 | JP |
WO2018165117 | Sep 2018 | WO |
Number | Date | Country | |
---|---|---|---|
20210075945 A1 | Mar 2021 | US |
Number | Date | Country | |
---|---|---|---|
62897975 | Sep 2019 | US |