Biometric camera mount system

Information

  • Patent Grant
  • 9716814
  • Patent Number
    9,716,814
  • Date Filed
    Wednesday, April 15, 2015
    9 years ago
  • Date Issued
    Tuesday, July 25, 2017
    7 years ago
Abstract
A system for reducing the substantially vertical extent of a wide-area biometric system and for reducing the cost and complexity of installation while maintaining high biometric performance, using a substantially horizontally configuration of cameras, preferably with an attention mechanism, and using a precision calibration system that can be used by an unskilled technician and that does not require an accurate site survey or additional materials or equipment.
Description
BACKGROUND OF THE INVENTION

Biometrics is the science and technology of measuring and analyzing biological data, such as the imagery of the face or iris. There are 2 problems that need to be overcome with the acquisition of biometric data: (i) ensuring that the biological data is within the field of coverage of one or more of the biometric sensors, and (ii) ensuring that the data is acquired as uniformly as possible so that comparison of data from the same user across different time periods is facilitated.


SUMMARY OF THE INVENTION

One existing approach to ensuring that the biological data is within the field of coverage is shown in FIG. 1 (prior art). In this system called Smart Gate, face imagery is acquired by one of 3 cameras mounted vertically in front of a user. The user is asked to stare straight forward at a kiosk, and the cameras are stacked vertically parallel to each other with a large vertical spacing so that the camera closest to the height of the user always captures a frontal view of the face. Ensuring a frontal view of the user facilitates comparison of the same user at a different time period, and improves overall system match performance.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 shows prior art whereby multiple cameras are mounted in front of a user at a fixed angle and at a fixed height such that the face of the person is in the field of view of at least one of the cameras; FIG. 2 shows a configuration where a biometric device is mounted above a doorway and covers a region of interest within the doorway: FIG. 3 shows a particular configuration ofa biometric device mounted above a doorway comprising an attention mechanism, and three cameras mounted horizontally covering a vertical region of interest; FIG. 4 shows a profile view of a biometric system mounted above a doorway, showing how the region of interest depends on the height H of the device and the tilt Theta of the device; and FIG. 5 shows a profile view of a biometric system mounted above a doorway whereby the cameras are mounted on a pivot the angle of which is adjusted by a calibration knob, such that the vertical region of interest of the biometric device can be adjusted on-site depending on deployment-specific constraints on the height and angle of the device.



FIG. 2 shows a different configuration for a biometric system. In this case, the biometric system has to be mounted between the top of a doorway and a ceiling (H1 in FIG. 2) which is typically 8-12″. In general, the biometric system has to be mounted in a very small vertical space between a lower obstruction and a higher obstruction. Unfortunately, the vertical region of interest of the system, H2, is typically much larger than the vertical space H1 that is available to mount the biometric system. H2 is typically 24″ or more. Even if H1 is greater than H2 such that the cameras in FIG. 1 could be raised above a doorway, then a problem still exists since if the user is asked to look straight ahead or at a fixed point, then a camera view will acquire a vertically skewed, perspective view of the person's face or is, which makes matching the biometric data much more difficult. FIG. 3 shows how the problem has been addressed. First, the cameras are mounted horizontally in the gap H1 rather than vertically. Mounting the cameras horizontally reduces significantly the vertical space occupied, and each camera is tilted and panned carefully to cover a different vertical portion of the region of interest as shown in FIG. 3 by the number of the camera and the number of the region of interest. Second, the horizontal spacing between the cameras is minimized as much as physically possible. A preferred separation is 2″ or 4″. The approach of mounting the cameras horizontally saves vertical space, but it potentially introduces a new problem in that horizontally skewing of the imagery of the subject will occur, in addition to the vertical skewing discussed earlier which as discussed previously makes the matching of the biometric data much more difficult. By mounting the cameras with a close horizontal separation however minimizes the degree of horizontal skewing. Thirdly, an attention-mechanism, such as a video screen showing live video of the user as they use the system, is placed near the cameras. The user is then asked to look at the video screen. Users who are short and are at the bottom of the region of interest will have to look up at a greater tilt angle than users who are tall and are at the top of the region of interest. The benefit of this approach is that vertical skewing of the imagery introduced by the position of the cameras is cancelled out by the user tilting their head to the same vertical height as all the cameras.





DETAILED DESCRIPTION OF THE INVENTION

Because the cameras are all at the same height, then the vertical skewing will be cancelled out equally in all camera views. If an attention mechanism at the camera cannot be applied due to the physical constraints of the system, then an alternative more complex solution to this third step is a fore shortening compensation algorithm to remove the vertical skewing.


While this discussion has focused on allowing a substantially vertical region of interest to be covered using a horizontal arrangement of cameras, alternatively the same method could be used such that a substantially horizontal region of interest is covered using a vertical arrangement of cameras. The cameras could also be pan/tilt/zoom cameras, either moved directly or by means of a mirror.



FIG. 4 shows a profile view of amount of a biometric system between a ceiling and a doorway. There are two problems with such an installation compared to the installation of a traditional biometric system. First, traditional biometric systems typically have carefully defined specifications that define the precise height that the unit should be mounted above the floor. However, when mounting a system between a ceiling and a doorway, the height of the doorway and the height of the ceiling dictates the vertical positioning, H, of the system, and not the installation manual. Further, the heights of doorways and ceilings vary substantially. This is very problematic since a biometric system designed for a certain vertical region of interest to capture a range of heights will not function properly if mounted at an unspecified height. Further, traditional biometric systems have typically acquired data within a small distance (approximately within 8-12″) so that any slight angle, theta, in the pitch of the device does not move the vertical region of interest substantially. However, more recent biometric systems can acquire data many feet away from the device, and therefore any slight angle, theta, in the pitch of the device can move the vertical region of interest substantially. The slight variations in pitch and height of the device depend on the circumstances that arise during actual installation, such as the flexing of the wall mounting points, and therefore cannot be calculated from site survey measurements with sufficient accuracy to allow adjustment at the factory. We have developed a method that allows an unskilled installation technician to adjust a complex biometric system in a very short period of time, thereby minimizing installation time and cost.



FIG. 5 shows the solution we have developed. The cameras are all mounted on a single camera module that in turn is mounted on a horizontal pivot. A pivot push bar is attached to the camera module. A housing bar is attached to the case of the biometric system which in turn is attached to the wall or other installation arrangement. A calibration knob comprising a screw thread is screwed through the housing bar and pushes against the pivot push bar. The installation technician installs the biometric unit without having to be concerned substantially with the pitch of the device, and only has to ensure that the device lies within a very broad height range (e.g. 6.5 ft-12 ft) which can be ascertained from inaccurate and rapid site-survey analysis. The installation technician is then able to adjust the precise vertical region of interest by rotating the calibration knob. Rotating the calibration knob during installation pushes the pivot push bar which in turns rotates the camera module within the housing. The installation technician can adjust the knob and then test performance at different heights in the region of interest. The use of the screwed thread as an adjustment mechanism has the benefit of (i) great precision in adjustment with a wide range of travel (ii) allows the operator to make relative adjustments to allow iterative calibration (e.g. turn the knob one revolution, re-test the biometric system, turn the knob a second revolution) without having to perform a difficult and error prone absolute calibration which may require the participation of a second person which increases cost, or requires additional calibration support materials such as target charts carefully positioned, which take time to set up and are error prone.

Claims
  • 1. A biometric system comprising: two or more imaging sensors disposed horizontally on top of a frame to acquire biometric data of a person coming towards the frame, each of the two or more imaging sensors monitoring a respective region of interest, and vertically tilted and horizontally panned with respect to each other to dispose the respective regions of interest vertically with respect to each other so as to form a vertically expanded region of interest located in front of the frame; anda horizontal pivot for adjusting the respective regions of interest upwards or downwards by a same amount between the respective regions of interest.
  • 2. The system of claim 1, wherein the sensors are closely spaced with respect to each other within a predetermined distance.
  • 3. The system of claim 1, further comprising an attention mechanism located close to the two or more sensors within a predetermined distance from the two or more sensors.
  • 4. The system of claim 3, wherein the attention mechanism comprises a video monitor configured to show imagery of the user.
  • 5. The system of claim 3, wherein the attention mechanism is configured to draw a gaze of the person towards a direction of the two or more sensors.
  • 6. The system of claim 1, further comprising an adjustment mechanism allowing tilt adjustment of a horizontal configuration of the two or more sensors about the horizontal pivot.
  • 7. The system of claim 6, wherein the adjustment mechanism comprises a screw-thread mechanism.
  • 8. The system of claim 1, wherein the physical orientation of the two or more sensors are fixed relative to one another after the respective regions of interest are disposed vertically with respect to each other.
  • 9. The system of claim 1, wherein the respective regions overlap at least to some extent.
  • 10. The system of claim 1, wherein the two or more sensors, as horizontally disposed, provides a reduced vertical profile for the system.
  • 11. The system of claim 1, further comprising a sensor housing module housing the two or more camera sensors.
  • 12. The system of claim 6, further comprising a sensor housing module comprising the pivot and the adjustment mechanism.
  • 13. A method of acquiring biometric data, the method comprising: horizontally disposing two or more imaging sensors on top of a frame to acquire biometric data of a person coming towards the frame; andmonitoring, by each of the two or more imaging sensors, a respective region of interest, each of the two or more imaging sensors vertically tilted and horizontally panned with respect to each other to dispose the respective regions of interest vertically with respect to each other so as to form an expanded region of interest located in front of the frame; andadjusting, via a horizontal pivot, the respective regions of interest upwards or downwards by a same amount between the respective regions of interest.
  • 14. The method of claim 13, wherein horizontally disposing two or more imaging sensors comprises closely spacing the sensors with respect to each other within a predetermined distance.
  • 15. The method of claim 13, further comprising locating an attention mechanism close to the two or more sensors within a predetermined distance from the two or more sensors.
  • 16. The method of claim 15, further comprising displaying, by the attention mechanism, imagery of the user on a video monitor of the attention mechanism.
  • 17. The method of claim 15, further comprising drawing, by the attention mechanism, a gaze of the person towards a direction of the two or more sensors.
  • 18. The method of claim 13, further comprising enabling, by an adjustment mechanism, tilt adjustment of a horizontal configuration of the two or more sensors about the horizontal pivot.
  • 19. The method of claim 18, wherein the adjustment mechanism comprises a screw-thread mechanism.
  • 20. The method of claim 13, wherein the physical orientation of the two or more sensors are fixed relative to one another after the respective regions of interest are disposed vertically with respect to each other.
CROSS-REFERENCE TO RELATED APPLICATIONS

The present application claims priority to and is a continuation of U.S. application Ser. No. 14/075,232 entitled “BIOMETRIC CAMERA MOUNT SYSTEM” and filed on Nov. 8, 2013, which claims priority to and is a continuation of U.S. application Ser. No. 13/464,710 entitled “BIOMETRIC CAMERA MOUNT SYSTEM” and filed on May 4, 2012, which claims priority to and is a continuation of U.S. application Ser. No. 12/749,663 entitled “BIOMETRIC CAMERA MOUNT SYSTEM” filed on Mar. 30, 2010, which claims the benefit of and priority to U.S. Provisional Application 61/164,528, entitled “BIOMETRIC CAMERA MOUNT SYSTEM” and filed on Mar. 30, 2009, all of which are incorporated herein by reference in their entirety.

US Referenced Citations (101)
Number Name Date Kind
4641349 Flom et al. Feb 1987 A
5259040 Hanna Nov 1993 A
5291560 Daugman Mar 1994 A
5488675 Hanna Jan 1996 A
5572596 Wildes et al. Nov 1996 A
5581629 Hanna et al. Dec 1996 A
5613012 Hoffman et al. Mar 1997 A
5615277 Hoffman Mar 1997 A
5737439 Lapsley et al. Apr 1998 A
5764789 Pare et al. Jun 1998 A
5802199 Pare et al. Sep 1998 A
5805719 Pare et al. Sep 1998 A
5838812 Pare et al. Nov 1998 A
5901238 Matsushita May 1999 A
5953440 Zhang et al. Sep 1999 A
5978494 Zhang Nov 1999 A
6021210 Camus et al. Feb 2000 A
6028949 McKendall Feb 2000 A
6064752 Rozmus et al. May 2000 A
6069967 Rozmus et al. May 2000 A
6144754 Okano et al. Nov 2000 A
6192142 Pare et al. Feb 2001 B1
6247813 Kim et al. Jun 2001 B1
6252977 Salganicoff et al. Jun 2001 B1
6289113 McHugh et al. Sep 2001 B1
6366682 Hoffman et al. Apr 2002 B1
6373968 Okano et al. Apr 2002 B2
6377699 Musgrave et al. Apr 2002 B1
6424727 Musgrave et al. Jul 2002 B1
6483930 Musgrave et al. Nov 2002 B1
6532298 Cambier et al. Mar 2003 B1
6542624 Oda Apr 2003 B1
6546121 Oda Apr 2003 B1
6594376 Hoffman et al. Jul 2003 B2
6594377 Kim et al. Jul 2003 B1
6652099 Chae et al. Nov 2003 B2
6700998 Murata Mar 2004 B1
6714665 Hanna et al. Mar 2004 B1
6760467 Min et al. Jul 2004 B1
6850631 Oda et al. Feb 2005 B1
6917695 Teng et al. Jul 2005 B2
6980670 Hoffman et al. Dec 2005 B1
6985608 Hoffman et al. Jan 2006 B2
7095901 Lee et al. Aug 2006 B2
7146027 Kim et al. Dec 2006 B2
7248719 Hoffman et al. Jul 2007 B2
7271939 Kono Sep 2007 B2
7298969 Elberbaum Nov 2007 B2
7385626 Aggarwal et al. Jun 2008 B2
7414737 Cottard et al. Aug 2008 B2
7418115 Northcott et al. Aug 2008 B2
7428320 Northcott et al. Sep 2008 B2
7542590 Robinson et al. Jun 2009 B1
7558406 Robinson et al. Jul 2009 B1
7558407 Hoffman et al. Jul 2009 B2
7574021 Matey Aug 2009 B2
7583822 Guillemot et al. Sep 2009 B2
7606401 Hoffman et al. Oct 2009 B2
7616788 Hsieh et al. Nov 2009 B2
7639840 Hanna et al. Dec 2009 B2
7693307 Rieul et al. Apr 2010 B2
7697786 Camus et al. Apr 2010 B2
7715595 Kim et al. May 2010 B2
7719566 Guichard May 2010 B2
7797606 Chabanne Sep 2010 B2
7843487 Tojima Nov 2010 B2
7869627 Northcott et al. Jan 2011 B2
7929732 Bringer et al. Apr 2011 B2
7978883 Rouh et al. Jul 2011 B2
8009876 Kim et al. Aug 2011 B2
8025399 Northcott et al. Sep 2011 B2
8092021 Northcott et al. Jan 2012 B1
8132912 Northcott et al. Mar 2012 B1
8170295 Fujii et al. May 2012 B2
8233680 Bringer et al. Jul 2012 B2
8243133 Northcott et al. Aug 2012 B1
8279042 Beenau et al. Oct 2012 B2
8317325 Raguin et al. Nov 2012 B2
20030093805 Gin May 2003 A1
20040119881 Matko Jun 2004 A1
20050084137 Kim et al. Apr 2005 A1
20060074986 Mallalieu et al. Apr 2006 A1
20070013779 Gin et al. Jan 2007 A1
20070122011 Takizawa May 2007 A1
20070211922 Crowley et al. Sep 2007 A1
20080225129 Viinikanoja Sep 2008 A1
20090074256 Haddad Mar 2009 A1
20090097715 Cottard et al. Apr 2009 A1
20090161925 Cottard et al. Jun 2009 A1
20090231096 Bringer et al. Sep 2009 A1
20100021016 Cottard et al. Jan 2010 A1
20100074477 Fujii et al. Mar 2010 A1
20100127826 Saliba et al. May 2010 A1
20100246903 Cottard Sep 2010 A1
20100278394 Raguin et al. Nov 2010 A1
20100310070 Bringer et al. Dec 2010 A1
20110158486 Bringer et al. Jun 2011 A1
20110194738 Choi et al. Aug 2011 A1
20110277518 Lais et al. Nov 2011 A1
20120240223 Tu Sep 2012 A1
20120257797 Leyvand et al. Oct 2012 A1
Foreign Referenced Citations (4)
Number Date Country
WO-2008036897 Mar 2008 WO
WO 2008036897 Mar 2008 WO
WO-2010062371 Jun 2010 WO
WO-2011093538 Aug 2011 WO
Non-Patent Literature Citations (13)
Entry
B. Galvin, et al., Recovering Motion Fields: An Evaluation of Eight Optical Flow Algorithms, Proc. of the British Machine Vision Conf. (1998).
J. R. Bergen, et al., Hierarchical Model-Based Motion Estimation, European Conf. on Computer Vision (1993).
K. Nishino, et al., The World in an Eye, IEEE Conf. on Pattern Recognition, vol. 1, at pp. 444-451 (Jun. 2004).
Notice of Allowance on U.S. Appl. No. 12/749,663 dated Feb. 7, 2012.
Notice of Allowance on U.S. Appl. No. 13/464,710 dated Mar. 29, 2013.
Notice of Allowance on U.S. Appl. No. 13/464,710 dated Jul. 24, 2013.
Office Action on U.S. Appl. No. 12/749,663 dated Feb. 23, 2011.
Office Action on U.S. Appl. No. 13/464,710 dated Jan. 9, 2013.
Office Action on U.S. Appl. No. 13/464,710 dated Jul. 3, 2012.
Office Action on U.S. Appl. No. 14/075,232 dated Oct. 15, 2014.
Office Action on U.S. Appl. No. 14/075,232 dated Feb. 25, 2014.
R. Kumar, et al., Direct recovery of shape from multiple views: a parallax based approach, 12th IAPR Int'l Conf. on Pattern Recognition.
R. P. Wildes, Iris Recognition: An Emerging Biometric Technology, Proc. IEEE 85(9) at pp. 1348-1363 (Sep. 1997).
Related Publications (1)
Number Date Country
20160065797 A1 Mar 2016 US
Provisional Applications (1)
Number Date Country
61164528 Mar 2009 US
Continuations (3)
Number Date Country
Parent 14075232 Nov 2013 US
Child 14687444 US
Parent 13464710 May 2012 US
Child 14075232 US
Parent 12749663 Mar 2010 US
Child 13464710 US