The manufacture of optical devices such as cameras may involve alignment of optical elements that are mounted on a printed circuit board. For example, a lens may be aligned with an image sensor via mounting holes for each of these components on the printed circuit board. However, printed circuit boards may be low-precision parts that are manufactured with loose tolerances. Therefore, in order to ensure proper alignment of optical elements mounted to a printed circuit board, an active alignment process may be utilized such that a position of an optical element is adjusted while the optical system is “live” (i.e. while the image sensor is actively acquiring images).
However, such active alignment may be complex and require a high level of skill, and therefore may lead to increased manufacturing costs. Furthermore, the alignment process may lead to deformation of the circuit board upon which the elements are mounted, thereby negatively affecting the quality of the electronics.
Accordingly, various embodiments are disclosed herein that relate to aligning optical elements mounted on a printed circuit board. For example, one disclosed embodiment comprises an optical system including a printed circuit board, and an image sensor package mounted on the printed circuit board, where the image sensor package includes an image sensor. The embodiment further comprises a lens holder including a lens, and one or more alignment features arranged on the lens holder. The one or more alignment features are configured to contact the image sensor package to mechanically align the lens holder with the image sensor package.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
As described above, aligning optical components that are mounted to a printed circuit board may pose various challenges. For example, due to the nature of the printed circuit board manufacturing process, it may be difficult to form mounting holes for a lens and image sensor with desired tolerances, even where a lens holder used to hold the lens and the package for the image sensor are themselves precision parts.
Therefore, embodiments are disclosed herein that are related to mounting and aligning an image sensor and associated lens holder onto a printed circuit board with sufficient precision that subsequent active alignment steps (e.g. manual adjustment of the lens while the image sensor is live) may be avoided. Before discussing these embodiments, an example optical device is shown in
The depth-sensing camera 106 may include a plurality of optical elements which are aligned in order to detect the user's movements. Such optical elements may include, but are not limited to, an image sensor mounted to a printed circuit board, and a lens or system of lenses to focus an image of the user onto the image sensor.
The image sensor package 204 also includes various geometrical sensor package features. For example, the image sensor package 204 may include an image sensor package cover plate 208, and/or a datum corner 210. Such geometric features may be configured to have a precise geometric alignment relative to the image sensor 206. As such, the tolerances of the geometric features of the image sensor package 204 relative to the image sensor 206 may be tighter than the tolerances of the geometric features of printed circuit board that holds the image sensor 206.
Continuing with
In light of the tight geometric tolerances of the lens holder 212 and the image sensor package 204 compared to the printed circuit board 202, a lens may be aligned with an image sensor in a more precise manner where the lens holder 212 references the image sensor package 204 directly, rather than referencing mounting holes in the printed circuit board.
Accordingly, the lens holder 212 comprises alignment features that are configured to contact geometric features of the image sensor package 204 to thereby mechanically align a lens within the lens holder 212 with the image sensor 206 on the image sensor package 204. In this manner, direct contact between parts constructed with tight geometric tolerances is used to align the parts, rather than mutual contact with an intervening structure (printed circuit board) that has looser tolerances.
Any suitable structures may be used as mounting features to facilitate the alignment of the lens holder 212 to the image sensor package 204. For example, in the depicted embodiment, a recessed portion 214 of the lens holder 212 comprises one or more protrusions, such as first protrusion 216 and second protrusion 218, extending from an inside surface of the recessed portion 214, and/or or from an interior side of another suitable portion of the lens holder 212. The protrusions are configured to snugly contact one or more selected geometric features on the image sensor package to thereby align the lens holder (and thus any lenses in the lens holder) with the image sensor package an image sensor. It will be understood that first protrusion 216 and second protrusion 218 are shown for the purpose of example, and that any other suitable alignment feature may be used. For example, instead of a protrusion, an alignment feature may comprise a notch configured to accommodate a complementary geometric feature on the image sensor package.
As mentioned above, the alignment features (e.g. first protrusion 216 and second protrusion 218 in the depicted embodiment) are configured to contact the image sensor package 204 to mechanically align the lens holder 212 with the image sensor package 204. This is illustrated in
The alignment features may be configured to contact any suitable geometric structures on the image sensor package. For example, in some embodiments, the alignment features may be configured to mechanically align the lens holder 212 by contacting the image sensor package cover plate 208. In other examples, the alignment features may be configured to mechanically align the lens holder 216 by contacting the sensor package datum corner 210, or both the datum corner and the image sensor package cover plate. Further, yet other embodiments may utilize other geometric features of the sensor package cover to align a lens in a lens holder to an image sensor. Additionally, in other embodiments, a lens holder may comprise a recessed portion without protrusions (e.g. where the entirety of the recessed portion is sized to fit snugly over the image sensor package).
The alignment features may be formed in any suitable manner. For example, depending upon how the lens holder 212 is constructed, the alignment features may be machined into the lens holder, cast or molded as a part of the lens holder, or bonded to the lens holder as a separately formed piece. It will be understood that these methods of forming the alignment features are described for the purpose of example, and are not intended to be limiting in any manner.
Method 400 comprises, at 402, placing the lens holder proximate to the image sensor package, and then aligning the lens holder to the image sensor package by contacting the one or more alignment features of the lens holders with the one or more geometrical sensor package features at 406. For example, in some embodiments, this may comprise contacting one or more alignment features with an image sensor package cover plate at 408. In other embodiments, this may comprise contacting the one or more alignment features with a sensor package datum corner at 410.
At 412, the method 400 includes fixing the lens holder to one or more of the image sensor package and the printed circuit board. At 414, the method 400 may further include placing the lens holder and printed circuit board into a depth-sensing camera, or a webcam, or in any other suitable optical device. Due to the tight tolerances of the geometrical features of the lens holder and the image sensor package, it will be understood that the lens holder and printed circuit board may be placed into the optical device without performing any additional lens-to-sensor alignment processes, such as active alignment processes, after fixing the lens holder to the image sensor package and/or the printed circuit board. It will be understood that the order of the individual processes of method 400 is presented for the purpose of example, and that the illustrated processes may be performed in any other suitable order. As an example, the lens holder and/or printed circuit board may be placed into a depth-sensing camera before alignment of the lens holder and the image sensor package.
It will further be understood that the configurations and/or approaches for aligning a lens with an image sensor in an optical device described herein are exemplary in nature, and that these specific embodiments or examples are not to be considered in a limiting sense, because numerous variations are possible. The specific routines or methods described herein may represent one or more of any number of processing strategies. As such, various acts illustrated may be performed in the sequence illustrated, in other sequences, in parallel, or in some cases omitted. Likewise, the order of any of the above-described processes is not necessarily required to achieve the features and/or results of the embodiments described herein, but is provided for ease of illustration and description.
The subject matter of the present disclosure includes all novel and nonobvious combinations and subcombinations of the various processes, systems and configurations, and other features, functions, acts, and/or properties disclosed herein, as well as any and all equivalents thereof.
Number | Name | Date | Kind |
---|---|---|---|
4627620 | Yang | Dec 1986 | A |
4630910 | Ross et al. | Dec 1986 | A |
4645458 | Williams | Feb 1987 | A |
4695953 | Blair et al. | Sep 1987 | A |
4702475 | Elstein et al. | Oct 1987 | A |
4711543 | Blair et al. | Dec 1987 | A |
4751642 | Silva et al. | Jun 1988 | A |
4796997 | Svetkoff et al. | Jan 1989 | A |
4809065 | Harris et al. | Feb 1989 | A |
4817950 | Goo | Apr 1989 | A |
4843568 | Krueger et al. | Jun 1989 | A |
4893183 | Nayar | Jan 1990 | A |
4901362 | Terzian | Feb 1990 | A |
4925189 | Braeunig | May 1990 | A |
5101444 | Wilson et al. | Mar 1992 | A |
5148154 | MacKay et al. | Sep 1992 | A |
5184295 | Mann | Feb 1993 | A |
5229754 | Aoki et al. | Jul 1993 | A |
5229756 | Kosugi et al. | Jul 1993 | A |
5239463 | Blair et al. | Aug 1993 | A |
5239464 | Blair et al. | Aug 1993 | A |
5288078 | Capper et al. | Feb 1994 | A |
5295491 | Gevins | Mar 1994 | A |
5320538 | Baum | Jun 1994 | A |
5347306 | Nitta | Sep 1994 | A |
5385519 | Hsu et al. | Jan 1995 | A |
5405152 | Katanics et al. | Apr 1995 | A |
5417210 | Funda et al. | May 1995 | A |
5423554 | Davis | Jun 1995 | A |
5454043 | Freeman | Sep 1995 | A |
5469740 | French et al. | Nov 1995 | A |
5495576 | Ritchey | Feb 1996 | A |
5516105 | Eisenbrey et al. | May 1996 | A |
5524637 | Erickson et al. | Jun 1996 | A |
5534917 | MacDougall | Jul 1996 | A |
5563988 | Maes et al. | Oct 1996 | A |
5577981 | Jarvik | Nov 1996 | A |
5580249 | Jacobsen et al. | Dec 1996 | A |
5594469 | Freeman et al. | Jan 1997 | A |
5597309 | Riess | Jan 1997 | A |
5616078 | Oh | Apr 1997 | A |
5617312 | Iura et al. | Apr 1997 | A |
5638300 | Johnson | Jun 1997 | A |
5641288 | Zaenglein | Jun 1997 | A |
5682196 | Freeman | Oct 1997 | A |
5682229 | Wangler | Oct 1997 | A |
5690582 | Ulrich et al. | Nov 1997 | A |
5703367 | Hashimoto et al. | Dec 1997 | A |
5704837 | Iwasaki et al. | Jan 1998 | A |
5715834 | Bergamasco et al. | Feb 1998 | A |
5872701 | Hayden, Sr. et al. | Feb 1999 | A |
5875108 | Hoffberg et al. | Feb 1999 | A |
5877803 | Wee et al. | Mar 1999 | A |
5913727 | Ahdoot | Jun 1999 | A |
5930383 | Netzer | Jul 1999 | A |
5933125 | Fernie | Aug 1999 | A |
5980256 | Carmein | Nov 1999 | A |
5989157 | Walton | Nov 1999 | A |
5995649 | Marugame | Nov 1999 | A |
6005548 | Latypov et al. | Dec 1999 | A |
6009210 | Kang | Dec 1999 | A |
6054991 | Crane et al. | Apr 2000 | A |
6066075 | Poulton | May 2000 | A |
6072494 | Nguyen | Jun 2000 | A |
6073489 | French et al. | Jun 2000 | A |
6077201 | Cheng et al. | Jun 2000 | A |
6098458 | French et al. | Aug 2000 | A |
6100896 | Strohecker et al. | Aug 2000 | A |
6101289 | Kellner | Aug 2000 | A |
6128003 | Smith et al. | Oct 2000 | A |
6130677 | Kunz | Oct 2000 | A |
6141463 | Covell et al. | Oct 2000 | A |
6147678 | Kumar et al. | Nov 2000 | A |
6152856 | Studor et al. | Nov 2000 | A |
6159100 | Smith | Dec 2000 | A |
6173066 | Peurach et al. | Jan 2001 | B1 |
6181343 | Lyons | Jan 2001 | B1 |
6188777 | Darrell et al. | Feb 2001 | B1 |
6215890 | Matsuo et al. | Apr 2001 | B1 |
6215898 | Woodfill et al. | Apr 2001 | B1 |
6226396 | Marugame | May 2001 | B1 |
6229913 | Nayar et al. | May 2001 | B1 |
6256033 | Nguyen | Jul 2001 | B1 |
6256400 | Takata et al. | Jul 2001 | B1 |
6283860 | Lyons et al. | Sep 2001 | B1 |
6289112 | Jain et al. | Sep 2001 | B1 |
6299308 | Voronka et al. | Oct 2001 | B1 |
6308565 | French et al. | Oct 2001 | B1 |
6316934 | Amorai-Moriya et al. | Nov 2001 | B1 |
6363160 | Bradski et al. | Mar 2002 | B1 |
6384397 | Takiar et al. | May 2002 | B1 |
6384819 | Hunter | May 2002 | B1 |
6411744 | Edwards | Jun 2002 | B1 |
6430997 | French et al. | Aug 2002 | B1 |
6476834 | Doval et al. | Nov 2002 | B1 |
6496598 | Harman | Dec 2002 | B1 |
6503195 | Keller et al. | Jan 2003 | B1 |
6539931 | Trajkovic et al. | Apr 2003 | B2 |
6570555 | Prevost et al. | May 2003 | B1 |
6633294 | Rosenthal et al. | Oct 2003 | B1 |
6640202 | Dietz et al. | Oct 2003 | B1 |
6661918 | Gordon et al. | Dec 2003 | B1 |
6681031 | Cohen et al. | Jan 2004 | B2 |
6714665 | Hanna et al. | Mar 2004 | B1 |
6731799 | Sun et al. | May 2004 | B1 |
6738066 | Nguyen | May 2004 | B1 |
6756797 | Brandorff et al. | Jun 2004 | B2 |
6765726 | French et al. | Jul 2004 | B2 |
6788809 | Grzeszczuk et al. | Sep 2004 | B1 |
6801637 | Voronka et al. | Oct 2004 | B2 |
6873723 | Aucsmith et al. | Mar 2005 | B1 |
6876496 | French et al. | Apr 2005 | B2 |
6937742 | Roberts et al. | Aug 2005 | B2 |
6950534 | Cohen et al. | Sep 2005 | B2 |
7003134 | Covell et al. | Feb 2006 | B1 |
7036094 | Cohen et al. | Apr 2006 | B1 |
7038855 | French et al. | May 2006 | B2 |
7039676 | Day et al. | May 2006 | B1 |
7042440 | Pryor et al. | May 2006 | B2 |
7050606 | Paul et al. | May 2006 | B2 |
7058204 | Hildreth et al. | Jun 2006 | B2 |
7060957 | Lange et al. | Jun 2006 | B2 |
7088397 | Hunter et al. | Aug 2006 | B1 |
7113918 | Ahmad et al. | Sep 2006 | B1 |
7121946 | Paul et al. | Oct 2006 | B2 |
7170492 | Bell | Jan 2007 | B2 |
7184048 | Hunter | Feb 2007 | B2 |
7202898 | Braun et al. | Apr 2007 | B1 |
7222078 | Abelow | May 2007 | B2 |
7227526 | Hildreth et al. | Jun 2007 | B2 |
7259747 | Bell | Aug 2007 | B2 |
7308112 | Fujimura et al. | Dec 2007 | B2 |
7317836 | Fujimura et al. | Jan 2008 | B2 |
7348963 | Bell | Mar 2008 | B2 |
7359121 | French et al. | Apr 2008 | B2 |
7367887 | Watabe et al. | May 2008 | B2 |
7379563 | Shamaie | May 2008 | B2 |
7379566 | Hildreth | May 2008 | B2 |
7389591 | Jaiswal et al. | Jun 2008 | B2 |
7412077 | Li et al. | Aug 2008 | B2 |
7421093 | Hildreth et al. | Sep 2008 | B2 |
7430312 | Gu | Sep 2008 | B2 |
7436496 | Kawahito | Oct 2008 | B2 |
7450736 | Yang et al. | Nov 2008 | B2 |
7452275 | Kuraishi | Nov 2008 | B2 |
7460690 | Cohen et al. | Dec 2008 | B2 |
7489812 | Fox et al. | Feb 2009 | B2 |
7536032 | Bell | May 2009 | B2 |
7555142 | Hildreth et al. | Jun 2009 | B2 |
7560701 | Oggier et al. | Jul 2009 | B2 |
7570805 | Gu | Aug 2009 | B2 |
7574020 | Shamaie | Aug 2009 | B2 |
7576727 | Bell | Aug 2009 | B2 |
7590262 | Fujimura et al. | Sep 2009 | B2 |
7593552 | Higaki et al. | Sep 2009 | B2 |
7598942 | Underkoffler et al. | Oct 2009 | B2 |
7607509 | Schmiz et al. | Oct 2009 | B2 |
7620202 | Fujimura et al. | Nov 2009 | B2 |
7668340 | Cohen et al. | Feb 2010 | B2 |
7680298 | Roberts et al. | Mar 2010 | B2 |
7683954 | Ichikawa et al. | Mar 2010 | B2 |
7684592 | Paul et al. | Mar 2010 | B2 |
7701439 | Hillis et al. | Apr 2010 | B2 |
7702130 | Im et al. | Apr 2010 | B2 |
7704135 | Harrison, Jr. | Apr 2010 | B2 |
7710391 | Bell et al. | May 2010 | B2 |
7729530 | Antonov et al. | Jun 2010 | B2 |
7746345 | Hunter | Jun 2010 | B2 |
7760182 | Ahmad et al. | Jul 2010 | B2 |
7809167 | Bell | Oct 2010 | B2 |
7834846 | Bell | Nov 2010 | B1 |
7852262 | Namineni et al. | Dec 2010 | B2 |
RE42256 | Edwards | Mar 2011 | E |
7898522 | Hildreth et al. | Mar 2011 | B2 |
8035612 | Bell et al. | Oct 2011 | B2 |
8035614 | Bell et al. | Oct 2011 | B2 |
8035624 | Bell et al. | Oct 2011 | B2 |
8072470 | Marks | Dec 2011 | B2 |
20050185088 | Kale et al. | Aug 2005 | A1 |
20070212061 | Woo | Sep 2007 | A1 |
20080026838 | Dunstan et al. | Jan 2008 | A1 |
20080246873 | Kinoshita | Oct 2008 | A1 |
20090213262 | Singh et al. | Aug 2009 | A1 |
Number | Date | Country |
---|---|---|
201254344 | Jun 2010 | CN |
0583061 | Feb 1994 | EP |
08044490 | Feb 1996 | JP |
9310708 | Jun 1993 | WO |
9717598 | May 1997 | WO |
9944698 | Sep 1999 | WO |
2009069925 | Jun 2009 | WO |
Entry |
---|
“Optical Mouse Sensor”, Retrieved at <<http://www.datasheet4u.com/html/A/D/N/ADNS-2610—AvagoTechnologies.pdf.html>>, Jul. 24, 2009, pp. 2. |
Kanade et al., “A Stereo Machine for Video-rate Dense Depth Mapping and Its New Applications”, IEEE Computer Society Conference on Computer Vision and Pattern Recognition, 1996, pp. 196-202,The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA. |
Miyagawa et al., “CCD-Based Range Finding Sensor”, Oct. 1997, pp. 1648-1652, vol. 44 No. 10, IEEE Transactions on Electron Devices. |
Rosenhahn et al., “Automatic Human Model Generation”, 2005, pp. 41-48, University of Auckland (CITR), New Zealand. |
Aggarwal et al., “Human Motion Analysis: A Review”, IEEE Nonrigid and Articulated Motion Workshop, 1997, University of Texas at Austin, Austin, TX. |
Shao et al., “An Open System Architecture for a Multimedia and Multimodal User Interface”, Aug. 24, 1998, Japanese Society for Rehabilitation of Persons with Disabilities (JSRPD), Japan. |
Kohler, “Special Topics of Gesture Recognition Applied in Intelligent Home Environments”, in Proceedings of the Gesture Workshop, 1998, pp. 285-296, Germany. |
Kohler, “Vision Based Remote Control in Intelligent Home Environments”, University of Erlangen-Nuremberg/Germany, 1996, pp. 147-154, Germany. |
Kohler, “Technical Details and Ergonomical Aspects of Gesture Recognition applied in Intelligent Home Environments”, 1997, Germany. |
Hasegawa et al., “Human-Scale Haptic Interaction with a Reactive Virtual Human in a Real-Time Physics Simulator”, Jul. 2006, vol. 4, No. 3, Article 6C, ACM Computers in Entertainment, New York, NY. |
Qian et al., “A Gesture-Driven Multimodal Interactive Dance System”, Jun. 2004, pp. 1579-1582, IEEE International Conference on Multimedia and Expo (ICME), Taipei, Taiwan. |
Zhao, “Dressed Human Modeling, Detection, and Parts Localization”, 2001, The Robotics Institute, Carnegie Mellon University, Pittsburgh, PA. |
He, “Generation of Human Body Models”, Apr. 2005, University of Auckland, New Zealand. |
Isard et al., “Condensation—Conditional Density Propagation for Visual Tracking”, 1998, pp. 5-28, International Journal of Computer Vision 29(1), Netherlands. |
Livingston, “Vision-based Tracking with Dynamic Structured Light for Video See-through Augmented Reality”, 1998, University of North Carolina at Chapel Hill, North Carolina, USA. |
Wren et al., “Pfinder: Real-Time Tracking of the Human Body”, MIT Media Laboratory Perceptual Computing Section Technical Report No. 353, Jul. 1997, vol. 19, No. 7, pp. 780-785, IEEE Transactions on Pattern Analysis and Machine Intelligence, Caimbridge, MA. |
Breen et al., “Interactive Occlusion and Collusion of Real and Virtual Objects in Augmented Reality”, Technical Report ECRC-95-02, 1995, European Computer-Industry Research Center GmbH, Munich, Germany. |
Freeman et al., “Television Control by Hand Gestures”, Dec. 1994, Mitsubishi Electric Research Laboratories, TR94-24, Caimbridge, MA. |
Hongo et al., “Focus of Attention for Face and Hand Gesture Recognition Using Multiple Cameras”, Mar. 2000, pp. 156-161, 4th IEEE International Conference on Automatic Face and Gesture Recognition, Grenoble, France. |
Pavlovic et al., “Visual Interpretation of Hand Gestures for Human-Computer Interaction: A Review”, Jul. 1997, pp. 677-695, vol. 19, No. 7, IEEE Transactions on Pattern Analysis and Machine Intelligence. |
Azarbayejani et al., “Visually Controlled Graphics”, Jun. 1993, vol. 15, No. 6, IEEE Transactions on Pattern Analysis and Machine Intelligence. |
Granieri et al., “Simulating Humans in VR”, The British Computer Society, Oct. 1994, Academic Press. |
Brogan et al., “Dynamically Simulated Characters in Virtual Environments”, Sep./Oct. 1998, pp. 2-13, vol. 18, Issue 5, IEEE Computer Graphics and Applications. |
Fisher et al., “Virtual Environment Display System”, ACM Workshop on Interactive 3D Graphics, Oct. 1986, Chapel Hill, NC. |
“Virtual High Anxiety”, Tech Update, Aug. 1995, pp. 22. |
Sheridan et al., “Virtual Reality Check”, Technology Review, Oct. 1993, pp. 22-28, vol. 96, No. 7. |
Stevens, “Flights into Virtual Reality Treating Real World Disorders”, The Washington Post, Mar. 27, 1995, Science Psychology, 2 pages. |
“Simulation and Training”, 1994, Division Incorporated. |
Number | Date | Country | |
---|---|---|---|
20110069221 A1 | Mar 2011 | US |