Patent Application
20110310218
Embodiments of the invention relate generally to a fast addressable multi-resolution lens system, and more particularly to a camera system that includes low and high resolution modes.
Optical recognition camera systems may be used to recognize objects in an image in industrial and security settings, as examples. In an industrial setting, these systems may be used in industrial inspection, serving the role to not only do basic inspections (component present/absent) but also to direct a mechanism to reject parts, position robots, or update databases, as examples.
In a security application, as another example, cameras may be used to identify individual faces in a crowd. In such an application, a system may use a first camera viewing a wide scene that may include a crowd of multiple people as well as other objects in a scene and a second camera having a higher resolution as well as a face recognition application that may be used to identify an individual within the crowd. Methods of two-dimensional (2D) face recognition have been widely published and are in use commercially today. These methods include such tools as large scale correlation, key point selection, wavelets and segmenting of the face into key components. In one example, a “self portrait” mode is made specifically to snap a picture when a face is positioned in the center of the camera view.
Today, dual resolution systems, or optical systems are often based upon dual camera systems or mechanical zooms. In these systems, the large view camera examines the scene, and then a high resolution camera is panned and tilted to a specific location. Thus, for high magnification in a traditional system, some means for pan and tilt are needed to move the small field-of-view for focusing on various specified locations. Typical security camera pan tilt units are large units that move the whole camera and are motorized by stepper motors or potentiometer equipped DC motors.
These systems that include movement of the whole camera have the disadvantage, especially in a security application, of potentially indicating to imaged subjects that they are in fact being viewed. For example, movement of a whole camera may draw the attention of the subject being imaged, and any panning and tilting of such a camera to coincide with the movement of the subject may indicate that the subject is of particular interest. Typical systems may also have the disadvantage of the cost of a second camera, and a speed of the pan/tilt mechanism may be too slow to follow subject movement. Further, these systems can have a reduced reliability because of the number of components and because of the mechanical mechanisms used to pan/tilt or autofocus the camera, which can lead to additional maintenance costs and system downtime. Thus, for reasons of reliability, cost, and performance, it is desirable to minimize the number of moving elements in a face recognition system.
One solution for a multiple resolution camera may be to integrate precise actuators into the lens itself. Small simple actuators can provide the limited pan, tilt, and focus without moving the entire system. However, this technology, based on piezo-driven lead screws, is typically only capable of short travel and light loads, thus limited to smaller lenses. Overall, these systems having piezoelectric focus mechanisms also tend to be expensive.
Therefore, it would be desirable to design an optical system and a method of fabricating same that overcomes the aforementioned drawbacks.
The invention is a multi-resolution optical system and a method of fabricating same.
According to one aspect, a multi-resolution lens system includes a relay lens configured to be directed toward a field-of-view (FOV) and receive a first plurality of image photons emanating from the FOV, a high-resolution lens positioned to receive a second plurality of image photons from the FOV and to pass the second plurality of image photons toward the relay lens, and a shutter device positioned to receive over an area thereof the image photons of the FOV that pass through the relay lens, and simultaneously receive overlaid on a portion of the area thereof the image photons from the portion of the FOV that pass through the high-resolution lens and toward the relay lens.
According to another aspect, a method of manufacturing a lens assembly includes providing a housing having a first aperture and a second aperture, and positioning a relay lens in the housing to receive image photons that pass from a field-of-view (FOV) and through the first aperture, and pass the image photons toward the second aperture. The method further includes positioning a high-resolution lens in the housing and between the first aperture and the relay lens, and positioning a shutter device between the relay lens and the second aperture.
According to another aspect, a computer readable storage medium having stored thereon a computer program, the computer program configured to generate an image of a full field-of-view (FOV), the image generated from photons passing from the full FOV, through a relay lens, and toward a shutter device, identify a first object-of-interest within the image for magnification, and position a high resolution lens to receive and pass photons from the identified first object-of-interest, through the relay lens, and toward the shutter device.
Various other features and advantages will be made apparent from the following detailed description and the drawings.
The drawings illustrate preferred embodiments presently contemplated for carrying out the invention.
In the drawings:
The operating environment of embodiments of the invention is described below with respect to a security camera or optical system for observing faces in a crowd at a first, low resolution and then automatically zooming in on a face within the crowd using a second, high resolution. The system described herein may be employed having an automatic face recognition capability, or it may be manually operated by security personnel while scanning a crowd and then focusing on a face within the crowd. Further, the system and method described herein are not limited to a security setting related to face recognition, but may be used in general for surveillance, as an example. For instance, a wide field-of-view (FOV) may be scanned or viewed at low resolution, and when an object or scenario of interest is identified for particular surveillance, a close-up or high-resolution FOV of the object of interest may be obtained.
Also, the operating environment is not limited to a security or surveillance environment. For instance, in an industrial inspection application, several parts may be viewed in a low resolution FOV, and then a close-up or high-resolution view may be obtained of one of the parts, according to embodiments of the invention. Thus, the embodiments of the invention described herein are applicable to any imaging system or application that may benefit from an ability to quickly switch between a low resolution FOV and a high resolution image of an object within the FOV using a single dual-resolution camera.
Referring to
Imaging system 10 includes a focusing lens 26 that is typically in a fixed location and positioned behind relay lens 20 to bring the small field image of smaller region or sub-region 24 back into focus and centered on a sensor or digitizing input 28. In one embodiment, digitizing input 28 is attached to housing 14 at second aperture 18, and in another embodiment, digitizing input 28 is separate from housing 14 and not attached thereto. Imaging system 10 includes a controllable blocking device 30, which may include an LCD or a mechanical shutter, as examples, which may be controlled to selectively block portions thereof from transmitting photons therethrough and to allow photons to pass through unblocked portions. For instance, an image of smaller region or sub-region 24 may pass to high-resolution lens 22, to relay lens 20, and to controllable blocking device 30 over a first area 32. Simultaneously, the primary image from wide FOV 12 passes to relay lens 20 and then to controllable blocking device 30 over a second area 34 thereof. Relay lens 20 is sized and positioned to receive the primary image and pass the image to controllable blocking device 30. In one embodiment, relay lens 20 is selected having a focal length 36 that corresponds to a distance between relay lens 20 and controllable blocking device 30, so that blocking device 30 is positioned properly with respect to relay lens 20.
Imaging system 10 includes a controller 38 coupled to digitizing input 28 and high-resolution lens 22. High-resolution lens 22 and relay lens 20 together create a secondary image at infinity (a collimated field) of sub-region 24 of wide FOV 12, which is directed toward digitizing input 28. Relay lens 20, at the same time, overlaps a large field image of the primary image which includes wide FOV 12, which is also directed toward digitizing input 28. The secondary image is generated from sub-region 24 and may include a face in a crowd or an object for inspection in, for instance, a manufacturing environment, as examples. Thus, imaging system 10 may be directed toward wide FOV 12 by maintaining imaging system 10 in a stationary position where wide FOV 12 is viewable therefrom. In one embodiment, not illustrated, imaging system 10 may be positioned on a rotatable device that is controllable via a controller such as controller 38 or via a remote access device such as a web page on the Internet that is itself remotely accessible and controllable.
Referring now to
Thus, image photons of wide FOV 12 are passed to second area 34 of controllable blocking device 30 while image photons of smaller region or sub-region 24 passing from high-resolution lens 22 are simultaneously passed to first area 32 of controllable blocking device 30. The passage of image photons from either wide FOV 12 or sub-region 24 to digitizing input 28 may be quickly toggled by simply selecting which area of controllable blocking device 30 to block. Controllable blocking device 30 may be, for example, an LCD or similar blocking device that selectively blocks either the large (wide) field rays or the small (narrow) field rays. In alternatives, the blocking can occur at the location of high-resolution lens 22, at the location of the secondary image behind relay lens 20, or at focusing lens 26 behind controllable blocking device 30, as examples. For instance, a controllable blocking device may be positioned at a first alternate location 38 or a second alternate location 40, which may be controllably blocked in the same manner as described with respect to controllable blocking device 30.
Thus, two images are available simultaneously and may be selectively directed toward digitizing input 28 via controllable blocking device 30, or via the other means of selectively blocking, as mentioned.
Alternative embodiments include digital image segmentation, color filtering, or other known methods to select the image to be projected to digitizing input 28. In one embodiment, only one frame may be used to quickly grab each high resolution image of a subject or object, leaving a wide field image useable as a continuous, human observable image.
Embodiments of the invention may be designed to produce from images photons based on the visible light spectrum or based on another spectrum such as the infrared (IR) spectrum to produce thermal images from a nighttime or dark environment. Thus, depending on the desired spectrum of photons to be imaged (visible light, near IR, etc.), controllable blocking device 30 is correspondingly configured to include an ability to selectively block or allow photons in the desired spectrum.
As such, embodiments of the invention provide fast access switching between a wide field and a close up image. By incorporating two images having different resolution into one lens system, excessive costs of a second camera and pan-tilt system is avoided. Further, by having an ability to transversely locate a high resolution lens within the imaging system, a reliable and robust means is provided to locate a particular region of interest within a FOV and to focus thereon. The system includes few moving parts, thus a high degree of reliability may be realized. Also, such a system is non-intrusive to subjects during surveillance, and subjects may be viewed and focused on without their knowledge. In addition, such a system can be retrofitted into current installations for a relatively low cost, providing an attractive alternative for users who desire improved image quality over existing systems.
Thus, embodiments of the invention remove the need to use a dual separate camera system or to use pan and tilt cameras by transferring means of selecting a specific region within a field to a local image within the optical system. Mapping locations within a wide FOV or large field image may be directly addressed with a simple transversely positionable high-resolution lens, rather than with more complex operation of a separate pan and tilt camera. Embodiments of the invention also permit a fast change from one image to another by being able to address a location very quickly (i.e., no moving a whole camera, but rather moving an internal lens a small distance) and by being able to use electronic means such as an LCD or mechanical shutter to select one image or the other.
A technical contribution for the disclosed method and apparatus is that is provides for a computer implemented camera system that includes a low resolution mode and a high resolution mode.
One skilled in the art will appreciate that embodiments of the invention may be interfaced to and controlled by a computer readable storage medium having stored thereon a computer program. The computer readable storage medium includes a plurality of components such as one or more of electronic components, hardware components, and/or computer software components. These components may include one or more computer readable storage media that generally stores instructions such as software, firmware and/or assembly language for performing one or more portions of one or more implementations or embodiments of a sequence. These computer readable storage media are generally non-transitory and/or tangible. Examples of such a computer readable storage medium include a recordable data storage medium of a computer and/or storage device. The computer readable storage media may employ, for example, one or more of a magnetic, electrical, optical, biological, and/or atomic data storage medium. Further, such media may take the form of, for example, floppy disks, magnetic tapes, CD-ROMs, DVD-ROMs, hard disk drives, and/or electronic memory. Other forms of non-transitory and/or tangible computer readable storage media not list may be employed with embodiments of the invention.
A number of such components can be combined or divided in an implementation of a system. Further, such components may include a set and/or series of computer instructions written in or implemented with any of a number of programming languages, as will be appreciated by those skilled in the art. In addition, other forms of computer readable media such as a carrier wave may be employed to embody a computer data signal representing a sequence of instructions that when executed by one or more computers causes the one or more computers to perform one or more portions of one or more implementations or embodiments of a sequence.
According to one embodiment, a multi-resolution lens system includes a relay lens configured to be directed toward a field-of-view (FOV) and receive a first plurality of image photons emanating from the FOV, a high-resolution lens positioned to receive a second plurality of image photons from the FOV and to pass the second plurality of image photons toward the relay lens, and a shutter device positioned to receive over an area thereof the image photons of the FOV that pass through the relay lens, and simultaneously receive overlaid on a portion of the area thereof the image photons from the portion of the FOV that pass through the high-resolution lens and toward the relay lens.
According to another embodiment, a method of manufacturing a lens assembly includes providing a housing having a first aperture and a second aperture, and positioning a relay lens in the housing to receive image photons that pass from a field-of-view (FOV) and through the first aperture, and pass the image photons toward the second aperture. The method further includes positioning a high-resolution lens in the housing and between the first aperture and the relay lens, and positioning a shutter device between the relay lens and the second aperture.
According to yet another embodiment, a computer readable storage medium having stored thereon a computer program, the computer program configured to generate an image of a full field-of-view (FOV), the image generated from photons passing from the full FOV, through a relay lens, and toward a shutter device, identify a first object-of-interest within the image for magnification, and position a high resolution lens to receive and pass photons from the identified first object-of-interest, through the relay lens, and toward the shutter device.
This written description uses examples to disclose the invention, including the best mode, and also to enable any person skilled in the art to practice the invention, including making and using any devices or systems and performing any incorporated methods. The patentable scope of the invention is defined by the claims, and may include other examples that occur to those skilled in the art. Such other examples are intended to be within the scope of the claims if they have structural elements that do not differ from the literal language of the claims, or if they include equivalent structural elements with insubstantial differences from the literal languages of the claims.
