Patent Application
20140355974
This disclosure generally relates to multi-view or autostereoscopic image system that uses a single camera to capture multiple views, and more particularly relates to a system that uses a transreflective device to multiplex distinct images to the single camera.
Various configurations of multi-view or autostereoscopic cameras that use only one camera have been proposed. A configuration shown in U.S. Pat. No. 8,381,985 issued to Ferren et al. on Feb. 26, 2013 uses a beam splitter in conjunction with shutters to multiplex distinct images to a single camera. This configuration has the undesirable attribute that the beam splitter reduce by half the intensity of light received the camera. Another configuration shown in U.S. Pat. No. 7,181,136 to Perisic issued Feb. 20, 2007 uses minors to provide a split image to a single camera. This configuration has the undesirable attribute that each image (e.g. left half-image and right half-image) has half the resolutions of what would be available if the images were multiplexed to the single camera.
In accordance with one embodiment, a multi-view image system is provided. The system includes a single camera and a transreflective device. The single camera is configured to capture an image. The transreflective device is operable to a transparent-state where light passes through the transreflective device to provide the camera a first image of an area from a first perspective. The transreflective device is also operable to a reflective-state where light is reflected by the transreflective device to provide the camera a second image of the area from a second perspective distinct from the first perspective.
In an embodiment, the system also includes a mirror arrangement configured to cooperate with the transreflective device to provide the camera the first image when the transreflective device is in the transparent-state, and the second image when the transreflective device in in the reflective-state.
Further features and advantages will appear more clearly on a reading of the following detailed description of the preferred embodiment, which is given by way of non-limiting example only and with reference to the accompanying drawings.
The present invention will now be described, by way of example with reference to the accompanying drawings, in which:
An advantageous feature of the system 10 is that only a single camera, hereafter the camera 26, is necessary for the system 10 to capture multiple views of the area 16. In general, the camera 26 is configured to capture a series of distinct images that include, but are not limited to, the first image 18 from the first perspective 20, and the second image 22 from the second perspective 24. As will become apparent in the description that follows, the system 10 multiplexes distinct images of the area 16 from distinct perspectives. As used herein and in accordance with this example, multiplexed images are characterized by the fact that the camera receives the first image 18 during a first time period, and receives a second image 22 during a second time period distinct from the first time period. In other words, the first image 18 and the second image 22 are alternated so the camera 26 receives one or the other. As such, multiple cameras are not required thereby reducing the cost of the system 10. Furthermore, since the images are multiplexed to the camera 26, each image captured by the camera 26 may be captured using the full resolution capability of the camera 26.
The system 10 also includes a transreflective device 30 that is generally configured to be operable to a transparent-state where the light of the images passes through the transreflective device 30, and operable to a reflective-state where light is reflected by the transreflective device 30. In the example illustrated in
In one embodiment, the function of the transreflective device 30 may be provided by an electrically switchable transreflective mirror (ESTM) available from Kent Optronics, Inc. located in Hopewell Junction, N.Y., USA. Alternatively, the function of the transreflective device 30 may be provided by a microshutter array that is described in a paper entitled MAGNETICALLY ACTUATED MICROSHUTTER ARRAYS by Mott et al., published in the Proceedings of Society for Optics and Photonics (SPIE) Vol. 4561 (2001), or U.S. Pat. No. 8,218,220 to Dodds et al, issued Jul. 10, 2012. Such microshutter array may include a metalized surface such as aluminum deposited using known deposition processes commonly used for integrated circuit manufacturing.
The camera 26 may include a processor (not shown) such as a microprocessor or other control circuitry as should be evident to those in the art. The processor may include memory, including non-volatile memory, such as electrically erasable programmable read-only memory (EEPROM) for storing one or more routines, thresholds and captured images. The one or more routines may be executed by the processor to perform steps to output a control signal 28 for controlling the transreflective device 30, and processing images received by the camera 26. For example, the processor may determine a three-dimensional (3D) location of the object 12 as part of an object detection activity, or for rendering a birds-eye view of the area 16.
The system 10 may include a mirror arrangement 32 configured to cooperate with the transreflective device 30 to provide the camera 26 the first image 18 when the transreflective device 30 is in the transparent-state, and the second image 22 when the transreflective device 30 is in the reflective-state. In this non-limiting example, the minor arrangement 32 constitutes a mirror 34. It is contemplated that the minor 34 is fixed, but could be replaced with a movable mirror (not shown) so that the distance from the camera 26 to where the center lines indicated by the first perspective 20 and the second perspective 24 intersect could be varied. It is also contemplated that the angle of the mirror 34 could be fixed so that the system 10 always takes panoramic image of the area 16. It is also contemplated that the minor arrangement 32 may include additional minors configured to equalize the optical path length from the camera 26 to the object 12 for the first image 18 and the second image 22, for example. It is noted that without the minor arrangement 32, the system 10 may still be useful to capture images where the second perspective 24 is oriented at right angles to the first perspective 20.
It is also contemplated that the transreflective device 30 and the minor arrangement 32 could be integrated within the camera between the camera's imager 44 and lens 46. The size of the devices would be proportionately smaller with the placement within the camera and could be advantageous from a cost integration perspective.
In general, the transreflective devices are operated so only one of the images (the first image 18, the second image 22, the third image 36, and the fourth image 40) is received by the camera 26 at any given time). The minor arrangement 32 may be configured so that various combinations of the images can be paired to form autostereoscopic images. For example the third image 36 and the fourth image 40 may be used to more accurately estimate a distance from the camera 26 to the object 12 as the spacing of the third perspective 38 and the fourth perspective 42 is the greatest for this non-limiting example. Alternatively, the mirror arrangement 32 may be such that the various perspectives (the first perspective 20, the second perspective 24, the third perspective 38, and the fourth perspective 42 may be oriented to provide a panaoramic view of the area 16, including a view behind the camera 26, i.e.—a direction opposites of the direction to the object 12. The advantage of using transreflective devices instead of beam splitters and shutters is particularly apparent for this example as an image would be greatly reduced if the image encountered two beam splitters before reaching the camera 26.
Accordingly, a multi-view image system (the system 10) is provided. Such a system may be particularly useful on a vehicle for detecting objects in an area proximate to the vehicle, especially since the cost of such features on a vehicle are highly scrutinized. For example, the autostereoscopic capability of the system 10 can be used to estimate the distance to an object in front of or behind a vehicle in order to warn the operator of the vehicle, or automatically apply the brakes of the vehicle, for example. The system may also be useful for synthesizing a ‘birds-eye’ view of the area surrounding the vehicle. The system 10 may also be used inside the vehicle to detect in three dimensions gestures made by the operator or occupants of the vehicle for controlling devices of the vehicle. Non-vehicle applications include gesture recognition by personal computing devices such as smart phones, tablets, personal computers, security systems, and the like.
While this invention has been described in terms of the preferred embodiments thereof, it is not intended to be so limited, but rather only to the extent set forth in the claims that follow.
