Patent Application
20070177018
The present invention relates to an image sensor coprocessor, and more particularly, to an image sensor coprocessor for use with Standard Mobile Imaging Architecture image sensors.
The growth of image sensors within mobile cellular telephone products has required significant developments in a number of areas including image quality, power consumption and module size. One aspect of this was the development of the Standard Mobile Imaging Architecture (SMIA) standard for image sensors to allow mobile phone manufacturers to select image sensor modules from a variety of providers. Details of the SMIA standard can be found at http://www.smia-forum.org/, the contents of which are herein incorporated by reference.
Other devices, such as laptop computers and web cameras, are constrained to other personal computer data interface standards such as USB (Universal Serial Bus) 1.0 and USB 2.0. Image sensors for these devices have been developed separately from the mobile telephone market and use a proprietary standard depending on the manufacturer. As such, these devices require proprietary coprocessors for each image sensor to transport the image information to the device using a particular format, such as USB.
The problem associated with prior art coprocessors is that they need to be used with a particular image sensor and cannot readily be used with multiple image sensors.
An object of the invention is to provide a coprocessor that enables an image sensor that adheres to the SMIA protocol to be used with devices that do not adhere to the SMIA protocol.
A first aspect of the present invention is directed to an image sensor coprocessor comprising an SMIA image sensor interface for accepting data from an SMIA image sensor, a device interface for transmitting and receiving instructions and data from a device, and a protocol translation module. The protocol translation module enables instructions received at the device interface to be translated to instructions for the SMIA image sensor interface, and sensor data from the SMIA image sensor interface to be translated to device data for the device interface.
Preferably, the SMIA image sensor interface comprises a camera control interface module for transmitting and receiving instructions and a camera control processor for receiving the sensor data.
The device interface may be a Universal Serial Bus (USB) interface. The USB interface may conform to one or more of the USB 1.0 or 2.0 standards. The sensor data may be a sensor video stream and, as such, the device data may be a device video stream.
The coprocessor may further comprise a video processing module to process the device video stream prior to being received at the device interface. The coprocessor may enable the device video stream received at the device interface to be unprocessed.
The coprocessor may comprise two or more SMIA image sensor interfaces, and two or more sets of sensor data may be processed by the protocol translation module for generating two or more sets of device data for the device interface.
A second aspect of the present invention is directed to a web camera comprising an image sensor coprocessor as defined above.
A third aspect of the present invention is directed to a portable computer comprising an image sensor coprocessor as also defined above.
A fourth aspect of the present invention is directed to a personal digital assistant (PDA) comprising an image sensor coprocessor as defined above.
Embodiments of the present invention will now be described, by way of example only, with reference to the accompanying drawings, in which:
The widely available mobile cellular telephone, or mobile phone, and increasing demand for additional functions incorporated within it have driven improvements in image sensors and, in particular, in CMOS image sensors. The mobile phone manufacturers developed a standard to enable them to swap in any image sensor, regardless of resolution or manufacturer, with their mobile telephone format coprocessor.
Image sensors traditionally used for other applications, such as web cameras and the like, continue to require to be individually designed with a proprietary image sensor and corresponding coprocessor or a single chip design with the image sensor chip also performing the functions of the coprocessor. Both of these options have a development time which can be extremely long.
As shown in
The coprocessor 14 has three corresponding interfaces: a data sync interface 28, an I2C master interface 30 and a parallel image data in interface 32. The coprocessor also comprises a video processing module 34, a buffer 36 and device interface, which, in this example, is a USB interface 38. The USB interface 38, in this example, is connected to a personal computer 40.
The I2C bus between the coprocessor 14 and image sensor 12, embodied by the I2C interface 24 and I2C master interface 30, enables instructions from the USB interface 30 to directly control the image sensor 12. The parallel data link, between the parallel image data interface 26 and the parallel image data in interface 32, is a high bandwidth data link which allows the transmission of the image data from the sensor to the coprocessor. Synchronization signals are sent from the capture interface 22 to the data sync interface 28 to allow correct transfer of data.
The video processing module 34 processes the raw video data from the image sensor and performs various operations, such as color correction and video compression, before transmitting the processed video via a buffer 36 to the USB interface 38 and consequently to the personal computer 40.
SMIA image sensors are not compatible with coprocessors of the type shown in
The SMIA image sensor 52 comprises an image array 60, an array driver 62, a digital control 64, a corresponding camera control interface 66 and a corresponding camera control processor 68.
The fact that the mobile phone is now the most significant sector of the image sensor imaging market means that developments for these products attract the most technological investment. One area, in particular, is the drive to reduce the physical module size. Such small camera modules are attractive to non-mobile markets such as laptops and PDAs. However, as they do not use the same video data interface as mobile phones, they cannot interface directly to the SMIA image sensors.
The present invention enables an SMIA camera module to be used with personal computer, and other devices, data interfaces, such as USB 2.0, to give non-mobile markets rapid access to the developments made in the cameras developed for mobile phone products.
Referring to
The image sensor coprocessor 74 comprises a SMIA image sensor interface, in the form of a Camera Control Processor (CCP) 76 and a Camera Control Interface 78 (CCI), to enable communications with the SMIA image sensor 72 using the SMIA standard. Furthermore, the coprocessor 74 comprises a device interface, which in this example, is a USB interface 80.
As the USB interface 80 requires adherence to the USB video class standard, and the SMIA image sensor interface requires adherence to the SMIA standard, a protocol translation module 82 maps instructions from one standard to that of the other.
The SMIA standard includes the CCP (Camera Control Processor) Sub-LVDS (Sub-Low Voltage Differential Signaling) data link from the image sensor to the processor performing video processing. The coprocessor then processes the raw video data from the SMIA image sensor and outputs it in the required format such as USB 1.0 or USB 2.0.
In a further embodiment, the image sensor coprocessor may have multiple inputs from image sensors by having additional CCP interfaces. This would allow the coprocessor send multiple video streams down the USB link. This could be used in applications such as stereo vision.
As well as creating PC imaging products the proposed coprocessor could be used to validate a SMIA camera in a PC environment due to the high bandwidth available with USB 2.0.
The coprocessor makes it possible to have a coprocessor that takes raw video input from a SMIA camera, developed for the mobile market, and converts it to a format compatible with PC products. This single coprocessor development would give the non-mobile market rapid access to the wide range of image sensors made for the mobile market without the need for custom PC developments.
Improvements and modifications may be incorporated without departing from the scope of the present invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 05270094.5 | Dec 2005 | EP | regional |
