Patent Application
20070052808
The present invention relates to an electronic device, which includes
Portable electronic devices equipped with camera devices, such as, for example, mobile stations, can be used for still and video imaging, and also for videoconferencing. In a videoconferencing situation, the opposite party is shown on the display of the device. In still and video imaging, the display of the device acts as the viewfinder.
However, a device technology problem is associated with implementing functionalities of this kind. Normally, in order to perform still and video imaging, lens optics and an image sensor must be arranged on the opposite side of the case structure of the device relative to the display component that acts as the viewfinder. On the other hand, in order to arrange a videoconferencing functionality, the lens optics and image sensor must be on the same side of the device as the display component, because in that case the opposite party is shown on the display while the image sensor is used simultaneously to image and transmit the user's own image to the opposite party.
To implement such functionalities, an arrangement of two separate image sensors in the same device, for instance, is known from the prior art. In that case, the lenses oriented in different directions each have a separate image sensor connected to them. However, the doubling of the camera components makes this quite cost-intensive. In addition, the limited size particularly of portable electronic devices makes it a challenge to arrange the two sensors, as there is no excess space in the case structures of the devices.
US patent publication 2003/0109232 discloses a camera-device arrangement, which is installed in the hinge-pin casing between the device's rotating cover and its body. The hinge-pin casing can then be rotated quite freely through as much as 180 degrees.
U.S. Pat. No. 6,535,239 discloses, as another prior art solution, the division of an elongated one-case structure into two parts, with the aid of longitudinal jointing. The camera devices can then be aimed by twisting the case structure. However, such a solution gives the device a rather deformed appearance.
A third solution depicting the prior art is the use of separate attachable camera modules. One such implementation is disclosed in WO publication 97/26744 (Robb). In it, an image sensor that can be turned in different exposure directions is attached to a portable device, as its own camera module. Such an attachable module also gives the device a deformed appearance and makes it difficult to use.
The difficulty of arranging it in present portable devices which have a slim appearance is, however, one significant drawback associated with the solution disclosed in the above Wo publication. Arranging a rotatable image sensor, together with the necessary optics, in a slim device concept is challenging, as the devices may, in certain structural constructions, be of a size that is even of the same order as that of the height/width of the sensor. In addition, the internal spaces of the cases of the devices are extremely cramped. Further, the properties of the optics facing different directions also differ from each other. This too creates a challenge in order to arrange them in connection with the exposure apertures. For example, the optics arrangements required by video-conferencing use and conventional imaging use also create their own challenges to devices with a slim appearance and equipped with a rotatable image sensor.
The present invention is intended to create a new type of electronic device equipped with camera devices and a method for controlling the camera devices of an electronic device. The characteristic features of the device according to the invention are stated in the accompanying claim 1 and those of the method in claim 9. In addition, the invention also relates to software means for implementing the method according to the invention, and an image sensor, the characteristic features of which are stated in the accompanying claims 13 and 14.
The electronic device according to the invention, by means of which a still/video imaging functionality can be implemented, in which the display of the device is used at least as a viewfinder, and also a videoconferencing functionality, in which the display of the device is used at least to show the opposite party, can be implemented using a single rotatable image sensor, in connection with which at least part of the optics is arranged to be rotatable.
The electronic device according to the invention includes a case structure, in connection with which a display component is fitted. Directional camera devices, which include, an image sensor and, surprisingly, also at least part of the optics, which are arranged to rotate, are fitted inside the case structure. The camera devices can be oriented at least to the display-component side and to a side differing from it, to conform with which the case structure includes an aperture arrangement for exposing the image sensor from outside the device. A characteristic feature of the electronic device according to the invention is that, besides the image sensor, at least part of the optics is arranged so that it can be rotated along with the image sensor to at least two exposure directions, the aperture arrangement being arranged in the case structure to conform with the exposure directions.
In the method according to the invention, the image sensor and at least part of the optics are oriented by turning them, relative to the device, to the selected exposure direction, after which imaging can be performed. The method according to the invention is characterized by the image sensor and at least part of the optics required for imaging being oriented by rotating them to the selected exposure direction, without any need to apply any special orienting measures to the actual case structure of the device.
Advantages are gained with the aid of the invention in applications in which, according to the prior art, two image sensors, each with their own associated optics, must be used. In addition, a solution using only a single image sensor can now also be used in mono-block-case devices, in which there is no hinge-pin between the cover and the body. The device according to the invention can be implemented using quite simple mechanical arrangements.
Still/video images can be taken using the rotatable image sensor installed inside the case structure of the device, through an exposure-aperture arrangement oriented to two different sides of the device. At least part of the optics for performing imaging, which, together with the optics arranged rotatably in connection with the image sensor, forms the necessary total optics, is therefore be arranged in connection with at least these two exposure directions. The optics can be arranged in several different ways. They can be partly fixed in connection with the apertures and partly, according to the invention, surprisingly also in connection with the rotatable image sensor. Lens arrangements that are entirely connected to the apertures, or even to the sensor are possible in certain cases.
Further, according to one embodiment, the optics can arranged in an appropriate manner. Thus, the optics connected to the exposure aperture on the display side, for example, can be arranged especially for close-up imaging, as a negotiating party to be imaged during videoconferencing will be generally close to the display of the device, observing the opposite party shown on the display. According to another embodiment, the optics arranged for still/video imaging can be equipped with a focal-length adjustment functionality (zoom).
The use of the invention achieves a particular advantage in the case of devices of a limited case size. The rotation of the image sensor is now also possible in these, even though the internal space of the case might be extremely cramped.
The other features characteristic of the invention will become apparent from the accompanying Claims while additional advantages achieved are itemized in the description portion.
In the following, the invention, which is not restricted to the embodiments disclosed in the following, is described in greater detail, with reference to the accompanying drawings, in which
a and 4b show a second embodiment of the electronic device according to the invention, as a cross-section when the image sensor is being rotated, and
The mobile station 10 shown in
The actual physical totality incorporating the image sensor 12 can be in the device 10 either permanently or detachably. If it is permanent, the image sensor 12 can be inside the actual case structure 23 of the device 10. The case structure 23 of the device 10 can be, for example, a so-called mono-block, when the case 23 is formed from a single unified piece. On the other hand, the case structure 23 can also be of an opening type, such as a ‘clamshell’ (not shown).
One example of a detachable camera device is a camera module that can be connected to the device's connector interface, so that the camera devices can also be disconnected from the actual case structure of the device. In that case, the detachably attachable camera module can also be considered as the case structure of the device.
The functions of the device 10 can be controlled using the processor unit DSP/CPU 13, by which, among other things, the information displayed on the display component 19 of the device 10 can be controlled. The processor unit 13 can be controlled from the user interface 14, which can be understood, for example, as a keypad and various switches.
In the device 10 according to the invention, the camera devices 12 are oriented by rotating the image sensor 12 and also, surprisingly, at least part of the optics 20.2′. When further references are made to rotating/reorienting the sensor 12, the terms will also refer equally to the rotation/reorientation of the optics 20.2′ arranged in the sensor 12. The optics 20.2′ rotating with the image sensor 12 can be in connection with the image sensor 12. In this case, the rotating of the image sensor 12 and at least part of the optics 20.2′ can be understood very broadly, as can be seen in the light of the embodiments presented later.
The case structure 23 also includes an aperture arrangement 21.1, 21.2 for exposing the image sensor 12 from outside. The aperture arrangement 21.1, 21.2 is arranged in such a way that the image sensor 12 can be oriented through them, at least for imaging (for example, in the videoconferencing functionality) performed on the display-component 19 side FS, and for imaging (for example, still/video imaging, in which case the display 19 can be used as the viewfinder) performed on another side BS relative to the display component 19. Generally, these sides are the front side FS and the back side BS, relative to the user of the device 10, depending partly on the shape of the device 10 and on the orienting of the display 19. The angle between the exposure apertures 21.1, 21.2 on the front and back sides FS, BS of the device 10 can then be approximately 180 degrees, though it can also deviate from this, as will be described later.
The paths of rotation of the image sensor 12 and the optics 20.2′ can be arranged in such a way that they can be set in at least two exposure directions FS, BS, in order to select the optical imaging path. The aperture arrangement 21.1, 21.2 associated with the rotation path of the image sensor 12 and the optics 20.2′ is arranged in the case structure 23 according to these exposure directions FS, BS.
In the device 10 according to the invention, the orienting mechanism 16 of the camera devices is operationally in connection with the camera devices, for instance, the image sensor 12. This permits the camera devices and particularly the image sensor 12 and at least part of the optics 20.2′ to be oriented, with no particular rotation measures having to be applied to the actual case structure 23 of the device 10. There is a corresponding aperture arrangement 21.1, 21.2 in the case 23 for exposing the sensor 12 according to the orienting directions FS, BS of the camera devices 12, 20.1, 20.2, 20.2′ in relation to which aperture arrangement 21.1, 21.2 the camera devices, or at least the image sensor 12 and part of the optics 20.2′, are arranged to be oriented, for example, by being rotated relative to an imagined axis of rotation running through the image sensor 12. The axis of rotation can be selected freely.
According to one embodiment, the aperture arrangement can include at least two apertures 21.1, 21.2. In that case, one of the apertures 21.2 can be, for example, on the same side FS as the display component 19, thus permitting the image sensor 12 to be used, for example, in a videoconferencing functionality. The other aperture 21.1 can then be on a different side BS of the case structure 23 relative to the display component 19, in which case the image sensor 12 can be used for still/video imaging while the display component 19 can simultaneously be used as a viewfinder, from which the imaging can be monitored. The image sensor 12 and the display 19 may permit the device to be used for other applications too, for example, to act as a mirror, or a bar-code reader. In mirror operation, image information that is detected through the aperture 21.2 using the image sensor 12 oriented to the display 19 side FS, is shown on the display 19 of the device 10. The embodiment shown in
As is known, the image sensor 12 requires optics to focus the image on the sensor 12. According one embodiment, in the device 10 according to the invention at least one part of the optics 20.1, 20.2 may be connected to the aperture arrangement 21.1, 21.2, for example, as a fixed lens arrangement. In that case, at least another part of the optics 20.2′ can be arranged in a surprising manner in connection with the image sensor 12, so that, if the image sensor 12 is turned, the lens arrangement 20.2′ connected to it will also turn correspondingly with it. On the other hand, the lens groups 20.1, 20.2, 20.2′ can also be either entirely rotatable in connection with the image sensor 12, or entirely fixed in connection with the apertures 21.1, 21.2.
The use of optics 20.2′ that rotate along with the image sensor 12, to which the invention also relates, achieves a particular advantage, for example, in devices with a slim appearance. In such a case, optics 20.1, 20.2 that are fixed only in connection with the exposure apertures 21.1, 21,2 would not necessarily permit the sensor 12 to be rotated from one exposure direction FS, BS to another, instead the optics 20.1, 20.1, for example, or the general internally cramped case structure 23 of the device 10 would limit the path of rotation of the sensor 12.
The optical type/focal length of the optics 20.2′, which is rotatable in connection with the sensor 12, are of such a type that they implement part of the optical system in both imaging directions FS, BS. According to one embodiment, the optics 20.2′ can include a set of microlenses and an infrared filter on the surface of the sensor 12.
According to one, extremely schematic embodiment, the optics 20.2′ arranged rotatably in connection with the sensor 12 can be arranged mainly for close-up imaging, being, for example, a lens/set of micro-lenses 20.2′ with a specific focal length, which possible additional optics 20.1, 20.2 on both sides FS, BS supplements to form an appropriate totality. Thus, optics may not necessarily be required at all in the exposure aperture 21.2 of the display-component 19 side, or it may be very limited, because most of the videoconferencing-side FS optics would already exist in connection with the sensor 12. Correspondingly, the optics 20.1 which is fixed in place in exposure aperture 21.1 on the distant-imaging side BS, will be able to be arranged as being of such a type/focal length that it forms, together with the rotating optics 20.2′ in connection with the sensor 12, an optical arrangement that permits distant imaging. The use of such a choice of optics, which is by way of a very schematic example, will permit part of the optics 20.2′ to be arranged to rotate along with the sensor 12.
According to one embodiment, at least part of the optics 20.1 can be equipped with operating devices 24 for performing, for example, focal-length adjustment operations (zooming/focussing) on the set of lenses 20.1. One example of such an optics is a set of lenses 20.1, arranged in connection with the exposure aperture 21.1 on the opposite side BS of the case structure 23 to the display 19 of the device 10, by means of which distant imaging can also be performed. The optics 20.1 will then include a liner-motion mechanism M for moving it relative to the position of the image sensor 12 and the part of the optics 20.2′ connected to it. The implementation of the zoom mechanism M can apply ways of implementing zoom that are, as such, known, from which sphere extremely small electric motors are presently known. In the case of a zoom implementation, the set of lenses 20.1 may also protrude from the case 23.
The solution according to the invention also permits the use of different optics 20.1, 20.2, 20.2′ in different exposure directions, for example, on the front and back sides FS, BS of the device. According to one embodiment, at least part of the optics 20.2, 20.2′ of the device 10 can be suitably selected, for example, for close-up imaging. According to one embodiment, optics 20.2, 20.2′ of this kind can be, for example, arranged in connection with the exposure aperture 21.2 arranged on the display-component 19 side, because videoconferencing generally takes place in the vicinity of the display 19 of the device 10.
According to yet another embodiment, there can also be shutter devices 22 in connection with the camera devices 12. These can be used to close the exposure aperture 21.1 not in use at the time, to prevent it causing problems with the exposure of the sensor 12 taking place from the desired exposure side FS.
According to one embodiment, the shutter devices 22 can be arranged in connection with the camera devices, for example, on the rear side of the sensor 12. The sensor component 12 can thus be given a spherical shape, in which case there will be a dome-shaped shutter element 22 behind it, for closing the exposure aperture 21.1 that it not in use. This will also facilitate the implementation of the invention in cramped case conditions.
A first rough embodiment of the device 10 according to the invention is shown, in the middle of
a and 4b show a second embodiment of the device 10 according to the invention. In this case, the image sensor 12 and the optics 20.2′ can not only be rotated, but also moved in a selected direction. In this case the movement takes place linearly, for example, in the longitudinal direction of the case structure 23. Of course, movement taking place laterally, or in other suitable directions, for example, even in the direction of the exposure apertures 21.1, 21.2, is also possible. Such an arrangement may be required, for example, if the device has a particularly slim case structure 23 and/or the positioning of the components is cramped. The use of the arrangement will achieve an advantage when applying a rotating part of the optics 20.2′ in connection with the sensor 12. When the sensor 12 and part of the optics 20.2′ are in an imaging position between the exposure apertures 21.1, 21.2, it may become impossible to rotate them around their imagined axis of rotation, because the lenses 20.1, 20.2 are so close to each other, due to the thinness of the case 23 and the internal space of the case 23 is otherwise cramped. One example of the possible size of the physical component of the sensor 12 is 10*10 mm, with a thickness of 3-5 mm. The image matrix of the sensor 12 will then have a size of, for example, 3*3 mm.
In
In the embodiment shown in
When the switch 16.1 is depressed, the sensor 12 and the lens 20.2′ also move correspondingly downwards, thanks to the shaft arrangement 16.2, 16.3. Once the image sensor 12 and the set of lenses 20.2′ connected to it are clear of the position between exposure aperture 21.1, 21.2 and the lenses 20.1, 20.2 associate with them, they can be rotated to a another position, to another desired exposure direction (
In general, the rotation and/or linear movement of the image sensor 12 and the optics 20.2′ can be performed using rotation elements 16, 16.1 arranged in connection with the device 10, or also using electric-motor devices 16.5 (
In the embodiment shown in
When the sensor 12 is in the videoconferencing position, it will be on the same side of the device 10 as the display 19, as shown in
On the other hand, the sensor 12 can also be implemented to be rotated around its imagined axis of rotation, in connection with the elongated exposure aperture 21 shown in
With reference to
As already stated, in the case of a camera module that is detachably attached to the connector interface of the device, the rotation of the image sensor can be controlled using commands given to the camera module through the connector interface, in which case the image sensor in the module can be motorized.
In addition to the device 10, the invention also relates to a method for controlling the orienting of camera devices 12 in an electronic device 10. Inside the case structure 23 of the device 10, there are directional camera devices, which include at least an image sensor 12 and optics 20.1, 20.2, 20.2′. The case structure 23 also includes an aperture arrangement 21.1, 21.2, for exposing the image sensor 12 from outside, which is arranged in at least two exposure directions BS, FS.
In the method according to the invention, the image sensor 12 and at least part of the optics 20.2′ are aimed relative to the device 10 by rotating them to the chosen exposure direction, preferably, however, without applying the orienting operations to the actual case structure 23 of the device 10. After this, imaging can be performed. In addition, in the aperture arrangement 21.1, 21.2, the part of the aperture arrangement that is not in use at the time can be closed. It is also possible to move the sensor 12 and at least part of the optics 20.2′ away from connection with the exposure apertures 21.1, 21.2, so that the rotation ability of the camera devices 12, 20.2′ will be improved. This is important, for example, in thin device constructions, the internal spaces of the cases 23 of which are very limited in terms of rotation in place.
In the cases shown in
Further, in order to implement the method according to the invention, the device according to the invention can include software means for controlling the aiming of the camera devices. These can be used to orient the image information in an appropriate manner on the basis of the image-path information obtained from the detection devices 16, for example, for display on the display 19, or for transmission to the other party. The software implementation can be, for example, in the processor 13 of the device 10, in the controller component 14 (
It must be understood that the above description and the related figures are only intended to illustrate the present invention. The invention is thus in no way restricted to only the embodiments disclosed above or stated in the Claims, but many different variations and adaptations of the invention, which are possible within the scope on the inventive idea defined in the accompanying Claims, will be obvious to one versed in the art.
| Number | Date | Country | Kind |
|---|---|---|---|
| 20035210 | Nov 2003 | FI | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/FI04/50159 | 11/11/2004 | WO | 4/5/2006 |
