Patent Application
20100238282
The present invention relates to a matrix lighting system and to a method of controlling an array of lighting sources. It also relates to a method of calibrating a camera with which a matrix lighting system is equipped.
The invention applies notably to scialytic or shadowless lamps meeting the lighting requirements in the medical field.
The lighting requirements in the medical field relate notably to:
Shadowless lamps are generally made up of a main lighting unit which may or may not be accompanied by a satellite lighting unit enabling light to be added if necessary. These lighting units are of the ceiling-mounted type, but there are also wall-mounted or mobile lighting units, notably for the emergency and resuscitation services. The latter units are in general smaller in size.
The lighting units mainly consist of halogen lamps fitted with infrared filters and are cooled by air convection. The lamps are either placed centrally, forming central-lamp lighting units, or are placed in windows at defined angles of inclination, forming a multi-projector lighting unit.
At the present time, the system for orienting these lighting units is manual. A central joystick or lateral joysticks are used to position the lighting units. The bulkiest systems include counterweights so as to make them easier to manipulate.
These shadowless lamps therefore have to be manipulated, this being a tedious task notably for large systems, and not very precise. They do not always make it possible to light well-defined areas with specific lighting parameters, such as color temperature, intensity or direction for example.
An objective of the invention is notably to allow the lighting provided by a shadowless lamp to be regulated without manipulating the lamp itself. For this purpose, one subject of the invention is a matrix lighting system comprising an array of lighting sources that are activated by a power supply system provided with a processing means, said system comprising at least one video sensor and a control object comprising marks characterizing the position and the orientation of the object in space, an area to be lit being designated according to the orientation of the object, the video sensor capturing the images of the object and transmitting them to the processing means which computes the space coordinates of the marks, the power supply system activating the lighting sources according to the position and the orientation of the object that are defined by the marks.
The object has, for example, an axis defining the orientation of the object, the area to be lit being pointed to by the straight line from the space coincident with the axis.
Advantageously, the object may be a stylus, the axis being the axis of the tip of the stylus. The position of the area to be observed is defined by the position of the tip of the stylus. The position of the tip of the stylus is notably known in a reference frame tied to the marks on the stylus.
The stylus has, for example, a plate on which the marks are placed, the plate being for example perpendicular to the axis of the tip of the stylus.
The marks are for example reflecting targets. Advantageously, the marks may be encoded, the encoding being a function of a given array of lighting sources.
Since the array of lighting sources is supported by a wall, the wall has for example an opening via which the sensor observes.
Advantageously, when the area to be lit has been designated, the regulating of the area may be controlled by means of a voice command transmitted to the system for activating the sources.
In another embodiment, when the area to be lit has been designated, the regulating of the area is controlled for example by means of an integrated interface on the object, the regulating command being transmitted to the system for activating the sources via the interface.
The array of lighting sources includes for example marks, the position of which is known in a reference frame tied to the array. The camera operates for example in the near infrared.
Another subject of the invention is a method of controlling an array of lighting sources that are activated by a power supply system provided with a processing means, said method using at least one video sensor and an object having marks characterizing the position and the orientation of the object in space, an area to be lit being designated according to the orientation of the object, the sensor capturing the images of the object and transmitting them to the processing means which computes the coordinates of the marks in a 3D reference frame tied to the sensor, the power supply system activating the lighting sources as a function of the position and the orientation of the object that are defined by the marks.
Another subject of the invention is a method of calibrating a video sensor with which an array of lighting sources activated by a power supply system provided with a processing means is equipped, said system comprising at least the sensor and an object having marks characterizing the position and the orientation of the object in space, an area to be lit being designated according to the orientation of the object, the sensor capturing the images of the object and transmitting them to the processing means which computes the space coordinates of the marks with respect to a reference frame tied to the sensor, the power supply system activating the lighting sources according to the position and the orientation of the object that are defined by the marks, said calibration method comprising:
a phase during which the sensor points to a test pattern equipped with marks, the position of these marks in space being known relative to a reference frame tied to the test pattern, making it possible to determine the transformation parameters Rcm, Tcm in order to switch from the reference frame of the test pattern to the reference frame of the sensor;
a phase during which another video sensor points to the marks, the position in space of which is known relative to a reference frame tied to the array of lighting sources, the other sensor also pointing to the marks of the test pattern, making it possible to determine the transformation parameters Rms, Tms for switching from the reference frame tied to the test pattern to the reference frame tied to the array of lighting sources; and
a phase for composing the two aforementioned transformations Rcm, Tcm, Rms, Tms for switching from the reference frame tied to the sensor to the reference frame tied to the array of lighting sources.
This method of calibration is for example to be applied for each of the video sensors used.
Notably, the main advantages of the invention are that it improves the instrument sterilization conditions, it dispenses with the use of a motor-driven system for moving the light sources, and it makes it possible to define the geometry of an area to be lit, the lighting conditions and, if necessary, to specify several lighting areas.
Other features and advantages of the invention will become apparent from the following description, in conjunction with the appended drawings which show:
Since the lighting system of
An opening 24 is for example provided in the wall so as to provide a passage for a video camera. More particularly, this opening is located in the field of the camera.
The lighting sources 21 are supplied with energy by a power supply system enabling each source to be individually powered. This system may be of the wire type or printed-circuit type. Each source is referenced by a position x, y on the wall. The position x, y and the orientation of each source are known by construction. The computer 4 determines for example the sources to be lit according to the designation of an area to be lit and its light intensity. The computer can therefore determine, according to the shape of the wall 22 and the position and orientation of the lighting sources 21 known by construction, the sources to be activated so as to light a given area 23.
When, in a preferred embodiment, the targets are circular, there are at least four of them so as to make it possible to determine the location and the direction of the stylus. However, to increase the precision of this determination, it may be advantageous to have a larger number of targets. In one particular embodiment, it is possible to use encoded targets, the encoding corresponding to a particular shadowless lamp. It may thus be advantageous to adapt the lighting control according to the shadowless lamp. Rectangular or square targets may also be used. In this case, a single target may suffice, the location and the direction of the stylus then being determined by detecting the four corners of the target. One method of locating an object bearing marks in space, such as for example the reflecting targets 31, is notably described in French patent application No. 2 760 277. More particularly, this method makes it possible to locate in space the marks relative to an image acquisition means, for example a camera.
The stylus may be passive or active. A passive stylus comprises only reflecting targets or any other marks that can be referenced by a video sensor. In this case, it may notably be easily sterilized. It is even possible to envisage a disposable stylus after each surgical intervention, in particular if the manufacturing cost is low.
An active stylus integrates notably electronic functions. In this case, it is for example provided with buttons, knurled wheels, liquid-crystal or other displays. It may also be fitted with a wireless transmission, for example of the bluetooth type. Thus, the operator can control the lighting directly via this interface, notably for regulating the intensity of the light or the boundaries of the area covered by the lighting.
The targets may be detected and then finally located in the video image by barycentric or more complex methods, such as those described in the aforementioned document No. 2 760 277.
To control the matrix lighting and to turn on the sources for the desired lighting, it is necessary to switch from the reference frame 41 of the camera to the reference frame 42 of the shadowless lamp. Specifically, the area to be lit is designated by the stylus, but in the reference frame of the camera. The spatial coordinates of the area to be lit must be transposed into the reference frame of the shadowless lamp in order to allow the computer 4 to determine the sources to be lit. As indicated above, it would be assumed that the position and the orientation of the lighting sources 21 are known in the reference frame of the shadowless lamp by construction. The transposition 44 of the space coordinates of the area may be carried out conventionally by a rotation R in three dimensions followed by a translation T in three dimensions, these two successive transformations being able to be expressed in matrix form corresponding to the three vectors of the translation T and to the three angles of the rotation R. From this matrix, the computer can determine the coordinates in the reference frame of the shadowless lamp and therefore the sources 31 to be activated.
In a first step, notably in the manufacturing process, it is possible to insert several targets 51 on the external face of the wall 22 opposite the lighting sources 21. These targets could also be placed on the opposite face, but would then take the place of lighting sources.
These targets are placed at locations known by construction. They may or may not be made of metal, they may have a circular or rectangular shape for example, and they may or may not be encoded. The position of these targets 51 is therefore known in the reference frame 42 of the shadowless lamp.
In a second step, the camera 43 of the shadowless lamp points at a known calibration test pattern 52. This test pattern comprises a number of targets 53, at least four. The positioning of these test patterns in space is also known in a reference frame 54 tied to the test pattern. From the known positions of the targets 53 notably in the reference frame 41 of the camera and from the same positions known in the reference frame 54 of the test pattern, it is thus possible in this second step to determine the six parameters Rcm1, Rcm2, Rcm3, Tcm1, Tcm2, Tcm3 of the transformation (Rcm, Tcm) that is used to switch from the reference frame of the test pattern to the reference frame of the camera 43 of the shadowless lamp.
In a third step, a second camera 55 points to the targets 51 of the lamp and the targets 53 of the test pattern, the positions of these targets 51, 53 being known in space. It is thus possible in this third step to determine the six parameters Rms1, Rms2, Rms3, Tms1, Tms2, Tms3 of the transformation (Rms, Tms) for switching from the reference frame 54 of the test pattern to the reference frame 42 of the lamp.
In a fourth step, by composing the two transformations (Rcm, Tcm) and (Rms, Tms), it is possible to determine the transformation 44 (Rcs, Tcs) for switching from the reference frame 41 of the camera 43 of the lamp to the reference frame 42 of the lamp.
In one embodiment of the shadowless lamp, it is possible to use preselected lighting sources instead of the targets 51 affixed on the lamp. In this case, the sources are activated so that they have the function described above of the targets 51. By construction, the position of these preselected sources is known in the reference frame of the lamp.
The video system may, in one particular embodiment, operate in the near infrared so as to detect only the targets 31 and therefore to provide more reliable detection, the environment external to the targets not being detected. In this case, a lighting unit in the near infrared, around a wavelength of the order of 1 μm, formed from a number of specific diodes, is for example placed around the camera. The latter is then fitted with a band-pass filter centered on the wavelength of the specific diodes.
In another embodiment, is it possible to increase the light of the shadowless lamp in the area of the targets 31 after first detection in order for said targets to be better delineated.
The interface with a user takes place by means of the stylus 2. Two interfacing modes are possible depending on whether the stylus is active or passive.
If the stylus is active, the interface may take place via the stylus, which then acts as a kind of three-dimensional mouse. The stylus designates the area to be lit, this area being referenced by the targets 31. The stylus is for example equipped with one or more buttons and with a liquid-crystal display LCD screen, the button or buttons then being associated with a scrolling menu displayed on the LCD screen. The commands are then sent to the computer by a wireless transmission system integrated into the stylus. The computer then determines the lighting sources to be powered.
If the stylus is passive, it is possible to provide an ergonomic, preferably “hands free”, interface. The interface may advantageously be achieved by means of a voice command. Once the area to be lit has been designated by the stylus, simple orders then allow the system to be controlled, the computer being responsible for interpreting the commands. Examples of voice commands may be the following:
In both modes, the invention enables the shadowless lamp to be controlled without requiring the lamp itself to be manipulated. It is also possible to provide the option of lighting well-defined areas with specific lighting parameters, both in terms of color temperature and intensity and notably direction, these lighting parameters being determined by the computer according to the environment, to the type of activity or else to a command delivered by an active stylus. Thus, various parts of the scene would receive light adapted to the activity being carried out. For example, in an operating room, a surgeon requires very strong light with no shadows, whereas an anesthetist instead needs lighting of the daylight type, notably to examine the skin color, an assistant himself requiring screened light. The stylus 2 is the tool that enables an operator to define the lighting direction 5, this direction pointing to the area to be lit. In this way, the lighting sources of the array that illuminate the direction 5 and notably the pointed area will be activated, notably as a priority, before responding to the operator's demands. The number of activated sources and their light intensities will depend on the area to be covered, this area being for example defined by the commands described above.
The invention has been described for a lighting system of the shadowless type. It may also be applicable in other fields, for example for creating ambient lighting or lighting compositions on request. The invention may thus for example be applicable to art galleries or museums, to exhibition halls or to mechanical workshops or even assembly lines.
Advantageously, the invention allows these lighting units to be remotely controlled so as to specify the area to be lit, the assembly direction and the light intensity. This command does not require the light sources to be moved. In the case of a shadowless lamp, the motor drive may thus be eliminated. However, the control method described applies in the same way if certain lighting sources are on motorized supports.
| Number | Date | Country | Kind |
|---|---|---|---|
| 07/01798 | Mar 2007 | FR | national |
This application is a national phase application “371” of PCT/EP2008/052806 filed Mar. 10, 2008, which claims priority of FR07/01798 filed Mar. 13, 2007, the entire contents of both applications are incorporated herein by reference in their entireties.
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/EP08/52806 | 3/10/2008 | WO | 00 | 5/26/2010 |
