The present invention relates generally to the field of cabin monitoring using an image sensor (camera). Specifically, the invention relates to determining if an occupant of the vehicle is correctly wearing a seat belt (safety belt).
Various driver and cabin monitoring systems (DMS, CMS) using image sensors are known in the art. Most driver monitoring systems are focused on the face and eyes of the driver, and may determine where the driver is looking, if the driver is tired or unfocussed, if the driver is under influence of drugs, etc. Cabin monitoring systems, on the other hand, are more generally related to various types of information about the inside of the cabin and the people therein.
Cabin monitoring systems typically include an image sensor (camera) configured to acquire an image of a larger part, e.g., the torso, of the occupants of the vehicle, e.g., the driver. It has been suggested to use such image data to provide information about the seat belt, e.g., if it is properly applied. Document CN 110569732 provides one example of such a system, involving determination of an angle of the belt. The angle detection can indicate whether the seat belt is correctly fastened. Optionally, the image data and detected angle may be provided to a trained neural network, to provide an improved assessment of the position of the seat belt.
The use of image data to determine whether a seat belt is correctly fastened provides a valuable complement to more rudimentary sensors such as a switch in the latch of the belt. However, existing systems, such as CN 110569732, are not sufficiently accurate or require extensive amounts of processing power.
It is an object of the present invention to provide an improved approach to image-based determination of a position of a vehicle seat belt.
According to a first aspect of the invention, this object is achieved by a computer implemented method for determining if an occupant of a vehicle has correctly applied a seat belt, the method comprising acquiring an image of the occupant, the image including at least a shoulder portion of the occupant, identifying, in the image, left and right shoulders, identifying, in the image, a longitudinal extension of a seat belt, determining an intersection between the longitudinal extension and a line connecting the left and right shoulders, and based on a relative position of the intersection and the shoulders, deducing whether the seat belt is correctly applied.
According to a second aspect of the invention, this object is achieved by a system for determining if an occupant of a vehicle has correctly applied a seat belt, the system comprising a camera for acquiring an image of the occupant, the image including at least a shoulder portion of the occupant, a body analysis unit for identifying, in the image, left and right shoulders, a seat belt identifier for identifying, in the image, a longitudinal extension of a seat belt, and an assessment unit for determining an intersection between the longitudinal extension and a line connecting the left and right shoulders, and, based on a relative position of the intersection and the shoulders, deducing whether the seat belt is correctly applied.
The invention is based on the fact that shoulders of an occupant and longitudinal extension of a seat belt can be reliably detected in an image using simple image processing. An intersection between these lines will provide a useful indication of whether the seat belt is in a correct position, and thus whether it has been correctly applied.
The present invention will be described in more detail with reference to the appended drawings, showing currently preferred embodiments of the invention.
In the following, embodiments of the invention are described in the context of a vehicle cabin monitoring system. It is noted that other implementations of the present invention are also possible.
The camera 4 is connected to a processing system 10 (not shown in
Operation of the system 10 will be explained with reference to
In step S3, the seat belt identifier identifies a longitudinal extension B of a seat belt 24 in the image. This identification can be made using conventional image analysis methods and may involve detection of an edge 23 of the seat belt 24, e.g., using a Canny edge detector algorithm. While it is possible to detect the edges of the seat belt with conventional approaches such as Canny edge detection, such approaches typically do not perform well when there is not sufficient contrast between the seatbelt and the driver's clothes, i.e., when the color/darkness gradient is not large enough. For this reason, a segmentation network may be applied to generate a polygon around the seat belt, thereby increasing robustness.
In step S4, the assessment unit 15 determines an intersection P of lines A and B. By comparing this intersection P with the positions of the shoulders 21a, 21b, the assessment unit 15 can deduce if the seat belt 24 has been properly applied by the occupant 22. For example, as shown in
The person skilled in the art realizes that the present invention by no means is limited to the preferred embodiments described above. On the contrary, many modifications and variations are possible within the scope of the appended claims. For example, the invention may be relevant also for other implementations than driver monitoring.
Number | Date | Country | Kind |
---|---|---|---|
22202159.4 | Oct 2022 | EP | regional |