Patent Application
20220219644
The subject disclosure relates to the art of motor vehicles and, more particularly, to a gesture recognition system for a vehicle.
Many vehicles include systems that respond to a driver's presence. For example, a vehicle may detect a key fob and turn on interior and/or exterior lights. A vehicle may respond to a driver's touch and the key fob by unlocking a door or a trunk. A vehicle may also include a sensor mounted to detect a foot movement. In response, a trunk may be unlocked and opened. While effective and convenient for opening a trunk without the need to use a key, the system requires a dedicated sensor mounted under the vehicle. The use of a dedicated sensor adds cost and complexity. Further, there is a need for additional structure to protect and shield the sensor. Accordingly, the industry would welcome a system that adds convenience to the operation of a vehicle without the need for additional dedicated sensors.
In one exemplary embodiment, a vehicle includes a body supporting at least one camera. The at least one camera is positioned to collect images of objects outside of the vehicle. The vehicle also includes a selectively operable vehicle system and a controller operatively connected to the at least one camera and the selectively operable vehicle system. The controller includes a gesture recognition system operable to process a gesture made by a person associated with the vehicle collected by the at least one camera and activate the selectively operable vehicle system associated with the gesture.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the at least one camera comprises a back-up camera.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include a sensor mounted in the vehicle and operatively connected to the controller, the sensor being operable to detect the person associated with the vehicle approaching the body and activate the at least one camera.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the sensor comprises a key fob sensor operable to detect a key fob associated with the vehicle.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the sensor comprises a cell phone sensor operable to detect a cell phone associated with the person associated with the vehicle.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the at least one camera includes an exterior camera and an interior camera, the controller being operable to process the gesture made by the person associated with the vehicle collected by one of the exterior camera and the interior camera and activate the selectively operable vehicle system associated with the gesture.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the controller includes a memory module having stored thereon one or more factory pre-set gestures, the one or more factory pre-set gestures being associated with activating the select vehicle system.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the controller includes a gesture learning module, the gesture learning module being operable to learn a gesture associated with activating the select vehicle system.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the select vehicle system includes a trunk lid latch.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein the controller is operatively connected to at least one vehicle light, the controller being configured to activate the at least one vehicle light if ambient light conditions are below a preselected level.
In another exemplary aspect, a method of activating a vehicle system includes detecting a person associated with the vehicle, capturing a gesture by the operator with a camera mounted to the vehicle, and activating the vehicle system based on the gesture.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein capturing the gesture with the camera includes capturing an image of the person associated with the vehicle with a back-up camera.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein detecting the person associated with the vehicle includes activating the camera.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein detecting the person associated with the vehicle includes sensing one of a key fob associated with the vehicle and a cell phone associated with the person associated with the vehicle.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein capturing the gesture includes capturing a movement of the person associated with the vehicle external to the vehicle.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include processing the gesture, comparing the gesture to one or more factory pre-set gestures, and activating the vehicle system associated with the factory pre-set gesture.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein processing the gesture includes determining whether predetermined constraint conditions are met including evaluating one of a skeletal structure position, a skeletal structure orientation, and a skeletal structure height.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include receiving a user defined gesture, and activating the vehicle system upon perceiving the user defined gesture through the camera.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include wherein activating the vehicle system includes operating a trunk lid latch.
In addition to one or more of the features described above or below, or as an alternative, further embodiments could include activating a vehicle light to illuminate the gesture when ambient light conditions are below a preselected level.
The above features and advantages, and other features and advantages of the disclosure are readily apparent from the following detailed description when taken in connection with the accompanying drawings.
Other features, advantages and details appear, by way of example only, in the following detailed description, the detailed description referring to the drawings in which:
The following description is merely exemplary in nature and is not intended to limit the present disclosure, its application or uses. It should be understood that throughout the drawings, corresponding reference numerals indicate like or corresponding parts and features. As used herein, the term module refers to processing circuitry that may include an application specific integrated circuit (ASIC), an electronic circuit, a processor (shared, dedicated, or group) and memory that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
A vehicle, in accordance with an exemplary embodiment, is indicated generally at 10 in
In accordance with an exemplary embodiment, vehicle 10 includes a gesture recognition system 40 which, as will be detailed herein, can perceive a gesture from a person associated with vehicle 10, process the gesture, and selectively operate a vehicle system such as to unlatch trunk 22. It should be understood that a person associated with the vehicle means a person that has been previously identified as, for example, an owner, a lessor or other individual associated with the vehicle by virtue of possession of a vehicle key or by associating a cell phone with the vehicle.
Referring to
In an embodiment, gesture recognition system 40 is operatively coupled to camera 24 and a sensor 52 that may detect a presence of a person associated with vehicle 10. At this point, it should be understood, that camera 24 may represent back-up camera 28 and/or additional cameras mounted externally to and/or internally to vehicle 10. Camera 24 may include front mounted cameras, cameras mounted in side view mirrors, dash mounted cameras and the like. Sensor 52 may also take on a variety of forms including a key fob detecting sensor, a cell phone detecting sensor, as well as other sensors that may detect a person associated with vehicle 10. Gesture recognition system 40 may also be selectively coupled to a cell phone or other input device (not shown) that may facilitate uploading user defined gestures, system updates and the like.
In further accordance with an exemplary aspect, gesture recognition system 40 may also be coupled to trunk 22 and, more specifically, to a trunk latch 54 associated with locking and unlocking trunk 22. Gesture recognition system 40 may also be connected to one or more additional vehicle systems such as an ignition system, a car seat adjustment system, a steering wheel adjustment system, door lock system, and the like. Still further, gesture recognition system 40 may be coupled to light 32. That is, in the event gesture recognition module 47 determines that there is insufficient ambient light to process a captured gesture, gesture recognition system 40 may activate light 32.
Reference will now follow to
In block 68, gesture recognition system 40 determines whether a skeletal structure of the person associated with vehicle 10 is detected. Detection of the skeletal structure facilitates capturing and evaluating gestures made by the person associated with vehicle 10. If a skeletal structure is detected, gesture recognition system 40 determines whether a gesture is made that corresponds to a gesture stored in memory 45 in block 80. If no gesture is detected, gesture recognition system 40 continues monitoring until, for example, the person associated with vehicle 10 enters a passenger compartment (not separately labeled).
If a gesture is detected, in block 82 a determination is made whether certain constraint conditions are met. For example, gesture recognition system 40 may evaluate skeletal structure position, skeletal structure orientation, and/or skeletal structure height to determine whether the captured gesture matches one stored in memory 45. If the constraint conditions are met, in block 100, gesture recognition system 40 activates the corresponding vehicle system. For example, gesture recognition system 40 may activate truck latch 54 allowing trunk 22 to open. If the constraint conditions are not met, gesture recognition system 40 continues monitoring until, for example, the person associated with vehicle 10 enters a passenger compartment (not separately labeled).
At this point, it should be understood that the gesture recognition system in accordance with exemplary embodiments allows a person associated with a vehicle to activate a vehicle system without the need for a special or dedicated sensor. Further, the gesture recognition system expands options available to a person associated with the vehicle. That it, the person is not limited to simply opening a trunk, but can rely on preset gestures and/or program various user defined gestures to activate any number of vehicle systems.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, element components, and/or groups thereof.
While the above disclosure has been described with reference to exemplary embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted for elements thereof without departing from its scope. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the disclosure without departing from the essential scope thereof. Therefore, it is intended that the present disclosure not be limited to the particular embodiments disclosed, but will include all embodiments falling within the scope thereof.
