The present disclosure relates to an access system for a motor vehicle. More specifically, the present disclosure relates to an access system for detecting a user and controlling a vehicle function based on user proximity to vehicle.
This section provides background information related to the present disclosure which is not necessarily prior art.
Closure members of motor vehicles may be mounted by one or more hinges to the vehicle body. For example, passenger doors may be oriented and attached to the vehicle body by the one or more hinges for swinging movement about a generally vertical pivot axis. In such an arrangement, each door hinge typically includes a door hinge strap connected to the passenger door, a body hinge strap connected to the vehicle body, and a pivot pin arranged to pivotably connect the door hinge strap to the body hinge strap and define a pivot axis. As another example, the closure member can be a hood or frunk lid.
Various functions may be associated with the closure members, such as locking and unlocking, obstacle detection, automatic and/or assisted opening. As a result, the closure members may include a plurality sensors to control the various functions. Nevertheless, even by utilizing the plurality of sensors, difficulty remains in accurately determining an intent of a user to activate or utilize the various functions.
In view of the above, there remains a need to develop improved access systems for vehicles which address and overcome limitations and drawbacks associated with known systems as well as to provide increased convenience and enhanced operational capabilities.
This section provides a general summary of the disclosure, and is not a comprehensive disclosure of its full scope or all of its features.
It is an object of the present disclosure to provide a user detection system for a motor vehicle. The motor vehicle has at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle. The user detection system includes a hardware token associated with and carried by the user to provide an authorization to access the motor vehicle. The user detection system additionally includes at least two proximity sensors configured to detect the hardware token in proximity to the motor vehicle. A controller is connected to the at least two proximity sensors and is configured to determine a location of the user relative to the motor vehicle using the at least two proximity sensors. The controller grants or rejects access to the motor vehicle via the at least one closure panel based on the authorization and the location of the user relative to the motor vehicle.
In another aspect, the controller is configured to determine at least one of an approach trajectory and a non-identifying biometric information and a non-identifying biomechanical information using the at least two proximity sensors. The controller is also configured to infer an intent of the user to access the motor vehicle based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information.
In another aspect, the controller is configured to infer the intent of the user to access the motor vehicle based on the at least one of the approach trajectory corresponding to the user approaching the motor vehicle and correlated to an environment surrounding the motor vehicle.
In another aspect, a plurality of valid access zones are defined around the motor vehicle and the controller is configured to infer the intent of the user to access the motor vehicle based on the user approaching the motor vehicle in one of the plurality of valid access zones.
In another aspect, the controller is configured to read stored access zone information defining the plurality of valid access zones. The controller is also configured to compare the approach trajectory and location of the user to the stored access zone information. The controller grants or rejects access to the motor vehicle via the closure panel based on the authorization and the comparison of the approach trajectory and location of the user to the stored access zone information.
In another aspect, the controller is configured to poll an environment surrounding the motor vehicle for the hardware token registered to the motor vehicle using the at least two proximity sensors. The controller is also configured to decide if the user associated with the hardware token detected meets predetermined authorization requirements for accessing the motor vehicle based on authorization signals received by the at least two proximity sensors from the hardware token. The controller is additionally configured to wake up the user detection system and send and receive location signals from the hardware token using the at least two proximity sensors and determine the at least two distances between the user and each of the at least two sensor positions. In addition, the controller is configured to execute the positioning algorithm and compute the location of the user relative to the motor vehicle using the positioning algorithm. The controller determines at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information using the at least two proximity sensor. The controller then analyzes the at least one of the approach trajectory and the location of the user and execute analysis of the non-identifying biometric information and the non-identifying biomechanical information. The controller verifies that the user is approaching the motor vehicle within one of the plurality of valid access zones surrounding the motor vehicle. The controller is also configured to grant or reject access to the motor vehicle via the closure panel in response to the hardware token detected meeting the predetermined authorization requirements and the analysis of the at least one of the approach trajectory and the location of the user, the non-identifying biometric information, and the non-identifying biomechanical information.
In another aspect, the hardware token includes at least one of a key fob and a mobile phone located with the user.
It is another object of the present disclosure to provide a method of operating a user detection system for a motor vehicle. The motor vehicle has at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle. The method includes the step of determining a location of the user relative to the motor vehicle using at least two proximity sensors configured to detect the hardware token in proximity to the motor vehicle. The method also includes the step of granting or rejecting access to the motor vehicle via the at least one closure panel based on the authorization provided by a hardware token associated with and carried by the user and the location of the user relative to the motor vehicle.
In another aspect, the at least two proximity sensors are disposed at at least two sensor positions on the motor vehicle. The method further includes the step of determining at least two distances between the user and each of the at least two sensor positions. The method continues by computing the location of the user relative to the motor vehicle using a positioning algorithm relative to the at least two sensor positions.
In another aspect, the at least two proximity sensors includes a first sensor disposed at a first sensor position on the motor vehicle and a second sensor disposed at a second sensor position on the motor vehicle. The first sensor position is a sensor spacing distance from the second sensor position. The method further includes the step of determining a first distance between the user and the first sensor position and a second distance between the user and the second sensor position. Next, defining a first circle with a first radius of the first distance and a second circle with a second radius of the second distance. The first circle and the second circle intersect at two intersection points. The method also includes the step of determining the location of the user relative to the motor vehicle based on the two intersection points.
In another aspect, the method further includes the step of determining at least one of an approach trajectory and a non-identifying biometric information and a non-identifying biomechanical information using the at least two proximity sensors. The method additionally includes the step of inferring an intent of the user to access the motor vehicle based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information.
In another aspect, the step of inferring the intent of the user to access the motor vehicle based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information includes inferring the intent of the user to access the motor vehicle based on the at least one of the approach trajectory corresponding to the user approaching the motor vehicle and correlated to an environment surrounding the motor vehicle.
In another aspect, a plurality of valid access zones are defined around the motor vehicle and wherein the step of inferring the intent of the user to access the motor vehicle based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information includes inferring the intent of the user to access the motor vehicle based on the user approaching the motor vehicle in one of the plurality of valid access zones.
In another aspect, the method further includes the step of reading stored access zone information defining the plurality of valid access zones. The method proceeds by comparing the approach trajectory and location of the user to the stored access zone information. The method continues with the step of granting or rejecting access to the motor vehicle via the closure panel based on the authorization and the comparison of the approach trajectory and location of the user to the stored access zone information.
In another aspect, the method further includes the step of polling an environment surrounding the motor vehicle for the hardware token registered to the motor vehicle using the at least two proximity sensors. The method proceeds with the step of deciding if the user associated with the hardware token detected meets predetermined authorization requirements for accessing the motor vehicle based on authorization signals received by the at least two proximity sensors from the hardware token. Next, waking up the user detection system and sending and receiving location signals from the hardware token using the at least two proximity sensors and determining the at least two distances between the user and each of the at least two sensor positions The method continues by executing the positioning algorithm and compute the location of the user relative to the motor vehicle using the positioning algorithm. In addition, the method includes the step of determining at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information using the at least two proximity sensors. The next step of the method is analyzing the at least one of the approach trajectory and the location of the user and executing analysis of the non-identifying biometric information and the non-identifying biomechanical information. The method additionally includes verifying that the user is approaching the motor vehicle within one of the plurality of valid access zones surrounding the motor vehicle. The method also includes the step of granting or rejecting access to the motor vehicle via the closure panel in response to the hardware token detected meeting the predetermined authorization requirements and the analysis of the at least one of the approach trajectory and the location of the user the non-identifying biometric information and the non-identifying biomechanical information.
In another aspect, the hardware token includes at least one of a key fob and a mobile phone located with the user.
It is a further object of the present disclosure to provide a user detection system for a motor vehicle. The motor vehicle has at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle. The user detection system includes at least one proximity sensor configured to sense the user in one of a plurality of valid access zones defined around the motor vehicle. The user detection system also includes at least one non-contact obstacle detection sensor configured to detect at least one obstacle. A controller is connected to the at least one proximity sensor and the at least one non-contact obstacle detection sensor and is in communication with an access system of the motor vehicle associated with the at least one closure panel. The controller is configured to determine a location of the user relative to the motor vehicle and whether the user is approaching the motor vehicle within one of the plurality of valid access zones using the at least one proximity sensor. The controller is also configured to detect the at least one obstacle in proximity to the motor vehicle using the at least one non-contact obstacle detection sensor and modify a functionality associated with the plurality of valid access zones to a modified access functionality based on detection of the at least one obstacle in proximity to the motor vehicle. The controller is additionally configured to control the access system based on the location of the user relative to the motor vehicle and whether the user is within one of the plurality of valid access zones and the modified access functionality.
In another aspect, the at least one proximity sensor includes an optical sensor configured to detect facial landmarks of a face of the user corresponding to an intent of the user to access the motor vehicle and an ultra wideband sensor configured to sense the user in one of the plurality of valid access zones. The controller is configured to determine whether the user is within one of the plurality of valid access zones using the ultra wideband sensor. The controller is also configured to infer the intent of the user based on the facial landmarks of the face of the user and whether the user is within one of the plurality of valid access zones and control the access system accordingly.
In another aspect, the at least one closure panel includes a door, and the access system includes a power closure member actuation system configured to move the door. The controller is configured to detect the user approaching the motor vehicle. The controller is also configured to determine whether the user is forward of a B-pillar of the motor vehicle and determine whether a path of the door is clear in response to determining the user is forward of the B-pillar of the motor vehicle. The controller opens the door to a small predetermined angle to allow the user to walk around the door using the power closure member actuation system in response to determining the path of the door is clear. The controller is additionally configured to provide a follow me function of the door as user moves past the B-pillar of the motor vehicle using the power closure member actuation system. The controller presents the door for a power assist mode operation by the user in response to determining the path of the door is not clear. The controller is further configured to determine whether the path of the door is clear in response to determining the user is not forward of the B-pillar of the motor vehicle. The controller is also configured to open the door to a fully open position using the power closure member actuation system in response to determining the path of the door is clear. The controller opens the door to an angle controlled by the at least one non-contact obstacle detection sensor using the power closure member actuation system in response to determining the path of the door is not clear.
It is yet another object of the present disclosure to provide a method of operating a user detection system for a motor vehicle. The motor vehicle has at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle. The method includes the step of determining a location of the user relative to the motor vehicle and whether the user is approaching the motor vehicle within one of the plurality of valid access zones using at least one proximity sensor configured to sense the user in one of a plurality of valid access zones defined around the motor vehicle. The method continues with the step of detecting at least one obstacle in proximity to the motor vehicle using at least one non-contact obstacle detection sensor configured to detect the at least one obstacle and modifying a functionality associated with the plurality of valid access zones to a modified access functionality based on detection of the at least one obstacle in proximity to the motor vehicle. The method also includes the step of controlling an access system of the motor vehicle associated with the at least one closure panel based on the location of the user relative to the motor vehicle and whether the user is within one of the plurality of valid access zones and the modified access functionality.
In another aspect, the at least one closure panel includes a plurality of closure panels each defining one of a plurality of closure boundaries and the plurality of valid access zones defined around the motor vehicle extend and are defined at a plurality of predetermined angles from the plurality of closure boundaries.
In another aspect, the at least one closure panel includes at least one door and a decklid and a hood. The plurality of valid access zones defined around the motor vehicle include a valid hood access zone adjacent the hood of the motor vehicle and a valid front right access zone adjacent the at least one door on a right side of the motor vehicle and a valid trunk access zone adjacent the decklid of the motor vehicle and a valid front left access zone adjacent the at least one door on a left side of the motor vehicle. The plurality of valid access zones are separated from one another by each of a plurality of invalid access zones.
In another aspect, the at least one proximity sensor includes an optical sensor configured to detect facial landmarks of a face of the user corresponding to an intent of the user to access the motor vehicle and an ultra wideband sensor configured to sense the user in one of the plurality of valid access zones. The method further includes the step of determining whether the user is within one of the plurality of valid access zones using the ultra wideband sensor. The method also includes the step of inferring the intent of the user based on the facial landmarks of the face of the user and whether the user is within one of the plurality of valid access zones and control the access system accordingly.
In another aspect, the at least one closure panel includes a door and the access system includes a power closure member actuation system configured to move the door. The method further includes the step of detecting the user approaching the motor vehicle. Next, determining whether the user is forward of a B-pillar of the motor vehicle. The method continues by determining whether a path of the door is clear in response to determining the user is forward of the B-pillar of the motor vehicle. The next step of the method is opening door to a small predetermined angle to allow the user to walk around the door using the power closure member actuation system in response to determining the path of the door is clear. The method proceeds with the step of providing a follow me function of the door as user moves past the B-pillar of the motor vehicle using the power closure member actuation system. In addition, the method includes the step of presenting the door for a power assist mode operation by the user in response to determining the path of the door is not clear. Next, determining whether the path of the door is clear in response to determining the user is not forward of the B-pillar of the motor vehicle. The method also includes the step of opening door to a fully open position using the power closure member actuation system in response to determining the path of the door is clear. The method additionally includes the step of opening door to an angle controlled by the at least one non-contact obstacle detection sensor using the power closure member actuation system in response to determining the path of the door is not clear.
It is yet a further object of the present disclosure to provide a method of facilitating access to a motor vehicle by a user of the motor vehicle having at least one closure panel for an entry of the motor vehicle. The method includes the step of using at least one proximity sensor and sensing the user around the motor vehicle. In addition, the method includes the step of determining at least one of a location of the user relative to the motor vehicle and whether the user is approaching the motor vehicle. Next, determining if moving the closure panel to an opened position using an access system of the motor vehicle associated with the at least one closure panel obstructs an approach of the user towards the entry. The method also includes the step of controlling the access system based on the location of the user relative to the motor vehicle to prevent the closure panel from obstructing the approach of the user towards the entry.
In another aspect, the method also includes the step of determining if the user has moved from a first location where the closure panel in the opened position would obstruct the approach of the user towards the entry to a second location where the approach of the user towards the entry is not obstructed by the closure panel in the opened position.
In another aspect, the method also includes the step of controlling the access system to move the closure panel to the opened position after determining the user has moved to an unobstructed location where the approach of the user towards the entry is not obstructed by the closure panel in the opened position.
In another aspect, the method also includes the step of detecting at least one obstacle in proximity to the motor vehicle using at least one non-contact obstacle detection sensor configured to detect the at least one obstacle and modifying a functionality associated controlling the access system.
In accordance with a further aspect, there is provided a user detection system for a motor vehicle having at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle, the user detection system comprising a proximity detection system configured to detect a user in proximity to the motor vehicle and a controller connected to the proximity detection system and configured to determine a location of the user relative to the motor vehicle using the at least two proximity sensors, and grant access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle in a valid access zone and deny access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle in an invalid access zone.
In accordance with a further aspect, there is provided a method of controlling access to a motor vehicle having at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle, the method comprising determining a location of the user relative to the motor vehicle using a proximity detection sensor system; granting access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle detected in a valid access zone; and denying access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle detected in an invalid access zone.
In accordance with a further aspect, there is provided a user detection system for a motor vehicle having at least one closure panel for facilitating access to the motor vehicle by a user of the motor vehicle, the user detection system comprising a proximity detection system configured to detect a user in proximity to the motor vehicle and a controller connected to the proximity detection system and configured to determine a location of the user relative to the motor vehicle using the at least two proximity sensors, and grant access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle in a valid access zone and deny access to the motor vehicle via the at least one closure panel based on the location of the user relative to the motor vehicle in an invalid access zone; wherein the controller is further configured to alter the valid access zone and invalid access zone.
Further areas of applicability will become apparent from the description provided herein. The description and specific examples in this summary are intended for purposes of illustration only and are not intended to limit the scope of the present disclosure.
The drawings described herein are for illustrative purposes only of selected embodiments and not all possible implementations, and are not intended to limit the scope of the present disclosure.
Corresponding reference numerals indicate corresponding parts throughout the several views of the drawings.
Example embodiments will now be described more fully with reference to the accompanying drawings. Example embodiments are provided so that this disclosure will be thorough, and will fully convey the scope to those who are skilled in the art. Numerous specific details are set forth such as examples of specific components, devices, and methods, to provide a thorough understanding of embodiments of the present disclosure. It will be apparent to those skilled in the art that specific details need not be employed, that example embodiments may be embodied in many different forms and that neither should be construed to limit the scope of the disclosure. In some example embodiments, well-known processes, well-known device structures, and well-known technologies are not described in detail.
Referring initially to
Each of upper door hinge 16 and lower door hinge 18 include a door-mounting hinge component and a body-mounted hinge component that are pivotably interconnected by a hinge pin or post. The door-mounted hinge component is hereinafter referred to a door hinge strap while the body-mounted hinge component is hereinafter referred to as a body hinge strap. While front passenger door 12 is shown, those skilled in the art will recognize that the motor vehicle 10 may include other closure members (e.g., door or liftgate) of vehicle 10 such as rear passenger doors 17, decklid 19, and a hood 106 or frunk lid.
The controller 26 includes a processor or central processing unit (“CPU”) 520, memory 530, and an interface device 550. The memory 530 may include a variety of storage devices including internal memory and external mass storage typically arranged in a hierarchy of storage as understood by those skilled in the art. For example, the memory 530 may include databases, random access memory (“RAM”), read-only memory (“ROM”), flash memory, and/or disk devices. The interface device 550 may include one or more network connections. The controller 26 may be adapted for communicating with other data processing systems (e.g., similar to controller 26) over a network 551 via the interface device 550. For example, the interface device 550 may include an interface to a network 551 such as a local area network (“LAN”), etc. As such, the interface 550 may include suitable transmitters, receivers, etc. Thus, the controller 26 may be linked to other data processing systems by the network 551. The CPU 520 may include or be operatively coupled to dedicated coprocessors, memory devices, or other hardware modules 521. The CPU 520 is operatively coupled to the memory 530 which stores an operating system (e.g., 531) for general management of the controller 26. The controller 26 may include a data store or database system 532 for storing data and programming information. The database system 532 may include a database management system (e.g., 532) and a database (e.g., 532) and may be stored in the memory 530 of the controller 26. In general, the controller 26 has stored therein data representing sequences of instructions which when executed cause the method described herein to be performed. Of course, the controller 26 may contain additional software and hardware a description of which is not necessary for understanding the invention.
Thus, the controller 26 includes computer executable programmed instructions for directing the controller 26 to implement the embodiments of the present disclosure. The programmed instructions may be embodied in one or more hardware modules 521 or software modules 531 resident in the memory 530 of the controller 26 or elsewhere (e.g., 520). Alternatively, the programmed instructions may be embodied on a computer readable medium or product (e.g., a memory stick, etc.) which may be used for transporting the programmed instructions to the memory 530 of the controller 26. Alternatively, the programmed instructions may be embedded in a computer-readable signal or signal-bearing medium or product that is uploaded to a network 551 by a vendor or supplier of the programmed instructions, and this signal or signal-bearing medium may be downloaded through an interface (e.g., 550) to the controller 26 from the network 551 by end users or potential buyers.
The latch 110 and drive mechanism 20 are controlled in part by the system 100. It will be appreciated by those skilled in the art that the system 100 may be applied to any motorized or automated closure panel structure that moves between an open position and a closed position. For example, a non-exhaustive list of closure panels includes window panes, sliding doors, tailgates, sunroofs and the like. For applications such as window panes or sun roofs, the sensor 122 may be mounted on the body 14 of the vehicle 10, and for applications such as powered liftgates and sliding doors the sensor 122 may be mounted on or within the bumper.
The sensors 122 may come in different forms, including non-contact proximity sensors which are typically based on capacitance changes. These are referred to as capacitive sensors in the following.
Capacitive sensors typically include a conductive strip, including, for example, a metal strip or wire. The conductive strip may be embedded in a non-conductive material, such as a non-conductive plastic or rubber strip, which is routed along and adjacent to the periphery of the bumper or wheel-well. The metal strip or wire and the chassis of the vehicle 10 may collectively form the two plates of a sensing capacitor. Alternatively, the sensor 122 may incorporate two discrete electrodes separately, or embedded together within the non-conductive material. An example of such a sensor 122 is described below. An obstacle placed near these two electrodes changes the dielectric constant and thus varies the amount of charge stored by the sensing capacitor over a given period of time. The charge stored by the sensing capacitor is transferred to a reference capacitor in order to detect the presence of the obstacle. The capacitive sensor is typically driven by a pulsed signal from a controller 26. Example sensors and possible mountings to a fascia are described in U.S. Patent Application No. 61/791,472 by Pribisic, et al., filed Mar. 15, 2013, the entire content of which is hereby incorporated by reference, and in U.S. Patent Application No. 61/791,322 by Pribisic et al., filed Mar. 15, 2013, the entire content of which is hereby incorporated by reference. Example driving of a sensor, particularly to minimize electrical noise, is described in U.S. Patent Application No. 61/791,779 by Pribisic et al., filed Mar. 15, 2013, the entire content of which is hereby incorporated by reference. It is to be recognized that these are only example capacitive sensors 122 and other capacitive proximity sensors, or non-capacitive proximity sensors, such as, for example, optical sensors, ultrasonic, infra-red, lidar, radar, acoustic sensors, or radio frequency (fob based) sensors could be used.
The controller 26 may be a separate electronic control unit (“ECU”) or may be coupled to or incorporated in the vehicle's main or central ECU system (e.g., a vehicle ECU, a body control module 27 (“BCM”), etc.). The controller 26 may be coupled to an authentication system, such as a passive entry passive start (“PEPS”) type system 200, a remote keyless entry (“RKE”) system 250, a front end antenna 170 associated with at least one of the PEPS system 200 and the RKE system 250, and a rear end antenna 180 also associated with at least one of the PEPS system 200 and the RKE system 250. For reference, both the PEPS system 200 and the RKE system 250 work with an electronic keyfob or fob 230 and/or mobile phone 231 that is located with the user 109. The PEPS and/or RKE systems 200, 250 receive signals from the fob 230 through one or more of the front and rear antennae 170, 180 to initiate an operation such as, for example, controlling the door 12 to open or close, etc. In general, a PEPS system 200 does not require the user 109 to push a button on the fob 230 and/or mobile phone 231 to initiate an operation. In contrast, a RKE system 250 does require the user 109 to push a button on the fob 230 and/or mobile phone 231 to initiate an operation. According to one example embodiment, the PEPS system 200 is a stand-alone, unmodified system coupled to the antennae 170, 180 and the controller 26 intercepts required signals from the PEPS system 200 to implement the method of the example embodiment.
The at least one proximity sensor 122 includes at least one short range proximity sensor 122a, 122b for sensing the position of the user 109 relative to the vehicle 10 in the at least one short range proximity zone 107 and at least one medium or long range proximity sensor 122c, 122d, 122e, 122f for sensing the position of the user 109 relative to the vehicle 10 in the plurality of medium or long range proximity zones 108. The at least one short range proximity sensor 122a, 122b is selected from a group comprising capacitive sensors 122a and close proximity PKE (passive keyless entry) approach sensors 122b. The at least one medium or long range proximity sensor 122c, 122d, 122e, 122f is selected from a group consisting of radar sensors 122c, optical sensors 122d, PKE/FOB sensors 122e, and GPS sensors 122f.
Continuing to refer to
According to another aspect, the controller 26 is further configured to operate the at least one proximity sensor 122 at a first polling rate. The controller 26 is also configured to determine whether the user 109 is detected in one of a plurality of wakeup zones. The controller 26 returns to operate the at least one proximity sensor 122 at the first polling rate in response to the user 109 not being detected in one of the plurality of wakeup zones. The controller 26 is configured to track the user 109 in the plurality of wakeup zones in response to user 109 being detected in one of the plurality of wakeup zones. In addition, the controller 26 is configured to increase a polling rate of the at least one proximity sensor 122 beyond the first polling rate based on tracking the user 109 moving closer to the vehicle 10. The controller 26 decreases the polling rate of the at least one proximity sensor 122 to be less than the first polling rate based on tracking the user 109 moving away from the vehicle 10.
As discussed above, the system 100 can include the user interface 599. So, according to yet another aspect, the controller 26 is further configured to determine a user input of a preferred polling rate using the user interface 599. The controller 26 then sets a polling rate of the at least one proximity sensor 122 based on the user input of the preferred polling rate.
As mentioned above, the system 100 can include the GPS sensors 122f and the vehicle global positioning system unit 600 for determining a geographical position, also referred to as a geo-location or geo-position, of the vehicle 10 and the controller 26 is further adapted to determine the activation intent of the user to access the vehicle based on the geo-location. So, according to yet another aspect, the controller 26 is further configured to determine the vehicle position of the vehicle 10 using at least one of the GPS sensors 122f and the vehicle global positioning system unit 600. The controller 26 is configured to set a polling rate of the at least one proximity sensor 122 based on the vehicle position of the vehicle 10. The controller 26 then operates the at least one proximity sensor 122 using the polling rate set. According to a further aspect, the controller 26 is configured to determine the vehicle position of the vehicle 10 using at least one of the GPS sensors 122f and the vehicle global positioning system unit 600. The controller 26 is also configured to disable the at least one medium or long range proximity sensor 122c, 122d, 122e, 122f if the vehicle position correlates to high traffic next to the vehicle 10. The controller 26 is additionally configured to poll the at least one short range proximity sensor 122a, 122b. According to another aspect, the controller 26 is further configured to determine the vehicle position of the vehicle 10 using at least one of the GPS sensors 122f and the vehicle global positioning system unit 600. The controller 26 is also configured to lookup a prestored polling rate based on the vehicle position. The controller 26 operates the at least one proximity sensor 122 using the prestored polling rate. GPS sensors 122f and the vehicle global positioning system unit 600 for determining a geographical position are examples of a sensor system configured to provide information or data about the state of the vehicle to the controller 26. Such geo-position data may be procured directly from on-board vehicle sensors or from a communication system connected to external geolocation positioning infrastructure.
According to another aspect, the controller 26 is further configured to receive environment data in a learning mode. The controller 26 is also configured to monitor proximity activity around the vehicle 10 in the environment in the learning mode. The controller 26 sets a polling rate of the at least one proximity sensor 122 based on the proximity activity monitored around the vehicle 10 in the learning mode. The controller 26 is additionally configured to receive the environment data in an applied learning mode. The controller 26 is configured to detect a recurrence of the environment data in the applied learning mode. The controller 26 uses the polling rate of the at least one proximity sensor 122 set based on the proximity activity monitored around the vehicle 10 in the applied learning mode.
Referring back to
In response to determining the vehicle position is a favorite location position, the controller 26 is configured to increase the polling rate of the at least one proximity sensor 122 based on one of the at least one of the mobile phone 231 and the key fob 230 distance from the vehicle 10 increasing and around learned interaction times to anticipate arrival of the at least one of the mobile phone 231 and the key fob 230 for wakeup.
In response to determining the vehicle position is not the home position, increase the polling rate of the at least one proximity sensor 122 as the at least one of the mobile phone 231 and the key fob 230 distance from the vehicle 10 increasing. Also in response to determining the vehicle position is not the home position, the controller 26 is configured to further increasing the polling rate of the at least one proximity sensor 122 if the at least one of the mobile phone 231 and the key fob 230 is not mobile for a predetermined immobile time.
According to another aspect, the system 100 includes an activation sensor 123 for sensing an activation gesture of the user 109. Again, the system 100 also includes a vehicle system 20, 110, 160 for controlling the vehicle function. The system 100 additionally includes a controller 26 in communication with the activation sensor 123 and the vehicle system 20, 110, 160. The controller 26 is configured to modify the operation of the activation sensor 123 based on receiving a signal indicative of the state of the vehicle 10, and to control the vehicle system 20, 110, 160.
As discussed above, the at least one proximity sensor 122 is configured to detect the user 109 in one of the plurality of zones 107, 108 including the at least one short range proximity zone 107 adjacent the vehicle 10 and the plurality of medium or long range proximity zones 108 disposed increasing further away from the vehicle 10 than the least one short range proximity zone 107. The at least one proximity sensor 122 includes the at least one short range proximity sensor 122a, 122b for sensing the position of the user 109 relative to the vehicle 10 in the at least one short range proximity zone 107 and the at least one medium or long range proximity sensor 122c, 122d, 122e, 122f for sensing the position of the user 109 relative to the vehicle 10 in the plurality of medium or long range proximity zones 108. The at least one short range proximity sensor 122a, 122b is selected from the group comprising capacitive sensors 122a and close proximity PKE approach sensors 122b. The at least one medium or long range proximity sensor 122c, 122d, 122e, 122f selected from the group consisting of radar sensors 122c, optical sensors 122d, PKE/FOB sensors 122e, and GPS sensors 122f. Radar sensors may be doppler type radar or FMCW, or other sensor types which may be able to detect motion and distance of objects for example and without limitation.
Again, the plurality of zones 107, 108 includes the activation zone immediately adjacent the vehicle 10 and the plurality of wakeup zones further from the vehicle 10 than the activation zone. Referring specifically to
Referring specifically to
According to an aspect, the method further includes the step of decreasing a polling rate of the at least one proximity sensor 122 in response to the user 109 stopping movement relative to the vehicle 10 for a predetermined stopping time. Referring specifically to
Referring specifically to
Referring specifically to
Referring specifically to
Referring specifically to
Referring specifically to
A vehicle power door(s) control strategy can then include vehicle location information, time and the ability to remember previous vehicle trip occupant information 1600. These 3 variables can aid understanding/infer the intent of the users 109 or operators to access a vehicle 10 (e.g. intent to open a door 12, 17) while interacting the vehicle 10. Understanding the intent of the user 109 will allow the powered door (PD) system (i.e., actuator or actuator unit 22) controlled by controller 26 to execute needed functions more efficiently and with less interaction from the user 109. In essence, the vehicle 10 will be able to anticipate user needs based on the location, time and previous ride history. Artificial intelligence control used in such a method if also provided. Aspects provided herein include: 1) the system 100 will understand vehicle GPS location, 2) the system 100 will understand time, 3) the system 100 will remember previous trip information to determine actions required for next trip, and 4) current trip occupant information to determine actions for end of trip will be determined by the system 100. Thus, according to an aspect, the system 100 includes a sensor 122 for sensing at least one of an activation gesture of a user 109 and a proximity of the user 109 to the vehicle 10. The system 100 can include a vehicle system or access system 20, 110, 160 for controlling the vehicle function. A controller 26 has a memory unit 530 and is in communication with the sensor 122 and with the vehicle system 20, 110, 160. The controller 26 is configured to store data relating to a previous operation of the vehicle function and subsequently control the vehicle system 20, 110, 160 based on the previously stored data. According to another aspect, the controller 26 is further configured to monitor data relating to a current operation of the vehicle function and subsequently control the vehicle system 20, 110, 160 based on the currently monitored data.
GPS locations can be programmed into the vehicle 10 (e.g., memory 530) or can be determined from points of interest labels in normal GPS services. When the vehicle 10 is at all locations except home (e.g. the user's house or most time spent parked at a location), a user approaching the vehicle 10 has intent of accessing vehicle 10. If the system 100 knows GPS location (i.e., vehicle position), it is able to execute functions that align with specific locations. For example, if the GPS location is determined to be the user's place of work, then probabilistically the controller 26 determines it is very likely that only one door will require access, such as the driver's door 12 when the user 109 is detected to be approaching the vehicle 10. The system 100 only needs to monitor about a single door and open accordingly. Conversely, if the GPS location is determined to be a sports venue; it is likely that multiple doors 12, 17 will require access. So, the system 100 can monitor multiple doors 12, 17 for user 109 approaches.
Thus, referring specifically to
By adding time component to the GPS signal, further refinement to intent can be determined. For example the GPS location is “restaurant”; and the time is after midnight, it is likely that only the front doors 12 will require access (i.e., no kids). Also, the system 100 needs to monitor only the front doors 12 for functional response. If the GPS signal is “school” and the time is 4 pm, it is likely front and rear doors 12, 17 will require access. The system 100 can monitor for occupants accordingly. So, referring specifically to
By recording a previous trip history, even further refinement to understanding intent can be achieved by recalling the previous trip details, such as may be stored in memory 530. For example, if 4 people leave a house/home (e.g., internal occupant monitoring system determines four persons are seated in vehicle 10; and GPS arrival location is determined to be a shopping center, it is very likely, or a high probability, that 4 people will return to the vehicle 10. Based on this high likelihood, the controller 26 will infer that each occupant will required a door 12, 17 to be opened, and as such the system 100 can monitor the approach of user's towards all of the door 12, 17 e.g. 4 doors. As another example, if one person enters the vehicle 10 when the user 109 enters from its home, and the GPS location upon exist of the vehicle 10 is at a gym, or not at home, it is very likely that only one person will return to the vehicle 10. The system 100 only needs to monitor for approach around a single door 12, 17. Previous trip information can also be used to enhance access to a Frunk or powered liftgate (PLG) system. If the occupant accessed the Frunk/PLG before opening the driver's side door 12, it is likely that access to the same compartment may be needed at arrival, e.g. at a gym location or a work location. When the occupant exits the door 12, the appropriate compartment can be opened in anticipation of egress request.
For end of trip function, yet further refinement to the understanding intent can be achieved when the system 100 obtains cabin information about users seating to operate only the doors 12, 17 required. To execute this feature requires the ability of the system 100 to determine occupation status of each seat during the trip. This can be accomplished using in cabin radar sensor, seatbelt user information, door latch state change information etc. At the end of the trip, doors 12, 17 can open based on occupant seating locations.
Integrating information such as GPS location, time, previous trip history, and end of trip function will allow controller 26 to predict required actions related to the door 12, 17 with higher degree of confidence allowing the system 100 to provide unimpeded access/egress to users 109.
Thus, referring specifically to
According to an aspect, yet another method for controlling a vehicle function of a vehicle 10 is provided. The method includes the step of determining operation of a vehicle system 20, 110, 160 in response to detecting a user 109 using a sensor for sensing an activation gesture or proximity of the user 109 to the vehicle 10. The method also includes the step of storing the parameters associated with the operation of the vehicle system 20, 110, 160. The next step of the method is controlling operation of the vehicle system 20, 110, 160 in response to subsequently detecting a user 109 using the sensor based on the stored parameters associated with the operation of the vehicle system 20, 110, 160. According another aspect, the data relating to the previous operation of the vehicle function includes a number of occupants and a destination and a time.
It is desirable to provide “unimpeded access” to the motor vehicle 10, that is how to open the door 12 with the minimal positive action by a user 109. A positive action could be for example, the user 109 making a positive intentional gesture. But this positive action decreases the seamless natural of access for the user 109. Some existing systems look for a “predetermined gesture” to be matched with a gesture being made in a designated detection zone. However, gestures have to be remembered which is a drawback. Identifying approach of the user 109 is preferable, but the challenge is to differentiate an approach to the vehicle 10 with intent to access, compared to one that has no intent. For example, the user 109 mowing the yard next to the vehicle 10 when they have their FOB 230 in their pocket.
So, for example, the vehicle access system 100, 2000 includes two or more sensors 122 for detecting at least one approach characteristic of the user 109. In addition, a controller 26, 608 is connected to the two or more sensors 122 and connected to the actuator unit 22. It is understood the vehicle access system 100, 2000 may include one or more sensors. The controller 26, 608 is adapted to determine a confidence level representative of an intent of the user 109 approaching the motor vehicle 10 to access the motor vehicle 10 based on the at least one approach characteristic of the user 109 and control the actuator unit 22 based on the confidence level. Therefore user approach characteristics are analyzed and intent is inferred.
According to another aspect, one or more sensors 122 for detecting at least one approach characteristic of the user 109 may be used instead of the two or more sensors 122. In addition, the controller 26, 608 is adapted to determine a confidence level representative of the intent of the user 109 approaching the motor vehicle 10 to access the motor vehicle 10 based on the at least one approach characteristic of the user 109. The controller 26, 608 is also configured to determine a sensor performance level of the one or more sensors 122 and adjust the confidence level based on the determined sensor performance level. The controller 26, 608 then controls the actuator unit 22 based on the adjusted confidence level. The controller 26, 608 may be further configured to determine an overall confidence level of the intent of the user 109 to access the motor vehicle 10. Additionally, the controller 26, 608 can be further configured to determine a sensor performance level for the at least one sensors 122, wherein the overall confidence level is a function of the sensor performance level determined. The at least one approach characteristic of the user 109 may include a plurality the approach characteristics of the user 109 and the controller 26, 608 is further configured to determine individual confidence levels for each of the plurality of approach characteristics of the user 109 detected. So, after the approach characteristics are identified, confidence values may be assigned to each sensor signal which may be used in an overall confidence score.
The controller 26, 608 is further configured to determine the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected based on at least one of the individual confidence levels being above a predetermined confidence level. In addition, the controller 26, 608 can be configured to determine the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected based on a sum of individual confidence levels.
Furthermore, the controller 26, 608 can be further configured to determine the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected based on a weighted sum of the individual confidence levels as one possible configuration. For example, weighting of individual sensor confidence values in the decision sum can be adjusted to reflect the importance of the characteristic's data which each sensor represents. For example if actor vector is more important that actor speed, then actor vector can be more heavily weighted. The controller 26, 608 may also be configured to control different functions of the access system 20, 110, 160 based on a determined level of intent of the user 109 to access the motor vehicle 10.
According to another aspect, the controller 26, 608 may also be adapted to determine at least one approach vector representative of the intent of the user 109 approaching the motor vehicle 10 to access the motor vehicle 10 based on the at least one approach characteristic of the user 109 and control the actuator unit 22 based on the intent of the user 109 to access the motor vehicle 10 inferred from the at least one approach vector. In addition, the at least one approach characteristic of the user 109 can include a speed of approach of the user 109 towards the motor vehicle 10, a location of the user 109 while approaching the motor vehicle 10, a gaze of the user 109 approaching the motor vehicle 10. So, the controller 26, 608 is configured to determine the intent of the user 109 to access the motor vehicle 10 using the detected at least one approach characteristic without a detected gesture performed by the user 109. Thus, with system 100, 2000, the user approach does not need to be the same, (or exactly repeated) all the time since multiple approach characteristics are analyzed.
According to yet another aspect, the controller 26, 2000 is adapted to determine a level of intent of the user 109 based on receiving a signal from the one or more sensors 122, and control the access system 20, 110, 160 differently based on the level of intent of the user 109 determined being different. Specifically, the controller 26, 608 is further configured to control different functions of the access system 20, 110, 160 based on a determined level of intent of the user 109 to access the motor vehicle 10. The controller 26, 608 controls increased functionality at each of plurality of functional levels of the access system 20, 110, 160 as the determined level of intent is increased. So, the system 100, 2000 may not necessarily act in an all or nothing fashion, but may control the access system 20, 110, 160 differently based on the confidence it has correctly inferred the intent.
The plurality of functional levels of the access system 20, 110, 160 can include a first functional level L1 with a maximum functionality of the access system 20, 110, 160 and a second functional level L2 with reduced amount of the functionality of the access system 20, 110, 160 compared to the first functional level L1 and a third functional level L3 with a further reduced functionality of the access system 20, 110, 160 compared to the second functional level L2.
According to yet another aspect, the controller 26, 2000 is adapted to determine an intent of the user 109 using the at least one approach characteristic of the user as well as using the state of the vehicle. The state of the vehicle may include data related to geo-position of the vehicle and to the environmental state of the vehicle, such as weather conditions surrounding the vehicle for example. Environmental data may be collected using a sensor system local to the vehicle and/or using a communication system connected to external data sources, such as to a weather data server for example. The controller 26, 2000 may be configured to use vehicle state information or data to adjust the determined intent of the user.
For example the controller 26, 2000 may modify an overall determined confidence level as described herein by increasing or decreasing the determined confidence level based on the state of the vehicle. For example, when the state of the vehicle is determined to be, using the geo-location data of the vehicle, parked in a downtown core known for being a densely populated area where many people (non-unauthorized users) may be moving about the vehicle, the overall determined confidence level may be decreased e.g. from 6 to 2 so as to avoid a premature action of the access system 20, 110, 160. As a result, an authorized user may have to had to approach the vehicle during a lull in the presence other un-authorized users about the vehicle to provide confidence to the access system 20, 110, 160 that a correct user is seeking to gain access. Or, in order for the user to access the vehicle, a vehicle intent signal e.g. activation of a FOB, may now be required to access the vehicle based on the geo location.
For example, when the state of the vehicle is determined to be, using the geo-location data of the vehicle, parked in at the user's home address, the overall determined confidence level may be increased e.g. from 3 to 6 so as to avoid a non-action of the access system 20, 110, 160. For example, a user, while the vehicle is determined to be in a geolocation of home, may be determined to be a primary actor, moving towards the front door, moving at a speed between 1 to 1.5 m/s, and performing a correct activation gesture, yet however, be determined to be looking at his phone and performing the correct gesture in an incorrect location. The access system 20, 110, 160 may increase the confidence of the user having intent to access the vehicle based on the geo-location and increase the level to provide a full power open under NCOD control. Since the user is at home, the risk of incorrect action is lesser since it is less likely other pedestrians may be impacts by the closure panel or an adjacent car, or that an unauthorized user may access the vehicle while the vehicle is at a home position. Such an adjustment based on the geolocation of the vehicle may also include adjusting sub-confidence values in the decision sum by providing for a weighting of individual sub-confidence values. For example, if the geolocation of the vehicle is determined to be a grocery store parking lot, the approach vector and speed inputs may be increased weighted to compensate for an unlikely gesture activation by a user assuming the user is carrying groceries due to visiting the grocery store. Such an adjustment may also be based on the environmental state of the vehicle, such as the weather. For example, if the temperature and weather conditions of the vehicle is determined to be a cold and raining, the approach vector and speed inputs may be increased weighted to compensate for an unlikely gesture activation by a user assuming the user is carrying an umbrella due to the rain, of has their hands in their pockets due to the lower temperature.
As another example, the controller 26, 2000 may be configured to modify inputs used to determine intent of the user based on the state of the vehicle, such as modify the predetermined authentication distance 2100, the predetermined sensing distance 2102, and the predetermined access distance 2104, by either increasing and/or decreasing such distances. For example, when the state of the vehicle used by the controller 26, 2000 to assist with inferring the intent of the user to access the vehicle is the geo-location of the vehicle determined to be at a home location of the user of the vehicle, the controller 26, 2000 may decrease the predetermined authentication distance 2100 since it is likely the user may more often be moving about the vehicle at home without having the intent to access the vehicle, such as if the vehicle is parked in a garage the user often accesses the garage for running errands without accessing the vehicle. Or for example if the user's living room is above a garage in which the vehicle is parked. The predetermined sensing distance 2102, and the predetermined access distance 2104 may also be decreased to avoid power drain of the system from frequent movement of the user about the vehicle at home without having intent to access the vehicle. For example, when the state of the vehicle used by the controller 26, 2000 to assist with inferring the intent of the user to access the vehicle is the geo-location of the vehicle determined to be at a parking lot location of the user of the vehicle and inclement weather has been determined, the controller 26, 2000 may increase the predetermined authentication distance 2100, and the predetermined sensing distance 2102, and the predetermined access distance 2104 having inferred that the user's intent when his approach is detected will be to access the vehicle rapidly to shelter from the inclement weather.
Further, the controller 26, 2000 may be configured to modify the response e.g. control the to control the vehicle system 20, 110, 160 or vehicle function, subsequent to having inferred the intent of the user to access the vehicle based on the state of the vehicle. For example, the controller 26, 2000 based on the geo-location of the vehicle if determined to be in a busy center downtown area next to a side walk with high density may determine to only move the door to presented position as opposed to a fully opened position so as not to obstruct a sidewalk and strike pedestrians. For example, the controller 26, 2000 based on the environment of the vehicle if determined to be in a windy may determine to only move the door to presented position as opposed to a fully opened position so avoid the wind catching the door which could damage the power door actuator.
Thus, user convenience is enhanced by adapting to environmental and positional changes of the vehicle after having been driven from to various locations, within changing environments.
Now referring to
According to additional aspects, the method can further comprise determining a sensor performance level for the at least one sensors 122, wherein the overall confidence level is a function of the sensor performance level determined. More specifically, the at least one approach characteristic of the user 109 includes a plurality the approach characteristics of the user 109 and the step of determining the overall confidence level of the intent of the user 109 to access the motor vehicle 10 comprises determining individual confidence levels for each of the plurality of approach characteristics of the user 109 detected. In addition, the step of determining the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected can be based on at least one of the individual confidence levels being above a predetermined confidence level. Furthermore, the step of determining the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected can be based on a sum of individual confidence levels. The step of determining the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected may also based on a weighted sum of the individual confidence levels. Additionally, the step of determining the intent of the user 109 to access the motor vehicle 10 using the at least one approach characteristic detected can be based on the overall confidence level being above a predetermined overall confidence level.
Again, according to another aspect, the step of controlling the access system 20, 110, 160 in response to the intent determined comprises controlling different functions of the access system 20, 110, 160 can be based on a determined level of intent of the user 109 to access the motor vehicle 10. In more detail, controlling different functions of the access system 20, 110, 160 based on the determined level of intent of the user 109 to access the motor vehicle 10 may comprise controlling increased functionality at each of a plurality of functional levels of the access system 20, 110, 160 as the determined level of intent is increased. In further detail, the plurality of functional levels of the access system 20, 110, 160 include a first functional level L1 with a maximum functionality of the access system 20, 110, 160 and a second functional level L2 with reduced amount of the functionality of the access system 20, 110, 160 compared to the first functional level L1 and a third functional level L3 with a further reduced functionality of the access system 20, 110, 160 compared to the second functional level L2.
According to an aspect, and as discussed above, the at least one approach characteristic of the user 109 is an approach vector of the user 109. In addition, the at least one approach characteristic of the user 109 includes a speed of approach of the user 109 towards the motor vehicle 10, a location of the user 109 while approaching the motor vehicle 10, a gaze of the user 109 approaching the motor vehicle 10. Also, determining the intent of the user 109 to access the motor vehicle 10 using the detected at least one approach characteristic may not be based on a detected gesture performed by the user 109.
As discussed, according to yet another aspect, controlling the access system 20, 110, 160 based on the determined intent can occur when the user 109 is detected to be within a predetermined access distance 2104 from the motor vehicle 10. More specifically, detecting, using the one or more sensors 122, at least one approach characteristic of the user 109 may be performed when the user 109 is detected to be within a predetermined sensing distance 2102 beyond the access distance from the motor vehicle 10. Similarly, detecting, using the one or more sensors 122, at least one approach characteristic of the user 109 can be performed in response to an authentication of the user 109 at a predetermined authentication distance 2100 beyond the predetermined sensing distance 2102 from the motor vehicle 10.
Again, controlling the access system 20, 110, 160 can be based on detecting a gesture adjacent the motor vehicle 10 after the intent of the user 109 to access the motor vehicle 10 is determined. Also, the step of detecting, using the one or more sensors 122, at least one approach characteristic of the user 109 may comprise using at least two different types of sensors 122.
Now referring to
Therefore, the system may be configured to determine a state of the user and determine a score based on the state of the user representative of the inferred intent of the user to access the vehicle, and control a vehicle access system using the score. The score may be altered based on sensed changes in user state, behavior, or things the user has. As discussed herein above, such access requirements may be different based on changes in the geo-positions of the vehicle, and based on changes in the surrounding environment of the vehicle, including changes in weather conditions or changes in people density (e.g. non-users) surrounding the vehicle, which may be reevaluated, determined or calculated by the system following a change in the state of the vehicle. For example, for, the access requirements when the vehicle is in one geolocation may be different when the vehicle has been moved to a different geolocation having been reassessed following the change in the position of the vehicle.
Now referring to
Now referring to
Now referring to
So, the user 109 approaching the vehicle 10 would have the registered keyfob 230 or equivalent mobile device 231, such as a cellular phone or tablet. The mobile device or tablet 231 could be enabled with Ultra-wide Band (UWB), Bluetooth Low Energy (BLE), or similar technology to enable connectivity with the vehicle-side controller (e.g., controller 26, 608, 612). The controller 26, 608, 612 or body control module 27 (e.g., using its own processor or microcontroller 2301) can then control all of the various subsystems (e.g., access system 20, 110, 160) based on detection of the keyfob 230 or mobile device 231.
According to an aspect, the at least two proximity sensors 122 are disposed at at least two sensor positions on the motor vehicle 10. The controller 26, 608, 612 is configured to determine at least two distances between the user 109 and each of the at least two sensor positions. The controller 26, 608, 612 is also configured to compute the location of the user 109 relative to the motor vehicle 10 using a positioning algorithm relative to the at least two sensor positions. Thus, the distance between the anchors/transceivers (i.e., sensors 122) and the keyfob device 230 may be computed based on the time-of-flight (ToF) of the signals transmitted between the two devices 122, 230, for example. A two or three-dimensional positioning algorithm is then be used to compute the location of the user 109 relative to the vehicle 10.
The controller 26, 608, 612 is also configured to determine at least one of an approach trajectory and a non-identifying biometric information and a non-identifying biomechanical information using the at least two proximity sensors 122 (e.g., sensor/imager). The controller 26, 608, 612 is also configured to infer an intent of the user 109 to access the motor vehicle 10 based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information. More specifically, according to an aspect, the controller 26, 608, 612 is configured to infer the intent of the user 109 to access the motor vehicle 10 based on the at least one of the approach trajectory corresponding to the user 109 approaching the motor vehicle 10 and correlated to an environment surrounding the motor vehicle 10. The the at least two proximity sensors 122 could be a camera or optical sensor or perhaps radar.
The positioning algorithm can be a two-dimensional calculation or algorithm could use triangulation.
So, the equations shown in
Therefore, according to an aspect, the controller 26, 608, 612 is further configured to poll an environment surrounding the motor vehicle 10 for the hardware token 230, 231 registered to the motor vehicle 10 using the at least two proximity sensors 122. The controller 26, 608, 612 is also configured to decide if the user 109 associated with the hardware token 230, 231 detected meets predetermined authorization requirements for accessing the motor vehicle 10 based on authorization signals received by the at least two proximity sensors 122 from the hardware token 230, 231. The controller 26, 608, 612 then wakes up the user detection system 100, 2000, 2300 and sends and receives location signals from the hardware token 230, 231 using the at least two proximity sensors 122 and determine the at least two distances between the user 109 and each of the at least two sensor positions. The controller 26, 608, 612 is additionally configured to execute the positioning algorithm and compute the location of the user 109 relative to the motor vehicle 10 using the positioning algorithm. In addition, the controller 26, 608, 612 is configured to determine at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information using the at least two proximity sensors 122. The controller 26, 608, 612 is also configured to analyze the at least one of the approach trajectory and the location of the user 109 and execute analysis of the non-identifying biometric information and the non-identifying biomechanical information. The controller 26, 608, 612 is further configured to verify that the user 109 is approaching the motor vehicle 10 within one of the plurality of valid access zones 2320, 2322, 2324, 2326 (
Thus, the access system 100, 2000, 2300 can poll at a specified rate using RF communication to scan the surroundings of the vehicle 10 for registered keyfobs 230 or other access devices 231. Once a registered device or hardware token 230, 231 is within the specified range for vehicle access, the access system 100, 2000, 2300 will check if the device 230, 231 is authorized to gain access to the vehicle 10.
So, the determination of user intent based on position or approach trajectory can include the implementation of the predefined valid access zones where closure systems can be toggled from or not. Consequently, the user detection system 100, 2000, 2300 can include at least one proximity sensor 122 configured to sense the user 109 in one of a plurality of valid access zones 2320, 2322, 2324, 2326 defined around the motor vehicle 10. The user detection system 100, 2000, 2300 also includes at least one non-contact obstacle detection sensor 122a, b configured to detect at least one obstacle. The user detection system 100, 2000, 2300 additionally includes a controller 26, 608, 612 connected to the at least one proximity sensor 122 and the at least one non-contact obstacle detection sensor 122a, b and in communication with an access system 20, 110, 160 of the motor vehicle 10 associated with the at least one closure panel 12, 17, 19, 106. The controller 26, 608, 612 is configured to determine a location of the user 109 relative to the motor vehicle 10 and whether the user 109 is approaching the motor vehicle 10 within one of the plurality of valid access zones 2320, 2322, 2324, 2326 using the at least one proximity sensor 122. The controller 26, 608, 612 is also configured to detect the at least one obstacle in proximity to the motor vehicle 10 using the at least one non-contact obstacle detection sensor 122a, b and modify a functionality associated with the plurality of valid access zones 2320, 2322, 2324, 2326 to a modified access functionality based on detection of the at least one obstacle in proximity to the motor vehicle 10. In addition, the controller 26, 608, 612 is configured to control the access system 20, 110, 160 based on the location of the user 109 relative to the motor vehicle 10 and whether the user is within one of the plurality of valid access zones 2320, 2322, 2324, 2326 and the modified access functionality.
Still referring to
As discussed above, the at least one closure panel 12, 17, 19, 106 includes door 12 and access system 20, 110, 160 can include a power closure member actuation system 20 configured to move the door 12. According to an aspect, the controller 26, 608, 612 is configured to detect the user 109 approaching the motor vehicle 10. The controller 26, 608, 612 is additionally configured to determine whether the user 109 is forward of a B-pillar 2338 (
Also disclosed herein is a method of operating a user detection system 100, 2000, 2300 for a motor vehicle 10 having at least one closure panel 12, 17, 19, 106 for facilitating access to the motor vehicle 10 by a user 109 of the motor vehicle 10. The method includes the step of determining a location of the user 109 relative to the motor vehicle 10 using at least two proximity sensors 122 configured to detect the hardware token 230, 231 in proximity to the motor vehicle 10. The method continues with the step of granting or rejecting access to the motor vehicle 10 via the at least one closure panel 12, 17, 19, 106 based on the authorization provided by a hardware token 230, 231 associated with and carried by the user 109 and the location of the user 109 relative to the motor vehicle 10.
As discussed above, the at least two proximity sensors 122 can include a first sensor 122 disposed at a first sensor position (0,0) on the motor vehicle 10 and a second sensor 122 disposed at a second sensor position (0,I) on the motor vehicle 10. The first sensor position (0,0) is a sensor spacing distance 1 from the second sensor position (0,I). So, according to an aspect, the method further includes the step of 2404 determining a first distance d1 between the user 109 and the first sensor position (0,0) and a second distance d2 between the user 109 and the second sensor position (0,I). The method continues by 2406 defining a first circle with a first radius of the first distance d1 and a second circle with a second radius of the second distance d2. The first circle and the second circle intersecting at two intersection points (X,Y1) and (X, −Y1). The method additionally includes the step of 2408 determining the location of the user 109 relative to the motor vehicle 10 based on the two intersection points (X,Y1) and (X, −Y1).
Still referring to
Again, the plurality of valid access zones 2320, 2322, 2324, 2326 are defined around the motor vehicle 10. So, the step of 2412 inferring the intent of the user 109 to access the motor vehicle 10 based on the at least one of the approach trajectory and the non-identifying biometric information and the non-identifying biomechanical information can include the step of 2416 inferring the intent of the user 109 to access the motor vehicle 10 based on the user 109 approaching the motor vehicle 10 in one of the plurality of valid access zones 2320, 2322, 2324, 2326. The method further includes the step of 2418 reading stored access zone information defining the plurality of valid access zones 2320, 2322, 2324, 2326. The method continues with the step of 2420 comparing the approach trajectory and location of the user 109 to the stored access zone information. The method also includes the step of 2422 granting or rejecting access to the motor vehicle 10 via the closure panel 12, 17, 19, 106 based on the authorization and the comparison of the approach trajectory and location of the user 109 to the stored access zone information.
According to an aspect, the method also includes the step of determining a location of the user 109 relative to the motor vehicle 10 and whether the user is approaching the motor vehicle 10 within one of the plurality of valid access zones 2320, 2322, 2324, 2326 using at least one proximity sensor 122 configured to sense the user 109 in one of a plurality of valid access zones 2320, 2322, 2324, 2326 defined around the motor vehicle 10. The method continues with the step of detecting at least one obstacle in proximity to the motor vehicle 10 using at least one non-contact obstacle detection sensor 122a, b configured to detect the at least one obstacle and modifying a functionality associated with the plurality of valid access zones 2320, 2322, 2324, 2326 to a modified access functionality based on detection of the at least one obstacle in proximity to the motor vehicle 10. The method also includes the step of controlling an access system 20, 110, 160 of the motor vehicle 10 associated with the at least one closure panel 12, 17, 19, 106 based on the location of the user 109 relative to the motor vehicle 10 and whether the user is within one of the plurality of valid access zones 2320, 2322, 2324, 2326 and the modified access functionality.
Referring back to
As discussed, the at least one proximity sensor 122 includes a optical sensor 122d configured to detect facial landmarks of a face of the user 109 corresponding to an intent of the user 109 to access the motor vehicle 10 and an ultra wideband sensor 122g configured to sense the user 109 in one of the plurality of valid access zones 2320, 2322, 2324, 2326. So, the method further includes the step of determining whether the user 109 is within one of the plurality of valid access zones 2320, 2322, 2324, 2326 using the ultra wideband sensor 122g. The method also includes the step of inferring the intent of the user 109 based on the facial landmarks of the face of the user 109 and whether the user 109 is within one of the plurality of valid access zones 2320, 2322, 2324, 2326 and control the access system 20, 110, 160 accordingly.
Clearly, changes may be made to what is described and illustrated herein without, however, departing from the scope defined in the accompanying claims. The foregoing description of the embodiments has been provided for purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure. Individual elements or features of a particular embodiment are generally not limited to that particular embodiment, but, where applicable, are interchangeable and can be used in a selected embodiment, even if not specifically shown or described. The same may also be varied in many ways. Such variations are not to be regarded as a departure from the disclosure, and all such modifications are intended to be included within the scope of the disclosure.
The terminology used herein is for the purpose of describing particular example embodiments only and is not intended to be limiting. As used herein, the singular forms “a,” “an,” and “the” may be intended to include the plural forms as well, unless the context clearly indicates otherwise. The terms “comprises,” “comprising,” “including,” and “having,” are inclusive and therefore specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. The method steps, processes, and operations described herein are not to be construed as necessarily requiring their performance in the particular order discussed or illustrated, unless specifically identified as an order of performance. It is also to be understood that additional or alternative steps may be employed
When an element or layer is referred to as being “on,” “engaged to,” “connected to,” or “coupled to” another element or layer, it may be directly on, engaged, connected or coupled to the other element or layer, or intervening elements or layers may be present. In contrast, when an element is referred to as being “directly on,” “directly engaged to,” “directly connected to,” or “directly coupled to” another element or layer, there may be no intervening elements or layers present. Other words used to describe the relationship between elements should be interpreted in a like fashion (e.g., “between” versus “directly between,” “adjacent” versus “directly adjacent,” etc.). As used herein, the term “and/or” includes any and all combinations of one or more of the associated listed items.
Although the terms first, second, third, etc. may be used herein to describe various elements, components, regions, layers and/or sections, these elements, components, regions, layers and/or sections should not be limited by these terms. These terms may be only used to distinguish one element, component, region, layer or section from another region, layer or section. Terms such as “first,” “second,” and other numerical terms when used herein do not imply a sequence or order unless clearly indicated by the context. Thus, a first element, component, region, layer or section discussed below could be termed a second element, component, region, layer or section without departing from the teachings of the example embodiments.
Spatially relative terms, such as “inner,” “outer,” “beneath,” “below,” “lower,” “above,” “upper,” and the like, may be used herein for ease of description to describe one element or feature's relationship to another element(s) or feature(s) as illustrated in the figures. Spatially relative terms may be intended to encompass different orientations of the device in use or operation in addition to the orientation depicted in the figures. For example, if the device in the figures is turned over, elements described as “below” or “beneath” other elements or features would then be oriented “above” the other elements or features. Thus, the example term “below” can encompass both an orientation of above and below. The device may be otherwise oriented (rotated 90 degrees or at other orientations) and the spatially relative descriptors used herein interpreted accordingly.
This application is a continuation-in-part of U.S. application Ser. No. 18/097,017 filed Jan. 18, 2023, which claims the benefit of U.S. Provisional Application No. 63/300,331 filed Jan. 18, 2022. This application also claims the benefit of U.S. Provisional Application No. 63/337,390 filed May 2, 2022. The entire disclosures of the above applications are incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
63300331 | Jan 2022 | US | |
63337390 | May 2022 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 18097017 | Jan 2023 | US |
Child | 18131970 | US |