Patent Application
20230298200
The present invention relates to a system for controlling actuators based on pedal positions in a vehicle. The present invention also relates to a vehicle comprising such a system. The present invention further relates to a method for controlling actuators based on pedal positions in a vehicle. Additionally, the present invention relates to a computer program, to a computer readable medium, and to a control unit.
The invention can be applied in heavy-duty vehicles, such as trucks, buses and construction equipment. The invention can also be applied in light-duty and medium-duty vehicles. Although the invention will mainly be described with respect to a heavy-duty vehicle, the invention is not restricted to this particular vehicle, but may also be used in other vehicles such as passenger cars.
In modern vehicles, the position of a pedal may be detected by a dedicated pedal position sensor. For example, there is a one sensor for the accelerator pedal, another sensor for the brake pedal and yet another sensor for the clutch pedal. As a driver presses a pedal, the associated sensor will detect the movement of the pedal and send a sensor signal to a control unit, and the control unit will then send an actuator signal to an associated actuator. An example of such a sensor is, for instance, a resistive type sensor using a potentiometer. A drawback of such a sensor is its degradation over time. In other words, it will become mechanically worn and will therefore become less accurate.
US 2003/067215 A1 discloses an infrared sensor mounted in the pedal which measures the distance from the pedal to an approaching foot of the driver. It also discloses another sensor that senses the distance between the pedal and a splashboard. While these sensors may reduce the risk of mechanical wear of the sensors and therefore reduce the risk of degradation over time, there is still room for improvement.
An object of the present invention is to provide system and a method which at least partly provide an improvement over the prior art. This and other objects, which will become apparent in the following disclosure, are accomplished by a system and a method as defined in the accompanying independent claims. Some non-limiting exemplary embodiments are presented in the dependent claims.
The inventors have realized that by using a camera which captures an image of two or more pedals, which captured image may be analysed by a control unit, the positions of the different pedals may effectively be determined. Thus, multiple sensors may be eliminated by using a single image-capturing camera. In this way, the risk of mechanical wear is reduced. In addition, the number of components may be reduced, since a single camera can capture an image which includes more than one pedal, while the prior art IR sensor technology is based on measuring the time for a transmitted wave to propagate and be reflected back to the sensor, and therefore requiring one sensor for each pedal.
According to a first aspect of the invention, there is provided a system for controlling actuators based on pedal positions in a vehicle, the system comprising:
By providing a camera which captures an image that shows two or more pedals, the control unit can control the associated actuators for all those pedal even though only one camera is used. For instance, if a driver presses the clutch pedal and the brake pedal at the same time, a control in a system of the present inventive concept would detect that both pedals have been pressed even though only one camera is used, as the camera and the resulting image provided by the camera covers both/all pedals.
It should be understood that the image provided by the camera to the control unit may suitably be in digital form, i.e. a digital image. Thus, the control unit may suitably analyse a digital image rather than an analogue image.
It should be understood that the actual controlling of the actuators, once the pedal positions have been determined, may be performed in any conventional way. Typically, the control unit may be configured to send an output/actuating signal to the respective actuator. For instance, if the control unit determines that the accelerator pedal has been pressed, then an accelerator output signal is sent to the actuator associated with the accelerator pedal. Similarly, a brake output signal and a clutch output signal, may in the event of the brake pedal and the clutch pedal being pressed, be send to a respective associated actuator. The actuators may be conventional actuators. For instance, the actuator associated with the accelerator pedal may comprise a motor that receives the output signal from the control unit, which motor moves a throttle valve to an appropriate position based on the output signal from the control unit.
As mentioned above, the control unit is configured to determine the current position of the pedal relative to a fixed structure in the vehicle or relative to a reference position of the pedal. A fixed structure may be any suitably structure that is intended to be still in the vehicle. For instance, such a fixed structure may be a base plate connected to the pedal. The pedal may be movably connected to such a fixed based plate. However, other fixed structures are also conceivable, such as a panel, rails, etc. The fixed structure may suitably be provided with a distinguishable point or area, which the control unit can identify in the provided image. Similarly the pedal may suitably be provided with a distinguishable point or area, which the control unit can identify in the provided image. In such cases, the control unit may analyse the image and determine the distance between the point on the pedal and the point on the fixed structure.
From the above it can be understood that, according to at least one exemplary embodiment, the camera is configured to capture an image containing two or more pedals in a vehicle, and also containing at least one fixed structure, and to provide the image to the control unit, wherein the control unit is configured to determine for each pedal, based on the provided image containing the pedals and the fixed structure, the current position of the pedal, and to control an actuator associated with the pedal based on the determined position.
Instead of comparing the position of the pedal relative to a fixed structure, the control unit may, in at least some exemplary embodiments compare the current position of the pedal relative to a reference position of the pedal. Such a reference position may, for instance, be the original non-pressed position of the pedal, i.e. the position of the pedal before it is pressed by a driver's foot. For example, when manufacturing the vehicle or when installing the system of the present disclosure in a vehicle, an initial reference image may be taken by the camera and stored in an electronic memory. Later on, in use, the control unit will be able to compare the initial reference image with new captured images to determine the position of each pedal.
The control unit may include a microprocessor, microcontroller, programmable digital signal processor or another programmable device. The control unit may also, or instead, include an application specific integrated circuit, a programmable gate array or programmable array logic, a programmable logic device, or a digital signal processor. Where it includes a programmable device such as the microprocessor, microcontroller or programmable digital signal processor mentioned above, the processor may further include computer executable code that controls operation of the programmable device.
According to at least one exemplary embodiment, for each pedal, the control unit is configured to:
Thus, the control unit may search for a predefined point in the provided image, the predefined point being an identifier used for determining the position of the pedal. Such a predefined point or identifier may be a distinguishable structure in the main pedal material itself, or it may be an item, marking, etch that has been connected at a certain location of the pedal. The control unit detects the position of the predefined point (identifier) and determines its position in the image. The control unit can then, in some exemplary embodiments, compare this position in the image with the position of the fixed structure, and thereby calculate the position of the pedal relative to the fixed structure, and then control the actuator based on this calculation. In other exemplary embodiments, the control unit may compare the determined position of the predefined point with a reference position of the predefined point (the reference position being stored in an electronic memory), and thereby calculate the pedal position and control the associated actuator based on this calculation. Using two or more predefined points on each pedal, and determining the positions of those points, will provide more confidence in the calculations made by the control unit.
From the above, it should be understood that the image does not necessarily need to include the entire pedal. What is important in the above mentioned exemplary embodiments, is that at least the part of the pedal that presents the predefined point (identifier), is included in the image. Thus, in the context of this disclosure, it should be understood that the fact that the camera is configured to capture an image containing two or more pedals encompasses that the entire pedals are included in the image or portions of the pedals are included in the image. Furthermore, it may be conceivable that one pedal is fully included while only a portion of another pedal is included in the image.
According to at least one exemplary embodiment, the camera is configured to capture and provide a sequence of images, wherein for at least one of said pedals, the control unit is configured to:
By comparing the position of the pedal in two or more sequential images a movement of the pedal is detectable. The camera may typically be a high-speed camera capable of achieving thousands of frames per second, or even more.
According to at least one exemplary embodiment, one of said pedals is a brake pedal, wherein the control unit is configured to send an emergency brake signal to a brake actuator associated with the brake pedal when the detected positional change per unit of time exceeds a predetermined threshold.
Thus, when the control unit detects a fast depressing of the brake pedal it will send an emergency brake signal to the brake actuator in order to urgently decelerate the vehicle. The predetermined threshold is suitably selected so that it is clearly separated from ordinary controlled braking under normal driving conditions, such as braking when approaching a red light or start/stop scenarios when driving through city traffic, etc. According to at least one exemplary embodiment, said camera is a thermographic camera configured to capture and create images by using infrared radiation emitted from said pedals. This is advantageous because thermographic cameras do not require any ambient brightness and operate just as well at night as in daytime.
As has already been mentioned above, the position of the pedal may be determined in different ways, such as relative to a fixed structure, or relative to reference position of the pedal itself. This different exemplary options will briefly be discussed below.
According to at least one exemplary embodiment, at least one of the pedals is connected to a base plate, wherein said fixed structure comprises said base plate, wherein the control unit is configured to determine for said at least one of the pedals, based on the provided image, the position of the pedal relative to its connected base plate. Thus, the image captured by the camera may suitably contain both the pedal and the base plate. The control unit may therefore from a single image determine the distance between the pedal and the base plate. The control unit may suitably translate the distance into a certain actuator signal. For instance, in case of the pedal being an accelerator pedal, the smaller the distance, the larger the acceleration request. The correspondence between different distances and different requested output values to which the distances are translated may, for instance, be provided in a look-up table accessible by the control unit, or calculated by the control unit using a mathematical formula.
According to at least one exemplary embodiment, the system comprises an electronic memory in which a reference image is stored, the reference image containing said two or more pedals when they are in their respective non-pressed original positions, wherein the control unit comprises or has access to said electronic memory, wherein the control unit is configured to determine the position of each pedal by comparing the captured image provided by the camera with said reference image. This is advantageous as the control unit does not need to look for a fixed structure. Thus, this exemplary embodiment may advantageously be used for pedals without base plates, such as suspended type pedals. However, this exemplary embodiment may, of course, be implemented for any type of pedal, i.e. also for those connected to a base plate.
According to at least one exemplary embodiment, the camera is configured to capture an image containing an accelerator pedal and a brake pedal, wherein the control unit is configured to:
Since the control unit receives an image that contains two or more pedals, such as the above exemplified accelerator pedal and brake pedal, the control unit may control the respective associated actuators in parallel, if needed. For instance, the captured image contains both the brake pedal and the clutch pedal, the control unit may from the received image determined that the driver has pressed both pedals and therefore actuates both the brake and the clutch actuator, respectively. The image captured by the camera may of course contain three pedals: accelerator pedal, brake pedal and clutch pedal, in which case the control unit may be configured to control all three associated actuators. For instance, according to at least one exemplary embodiment, the captured image further contains a clutch pedal, wherein the control unit is configured to send a clutch actuating signal to a clutch actuator based on the determined position of the clutch pedal.
In addition to controlling the actuators, in at least some exemplary embodiments, the control unit may, when analysing the received image from the camera, be configured to detect foreign objects in the pedal area, and issue a warning signal to alert the driver thereof. Such a warning signal may, for instance, be implemented as a visual warning on a display or a light turned on, etc. or as an audible warning such as a voice message or an audible tone, etc. or a tactile warning such as a vibration discernible by the user's hands, feet, or other body parts.
According to a second aspect of the invention, there is provided a vehicle. The vehicle of the second aspect comprises a system of the first aspect, including any embodiment thereof. The advantages of the vehicle according to the second aspect are largely analogous to the advantages of the system according to the first aspect, including any embodiment thereof.
According to a third aspect of the invention, there is provided a computer-implemented method for controlling actuators based on pedal positions in a vehicle, the method comprising:
The advantages of the method of the third aspect largely correspond to the advantages of the system of the first aspect, including any embodiment thereof.
Some exemplary embodiments of the method of the third aspect are listed below.
According to at least one exemplary embodiment, the method comprises:
According to at least one exemplary embodiment, the method comprises:
According to a fourth aspect of the present invention, there is provided a computer program comprising program code means for performing the steps of the method according the third aspect, including any embodiment thereof, when said program is run on a computer. The advantages of the computer program of the fourth aspect are largely analogous to the advantages of the method of the third aspect, including any embodiment thereof.
According to a fifth aspect of the present invention, there is provided a computer readable medium carrying a computer program comprising program code means for performing the steps of the method according to the third aspect, including any embodiment thereof, when said program product is run on a computer. The advantages of the computer readable medium of the fifth aspect largely correspond to the advantages of the method of the third aspect, including any embodiment thereof.
According to a sixth aspect of the present invention, there is provided a control unit for controlling actuators based on pedal positions in a vehicle, the control unit being configured to perform the steps in the method according to the third aspect, including any embodiment thereof. The advantages of the control unit of the sixth aspect are largely analogous to the advantages of the method of the third aspect, including any embodiment thereof.
Generally, all terms used in the claims are to be interpreted according to their ordinary meaning in the technical field, unless explicitly defined otherwise herein. All references to “a/an/the part, element, portion, component, arrangement, device, means, step, etc.” are to be interpreted openly as referring to at least one instance of the part, element, portion, component, arrangement, device, means, step, etc., unless explicitly stated otherwise. The steps of any method disclosed herein do not have to be performed in the exact order disclosed, unless explicitly stated. Further features of, and advantages with, the present inventive concept will become apparent when studying the appended claims and the following description. The skilled person realizes that different features of the present inventive concept may be combined to create embodiments other than those described in the following, without departing from the scope of the present inventive concept.
With reference to the appended drawings, below follows a more detailed description of embodiments of the invention cited as examples.
In the drawings:
The invention will now be described more fully hereinafter with reference to the accompanying drawings, in which certain aspects of the invention are shown. The invention may, however, be embodied in many different forms and should not be construed as limited to the embodiments and aspects set forth herein; rather, the embodiments are provided by way of example so that this disclosure will be thorough and complete, and will fully convey the scope of the invention to those skilled in the art. Accordingly, it is to be understood that the present invention is not limited to the embodiments described herein and illustrated in the drawings; rather, the skilled person will recognize that many changes and modifications may be made within the scope of the appended claims. Like reference numerals refer to like elements throughout the description.
Although it is known to use a control unit which translates pedal sensor signals into actuating signals for controlling the corresponding actuators, the general inventive concept achieves it in a new and efficient way, eliminating the need for individual sensors for each pedal.
The system 10 of the present general inventive concept uses a single camera 30 for capturing an image 40 containing all the pedals 12, 14, 16 (or containing portions of all the pedals 12, 14, 16). The captured imaged 40 is provided to a control unit 50 for analysis. Thus, the system 10 of
The base plate 72 in
As illustrated in
When the control unit has identified the predefined points 80 in the image received from the camera 30 and determined their positions in the image, the control unit may, based on these determined positions, calculate the position of each pedal 60, 70. In the example of
With reference to
Turning now to
Particularly, the processing circuitry 810 is configured to cause the control unit 50 to perform a set of operations, or steps, such as the method discussed in connection to
The storage medium 830 may also comprise persistent storage, which, for example may be any single one or combination of magnetic memory, optical memory, solid state memory or even remotely mounted memory.
The control unit 50 may further comprise an interface 820 for communications with at least one external device such as the camera 30 and the actuators 22, 24, 26 discussed herein. As such, the interface 820 may comprise one or more transmitters and receivers, comprising analogue and digital components and a suitable number of ports for wireline or wireless communication.
The processing circuitry 810 controls the general operation of the control unit 50, e.g. by sending data and control signals to the interface 820 and the storage medium 830, by receiving data and reports from the interface 820, and by retrieving data and instructions form the storage medium 830. Other components, as well as the related functionality, of the control unit 50 are omitted in order not to obscure the concepts presented herein.
| Number | Date | Country | Kind |
|---|---|---|---|
| 22162339.0 | Mar 2022 | EP | regional |
