Patent Grant
10549696
The present application claims priority from Japanese Patent Application No. 2017-089690, which was filed on Apr. 28, 2017, the disclosure of which is herein incorporated by reference in its entirety.
The following disclosure relates to an image display apparatus configured to take an image representing a view outside a vehicle and display the taken image on a display.
There is known an image display apparatus installed in a vehicle and including: a camera configured to take images representing lateral sides and a rear side of the vehicle; and a display configured to display an image taken by the camera, as disclosed in Patent Document 1 (Japanese Patent Application Publication No. 2016-220011), Patent Document 2 (Japanese Patent Application Publication No. 2009-083613), Patent Document 3 (Japanese Patent Application Publication No. 2007-148618), and Patent Document 4 (Japanese Patent Application Publication No. 2009-040113).
An image display apparatus is normally configured such that a camera and a display are active when an ignition switch is in an ON state, and the camera and the display are not active when the ignition switch is in an OFF state. In this image display apparatus, the display is not active when an occupant gets out of the vehicle after stopping the vehicle and changing the ignition switch into the OFF state. Thus, when getting out of the vehicle, the occupant cannot view the image representing the lateral sides and the rear side of the vehicle, leading to difficulty in checking the lateral sides and the rear side of the vehicle.
Accordingly, an aspect of the disclosure relates to an image display apparatus configured to display a taken image on a display before an occupant gets out of a vehicle.
In one aspect of the disclosure, an image display apparatus, comprises: a plurality of cameras each configured to take an image representing a view outside a vehicle; a plurality of displays each configured to display the image taken by a corresponding one of the plurality of cameras; and a controller configured to control the plurality of cameras and the plurality of displays, wherein the controller is configured to: detect a first action that is a preliminary action taken by an occupant of the vehicle to get out of the vehicle in a state in which the plurality of cameras and the plurality of displays are not activated; and when the first action is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
It is possible to display a taken image on a display before an occupant gets out of a vehicle.
There will be described by way of examples forms of inventions recognized to be claimable by the present applicant. The inventions may be hereinafter referred to as “claimable inventions” and include at least the invention as defined in the appended claims. However, the inventions may further include an invention of a concept subordinate or superordinate to the concept of the invention defined in the appended claims, and/or an invention of a concept different from the concept of the invention defined in the appended claims. The forms are numbered like the appended claims and depend from another form or forms, where appropriate, for easy understanding of the invention. It is to be understood that combinations of features of the claimable inventions are not limited to those of the following forms. That is, the claimable inventions are to be construed by taking account of, e.g., the description following each form, the description of the embodiments, and conventional techniques, and as long as the claimable inventions are constructed in this way, any one of the following forms may be implemented with one or more features added, or one or more of a plurality of features included in any one of the following forms are not necessarily provided all together.
(1) An image display apparatus, comprising:
a plurality of cameras each configured to take an image representing a view outside a vehicle;
a plurality of displays each configured to display the image taken by a corresponding one of the plurality of cameras; and
a controller configured to control the plurality of cameras and the plurality of displays,
wherein the controller is configured to:
detect a first action that is a preliminary action taken by an occupant of the vehicle to get out of the vehicle in a state in which the plurality of cameras and the plurality of displays are not activated; and
when the first action is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The preliminary action taken by the occupant of the vehicle to get out of the vehicle may be hereinafter referred to as “getting-out preliminary action”. This getting-out preliminary action is taken after each of a plurality of the cameras and a plurality of the displays is changed to an OFF state by the occupant and before an action taken by the occupant getting out of the vehicle. For example, in the case where a sensor for detecting that the occupant is seated on a seat of the vehicle is provided, the sensor detects a change from a state in which the occupant is seated on the seat to a state in which the occupant is not seated on the seat, and when the state in which the occupant is not seated on the seat has continued for greater than or equal to a predetermined period, the getting-out action taken by the occupant getting out of the vehicle is detected. An action taken before this getting-out action (before the change to the state in which the occupant is not seated on the seat) is the getting-out preliminary action. Also, the getting-out preliminary action is taken in a state in which the vehicle is at rest and a state in which an engine or motors for driving the vehicle are not operated. Accordingly, the getting-out preliminary action is taken after an ignition switch is switched from its ON state to its OFF state and before the getting-out action taken by the occupant getting out of the vehicle is detected (before the change to the state in which the occupant is not seated on the seat), for example. Examples of the getting-out preliminary action include: an action taken by the occupant in advance of the getting-out action; and an action of equipment of the vehicle. The action taken by the occupant in advance of the getting-out action includes an operation performed by the occupant on the equipment of the vehicle. Examples of the operation include: an action of pressing a component for unfastening a seatbelt for getting out of the vehicle; and an action of pulling an inside handle for opening a door. Examples of the action of the equipment of the vehicle include: an action of, for getting out of the vehicle, changing a state of the seatbelt from a fastened state to an unfastened state; and an action of changing a state of the door from a closed state to an open state. In the present image display apparatus, when the first action as the getting-out preliminary action is detected, the controller activates at least one of the deactivated cameras and at least one of the deactivated displays. Thus, the image taken by the camera is displayed on the display before the occupant gets out of the vehicle. This configuration enables the occupant to check surroundings of the vehicle by viewing the image taken by the camera before getting out of the vehicle.
(2) The image display apparatus according to the above form (1), wherein the controller is configured to:
detect a second action of causing a change in a state of a door of the vehicle from a closed state to an open state as the first action in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the second action is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
In the configuration described above, the controller detects that the door is changed from the closed state to the open state, by detecting the second action. Here, the closed state of the door refers to a state in which the door is completely closed. A state of the door in which the door is open from the closed state even a little (i.e., a door-ajar state) is an open state. Thus, the controller detects the state in which the door is open from the closed state even a little. When this state is detected, the controller activates at least one of the cameras and at least one of the displays and displays the taken image before the occupant gets out of the vehicle. This configuration enables the occupant to view the taken image before getting out of the vehicle.
(3) The image display apparatus according to the above form (1), wherein the controller is configured to:
detect a third action for opening a door of the vehicle as the first action in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the third action is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The third action for opening the door of the vehicle is an action taken when opening the door. Examples of the third action include: an action of unlocking the door; an action of touching the inside handle of the door; an action of pulling the inside handle of the door; and an action of pushing the door from the inside toward the outside of the vehicle. In the present image display apparatus, when having detected the action, the controller activates at least one of the cameras and at least one of the displays and displays the taken image. This configuration enables the occupant to view the taken image before getting out of the vehicle.
(4) The image display apparatus according to the above form (1), wherein the controller is configured to:
detect a fourth action taken by the occupant to move off a seat of the vehicle as the first action in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the fourth action is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The fourth action for the occupant to move off the seat is taken when the occupant moves off the seat. Examples of the fourth action include: an action of changing seating pressure applied from the occupant to the seat; an action of unlocking the seatbelt; and an action of changing the door to the open state. In the present image display apparatus, when the action is detected, the controller activates at least one of the cameras and at least one of the displays and displays the taken image. This configuration enables the occupant to view the taken image before getting out of the vehicle.
(5) The image display apparatus according to the above form (1), wherein the controller is configured to:
detect a first operation performed on equipment of the vehicle by the occupant to get out of the vehicle as the first action in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the first operation is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The first operation is performed for the equipment of the vehicle by the occupant to get out of the vehicle. It is noted that the equipment of the vehicle is a structure or a component installed on the vehicle. When the equipment is operated by the occupant, the structure and/or another or other structures are operated. The inside handle for opening the door of the vehicle is one example of the equipment of the vehicle. When the inside handle is operated, the door mechanically coupled to the inside handle is changed from the closed state to the open state, for example. A switch for detecting a pressing operation performed by the occupant is another example of the equipment of the vehicle. When the switch is operated, this operation is electrically detected. The controller based on this detection drives actuators such as motors to operate components or devices to be operated. Thus, the operation for the equipment of the vehicle by the occupant causes mechanical operations and/or electric operations of the components or devices to be operated. Examples of the first operation include: an operation of pushing a component for unlocking the door; an operation of pushing a component for unlocking the seatbelt; an operation of pulling the inside handle of the door; and an operation of pushing or pulling a switch (a component) for changing the door from the closed state to the open state. In the present image display apparatus, when the operation is detected, the controller activates at least one of the cameras and at least one of the displays and displays the taken image. This configuration enables the occupant to view the taken image before getting out of the vehicle.
(6) The image display apparatus according to the above form (3), wherein the controller is configured to:
detect a second operation performed on equipment of the vehicle by the occupant to open the door in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the second operation is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The second operation is performed by the occupant to open the door. Examples of the second operation include: the operation of pushing the component for unlocking the door; the operation of pulling the inside handle of the door; an operation of pushing a switch (a component) for changing the door from the closed state to the open state; and an operation of pushing the door from the inside toward the outside of the vehicle. In the present image display apparatus, when the operation is detected, the controller activates at least one of the cameras and at least one of the displays and displays the taken image. This configuration enables the occupant to view the taken image before getting out of the vehicle.
(7) The image display apparatus according to the above form (4), wherein the controller is configured to:
detect a third operation performed on equipment of the vehicle by the occupant to move off the seat in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the third operation is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The third operation is performed by the occupant to move off the seat. Examples of the third operation include: the operation of pushing the component for unlocking the seatbelt; the operation of pushing the component for unlocking the door; and an operation for opening the door. In the present image display apparatus, when the operation is detected, the controller activates at least one of the cameras and at least one of the displays and displays the taken image. This configuration enables the occupant to view the taken image before moving off the seat.
(8) The image display apparatus according to any one of the above forms (1) through (7), wherein the controller is configured to:
detect a touch of the occupant on an inside handle of a door of the vehicle in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the touch of the occupant on the inside handle is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The occupant touches the inside handle when the occupant is about to open the door or move off the seat. That is, the touch of the occupant on the inside handle is yet another example of the first action, the second action, the third action, the fourth action, the first operation, the second operation, and the third operation. Accordingly, in the present image display apparatus, by detecting a touch of the occupant on the inside handle, the controller can activate at least one of the cameras and at least one of the displays and display the taken image before the occupant gets out of the vehicle and before the door is changed to the open state.
(9) The image display apparatus according to any one of the above forms (1) through (7), wherein the controller is configured to:
detect a change in a state of a door of the vehicle from a locked state to an unlocked state in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the controller detects the change in the state of the door from the locked state to the unlocked state, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The occupant unlocks the door when the occupant is about to open the door or move off the seat. That is, unlocking of the door is yet another example of the first action, the third action, the fourth action, the first operation, the second operation, and the third operation. Accordingly, in the present image display apparatus, by detecting unlocking of the door, the controller can activate at least one of the cameras and at least one of the displays and display the taken image before the occupant gets out of the vehicle and before the door is changed to the open state.
(10) The image display apparatus according to any one of the above forms (1) through (7), wherein the controller is configured to:
detect a change in a state of a seatbelt for a seat of the vehicle from a locked state to an unlocked state in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the controller detects the change in the state of the seatbelt from the locked state to the unlocked state, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
The occupant unlocks the seatbelt when the occupant is about to open the door or move off the seat. That is, unlocking of the seatbelt is yet another example of the first action, the third action, the fourth action, the first operation, the second operation, and the third operation. Accordingly, in the present image display apparatus, by detecting unlocking of the seatbelt, the controller can activate at least one of the cameras and at least one of the displays and display the taken image before the occupant gets out of the vehicle.
(11) The image display apparatus according to any one of the above forms (1) through (7), wherein the controller is configured to:
detect a change in seating pressure generated by the occupant seated on a seat of the vehicle in the state in which the plurality of cameras and the plurality of displays are not activated; and
when the change in seating pressure generated by the occupant is detected, activate at least one of the plurality of cameras and at least one of the plurality of displays and control the at least one of the plurality of displays to display an image taken by the at least one of the plurality of cameras.
When the occupant is about to open the door or move off the seat, the occupant moves in a state in which the occupant is seated on the seat, so that the seating pressure generated by the occupant changes. That is, the change in seating pressure generated by the occupant seated on the seat is yet another example of the first action, the third action, the fourth action, the first operation, the second operation, and the third operation. Accordingly, in the present image display apparatus, by detecting the change in seating pressure generated by the occupant, the controller can activate at least one of the cameras and at least one of the displays and display the taken image before the occupant gets out of the vehicle.
(12) The image display apparatus according to the above form (1), wherein the controller is configured to, when the first action is detected:
activate (i) a first camera that is at least one of the plurality of cameras and (ii) a first display that is at least one of the plurality of displays which corresponds to the first camera; and
control the first display to display an image taken by the first camera.
In the configuration described above, in the case where the first camera and the first display, for example, are installed at positions close to each other such as a driver-side side-mirror installed position and a driver's-seat-side instrument panel, the first display disposed near the driver's seat displays a taken image representing a view near the driver's seat. This configuration enables the occupant to check a surrounding of the driver's seat of the vehicle by viewing the first display in the same manner as a manner in which the occupant checks the surrounding of the driver's seat of the vehicle by viewing a conventional driver-side side mirror.
The objects, features, advantages, and technical and industrial significance of the present disclosure will be better understood by reading the following detailed description of the embodiments, when considered in connection with the accompanying drawings, in which:
Hereinafter, there will be described embodiments by reference to the drawings.
The controller 20 includes: non-volatile memories such as a CPU, a ROM, and an EEPROM; a RAM; various ICs; and a communication interface. The CPU executes programs stored in the ROM to execute various processings. Devices communicably connected to the controller 20 include the door open/close switches 8, the ignition switch 10, the cameras 22a, 22b, 22c, the displays 24a, 24b, a display 24c, the display switching switch 28, and a multimedia controller 60 which will be described below.
The controller 20 supplies electric power to the cameras 22a, 22b, 22c and obtains taken images from the cameras 22a, 22b, 22c via a plurality of camera connection lines 30. The controller 20 supplies electric power to the cameras 22a and/or 22b via the camera connection lines 30 when the ignition switch 10 is switched to an ON state or when an open state of one of doors of the vehicle 2 is detected based on a signal output from a corresponding one of the door open/close switches 8. When the ignition switch 10 is switched from the ON state to an OFF state, the electric power is stopped from being supplied to the cameras 22a, 22b. The controller 20 and each of the displays 24a, 24b, 24c are connected to each other by a corresponding one of ON/OFF control lines 32 and a corresponding one of image lines 34. Each of the ON/OFF control lines 32 is used when a signal for activating a corresponding one of the displays 24a, 24b, 24c (hereinafter may be referred to as “display activation signal”) is output from the controller 20 to a controller, not illustrated, of the corresponding one of the displays 24a, 24b, 24c. Each of the image lines 34 is used when an image is output from the controller 20 to a corresponding one of the displays 24a, 24b, 24c. When the ignition switch 10 is switched to the ON state or when an open state of one of the doors is detected based on a signal output from a corresponding one of the door open/close switches 8, the controller 20 outputs the display activation signal to the controller of the display 24a and/or 24b. The controller of each of the displays 24a, 24b, 24c activates a corresponding one of the displays 24a, 24b, 24c when having received the display activation signal from the controller 20. When the ignition switch 10 is switched from the ON state to the OFF state or when one of the doors is switched from the open state to a closed state, a signal for deactivating the displays 24a, 24b and/or 24c (hereinafter may be referred to as display deactivation signal) is output from the controller 20.
The battery 12 is connected to the controller 20 via power supply lines 36, 38. A power-supply-line switch 40 is provided on a power supply line 36. When the ignition switch 10 is in the ON state, the power-supply-line switch 40 connects the controller 20 and the battery 12 to each other. When the ignition switch 10 is in the OFF state, the power-supply-line switch 40 interrupts the connection between the controller 20 and the battery 12. The power supply line 38 is what is called a permanent power supply line (+B line) which always connects the controller 20 and the battery 12 to each other. Electric power is always supplied to the controller 20 from the battery 12 via the power supply line 38. That is, the controller 20 is active even in the OFF state of the ignition switch 10.
As illustrated in
As illustrated in
The rear-view-image display device 26 is mounted on a ceiling of the vehicle 2 in the passenger compartment. The rear-view-image display device 26 is located in front of the driver's seat and between the driver's seat and the assistant-driver's seat. The rear-view-image display device 26 includes the display 24c, a mirror surface 44, and a frame 46. The display 24c is smaller in size than the mirror surface 44 and disposed at substantially the center of the mirror surface 44. The display 24c displays a rear-view image taken by the camera 22c. As illustrated in
As illustrated in
The display switching switch 28 is provided at a position at which the rear-view-image display device 26 and the ceiling of the vehicle 2 are connected to each other. The display switching switch 28 sends the controller 20 a signal for switching a display state of the rear-view-image display device 26 between the mirror-surface showing state and the display showing state. The display switching switch 28 is switched between an ON state and an OFF state when the angle of the frame 46 of the rear-view-image display device 26 is changed by the occupant. When operated by the occupant, the frame 46 is turned by a turning mechanism provided on the rear-view-image display device 26.
A holding mechanism is provided on the rear-view-image display device 26. When the frame 46 is held by the holding mechanism at an angle at which the mirror surface 44 reflects the ceiling of the vehicle 2, a contact of the display switching switch 28 is closed, so that the display switching switch 28 is switched to the ON state. When the display switching switch 28 is switched to the ON state, the display state of the rear-view-image display device 26 is switched to the display showing state. When the frame 46 is held by the holding mechanism at an angle at which the mirror surface 44 reflects a view behind the vehicle 2, the contact of the display switching switch 28 is opened, so that the display switching switch 28 is switched to the OFF state. When the display switching switch 28 is switched to the OFF state, the display state of the rear-view-image display device 26 is switched from the display showing state to the mirror-surface showing state.
The multimedia monitor 6 has functions such as Internet communication, a DVD player, a navigation system, and television. The multimedia monitor 6 is connected to the battery 12 via a power supply line 56. A power-supply-line switch 58 is provided on the power supply line 56. In the ON state of the ignition switch 10, the power-supply-line switch 58 connects the multimedia monitor 6 and the battery 12 to each other. In the OFF state of the ignition switch 10, the power-supply-line switch 58 interrupts the connection between the multimedia monitor 6 and the battery 12. Thus, in the ON state of the ignition switch 10, electric power is supplied from the battery 12 to the multimedia monitor 6 via the power supply line 56 to activate the multimedia monitor 6. In the OFF state of the ignition switch 10, the supply of the electric power from the battery 12 to the multimedia monitor 6 is stopped.
The multimedia monitor 6 includes the multimedia controller 60 and a display 24d. The controller 20 and the display 24d are communicably connected to the multimedia controller 60. In the ON state of the ignition switch 10, the multimedia controller 60 displays images or videos on the display 24d. The display 24d is capable of displaying not only a video of television and images relating to the navigation system but also images taken by the cameras 22a, 22b, 22c.
The door open/close switches 8 are provided at a right front door, a left front door, a right rear door, a left rear door, and the back door of the vehicle 2, respectively. Each of the door open/close switches 8 includes a pressing member and a switch casing. The door open/close switches 8 are provided at a peripheral portion of the vehicle 2 which defines openings of the vehicle 2. The switch casing of each of the door open/close switches 8 is embedded in the vehicle 2 at the peripheral portion, and the pressing member is exposed from the vehicle 2 at the peripheral portion. Each of the door open/close switches 8 is always connected to the battery 12 via a power supply line 64. The door open/close switch 8 outputs an ON signal to the controller 20 when the pressing member is pressed into the switch casing. The pressing member is pressed into the switch casing by the door in a state in which the door of the vehicle 2 is completely closed. It is noted that this state may be hereinafter referred to as “closed state”. The pressing member is not pressed in the switch casing when the door of the vehicle 2 is in an open state including a door-ajar state in which the door is open slightly from the closed state. Each of the door open/close switches 8 detects the open state and the closed state of a corresponding one of the doors of the vehicle 2. When the door is in the closed state, the door open/close switch 8 is in an ON state and outputs the ON signal to the controller 20. When the door is switched from the closed state to the open state, the door open/close switch 8 becomes an OFF state and stops outputting the ON signal to the controller 20.
When a button of the ignition switch 10 is pressed by the occupant, the ignition switch 10 is switched between the ON state and the OFF state. In the present embodiment, the ON state of the ignition switch 10 includes an ignition-switch ON state (an IG-ON state) and an accessory-switch ON state (an ACC-ON state).
When the ignition switch 10 is in the ON state, the power-supply-line switches 40, 52, 58 are closed to connect each of the controller 20, the display 24c, and the multimedia monitor 6 to the battery 12. In this state, when the ON state of the ignition switch 10 is detected, the controller 20 supplies electric power from the controller 20 to the cameras 22a, 22b, 22c. Also, when the ON state of the ignition switch 10 is detected, the controller 20 outputs the display activation signal to the displays 24a, 24b via the ON/OFF control lines 32. When the ignition switch 10 is switched to the OFF state, each of the power-supply-line switches 40, 52, 58 interrupts the connection between the battery 12 and a corresponding one of the controller 20, the display 24c, and the multimedia monitor 6. This operation stops the supply of the electric power from the controller 20 to the cameras 22a, 22b, 22c and stops the output of the display activation signal from the controller 20 to the displays 24a, 24b.
There will be next described a process (a taken-image display process) executed by the controller 20 to display taken images on the displays 24a, 24b in the ON state and the OFF state of the ignition switch 10. In the ON state of the ignition switch 10, electric power is supplied from the controller 20 to the cameras 22a, 22b via the respective camera connection lines 30, so that the cameras 22a, 22b take images. Also, the display activation signal is output from the controller 20 to the displays 24a, 24b via the respective ON/OFF control lines 32, and the taken images are output to the displays 24a, 24b via the respective image lines 34. The taken images are displayed on the displays 24a, 24b. This enables the occupant to check lateral sides of the vehicle 2 by viewing the displays 24a, 24b.
Just after the ignition switch 10 is switched from the ON state to the OFF state, the door is in the closed state. Thus, the controller 20 and the door open/close switch 8 are in an ON state (which indicates that the door is in the closed state). In the OFF state of the ignition switch 10, each of the cameras 22a, 22b is in the OFF state, since no electric power is supplied from the controller 20 to the cameras 22a, 22b via the camera connection lines 30. Though the displays 24a, 24b are connected to the battery 12, each of the displays 24a, 24b is in the OFF state because the display deactivation signal is output from the controller 20 when the ignition switch 10 is switched to the OFF state. That is, since no taken images are displayed on the displays 24a, 24b, the occupant cannot check lateral sides of the vehicle 2 by viewing the taken images.
In the OFF state of the ignition switch 10, the door open/close switch 8 stops outputting the ON signal when the door is changed from the closed state to the open state. Based on the stop of the output of the ON signal by the door open/close switch 8, the controller 20 activates the camera and the display corresponding to one of the plurality of doors which is determined to be in the open state. For example, when the controller 20 determines that the right front door is in the open state based on a stop of output of the ON signal by the door open/close switch 8 corresponding to the right front door, the controller 20 supplies electric power to the right camera 22a to control the right camera 22a to take an image representing a view on a right side of the vehicle 2. The controller 20 then outputs the display activation signal to the right display 24a to activate the right display 24a and sends the right display 24a the image taken by the camera 22a. This configuration enables the occupant to check lateral sides and a rear side of the vehicle 2 by viewing the taken image displayed on the display 24a before getting out of the vehicle 2. When the door is switched from the closed state to the open state, the occupant in the vehicle 2 is performing an action for getting out of the vehicle 2. An action of changing the door from the closed state to the open state is one example of a preliminary action for the occupant to get out of the vehicle 2.
There will be next described the taken-image display process in the OFF state of the ignition switch 10 with reference to the flowchart in
The controller 20 at S7 determines, based on the signals output from the door open/close switch 8, whether the door determined at S1 to be changed from the closed state to the open state is changed from the open state to the closed state. When the controller 20 determines that the door is not changed from the open state to the closed state, this flow goes to S9. When the controller 20 determines that the door is changed from the open state to the closed state, this flow goes to S11. The controller 20 at S9 determines whether the particular length of time is elapsed from a time when the taken images are displayed on the displays 24a, 24b. When the controller 20 determines that the particular length of time is not elapsed, this flow returns to S5. When the controller 20 determines that the particular length of time is elapsed, this flow goes to S11. The controller 20 at S11 stops supplying the electric power to the active camera and outputs the display deactivation signal to the active display, and this flow ends.
In the present embodiment as described above, the controller 20 determines whether the door is changed from the closed state to the open state, based on the ON signals output from the door open/close switches 8 provided for the right front door and the left front door of the vehicle 2. When the controller 20 determines that the door is changed from the closed state to the open state, the controller 20 activates the camera and the display corresponding to the door determined to be changed from the closed state to the open state. For example, when the right front door is opened by the occupant, the controller 20 determines that the right front door is switched from the closed state to the open state, based on the stop of output of the ON signal by the door open/close switch 8 provided for the right front door. When the right front door is changed from the closed state to the open state, the right display 24a displays an image taken by the right camera 22a and representing a view on a right side of the vehicle. This configuration enables the occupant to check a right-side situation by viewing the taken image before getting out of the vehicle 2 from the right front door to a right side of the vehicle 2.
There will be next described a second embodiment. In the first embodiment, the controller 20 detects the open state of the right front door or the left front door and activates the camera and the display corresponding to the door changed from the closed state to the open state. In the present second embodiment, when one of the right front door, the left front door, the right rear door, and the left rear door is changed to the open state, the controller 20 activates (i) all the cameras for taking images representing surroundings of the vehicle 2 and (ii) all the displays for displaying the taken images representing the surroundings of the vehicle 2. The configuration of the vehicle 2 in the second embodiment is similar to that of the vehicle 2 in the first embodiment, and an explanation thereof corresponding to
There will be next described the taken-image display process executed by the controller 20 to display taken images on the displays 24a, 24b, 24c, 24d in the ON state and the OFF state of the ignition switch 10. In the ON state of the ignition switch 10, electric power is supplied from the controller 20 to the cameras 22a, 22b, 22c via the respective camera connection lines 30, so that the cameras 22a, 22b, 22c take images. Also, the display activation signal is output from the controller 20 to the displays 24a, 24b, 24c via the respective ON/OFF control lines 32, and the taken images are output to the displays 24a, 24b, 24c via the respective image lines 34. The taken images are displayed on the displays 24a, 24b. This enables the occupant to check lateral sides of the vehicle 2 by viewing the displays 24a, 24b, 24c.
Just after the ignition switch 10 is switched from the ON state to the OFF state, each of the right front door, the left front door, the right rear door, and the left rear door is in the closed state. The controller 20 and the door open/close switches 8 are in an ON state (which indicates that each of the doors is in the closed state). In the OFF state of the ignition switch 10, each of the cameras 22a, 22b, 22c is in the OFF state since no electric power is supplied from the controller 20 to the cameras 22a, 22b, 22c via the camera connection lines 30. Though the displays 24a, 24b, 24c are connected to the battery 12, each of the displays 24a, 24b, 24c is in the OFF state because the display deactivation signal is output from the controller 20 when the ignition switch 10 is switched to the OFF state. That is, since no taken images are displayed on the displays 24a, 24b, 24c, the occupant cannot check lateral sides of the vehicle 2 by viewing the taken images.
In the OFF state of the ignition switch 10, the door open/close switch 8 stops outputting the ON signal when any of the doors is changed from the closed state to the open state. When the controller 20 determines, based on the stop of the output of the ON signal by the door open/close switch 8, that one of the four doors is changed from the closed state to the open state, the controller 20 activates (i) all the cameras for taking images representing surroundings of the vehicle 2 and (ii) all the displays for displaying the taken images representing the surroundings of the vehicle 2. In the case where one of the four doors is changed from the closed state to the open state, there is a possibility that another door is to be also changed to the open state. In the present embodiment, since all the cameras 22a, 22b, 22c and all the displays 24a, 24b, 24c, 24d are activated at the time when one of the four doors is changed from the closed state to the open state, the taken image can be viewed also by an occupant who is about to get out of the vehicle 2 from another door having not changed to the open state yet.
Each of the displays 24a, 24b, 24c may display a corresponding one of the images taken by the respective cameras 22a, 22b, 22c and may display two or three of the images taken by the respective cameras 22a, 22b, 22c at a time. Also, the display 24d may display at least one of the images taken by the respective cameras 22a, 22b, 22c. When the door is switched from the closed state to the open state, the occupant in the vehicle 2 is performing an action for getting out of the vehicle 2. An action of changing the door from the closed state to the open state is one example of the preliminary action for the occupant to get out of the vehicle 2.
At S27, the controller 20 determines whether each of all the four doors is in the closed state, based on the signals output from the door open/close switches 8. When the controller 20 determines that at least one of the four doors is not in the closed state, this flow goes to S29. When the controller 20 determines that each of all the four doors is in the closed state, this flow goes to S31. At S29, the controller 20 determines whether a particular length of time is elapsed from a time when the taken images are displayed on the displays 24a, 24b, 24c, 24d. When the controller 20 determines that the particular length of time is not elapsed, this flow returns to S25. When the controller 20 determines that the particular length of time is elapsed, this flow goes to S31. At S31, the controller 20 stops supplying electric power to the cameras 22a, 22b, 22c and outputs the display deactivation signal to the displays 24a, 24b, 24c, 24d, and this flow ends.
In the present embodiment as described above, the controller 20 determines whether each of the four doors is changed from the closed state to the open state, based on the ON signals output from the door open/close switches 8 provided for the respective four doors of the vehicle 2. When the controller 20 determines that one of the four doors is changed from the closed state to the open state, the controller 20 activates the cameras 22a, 22b, 22c and the displays 24a, 24b, 24c. For example, in the case where both of occupants seated on the driver's seat and the assistant-driver's seat of the vehicle 2 are to get out of the vehicle 2, when the right front door is opened by the occupant seated on the driver's seat, the controller 20 determines that the right front door is switched from the closed state to the open state, based on the stop of output of the ON signal by the door open/close switch 8 provided for the right front door. When the right front door is changed from the closed state to the open state, not only the display 24a near the driver's seat but also the displays 24b, 24c display the taken images. With this configuration, not only the occupant having opened the right front door but also the occupant seated on the assistant-driver's seat and having not opened the left front door yet can check a situation outside the vehicle 2 by viewing the taken image.
There will be next described a third embodiment. In the first embodiment, when the door of the vehicle 2 is changed from the closed state to the open state, the taken image is displayed on the display 24a or the display 24b. In the third embodiment, in contrast, the taken image is displayed on the display 24a or the display 24b before the door of the vehicle 2 becomes the open state.
The capacitance detectors 104 are respectively provided at inside handles of the right front door, the left front door, the right rear door, and the left rear door of the vehicle 2. Each of the capacitance detectors 104 detects a change in capacitance of electrodes 112 provided at a corresponding one of the inside handles. Each of the capacitance detectors 104 includes the electrodes 112 and a capacitance detecting circuit 114. As illustrated in
Each of the seatbelt lock switches 106 is embedded in a buckle of a seatbelt provided for a corresponding one of a right front seat, a left front seat, a right rear seat, and a left rear seat of the vehicle 102. Each of the seatbelt lock switches 106 detects whether the seatbelt is locked by insertion of a tongue of the seatbelt into the buckle. Each of the seatbelt lock switches 106 is always connected to the battery 12 via a power supply line 118. Thus, the seatbelt lock switches 106 are always active regardless of the state of the ignition switch 10. Each of the seatbelt lock switches 106 is connected to the controller 20 and a buckle-side contact 120 provided on the corresponding buckle. The buckle-side contact 120 outputs a signal to the corresponding seatbelt lock switch 106 upon contacting a tongue-side contact provided on the tongue when the tongue is inserted in the buckle. Upon receiving the signal from the buckle-side contact 120, the seatbelt lock switch 106 outputs a lock signal to the controller 20. When the tongue is pulled out of the buckle, and thereby the buckle-side contact 120 and the tongue-side contact become separated from each other, the buckle-side contact 120 stops outputting the signal, so that the seatbelt lock switch 106 stops outputting the lock signal.
The seating sensors 108 are respectively provided at the right front seat, the left front seat, the right rear seat, and the left rear seat of the vehicle 102. Each of the seating sensors 108 detects a change in capacitance of a plurality of electrodes 122 to detect an action being taken by the occupant seated on the seat. Each of the seating sensors 108 includes the electrodes 122 and a seating-sensor circuit 124. Each of the seating sensors 108 is always connected to the battery 12 via a power supply line 126. Thus, the seating sensors 108 are always active regardless of the state of the ignition switch 10. The electrodes 122 each having an elongated shape are arranged parallel with each other in the seat of the vehicle 2. Capacitance is generated between the electrodes 122 by application of a voltage to the electrodes 122. The magnitude of the capacitance of each of the electrodes 122 increases when a portion of a body of the occupant as a conductor has approached or touched the electrode 122. For example, the electrodes 122 are uniformly arranged over the entire sitting surface of the seat, and the seating sensor 108 is configured to detect a local change in seating pressure on the sitting surface of the seat. That is, when the occupant has performed an action in a state in which the occupant is seated on the seat, some of the electrodes 122 change in capacitance. The seating sensor 108 specifies the electrodes 122, of which capacitance has changed, among the plurality of electrodes 122 to detect a position on the sitting surface of the seat where the seating pressure has changed. The electrodes 122 and the controller 20 are connected to the seating-sensor circuit 124. The seating-sensor circuit 124 outputs a signal relating to the magnitude of the capacitance of each of the electrodes 122, to the controller 20 each time when a specific length of time is elapsed.
The door lock switches 110 are respectively provided at the right front door, the left front door, the right rear door, and the left rear door of the vehicle 2. Each of the door lock switches 110 is provided on a latch mechanism which includes: a latch provided on the corresponding door of the vehicle 2 and a striker provided on a vehicle body. When the door is changed to the closed state and thereby the striker is pushed into the latch, the striker and the latch are engaged with each other to lock the door. When unlocking the door, an actuator disengages the striker and the latch from each other. Each of the door lock switches 110 detects a locked state and an unlocked state of the latch mechanism. The door lock switch 110 is connected to the controller 20 and the battery 12. The door lock switch 110 outputs an ON signal to the controller 20 when the latch mechanism is in the unlocked state. The door lock switch 110 stops outputting the ON signal when the latch mechanism is in the locked state. Each of the door lock switches 110 is always connected to the battery 12 via a power supply line 128. Thus, the door lock switches 110 are always active regardless of the state of the ignition switch 10.
There will be next described the taken-image display process executed by the controller 20 in the ON state and the OFF state of the ignition switch 10. In the ON state of the ignition switch 10, electric power is supplied from the controller 20 to the cameras 22a, 22b via the respective camera connection lines 30, so that the cameras 22a, 22b take images. Also, the display activation signal is output from the controller 20 to the displays 24a, 24b via the respective ON/OFF control lines 32, and the taken images are output to the displays 24a, 24b via the respective image lines 34. The taken images are displayed on the displays 24a, 24b. This enables the occupant to check lateral sides of the vehicle 2 by viewing the displays 24a, 24b.
Just after the ignition switch 10 is switched from the ON state to the OFF state, each of the cameras 22a, 22b is in the OFF state, since no electric power is supplied from the controller 20 to the cameras 22a, 22b via the camera connection lines 30. Though the displays 24a, 24b are connected to the battery 12, each of the displays 24a, 24b is in the OFF state because the display deactivation signal is output from the controller 20 when the ignition switch 10 is switched to the OFF state. That is, since no taken images are displayed on the displays 24a, 24b, the occupant cannot check lateral sides of the vehicle 2 by viewing the taken images.
In the OFF state of the ignition switch 10, when one of the first to fourth conditions described below is satisfied in a state in which none of the first to fourth conditions is satisfied, the controller 20 activates the cameras 22a, 22b and the displays 24a, 24b and displays the taken images on the displays 24a, 24b. The first condition is that the occupant has touched the inside handle. The capacitance detecting circuit 114 outputs the signal relating to the capacitance of the corresponding electrodes 112, to the controller 20 each time when the specific length of time is elapsed. The controller 20 determines, based on the signal output from the capacitance detecting circuit 114 provided for each of the right front door and the left front door, whether the magnitude of the capacitance of the electrodes 112 is greater than or equal to a threshold value. Here, the threshold value of the capacitance is a value for determination, using the magnitude of the capacitance, of whether the inside handle is touched by the occupant. When the magnitude of the capacitance is greater than or equal to the threshold value, the controller 20 determines that the occupant is touching the inside handle. When the magnitude of the capacitance is less than the threshold value, the controller 20 determines that the occupant is not touching the inside handle. Each of an action of causing decrease in the capacitance of the electrodes 112 of the capacitance detector 104 and an action taken by the occupant touching the inside handle is one example of a preliminary action taken by the occupant for getting out of the vehicle 102.
The second condition is that the seatbelt has been unlocked. Each of the seatbelt lock switches 106 outputs the lock signal when the seatbelt is locked, with the tongue inserted in the buckle. The seatbelt lock switch 106 stops outputting the lock signal when the seatbelt is unlocked by pulling of the tongue out of the buckle. The controller 20 determines whether the seatbelt is unlocked, for each of the right front seat and the left front seat. Each of an action of unlocking the seatbelt and an operation of the occupant for unlocking the seatbelt is another example of the preliminary action taken by the occupant for getting out of the vehicle 102.
The third condition is that the seating pressure has decreased. When the occupant performs an action in the state in which the occupant is seated on the seat, a position of contact between the occupant and the seat changes. This positional change changes the magnitude of the capacitance of each of the electrodes 122 provided in the seat. An action taken by the occupant is detected based on a change in the magnitude of the capacitance of each of the electrodes 122. In the OFF state of the ignition switch 10, the controller 20 detects whether the seating pressure has decreased, by detecting whether the magnitude of the capacitance of the electrodes 122 of each of the seating sensors 108 provided for the right front seat and the left front seat has changed by an amount greater than or equal to a particular value. Each of an action of causing decrease in capacitance of the electrodes 122 of each of the seating sensors 108 and an action taken by the occupant decreasing the seating pressure is yet another example of the preliminary action taken by the occupant for getting out of the vehicle 102.
The fourth condition is that the door is changed to its unlocked state. When the ON signal is output from the door lock switch 110, the door is in the unlocked state in which the door is openable. The controller 20 determines whether each of the right front door and the left front door is changed to an unlocked state. When the door is changed to the unlocked state, the occupant is about to open the door and get out of the vehicle 2. Each of an action of changing the door from the locked state to the unlocked state and an action taken by the occupant changing the door to the unlocked state is yet another example of the preliminary action taken by the occupant for getting out of the vehicle 102.
There will be next described the taken-image display process in the OFF state of the ignition switch 10 with reference to the flowchart in
At S43, the controller 20 determines whether the condition satisfied among the first to fourth conditions is satisfied on a driver's-seat side or an assistant-driver's-seat side. The controller 20 supplies electric power to the camera corresponding to a position for which the condition is satisfied, and outputs the display activation signal to the display corresponding to the camera. For example, regarding the first condition, when the inside handle of the right front door is touched by the occupant, the controller 20 activates the right camera 22a and the right display 24a, and when the inside handle of the left front door is touched by the occupant, the controller 20 activates the left camera 22b and the left display 24b. Regarding the second condition, when the seatbelt at the driver's seat is changed to its unlocked state by the occupant, the controller 20 activates the right camera 22a and the right display 24a, and when the seatbelt at the assistant-driver's seat is changed to the unlocked state by the occupant, the controller 20 activates the left camera 22b and the left display 24b. Regarding the third condition, when the seating pressure generated by the occupant seated on the driver's seat has decreased, the controller 20 activates the right camera 22a and the right display 24a, and when the seating pressure generated by the occupant seated on the assistant-driver's seat has decreased, the controller 20 activates the left camera 22b and the left display 24b. Regarding the fourth condition, when the right front door is changed to the unlocked state by the occupant, the controller 20 activates the right camera 22a and the right display 24a, and when the left front door is changed to the unlocked state by the occupant, the controller 20 activates the left camera 22b and the left display 24b.
At S45, the controller 20 sends the activated display the image taken by the activated camera. The controller 20 at S47 determines whether a particular length of time is elapsed from a time when the taken image is displayed on the active display. When the controller 20 determines that the particular length of time is not elapsed, this flow returns to S45. When the controller 20 determines that the particular length of time is elapsed, this flow goes to S49. At S49, the controller 20 stops supplying the electric power to the active camera and outputs the display deactivation signal to the active display, and this flow ends.
In the present embodiment as described above, the controller 20 determines whether the occupant is performing the preliminary action of getting out of the vehicle 102, based on whether one of the first to fourth conditions is satisfied. When the first condition is satisfied, the controller 20 detects that the occupant is touching the inside handle of the door. When the second condition is satisfied, the controller 20 detects that the seatbelt is changed to the unlocked state. When the third condition is satisfied, the controller 20 detects that the seating pressure generated by the occupant has decreased. When the fourth condition is satisfied, the controller 20 detects that the door is changed to the unlocked state. Each of these detected actions is one example of a preliminary action taken by the occupant for getting out of the vehicle 102. When one of the first to fourth conditions is satisfied, the occupant is about to get out of the vehicle 102. The controller 20 at this time displays the taken image on the display corresponding to a position at which the occupant is seated, whereby before opening the door of the vehicle 102, the occupant can view the taken image representing a view on a side of the vehicle 102 to which the occupant is about to get out.
In the present embodiment, the controller 20 is one example of a controller, and the OFF state of the ignition switch 10 is one example of a state in which the cameras and the displays are not active. A stop of output of the ON signal from the door open/close switch 8 is one example of a first action and a second action. A change in the magnitude of the capacitance detected the capacitance detector 104 to a value greater than the threshold value (i.e., a touch of the occupant on the inside handle) is another example of the first action and the second action and one example of a third action, a fourth action, a first operation, a second operation, and a third operation. A stop of output of the lock signal from the seatbelt lock switch 106 (i.e., unlocking of the seatbelt by the occupant) is yet another example of the first action and another example of the third action, the fourth action, the first operation, the second operation, and the third operation. A change in the magnitude of the capacitance of the electrodes 122 of the seating sensor 108 (i.e., movement of the occupant seated on the seat) is yet another example of the first action, the third action, and the fourth action. An output of the ON signal by the door lock switch 110 (i.e., unlocking of the door by the occupant) is yet another example of the first action, the third action, the fourth action, the first operation, the second operation, and the third operation.
While the embodiments have been described above, it is to be understood that the disclosure is not limited to the details of the illustrated embodiments, but may be embodied with various changes and modifications, which may occur to those skilled in the art, without departing from the spirit and scope of the disclosure. While the controller 20 executes the taken-image display process when one of the first to fourth conditions is satisfied in the third embodiment, the present disclosure is not limited to this configuration. For example, one of the first to fourth conditions may be employed as a condition for execution of the processing at S41 in the taken-image display process. In this case, the controller 20 may execute the taken-image display process when the condition is satisfied, and may not execute the taken-image display process when the condition is not satisfied. While the displays 24a, 24b, 24c display the images taken by the cameras 22a, 22b mounted at the side-mirror installed position and the image taken by the camera 22c mounted on the back door, the present disclosure is not limited to this configuration. The camera only needs to take an image representing a view near the vehicle 2 and only needs to take an image to be checked by the occupant when the occupant gets out of the vehicle 2. For example, the image display apparatus 4 may be configured such that the cameras are mounted near the right rear door and the left rear door to take images representing views near the right rear door and the left rear door, and the taken images are displayed on the displays provided at the right rear seat and the left rear seat.
While the taken images are displayed on the displays 24a, 24b provided on the instrument panel and the display 24c provided on the rear-view-mirror installed position, the present disclosure is not limited to this configuration. The display only needs to be disposed at a position viewable by the occupant. For example, the display may be mounted at a position near the rear seat at which the display is viewable by the occupant seated on the rear seat. While the display 24c is formed on the mirror surface 44 of the rear-view-image display device 26, the present disclosure is not limited to this configuration. The display 24c may be formed as an element of the rear-view-image display device 26 not including the mirror surface.
While the right camera 22a and the right display 24a are activated when the right front door is changed from the closed state to the open state in the first embodiment, the present disclosure is not limited to this configuration. For example, the right camera 22a and the right display 24a may be activated when the door corresponding to the right rear seat is changed from the closed state to the open state. While all the cameras and all the displays are activated when one of the four doors is changed from the closed state to the open state in the second embodiment, the present disclosure is not limited to this configuration. For example, the image display apparatus 4 may be configured such that when the back door or a rear gate is changed from the closed state to the open state, the controller 20 activates (i) the camera 22c configured to take an image representing a view at a rear of the vehicle and (ii) the display 24c configured to display the taken image representing the rear-side view or activates at least two of the cameras and at least two of the displays. The at least two cameras may be all the cameras, and the at least two displays may be all the displays.
While the controller 20 activates the camera and the display corresponding to a satisfied one of the first to fourth conditions in the third embodiment, the present disclosure is not limited to this configuration. For example, when one of the four conditions is satisfied, the controller 20 may activate at least two of the cameras and at least two of the displays. The at least two cameras may be all the cameras, and the at least two displays may be all the displays.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2017-089690 | Apr 2017 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 20030209893 | Breed | Nov 2003 | A1 |
| 20060111819 | Servera Serapio | May 2006 | A1 |
| 20090115846 | Ohue | May 2009 | A1 |
| 20100238288 | Klaerner | Sep 2010 | A1 |
| 20120065858 | Nickolaou | Mar 2012 | A1 |
| 20160152211 | Owens | Jun 2016 | A1 |
| 20170066375 | Kato | Mar 2017 | A1 |
| 20170318267 | Kim | Nov 2017 | A1 |
| 20180086268 | Kochiya | Mar 2018 | A1 |
| 20180137595 | Kim | May 2018 | A1 |
| Number | Date | Country |
|---|---|---|
| 10 2012 004 640 | Sep 2013 | DE |
| 10 2013 000 645 | Apr 2014 | DE |
| 10 2015 009 184 | Jan 2016 | DE |
| 10 2015 106 304 | Oct 2016 | DE |
| 2007-148618 | Jun 2007 | JP |
| 2009-40113 | Feb 2009 | JP |
| 2009-83613 | Apr 2009 | JP |
| 2009-83618 | Apr 2009 | JP |
| 2016-220011 | Dec 2016 | JP |
| WO 2016169912 | Oct 2016 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20180312114 A1 | Nov 2018 | US |
