The present disclosure is based on Japanese Patent Application No. 2012-163830 filed on Jul. 24, 2012, the disclosure of which is incorporated herein by reference.
The present disclosure relates to a vehicular visibility support apparatus that displays an image (video) of a view laterally behind a vehicle, picked up by, for example, a camera, in a display portion.
A conventional vehicular visibility support apparatus is indicated in Patent Literature 1, for example. The visibility support apparatus (vehicle rear view monitoring system) in Patent Literature 1 includes: a rear view camera for picking up an image of the view behind a vehicle; two side view cameras, left side and right side, for picking up an image of the view laterally behind the vehicle; and a display device to display the image picked up by each camera on a monitor screen surface.
An image picked up by the rear view camera is displayed on the monitor screen surface as a bird's-eye view image obtained when the periphery of the vehicle is viewed from a different eye view direction. The display device displays on the monitor screen surface an icon forming a frame shape in an area corresponding to a dead angle produced when an image is picked up with a rear view camera. The images picked up by the side view cameras are reduced or partly cut out and displayed in the icon.
As a result, the images picked up with the side view cameras on the left side and right side of the vehicle are displayed on the single monitor screen surface together with the bird's-eye view image. Therefore, if there is any dangerous object or obstacle behind or beside the vehicle, a driver can easily find the dangerous object or obstacle and avoid it with a leeway.
However, Patent Literature 1 involves an issue. That is, the area for trimming an image taken by a side view camera is any one of an outer area away from a host vehicle; an inner area in proximity to the host vehicle; and an intermediate area between the outer area and the inner area. The displayed image thus exhibits none of a positional reference for the driver viewing the image on the monitor screen surface. This makes it difficult for the driver to instantaneously grasp the positional relation between any laterally rear obstacle or the like in the image and the host vehicle.
In consideration of the above issue, it is an object of the present disclosure to provide a vehicular visibility support apparatus that enables easy understanding of a positional relation between a host vehicle and an image even though such an image is obtained through a trimming manipulation. To achieve the object, the present disclosure adopts the following techniques.
An aspect of the present disclosure is provided to include a camera, an input portion, a control portion, and a display portion. The camera is provided on a side that is a left side or a right side of a vehicle, picks up an image of a view laterally behind the vehicle, and provides a camera image. The input portion accepts an input manipulation performed by an occupant to input a change to a desired region the occupant desires to view in the camera image. The control portion trims the desired region from the camera image based on an input signal generated by the input manipulation with the input portion to provide a trimmed image. The display portion displays the trimmed image trimmed by the control portion. The control portion trims the camera image based on a vertical reference line containing a part of the vehicle in a trimmed image before the input manipulation with the input portion and a horizontal reference line orthogonal to the vertical reference line; and a direction of movement for the change to the desired region inputted to the input portion.
According to the aspect, a trimmed image is changed based on the vertical reference line containing a part of the vehicle in a trimmed image before the input manipulation, the horizontal reference line, and the direction of movement of the desired region. Therefore, the trimmed screen image after the change makes it easy to grasp the positional relation to the host vehicle; furthermore, the association between the trimmed screen image before the change and the trimmed screen image after the change can be easily estimated.
The above and other objects, features and advantages of the present disclosure will become more apparent from the following detailed description made with reference to the accompanying drawings. In the drawings:
Hereafter, a description will be given to a plurality of embodiments for carrying out the present disclosure with reference to the drawings. In the description of each embodiment, items corresponding to items precedently described in relation to a different embodiment will be marked with identical reference numerals and a redundant description thereof may be omitted. When only a part of the configuration of each embodiment is described, the precedent description of a different embodiment can be applied to the other parts of the configuration. Parts of embodiments can be combined when the feasibility of the concrete combination is explicitly stated. Further, even though not explicitly stated, embodiments can also be partly combined as long as the combination does not pose any problem.
A description will be given to a vehicular visibility support apparatus 100 in a first embodiment with reference to
The camera 110 is for picking up an image of the scenery laterally behind the vehicle and provided on each of side faces that are a left side face and a right side face of the vehicle. For example, the present embodiment may be applied to a vehicle of a right-hand drive. Two cameras 110 are provided in front of the front door on the driver seat side (right side of the vehicle) and in front of the front door on the passenger seat side (left side of the vehicle), and each camera 110 is positioned to be near an intermediate position in the vertical direction (near the position of a conventional door mirror). The two cameras 110, left and right, are respectively for picking up images of the laterally rear view on the driver seat side and the laterally rear view on the passenger seat side. The cameras 110 basically each have an identical function; therefore, the following description will be given mainly with the camera 110 provided on the driver seat side.
As illustrated in
When input manipulation is performed by the driver with the input portion 120, a desired region (trimmed image to be described later) the driver desires to view in the camera image can be changed (selected). The input portion 120 is provided, for example, in proximity to the driver seat (steering wheel) in the vehicle compartment. The input portion 120 is provided with a selector switch 121 and a manipulation switch 122.
The selector switch 121 is used to select which camera 110 of the two cameras 110, left and right, to be manipulated. The selector switch 121 is provided with the positions of: “OFF” to prohibit selecting manipulation; “R (Right)” to select the camera 110 on the driver seat side; “L (Left)” to select the camera 110 on the passenger seat side; and “R+L” to select both the cameras 110. Any position can be selected by a lever 121a.
The manipulation switch 122 is used to determine a direction of movement for changing the current position of the desired region in the camera image. The manipulation switch 122 is rectangular and supported at the center and the positions (eight in total) corresponding to the middle point in each side and each corner can be depressed. A position depressed in the manipulation switch 122 is determined as the direction of movement of the desired region. As illustrated in
Selection or manipulation through input manipulation with the selector switch 121 or the manipulation switch 122 is outputted as an input signal to the control portion 130.
The control portion 130 processes (trims) a camera image (video signal) outputted from the camera 110 and is provided, for example, in the instrument panel in front of the driver seat. The control portion 130 receives a camera image from a selected one of the two cameras 110 based on an input signal inputted from the input portion 120 and changes the desired region established in the camera image to a selected direction of movement. The control portion 130 trims the changed desired region from the camera image to generate a trimmed image (video). The control portion 130 then enlarges or reduces the trimmed image to the size of the screen surface of the display 140 and outputs it as a video signal.
A description will be added with reference to
The trimmed image is selected as the driver's desired region in the camera image and shows an area smaller than that of the camera image. The position of the side at the left end of the trimmed image agrees with the position of the side at the left end of the camera image.
In the trimmed image, a vertical reference line V and first to third horizontal reference lines H1 to H3 are defined. The vertical reference line V includes the displayed part of the vehicle and is vertically extended along the side at the left end of the trimmed image. The first to third horizontal reference lines H1 to H3 are orthogonal to the vertical reference line V and the first horizontal reference line H1 is horizontally extended along the side at the upper end of the trimmed image. The second horizontal reference line H2 passes through a central portion of the trimmed image and is horizontally extended. The third horizontal reference line H3 is horizontally extended along the side at the lower end of the trimmed image.
Each of the reference lines V and H1 to H3 may be displayed actually on the display 140 as illustrated in
When the position at the lower left corner of the camera image is taken as the positional reference of the camera image, the dimension H of the trimmed image in the vertical direction is defined as H1−H3. The dimension of the trimmed image in the horizontally direction is set as a predetermined multiple of (for example, 4/3 times) the dimension H in the vertical direction.
The description will be back to
The display 140 displays the trimmed image generated at the control portion 130 as a display image (display video) and is provided in a position clearly visible to the driver, for example, in the instrument panel. The display 140 can be constructed using, for example, a liquid crystal display, or an organic EL display. The display portion of the display 140 is divided into, for example, two display areas, left and right. The right display area shows an image picked up by the camera 110 on the driver seat side and the left display area shows an image picked up by the camera 110 on the passenger seat side.
A description will be given to the action of the visibility support apparatus 100 configured as mentioned up to this point with reference to
It is noted that a flowchart or the processing of the flowchart in the present application includes sections (also referred to as steps), each of which is represented, for instance, as S100. Further, each section can be divided into several sub-sections while several sections can be combined into a single section. Furthermore, each of thus configured sections can be also referred to as a device, module, or means.
When the ignition switch is turned on and power is supplied to the control portion 130 in the flowchart shown in
At S110, subsequently, the control portion 130 performs processing (a switch manipulation process) based on the driver's manipulation with each switch 121, 122 in the input portion 120. The control portion 130 performs the switch manipulation process in accordance with the control flow shown in
At S111, first, the control portion 130 determines whether the input state of the selector switch 121 is on state or off state. The on state cited here is equivalent to a case where the selection (position) of the selector switch 121 is any of “R,” “L,” and “R+L”; and the off state is equivalent to a case where the selection (position) of the selector switch 121 is “OFF.” When it is determined at S111 that the input state is on, the control portion 130, at S112, generates and stores a selector switch flag (R, L, or R+L) corresponding to a selected position.
At S113, subsequently, the control portion 130 determines whether the input state of the manipulation switch 122 is on state or off state. The on state cited here is equivalent to a case where the depressed position in the manipulation switch 122 is any of “1” to “8”; and the off state is equivalent to a case where the manipulation switch 122 has not been manipulated (the switch has been untouched). When it is determined at S113 that the input state is on, the control portion 130, at S114, generates and stores a manipulation switch flag (any of 1 to 8) corresponding to the depressed position.
When it is determined at S113 that the input state of the manipulation switch 122 is off state, the control portion 130, at S115, clears the manipulation switch flag stored up to then. When it is determined at S111 that the input state of the selector switch 121 is off state, the control portion 130, at S116, clears the selector switch flag stored up to then.
The description will be back to
At S130, the control portion 130 performs image trimming processing based on the selector switch flag, the manipulation switch flag, and the present image information (the reference lines V and H1 to H3 in the trimmed image). At S140, the control portion 130 outputs the video signal of the trimmed image generated by the image trimming processing of S130 to the display 140 and causes the display 140 to display the trimmed image. The control portion 130 performs the image trimming processing of S130 in accordance with the control flow shown in
At S1301, first, the control portion 130 determines which one of R, L, and R+L is the selector switch flag and when it is determined that the selector switch flag is R, the control portion 130 proceeds to S1302. At S1302, the control portion 130 determines which one of 1 to 8 is the manipulation switch flag. Then the control portion 130 proceeds to any of S1303, S1306, S1309, S1312, S1315, S1318, S1321, and S1324 according to the determined manipulation switch flag (1 to 8). The control portion 130 changes the position of each reference line H1 to H3 based on each reference line V and H1 to H3 in the present trimmed image and a direction of movement (manipulation switch flag 1 to 8). Further, the control portion 130 generates a new trimmed image at S1327 and at S1328.
A more specific description will be given. When the manipulation switch flag is 1, the control portion 130 proceeds S1303 and performs processing based on the manipulation switch flag 1. Specifically, the control portion 130 performs the processing of the following steps, S1304 and S1305. At S1304, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
The direction of movement of the trimmed image specified by the manipulation switch 122 is 1 (upward); at S1305, the present trimmed image (
When the manipulation switch flag is 2, the control portion 130 proceeds to S1306 and performs processing based on the manipulation switch flag 2. Specifically, the control portion 130 performs the processing of the following steps, S1307 and S1308. At S1307, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 2 (downward); at S1308, the present trimmed image (
When the manipulation switch flag is 3, the control portion 130 proceeds to S1309 and performs processing based on the manipulation switch flag 3. Specifically, the control portion 130 performs the processing of the following steps, S1310 and S1311. At S1310, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 3 (upper rightward); at S1311, the present trimmed image (
When the manipulation switch flag is 4, the control portion 130 proceeds to S1312 and performs processing based on the manipulation switch flag 4. Specifically, the control portion 130 performs the processing of the following steps, S1313 and S1314. At S1313, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 4 (rightward); at S1314, the present trimmed image (
When the manipulation switch flag is 5, the control portion 130 proceeds to S1315 and preforms processing based on the manipulation switch flag 5. Specifically, the control portion 130 performs the processing of the following steps, S1316 and S1317. At S1316, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 3 (lower rightward); at S1317, the present trimmed image (
When the manipulation switch flag is 6, the control portion 130 proceeds to S1318 and performs processing based on the manipulation switch flag 6. Specifically, the control portion 130 performs the processing of the following steps, S1319 and S1320. At S1319, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 3 (upper leftward); at S1319, the present trimmed image (
When the manipulation switch flag is 7, the control portion 130 proceeds to S1321 and performs processing based on the manipulation switch flag 7. Specifically, the control portion 130 performs the processing of the following steps, S1322 and S1323. At S1322, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 4 (leftward); at S1323, the present trimmed image (
When the manipulation switch flag is 8, the control portion 130 proceeds to S1324 and performs processing based on the manipulation switch flag 8. Specifically, the control portion 130 performs the processing of the following steps, S1325 and S1326. At S1325, the control portion 130 reads each reference line V and H1 to H3 in the present trimmed image (
Since the direction of movement of the trimmed image specified by the manipulation switch 122 is 3 (lower leftward); at S1326, the present trimmed image (
At S1327, subsequently, the control portion 130 stores each reference line H1′ to H3′ set at S1305, S1308, S1311, S1314, S1317, S1320, S1323, or S1326 as each reference line H1 to H3.
At S1328, the control portion 130 sets a region determined by the reference line V and each newly set reference line H1, H3 as the region of the new trimmed image. That is, the control portion 130 sets a dimension in the horizontal direction so that the dimension in the horizontal direction is a predetermined multiple of (4/3 times) the dimension in the vertical direction of the new trimmed image defined by H1−H3 (=H1′−H3′). Then the control portion 130 trims the region as a new trimmed image from the camera image.
When the manipulation switch flag is 1 (when the direction of movement is upward), each reference line H1 to H3 is moved upward relative to the vertical reference line V. The region on the upper side of the present trimmed image in
When the manipulation switch flag is 2 (when the direction of movement is downward), each reference line H1 to H3 is moved downward relative to the vertical reference line V. The region on the lower side of the present trimmed image in
When the manipulation switch flag is 3 (when the direction of movement is upper rightward), each reference line H1, H2 is moved upward relative to the vertical reference line V and the third horizontal reference line H3. The regions on the upper side and the right side, that is, the region on the upper right side of the present trimmed image in
When the manipulation switch flag is 4 (when the direction of movement is rightward), the first horizontal reference line H1 is moved upward and the third horizontal reference line H3 is moved downward relative to the vertical reference line V and the second horizontal reference line H2. The regions on the upper side, the lower side, and the right side, broadly the region on the right side of the present trimmed image in
When the manipulation switch flag is 5 (when the direction of movement is lower rightward), the second and third horizontal reference lines H2, H3 are moved downward relative to the vertical reference line V and the first horizontal reference line H1. The regions on the lower side and the right side, broadly the region on the lower right side of the present trimmed image in
When the manipulation switch flag is 6 (when the direction of movement is upper leftward), the second and third horizontal reference lines H2, H3 are moved upward relative to the vertical reference line V and the first horizontal reference line H1. The regions on the right side and the lower side of the present trimmed image in
When the manipulation switch flag is 7 (when the direction of movement is leftward), the first horizontal reference line H1 is moved downward and the third horizontal reference line H3 is moved upward relative to the vertical reference line V and the second horizontal reference line H2. The regions on the upper side, the lower side, and the right side of the present trimmed image in
When the manipulation switch flag is 8 (when the direction of movement is lower leftward), each reference line H1, H2 is moved downward relative to the vertical reference line V and the third horizontal reference line H3. The regions on the upper side and the right side of the present trimmed image in
When it is determined at S1301 that the selector switch flag is L, at S1329, the same control as of S1302 to S1328 is carried out with the camera 110 provided on the passenger seat side.
When it is determined at S1301 that the selector switch flag is R+L, at S1329, the same control as of S1302 to S1328 is carried out with both the cameras 110 provided on the driver seat side and on the passenger seat side. In this case, the control portion 130 performs trimming processing on the camera image of the camera 110 on the driver seat side similarly to the processing of S1302 to S1328. As for the camera image of the camera 110 on the passenger seat side, the control portion 130 performs trimming processing so that the trimmed image is left-right symmetrical with trimming in the camera image of the camera 110 on the driver seat side.
In this embodiment, as described up to this point, image trimming processing is performed based on: the vertical reference line V including a part of the vehicle in a trimmed image before input manipulation; the horizontal reference lines H1 to H3 orthogonal to the vertical reference line (V); and a direction of movement of the trimmed image. Therefore, such a new trimmed image as described with reference to
In a second embodiment, the control portion 130 uses a speed signal obtained from the speed sensor 152 and increases the speed of change from the present trimmed image to a new trimmed image with increase in the speed signal. As a result, when the trimming positions of a trimmed image are changed, a new trimmed image can be checked more quickly with increase in vehicle speed; therefore, it is possible to perform sooner danger avoiding driving and this leads to safe driving.
In a third embodiment, the control portion 130 performs image trimming processing in accordance with the action of a traffic indicator 153. A more detailed description will be given. In the control portion 130, preferable regions are stored beforehand. The preferable regions are regions in the camera image suitable as a trimmed image for checking the right side or the left side of the vehicle when the vehicle makes a right turn or a left turn. The preferable regions are predetermined ranges in the present disclosure and are set by prior adjustment before driving. When a driver manipulates a traffic indicator 153 and the input portion 120 before driving, an actuation signal from the traffic indicator 153 and an input signal from the input portion 120, that is, a desired region for trimming at a selected camera 110 are inputted to the control portion 130. The control portion 130 then stores the above-mentioned desired region in connection with the actuation signal from the traffic indicator 153. This stored desired region is a preferable region. When a traffic indicator 153 is actuated during driving, the control portion 130 switches the trimmed image of the camera 110 installed on the same side as the actuated traffic indicator to a trimmed image obtained by trimming a stored preferable region.
This makes it possible to more reliably check the right side or the left side of the vehicle when making a right turn or a left turn and this leads to safe driving.
The above description of each embodiment is on the assumption that the cameras 110 are provided on both side faces (i.e., both the left side face and the right side face) of a vehicle. The present disclosure is not limited to this and the camera 110 may be singly provided on either side face. In this case, it is advisable that the camera 110 should be provided on the passenger seat side (the side closer to the passenger seat) where the area out of the driver's line of vision is larger. This provides a visibility support apparatus easy to use.
In the first embodiment, two cameras 110 are provided on both the left side face and the right side face of a vehicle. When a trimmed image is moved under R+L being selected by the selector switch 121, the direction of movement of the trimmed image of the camera 110 on the passenger seat side is left-right symmetric with the direction of movement of the trimmed image of the camera 110 on the driver seat side. Instead, both the trimmed images may be moved to an identical direction.
While the present disclosure has been described with reference to embodiments thereof, it is to be understood that the disclosure is not limited to the embodiments and constructions. The present disclosure is intended to cover various modification and equivalent arrangements. In addition, while the various combinations and configurations, other combinations and configurations, including more, less or only a single element, are also within the spirit and scope of the present disclosure.
Number | Date | Country | Kind |
---|---|---|---|
2012-163830 | Jul 2012 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2013/004392 | 7/18/2013 | WO | 00 |