Patent Application
20110304477
The present invention relates to parking support devices, and more particularly to a parking support device for setting a target parking position at which a vehicle is to be parked and guide the vehicle to the set target parking position.
A parking support device is for supporting a driver to park a vehicle by acquiring, with the use of a camera and a distance sensor, the relationship between the present position of the vehicle and the position at which the driver intends to park the vehicle, and automatically steering the vehicle by Electric Power Steering (hereinafter, “EPS”).
The following is an example of a method of setting the position at which the driver intends to park the vehicle (hereinafter, “target parking position”). Specifically, the vehicle is temporarily stopped near the target parking position, this position information is stored (see, for example, Patent Document 1), or information of the target parking position is acquired by examining the parking space with a distance measuring sensor (see, for example, Patent Document 2). After moving the vehicle to a position for starting to park the vehicle, based on the above information, an initial position of a target parking frame for determining the target parking position is superimposed on an image showing the environment surrounding the vehicle. The target parking frame is moved or rotated on the image to adjust the target parking position.
Furthermore, there is known a parking support device in which a target parking frame for determining the target parking position at which a vehicle is to be parked is superimposed on an image showing the environment surrounding the vehicle, and the target parking frame is moved or rotated on the image to adjust the target parking position (see, for example, Patent Document 3). In such a parking support device, the path to the set target parking position is calculated, and the vehicle is guided along the calculated path.
However, the inventions described in Patent Documents 1 and 2 have the following problems. In a case where it is necessary to adjust the position of the target parking frame because the vehicle has temporarily stopped at an inappropriate position or the parking space is so large that the target parking position is difficult to determine, the target parking frame is moved up, down, left, and right with the use of direction buttons. However, each time the direction button is operated, the target parking frame moves only by a short distance. Therefore, there may be cases where it is difficult to quickly move the target parking frame to the desired position.
Furthermore, in the invention described in Patent Document 3, the rotation center, which is used when rotating the target parking frame, corresponds to the center of the target parking frame. Therefore, in order to make the target parking frame match a position that is partitioned by white lines in the actual image and that is tilted in the image, the target parking frame not only needs to be matched, but also moved up/down/left/right. This makes it difficult to make adjustments. In particular, in a case where there is a large distance between the vehicle and the target parking position, if the target parking frame is displaced even slightly, the vehicle may be guided inappropriately. Furthermore, the target parking frame is moved with the use of direction buttons, and therefore it may be difficult to move the target parking frame to the desired position.
In view of the above problems, an object of the present invention is to provide a parking support device for easily and quickly moving the target parking frame to an appropriate position.
Furthermore, an object of the present invention is to provide a parking support device for easily and quickly rotating the target parking frame.
In order to achieve the above objects, a parking support device according to a first invention is characterized by including a target parking position setting unit configured to set a target parking position at which a vehicle is to be parked by superimposing a predetermined target parking frame on an actual image displaying an area surrounding the vehicle, wherein the parking support device guides the vehicle to the target parking position set by the target parking position setting unit; and the target parking position setting unit moves the target parking frame initially displayed on a touch display to a position indicated by one coordinate point determined by a touch operation.
A second invention is preferably characterized as being the parking support device according to the first invention, wherein the target parking frame has a rectangular shape representing the vehicle; and one of four corners of the target parking frame is moved to coincide with said one coordinate point.
A third invention is preferably characterized as being the parking support device according to the first or the second invention, further including a feature point recognition unit configured to recognize a feature point from the actual image displaying the area surrounding the vehicle, wherein the target parking position setting unit moves said one coordinate point to one feature point that is recognized by the feature point recognition unit and that is nearest to said one coordinate point, and moves the target parking frame to a position indicated by said one feature point.
A fourth invention is preferably characterized as being the parking support device according to the third invention, wherein said one feature point includes one point along a parking section line marked on the ground; and the target parking position setting unit moves the target parking frame to a position indicated by said one point along the parking section line to arrange the target parking frame in such a manner as to substantially correspond to the parking section line.
A fifth invention is a parking support device characterized by including a target parking position setting unit configured to set, based on a position of a predetermined target parking frame, a target parking position at which a vehicle is to be parked by superimposing the target parking frame on an actual image displaying an area surrounding the vehicle, wherein the parking support device guides the vehicle to the target parking position set by the target parking position setting unit; and the target parking position setting unit moves the target parking frame to a position determined by one coordinate point, and uses said one coordinate point as a rotation center of the target parking frame.
A sixth invention is characterized as being the parking support device according to the fifth invention, wherein the target parking frame has a rectangular shape representing the vehicle; and one of four corners of the target parking frame is moved to coincide with the position determined by said one coordinate point.
A seventh invention is characterized as being the parking support device according to the fifth or the sixth invention, further including a rotation center highlighting unit configured to highlight the rotation center in such a manner that the rotation center can be identified.
An eighth invention is characterized as being the parking support device according to the fifth through seventh inventions, further including a translucent display unit configured to display, in a translucent manner, the target parking frame to be superimposed on the actual image displaying the area surrounding the vehicle.
By the aforementioned means, the present invention can provide a parking support device for easily and quickly moving the target parking frame to an appropriate position.
Furthermore, the present invention can provide a parking support device for easily and quickly rotating the target parking frame.
The best mode for carrying out the invention is described based on the following embodiments with reference to the accompanying drawings.
As shown in
The parking assist ECU 12 has a built-in memory 20 that can be used for reading and writing data, and is connected to the back camera 14, the wheel speed sensor 15, the touch display 16, and the EPS 18 via a CAN (Controller Area Network). The memory 20 stores position information on a road (absolute coordinates) of a target parking position that is set by the driver as described below, and path information of the path to the target parking position generated by calculation. The information stored in the memory 20 is usually erased when parking assist control is completed, such as when the shift position has been shifted from a reverse position to the parking position or a neutral position or when the vehicle has come near the target parking position. The back camera 14 is disposed at the center rear part of the vehicle and takes photographs of a region extending behind the vehicle in a predetermined angle range. The image information of the area behind the vehicle photographed by the back camera 14 is supplied to the parking assist ECU 12. A feature point recognition unit processes the image received from the back camera 14 and recognizes feature points. “Feature points” are points that can be indicators for setting the target parking position such as white lines indicating a parking section on the ground, side lines of a road, road shoulders, gutters, and wheel clamps. Feature points can be displayed on the touch display 16 so as to be recognizable, or the feature points can be potentially included without being displayed. The image process can be performed by a smoothing process, shading correction, a spatial filtering process, a binarization process, binary image processing, etc., and the feature points are recognized by pattern recognition.
The wheel speed sensor 15 is provided on a steering knuckle arm and detects the speed at which a wheel is rotating. The parking assist ECU 12 receives signals from the wheel speed sensor 15, and can acquire the vehicle speed and the vehicle movement distance.
The touch display 16 is a display device including an input device with which an operator can input coordinate values by touching a screen, and is disposed at a position where it can be seen and operated by the operator (for example, at the center of the instrument panel). The parking assist ECU 12 displays an actual image photographed by the back camera 14 on the touch display 16 if the shift position of the vehicle is at a reverse position. In response to commands from the parking assist ECU 12, the touch display 16 displays an image of the area behind the vehicle taken by the back camera 14. Furthermore, in response to commands from the parking assist ECU 12, the touch display 16 superimposes, on the actual image taken by the back camera 14, auxiliary lines for the parking assist control, the target parking frame for determining the target parking position, and a parking unpermitted region indicating the region in which vehicles cannot be parked, and displays operation contents and help messages according to the screen display.
Furthermore, the touch display 16 includes a pressure type or a thermal sensing type touch operation unit that can be operated by the operator. The touch operation unit includes plural hierarchical switches which are displayed on the display screen in response to commands from the parking assist ECU 12.
The speaker 17 is a device for outputting voices, and outputs warnings and messages generated by the parking assist ECU 12.
The parking assist ECU 12 detects a touch operation by an operator on the touch operation unit and executes a process based on the contents of the touch operation unit. The touch operation unit includes a switch for starting a garage (parking section) parking mode (hereinafter, “parking section parking mode”) as the parking assist control, a switch for starting a parallel parking mode, and arrow button switches for determining the target parking position for the driver to park the vehicle.
The EPS 18 includes a torque sensor for detecting steering torque applied to a steering shaft as the driver steers the vehicle, a rudder angle sensor for detecting the rudder angle of the steering shaft, and an electric motor for applying torque to the steering shaft.
The EPS 18 causes the electric motor to generate torque for assisting the steering torque when the driver steers the vehicle, and as described below, causes the electric motor to generate torque for steering the vehicle for parking the vehicle by parking assist control without having the driver steer the vehicle, such as when parking the vehicle in a garage (parking section) or when performing parallel parking.
Furthermore, the EPS 18 supplies the rudder angle information of the detected steering shaft to the parking assist ECU 12. When executing parking assist control, the parking assist ECU 12 supplies to the EPS 18 a target rudder angle to be realized by the steering shaft as described below. When the target rudder angle is supplied from the parking assist ECU 12, the EPS 18 will cause the electric motor to generate torque for the parking assist control, and will then feed back the detected rudder angle to the parking assist ECU 12.
Next, a description is given of operations of the parking support device 10.
When the shift position of the vehicle is shifted to the reverse position, an image of the area behind the vehicle taken by the back camera 14 is displayed on the display screen of the touch display 16. At this time, as shown in
When the parking section parking mode switch M1 is touched, as shown in (A) of
The target parking frame S corresponds to the target parking position on the actual road and has a rectangular shape that will substantially match the size of the vehicle if projected on the actual road. However, on the display screen of the touch display 16, the target parking frame S has a shape corresponding to the position behind the vehicle on the image (on camera coordinates) taken by the back camera shown on the display screen. Furthermore, each time the driver touches the arrow button switches C, the target parking frame S moves by X cm (for example, 5 cm) in the scale on the actual road or rotates by Y° (for example, 1°), thereby changing the position of the target parking frame S on the display screen of the touch display 16. At this time, as the target parking position becomes closer to the vehicle, the movement amount of the target parking frame S on the display screen of the touch display 16 becomes greater, due to the perspective relationship in the image behind the vehicle taken by the back camera 14.
The target parking frame S is roughly determined beforehand. Specifically, before the parking assist control starts, the driver temporarily stops the vehicle near the target parking position, and stores position information of the target parking position in the parking support device, or causes the distance measuring sensor to examine the parking space and acquire information on the target parking position.
The parking base point position P is one point of the frame of the target parking frame S and corresponds to a standard position for positioning the target parking frame S. The parking base point position P is preferably positioned at a corner of the target parking frame S. This is because a corner or an edge in parking section lines W is often set as the point corresponding to an indicator for positioning the target parking frame, and it is easier to superimpose the target parking frame S onto the parking section lines W if the parking base point position P is positioned at a corner of the target parking frame S. When a wheel clamp is set as the point to be an indicator for positioning the target parking frame, the parking base point position P can be positioned at the center of one of the short sides of the target parking frame S representing the width of the vehicle.
The arrow button switches C include an upward switch for moving the target parking frame S away from the vehicle on the road, a downward switch for moving the target parking frame S toward the vehicle, a leftward switch for moving the target parking frame S toward the left, a rightward switch for moving the target parking frame S toward the right, a counter clockwise switch for rotating the target parking frame S in a counter clockwise direction, and a clockwise switch for rotating the target parking frame S in a clockwise direction.
Furthermore, when the parallel parking mode switch M2 is touched, as shown in (B) of
In both parking modes, with the target parking position setting unit, the operator can move the target parking frame S by touching a part other than the arrow button switches C on the touch display. For example, by touching a coordinate point X or Y in
Furthermore, the target parking position setting unit can make the coordinate point X or Y move automatically (snap) to a feature point that is closest to the coordinate point. Accordingly, even if the operator roughly specifies a coordinate position, the target parking frame S can be accurately positioned along parking section lines W.
In principle, the target parking frame S is moved while maintaining its posture before being moved. This is because the target parking frame S is roughly determined beforehand by storing position information. Specifically, the driver temporarily stops the vehicle near the target parking position and stores position information of the target parking position, or causes the distance measuring sensor to examine the parking space and acquire information on the target parking position. However, the target parking frame S can be automatically adjusted so that its posture after movement substantially matches the white lines of the parking section lines W. This is because the parking support device 10 is aware of the positions of the white lines of the parking section lines W by image processing.
In
Accordingly, without requiring the operator to push the arrow button switches C, the parking support device 10 can move the target parking frame S to a desired position by a single touch. Therefore, it is extremely easy to set the target parking frame S.
In this case, it is also possible to use the upward switch, the downward switch, the leftward switch, and the rightward switch for fine adjusting the position of the target parking frame S.
As described above, the target parking position setting unit displays the target parking frame S and the parking base point position P to allow an operator to set the target parking position by touching the arrow button switches C or directly touching a coordinate point on the touch display.
Furthermore, a parking base point position highlighting unit can let the operator easily see where the parking base point position P is by indicating the parking base point position P with figures such as a circle or a rectangle that is larger than the frame lines, or by indicating the parking base point position P with a different color, or by blinking the parking base point position P.
A translucent display unit displays the target parking frame S and the parking base point position P in a translucent manner so that even when the target parking frame S and the parking base point position P are superimposed on the actual image, the actual image is visible.
The target parking position setting unit, the feature point recognition unit, the parking base point position highlighting unit, and the translucent display unit are realized by causing a not shown CPU (Central Processing Unit) to execute a program stored in a not shown ROM in the parking assist ECU 12.
From the point when the target parking frame S, the parking base point position P, and the arrow button switches C are displayed on the display screen of the touch display 16, at every predetermined time point (for example, every two minutes), the following calculation is performed. That is, assuming that the current position of the vehicle at a certain time point is an initial position, a path from the initial position to the target parking position corresponding to the set position of the target parking frame S is calculated.
Furthermore, when the parking section parking mode switch M1 or the parallel parking mode switch M2 is touched, in addition to the target parking frame S, the parking base point position P, the arrow button switches C as shown in
In the parking section parking mode and in the parallel parking mode, the path to the target parking position is calculated. When the path is generated, the target parking position information and the path information are stored in the memory 20. Additionally, on the display screen of the touch display 16, the inside of the target parking frame S is colored green, for example, which indicates that parking assist control can be executed. When the path to the target parking position is generated by the calculation, and the confirm button switch K of the touch display 16 is touched when the inside of the target parking frame S is colored green, the arrow button switches C and the confirm button switch K disappear from the touch display 16.
Meanwhile, if the path to the target parking position is not generated by calculation because the relative positions between the vehicle and the target parking position do not satisfy a predetermined relationship, the inside of the target parking frame S is colored red, for example, to indicate that the parking assist control cannot be executed. Additionally, to prompt the operator to change the target parking position, the arrow button switches C and the confirm button switch K are continuously displayed.
When the driver releases the brakes and the vehicle starts to reverse due to a creeping phenomenon where the path to the target parking position is generated and the confirm button switch K on the touch display 16 is touched so that the target parking position is finalized, parking assist control is executed for guiding the vehicle to the target parking position. Specifically, the movement amount of the vehicle on the road after starting to reverse is calculated, and based on this calculated movement amount and the rudder angle information from the EPS 18, the position of the vehicle on the road to the target parking position is calculated. Then, the target rudder angle for moving the vehicle along the generated path is calculated. The calculated target angle is supplied to the EPS 18. Based on the target rudder angle from the parking assist ECU 12, the EPS 18 causes the electric motor to generate torque for rotating the steering shaft to move the vehicle along the generated path.
As described above, at the time of parking section parking and parallel parking, it is possible to execute parking assist control for automatically steering the vehicle along a path to the target parking position set by an operator's operation. If such parking assist control is executed, the driver does not need to steer the vehicle. Accordingly, with the parking support device 10 according to the present embodiment, the driver's workload of steering the vehicle is reduced at the time of parking section parking and parallel parking.
A preferred embodiment of the present invention is described above; however, the present invention is not limited to the specifically disclosed embodiment, and variations and modifications may be made without departing from the scope of the present invention.
For example, in the above embodiment, the target parking position setting unit can wait for a touch operation by the operator to move the target parking frame or automatically move the target parking frame to the nearest feature point without waiting for a touch operation by the operator. The target parking frame is positioned beforehand somewhat accurately when the vehicle is temporarily stopped and a space recognition method is performed. Therefore, if the parking base point position is only slightly displaced from the feature point, the parking base point position is automatically moved to a position indicated by the feature point so that the operator can start the parking assist control without having to adjust the position of the target parking frame.
As shown in
The parking assist ECU 112 is connected to the back camera 114, the touch display 116, and the EPS 118. The parking assist ECU 112 has a built-in memory 120 that can be used for reading and writing data. The memory 120 stores position information on a road (absolute coordinates) of a target parking position that is set by the driver as described below, and path information of the path to the target parking position generated by calculation. The information stored in the memory 120 is usually erased when parking assist control is completed, such as when the shift position has been shifted from a reverse position to the parking position or a neutral position, or when the vehicle has come near the target parking position.
The back camera 114 is disposed at the center rear part of the vehicle and takes photographs of a region extending behind the vehicle in a predetermined angle range. The image information of the area behind the vehicle photographed by the back camera 114 is supplied to the parking assist ECU 112.
The touch display 116 is disposed at a position where it can be seen and operated by the operator of the vehicle (for example, at the center of the instrument panel). The parking assist ECU 112 displays an actual image photographed by the back camera 114 on the touch display 116 if the shift position of the vehicle is at a reverse position. In response to commands from the parking assist ECU 112, the touch display 116 displays an image of the area behind the vehicle taken by the back camera 114. Furthermore, in response to commands from the parking assist ECU 112, the touch display 116 superimposes, on the actual image taken by the back camera 114, auxiliary lines for the parking assist control and the target parking frame for determining the target parking position.
The touch display 116 includes a pressure type or a thermal sensing type touch operation unit that can be operated by the operator of the vehicle. The touch operation unit includes plural hierarchical switches, which are displayed on the display screen in response to commands from the parking assist ECU 112.
The parking assist ECU 112 detects a touch operation by an operator of the vehicle on the touch operation unit and executes a process based on the contents of the touch operation unit. The touch operation unit includes a switch for starting a parking section parking mode as the parking assist control, a switch for starting a parallel parking mode, and arrow button switches for determining the target parking position for the driver to park the vehicle.
The EPS 118 includes a torque sensor for detecting steering torque applied to a steering shaft as the driver steers the vehicle, a rudder angle sensor for detecting the rudder angle of the steering shaft, and an electric motor for applying torque to the steering shaft.
The EPS 118 causes the electric motor to generate torque for assisting the steering torque when the driver steers the vehicle, and also, as described below, causes the electric motor to generate torque for steering the vehicle for parking the vehicle by parking assist control without having the driver steer the vehicle, such as when parking the vehicle in a parking section or when performing parallel parking.
Furthermore, the EPS 118 supplies the rudder angle information of the detected steering shaft to the parking assist ECU 12. When executing parking assist control, the parking assist ECU 112 supplies to the EPS 18 a target rudder angle to be realized by the steering shaft as described below. When the target rudder angle is supplied from the parking assist ECU 112, the EPS 118 causes the electric motor to generate torque for the parking assist control, and then feeds back the detected rudder angle to the parking assist ECU 112.
Next, a description is given of operations of the parking support device 110.
When the shift position of the vehicle is shifted to the reverse position, an image of the area behind the vehicle taken by the back camera 114 is displayed on the display screen of the touch display 116. At this time, as shown in
When the parking section parking mode switch M1 is touched, as shown in (A) of
The arrow button switches C include an upward switch for moving the target parking frame S away from the vehicle on the road, a downward switch for moving the target parking frame S toward the vehicle, a leftward switch for moving the target parking frame S toward the left, a rightward switch for moving the target parking frame S toward the right, a counter clockwise switch for rotating the target parking frame S in a counter clockwise direction, and a clockwise switch for rotating the target parking frame S in a clockwise direction.
Furthermore, when the parallel parking mode switch M2 is touched, as shown in (B) of
In both parking modes, the vehicle operator can move the target parking frame S by touching a part other than the arrow button switches C on the touch display. For example, by touching a coordinate point X in (A) of
The rotation center Q is a point on the frame lines of the target parking frame S, and is preferably positioned at a bottom left corner of the target parking frame S as shown in
The target parking frame S corresponds to the target parking position on the actual road, and has a rectangular shape that substantially matches the size of the vehicle if projected on the actual road. However, on the display screen of the touch display 16, the target parking frame S has a shape corresponding to the position behind the vehicle on the image (on camera coordinates) taken by the back camera 114 shown on the display screen. Furthermore, each time the driver touches the arrow button switches C, the target parking frame S moves by X cm (for example, 5 cm) in the scale on the actual road or rotates by Y° (for example, 1°), thereby changing the position of the target parking frame S on the display screen of the touch display 116. At this time, as the target parking position becomes closer to the vehicle, the movement amount of the target parking frame S on the display screen of the touch display 116 becomes greater due to the perspective relationship in the image behind the vehicle taken by the back camera 114.
As described above, the target parking position setting unit sets the target parking position when the operator touches the arrow button switches C or directly touches a coordinate point on the touch display, while the target parking frame S and the rotation center Q are displayed.
Furthermore, a rotation center highlighting unit can let the operator easily see where the rotation center Q is by indicating the rotation center Q with a figure such as a circle or a rectangle that is larger than the frame lines, or by indicating the rotation center Q with a different color, or by flashing the rotation center Q.
A translucent display unit displays the target parking frame S and the rotation center Q in a translucent manner so that even when the target parking frame S and the rotation center Q are superimposed on the actual image, the actual image is visible.
The target parking position setting unit, the rotation center highlighting unit, and the translucent display unit are realized by causing a not shown CPU (Central Processing Unit) to execute a program stored in a not shown ROM in the parking assist ECU 112.
From the point when the target parking frame S, the rotation center Q, and the arrow button switches C are displayed on the display screen of the touch display 116, at every predetermined time point (for example, every two minutes) the following calculation is performed. That is, assuming that the current position of the vehicle at a certain time point is an initial position, a path from the initial position to the target parking position corresponding to the set position of the target parking frame S is calculated.
Furthermore, when the parking section parking mode switch M1 or the parallel parking mode switch M2 is touched, in addition to the target parking frame S, the rotation center P, the arrow button switches C, as shown in (A) and (B) of
In the parking section parking mode and in the parallel parking mode, the path to the target parking position is calculated. When the path is generated, the target parking position information and the path information are stored in the memory 120. Additionally, on the display screen of the touch display 116, the target parking frame S is colored green, for example, which indicates that parking assist control can be executed. When the path to the target parking position is generated by the calculation, and the confirm button switch K of the touch display 116 is touched when the target parking frame S is colored green, the arrow button switches C and the confirm button switch K disappear from the touch display 116.
Meanwhile, if the path to the target parking position is not generated by calculation because the relative positions between the vehicle and the target parking position do not satisfy a predetermined relationship, the target parking frame S is colored red, for example, to indicate that the parking assist control cannot be executed. Additionally, to prompt the operator to change the target parking position, the arrow button switches C and the confirm button switch K are continuously displayed. Only the frame of the target parking frame S can be colored, or both the frame and the inside of the target parking frame S can be colored.
When the driver releases the brakes and the vehicle starts to reverse due to a creeping phenomenon where the path to the target parking position is generated and the confirm button switch K on the touch display 116 is touched so that the target parking position is finalized, parking assist control is executed for guiding the vehicle to the target parking position. Specifically, the movement amount of the vehicle on the road after starting to reverse is calculated, and based on this calculated movement amount and the rudder angle information from the EPS 118, the position of the vehicle on the road to the target parking position is calculated. Then, the target rudder angle for moving the vehicle along the generated path is calculated. The calculated target angle is supplied to the EPS 118. Based on the target rudder angle from the parking assist ECU 112, the EPS 118 causes the electric motor to generate torque for rotating the steering shaft to move the vehicle along the generated path.
As described above, at the time of parking section parking and parallel parking, it is possible to execute parking assist control for automatically steering the vehicle along a path to the target parking position set by an operator's operation. If such parking assist control is executed, the driver does not need to steer the vehicle. Accordingly, with the parking support device 110 according to the present embodiment, the driver's workload of steering the vehicle can be reduced at the time of parking section parking and parallel parking.
A preferred embodiment of the present invention is described above; however, the present invention is not limited to the specifically disclosed embodiment, and variations and modifications may be made without departing from the scope of the present invention.
For example, in the second embodiment, the rotation center Q of the target parking frame S is moved to an arbitrary coordinate point, and then the counter clockwise switch or the clockwise switch is used to fine adjust the rotational angle. However, another arbitrary coordinate point can be touched to make the fine adjustment of the rotational angle, without using the counter clockwise switch or the clockwise switch. In this case, a line connecting the rotation center Q and the other arbitrary coordinate point corresponds to one of the four frame lines of the target parking frame. Accordingly, the target parking frame can be set by just touching the display twice, and therefore the vehicle operator's workload is reduced.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2005 316921 | Oct 2005 | JP | national |
| 2005 317579 | Oct 2005 | JP | national |
This application is a division of and is based upon and claims the benefit of priority under 35 U.S.C. §120 for U.S. Ser. No. 12/092,095, filed Apr. 30, 2008, the entire contents of which are incorporated herein by reference. U.S. Ser. No. 12/092,095 is a National Stage of PCT/JP06/321166, filed Oct. 24, 2006, and claims the benefit of priority under 35 U.S.C. §119 from Japanese Patent Application No. 2005-316921, filed Oct. 31, 2005 and Japanese Patent Application No. 2005-317579, filed Oct. 31, 2005. JP 2005-316921 and 2005-317579 are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12092095 | Apr 2008 | US |
| Child | 13216332 | US |
