Patent Grant
12094255
The present application relates to the autonomous driving field, and particularly to a method of implementing vehicle automatic inspection and repair, a system of implementing vehicle automatic inspection and repair, a vehicle controller, and an inspection and repair apparatus.
With the development of the autonomous driving technology, the autonomous vehicles will be more and more popular. The safety in the driving process of the autonomous vehicles appears to be particularly important. However, how to implement the automatic inspection and repair of the vehicles becomes an urgent problem to be solved by those skilled in the art. At present, there is no related disclosed technology of implementing the automatic inspection and repair of the autonomous vehicles.
The present application provides a method and system of implementing vehicle automatic inspection and repair, a vehicle controller, and an inspection and repair apparatus.
An embodiment of the present application provides a method of implementing vehicle automatic inspection and repair, which includes:
An embodiment of the present application provides a system of implementing vehicle automatic inspection and repair, which includes:
An embodiment of the present application provides a vehicle controller, which includes:
An embodiment of the present application further provides an inspection and repair apparatus, which includes:
The accompanying drawings are used to provide the further understanding of the present application and constitute a part of the specification, and serve to explain the present application together with the embodiments of the present application but not limit the present application.
In order to make those skilled in the art better understand the technical solution in the present application, the technical solution in the embodiments of the present application will be described clearly and completely below in combination with the accompanying drawings in the embodiments of the present application. Obviously the described embodiments are just a part of the embodiments of the present application but not all the embodiments. Based upon the embodiments of the present application, all of other embodiments obtained by those ordinary skilled in the art without creative work should pertain to the protection scope of the present application.
For the problem that the automatic inspection and repair of the unmanned vehicle can not be implemented in the prior art, the embodiments of the present application provide a method and system of implementing vehicle automatic inspection and repair, in which an inspection and repair apparatus is arranged at a preset inspection and repair position, and the vehicle controller can control the vehicle to drive to the inspection and repair position when determining the vehicle malfunctions according to the vehicle self-inspection data, and interact with the inspection and repair apparatus at this inspection and repair position to accomplish the automatic inspection and repair without manual intervention, thereby implementing the function of the automatic inspection and repair of the autonomous vehicle.
In an embodiment of the present application, the vehicle controller of the vehicle can be a DSP (Digital Signal Processor), FPGA (Field-Programmable Gate Array) controller, industrial computer, driving computer, ECU (Electronic Control Unit), or VCU (Vehicle Control Unit) or the like, which is not limited strictly by the present application.
Referring to
In an embodiment of the application, the vehicle controller obtains the vehicle self-inspection data, which can be achieved by but not limited to any of the following modes:
In the mode A1, the vehicle controller sends a request of obtaining the monitoring data to the vehicle self-inspection system periodically and actively, to obtain the monitoring data from the vehicle self-inspection system.
In the mode A2, the vehicle self-inspection system sends the monitoring data to the vehicle controller periodically and actively.
In an embodiment of the application, the monitoring data contains the self-inspection data of each component in the vehicle, e.g., tire pressure abnormity alarm information, Transmission Control Unit (Automatic Transmission Control Unit, TCU) abnormity alarm information, voltage abnormity alarm information and the like.
In an embodiment of the present application, if the monitoring data contains the alarm information of the component, it is confirmed that the corresponding component malfunctions.
In an embodiment of the application, the vehicle controller obtains the vehicle diagnostic information from an On-Board Diagnostic (OBD) system through a Controller Area Network (CAN) bus, and sends the vehicle diagnostic information to the inspection and repair apparatus.
In an embodiment of the application, in the above step 103, the inspection and repair apparatus determines the corresponding repair advice according to the vehicle diagnostic information, which can be achieved by but not limited to any of the following modes:
In an embodiment of the present application, in the above step 101, the vehicle controller controls the vehicle to drive and stop at the inspection and repair position, which includes: the vehicle controller plans a route from a current position to the selected inspection and repair position through a map software or navigation software installed in the vehicle controller, and the vehicle controller controls the vehicle to drive along the route and stop at the inspection and repair position.
In an embodiment of the present application, the selected inspection and repair position can be the inspection and repair position closest to the current position of the vehicle.
In an embodiment of the present application, the repair advice can includes but not limited to one or more of: no repair is needed, repair the vehicle in the target highway port, calling the rescue, minor repair in a repair shop/4S shop is needed, overhaul in a repair shop/4S shop is needed and the like. When the repair advice is a minor repair/overhaul in a repair shop/4S shop is needed, the vehicle controller queries the repair shop or 4S shop closest to the target highway port through the electronic map, controls the vehicle to drive from the inspection and repair position to the exit position of the target highway port, and controls the vehicle to drive from the exit position of the target highway port to the closest repair shop or 4S shop.
Based upon the same concept as the method of implementing vehicle automatic inspection and repair provided by the first embodiment described above, the second embodiment of the application provides a system of implementing vehicle automatic inspection and repair. The structure of the system is as shown in
In some embodiments, the inspection and repair apparatus 2 determines the corresponding repair advice according to the vehicle diagnostic information, which includes:
In some embodiments, the vehicle controller sends the vehicle diagnostic information to the inspection and repair apparatus, which includes:
In some embodiments, the vehicle controller obtains the vehicle self-inspection data, which includes: the vehicle controller obtains or receives monitoring data from a vehicle self-inspection system.
In some embodiments, the vehicle controller controls the vehicle to drive and stop at the inspection and repair position, which includes: the vehicle controller plans a route from a current position to the selected inspection and repair position through a map software or navigation software installed in the vehicle controller, and controls the vehicle to drive along the route and stop at the inspection and repair position.
The embodiment of the present application provides a vehicle controller. The structure of the vehicle controller is as shown in
In some embodiments, the control unit 12 sends, by the communication unit 11, the vehicle diagnostic information to the inspection and repair apparatus, which includes:
In some embodiments, the control unit 12 obtains the vehicle self-inspection data, which includes: the control unit 12 obtains or receives monitoring data from a vehicle self-inspection system.
In some embodiments, the control unit 12 controls the vehicle to drive and stop at the inspection and repair position, which includes: the control unit 12 plans a route from a current position to the selected inspection and repair position through a map software or navigation software installed in the vehicle controller, and controls the vehicle to drive along the route and stop at the inspection and repair position.
The fourth embodiment of the application provides an inspection and repair apparatus. The structure of the inspection and repair apparatus is as shown in
In some embodiments, the inspection and repair unit 22 determines the corresponding repair advice according to the vehicle diagnostic information, which includes:
It should be understood by those skilled in the art that the embodiments of the present application can provide methods, systems and computer program products. Thus the present application can take the form of hardware embodiments alone, application software embodiments alone, or embodiments combining the application software and hardware aspects. Also the present application can take the form of computer program products implemented on one or more computer usable storage mediums (including but not limited to magnetic disk memories, CD-ROMs, optical memories and the like) containing computer usable program codes therein.
The present application is described by reference to the flow charts and/or the block diagrams of the methods, the devices (systems) and the computer program products according to the embodiments of the present application. It should be understood that each process and/or block in the flow charts and/or the block diagrams, and a combination of processes and/or blocks in the flow charts and/or the block diagrams can be implemented by the computer program instructions. These computer program instructions can be provided to a general-purpose computer, a dedicated computer, an embedded processor, or a processor of another programmable data processing device to produce a machine, so that an apparatus for implementing the functions specified in one or more processes of the flow charts and/or one or more blocks of the block diagrams is produced by the instructions executed by the computer or the processor of another programmable data processing device.
These computer program instructions can also be stored in a computer readable memory which is capable of guiding the computer or another programmable data processing device to operate in a particular way, so that the instructions stored in the computer readable memory produce a manufacture including the instruction apparatus which implements the functions specified in one or more processes of the flow charts and/or one or more blocks of the block diagrams.
These computer program instructions can also be loaded onto the computer or another programmable data processing device, so that a series of operation steps are performed on the computer or another programmable device to produce the computer-implemented processing. Thus the instructions executed on the computer or another programmable device provide steps for implementing the functions specified in one or more processes of the flow charts and/or one or more blocks of the block diagrams.
Although the preferred embodiments of the present application have been described, those skilled in the art can make additional alterations and modifications to these embodiments once they learn about the basic creative concepts. Thus the attached claims are intended to be interpreted to include the preferred embodiments as well as all the alterations and modifications falling within the scope of the present application.
Evidently those skilled in the art can make various modifications and variations to the present application without departing from the spirit and scope of the present application. Thus the present application is also intended to encompass these modifications and variations therein as long as these modifications and variations to the present application come into the scope of the claims of the present application and their equivalents.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201710602331.6 | Jul 2017 | CN | national |
This patent document is a continuation of U.S. patent application Ser. No. 17/548,448, filed on Dec. 10, 2021 and issued as U.S. Pat. No. 11,715,336, which is a continuation of U.S. patent application Ser. No. 16/035,666, filed on Jul. 15, 2018 and issued as U.S. Pat. No. 11,200,758, which claims priority to and the benefit of Chinese Patent Application No. 201710602331.6, filed on Jul. 21, 2017. The aforementioned applications are incorporated herein by reference in their entireties.
| Number | Name | Date | Kind |
|---|---|---|---|
| 6777904 | Degner | Aug 2004 | B1 |
| 7103460 | Breed | Sep 2006 | B1 |
| 7783403 | Breed | Aug 2010 | B2 |
| 8412449 | Trepagnier | Apr 2013 | B2 |
| 8788134 | Litkouhi | Jul 2014 | B1 |
| 8965621 | Urmson | Feb 2015 | B1 |
| 8970359 | Barth | Mar 2015 | B2 |
| 9002632 | Emigh | Apr 2015 | B1 |
| 9111444 | Kaganovich | Aug 2015 | B2 |
| 9134402 | Sebastian | Sep 2015 | B2 |
| 9248835 | Tanzmeister | Feb 2016 | B2 |
| 9315192 | Zhu | Apr 2016 | B1 |
| 9317033 | Ibanez-guzman | Apr 2016 | B2 |
| 9342074 | Dolgov | May 2016 | B2 |
| 9399397 | Mizutani | Jul 2016 | B2 |
| 9438878 | Niebla | Sep 2016 | B2 |
| 9476970 | Fairfield | Oct 2016 | B1 |
| 9535423 | Debreczeni | Jan 2017 | B1 |
| 9582944 | Brozovich | Feb 2017 | B2 |
| 9587952 | Slusar | Mar 2017 | B1 |
| 9720418 | Stenneth | Aug 2017 | B2 |
| 9723097 | Harris | Aug 2017 | B2 |
| 9723099 | Chen | Aug 2017 | B2 |
| 9738280 | Rayes | Aug 2017 | B2 |
| 9746550 | Nath | Aug 2017 | B2 |
| 10086782 | Konrardy | Oct 2018 | B1 |
| 11200758 | Wu et al. | Dec 2021 | B2 |
| 20060229777 | Hudson | Oct 2006 | A1 |
| 20080249667 | Horvitz | Oct 2008 | A1 |
| 20090040054 | Wang | Feb 2009 | A1 |
| 20100049397 | Lin | Feb 2010 | A1 |
| 20120083959 | Dolgov | Apr 2012 | A1 |
| 20150142257 | Brozovich | May 2015 | A1 |
| 20160163130 | Zagajac | Jun 2016 | A1 |
| 20160321381 | English | Nov 2016 | A1 |
| 20160375907 | Erban | Dec 2016 | A1 |
| 20190026960 | Wu et al. | Jan 2019 | A1 |
| 20220101658 | Wu et al. | Mar 2022 | A1 |
| Number | Date | Country |
|---|---|---|
| 101251923 | Aug 2008 | CN |
| 101482752 | Jul 2009 | CN |
| 101718992 | Jun 2010 | CN |
| 102073319 | May 2011 | CN |
| 102120441 | Jul 2011 | CN |
| 102347980 | Feb 2012 | CN |
| 102455700 | May 2012 | CN |
| 103135515 | Jun 2013 | CN |
| 103676923 | Mar 2014 | CN |
| 104331066 | Feb 2015 | CN |
| 204821320 | Dec 2015 | CN |
| 105480259 | Apr 2016 | CN |
| 106094830 | Nov 2016 | CN |
| 106143202 | Nov 2016 | CN |
| 106354130 | Jan 2017 | CN |
| 106406269 | Feb 2017 | CN |
| 03034166 | Apr 2003 | WO |
| Entry |
|---|
| No Author. Chinese Application No. 201710602331.6, First Search Report Mailed Jun. 30, 2018, pp. 1-2. |
| No Author. Chinese Application No. 201710602331.6, First Office Action, Mailed Jul. 10, 2018, pp. 1-14. |
| No Author. Chinese Application No. 201710602331.6, Supplementary Search Report Mailed, Jan. 22, 0219, p. 1. |
| No Author. Chinese Application No. 201710602331.6, Second Supplementary Search Report Mailed, Feb. 26, 2019, pp. 1-2. |
| No Author. Chinese Application No. 201710602331.6 Second Office Action Mailed Jun. 3, 2019, pp. 1-15. |
| Spinello, Luciano, Triebel, Rudolph, Siegwart, Roland, “Multiclass Multimodal Detection and Tracking in Urban Environments”, Sage Journals, vol. 29 issue: 12, pp. 1498-1515 Article first published online: Oct. 7, 2010; Issue published: Oct. 1, 2010. |
| Matthew Barth, Carrie Malcolm, Theodore Younglove, and Nicole Hill, “Recent Validation Efforts for a Comprehensive Modal Emissions Model”, Transportation Research Record 1750, Paper No. 01-0326, College of Engineering, Center for Environmental Research and Technology, University of California, Riverside, CA 92521, dale unknown. |
| Kyoungho Ahn, Hesham Rakha, “The Effects of Route Choice Decisions on Vehicle Energy Consumption and Emissions”, Virginia Tech Transportation Institute, Blacksburg, VA 24061, dale unknown. |
| Ramos, Sebastian, Gehrig, Stefan, Pinggera, Peter, Franke, Uwe, Rother, Carsten, “Detecting Unexpected Obstacles or Self-Driving Cars: Fusing Deep Learning and Geometric Modeling”, arXiv:1612.06573v1 [cs.CV] Dec. 20, 2016. |
| Schroff, Florian, Dmitry Kalenichenko, James Philbin, (Google), “FaceNet: A Unified Embedding for Face Recognitionand Clustering”, CVPR 2015. |
| Dai, Jifeng, Kaiming He, Jian Sun, (Microsoft Research), “Instance-aware Semantic Segmentation via Multi-task Network Cascades”, CVPR 2016. |
| Huval, Brody, Tao Wang, Sameep Tandon, Jeff Kiske, Will Song, Joel Pazhayampallil, Mykhaylo Andriluka, Pranav Rajpurkar, Toki Migimatsu, Royce Cheng-Yue, Fernando Mujica, Adam Coates, Andrew Ng, “An Empirical Evaluation of Deep Learning on Highway Driving”, arXiv:1504.01716v3 [cs.RO] Apr. 17, 2015. |
| Tian Li, “Proposal Free Instance Segmentation Based on Instance-aware Metric”, Department of Computer Science, Cranberry-Lemon University, Pittsburgh, PA., date unknown. |
| Mohammad Norouzi, David J. Fleet, Ruslan Salakhutdinov, “Hamming Distance Metric Learning”, Departments of Computer Science and Statistics, University of Toronto, date unknown. |
| Jain, Suyong Dutt, Grauman, Kristen, “Active Image Segmentation Propagation”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), Las Vegas, Jun. 2016. |
| MacAodha, Oisin, Campbell, Neill D.F., Kautz, Jan, Breslow, Gabriel J., “Hierarchical Subquery Evaluation for Active earning on a Graph”, In Proceedings of the IEEE Conference on Computer Vision and Pattern Recognition (CVPR), 2014. |
| Kendall, Alex, Gal, Yarin, “What Uncertainties Do We Need in Bayesian Deep Learning for Computer Vision”, rXiv:1703.04977v1 [cs.CV] Mar. 15, 2017. |
| Wei, Junqing, John M. Dolan, Bakhtiar Litkhouhi, “A Prediction- and Cost Function-Based Algorithm for Robust Autonomous Freeway Driving”, 2010 IEEE Intelligent Vehicles Symposium, University of California, San Diego, CA, USA, Jun. 21-24, 2010. |
| Deter Welinder, Steve Branson, Serge Belongie, Pietro Perona, “The Multidimensional Wisdom of Crowds”; http://www.vision.caltech.edu/visipedia/papers/WelinderEtalNIPS10.pdf, 2010. |
| Kai Yu, Yang Zhou, Da Li, Zhang Zhang, Kaiqi Huang, “Large-scale Distributed Video Parsing and Evaluation Platform”, Center for Research on Intelligent Perception and Computing, Institute of Automation, Chinese Academy of Sciences, China, arXiv:1611.09580v1 [cs.CV] Nov. 29, 2016. |
| C. Yang, Z. Li, R. Cui and B. Xu, “Neural Network-Based Motion Control of an Underactuated Wheeled Inverted Pendulum Model,” in IEEE Transactions on Neural Networks and Learning Systems, vol. 25, No. 11, pp. 2004-2016, Nov. 2014. |
| Stephan R. Richter, Vibhav Vineet, Stefan Roth, Vladlen Koltun, “Playing for Data: Ground Truth from Computer Sames”, Intel Labs, European Conference on Computer Vision {ECCV), Amsterdam, the Netherlands, 2016. |
| Thanos Athanasiadis, Phivos Mylonas, Yannis Avrithis, and Stefanos Kollias, “Semantic Image Segmentation and Object Labeling”, IEEE Transactions on Circuits and Systems for Video Technology, vol. 17, No. 3, Mar. 2007. |
| Marius Cordis, Mohamed Omran, Sebastian Ramos, Timo Rehfeld, Markus Enzweiler Rodrigo Benenson, Uwe Franke, Stefan Roth, and Berni Schiele, “The Cityscapes Dataset for Semantic Urban Scene Understanding”, Proceedings of the IEEE Computer Society Conference on Computer Vision and Pattern Recognition {CVPR), Las Vegas, Nevada, 2016. |
| Adhiraj Somani, Nan Ye, David Hsu, and Wee Sun Lee, “DESPOT: Online POMDP Planning with Regularization”, Department of Computer Science, National University of Singapore, dale unknown. |
| Adam Paszke, Abhishek Chaurasia, Sangpil Kim, and Eugenio Culurciello. Enet: A deep neural network Architecture for real-lime semantic segmentation. CoRR, abs/1606.02147, 2016. |
| Number | Date | Country | |
|---|---|---|---|
| 20230377379 A1 | Nov 2023 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17548448 | Dec 2021 | US |
| Child | 18362334 | US | |
| Parent | 16035666 | Jul 2018 | US |
| Child | 17548448 | US |
