FIELD OF THE INVENTION
The present invention generally relates to a digital mapping system. More specifically, the present invention not only retains and displays features of current digital maps, including road geophysical position, road characters, and even three-dimensional images, but also has a supplemental electromagnetic (EM) propagation profile map for various wavelengths.
BACKGROUND OF THE INVENTION
Wireless communication networks and automatic radar systems for self-driving vehicles has been a fast-growing area of interest for many automobile and wireless enterprises. These markets are among fast growing markets in the world. Recently, the development of auto radar provides a sensing tool for advanced driver-assistance systems (ADAS) and automatic driving are the focus of automobile manufacture and artificial intelligence (AI) research and development industry. However, current systems often fail due to an inability to communicate effectively car-to-car in crowded or obstructed conditions. For example, a sharp turn in a mountainous highway, as represented in FIG. 1, prevents direct impingement between two cars, as the cars are hidden from each other on the other side of the sharp turn. It is difficult to receive any radar echoes from the vehicles from the other side of the hill either from direct pass, or via a multipath. The radar echo signal from the incoming vehicle can only be detected via a scattering, weak EM wave that might be undetectable. In this case, the ADAS and automatic radar detection will fail, or at least the detectability of the target is greatly compromised, especially for millimeter wave band radar. Further, systems fail to accurately communicate and display road conditions as conditions change over time due to fatigue and incident. Radio detection and ranging (radar) is one of the sensing devices needed for ADAS and automatic driving. Unfortunately, automobile radar and vehicle wireless systems for vehicle-to-everything (V2X) face great challenges accounting for many geographic road features both in rural and urban areas.
The present invention addresses these issues. An electromagnetic-profile digital map provides three dimensional geographic characteristics of a road, thus enabling automatic driving. The present invention further utilizes AI technology that can improve an autopilot role in automatic driving and for ADAS. EM profiles cover wavelengths ranging from 800 MHz up to 77 GHz to provide powerful tools for various wireless communication services, vehicular radar and V2X systems. The present invention utilizes both compiled digital geographical characteristics (location, road futures, including curvature, condition, and more), and surrounding features (3D images, elevations, traffic light location, speed limit, EM propagation profile, and more) to render road conditions. Artificial intelligence or machine learning patterns are utilized to update the EM propagation profile map.
Urban road geometry, as represented in FIG. 2, presents a challenge in which there is no direct path for auto radar target reflect signal. Besides, there are many multipath signals from surrounding buildings, and from many radiation sources that may or may not be in the same frequency band. Therefore, it presents a great challenge for auto radar target detection and mobile vehicular communication. Many multipath signals are from fixed surrounding object. The EM digital map will greatly eliminate the adverse effect on the radar detection, mobile communication, and V2X communication systems. The present invention makes automatic driving possible in all geometric environments that may present a great challenge for automatic driving, ADAS system and Radar and Lidar detection. Further, the present invention makes it possible for mobile vehicular communication mechanisms, such as 5G, 4G vehicular networks and Wi-Fi networks to eliminate dead or weak points or areas while simultaneously increasing mobile vehicular network capacity and data rate.
BRIEF DESCRIPTION OF THE DRAWINGS
FIG. 1 is a schematic diagram illustrating a sharp turn.
FIG. 2 is a schematic diagram illustrating radio detection and ranging (radar) usage in a city.
FIG. 3 is a schematic diagram illustrating the process of capturing each electromagnetic (EM) profile.
FIG. 4 is a schematic diagram illustrating the process of making the EM digital map.
FIG. 5 is a schematic diagram illustrating the process of assigning a profile class.
FIG. 6 is a schematic diagram illustrating the process of applying an artificial intelligence (AI) radar signal to the present invention.
FIG. 7 is schematic diagram illustrating the process of applying vehicle-to-vehicle communication to the present invention.
FIG. 8 is flowchart illustrating the overall process for the method of the present invention.
FIG. 9 is a continuation of FIG. 8.
FIG. 10 is a flowchart illustrating the subprocess of detecting other vehicles in the same lane.
FIG. 11 is a flowchart illustrating the subprocess of detecting other vehicles in a different lane moving in the same direction.
FIG. 12 is a flowchart illustrating the subprocess of detecting other vehicles in a different lane moving in the opposite direction.
FIG. 13 is a flowchart illustrating the subprocess of geographically classifying EM profiles.
FIG. 14 is a flowchart illustrating the subprocess of updating a geographic classification.
FIG. 15 is flowchart illustrating the subprocess of configuring a signature beam of a MIMO antenna.
FIG. 16 is a flowchart illustrating the subprocess of configuring an optimal scanning beam for a MIMO antenna.
FIG. 17 is a flowchart illustrating the subprocess of optimizing a coding-and-decoding process for the MIMO antenna.
FIG. 18 is a flowchart illustrating the subprocess of distinguishing dynamic objects from static objects with a MIMO antenna.
DETAILED DESCRIPTION OF THE INVENTION
All illustrations of the drawings are for the purpose of describing selected versions of the present invention and are not intended to limit the scope of the present invention.
The present invention is a method for generating an electromagnetic-profile digital map that provides a user with an electromagnetic-profile of an entire geographic area that includes all obstacles on the road, including road textures, other vehicles, and more. Referring to FIG. 1-9, the present invention accomplishes this by analyzing data from vehicles deployed to collect test data about a plurality of points along the road. The system of the present invention includes at least one radio detection and ranging (radar)-enabled vehicle and an automated driving system (Step A). The radar-enabled vehicle relates to any automobile capable of positioning an array of sensors adjacent to a road while moving. The automated driving system is any type of fixed and mobile setup of devices and/or mechanisms that allow for the automatic driving of vehicles. The radar-enabled vehicle and the automated driving system are communicably coupled to each other. This arrangement enables transmission of data between the radar-enabled vehicle and the automated driving system. A plurality of geographic classifications is stored on the automated driving system. Each geographic classification is a type of EM profile that represents one or more specific geographic features such as, but not limited to, terrain, road quality, road age, proximity to hazards, and proximity to populated areas.
The present invention follows an overall process order to leverage the provided tools. To this end, a plurality of electromagnetic (EM) profiles is captured along a specific road with the radar-enabled vehicle by travelling the specific road with the radar-enabled vehicle (Step B). The plurality of EM profiles is a set of data regarding the topology and distribution of various points along a road. The specific road is a single path connecting two points on a map capable of supporting a vehicle and communicating various road laws. The specified road is mapped in a plurality of geospatial points, which is a set of global or relative coordinates capable of denoting the precise location of a point or defined section of a road. Each EM profile is associated to a corresponding point from the plurality of geospatial points, which allows each EM profile to be mapped along the specific road by their geospatial location. Each EM profile is next assigned to a corresponding classification with the automated driving system (Step C), wherein the corresponding classification is from the plurality of geographic classifications. This provides each EM profile with relevant supplemental information about the documented area, thus enabling application of the captured data to a digital map. A plurality of iterations for Steps B and C is executed for a plurality of mapped roads, wherein the specific road in each iteration for Steps B and C is a different road from the plurality of mapped roads (Step D). In this way, a comprehensive set of mapping data can be generated for all of the roads within a designated geographic area. Each EM profile is compiled with the corresponding classification at the corresponding point for each mappable road into an EM digital map of the plurality of mapped roads with the automated driving system (Step E). Thus, a fully comprehensive digital map, including the new data regarding the road, is generated. Finally, the EM digital map is implemented with the automated driving system (Step F). In this way, relevant, up-to-date information is provided to any automated driving service. In an alternative embodiment, such information is further provided directly to the vehicle operator.
The radar-enabled vehicle may be traveling on a road in proximity to other vehicles. To account for one such arrangement of vehicles, the radar-enabled vehicle is travelling in a forward direction on a selected lane of the specific road during Step B, as represented in FIG. 10. The radar-enabled vehicle may be traveling upon any defined lane of the road of interest. A first set of echo data for each EM profile is received with the radar-enabled vehicle, wherein the first set of echo data is used to detect a vehicular presence travelling in the forward direction on the selected lane ahead of the radar-enabled vehicle. Thus, the radar-enabled vehicle is provided with the location of one or several vehicles ahead of the radar-enabled vehicle so that the automated driving system can eventually distinguish between those vehicles and static objects near the specific road. A second set of echo data is received for each EM profile with the radar-enabled vehicle, wherein the second set of echo data is used to detect a vehicular presence travelling in the forward direction on the selected lane behind of the radar-enabled vehicle. Thus, the radar-enabled vehicle is provided with the location of one or several vehicles behind the radar-enabled vehicle, so that the automated driving system can again eventually distinguish between those vehicles and static objects near the specific road. Such positional data is crucial to improving the effectiveness of automated driving systems.
In many scenarios, a road must be wide enough to accommodate heavier traffic flow. To adjust for this possibility, the specific road includes at least one adjacent lane to the selected lane, as represented in FIG. 11. The specific road may, in this case, be a multi-lane highway, a busy urban intersection, or a variety of other common road configurations. A third set of echo data for each EM profile is received with the radar-enabled vehicle, wherein the third set of echo data is used to detect a vehicular presence travelling in the forward direction on the adjacent lane ahead of the radar-enabled vehicle. Thus, the radar-enabled vehicle is equipped to monitor vehicles that are diagonally ahead, so that the automated driving system can again eventually distinguish between those vehicles and static objects near the specific road. A fourth set of echo data for each EM profile is received with the radar-enabled vehicle, wherein the fourth set of echo data is used to detect a vehicular presence travelling in the forward direction on the adjacent lane behind the radar-enabled vehicle. This arrangement enables the radar-enabled vehicle to monitor vehicles that are diagonally behind so that the automated driving system can again eventually distinguish between those vehicles and static objects near the specific road.
It is further likely that the radar-enabled vehicle is traveling on a road with traffic in the opposite direction in the immediately adjacent lane. To allow the radar-enabled vehicle to respond to such a scenario, the specific road includes at least one adjacent lane to the selected lane, as represented in FIG. 12. The at least one adjacent lane may be to the left or to the right of the driver depending upon the laws of the country. A fifth set of echo data for each EM profile is received with the radar-enabled vehicle, wherein the fifth set of echo data is used to detect a vehicular presence travelling in an opposite direction on the adjacent lane ahead of the radar-enabled vehicle. Thus, the radar-enabled vehicle is equipped to monitor to cars that are diagonally ahead so that the automated driving system can again eventually distinguish between those vehicles and static objects near the specific road. A sixth set of echo data for each EM profile is received with the radar-enabled vehicle, wherein the sixth set of echo data is used to detect a vehicular presence travelling in the opposite direction on the adjacent lane behind of the radar-enabled vehicle. Thus, the radar-enabled vehicle is equipped to monitor to cars that are diagonally behind so that the automated driving system can again eventually distinguish between those vehicles and static objects near the specific road.
The geographic classification system described briefly in Step C may work in conjunction with an EM profile to determine topology and road conditions. To this end, a specific profile is compared to each geographical classification with the automated driving system in order to identify a matching classification from the plurality of geographical classifications, wherein the specific profile is from the plurality of EM profiles (Step G), as represented in FIG. 13. Comparing the specific profile to each geographical classification allows for the determination of differences for subsequent analysis. The matching classification is assigned as the corresponding classification for the specific profile with the automated driving system, if the matching classification is identified by the automated driving system (Step H). Thus, the corresponding classification may be subsequently utilized in the determination of relevant road features. The specific profile is appended into the geographical classifications as a new classification with the automated driving system, if the matching classification is not identified by the automated driving system (Step I). This arrangement enables the addition of new types of objects and features of the road into the automated driving system. The new classification is assigned as the corresponding classification for the specific profile with the automated driving system, if the matching classification is not identified by the automated driving system (Step J). In this way, unexpected objects are noted and processed in relation to the digital map. Finally, a plurality of iterations is executed for Steps H through J, wherein the specific profile in each iteration is a different profile from the plurality of EM profiles (Step K). Thus, all of the EM profiles are geographically classified along the specific road.
The system requires a mechanism by which to compare and recognize road features. To this end, a matching threshold managed by the automated driving system is provided, as represented in FIG. 14. The matching threshold is the minimum amount of similarities that need to be shared between an EM profile and a geographical classification in order for the geographical classification to be designated as a matching classification for the EM profile. A profile-similarity score between the matching classification and the specific profile is assessed with the automated driving system. In this way, the automated driving system generates a value related to the similarity of the matching classification to the specific profile. The matching classification is next updated with a modification based on the specific profile with the automated driving system, if the profile-similarity score is less than or equal to the matching threshold. In this way, automated driving system is able to refine and update each geographical classification.
The present invention may utilize a variety of devices in order to obtain and distribute collected information. The automated driving system is thus provided with at least one multiple-input multiple-output (MIMO) antenna, as represented in FIG. 15. The MIMO antenna is a device capable of performing a practical technique for sending and receiving more than one data signal simultaneously over the same radio channel by exploiting multipath propagation. A signature scanning beam of the MIMO antenna is configured with the automated driving system by referencing the EM digital map. The signature scanning beam contains data to be received or transmitted as relevant, along with a unique identifier key enabling encryption and decryption.
The automated driving system must further be equipped to perform scanning operations in a highly efficient manner. To improve the efficacy of the data collection and transfer process, the automated driving system is thus provided with at least one MIMO antenna, as represented in FIG. 16. The MIMO antenna is a device capable of performing a practical technique for sending and receiving more than one data signal simultaneously over the same radio channel by exploiting multipath propagation. A geospatial detection range of the MIMO antenna is compared to the corresponding point for each EM profile with the automated driving system in order to identify at least one proximal profile from the plurality of EM profiles, wherein the proximal profile is located within the geospatial detection range. This arrangement enables determination of an EM profile within the working range of the MIMO antenna. A signature scanning beam of the MIMO antenna is optimally oriented with the automated driving system by referencing the corresponding point for the proximal profile on the EM digital map during Step F. This allows the signature scanning beam to be directed in a way to maximize its detection capabilities.
The present invention further benefits from the ability to codify data for secure transmission. To enable this process, the automated driving system is provided with at least one MIMO antenna, as represented in FIG. 17. The MIMO antenna is a device capable of performing a practical technique for sending and receiving more than one data signal simultaneously over the same radio channel by exploiting multipath propagation. A geospatial detection range of the MIMO antenna is compared to the corresponding point for each EM profile with the automated driving system in order to identify at least one proximal profile from the plurality of EM profiles, wherein the proximal profile is located within the geospatial detection range. This arrangement enables determination of an EM profile within the working range of the MIMO antenna. A coding-and-decoding process for a signature scanning beam of the MIMO antenna is optimized with the automated driving system by referencing the corresponding point for the proximal profile on the EM digital map during Step F. The coding-and-decoding process is any of a variety of data encryption and decryption mechanisms by which information may be identified and securely transmitted.
The present invention may further be utilized to direct consumer vehicles, driving both automatically and manually. To achieve this, the automated driving system is provided with a mobile auto-radar system, as represented in FIG. 18. The mobile auto-radar system generates an updating map denoting all relevant objects. Echo-detection data is received at a known geospatial point along the specific road with the mobile auto-radar system. The echo-location data may be utilized to determine the presence or absence of relevant objects. The known geospatial point is compared with the corresponding point for each EM profile with the automated driving system in order to identify a proximal profile from the plurality of EM profiles, wherein the proximal profile is located closest to the known geospatial point. Thus, the automated driving system registers objects as being similar or dissimilar from existing or expected objects upon a given road. The automated driving system then distinguishes dynamic objects from static objects within the echo-detection data by referencing the corresponding point for the proximal profile on the EM digital map during Step F. Thus, the automated driving system can respond appropriately and distinctly in response to other vehicles, which would be filtered from the echo-location detection data, as opposed to road features, which have been mapped in the EM digital map.
Supplemental Description
An innovative EM Digital Map is our invention for V2X communication and automatic driving auto radar.
As can be seen in FIG. 3, the present invention will now be described as following: EM profile is built for a road point that is descript in a digital map as (X, Y), for each point in digital map a EM profile is built denote as
(x,y).
For a road location (x,y) the profile set
(x,y) contents:
- a. the receiving echo characters from cars in the same direction, ahead of radar distance ranger (1, 500) meter;
- b. echo characters from cars in the same direction, Behind of radar distance ranger (1, 500) meter;
- c. echo characters from cars in the same direction, but in adjacent lane (s) ahead of radar distance ranger (1, 500) meter;
- d. echo characters from cars in the opposite direction, but in adjacent lane (s) ahead of radar distance ranger (1, 500) meters;
- e. echo characters from cars in the opposite direction, but in adjacent lane (s) behind of radar distance ranger (1, 500) meters;
- f. The test scenario in covers many variables, such as number of surrounding cars in all lanes and all possible car number N ∈ {0, N} in M ∈ {1, M}; and
- g. Typical multiple antenna array output is recorded and classified with corresponding geographical class.
Machine learning algorithms are used to construct EM propagation profile and to associate with a particular geographic class whose features are extracted by AI classification algorithm from digital map.
As can be seen in FIG. 4, once enough road tests are accomplished and the EM geographic road class is available, further EM map construction would be much simplified. By verify and calibrate the class profile for the location (x,y) There for any road location, the Digital EM maps would be established. The EM digital map will be able to deduct the EM propagation profile without to do road test.
Road geophysical feature extraction is accomplished by AI machine learning to build a group of geographical features that are relevant and important to EM propagation, especially for millimeter wave and other wireless communication wavelength.
As can be seen in FIG. 5, road test results for each geographic class is used to predict an EM profile class for each Geographical feature. It will be iteratively verified by real test data, modify the class profile, or created new class if the test results cannot fit into any built class. This is an iterative process to refine class definition, add new class by comparing test data and existing classes.
As can be seen in FIG. 6, road geophysical feature extraction is accomplished by AI machine learning to build a group of geographical features that are relevant and important to EM propagation, especially for millimeter wave and other wireless communication wavelength. The EM propagation profile will be used in receiving and transmission by making the optimal beam pattern of MIMO transceiver and optimization the code and decode for the transceiver using the knowledge of multiphases and other EM wave propagation features at a particular location on the Digital EM maps. For the base station of wireless communication, such as 4G/5G wireless system, Digital EM profile will enable the base station or access point optimized MOMO transmission and receiving beam pattern, design optimal coding and decoding scheme, such as in OFDM coding cyclic symbol length etc.
The EM digital map will greatly improve detectability and accuracy of auto radar system. By comparing EM profile at the location and MIMO received signal matrix, the radar can instantaneously identify target cars locations and speeds in the radar range for this location. By comparing the output radar multiple antenna array receiver, the auto radar will be able to turn its beamforming by compare received signal with EM profile to determine the surrounding vehicles number and location and directions, then do fine tuning to get precise targets location and speed. In no direct pass radar echo detection situation, the EM Digital Maps play even more important role to make the detection possible.
As can be seen in the FIG. 7, the EM digital will greatly improve Vehicles to Vehicles communication liability and data rate: The EM propagation profile will be used in receiving and transmission by making the optimal beampattern of MINO transceiver and optimization the code and decode for the transceiver using the knowledge of multiphases and other EM wave propagation features at a particular location on the Digital EM maps. For each vehicle in the V2V communication link can dynamically optimize MIMO transmission and receiving beam pattern, design optimal coding and decoding scheme, such as in OFDM coding cyclic symbol length etc. Thus, communication reliability would be greatly improved to achieve higher data rate.
The EM digital will greatly improve V2X communication system capacity, liability and data rate. The EM propagation profile will be used in receiving and transmission by making the optimal beampattern of MINO transceiver and optimization the code and decode for the transceiver using the knowledge of multiphases and other EM wave propagation features at a particular location on the Digital EM maps. For the base station/access point of wireless communication, such as 4G/5G wireless system. Digital EM profile will enable the base station or access point optimized MOMO transmission and receiving beam pattern, design optimal coding and decoding scheme, such as in OFDM coding cyclic symbol length etc.
The EM digital will greatly improve Wi-Fi vehicles network system capacity and communication liability and data rate. The EM propagation profile will be used in receiving and transmission by making the optimal beampattern of MINO transceiver in both access point and terminal vehicle, and to optimize the code and decode for the transceiver using the knowledge of multiphases and other EM wave propagation features at a particular location on the Digital EM maps.
The EM digital will greatly improve 5G vehicles network communication liability and data rate. The EM propagation profile will be used in receiving and transmission by making the optimal beampattern of MINO transceiver and optimization the code and decode for the transceiver using the knowledge of multiphases and other EM wave propagation features at a particular location on the Digital EM maps. For the base station of wireless communication, such as 4G/5G wireless system, Digital EM profile will enable the base station or access point optimized MOMO transmission and receiving beam patent, design optimal coding and decoding scheme, such as in OFDM coding cyclic symbol length etc.
Although the invention has been explained in relation to its preferred embodiment, it is to be understood that many other possible modifications and variations can be made without departing from the spirit and scope of the invention as hereinafter claimed.