The present disclosure relates to light-based communication systems, and more particularly to light-based communication systems that may be used to determine vehicle position.
Determining the position and distance between vehicles on a roadway is crucial for various autonomous automotive applications. Primarily in safety critical situations, an advanced driver assistance system (ADAS) of a vehicle may automatically alert and/or assist the driver if a collision is imminent. In addition, vehicle position estimation is also important for autonomous vehicle navigation and mapping. The position of a vehicle relative to another vehicle or roadway infrastructure provides information to the planner and the navigation system in determining alternate routes or potential hazards.
Techniques are disclosed for determining vehicle position with respect to another vehicle or an infrastructure using light based communication (LBC). As will be appreciated, the techniques may be embodied in a system. In one such example system, light-based digital messages (LBC messages or other pulsed optical messages) are used in combination with a signal parameter of the digital message (such as a received signal strength indication (RSSI) or signal-to-noise ratio (SNR) value) to estimate the position of the vehicle. Each vehicle may be equipped with one or more LBC systems to communicate with another vehicle using digital messages. Each LBC system may include a transmitter having one or more optical transmitter elements, such as an array of light emitting diodes (LEDs), and a receiver having one or more optical receiver elements, such as an array of photodiodes, for transmitting and receiving LBC messages between the vehicles. In some cases, adjacent diodes (transmitting light emitting diodes or receiving photodetector diodes) may have an overlap region, for example in which a receiver element on a receiving vehicle is able to view a portion of two distinct, adjacent transmitter elements. Likewise, there may be an overlap in receiving a signal where the transmitted signal overlaps with two adjacent receiver elements. The overlap regions may be used in resolving the angle at which the transmitter and receiver are positioned with respect to each other. Both angle and distance are used to determine the relative position of one vehicle with respect to another vehicle. For the purposes of this disclosure, it is assumed that the distance between the two vehicles is known by independent measurement, and thus the present disclosure focuses on techniques for discerning the relative angles of the vehicles.
General Overview
Implementing an LBC system involves a number of non-trivial issues, particularly in communicating between vehicles. For example, some methods for real-time communication in a connected vehicle environment require broadcast transmission in an omnidirectional pattern. Dedicated short range communications (DSRC) data is an example broadcast transmission in a radio-based 360-degree field and all recipients receive the same information. As more vehicles join the connected vehicle network in dense traffic situations, the network may experience congestion and bottlenecks because every vehicle is broadcasting messages. DSRC and other methods use GPS alone or in combination with sensors on the vehicle. GPS generally requires the GPS receiver on the vehicle to have an unobstructed line-of-sight (LOS) view of at least four GPS satellites. GPS has limitations in determining vehicle location due to estimation error (which is typically greater than 1 m, but may be 10 m or greater) and satellite obstruction (which may be caused by tunnels, parking garages, shadowing by tall buildings, etc.). Omni-directional strategies (for example, DSRC) may result in further ambiguities, as there may be an overlap region where more than one transmitter element may be ‘visible’ to (i.e., within the field of view of) a receiver element, or where multiple receivers receive a signal from a same transmitter. This may result in ambiguities in trying to determine the location of the transmitter with respect to the receiver when the overlap exists, because it is unclear to which transmitter the RSSI should be attributed. There is a need, therefore, for directional, specified messages to be transmitted and received, to estimate the position of a vehicle, and provide other appropriate information within the messages. There is a further need for positional, distance based, or proximity based communication that accounts for the overlap region between adjacent diodes.
Thus, in accordance with an embodiment of the present disclosure, a system is provided for resolving the angle of the transmitter and the angle of the receiver used in determining relative vehicle position using light-based digital messages. An LBC message is a pulsed light-based digital message that is transmitted and received using light based communication. The vehicles implement LBC systems that use a signal parameter of the digital message to determine the relative location of one vehicle with respect to the other vehicle. In an embodiment, the LBC system includes a transmitter array of LEDs or other optical transmitter elements and a receiver array of photodiodes or other optical receiver elements. Both the transmitter and receiver arrays are deployed or installed on the vehicle and are coupled to a controller. The controller may be coupled to a memory having one or more program(s) that are executable by a processor of the controller. The overlap region between adjacent transmitters of the transmitting LBC system may be used to further define the angle of the transmitter with respect to a reference point, such as the 0-degree normal, of the vehicle. For example, using the overlap region of the transmitter element, one receiver element may be used to determine the angle of the transmitter based on two messages received, respectively, from two adjacent transmitter devices. Likewise, the overlap region between adjacent receivers of the receiving LBC system may be used to further define the angle of the receiver with respect to a reference point, such as the 0-degree normal, of the receiver vehicle. For example, two receivers may be used to determine the angle of the receiver based on a single message from a single transmitter that is received at both receivers, and using the overlap region of the receiver, to resolve the angle of the receiver. The distance between the two vehicles may be determined independently, for example using time-of-flight methods as implemented using the same light transmitter and light receiver hardware, or by performing triangulation using the RSSI.
LBC-equipped vehicles in close proximity to each other are able to estimate vehicle pose more accurately because, in part, as the vehicles become closer together, the received signal strength indicator (RSSI) becomes larger. Thus, as one vehicle becomes closer to another vehicle, the RSSI becomes larger, and likewise the RSSI decreases as the vehicles move away from each other. Thus, contrary to GPS, the accuracy improves as the vehicles become closer together. It is also true, however, that as the RSSI becomes larger and is easier to detect, this may also cause an overlap area to increase, which may make it difficult to determine which transmitter is transmitting a particular light-based digital message. To address this, the overlap region itself may be used as a parameter to further resolve any ambiguities regarding the angle of the transmitter or the angle of the receiver.
Light-Based Communication (LBC) System
As shown in
It will be appreciated that, although the zones of communication are depicted as having approximately the same angle of transmission as its respective neighbors, in some embodiments the angle of each diode may be varied so that adjacent diodes do not have the same angle of transmission. In some embodiments, the angle may be uniform for all of the diodes that are part of the LBC system. It will also be appreciated that although each LBC system is described as having a plurality of optical transmitter elements (e.g., LEDs), there may be a multi-channel optical transmitter element, having multiple separate channels that each have a separate zone of communication. In some embodiments, each optical transmitter element may have its own LBC system, resulting in multiple LBC systems per vehicle (48 in this example), or in some embodiments a single LBC system may be provided, having multiple optical transmitter elements or one or more multi-channel optical transmitter elements coupled thereto.
Note that there is an overlap with one of the zones of transmission of the driver LBC system 116 is overlapping with the zone of transmission 125 of the front LBC system 114, and another zone of transmission of the driver LBC system 116 is overlapping with the zone of transmission 126 of the front LBC system 114. There is also an overlap between the zone of transmission 129 and 130 and two zones of transmission of the passenger side LBC system 118. Also note that there is an overlap between the zone (or region) of communication 136 of the rear LBC system 112 and one of the zones of communication of the passenger side LBC system 118. This overlap region may be used to resolve potential ambiguities when determining the relative angle of a vehicle, and more particularly the angle of one receiver on a receiving vehicle with respect to one transmitter on a transmitting vehicle.
An example LBC system 210 includes one or more optical transmitter elements 214 and one or more optical receiver element(s) 212, each coupled to a controller 216. The optical transmitter elements 214 may be LEDs or other optical light sources and the optical receiver elements 212 may be photodiodes or other optical receiver elements, in accordance with an embodiment of the present disclosure. The controller is executable by a processor 218 and is coupled to memory 220 which may have one or more programs stored thereon that may be executable by the processor 218. The optical transmitter element(s) 214 may be used to transmit light signals (or other digital messages) to an LBC system of another (receiving) vehicle, and may also be used to send a time-of-flight pulse or other information when applicable. The optical receiver element(s) 212 may be used to receive light signals (or other digital messages) sent from one or more optical transmitter elements of another (receiving) vehicle, and may also be used to receive a time-of-flight pulse when applicable.
The controller 216 is coupled to a memory 220 that includes one or more programs that are executable by a processor 218, depending upon the data analysis and processing to be performed, as will be appreciated in light of the present disclosure. The memory 220 may include any appropriate structure or format for storage of data, including random access memory (RAM), read only memory (ROM), FLASH memory, or any combination thereof. The processor 218 may execute a program stored in memory 220 to determine the relative angular position of two vehicles, in accordance with an example embodiment. Refer, for example, to
As shown in
It is therefore desirable, as shown in
Reference is made to
An overlap region 440 results from the overlap of the first zone 420 of transmission from the first transmitter 410 and the second zone 430 of transmission from the second transmitter 412. Each of the transmitters 410, 412 may be a separate LBC system, or may be two transmitter devices under control of a single controller as part of one LBC system. The overlap region 440 is generally known to each of the transmitters 410 and 412 so that it may be used as a factor in determining the distance between a first vehicle and a second vehicle.
It will be appreciated in light of the present disclosure that data received from two (or more) transmitter elements, and the overlap between the transmitter element and its adjacent transmitter element, may be used by a processor coupled to the receiver element to determine the angle of the transmitter with respect to a reference point, such as the 0-degree normal of the vehicle. In some embodiments, the 0-degree normal may be parallel to the axis of travel of the vehicle. Likewise, two adjacent receiver elements and a single transmitter element, and the overlap region of the two receiver elements, may be used to determine the angle of the receiver with respect to a reference point, such as the 0-degree normal of the vehicle. Similarly, although the overlap of the transmitter with respect to its adjacent transmitter is generally transmitted as part of the message because it is not known to the receiver, the overlap region of the receivers is known, and thus may not be transmitted as part of the digital message.
Although
Resolving Angle of Transmitter and Angle of Receiver
It will be appreciated in light of the present disclosure that various techniques are available for determining the distance between a first vehicle and a second vehicle, and that this disclosure is focused on resolving the angle of the transmitter and/or the angle of the receiver to more accurately determine the angular position and angular orientation between a first vehicle and a second vehicle along a horizontal plane corresponding to a typical roadway.
It will be appreciated in light of the present disclosure that resolving θT includes a single receiver receiving a first digital message transmitted from a first transmitter and a second digital message from a second transmitter in which a processor coupled to the receiver uses the received signal strength of the first message and of the second message and the overlap therebetween to resolve the angle of the transmitter. Likewise, resolving θR includes a first receiver using a first digital message transmitted from a first transmitter that is received at both the first receiver and a second receiver adjacent to the first receiver, in which a processor coupled to the first receiver uses the received signal strength of the first digital message as seen by both the first receiver and the second receiver, and the overlap region therebetween, to resolve the angle of the receiver, as will be appreciated in light of the present disclosure.
Reference is now made to
The boundaries of the region identified in
These and several other ways of using the message signal data for the purpose of increasing the angular resolution of the messages received at the receiver, as will be appreciated in light of the present disclosure. Refer, for example, to
Reference is made to
The information contained in the graph of
It will be appreciated in light of the present disclosure that the principles for determining the angle of the transmitter may likewise be applied to the optical overlap of the receivers to resolve the angle of the receiver. More particularly, determining the angle of the transmitter involves two distinct messages from adjacent channels incident on one receiver, and thus the angle of the receiver may be determined using a single message that is incident on two adjacent receiver channels. Any incoming message from a transmitting vehicle has some probability of registering on both receivers. By dividing the signal strength (in the form of pulse amplitude, for example), of one receiver by that of the adjacent receiver, this results in a ratio that may be checked against previously computed, or otherwise stored, ratios of receiver sensitivity as a function of angle. In principle, this is the same strategy as was used for calculating the angle of the transmitter, except instead of relying on the header of the transmitted message to provide the ratio characteristics. The receiver ratio characteristics are already stored ad they relate to the design of the receiving vehicle system. The ratio characteristics of the receiver may be stored locally for each receiver element, or in multiple memory storage locations each coupled to one or more receiver elements, or in a single memory storage that is coupled to all of the receiver elements, as will be appreciated in light of the present disclosure.
Methodology
Reference is now made to
The first and second digital messages are received as optical signals, and the incoming stream of light pulses are analyzed to discern pulse sequences, as will be appreciated. The incoming photodiode signals are analyzed, and decoded if necessary, to interpret the transmitted message.
At block 814, the method continues by determining, by a processor coupled to the first receiver on the first vehicle, an angle of the first transmitter using the first digital message, the second digital message, and the overlap region identified (or otherwise specified) in the first digital message. The processor is able to determine the angle of the transmitter by measuring relative amplitude of messages received from two different transmitter elements, comparing the ratio of the overlap region to a look-up table or other information, and determining the angle therefrom, as will be appreciated in light of the present disclosure. For example, the receiver may provide the amplitude of the signals to the processor, and the processor measures the amplitude ratio by dividing the amplitude of one signal by the amplitude of another signal. The ratio is then compared to a look-up table or threshold value by the processor to determine the angle of the transmitter. The angle may then be used to determine the angular position and orientation between the transmitter and the receiver, now that the angle of the transmitter has been resolved and any potential ambiguities have been removed.
There are several methods of using the message data for increasing the angular resolution of the messages received at the receiver, as will be appreciated in light of the present disclosure. And likewise, for resolving the angle of the message transmitted at the transmitter. One method includes determining the ratio of the signal strength in accordance with an embodiment of the present disclosure. The boundaries of the region identified in
In another example embodiment, rather than a specific ratio number, a set of ratios may be included that specify the ratios at, for example, one degree increments (for example, the values of
At block 816, the methodology continues by receiving, at a second receiver on the first (receiving) vehicle, the first digital message, in accordance with an example embodiment of the present disclosure. This may be the first digital message received at the first receiver at block 810. Thus, the first digital message has now been received at the first receiver and the second receiver on the second (receiving) vehicle. At block 818, the method continues by determining, by the processor coupled to the first receiver on the first vehicle, an angle of the first receiver. In accordance with an embodiment of the present disclosure, the angle of the first receiver is determined using the first digital message which is received at both the first receiver and the second receiver on the first vehicle, as well as the receiver overlap region. As will be appreciated in light of the present disclosure, each receiver knows the overlap region that it has with respect to its adjacent overlap regions, and thus it may use this information to determine the angle of the receiver, combined with the level of illuminance of the first digital message with respect to the second digital message. Each optical receiver element may have an overlap region stored in local memory of the receiver or in another memory location that is accessible by the receiver or a processor or controller coupled to the receiver.
At block 820, the position of the second vehicle is determined with respect to the first vehicle using the angle of the first transmitter and the angle of the first receiver.
At block 836, the methodology continues by receiving, at the first receiver on the first vehicle, a second digital message. The second digital message is transmitted by the second transmitter on the second (transmitting) vehicle, such that the first message and the second message are received by the first receiver. The methodology continues at block 838 by determining, by the processor coupled to the first receiver on the first vehicle, an angle of the first transmitter using the first digital message, the second digital message, and the overlap region identified in the first digital message.
It will be appreciated in light of the present disclosure that the angle of the receiver or the angle of the transmitter may be determined first, with the other being calculated second, or that they may both be calculated at substantially the same time, once all pertinent data is obtained. Determining the angle of the first receiver element may be performed by a processor coupled to the receivers, using the first digital message received at both the first receiver and the second receiver, and the angle of the first transmitter may be determined using the first digital message and the second digital message received at the first receiver.
At block 840, the methodology continues by determining the position of the second vehicle with respect to the first vehicle using the angle of the first transmitter and the angle of the first receiver. It will be appreciated in light of the present disclosure that numerous techniques may be implemented to determine the distance of the second vehicle with respect to the first vehicle, and any ambiguities in the angle may be resolved by determining the angle of the transmitter and the angle of the receiver.
The data rates for transmission of messages should be fast enough that the time duration of any message is short enough, such that the physical travel speed (km/hr) of the transmitting vehicle does not result in only a partial message being received before that vehicle is no longer within line-of-sight (LOS) of the given receiver. Thus, for example, at 0.5 Mbps data rates, a 30 byte LBC message might theoretically transmit in 0.5 ms resulting in maximum 1.5 cm vehicle movement and a 300 byte LBC message would theoretically transmit in 5 ms resulting in maximum 15 cm vehicle movement, assuming a vehicle speed of 100 km/hr. Thus, in accordance with the techniques of the present disclosure, it is reasonable to assume that most of the time a vehicle will remain within the LOS zone of a targeted receiver for the duration of its transmitted message.
Timing of Transmission of Optical Signals
In accordance with an embodiment of the present disclosure, the robustness of the system may be still further enhanced by providing a timing scheme in which specific channels are assigned to one of a number of different message time slots. In some embodiments, it may be important that two digital messages do not overlap in time at the same receiver, as they may potentially not be interpretable. The various transmitters/receivers, or transmitter/receiver channels, may be configured to deliberately stagger the transmission of their optical signals so that two messages may be received from adjacent channels. For example, each channel or adjacent LED may be assigned to one of three different message time slots. In this manner, adjacent channels should not overlap in time, further refining the robustness of the light-based communication system by ensuring neighboring digital message are transmitted at different times. For example, the channels may be divided into three (or more) groups, in which the first group transmits a first optical signal, and there is a 10 millisecond (ms) delay before the second group transmits a second optical signal, and then another 10 ms delay before the third group transmits a third optical signal.
For example, the channels may be divided into three (or more) groups, in which the first group transmits a first optical signal, and there is a 10 millisecond (ms) delay before the second group transmits a second optical signal, and then another 10 ms delay before the third group transmits a third optical signal. Each of the 48 channels may have one or more optical transmitter elements which transmit, in addition to a basic safety message, a unique header with information specific to the interpretation of that message, including but not limited to the location of the transmitter on the body. By assigning the channels to one of three different time slots, adjacent channels should not overlap in time. It will be appreciated that although the channels are shown and described as being divided into three groups, the channels may be divided into fewer or more than three groups in an embodiment, dependent on the spatial overlap of transmitting and receiving optical characteristics for specific vehicle designs.
The unique header for each message may also identify the angle between the transmitter channels, the ratio of adjacent transmitting channel signal intensity, and a coarse outline of the footprint of the transmitting vehicle relative to the transmitter. In accordance with an embodiment, the coarse outline may include the spatial coordinates of the four corners of the transmitting vehicle, thus outlining a rectangle in space.
Example Head Light, Tail Light, and Side Mirror Structure Implementations
There are at least two additional options for providing the broad angular coverage, as will be appreciated in light of this disclosure. One option is for all of the optical transmitter elements and the optical receiver elements in an array to be uniformly installed within the same geometric plane (e.g., on a flat circuit board), while relying on the different lens characteristics to direct each optical transmitter element beam pattern to a different angle to achieve a wide beam spread. This may require expensive, specialized lenses, for example. Another option is to provide each optical transmitter element with the same type of lens, while relying on a curved substrate (e.g., circuit board) to aim optical transmitter elements in a slightly different direction. For example, as a cylindrical post shown in
It will be appreciated in light of the present disclosure that the term the “angle of the transmitter,” unless otherwise noted, refers to the angle of the transmitter with respect to the 0-degree normal of the vehicle (or another point of reference) whereas the “beam spread” refers to the actual angle of the cone of transmission of the transmitter. Likewise, the term the “angle of the receiver,” unless otherwise noted, refers to the angle of the receiver with respect to the 0-degree normal of the vehicle (or another point of reference) whereas the “acceptance angle” refers to the angle within with a particular receiver may receive a light-based digital message, also referred to herein as the zone or cone of communication of the receiver.
Numerous variations and configurations will be apparent in light of the disclosure. For example, one example embodiment of the present disclosure provides a light based communication (LBC) system including a first receiver deployable on a first vehicle, the first receiver configured to receive a first digital message from a first transmitter deployable on a second vehicle, the first digital message identifying a first overlap region of the first transmitter with respect to a second transmitter deployable on the second vehicle and receive a second digital message from the second transmitter, and a processor coupled to the first receiver, the processor configured to determine an angle of the first transmitter with respect to a reference point on the second vehicle based on the first digital message, the second digital message, and the first overlap region identified in the first digital message.
In some embodiments, the reference point on the second vehicle is a 0-degree normal of the second vehicle, and the first digital message further includes position information identifying a first location of the first transmitter with respect to the 0-degree normal of the second vehicle. In some embodiments, the first digital message further identifies an offset angle between adjacent transmitter channels and a coarse outline of the second vehicle. In some embodiments, the first overlap region is provided as a look-up table of ratios indexed by angles of transmittance, in which each angle of transmittance corresponds to a unique ratio of a first intensity of the first transmitter with respect to a second intensity of the second transmitter. In some embodiments, each ratio is of a first signal amplitude of the first transmitter divided by a second signal amplitude of the second transmitter. In some embodiments, the first digital message further identifies a third overlap region of a third transmitter deployable on the second vehicle with respect to the first transmitter and the second transmitter. In some embodiments, the first transmitter is configured to transmit the first digital message at a first predefined time period, and the second transmitter is configured to transmit the second digital message at a second predefined time period that is different from the first predefined time period. In some embodiments, the first predefined time period is identified in the first digital message, and the second predefined time period is identified in the second digital message. In some embodiments, the first transmitter and the second transmitter are deployable on a base that is curved or cylindrical such that a surface normal of the first transmitter is offset at a predefined angle with respect to a surface normal of the second transmitter. In some embodiments, the system further includes a second receiver on the first vehicle that is configured to receive the first digital message from the first transmitter on the second vehicle, and the processor is further coupled to the second receiver and is further configured to determine an angle of the first receiver with respect to a reference point on the first vehicle based on a first intensity of the first digital message received at the first receiver, a second intensity of the first digital message received at the second receiver, and a second overlap region of the first receiver with respect to the second receiver.
Another example embodiment of the present disclosure provides a light based communication (LBC) system including a first receiver on a first vehicle that is configured to receive a first digital message from a first transmitter on a second vehicle, a second receiver on the first vehicle that is configured to receive the first digital message from the first transmitter on the second vehicle, and a processor coupled to the first receiver, the processor configured to determine an angle of the first receiver with respect to a reference point on the first vehicle based on a first intensity of the first digital message received at the first receiver, a second intensity of the first digital message received at the second receiver, and a first overlap region of the first receiver with respect to the second receiver.
In some embodiments, the first digital message includes information identifying a location of the first transmitter. In some embodiments, the first overlap region is stored in a memory of the first vehicle. In some embodiments, the first receiver and the second receiver are on a base that defines a cylindrical post, such that a surface normal of the first receiver is offset at a predefined angle with respect to a surface normal of the second receiver. In some embodiments, the first receiver and the second receiver are on a substrate having a curved shape such that a surface normal of the first receiver is offset at a predefined angle with respect to a surface normal of the second receiver. In some embodiments, the first receiver is further configured to receive a second digital message from a second transmitter deployable on the second vehicle, the first digital message further identifies a second overlap region of the first transmitter with respect to the second transmitter, and the processor is further configured to determine an angle of the first transmitter with respect to a reference point on the second vehicle based on the first digital message, the second digital message, and the second overlap region identified in the first digital message.
Another example embodiment of the present disclosure provides a method including receiving, at a first receiver deployable on a first vehicle, a first digital message transmitted by a first transmitter deployable on a second vehicle, the first digital message identifying a first overlap region with respect to at least a second transmitter deployable on the second vehicle, receiving, at the first receiver, a second digital message transmitted by the second transmitter, and determining, by a processor coupled to the first receiver of the first vehicle, an angle of the first transmitter with respect to a reference point on the second vehicle using the first digital message, the second digital message, and the first overlap region identified in the first digital message.
In some embodiments, the method further includes receiving, at a second receiver on the first vehicle, the first digital message transmitted by the first transmitter on the second vehicle, and determining, by the processor, an angle of the first receiver with respect to a reference point on the first vehicle based on a first intensity of the first digital message received at the first receiver, a second intensity of the first digital message received at the second receiver, and a second overlap region of the first receiver with respect to the second receiver. In some embodiments, the method further includes receiving, at the first receiver of the first vehicle, a third digital message transmitted by a third transmitter of the second vehicle, the third digital message identifying a third overlap region with respect to both the second transmitter and the first transmitter on the first vehicle. In some embodiments, the method further includes receiving, at a second receiver on the first vehicle, the third digital message from the third transmitter on the second vehicle, and determining, by the processor, an angle of the third transmitter with respect to the reference point on the second vehicle using at least one of the first digital message, the second digital message, the third digital message, and the third overlap region identified in the third digital message.
The foregoing description of the embodiments of the disclosure has been presented for the purposes of illustration and description. It is not intended to be exhaustive or to limit the disclosure to the precise form disclosed. Many modifications and variations are possible in light of this disclosure. It is intended that the scope of the disclosure be limited not by this detailed description, but rather by the claims appended hereto.