The present invention relates to radar equipment, and more particularly to radar equipment implemented in a communication device.
There is a growing need for applications that run in mobile phones and other types of modem-equipped devices to be aware of objects and events in their surroundings as well as their position. Different sensor options for enabling this awareness include radar and cameras. There is no need to exclude one option in favor of another because information from different sensors can be combined in a process called “sensor fusion” to create a more complete picture.
Conventional technology has considered providing a mechanism for making mobile communication devices radar-capable. For example, both US Patent Application No. US 20170329449A1 (B. Silverstein and Eden Sherry, “Systems, Methods, and Devices for Utilizing Radar-Based Touch Interfaces”, November 2017) and U.S. Pat. No. 8,004,454B2 (M. Lindoff and M. Blomkvist, “Mobile Electronic Device Equipped With Radar”, Aug. 23, 2011) describe equipping such devices with a dedicated radar chip so that they can detect objects in the vicinity. But while most mobile phones have a camera, radar sensors are still not widely implemented. One rare exception is the Google Pixel 4 phone, which incorporates a dedicated radar chip to achieve the desired functionality.
The current solution for equipping communication devices with radar capability has only a short range application that requires only low resolution (e.g., gesture recognition and detecting objects in proximity of the device). In addition, the current solutions requiring dedicated radar chips inside the mobile device lead to increased cost and the need provide additional space in the device.
As another solution, U.S. Pat. No. 9,945,934 B2 (D. Corcos and D. Elad, “Radar Integration With Handheld Electronic Devices”, April 2018) describes mounting a phased array on the device to add a frequency modulated continuous wave (FMCW) radar. Such a solution is proposed for vehicle communication.
However, integrating long-range and high-resolution radar chips inside the mobile phones or mounting a radar enabling mounting case on the device can increase the cost and size of a mobile device substantially. The reason is that the size of an antenna array must be many wavelengths to create a narrow beam for high angular resolution.
There is therefore a need for radar-enabling technology that addresses the above and/or related problems.
It should be emphasized that the terms “comprises” and “comprising”, when used in this specification, are taken to specify the presence of stated features, integers, steps or components; but the use of these terms does not preclude the presence or addition of one or more other features, integers, steps, components or groups thereof.
Moreover, reference letters may be provided in some instances (e.g., in the claims and summary) to facilitate identification of various steps and/or elements. However, the use of reference letters is not intended to impute or suggest that the so-referenced steps and/or elements are to be performed or operated in any particular order.
In accordance with one aspect of the present invention, the foregoing and other objects are achieved in technology (e.g., methods, apparatuses, nontransitory computer readable storage media, program means) that includes a communication device having a modem and a transceiver, wherein the modem comprises digital baseband circuitry for generating a digital baseband signal for transmission, and the transceiver is configured to receive the digital baseband signal from the modem and to generate therefrom a radiofrequency signal for transmission by the communication device. The communication device controls the modem to operate in a first mode, and controls the modem to operate in a second mode. The first mode is a radar mode in which the modem generates radar baseband signals for transmission as one or more radar radiofrequency signals by the transceiver, and the second mode is a communication mode in which the modem generates information-containing baseband signals for transmission by the transceiver.
In accordance with an aspect of some embodiments consistent with the invention, the modem further comprises radar signal processing circuitry, and operating the modem in the first mode comprises receiving a baseband radar reflection signal from the transceiver; and operating the radar signal processing circuitry using the received baseband radar reflection signal as input.
In accordance with an aspect of some embodiments consistent with the invention, a signal correlation is performed using the radar baseband signals as reference signals against which the baseband radar reflection signal is compared.
In accordance with an aspect of some embodiments consistent with the invention, when operating in the first mode, the modem is configured to generate the radar baseband signal from a radar baseband sequence. In some of these embodiments, this includes generating the radar baseband sequence; and supplying the radar baseband sequence to an Orthogonal Frequency Division Multiplexing, OFDM, modulator, wherein the radar baseband sequence is configured to cause the transceiver to generate the one or more radar radiofrequency signals as one or more OFDM pulses. When operating in the second mode data representing information is supplied to the OFDM modulator, wherein the data representing information causes the transceiver to generate the radiofrequency signal as information-containing OFDM symbols.
In some but not necessarily all of these embodiments, supplying the radar baseband sequence to the OFDM modulator comprises supplying the radar baseband sequence to a resource element mapping portion of the OFDM modulator that is also used by the modem when operating in the second mode.
In some alternative embodiments, operating in the first mode includes generating the radar baseband sequence as a sequence configured to cause the transceiver to generate the one or more radar radiofrequency signals as one or more Frequency Modulation Continuous Wave, FMCW, signals.
In accordance with an aspect of some embodiments consistent with the invention, the one or more radar radiofrequency signals are transmitted in a directional beam.
In accordance with an aspect of some embodiments consistent with the invention, one or more antenna panels are used when transmitting the one or more radar radiofrequency signals.
In accordance with an aspect of some embodiments consistent with the invention, the radar baseband sequence is selected from at least a first radar baseband sequence and a second radar baseband sequence, wherein the first radar baseband sequence causes the one or more radar radiofrequency signals to have a first pulse width and a first amplitude, and the second radar baseband sequence causes the one or more radar radiofrequency signals to have a second pulse width and a second amplitude. The radar radiofrequency signals produced from the first radar baseband sequence differ from the radar radiofrequency signals produced from the second radar baseband sequence by at least one of:
In accordance with an aspect of some embodiments consistent with the invention, the communication device is configured to base selection of the radar baseband sequence on a targeted detection range interval.
In accordance with an aspect of some embodiments consistent with the invention, the one or more radar radiofrequency signals are transmitted using an unlicensed portion of a radiofrequency spectrum.
In accordance with an aspect of some embodiments consistent with the invention, the communication device operates in a time duplex mode in which transmission of the one or more radar radiofrequency signals and reception of radar reflection signals occur at non-overlapping times.
In accordance with an aspect of some embodiments consistent with the invention, the communication device operates in a full duplex mode in which transmission of the one or more radar radiofrequency signals and reception of radar reflection signals occur at overlapping times.
In accordance with an aspect of some embodiments consistent with the invention, the communication device is a millimeter wave, mmWave, communication device.
In accordance with an aspect of some embodiments consistent with the invention, the communication device is configured for operation in a 5G communication network.
In accordance with an aspect of some embodiments consistent with the invention, the modem operates in the first mode and in the second mode.
The objects and advantages of the invention will be understood by reading the following detailed description in conjunction with the drawings in which:
The various features of the invention will now be described with reference to the figures, in which like parts are identified with the same reference characters.
The various aspects of the invention will now be described in greater detail in connection with a number of exemplary embodiments. To facilitate an understanding of the invention, many aspects of the invention are described in terms of sequences of actions to be performed by elements of a computer system or other hardware capable of executing programmed instructions. It will be recognized that in each of the embodiments, the various actions could be performed by specialized circuits (e.g., analog and/or discrete logic gates interconnected to perform a specialized function), by one or more processors programmed with a suitable set of instructions, or by a combination of both. The term “circuitry configured to” perform one or more described actions is used herein to refer to any such embodiment (i.e., one or more specialized circuits alone, one or more programmed processors, or any combination of these). Moreover, the invention can additionally be considered to be embodied entirely within any form of nontransitory computer readable carrier, such as solid-state memory, magnetic disk, or optical disk containing an appropriate set of computer instructions that would cause a processor to carry out the techniques described herein. Thus, the various aspects of the invention may be embodied in many different forms, and all such forms are contemplated to be within the scope of the invention. For each of the various aspects of the invention, any such form of embodiments as described above may be referred to herein as “logic configured to” perform a described action, or alternatively as “logic that” performs a described action.
An aspect of the herein-described technology is the addition of radar functionality to a mmWave communication device (such as a 5G cellular phone) with slight hardware modifications, where the 5G beamforming mmWave transceiver, together with its RF front end components and antenna array, are shared between radar and communication modem. In a mmWave communication device, the RF transceiver, RF front-end components and the antenna array are generally integrated into a single module, called “antenna panel”, or “antenna module”. The term “antenna panel” is used herein to refer to such a module.
There are different ways in which radar functionality can be performed. One of these is “monostatic radar” in which a single device both transmits a radar signal and receives its reflections. Monostatic radar requires a radar device whose transmitter and receiver are collocated.
In one alternative, “bistatic radar” is a radar system comprising a transmitter and receiver that are separated by a distance that is typically comparable to the expected target distance.
And in another alternative, “multistatic radar” is a radar system containing multiple spatially diverse monostatic radar and/or bistatic radar components with a shared area of coverage. It can contain one or more receivers processing reflected signals from one or more geographically separated transmitters. For example, the radar system may include one receiver and multiple transmitters, or multiple receiver and one transmitter, or multiple receivers and multiple transmitters.
The technology can be embodied in a number of different ways:
Depending on its RF circuit and radar mode, the communication device can generate different types of radar signals. For example,
When implemented as a monostatic radar, the mmWave transceiver needs to receive and transmit radar signals simultaneously, or pseudo-simultaneously by quickly switching between reception and transmission. A fast antenna switch can be implemented so it can switch extremely fast between receive and transmit modes. This would have a much lower cost than adding reliable and high isolation between the transmitter and receiver. A description of one example of a suitable fast antenna switch can be found in PCT Patent Application Number PCT/EP2020/064810, filed on May 8, 2020 and entitled “Fast Antenna Switch”.
The exemplary embodiment illustrated in
To further lower the hardware cost associated with providing radar capability in a communication device, the radar baseband processing can be implemented in the modem baseband, that is, using the modem (or part of the modem) to realize radar functions. An exemplary embodiment is shown in
The baseband part 303 includes a modem 309 that, in an aspect of embodiments consistent with the invention, is capable of operating in two different modes:
Aspects of the exemplary communication device 301 of
Aspects of a communication device such as the exemplary communication device 301 will now be described in greater detail, beginning with a discussion of radar signal generation by the modem 309.
Depending on its RF circuit and radar mode configuration, the communication device 301 can generate different types of radar signals. For example, for a device acting as a monostatic radar device, possible configurations depend on whether the device is capable of full-duplex operation or time-duplex operation:
For two devices acting as a bistatic radar, neither device is required to have full-duplex RF transceiver capability, so this is not a necessary consideration. An OFDM symbol can be generated by one of the devices as a radar signal for reception as a radar signal reflection by the other. Of course, the same is also viable when there are more than two devices configured as a multistatic radar group.
As mentioned above, a number of embodiments configure an OFDM symbol for use as a radar signal that can be generated by, and transmitted from, the communications device. In the modem 309, an OFDM radar signal is generated from a radar sequence injected to the OFDM modulator, and mapped to antenna panels for beamforming. Looking at this in more detail,
As is typical in a modem found in a communication device configured to transmit OFDM signals, data intended for uplink transmission 401 is generated and supplied to the modem 309 where it undergoes initial processing 403 that includes:
The next step in uplink data communication is resource element mapping 405 of the so-far processed uplink data to be transmitted. But in an aspect of embodiments consistent with the invention, the radar sequence can be generated (407) by a DSP in the modem 309. The available communication UL reference signal sequence, such as a Zadoff-Chu sequence typically used for a 5G sounding reference signal (SRS), can be used for this purpose.
The generated radar sequence is injected (409) directly to an OFDM Resource element mapping block 405 and then to the OFDM modulator (IFFT) 411 and beamformer 413 to generate an OFDM radar signal. As shown, the radar signal generation can be performed within the physical layer baseband processing. It is noted that this solution is compatible with the use of a cyclic prefix (CP).
In an aspect of some embodiments consistent with the invention, the OFDM modulator 411 has one parameter set for modem communication applications which must be compatible with applicable communication standards; and another parameter set for a radar application which can meet the radar performance requirements. For example, in a radar application, the OFDM subcarrier spacing of the OFDM modulator can be extended from 120 kHz to a much higher value (e.g., 1200 kHz). This leads to the duration of a radar OFDM symbol being reduced from 8.33 μs to 833 ns. In this way, both long radar pulses and short radar pulses can be generated. The short pulses are suitable for finding close in targets, and the long pulses for finding far away targets.
Focusing now on pulse radar signal generation, when the radar is associated with a device operating in monostatic mode, after each pulse there should be a listening interval, listening for a pulse of the type just sent. The amount of time during which listening should occur depends on the target range being aimed for (e.g., a short pulse typically corresponds to a short listening interval). To avoid false detection of targets, however, the time until the next pulse of the same type is listened for must exceed the maximum range of the system. This can be solved using different pulse modulations, and by alternatingly sending pulses of different length, so that a short pulse is followed by a long transmission during which there is no listening.
In one embodiment, an OFDM symbol is generated by using a radar data sequence as a template. Time windows with different widths and/or amplitudes can be applied on the template to generate a train of radar pulses.
In an alternative embodiment, the radar baseband generates pulses and connects directly to the digital-to-analog converter.
In yet another embodiment, the amplitude of the radar pulses can be controlled so that the short pulses have low amplitude while the long pulses have higher amplitude. With wider frequency bandwidth, the short pulses can be used to detect a target in short range with good resolution. With narrower frequency bandwidth and higher transmission power, the wide pulses can be used to detect a target in long range. The reduced power of the short pulses improves Adjacent Channel Leakage Ratio (ACLR). To further improve ACLR the ordering of the pulses should be optimized differently, for instance as shown in
It should not be inferred from this discussion, however, that pulse width and amplitude should always be linked as just described. To the contrary, there is no necessary coupling between pulse width and amplitude. For example, a short pulse with increased amplitude can find use with respect to enabling a longer detection distance with high resolution even though it presents a greater risk of causing interference to other devices.
In yet another embodiment, by adding phase/frequency modulation (e.g., a frequency sweep chirp) on the long pulse, it is possible to mitigate the problem of high spectral density at the center frequency.
As mentioned earlier, for example with reference to
When running in monostatic mode, the reference signal of the correlator can be extracted from the local radar signal generator.
When the radar on the device is in bistatic (or multistatic) mode, a device acting as radar transmitter can send its radar sequence to a base station (or to another device by device-to-device (D2D) communication). A device acting as radar receiver can fetch the sequence of the transmitted radar signal via modem DL communication from the base station (or from another device via D2D communication).
As mentioned earlier, in advantageous embodiments the communication device 301 is configured to operate as a device in, for example, a 5G communication network. Therefore, coexistence with other network components is a consideration.
In one embodiment a device 301 can send a request to the base station it is connected to, asking for its radar application. The base station acknowledges the request and allocates radar radio resources for the device out of the pool of communication network resources. To assist the base station with the selection of appropriate resources, a device 301 may extract the required RF properties of its radar signal from the radar application layer and send the information to its modem which transmits the information further to a base station (or a server).
One benefit of this is that the base station can allocate RF resources for both radar and communication among the devices in the network. Therefore, interference to base stations and other devices can be avoided. The communication and radar functions can co-exist.
The radar function can be configured to operate in any of the following different ways:
These duplex methods can also be combined. The radar signal of a device can also be aligned with communication signals in the time/frequency domain for the sake of power saving and interference avoidance. For example, the transmission/reception of radar signals can be scheduled in a way that bundles them with the device communication wakeup occasions (e.g., for paging) when the device is in the communications standard defined RRC IDLE/INACTIVE mode. Therefore, the device does not need a separate wakeup event to transmit/receive radar signals.
To further illustrate aspects of the technology consistent with the invention, a rough example with accompanying calculations will now be presented. Assume an available RF bandwidth of 400 MHz. In such a case, the radar pulses can be as short as 2.5 ns, which corresponds to 0.4 meters of minimum sensing distance. Adding a switch delay of 1 ns increases the minimum distance to about 0.6 meters. If the maximum distance to be sensed is 20 meters, then the pulse length becomes 133 ns. If the device listens for reflections for 266 ns a margin is provided that allows the measurement of echoes of targets with up to 40 meters distance. The total time for the long pulse and listening becomes 400 ns, while for the short pulse it is 7.5 ns. The average becomes 205 ns, so in the 8333 ns of an OFDM symbol it is possible to have 40 pulses of different lengths, for example in 0.5-meter distance steps.
To further illustrate this example, reference is again made to
When the radar signal is increased to full amplitude (=1) in the 133 ns long pulses for maximum range, an effective ACLR was calculated by using the in-channel 400 MHz power of the OFDM signal divided by the adjacent channel power of the radar signal. The calculation results in ACLR1=40 dB (with ACLR1 corresponding to the 400 MHz channel spanning from 27.4 GHz to 28.8 GHz), ACLR2=47 dB (with ACLR2 corresponding to the 400 MHz channel spanning from 27 GHz to 27.4 GHz).
Using the radar equation (shown below), an estimate of the reflected signal power level was obtained from the transmitted radar pulses and the maximum detectable range. Considering a monostatic radar with a carrier frequency of 28 GHz and 400 MHz bandwidth, an antenna gain of the RF transceiver is assumed to be 20 dB and its receiver noise figure is 8 dB. The radar sensing target has a radar cross section area of 0.1 m2. Below is the estimated RF link budget and maximum detectable range for radar pulses with different durations and different transmitted power levels.
Above illustrates how different pulse lengths (400 ns, 10 ns, and 2.5 ns in the example) and power levels are adapted to different distances. This can be made available to applications so that, depending on needs, the device can use different types and amplitudes of pulses dependent on needs (close or far distances) or whether a suite of pulses to scan the environment across a distance interval shall be used. Furthermore, depending on the risk of interference, it might be acceptable to use pulses with lower amplitude without restrictions whereas pulses with higher output power must be restricted and might require coordination from the base station.
Referring now to
By contrast,
Aspects of an exemplary controller 307 that may be employed to cause any and/or all of the above-described actions to be performed as discussed in the various embodiments is shown in
The examples presented so far have all based generation of a radar symbol on the use of an OFDM symbol, but this is not essential to the technology. to the contrary, other types of waveforms can also be generated by the communication device 101, for example Frequency Modulation Continuous Wave (FMCW), and used as a radar signal.
Moreover, the technology is not limited to use in only 3GPP communication devices, but can be extended to communication devices using unlicensed spectrum (e.g. communication devices having a main carrier frequency of 60 GHz).
In some other alternative embodiments, radar transmission need not be coordinated by a central network node. For example, when a device is detecting a target in a short range by using short pulses with low RF transmission power, there is less probability of interference on its base station or other devices. Hence, the coordination by the base station is not needed or not always needed.
In some other alternative embodiments, some variation of the illustrated radar waveforms can be exploited as an RF carrier for data communication.
One potential use case for the technology described herein is in an industrial setting, where there are mobile units (e.g., autonomous carts) that are equipped with a UE for communication and general guidance. In order to navigate properly, both for fine-tuning their position relative to a map as well as to avoid obstacles that might appear, the availability of a radar functionality would be of high value. With a radar function built into the UE, there is no need to add an additional dedicated radar module.
Furthermore, multiple radar reflectors can be placed in the industrial setting, which can be used by the UE to calibrate its radar, extend radar sensing range and improve radar detectability.
In such a use case, the needed detection range could be between a few decimeters to several tens of meters—when it is far from wall and equipment, there could be a need to range more distant objects for positioning, but as it gets closer to obstacles it needs to accurately detect up close. In some scenarios, the frequency at which such radar sensing is needed (e.g., how often) relates to how far the vehicle is from obstacles or points of interest combined with the speed of the vehicle, and as it gets closer to obstacles it is likely to need sensing more often.
The above methods and implementations provide the means to sweep the radar sensing at a broad range of distances, from about 100 meters down to a few meters.
It will be appreciated that the various aspects of embodiments consistent with the invention provide a number of advantages over conventional radar technology, including but not limited to:
The invention has been described with reference to particular embodiments. However, it will be readily apparent to those skilled in the art that it is possible to embody the invention in specific forms other than those of the embodiment described above. Thus, the described embodiments are merely illustrative and should not be considered restrictive in any way. The scope of the invention is further illustrated by the appended claims, rather than only by the preceding description, and all variations and equivalents which fall within the range of the claims are intended to be embraced therein.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2020/069491 | 7/10/2020 | WO |