The present invention relates to avalanche risk assessment. In particular, the invention relates to ground penetrating radar devices attached to or integrated in skis or other types of equipment designed for travel in or on snow, methods for using such devices to obtain information about snow conditions, and systems for aggregating, processing and distributing information collected from such devices.
Thousands of avalanches take place worldwide during a typical skiing season, and they claim more than 150 lives worldwide every year. In addition, there are material damages for example to snowmobiles and buildings, as well as losses caused by roads being closed, and terrain being made unavailable for travel or recreation. With the growing popularity of off-piste (backcountry skiing), ski mountaineering, and other activities away from the controlled environment of ski resorts, accidents associated with avalanches and other snow conditions may increase in frequency.
Snow avalanches occur as a function of wind and weather, the terrain's inclination and the instability of the snow layers. Avalanches can be naturally triggered by wind, weight added by snowfall, and temperature changes and can be triggered by the weight, movement or vibration of skiers or all-terrain vehicles and snowmobiles going up or down a mountainside.
Today, an off-piste skier can check the snow layers by digging a snow profile to get a cross section of the snow cover and make a qualitative assessment of the snow layers stability. The method has its weaknesses: it is time consuming, it can be risky (it is not recommended to dig snow profiles in steep or unstable terrain), and it can be difficult to interpret the results for people who are not experts or have had specialized training. Market research has shown that less than 20% of backcountry skiers feel comfortable digging and interpreting a snow profile and less than 10% regularly assess the snow layers by digging snow profiles.
Related situations that require examination of snow and ice below the surface may not be directly associated with avalanche risk. Examples include examination of ice thickness and quality on frozen lakes and thickness and quality of permanent snow in Arctic and Antarctic regions, on glaciers and the like. Such situations are also usually handled by digging or drilling holes and examining a cross section at a single location.
In view of this situation, it is desirable to find ways of providing skiers with information that can help them reduce their exposure to the risk of triggering or being caught in avalanches. If they are in possession of sufficiently high quality information, skiers may modify their route, avoid making stops in risky areas for non-critical activities such as taking pictures, drinking water, adjusting clothing, etc., increase the security distance between members of their group, or they may decide to dig new snow profiles if information indicates that conditions may have changed.
Ground Penetrating Radar (GPR) fixed on moving antenna constructions such as sledges, GPR fixed on stationary installations placed under the snow, Ultra-Wide Band (UWB) radar mounted on drone or movable antenna slings, and various radar or Doppler installations are currently utilized in academic (skid, climate) research and for commercial purposes (ski resorts) for measuring and monitoring snow layer thickness. None of the existing solutions are small or light enough to be used for large commercial market purposes, and in addition, there are no good processing and visualization solutions that allow radar-induced data on snow layers to be used by skiers or other people while they are moving in snowy terrain.
Consequently, there is a need for solutions that can provide skiers and others with data related to snow conditions and improve the quality of the data that are already available to them.
The innovation contributes to simplification of risk assessment associated with avalanche for skiers and others that move in terrain where avalanches may occur. The invention makes this contribution through further development of radar technology by combining antenna design, data acquisition and data visualization in a completely new way wherein a GPR device is mounted on or embedded in the ski or other equipment that is in contact with the snow during use and enable viewing of the provided data results in real-time using, for example, indicators or buzzers on the GPR device itself, as well as connected smartphones, smart watches and goggles. Furthermore, the acquired data sets can be shared with others in a way that not only makes the data available to more people, but also improves the quality of the available information. By connecting the obtained snow layer information with other available information including slope angle measurements, topography, weather, historical avalanche information and more, the invention aims at contributing to a significant reduction in accidents involving people. The invention contributes to collection of large amounts of data regarding snow conditions without investment in infrastructure and equipment and without requiring that experts be sent into the field to obtain snow data and make assessments. The information can be collected over large areas and from remote locations since the only requirement is that someone equipped with a device according to the invention actually skis through the area.
In order to facilitate understanding of the invention and explain how it may be worked in practice, non-limiting examples will be described with reference to the accompanying drawings, in which:
In the following description of various embodiments, reference will be made to the drawings, in which like reference numerals denote the same or corresponding elements. The drawings are not necessarily to scale. Instead, certain features may be shown exaggerated in scale or in a somewhat simplified or schematic manner, wherein certain conventional elements may have been left out in the interest of exemplifying the principles of the invention rather than cluttering the drawings with details that do not contribute to the understanding of these principles.
It should be noted that, unless otherwise stated, different features or elements may be combined with each other whether or not they have been described together as part of the same embodiment below. The combination of features or elements in the exemplary embodiments are done in order to facilitate understanding of the invention rather than limit its scope to a limited set of embodiments, and to the extent that alternative elements with substantially the same functionality are shown in respective embodiments, they are intended to be interchangeable. For the sake of brevity, no attempt has been made to disclose a complete description of all possible permutations of features.
Furthermore, those with skill in the art will understand that the invention may be practiced without many of the details included in this detailed description. Conversely, some well-known structures or functions may not be shown or described in detail, in order to avoid unnecessarily obscuring the relevant description of the various implementations. The terminology used in the description presented below is intended to be interpreted in its broadest reasonable manner, even though it is being used in conjunction with a detailed description of certain specific implementations of the invention.
The present invention provides several aspects that can be combined into a system for improved monitoring and warning of snow conditions that may represent a risk of avalanches. The first aspect relates to the way data about snow conditions may be obtained, while additional aspects relate to aggregation of such data, processing of aggregated data, and sharing of processed data.
With the exception of structural details that are specifically developed for a particular type of equipment, for example devices or antennas adapted for integration in skis, the devices and methods described herein are adaptable for use with a wide range of equipment including not only skis, but also snowboards, snow shoes, ski poles, snowmobiles, all-terrain vehicles (ATVs), snowcats, snow groomers, and even boots and shoes or remote operated vehicles (ROVs). For ease of understanding, the examples described herein will primarily describe embodiments where GPR devices are mounted on or integrated in skis, but the examples may be generalized to other types of equipment.
Reference is first made to
These layers can be examined in detail by digging a snow profile, which is a time consuming process that can only be performed in order to obtain general information about an area or specific information about a particularly risky hillside. It is not practical or realistic for skiers to dig new snow profiles every time they move into new terrain, and many skiers lack the necessary skills to draw the right conclusions even if they do dig a snow profile.
The skier 101 shown in
The transmitter 11 and the receiver 12 may be implemented as a single device or as two units mounted on different locations on a ski 10. For the purposes of the present disclosure, the combined transmitter 11 and receiver, 12 will be referred to as a GPR device and this term is intended to cover both alternatives. As such, a GPR device 13 may comprise a GPR transmitter 11 and a GPR receiver 12 implemented as a single unit, or a GPR device 13 may comprise one GPR transmitter 11 unit and one GPR receiver unit 12. Furthermore, the computing capabilities carried by the skier 101 may be implemented solely in the GPR device 13, or it may be distributed between the GPR device 13 and a portable device 14. In the present disclosure, unless otherwise specified, reference to communication between a GPR device 13 and a remote server is intended to cover any combination of processing of data in the GPR device 13 or by an application on the portable device 14 prior to exchange of data with the server.
Reference is now made to
Furthermore, as mentioned above a GPR device 13 according to the invention may be provided with Bluetooth or other short-range communication capabilities enabling communication with a portable device 14 carried by the skier for further processing of data and display of rich information to the skier on a display of the device 14. The portable device 14, or the GPR device 13 itself, may also be provided with wide area communication capabilities able to establish communication with e.g. a cellular base station 15 for upload of data to a remote server. Such communication may, for example, be based on 4G/5G or LoRa-WAN, which are well known to those with skill in the art. When communication between the GPR device and a remote server is referred to in the present disclosure, this is intended to cover direct communication from the GPR device itself as well as communication between the portable device 13
It should be realized that the short range communication between GPR devices 13 illustrated in
The back end server 17 may implement a service where data is transmitted back to the GPR device 13 in order to enhance the information available to the skier. The back end server 17 may also provide additional web services, for example by serving web pages including maps where avalanche risk is indicated.
The back end server 17 may thus access data available from the cloud and it may implement or otherwise utilize one or more machine learning algorithms or strategies in order to recognize patterns and extract information from these large datasets. The machine learning strategies may be implemented on the back end server 17 itself, or they may be available as cloud services from centralized servers 20. Examples of such services include Microsoft's Azure and Google's Cloud Machine Learning Engine.
Having thus described the overall functionality and structure of the system as a whole, a more detailed description of the GPR device will now be given with reference to
The central component of the GPR device is a low power microcontroller 401. The microcontroller 401 is connected to and controls multiple sensors. The multiple sensors may include a radar transceiver 402, a GPS receiver 403, an accelerometer 404, a gyroscope 405 and a temperature sensor 406. Some embodiments may only have a subset of these sensors, and additional sensors may be included, for example a tiltmeter, and an electronic compass. No attempt will be made to explicitly list all possible configurations of sensors that may be included. Any sensor that provides data that may be obtained from other sources or is considered unnecessary may be omitted in a particular embodiment, as a design choice that may be made by a systems designer. For example, positioning information may be obtained from a GPS receiver included in the portable device 14.
The micro controller 401 could be used in conjunction with a component dedicated to machine learning, such as a co-processor optimized for pattern recognition (Google Edge TPU, Nvidia GPU, Intel® Movidius™ Myriad™ VPU). This component may then be used to implement pattern recognition algorithms locally (i.e. in the GPR device 13) in manner that is simpler in terms of development cost and complexity. This may also contribute to faster response and lower power consumption.
The GPR device 13 may further include local memory 407 where data may be stored temporarily or permanently by the microcontroller. The local memory 407 may be implemented in any suitable memory technology known to those with skill in the art. Typically a flash memory technology may be selected, for example Secure Digital (SD) or eMMC.
The GPR device 13 is furthermore provided with communication interfaces. In the exemplary embodiment illustrated in
Wireless communication interfaces may include WiFi 409, Bluetooth 410, and a communication capability able to establish WAN communication, for example a cellular (mobile phone) standard.
Depending on the computational power of the microcontroller itself and the amount of signal processing performed locally by the GPR device 13, a digital signal processor (DSP) 412 may also be included.
The GPR device 13 will also include antennas. The radar transceiver 402 is connected to one transmitting antenna 412 and one receiving antenna 413. These antennas will be described in further detail below. The GPS receiver 403 and the radio communication modules 409, 410, 411 will also be connected to one or more antennas 414.
Some embodiments of the GPR device 13 may also include some kind of user interface 415 for output of alerts or other information to the user, for example in the form of a small display, LEDs, audible alarms, and also buttons or switches for turning the device on and off or changing modes of operation. The user interface 415 will hereinbelow also be referred to as a risk assessment indicator 415, but this should not be interpreted to exclude the possibility of outputting other information than risk assessments over the user interface 415. In some embodiments the user interface 415 on the GPR device 13 includes two LEDs. One of these LEDs, when lit or of a specific color e.g. red, may then indicate that the steepness of the slope is above a certain threshold value, for example 30°. The other LED, when lit, may indicate that the risk assessment resulting from the processing of the radar data, as will be discussed further below, is above a certain level. If both LEDs are lit, this may be taken as an indication that the risk of an avalanche is high and that the user should move to a safer area. If only the LED indicating risk based on radar data (e.g. detected presence of a weak snow layer) is indicating danger, this can be interpreted as a warning against moving into steeper areas and a warning to look out for other skiers higher up that may trigger an avalanche.
In addition to the components described above, the GPR device 13 will also include a number of additional components that are not shown in the drawing because they are well known by people with skill in the art. Such components include a power source, for example a chargeable or replaceable battery, a system clock, communication buses, and antenna impedance compensation circuits. The battery, or any other power source included in a GPR device 14 according to the invention, should, of course, be capable of operating at cold circumstances.
The radar transceiver 402 is controlled by the microcontroller 401 to operate in a manner similar to methods used in seismic exploration, with a source emitting a transmitted signal and a receiver recording a received signal that is the result of reflection of the transmitted signal by the layers of the snow at various depths.
In seismic exploration, the source signal is acoustic or elastic waves that penetrate to substantial depths of the Earth's crust. The present invention, however, is designed to penetrate to a maximum depth of approximately 10 meters into layers of snow and transformed snow. The invention therefore uses high frequency electromagnetic waves transmitted and received by radar antennas 412, 413 that can be attached to or fitted inside a ski, preferably without affecting its robustness and with a minimum of adverse impact on manufacturing.
The radar transceiver 402 may be a microwave radar system integrated on a single CMOS chip that can act as ground-probing radar. Such a radar transceiver can be manufactured with a small size, low power consumption, and as a System-On-Chip (SoC) device. An example of such a chip is XeThru (XeThru is a trademark) which is an SoC device with small size and low power consumption. The availability of this device, which is made by Novelda AS of Kviteseid, Norway) made it possible to test aspects of the invention very early in the development project and therefore prove the viability of the concept very early. Google Soli is another alternative, as is The MIT Lincoln Laboratory Localizing Ground-Penetrating Radar (LGPR)
An exemplary embodiment of the transmitting antenna 412 and receiving antenna 413 is shown in
The drawing in
It is, however, consistent with the principles of the invention to design antennas with other dimensions, including for the use with other frequencies, and to provide the transmitting antenna 412 and the receiving antenna 413 on separate substrates, for example in order to position them further apart on the ski 10.
The antenna patterns 503, 504 are directed downwards toward the snow, while the ground plane 502 and the connectors 506 are directed upward.
In some embodiments of the invention, the antennas and in some cases also the GPR electronics, may be embedded in the ski when the ski is produced. However, other embodiments are configured for being retrofitted. With the configuration of the antenna shown in
This gives the following combinations, all of which are consistent with the principles of the invention. First of all it is possible to integrate both the antenna component 500 and the GPR device 13 in the ski. It may be necessary to provide the antennas 414 for GPS reception and wide area network communication on the outside of the ski, or they may be embedded just below the top surface of the ski. This embodiment may require that a rechargeable battery can be wirelessly charged or that the ski is provided with a connector for charging. Secondly, all components may be provided on the outside of the ski. The simplest embodiment representing this alternative is one where all components are provided in one unit which is mounted on the top of the ski. However, it is also possible to distribute components between several units, for example one or more antennas and one or more units containing the electronics. A third alternative is to embed the antenna component 500 in the base or core of the ski and mount the GPR device 13 including external antennas 414 on the top of the ski. The GPR device 13 may according to this alternative either be permanently mounted, or it may be releasably mounted to the top of the ski. Again it is possible to distribute functionality between several units. One possibility is to include some electronics in a holder that is permanently attached to the ski 10 and additional electronics in a device that may be removed from the ski and transferred to another ski with another, similar holder. For example, the radar transceiver may be placed in the permanently attached holder, removing the need for high frequency radio signals to be transmitted over a releasable connector between a removeable device and a permanently attached holder. Such a connector may be worn or exposed to ice, snow and water, which may cause reflections that will corrupt the radar signal.
Embodiments representing some of the alternatives mentioned above will now be described with reference to
The core or the base of a ski 10 has been provided with a recessed area 601 with substantially the same shape and size as the substrate 501. This may for example be done with a milling machine. In addition, two holes 602 have been made such that they are able to receive the connectors 506 and that a connector, wire or cable can pass through them and connect them to the GPR device on the other side of the ski.
In embodiments where the antenna is embedded in the ski 10 the recessed area 601 and the holes 602 are provided in the core of the ski. In embodiments where the antenna is embedded in the base of the ski 10 after the ski has been produced, the recessed area 601 is milled into the base and the holes are 602 are drilled all the way through the ski 10.
In either case, the antenna component 500 is glued into the recess 601. This will position the antennas 412, 413 as close to the snow as possible, either in direct contact with the snow if the antenna component 500 is embedded in the base, or with only the base separating the antenna component 500 from the snow if the antenna component 500 is embedded in the core.
In some embodiments, the ski 10 is provided with an embedded antenna during production, but the GPR device 13 is not provided with the ski. The embedded antenna does not add any substantial costs to the ski 10, but the GPR device 13 is comparatively much more costly and may not add any value to persons who only ski where there is no avalanche risk whatsoever. In these embodiments, it is unnecessary to drill holes through the layers on top of the core. Instead, a metal cylinder (not shown) fitting each hole 602 may be placed inside the holes such that they establish inner walls of the holes. This may be done for two reasons, namely in order to guide the drill bit when the hole is completed from the top of the ski through the layers above the core in order to provide access to the connector. The metal cylinders may also help prevent an excess of glue from moving up through the hole, something that may deteriorate the connector.
If the antenna is embedded in the ski during production, once it has been glued in position in the recess 601, the remaining production steps of adding all the layers around the core remain unchanged.
In one embodiment, the antenna component is embedded in the ski and markings are printed on the top layer of the ski indicating where the connectors 506 are positioned. Holes can then be drilled through the top layers and down towards the connectors at a later time if and when it is desirable to mount a GPR device 13 on the ski 10.
A similar embodiment is illustrated in
The embodiment shown in
The embodiment in
In other embodiments of the invention, the antenna component 500 is not embedded in the ski 10. Instead, it is integrated in the GPR device 13. The antenna component 500 illustrated in
Reference is now made to
As already described above, all electronic components may be embedded in the GPR device 13, or some components may be embedded in the holder 705. Examples of components that may be included in the holder 705 are the radar transceiver 402 and associated radio frequency components, possibly as a system on a chip (SOC). In this case the connectors 706 between the GPR device 13 will be a single digital interface and no radio frequency interface. Depending on how components are distributed between the holder 705 and the GPR device 13 the connectors or contacts 706 may include both a digital and a radio frequency interface.
It should be noted that for the sake of convenience the removable component is referred to as the GPR device 13 also with reference to embodiments where the actual radio frequency components are all included in the holder 705. The GPR device 13 will still include the microcontroller 401, the memory 407, and other components that control the radar transceiver 402 and that process data received from the radar transceiver. The term GPR device 13 is therefore not limited to devices that actually include radio frequency components, but also include devices that are configured to control radio frequency components.
When determining which components to include in a removable GPR device 13 it will typically be relevant to consider cost of the components in order to be able to reuse expensive components on several pairs of skis, and also to consider data portability in order to be able to accumulate data in one device and based on configuration made on one device, as well as the ability to connect the removable device to a computer for data transfer and configuration.
Having thus described embodiments representing exemplary designs of the physical and electronic configuration of the devices carried by a skier, a description of the operation of the GPR radar and corresponding signal processing will be presented.
Returning first to
The GPR radar determines the transit time of the reflected signal and uses the transit time to calculate the depth of the reflecting layer. GPR radars can be classified as operating either in the time domain or in the frequency domain. A GPR operating in the time domain may transmit baseband pulses or noise modulated pulses. A GPR transmitting baseband pulses uses extremely short pulses that may be considerably shorter than the wavelength of the carrier wave. This is done to achieve a high bandwidth signal and the resulting waveform has a shape similar to a Mexican hat. It is therefore often referred to as a “Mexican hat” wavelet, or more formally as the negative normalized second derivative of a Gaussian function. Other Gaussian pulse shapes are also possible.
A noise-modulated GPR emits a random waveform as the transmitting signal, and detection of the reflected signal is based on optimal correlation between transmitted signal and received reflection. Due to the unpredictable spreading of energy across the bandwidth of the radar, the noise-modulated GPR reduces the amount of disturbance to others operating in the same bandwidth.
GPRs operating in the frequency domain include Frequency-Modulated Continuous Wave (FMCW) and Stepped Frequency FMCW (SFCW). FMCW radars may transmit a frequency sweep signal (chirp) or, in the case of SFCW, a sequence of individual frequencies. GPR radars operate in the frequency domain are slower than time domain radar systems, but they may be simpler and thus cheaper to produce. The transit time is obtained using inverse fast Fourier transformations.
The different types of radar systems described above may involve different advantages and disadvantages with respect to speed, cost, penetration depth, resolution and the amount of information that can be extracted from the signal in addition to transit time. Different embodiments of the invention may use any one of the radar systems described based on design criteria with respect to system performance.
In addition to transit time, which can be used to calculate depth to layer transitions, additional information about the snow layers can be determined from additional characteristics of the received reflected signal, such as the envelope, or shape, of the signal. In particular, while time between emission and reception will be indicative of the depth and location of transitions between layers, the amplitude, frequency response and shape of the received pulse will depend on dielectric properties of the snow, in particular dielectric permittivity, ε*, magnetic permeability, μ*, and electric conductivity σ*. Thus, it will be possible to characterize these properties based on measurement of amplitude and shape, and from the dielectric properties it is possible to derive characteristics of the snow, such as water content, density, ice-particle shape, etc.
Reference is made to Complex dielectric permittivity measurements from ground-penetrating radar data to estimate snow liquid water content in the pendular regime, by John H. Bradford, Joel T. Harper and Joel Brown, Water Resources Research, Vol. 45, available from https://agupubs.onlinelibrary.wiley.com.doi/abs/10.1029/2008WR007341, and first published Aug. 5, 2009. This article, which is hereby incorporated by reference in its entirety, describes how reflected amplitude and frequency spectrum can be used to estimate snow properties, and the methods described are used to implement some embodiments of the invention.
By repeatedly transmitting and receiving pulses while at the same time keeping track of positional data received from a positioning capability of the GPR device 13, such as a GPS receiver 403, possibly enhanced by additional data from for example an accelerometer 404, an inclinometer or gyroscope 405, and external data received over a wireless interface 409, 410, 411, it is possible to characterize the snow layers along the skier's track with considerable accuracy. The radar pulse may be a wide band pulse which may be frequency modulated, for example as a frequency-swept pulse (chirp).
Information about the snow layers derived from the reflected radar signal can be presented on the display 900 of the device 14 graphically, for example in the form of the color or background pattern of the area behind the curves 901, 902, 903, 904s), color or other characteristics of the curves themselves (for example in the form of a diffuse curve), and by other means that are found suitable for conveying this information. A trained person may then be able to estimate the avalanche risk simply by looking at the display, which will show an estimate of a snow profile along the track covered by the skier. It will be understood that the presentation of this information in and of itself is not part of the invention and that any convenient way of conveying information generated by the invention to a user may be selected.
In order to provide untrained skiers with adequate warnings the alert area 905 presents an estimated level of risk based on further processing of the available information. In some embodiments, this estimate is based on a function, or a set of rules, which maps input data extracted from the radar reflection signal to output risk assessment. This function may be preinstalled on the device and subsequently updated from the cloud service as will be described in further detail below. In some embodiments the function is a trained model (sometimes referred to as a pre-trained model) that has been generated through machine learning performed on aggregated data. An example of such a process will be described below.
As described above with reference to
Reference is now made to
It should also be noted that while the flowchart illustrates the process as a series of discrete steps that are performed one after the other and not repeated until the process returns to that step, an actual embodiment will run many of these steps in parallel. For example, the GPR device 13 will transmit radar pulses (or radar frequency sweeps) continually, for example, some embodiments will emit 200 or more pulses as one measurement, or trace, and one trace takes less than 10 ms. Traces may be generated and stored at specific times, for example every second, or at specific distances, for example every 10 m. The received information is processed as soon as it is obtained, and the online service aggregates, processes and distributes information whenever it is received or requested.
In a first step 1001 the radar transceiver 402 transmits a radar pulse (or frequency sweep) using the transmitting antenna 412. This pulse is reflected by layer boundaries in the snow as described above and received by the transceiver 402 over the receiving antenna 413 in step 1002. The received reflected signal may then be processed by the microcontroller 401, possibly in cooperation with a co-processor 412, for example a DSP. The signal processing may first include pre-processing, performed as step 1003, in the form of frequency filtering and clutter filtering. The preprocessed data is then stored with locally aggregated data in local memory in step 1004. In a following step 1005 the locally aggregated data is delivered as input to a function, or a set of rules, that maps reflected radar data to an output that may include an estimated snow profile and a risk assessment. This function is preinstalled on the GPR device 13, but may be updated from the cloud service during use, as will be described in further detail below.
The data delivered as input to the function may, in addition to radar reflection data, include other relevant information received from the cloud service, including for example, weather data, wind, the number of hours an area has been directly exposed to sunshine, historical avalanche data and other relevant information that can be accepted by the function as input.
In embodiments where the GPR device 13 is provided with some sort of user interface (LED, buzzer, or something similar) with a risk assessment indicator, this indicator may now be updated 1006 if there is a change in risk assessment.
The new data may now be transferred 1007 to the portable device 14. Depending on the embodiment the data that is transferred may be one or more of the raw radar data, the pre-processed radar data, and the output from the snow profile and risk assessment generating function. It should be noted that it is within the scope of the invention to include all functionality in the GPR device 13 itself, in which case the steps described here as performed by the portable device 14 may be performed by the GPR device 13.
The transferred data is received 1008 by the portable device 14, for example over a Bluetooth interface. In some embodiments, the data may be further processed by the portable device 14. The snow profile information and risk assessment may then be displayed 1009 on the display of the portable device 14. Furthermore, the data may be uploaded 1010 to an online service 17 using, for example, a cellular network. The data uploaded to the online, or cloud, service 17 may be any combination of one or more of the raw radar input from step 1002, the pre-processed data from step 1003, and the result of the analysis in step 1005. According to the embodiment described in the following description, at least raw or pre-processed radar data is uploaded.
The online service may be configured to receive or obtain data from other online services and aggregate 1011 this information. This aggregated information may include radar data provided by other GPR devices as well as other relevant information for example relating to weather, wind, humidity, historical avalanche information etc. The online service 17 receives, in step 1012, data from the GPR device 13 and the data may now be processed 1013 together with aggregated data received from other GPR devices 13 as well as other online services. The actual processing may be performed by the server or servers providing the online service themselves, by dedicated hardware, or by another online service, for example a cloud computing platform providing machine learning and artificial intelligence. The processing performed by the online service 17 will be described in further detail below.
The result of this processing may now be used to update snow profile information and avalanche risk assessment that is stored by the online service and made available to GPR devices as well as other devices, for example as a web site. In addition, the processing may result in an updated snow profile and risk assessment function, as will be described in further detail below. This updated function may also be distributed to GPR devices. The data thus provided 1014 by the online service 17 is received 1015 by the portable device 14. The information may then be added 1016 to the locally aggregated data and it will thus be available the next time the step 1005 of analyzing aggregated data is performed. This process may continue as long as the GPR device 13 is active.
While the process is described above as flowing from one discrete step to another, it will be realized by those with skill in the art that many of the process steps are performed in parallel and continuously. As such, steps 1001 and 1002 are performed repeatedly, for example by emitting between 100 and 1000 pulses as one measurement, or trace. One trace may take between inns and 100 ms. Traces may be generated and stored at specific times, for example every 0.1 seconds up to every 5 seconds, or at specific distances, for example every 10 m or anywhere between every 2 meters and every 30 meters. The received reflected signals are processed and stored locally subsequent to being received irrespective of which other steps illustrated in the drawing are performed simultaneously. Similarly, external data may be received from the cloud intermittently and independently of the ongoing radar pulses, and the processing of local aggregated data in order to update of risk assessment and display of information on the portable device may at any time utilize all the latest data that has been received and added to the local memory 407.
Similarly, exchange of data between the GPR device 13 and the portable device 14 can be performed concurrently with the operation of the radar transceiver 402 and the processing of the resulting data.
The online service 17 may receive data in parallel from many GPR devices as well as other sources of information mentioned above, and the processing, aggregation and distribution of data may utilize any data that is available when the processing, aggregation or distribution is performed.
It will also be understood that the distribution of tasks between the GPR device 13 and the portable device 14 may be arranged differently, for example by processing or storing data in the portable device 14. Indeed, in some embodiments the GPR device 13 may include wide area communication capabilities and a display and perform all the steps described above as being performed by the portable device 14.
The steps illustrated in
In
In a first step 1201 the analog radar reflection signal is digitized. This is the same step as step 1101 in
In a next step 1202 the digitized reflection signal is pre-processed in order to remove noise and other unwanted artifacts. This step corresponds to step 1102 in
In step 1204 data inversion is performed to build a model of the snow conditions. This may take additional information into consideration, i.e. data obtained from other sources or additional knowledge about snow profile modeling. Data inversion as such is well known from the field of geological exploration.
Synthetic data may now be generated from the model. The synthetic data may be included in a training set that will be subject to supervised machine learning in step 1205. Synthetic data is used because it gives better control over the input to and the output from the machine learning process and makes it possible to modify the model based on other knowledge that which is inherent in the radar data. However, in alternative embodiments the data inversion and generation of synthetic training data is replaced by unsupervised machine learning for identification of clusters or patterns in the radar data. These clusters or patterns can be used to label the radar data based on best guess estimates, and the labeled radar data is used for supervised machine learning similar to synthetic data supervised machine learning as described above.
The machine learning process may generate a function that associates snow conditions with snow parameters, and potentially also with avalanche risk. In step 1206 the supervised machine learning may be expanded to include other data, such as weather, historical avalanche information from the relevant area etc.
The machine learning is performed in two steps (data inversion and synthetic data generation or unsupervised learning, followed by supervised training) in order to create labels (parameter values) for the training set. A potential advantage with the data inversion model is, as already mentioned, greater control over the input to the machine learning that actually generates the trained model. The data samples received from GPR radars all include the same type of information (radar reflection signal, position, slope, temperature), and all this information relates to the same occurrence (the same position and point in time), making the data well suited to unsupervised machine learning as well as data inversion. Other information, such as weather (current as well as historical), historical avalanche information, topography, etc., cannot be directly related to individual samples, but may be used to make more general modifications either to the model generated through data inversion, during the supervised training, or both, providing increased accuracy to the trained model for a given area or given conditions.
The process then moves on to step 1207 where a finalized parameter generation and risk assessment function, or a corresponding set of rules, are generated. This function is transferred or distributed to GPR devices in step 1208 where they can be used to generate local risk assessment based on real time radar data (step 1104 in
The steps illustrated in
Reference is now made to
Based on the model, synthetic data can be generated, and the synthetic data can be used to further train, test and validate the model using machine learning 1305.
As described with reference to
Finally, parameter supervision can be used in step 1306 to verify that the parameters estimated by the trained function correspond to parameters established through data inversion modelling.
The process described with reference to
The accuracy and the resolution of the snow analysis can be improved based on additional tools. For example, it is possible to combine multiple radars and antennas along the ski as well as on both skis. Furthermore, as the skier moves across the snow surface, multiple radar measurements taken at multiple times and locations may be combined based on positioning information provided by a GPS receiver. Correlation between measurements taken closely together in space and/or time may be used to distinguish relevant information from noise and other unwanted artifacts in the received signal.
In order to penetrate deeper into the layers of snow, or to cancel noise interferences, the signal from the source may be more complex than just a pulse signal, for example a frequency sweep signal (chirp). This may necessitate pre-processing of the received signal using correlation, deconvolution and filter algorithms. These algorithms may be executed by the DSP 412.
The present invention is designed to penetrate to a maximum depth of approximately 10 meters into layers of snow and transformed snow. The actual depth of penetration may depend on current conditions such as the density, character and water content of the snow, as well as design choices such as transmitting power, number and design of transmitting and receiving antennas, signal shape, processing power, etc.
While the invention has been described above in the context of being used by skiers who have GPR radar devices mounted on their skis (or similar equipment such as snow shoes, sled or toboggan), and for the purpose of obtaining avalanche risk assessment, the invention may be adapted to other application areas. Some examples are described below.
Embodiments of the invention more related to environmental research include equipping expeditions going to very remote areas (such as the north and south poles) with the invention in order to record ice and snow thickness over long periods without having to carry heavy equipment and without dedicating any time to this activity. In the context, the invention will remain unchanged, however the firmware in the GPR device may be updated to make less frequent measurements and therefore extend the typical battery life of the system. The radar may also be configured differently to not focus on thin snow layer resolution but rather on penetrating deeper into the snow layers.
Another possible application is checking that ice thickness is safe on lakes and rivers before vehicles and people are allowed access. The invention could be used to determine if roads and ski trails should be open or closed during the winter season.
A further possible application is for checking the crust layer of any type of ground, such as the top layer determination of for example a desert ground, volcanic active area, ground frost thickness, crust above tundra (summer), tundra thickness and other.
Although the applications discussed above describe the use of GPR devices, it should be understood that the same objective may be achieved using other techniques, for example transmitters/receivers/transducers for ultrasound, to provide the ground reflection signal.
For some of the above applications, it may be convenient to consider designing a larger antenna.
Number | Date | Country | Kind |
---|---|---|---|
20181273 | Oct 2018 | NO | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/NO2019/050201 | 9/30/2019 | WO | 00 |