Patent Application
20250198793
The present disclosure relates to a computer-implemented method for capturing data of surroundings by means of a data capturing unit.
Mobile mapping is used in surveying projects as well as in other applications, such as engineering, entertainment, automotive or robotics, where a 2D or 3D model of an object or environment is required. For these purposes, common mobile mapping systems consist of a sensor unit equipped with LiDAR scanners and/or cameras to create a 2D or 3D model of the environment/surroundings.
Typical mobile mapping systems are vehicle-based systems (e.g. in cars, trains or boats) in which the sensor unit is mounted on the roof of the vehicle and collects data on the surroundings while the vehicle is moving. There are also mobile mapping systems in which the user walks through the surroundings while holding the sensor unit in his hand or carrying the sensor unit on his body, for example as a kind of backpack.
The sensor unit is triggered through a software interface with which the user interacts during the data acquisition/capturing. These interactions with the software interface are needed to trigger different behaviors from the sensor unit to build the 2D or 3D model with the desired levels of accuracy and precision. Examples of interactions of the user with the sensor unit or a control unit for the sensor unit are for example turn on and off the LiDAR scanners and/or the cameras, change sensors settings in real time, adjust map view and check for errors and warnings.
The fact that the user has to interact with the software interface during data capturing in prior art systems means that there is a risk that the user could, for example, make a mistake when switching on the sensor unit and thus not fully capture the data from the surroundings or capture data of specific surroundings, e.g. like military facilities, from which he should not have captured the data. There is also the risk that the user will be distracted by the interaction with the software interface in the case of hand-held systems or vehicle-based systems and thus get lost or even fall or cause a traffic accident. In other words, the user has to both pay attention to the predefined data capturing path (road in case of a car vehicle-based system) but also to the software interface which is a potential accident risk.
In addition, the mobile mapping systems known from the prior art have the further disadvantages that the user must be an expert in handling the mapping system, for example knowing exactly how and when to trigger the sensor unit, and that in the case of a vehicle system at least two users, namely the driver and the operator, must interact with the user interface in order to follow the plan.
Furthermore, the planning of such a surveying operation is a complex task for a human since many factors have to be coordinated. For example, it must be determined how several predefined data capturing paths are to be arranged or lined up so that the data of the surroundings is captured as completely as possible, but the time required for this and the distance to be covered are as short as possible. Such large and complex planning, which is carried out by a human, is very error-prone and also time-consuming and cost-intensive.
All this leads to higher costs per project, potential errors in the final 2D or 3D model due to human interaction and the complexity of the usability due to the introduction of a new technology, as well as a potential source of danger for the user and other people.
Consequently, there is a need for computer-implemented methods and computer systems, which perform the navigation of the user through the surroundings along predefined data capturing paths as well as the control of the data capturing unit, for example a laser scanner or a camera, for the complete data capturing of the surroundings, so that the user can concentrate only on the movement.
It is therefore an object to provide a computer-implemented method, a computer system and a computer program product which overcome the disadvantages of the prior art, particularly in the light of safety, error reduction and cost efficiency.
Another object is to provide a computer-implemented method, a computer system and a computer program product for improved navigation and data capturing of surroundings.
The present disclosure relates to a computer-implemented method for capturing data of surroundings by means of a data capturing unit (e.g. a portable/movable data capturing unit), wherein the method comprises:
A predefined data capturing path can also be described as a “track”, wherein every predefined data capturing path being part of the planned job. A job, therefore, will always be composed by a specific number of predefined data capturing path (tracks). A “transfer path” is every path the user has to follow to reach the start point of the next planned track. Thus, a planned job is a combination of transfers and tracks through which the user must go through to accomplish the desired result. Every track has a start point and an end point representing the limit of the acquisition the user wants to perform. Moreover, they contain specific sensor unit settings such as camera shooting frequency and LiDAR point cloud density previously defined by the user in the planning phase. Because of this, a planned job results in a list of tracks geolocalized on the map through a defined sets of start and end coordinates.
Regarding the step “if the data capturing unit has reached the start position, providing a start command to the data capturing unit, the start command causing the data capturing unit to capture data of the surroundings” of the computer-implemented method, it can be said in other words, once the sensor unit reaches a start point of a planned track, and the necessary conditions are met, the sensor unit will start recording setting up automatically each sensor according to the planned settings. Exemplary conditions to start recording a planned track are (this list is not exhaustive and is not intended to be restrictive, it is merely examples of starting conditions):
After the recording is started the sensor unit will maintain its settings along the track until it reaches the end point where the recording will be interrupted automatically.
The computer-implemented method enables precise navigation of the user to and along predefined data capturing paths in the surroundings from which the data should be captured, as well as accurate and autonomous control of the data capturing unit, for example a laser scanner or a camera, to fully capture the data of the surroundings. This allows the user to concentrate fully on moving around correctly and safely, whether on foot or driving a vehicle. Thus, the computer-implemented method contributes, among other things, to a complete, error-reduced, fast, cost-efficient and safe data capturing of the surroundings and thus solves the problems of the prior art.
In other words, the auto-capture solution solves the prior art problems throughout the complete workflow, from planning to acquisition, allowing a hands-free experience guiding the user through the optimal path while triggering and configuring sensor unit in an autonomous way.
In one exemplary embodiment of the computer-implemented method, the current position of the data capturing unit is continuously monitored by means of at least one of the following (this list is not exhaustive and is not intended to be restrictive):
In a further exemplary embodiment of the computer-implemented method, the method further comprises generating a particularly colored 2D and/or 3D model of the surroundings by means of the data captured by the data capturing unit.
In a further exemplary embodiment, motion of the data capturing unit is provided by
In a further exemplary embodiment, the data capturing unit comprises one or more laser scanners and/or one or more cameras (in other words image capturing units) and is configured to capture 3D point-cloud data and/or image data of the surroundings.
For example, the data capturing unit can comprise a laser scanner, which is configured to capture 3D point-cloud data of the surroundings, and a camera, which is configured to capture image data of the surroundings. Alternatively or in addition to this embodiment, the camera can be configured to capture the 3D point-cloud data, for example, if the camera is configured as a time-of-flight (TOF) camera, and the laser scanner can be configured to capture image data, for example, if the laser scanner is configured to capture a colored point cloud.
In a further exemplary embodiment, the navigation commands are continuously provided to the user
In a further exemplary embodiment, the method further comprises
In a further exemplary embodiment, the method further comprises
Such an obstacle can be, for example, an obstacle on the user's path (e.g. a road closure), so that the user has to make a longer detour and therefore has to leave the predefined data capturing path and therefore certain data of the surroundings of the predefined data capturing path cannot be captured, or an obstacle that covers a certain part of the surroundings (e.g. a scaffold), so that the user can stay on the predefined data capturing path but still cannot capture the data of the surroundings of the predefined data capturing path.
In other words, if a user drives out of track (due to non-plannable circumstances, for example: construction sites or taking a wrong exit on a roundabout), the system will stop the capture and re-route the user to the start point of the track, which will be the leftover of the previous one. Then a new residual track is created, called “residual track” or “track left”. In such a scenario, there is also a possibility to continue capturing in manual mode. Moreover, this embodiment allows to adapt the plan to the real environment changing conditions such as: closed streets, path deviations or voluntary plan change with a specific set of tools.
In a further embodiment, once the data capturing job is finish, a completion report is shown (how much percentage of the planned tracks have been captured) and if not all the planned tracks where captured a new data capturing job will be created by default with the non-acquired but planned tracks for a later acquisition
In a further exemplary embodiment, the method further comprises receiving information regarding the distance which has to be covered to traverse the predefined data capturing path, in particular the distance from the start position to the end position.
In a further exemplary embodiment, the method further comprises receiving information regarding the expected time required to traverse the predefined data capturing path, in particular the time from the start position to the end position.
In a further exemplary embodiment, the method further comprises providing information regarding how a plurality of predefined data capturing paths are arrangeable such that the data of the surroundings, from which a particularly colored 2D and/or 3D model has to be generated, is captured efficiently, in particular such that the shortest possible distance has to be covered and/or the shortest possible time is required.
Such a plan/such information can be imported in the computer system (e.g. Pegasus Field) from an external source or can be defined within the built-in planning module. When the plan is ready the user can proceed with the autonomous acquisition.
In a further embodiment, during predefined data capturing path (track) recording and transfers, guiding instructions are provided to help the user to stick to the plan. After a predefined data capturing path (track) is captured, the user is guided to the next one until the complete data capturing job gets acquired. All the above-mentioned procedure does not require any interaction from the user.
Alternatively or in addition to the embodiment described before, the user can assign different data capturing unit parameters (in other words the sensor unit parameters) to each predefined data capturing path (planned track) and optimize a path/track sequence based on, e.g., his experience and/or on current data, the current data regarding satellite availability and/or the traffic situation to define the most efficient path to acquire the job. The possibility to define different settings to data capturing paths/tracks is important as e.g. the user has to drive through “non-camera allowance” areas (like military areas) where cameras need to be switched off only over a certain part of the track (not necessarily the whole job).
In a further exemplary embodiment, the path information comprises a course of the predefined data capturing path within an environmental map, wherein the environmental map is
The present disclosure further relates to a computer system for capturing data of surroundings by means of a data capturing unit, in particular wherein the system is configured to carry out the computer-implemented method according to one of the embodiments described above, for which the system comprises a computing unit configured
The present disclosure further relates to a computer program product comprising program code which is stored on a machine-readable medium, or being embodied by an electromagnetic wave comprising a program code segment, and has computer-executable instructions for performing, in particular when run on a computing unit of a computer system described above:
In one exemplary embodiment of the computer program product, the program code comprises computer-executable instructions for performing any step in the computer-implemented method according to one of the embodiments described above.
The features listed below may complement the computer-implemented method, thereby forming alternative embodiments previously described in other words. The features are (this list is not exhaustive and is not intended to be restrictive, it is merely examples of possible features):
The computer-implemented method, the computer system and the computer program product have the advantage over the prior art that, among other things:
Given these benefits, the result is a considerable reduction in acquisition times and costs together with an improvement of safety and overall project quality by reduction of human mistakes.
Aspects are illustrated in more detail below, by way of example, with reference to working examples shown schematically in the drawing. Identical elements are labelled with the same reference numerals in the figures. The described embodiments are generally not shown true to scale and they are also not to be interpreted as limiting.
If a 2D or 3D model of a larger surroundings has to be created, e.g. of an entire city district with several streets, wherein the data for this cannot be reasonably acquired with a single data acquisition path, then in a further embodiment of the computer-implemented method, information are provided on how a plurality of predefined data capturing paths can be arranged such that the data of the environment from which a particularly colored 2D and/or 3D model has to be created are efficiently captured, in particular such that the shortest possible distance has to be covered and/or the shortest possible time is required. The individual predefined data capturing paths are connected by further transfer paths, which is illustrated in
In an exemplary embodiment of the computer-implemented method respectively the computer system navigation commands (e.g. “in 200 meters move right”) are continuously provided to the user (e.g. by an acoustic announcement or the indication on a display) to guide the user back to the intermediate end position 7 and then when the user reaches the intermediate end position provide an intermediate start command to the data capturing unit, the intermediate start command causing the data capturing unit to start again capturing data of the surroundings 5.
The environment map 12 shows several streets, wherein data of the surroundings along these streets are to be captured by means of the data capturing device. For example, the user can click on the road map 12 to define a starting point and an end point of the data capture and the computing unit of the computer system then calculates how the predefined data capturing paths are to be arranged accordingly (in other words refinement of the track order) and/or how the corresponding setting parameters (e.g. whether a predefined data capturing path is run/traversed several times) are to be selected in order to ensure the optimum and most (time) efficient data capture. The setting parameters determined by the computing unit can then be taken from the window 13.
Alternatively or in addition to the embodiment of the computer system described above, the user can define the predefined data capturing paths, e.g. by clicking on the respective roads, and/or the setting parameters, e.g. by entering corresponding values, himself and the computing unit of the computer system then calculates approximately how long the entire data capturing process will take and what distance will be covered in total, wherein during the capturing phase, these calculations/estimations are continuously updated based on the remaining part of the plan.
Among other things, the traffic on the roads, the satellite availability, the kilometers to be covered and/or the battery status of the data capturing unit are also taken into account for the respective calculation.
Such an embodiment of the computer system is particularly intended for experienced users who have a precise idea of how exactly the data capturing should be carried out in the corresponding environment or for users who have to react to special circumstances with regard to the data capturing.
In
Although aspects are illustrated above, partly with reference to some preferred embodiments, it must be understood that numerous modifications and combinations of different features of the embodiments can be made. All of these modifications lie within the scope of the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 23217784.0 | Dec 2023 | EP | regional |
