Patent Application
20210192215
In a more general aspect, the present invention refers to a platform for the validation of video images, photographic images, audio recordings or other type of contents, generated by different types of apparatuses.
Before proceeding further, it is only necessary to point out that in this description and in the subsequent claims, reference will be made primarily to contents of video images, audio-video data or photographic images, such as movies, photographs, audio recordings and the like, as mentioned above.
This shall be understood in a broad manner, in the sense that such contents can be considered alone or combined, such as, for example, the audio track and the images acquired from the same apparatus, such as a video camera, or those acquired by different devices, such as video cameras, mobile phones and the like, which can also be in different positions.
Furthermore, the photographic images can derive from frames extracted from a video or can be taken by means of dedicated photographic apparatuses.
Thereby, it should be noted that the validation platform according to the present invention is a complex system in which various parts are included; for simplicity and clarity, in the present description and in the subsequent claims, reference will be made predominantly to some of them: this must not however be understood as a limitation, since the scope of the invention and/or the application thereof also extends beyond the apparatus and the various devices considered here.
Therefore, in a more specific aspect thereof, the invention relates to an apparatus and/or a method for detecting whether a content of images, sounds or other video, audio and/or even video/audio data, relating in particular, but not exclusively, to a road accident, is original or has been modified.
In particular, the invention aims at detecting the presence of any alterations made to the image content, in videos, photographs, in audio-video data or the like, acquired by a general-purpose device, i.e., not specifically dedicated, such as, for example, a mobile phone of the so-called smart type (smartphone), a tablet, a video camera or a camera, either analog or digital, nowadays commonly widespread and used.
For example, for the surveillance and security in general of public areas and in particular of roads, the employment of means for acquiring images, whether in the form of video, photographic or audio-video contents to be reproduced on observation screens (i.e., monitors), or detected in another manner (e.g., with infrared or other electromagnetic waves for thermographic, radiographic or other type of images; sonars or other acoustic probes for ultrasound, sonic and other images) is widespread.
Such contents are often used by subjects responsible for the management of traffic routes (e.g., the police, security forces, etc.) or related situations, such as insurance companies managing road accident practices or courts which must decide on legal cases for damages caused by accidents.
Under these circumstances, the use of fixed video cameras at road intersections, traffic lights or predefined points on the road (and motorway) network, or mobile video cameras on board vehicles (also known as ‘dash cams’) is increasingly widespread.
These cameras are used not only to check traffic routes but also, especially in the case of those mounted on board the vehicles, to acquire images from the point of view of the driver, which can possibly be used as evidence in the event of a road accident.
It is however necessary to observe how the usage of video cameras on board cars is rather common in latest-generation models, to allow a view in reversing operations or even as sensors.
These apparatuses for acquiring images (in the form of the various contents mentioned above) can also be used by individuals and ordinary citizens, in addition to road professionals (taxi drivers, truck drivers, security forces, etc.).
Many of these devices allow to detect an impact caused by a road accident by means of an accelerometer and to permanently or semi-permanently store the video stream before, during and after the road accident. It is worth noting that many of these devices are, in fact, mobile telecommunications terminals (i.e., the latest generation of mobile phones, the so-called smartphones) which implement dash cam functions by executing specific applications capable of acquiring a video stream by means of the video sensor of the mobile terminal when the accelerometer of said terminal detects an acceleration of high intensity but of short duration which can be due to an impact suffered by the vehicle.
Representative examples of this background art are described in the publications of the European patent applications EP 2949510 A1 and EP 2950311 A1, of which the current applicant of the present application is the owner.
This wide diffusion of fixed or mobile terminals and apparatuses for generally acquiring images relating to roads, traffic and traffic routes as a whole, has led to an increasingly wide use of heterogeneous devices, which adopt different technologies and/or standards, thus generating an increase in the quantity and complexity of data relating to video contents.
Since the latter are also more and more often used as evidence in the event of a road accident, especially in court, to attribute responsibility for accidents and obtain or establish compensation from insurance companies, it becomes important to ascertain the authenticity of the images taken with the means mentioned above.
In fact, only some (a few) apparatuses are now recognized as reliable and capable of ensuring the authenticity of the contents of video images, audio-video data, photographic images or the like, relating to road accidents; basically, these are apparatuses similar to the black boxes of airplanes, also known as VEDR devices (acronym of Video Event Data Recorder).
Instead, in the case of images acquired by means of other devices, such as fixed surveillance video cameras or mobile ones of mobile phones or dash cams, etc., the reliability of video, audio, photographic contents or the like is not recognized, especially in court.
It is in fact known that current technologies allow to quite easily process and modify images of a film or of photographs in general; this occurs both for professional (e.g., the post-production of television broadcasts or of cinematographic filming) and recreational purposes (people who share videos on-line with friends and acquaintances, or who do it as their own hobby), but the effect is however that of having a diversity or discrepancy between the original and final images of a video or, in any case, of a series of frames.
It is understandable that such a situation is not compatible with the use of video and/or photographic material as documentary evidence in a judicial or insurance process, following a road accident.
As a result, the increase in quantities and the heterogeneity of video or photographic images has made it difficult for insurance companies or other operators in the sector (e.g., courts) to ascertain the authenticity and/or originality of the material examined, i.e., the correspondence between the images acquired and the facts which they refer to.
Usually these assessments require the human intervention of specialized experts, who examine the material and determine whether it is original or not.
It is apparent that, given the limited availability, the (long) time and the relevant (high) costs of experts for carrying out their work, and considering the increasing quantity of images to be evaluated coming from the heterogeneous sources mentioned above (video cameras, camcorders and similar fixed or mobile apparatuses, mobile phones or other devices on board the vehicles), there is a need to find alternatives which can improve the current state of the art.
In fact, the difficulty in attesting the authenticity or originality of video or photographic images increases the risk of falsification or fraud against motorists, public administrations or insurance companies.
Furthermore, the increase in the risk of frauds or falsifications entails an increase in insurance costs, because it drives companies to allocate this risk to all customers, generally increasing the amount of insurance premiums.
The present invention proposes to solve these and other problems by providing an apparatus and a method for detecting the authenticity or originality of a video or photographic document, intended, in particular but not exclusively, for images related to traffic routes.
The idea underlying the present invention is to detect whether a video content, which can be acquired during a road accident by a general-purpose device (such as, for example, a mobile terminal, a dash cam, a fixed surveillance camera or the like) and relating to a road accident, has been altered, by searching said video content for changes, through automatic processing means, by executing a set of search instructions defining how to identify at least one alteration of the video content following the acquisition thereof.
Thereby, it is possible to automatically verify a high quantity of video contents acquired by means of general-purpose devices which, as is known, do not allow to verify the unalteration of the video, as they produce video contents in digital formats which can be easily modified, since they do not provide for authentication and/or integrity data allowing the verification of the authenticity of the content (i.e., to verify that it has been acquired by a particular device and/or person) and/or of the integrity of said content (i.e., to verify that such a content has not been modified after the acquisition thereof).
Further advantageous features of the present invention are the object of the attached claims.
These features and further advantages of the present invention will become more apparent from the description of an embodiment thereof shown in the accompanying drawings, provided by way of explanation and not by way of limitation, in which:
The reference to “an embodiment” in this description indicates that a particular configuration, structure or feature is comprised in at least one embodiment of the invention.
Therefore, the terms “in an embodiment” and the like, present in different parts of this description, do not all necessarily refer to the same embodiment. Furthermore, the particular configurations, structures or features may be combined in any suitable manner in one or more embodiments. The references used below are only for the purpose of convenience and do not limit the scope of protection or the scope of the embodiments.
With reference to
As an alternative to the communication bus 17, the control and processing means 11, the memory means 12, the communication means 13 and the input/output means 14 can be connected by means of a star topology.
With reference also to
It should be noted that, in the case in which the method in accordance with the invention is executed directly by said server 2, said apparatus 1 can coincide with the server 2, without however departing from the teachings of the present invention. In this configuration, the invention can also be implemented as an additional application (plugin) of a video (or audio/video) content acquisition service relating to road accidents.
With reference also to
Thereby, an insurance company or another user (e.g., an expert, an attorney, a judge) can quickly analyze a video content, thus reducing the risk of fraud; in fact, if a video content is classified as unaltered, the insurance company can proceed with the liquidation of the damage with a lower risk of being cheated, while in the event in which said content is classified as altered, the company may proceed in a different manner (for example, by not accepting the video content and/or by having an expert intervene in the evaluation of the video contents and/or by reporting the person who provided said content to the competent authorities and/or other).
The set of search instructions which is executed during the search step of processing means 11 to search for changes can implement a series of steps which serve to determine if the video content is altered or not based on the type of video sensor which acquired it. In fact, the type of video sensor allows to know the response of the sensor to colors and/or to light, therefore allowing to understand if the video was actually acquired by that type of sensor or if it was altered afterwards.
More in detail, the set of search instructions can configure the processing means 11 to perform the following steps:
This set of features advantageously allows to detect video contents which have been modified by using a photo/video retouching software, since the tools that these softwares make available very easily generate changes which remain in the image or in at least one of the frames (in the event in which the video content is a sequence of frames). Thereby, the probability of automatically detecting a counterfeit video content can be advantageously increased, thus reducing the likelihood of an insurance company being cheated.
Alternatively, or in combination with the above, the set of search instructions which is executed during the search step by the processing means 11 to search for changes can implement a series of steps which serve to determine if the video content is altered or not based on the time instant at which such video content was acquired; in fact, knowing the time and optionally also the date and possibly also the weather conditions, it is possible to estimate the amount of light which was there at the time of the accident and to determine if the content was altered afterwards by comparing the luminance data of the video content with the estimated amount of light.
More in detail, the set of search instructions can configure the processing means 11 to perform the following steps:
This set of features allows to detect the video contents acquired at a different time from the one present in the metadata or declared by the user of the system (for example, because the recorded accident was staged). Thereby, the probability of automatically detecting a video content altered after the acquisition thereof increases advantageously, thus reducing the likelihood of an insurance company being cheated.
As already mentioned above, the mean light can also be calculated based on the weather conditions present at the time of the accident. For this purpose, the apparatus 1 can also be configured to determine the position where the accident occurred and, on the basis thereof, determine the weather conditions present at the time of the accident on the basis of said position and of historical weather data defining the evolution over time of weather conditions in a particular area (for example, the cloud coverage level) and which can preferably be acquired, through the communication means 13, from a weather forecast service (for example, accessible via the Internet) capable of providing the history of all weather conditions in a certain area, for example, of a country, of a continent, or of the entire globe.
More in detail, the set of search instructions can also configure the processing means 11 to determine the mean luminance of at least one image by executing, in addition to the steps defined above, also the following steps:
This further feature further increases the probability of automatically detecting if a video content was altered after the acquisition thereof, as it also takes into account the weather conditions at the time of the road accident. Thereby, the probability of an insurance company being cheated is (further) reduced.
Alternatively, or in combination with the above, the set of search instructions which is executed during the search step by the processing means 11 to trace any changes can implement a series of steps which serve to determine if the video content is altered or not based on the position of the colors and/or of the shapes emitted by luminous signs, such as, for example, a traffic light L, shown in the images of the video content acquired by a general-purpose device 41, 42 and transmitted to the server 2. This allows to (automatically) detect the video contents which have been altered by changing the colors and/or the shapes of indications emitted by luminous signs.
More in detail, the set of search instructions can configure the processing means 11 to perform the following steps:
This set of features allows to detect video contents which have been altered (for example by means of a photo/video retouching software) so as to change the color and/or the shape of the luminous indication emitted by a luminous signal, for example, the video contents in which a traffic light is shown, emitting a green light from the lamp which is in the position above the other lamps, instead of from the lamp which is in the position below the others, or a traffic light emitting a red light from the lamp which is in the position under the other lamps. Thereby, the probability of automatically detecting a video content altered after the acquisition thereof increases advantageously, thus reducing the likelihood of an insurance company being cheated.
Alternatively, or in combination with the above, the set of search instructions which is executed during the search step by the processing means 11 to trace any changes in the image contents can implement a series of steps which allow to determine, by means of a three-dimensional reconstruction technique of the type well known in the background art, if a first image content has been altered by comparing said first video content with at least one second image content. This solution is based on the reconstruction of a three-dimensional scene using at least two video image contents of which the position and orientation of the general-purpose devices 41, 42 which acquired them are known. This approach allows to (automatically) identify any alterations of one of the two contents by analyzing (also automatically) the result of the three-dimensional reconstruction. In particular, if one of the two videos has been altered (for example, by deleting details from the video image content, such as a precedence sign near an intersection, a stop prohibition or the like), the result of the three-dimensional reconstruction will be incomplete, since it will not be possible to place all the objects in the space with a sufficient level of precision.
In other words, the communication means 13 can be configured to receive at least two video contents, and pointing and position data relating to each of said video contents, where said pointing data define at least one position and one orientation which each device 41, 42 had when it was acquiring said content; such pointing and position data can, for example, be generated using the GPS receiver and/or the compass of the smartphone which acquires one of said contents or be specified by the user who sends the content or be already known (in the event of fixed cameras whose position and orientation are known). Furthermore, the set of search instructions can configure the processing means 11 to perform the following steps:
Thereby, the probability of automatically detecting a video content altered after the acquisition thereof increases advantageously, thus reducing the likelihood of an insurance company being cheated.
Some of the possible variants have been described above, but it is apparent to those skilled in the art that, in the practical implementation, also other embodiments exist, with different elements which can be replaced by others which are technically equivalent. Therefore, the present invention is not limited to the illustrative examples described, but is subject to various amendments, improvements, replacements of parts and equivalent elements without departing from the basic inventive idea, as specified in the following claims.
In this regard, with reference to what was initially stated, although the invention is primarily focused on videos of images acquired with fixed or mobile camcorders, video cameras and cameras, the principles herein disclosed can also be extended to images obtained with infrared rays, radars and the like (i.e., radiations not visible to the human eye), or ultrasound images (i.e., obtained with ultrasonic waves).
| Number | Date | Country | Kind |
|---|---|---|---|
| 102017000043264 | Apr 2017 | IT | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/IB2018/052749 | 4/20/2018 | WO | 00 |
