Police officers and law enforcement agencies, as well as emergency medical services (“EMS”) responders, are often required to document incidents and generate detailed police reports and incident reports. The traditional process of manually writing police reports can be time-consuming, error-prone, and resource-intensive. As can be seen, there is a need for an efficient and accurate solution to streamline the report generation process while ensuring comprehensive and standardized reports.
The disclosed novel system and method are directing to overcoming or at least reducing one of the above issues experienced with manually created police and EMS reports.
A novel system and method for generating police and/or EMS reports is disclosed and can streamline the process for creating such reports, while providing for more accurate reports and in a preferred embodiment can employ or otherwise use prompts from an artificial intelligence engine for creating such comprehensive reports. Through incorporating AI technology as part of the system, the novel system can assist law enforcement and EMS personnel in generating accurate, consistent, and complete police and/or incident reports efficiently and consistently.
In a preferred embodiment, the system can be an advanced AI-powered platform which can be configured and programmed to streamline report writing preferably in law enforcement and other first responder scenarios. The system can use artificial intelligence algorithms configured to generate comprehensive and accurate reports efficiently. The platform can be customizable for each user in order to meet any specific needs and reporting requirements of the user's organization, company, agency, etc. (collectively referred to as “organization”). As a non-limiting example, customizable report templates can be provided and the system can recognize the specific agency templates to use based on the user's login which can include a specific key identifying the user's organization/agency, etc. Thus, the provided templates provided for use to the user can be tailored to match the user's jurisdiction's standards and formatting guidelines. The system can be preferably accessed by a user through a desktop or laptop, as well as being designed to be mobile-friendly to allow officers/first responders to conveniently access, create, and review reports using the platform/system from their smartphones or tablets while in the field. The system can employ advanced natural language processing and AI algorithms to ensure accurate report generation, while still allowing the review, edit, approve and/or validate a proposed report for accuracy and completeness.
Accordingly, the system/platform provides for a method that requires a few steps to complete a comprehensive and accurate report (i.e. incident report, etc.) and thus saves the user valuable time in creating the report while also minimizing the risk of errors or omissions by the user. Tailored reports for the user's organization can create complying with specific report requirements for organization using customizable templates that can adhere to the standards and formats for the jurisdiction associated with the organization, thus, helping to ensure and consistency and professionalism for the report created using the system and method.
The novel algorithm, which can be AI-powered, is configured to understand and analyze the context of the user's input, which can result in providing intuitive report generation and enhancing overall quality of the report. As the report can be prepared and finalized in a significant reduced amount of time, as compared to prior manually created reports, the user can be provided with additional time to focus on other non-report tasks, while knowing that the report created using the disclosed novel system and method is timely and accurate.
Accordingly, the novel algorithm allows for automation of certain tasks normally involved for generating an incident report and can also sift and search through large datasets and databases to detect patterns or anomalies, which can support or enhance predictive policing/first responder efforts. With the disclosed novel system and method human errors can be reduced, if not minimized, to aid in providing reports that are accurate, consistent and in compliance with any requirements of the organization and which adhere to legal standards in order to be admissible for legal proceedings and investigations.
The novel algorithms of the disclosed system and method can also review and analyze report data for identifying trends, predicting potential crime hotspots and suggesting preventive measures that may be undertaken. Thus, the predictive analytics provided by the novel algorithm can contribute to proactive policing and first responder strategies, which may lead to a reduction in crime rates and an overall enhancement of community safety.
Broadly, a preferred, non-limiting embodiment for the novel system and method is described herein and will describe the system and method in connection with digitally creating a police report as the example report. However, the disclosed system and method are not limited to use for creating police reports, and the system and method can also be used for creating EMS and FireFighter reports (collectively “EMS”), as well as other reports and other first responder reports, based on templates, prompts, etc. programmed or provided in connection with these other types of reports and such other uses are also considered within the scope of this disclosure. The novel system and method allows for generating police reports in an efficient and consistent manner, which addresses some of the problems with manually created reports.
A general process flow for creating a police report is shown in
After a user has logged into their preferably online account, the user can identify themself with their online/digital credentials and a specific encryption key for the agency they are associated with (e.g. specific police department, specific governmental agency, specific EMS company, etc.). In this screen or a subsequent screen that appears of the credentials and encryption key have been digitally entered, the user can be presented and/or chose one or more written prompts that have been previously configured/programed to be linked to specific criminal/law violations/crimes for the police report example (i.e. which could be various medical events or conditions or other information in an EMS report example).
Once the proper violation of the incident is digitally chosen by the user, a new online page of the user's screen can open where users can use voice dictation, audio uploads, video uploads and/or enter text as one or more methods to describe the incident. When information concerning the incident is uploaded and properly described, the user can accept the terms of service and/or the uploaded and incident description, which can cause the system to preferably combine and/or send the inputted/uploaded information with the selected prompt(s) linked to the violation to a trained large language model for further processing and handling of the information.
Preferably, the large language model can be previously provided/configured/programmed with any and all report format requirements of the specific agency associated with the user's encryption key and can be programmed to extract the inputted and/or upload information and generate an accurate report, specific to the format required and/or requested by the specific agency. Thus, the large language model can be programmed to extract and move around the inputted information and place such information in predefined areas required by the specific agency to automatically create an accurate and agency compliant report that the user can copy, print and/or download from the server.
The below non-limiting code example explains the steps of sending the incident details and selected prompt linked to the violation to the large language model and the generation of the accurate report.
The user can be an experienced police officer, who specializes in generating police reports.
The user can give the DESCRIPTION_HERE. The generated answer should preferably follow these following rules:
Example Report from Agency Entered
Preferably, after being digitally sent to a large language model of the system, the LLM can look at the logic explained in the prompt, follow certain guidelines defined in the prompt and create an accurate written report.
As seen in
With respect to
As noted above, as part of their login credentials, the system can receive information or data about the specific organization that the user is associated with or is generating the report for, which will allow the system when opening up the report page for the selected module, to search for preloaded/preconfigured customized templates for the user's organization that are associated with the selected module and if found, the customized template for the organization can be opened and displayed on the user's screen for the report page.
With either a default report page or the user's organization's customized report page displayed on the user's screen, the user can then fill in any text information regarding the crime and upload their body cam footage. After uploading bodycam footage, the system can be programmed/configured to take (i.e. digitally strip/extract, etc.) the audio from the uploaded body cam footage file and/or another user uploaded video file and preferably electronically/digitally sends it to a large language model (“LLM”) or other software based system/program for transcription of the audio. The transcribed audio can then be preferably electronically/digitally returned/sent back to the user and can be displayed as text/data on the user's screen or printed out by the user to allow the user to read through the transcription and make any changes needed to the transcription prior to generating the final report. Preferably, the changes can be made by the user to the text/data on the user's electronic device screen and entered/saved by the user. The transcribed and proofed/approved data and module prompt can be electronically/digitally sent to the LLM or other software based system/program to digitally prepare and write the full report preferably in compliance with any specific requirements for the organization through presenting the user with an organization specific customized template for the module selected by the user. It should be noted, that in addition to or in lieu of bodycam footage, the user can also record audio at the website and the recorded audio can be sent to the LLM or other software based system for transcription (however as the recorded audio can be preferably just audio of the user speaking, the taking or extracting of the audio step described in
Though not considered limiting, preferably a custom LLM, preferably exclusive for the novel system or a third pary machine learning model, including without limitation, the WHISPER machine learning model, or another transcription software program or digital technology vcan be used to reformat the voice or video data from the bodycam footage to preferably a MP3 format and then the LLM of the novel system can be used to transcribe the audio into various supported languages (e.g. English, Spanish, etc.). Preferably, multiple speakers on the bodycam footage can be differentiate by the LLM or other digital transcription technology by an inference of the conversation. It is also considered within the scope of the disclose to train or program the LLM to transcribe events from the bodycam footage just from viewing the video, whether or not the video also contains spoken words, audio and/or other sounds and noises.
With respect to
As noted above, as part of their login credentials the system can receive information or data about the specific organization that the user is associated with or is generating the report for, which will allow the system when opening up the report page for the selected module, to search for preloaded/preconfigured customized templates for the user's organization that are associated with the selected module and if found, the customized template for the organization can be opened up and displayed on the user's screen for the report page.
With either a default report page or the user's organization's customized report page displayed on the user's screen, the user can then fill in any text information regarding the crime and upload their prerecorded audio file or record a new audio file using the novel online system. After uploading the audio, the system can be programmed/configured to recognize that file is already just an audio file so that no stripping or extracting of audio from a file containing more than just audio is needed. The system can preferably electronically/digitally send the audio file to the LLM or other software based system/program for transcription of the audio. The transcribed audio can then be preferably electronically/digitally returned/sent back to the user and can be displayed as text/data on the user's screen or printed out by the user to allow the user to read through the transcription and make any changes needed to the transcription, prior to generating the final report. Preferably, the changes can be made by the user to the text/data on the user's electronic device screen and entered/saved by the user. The transcribed and proofed/approved data and module prompt can be electronically/digitally sent to the LLM or other software based system/program to digitally prepare and write the full report, preferably in compliance with any specific requirements for the organization through presenting the user with an organization specific customized template for the module selected by the user.
With respect to
As noted above, as part of their login credentials the system can receive information or data about the specific organization that the user is associated with or is generating the report for, which will allow the system when opening up the report page for the selected module, to search for preloaded/preconfigured customized templates for the user's organization that are associated with the selected module and if found, the customized template for the organization can be opened up and displayed on the user's screen for the report page.
With either a default report page or the user's organization's customized report page displayed on the user's screen, the user can then fill in any text information regarding the crime, upload their body cam footage, upload their prerecorded audio file, or record a new audio file using the novel online system. After uploading bodycam footage, the system can be programmed/configured to take (i.e. digitally strip/extract, etc.) the audio from the uploaded body cam footage or user uploaded video file, or takes the whole audio file (i.e. extracted from uploaded video and user recorded audio) and preferably electronically/digitally sends it to a large language model (“LLM”) or other software based system/program for transcription of the audio. The transcribed audio can then be preferably electronically/digitally returned/sent back to the user and can be displayed as text/data on the user's screen or printed out by the user to allow the user to read through the transcription and make any changes needed to the transcription prior to generating the final report. Preferably, the changes can be made by the user to the text/data on the user's electronic device screen and entered/saved by the user. The transcribed and proofed/approved data and module prompt can be electronically/digitally sent to the LLM or other software based system/program to digitally prepare and write the full report, preferably in compliance with any specific requirements for the organization through presenting the user with an organization specific customized template for the module selected by the user.
After digitally generating or digitally creating a report, the system can be programed or configured for the user to be able to have the system check the report to ensure that all required information is present in the report. In a preferred non-limiting embodiment, the user can click or select a check button appearing on the user's screen to initiate the system's check of the report, which can also load in another custom prompt that can tell the user if the generated report is missing information.
The “Custom Trained Algorithm” block appearing in the drawings can be considered the customized prompt, which can be provided/programmed/configured with one or more rules for operation, with the algorithm using such rules, the user inputted/uploaded/recorded incident details and the LLM to create a response/report. EMS and other reports can also be completed by filling out sections via data reorganized through the LLM.
The modules can be customized per organization/agency and/or type of crime/incident. For police reports, a plurality of organizations can all have modules for the most common crime types, and during setup or at a later time, the settings for a specific organization can be further updated to add new/additional modules for new crime types and/or one or more of the existing modules can be updated for specific information/data required by the specific organization.
The custom prompts can be the logic inside a module and is where the system informs the LLM what rules and information to use and combine with the user provided incident details.
The steps performed by the computer for combining the raw text input (regardless of origination—body cam, dictated, typed, etc.) with the custom prompt can include configuring the system to replace a specific placeholder inside a custom prompt with the incident details inputted or otherwise provided by the user/officer. As a non-limiting example:
The relational database service (“RDS”) for the cloud computing (e.g. Amazon Web Services—AWS, etc.) preferably used for the system and method can be where the method/process performed by the system ends. When the report is completed and preferably encrypted by the system, the report can be preferably be saved to the database and the user can be provided the option by the system to generate another report without having to start the complete process again.
As noted above, the system preferably incorporates or uses a LLM or back end prompting in connection with performing the novel steps in creating or generating the reports. Preferably, the LLM can be custom and specific to the novel system as opposed to a general LLM. The custom LLM can be hosted on a foundation model, such as, but not limited to, AWS Bedrock. The disclosed preferably has sole access to the LLM (i.e. the LLM is not shared with anyone else), which is unlike common AI applications like Chat-GPT. The custom prompts used by the system can be used by the system for generating reports, for checking reports, or for reorganizing video into reports.
Preferably through the use of AI, the system can also auto caption reports via extensions, such as, but not limited to, chrome extension. As such, in addition to completing the text portion the system can also complete the dropdown portion, to further reduce the time needed to complete a typical entire report to just a few minutes (i.e. around 3 minutes).
In a preferred embodiment, the system can comprise one or more, and preferably all, of the following components:
Artificial Intelligence Prompt Engine: The disclosed novel system can feature or include an AI prompt engine that can employ natural language processing algorithms and machine learning techniques to capture relevant data from an officer-generated written synopsis. For example, the engine can analyze the officer-generated synopsis to automatically and quickly generate context-specific prompts and questions based on the information within the office-generated synopsis. The system can also automatically analyze any available body camera footage provided by the user to generate additional prompts. For example, by analyzing information concerning the incident type, location, or relevant details provided by the individual police officer the AI prompt engine can automatically generate prompts to ensure the officer (or other user) enters all relevant information needed for a particular police report.
The AI prompt engine can present a series of context-relevant questions and prompts to the user based on the entered incident information synopsis and/or body camera information. These prompts can then guide the officer to ensure that all pertinent aspects of the incident are captured that are necessary for the report generation process.
By way of example, an API key from a custom hosted LLM or cloud based LLM can be obtained and code (such as that provided below as a non-limiting example) could be used to implement certain aspects of the disclosed system and method.
Data Input Interface: As discussed above, law enforcement personnel can interact with the system through a user-friendly data input interface. A synopsis can be entered preferably containing certain incident information, such as, but not limited to, the date, time, location, involved parties, witnesses, and other evidence details. As also noted above, the system can also gather footage from the body camera device worn by the officer (if applicable) and other recorded audio/video, and the AI engine can transcribe the camera information and/or videos or photos to text to be included in the incident report as appropriate and in compliance with any requirements for the particular organization that the user is associated with.
Automated Data Organization: The system can be configured to automatically organize the gathered information into appropriate sections of the police report, such as incident description, witness statements, suspect details, evidence inventory, and officer's observations, by way of non-limiting example.
Report Generation Engine: Once all necessary information is inputted and/or uploaded and the prompts generated by the system based on the information it received from the user are answered, the system can be configured to compile the data into a cohesive, comprehensive and standardized police report format or customized report specific for the user's organization, ready for further review and submission as necessary.
Customizable Templates: The system can be configured to offer customizable report templates, allowing law enforcement and/or other agencies to tailor the prompts and report formats according to their specific requirements and/or the requirements of the organization that the user is associated with (e.g. user's police department, etc.).
Data Security and Access Controls: The system can incorporate robust data security measures, ensuring the confidentiality and integrity of sensitive information. Access controls can restrict report editing and viewing privileges to authorized personnel only.
A back-end prompt of the present system can be added and/or modified to be specific to a particular organization/agency or user.
Though not limiting or exhaustive, the disclosed novel system and method offers several advantages over traditional manual report writing methods which can include:
Time and Resource Efficiency: The AI-driven prompt system accelerates report generation, reducing the time and resources required for documentation.
Consistency and Standardization: The system ensures standardized reports by following a structured template and capturing all relevant details through guided prompts.
Accuracy and Completeness: The AI prompts help avoid omissions and errors that may have contained within a manually written report, resulting in accurate and comprehensive police reports.
Customizability: The customizable templates cater to the specific needs of different law enforcement agencies/organizations.
Though not considered limiting, the following servers are examples of servers that can be used with the disclosed novel system and method, AWS, EC2, RDS and/or Bedrock LLM servers, though other servers that can provide the functions and capabilities needed for creating the reports described herein can be used and are also considered within the scope of the disclosure.
Additionally, where EC2 and/or RDS servers are employed, preferred, non-limiting instance minimal characteristics/requirements for the servers can comprise:
Accordingly, the disclosed system and method provide for a novel solution primarily directed to public safety and/or public service organizations, though such is not considered limiting, and the system can be configured to also generate reports for other types of organizations. With use of the herein described novel system and method the creation of a large array of reports and documentation for public service agencies can be automated and the system allows users to create or generate reports specific or customized for a particular organization/agency.
The software and algorithms used by the system can be continuously updated, and the system configurations can be continuously updated, to incorporate the latest advancements in natural language processing and machine learning, as well as the client/user organizations' changing policies and procedures. The system and software can be specifically customizable and configured for every client/user/organization, incorporating the organizations'/agencies' adopted/required/suggested policies, procedures, and other specific nuances to the generated output.
The system software can use Client-Side Encryption which can provide for a high or highest level of security and privacy by encrypting data on the client side, providing an additional layer of protection for sensitive information. The system operating software can be provided as a free-standing platform such that users are not required to purchase other programs and the disclosed system software can complement current programs in place. With proper cooperation, the system software can be relatively easily integrated into third party companies, such as record management systems and other software, maintaining workflows, and minimizing disruption for agencies/organizations and their end users.
Preferably, once the user logs into the disclosed novel system with their credentials, the end user can be presented with a digital online dashboard displayed on their computer or electronic device screen with the dashboard preferably being specific to his or her agency/organization and account settings. Each agency/organization can be provided the ability to create custom modules, based on common report types, as well as agency/organization policy and procedure and desired report format. Once signed in, the end user can select the most appropriate module from a list of modules displayed on their screen to generate their desired report. Once electronically/digitally inside of the selected module, the user can be provided with several options to generate the report.
One of the methods for an end user to generate reports is through a voice dictation feature of the system/system software. In one non-limiting embodiment, to use the voice dictation feature, the end user can click a “Start Recording” Button and then begin to converse with the system/software (i.e. through a microphone component of their computer/electronic device, etc.) and verbally provide/speak the details in his or her own words of the incident. Once completed, the end user can click a “Stop Recording” button. Once this button is selected, the system can be configured to employ a transcription program/technology, that can be specifically tailored for public safety and public service agencies in one non-limiting embodiment, to convert the end user's dictated speech into text/text file. Once converted, the system can be configured to display the text in a box or other area of the user's screen, where the text can be preferably both viewable and editable by the end user. After reviewing the content for accuracy and content and making any edits to the text deemed needed by the user, the end user can then digitally agree to terms of service and initiate the digital generation/creation of the incident report.
The system can be configured to use natural language processing and machine learning to generate the report, based on the information inputted by the end users using his or her computer/electronic. As the organization/agency format requirements are already preconfigured defined and saved in the system, when the system generates the report, the report can be customized and in compliance with the agency's/organization's desired format. Once the report is generated, it can be displayed on the user's screen or otherwise electronically presented to the user and the user can be given the ability to review and edit the generated report if necessary, using his or her computer/electronic device.
In addition to or alternatively to the above-referenced voice dictation method, the system can be configured to allow the end user to upload a previously recorded audio file, documenting the details of the desired report generation. Within the desired selected module, the end user has the ability to import any format of audio file. Once uploaded, the audio file can be similarly transcribed as discussed above and the audio filed converted into text/text file for viewing and any editing by the end user. Similarly, once reviewed and edited, if necessary, the end user then follows the same or similar steps of agreeing to the terms of service, and selecting to generate a report, causing the system to use the above-referenced natural language processing and machine learning to generate a report into a desired agency format.
In addition to or alternatively to the above-referenced voice dictation and/or audio upload features, the system can be configured to analyze various types of video footage, such as, but not limited to, body camera, covert video, or surveillance camera footage, and extract out an audio portion from the video which can then be converted to text/text file for similar handling and report generation/review/editing as described above for the voice dictation and audio file upload scenarios.
In addition to electronically generating the incident report, the system can also be configured to employ agency specific checkers, allowing end users to verify the report for completeness and accuracy, preferably in accordance with the user's agency's/organization's policies, procedures and/or practices. To electronically/digitally initiate the checkers, once the report is generated and reviewed by the end user, the end user can select a “check” on his or her computer/electronic device screen. The system/system software can be configured to analyze the content of the generated report, based on specific predefined/preconfigured factors desired by the agency/organization. Once the report is analyzed the system can be configured to digitally/electronically respond to the end users with details such as missing content, necessary agency codes, and other factors. The end user then has the ability to add to or make necessary changes to the generated report, based on the checker's analysis. With any needed changes/additions made, by way of either extension or endpoint with a third party software application/program, a JSON file can be completed and the report along with appropriate fields can be filled out within a specific records management system of the agency/organization, or agency specific forms and documents. Thus, the generated report can then be digitally/electronically sent to the agency/organization, where the information from the report can be automatically digitally/electronically extracted into appropriate fields of the agency's/organization's records management system.
In addition to report generation, the system can be preferably configured to comprise other modules with the ability to provide specific and customizable analysis of data, such as phone calls, text messages, agency reports, interviews, and interactions with the public. These other types of data can be digitally/electronically submitted/inputted/uploaded into the system at the user's screen in the same or similar manner as described above for report generation (video, audio, etc.). Accordingly, the system can analyze and synthesize complex data which can increase efficiency for end users in providing necessary services.
The system can be configured to operate in multiple languages and can translate the input and output text into these multiple languages desired by the end user.
As seen from the above-description, through the use of the novel system and method, the report can be generated using a significant reduction of the user's actual time. Additionally, certain aspects of the described system and method, such as, but not limited to, extracting an audio file out of an uploaded video file, etc. are not capable of being performed manually. Accordingly, the novel system and method can significantly reduce the manual effort commonly employed by end users in these fields and increases accuracy, effectiveness, and worker satisfaction.
The below non-limiting computer code for the novel algorithm in accordance with the present disclosure is included by way of example only and intended to be exemplary of how the novel system and steps performed by such system can be designed and implemented in accordance with the principles of the current disclosure. However, an API key from chat GPT could also be obtained and the following code could be used in python to implement certain aspects of the disclosed system and method and such implementation is also considered within the scope of the disclosure.
It should be recognized that all of the steps described above performed in creating the incident reports from the initial login steps can be performed by software, web-based applications, LLM, etc. residing on a single computer system, including, but not limited to, a server (local, remote, cloud-based, etc.) or alternatively certain steps can be performed by software, web-based applications, LLM, etc. residing one computer system/server, while other steps described above can be performed by one or more different computer systems/servers such that the system distributed and not performing all steps from a single computer system and the above-configurations and other distributed system configurations can also be used and all are considered within the scope of the disclosure. As a non-limiting example of a distributed system configuration, the login steps performed by the web-based application can be operated located or hosted at one location and the audio extracting and report generation and checking can be performed by a software program or LLM located or hosted at a different location which can digitally/electronically receive the uploaded and/or entered information from the web-based application, where the information is uploaded/entered by the user using his or her electronic device having the webs-based application displayed on the screen of the electronic device.
Though not limiting, the system can be a system for creating comprehensive police reports, EMS reports or other agency/organization reports through the utilization of artificial intelligence (in one non-limiting embodiment), the system can comprise, without limitation:
It should be understood, of course, that the foregoing relates to exemplary embodiments of the disclosed system and method and that modifications may be made without departing from the spirit and scope of the disclosure as set forth in the following claims.
This application claims the benefit of and priority to U.S. Application Ser. No. 63/517,430, filed Aug. 3, 2023, which application is incorporated by reference in its entirety herein for all purposes.
Number | Date | Country | |
---|---|---|---|
63517430 | Aug 2023 | US |