Patent Application
20230319231
Embodiments of the invention are broadly directed to video collection and storage. More specifically, embodiments of the invention are directed to the storage and collection of video data from body-wearable video cameras and camera docks.
Many institutions, such as schools, hospitals, factories, and businesses, could benefit from equipping employees with body-wearable video cameras. These body-wearable video cameras are small enough to be unobtrusive while capturing the events experienced by the wearer. However, body-wearable video cameras of the prior art require a significant administrative and technical burden to implement. What is lacking in the prior art is an efficient and intelligent system to manage video collection and storage from body-wearable video cameras.
Embodiments of the invention solve these problems by providing a video collection system that retains and selectively stores video data. The video collection system broadly comprises a plurality of body-wearable cameras, a plurality of camera docks for receiving and docking the plurality of body-wearable cameras, and a video collection manager. The plurality of camera docks is configured to interface with the plurality of body-wearable cameras, wherein each camera includes a camera-memory element. The camera docks also include a dock-memory element that is configured to receive and store video data from the camera-memory element. The video collection manager is communicatively coupled with one or both of the plurality of cameras and the plurality of camera docks. In some embodiments, the body-wearable video camera can be instructed or controlled by the video collection manager and can transmit captured video to a remote location, such as a memory associated with the video collection manager. In other embodiments, the captured video is transmitted or otherwise downloaded to the camera dock(s), and the video collection manager can instruct or otherwise control transmission of the captured video from the video camera dock and to the memory associated with the video collection manager.
A first embodiment of the invention is directed to a video collection system comprising a body-wearable video camera, a camera dock, and a video collection manager. The camera dock is configured to interface with the body-wearable video camera having a camera-memory element. The camera dock includes a dock-memory element configured to receive and store video data from the camera-memory element. The video collection manager is communicatively coupled with the camera dock. The camera dock sends at least a portion of the video data to the video collection manager.
A second embodiment of the invention is directed to a video collection system that includes a body-wearable video camera and a camera dock. The body-wearable video camera has a camera-memory element. The camera dock is configured to interface with the body-mounted video camera and includes a dock-memory element configured to receive and store video data from the camera-memory element, and a communication element configured to send a portion of the video data to a video collection manager. The video collection manager is remote from the camera dock.
A third embodiment of the invention is directed to a computerized method for selectively saving and transferring video data by a camera dock, the method comprising the following steps: acquiring an indication that a body-wearable video camera is communicatively coupled; receiving a set of metadata associated with a set of video data that is on the body-wearable video camera; analyzing the set of metadata to determine a subset of the set of video data to be transferred; instructing the body-wearable video camera to transfer the subset of video data; saving the subset of the video data to a dock-memory unit; selecting a sub-subset of the video data by analyzing the set of metadata and at least one criterion from a video collection manager; and transferring the sub-subset of the video data to the remote video collection manager.
Other embodiments of the invention may be directed to a video collection system that includes a body-wearable video camera, a camera dock, and a video collection manager. Still other embodiments of the invention may be directed to a video collection manager, a camera dock, or a body-wearable video camera. Still further embodiments of the invention may be directed to a computerized method for selectively saving and transferring video data by a body-wearable video camera, or a computerized method for selectively requesting and saving video data by a video collection manager. Yet still further embodiments of the invention may be directed to a non-transitory computer readable storage medium having a computer program thereon for performing at least one of the methods discussed herein. The computer program instructs a processing element to perform the steps of the method.
This summary is provided to introduce a selection of concepts in a simplified form that are further described below in the detailed description. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used to limit the scope of the claimed subject matter. Other aspects and advantages of the invention will be apparent from the following detailed description of the embodiments and the accompanying drawing figures.
Embodiments of the invention are described in detail below with reference to the attached drawing figures, wherein:
The drawing figures do not limit the invention to the specific embodiments disclosed and described herein. The drawings are not necessarily to scale, emphasis instead being placed upon clearly illustrating the principles of the invention.
The following detailed description references the accompanying drawings that illustrate specific embodiments in which the invention can be practiced. The embodiments are intended to describe aspects of the invention in sufficient detail to enable those skilled in the art to practice the invention. Other embodiments can be utilized and changes can be made without departing from the scope of the invention. The following detailed description is, therefore, not to be taken in a limiting sense. The scope of the invention is defined only by the appended claims, along with the full scope of equivalents to which such claims are entitled.
In this description, references to “one embodiment,” “an embodiment,” or “embodiments” mean that the feature or features being referred to are included in at least one embodiment of the technology. Separate references to “one embodiment,” “an embodiment,” or “embodiments” in this description do not necessarily refer to the same embodiment and are also not mutually exclusive unless so stated and/or except as will be readily apparent to those skilled in the art from the description. For example, a feature, structure, act, etc. described in one embodiment may also be included in other embodiments but is not necessarily included. Thus, the current technology can include a variety of combinations and/or integrations of the embodiments described herein.
Embodiments of the invention are directed to a video collection system 100 comprising a video collection manager 102, at least one camera dock 104, and at least one body-wearable video camera 106.
In embodiments, the video collection manager 102 is a centralized or regional device or computer program. The video collection manager 102 communicates with the camera docks 104 and/or the body-wearable video cameras 106 to determine what video data should be saved, where it should be saved, and for how long it should be saved. The video collection manager 102 does so by setting various criteria for saving and deleting. The video collection manager 102 may have an associated administrator 112. The administrator 112 is a person, group of people, or other entity that controls or monitors the video collection system 100 (which may include one or more of the users 108). The administrator 112 may set the criteria for saving video data, request specific video data, review received video data, transfer video data, or perform other functions (such as those described herein) in furtherance of monitoring and controlling the video collection system 100. The administrator 112 may configure the video collection system 100 as desired based on the camera parameters (e.g., location of the body-wearable video camera 106), the user 108 (a first user's camera may be programmed differently than a second user's camera based on a desire to always record all data for the first user but not always record all data for the second user), or other factors.
In embodiments of the invention, multiple video cameras are associated with the video collection manager 102. Video cameras can be used to record events as seen from a first-person perspective of the user 108. This can be advantageous for recreating and demonstrating what happened at a later date. For example, if the user 108 observes a crime, an accident, or an event or function being performed, this can be observed later by others via the video. The video camera may be mounted, worn, secured, or otherwise associated with the user 108 as discussed below.
In embodiments of the invention, the body-wearable video camera 106 will record continuously throughout the work shift (or similar time period). The body-wearable video camera 106 may therefore begin recording so long as it is not in the camera dock 104. For example, the video camera may automatically begin recording upon being removed from the camera dock 104 and then cease recording upon being returned from the camera dock 104. This allows minimal interaction and requirements to the placed on the user 108. The body-wearable video camera 106 may contain enough battery life in a battery and enough memory in a camera-memory element 308 to record at least one day's worth of events (and may record much longer, such as 15 days as discussed below). The user 108 can utilize a “mark” button (illustrated in
In embodiments of the invention, each body-wearable video camera 106 is assigned to a single user 108. This allows the administrator 112 and/or the video collection manager 102 to request video data associated with the user 108 by requesting specific information from the associated body-wearable video camera 106. In some embodiments, the labor associated with assigning each user 108 and chances for error are reduced by an automated process. For example, the body-wearable video camera 106 may include a unique code (such as a QR code) as each are distributed. All the user 108 has to do is scan the QR code with smartphone. The QR code takes them to a special website that asks for name, pull-down of school locations, and any other needed information. As the video collection system 100 knows the serial numbers associated with a customer, the assignment is automatically performed and less prone to error.
In embodiments of the invention, the captured and recorded data may be deleted in post processing based on a parameter associated with the recorded data or the capture of data may be temporarily paused based on a parameter associated with the body-wearable video camera 106. For example, in embodiments, the parameter may be a location of the body-wearable video camera 106 when the data was captured. In some instances, in may be undesirable to capture and/or record data when the user 108 is in a restroom. Therefore, embodiments of the invention may either pause the recording when the body-wearable video camera 106 detects it is in the restroom, or some or all of the data recorded while the user 108 was in the restroom may be deleted post processing. Alternatively, some data is not deleted, such as metadata or audio, but video data is deleted; for example, it may be desirable to record audio data and/or metadata even when the parameter is detected, but not to record video data.
Controlling and monitoring embodiments of the video collection system 100 may be performed in various ways. A few exemplary structures and methods will be discussed. It should be appreciated that various embodiments of the invention could be applied to numerous fields. Two exemplary fields of use for the invention include schools and hospitals and will be discussed briefly such that the reader can get an appreciation for how embodiments of the invention may be utilized. Other embodiments could be directed to factories, commercial establishments, and other locations where fixed video cameras would provide an inadequate and incomplete record of events transpiring in the area. As yet another example, embodiments of the invention may be used in any building where video and/or audio surveillance is desirable, either for evidence collection or security purposes. In some embodiments, the cameras may not be body-wearable video cameras 106 but may instead be fixedly mounted in a building (either inside or outside), such as for a building-security system.
In the exemplary field of schools, teachers, coaches, and school administrators may be outfitted with body-wearable video cameras 106 that easily adhere to a clothing article worn by the user 108. Then, as the teacher (or other user 108) interacts with students throughout the day, the body-wearable video camera 106 silently and inconspicuously records the events experienced. The teacher would also be provided with a camera dock 104 in their classroom or office for charging the body-wearable video camera 106 and storing the video data. As most video data would be uneventful, the video data would be stored on the camera dock 104 as space permitted. This would allow the video data to be accessed within the certain time period if it becomes later evident that the video data may be important. For example, a crime may be committed in front of a teacher without that teacher realizing what happened. Upon later realization, the video data could be retroactively located and used to prosecute the crime.
These rooms 202 may include a beacon 204 or other structure to identify the current location of the body-wearable video camera 106. The beacon 204 is used to tell the body-wearable video camera 106 what room 202 the body-wearable video camera 106 (and by extension, the user 108 wearing or otherwise controlling the body-wearable video camera 106) is currently in or near. These beacons 204 may utilize Bluetooth technology, Wi-Fi technology, RFID technology, Infrared technology, or any other technology that may be utilized to inform the body-wearable video camera 106 of its current location. The beacons 204 are labeled in circles in
In embodiments of the invention, at least one beacon 204 may prevent the recording of video data in proximity thereto. For example, the Restroom may include a beacon 204 that instructs a cease of recording or an immediate deletion of recording upon docking. The video collection system 100 could have a sensor (such as the beacon 204) in a restroom to instruct the body-wearable video camera 106 to not record when in the restroom unless the mark button is pressed. The instruction not to record may be explicit in the received message (such as a digital instruction to cease recording) or may be understood by the body-wearable video camera 106 to cease recording based upon knowing that the certain beacon 204 (e.g., Beacon 1 as illustrated in
In embodiments of the invention, at least one beacon 204 may induce conditional recording of video data in proximity thereto. For example, Classroom A and Classroom B may include user-specific beacons 204. User A may be a teacher in Classroom A but not in Classroom B. Beacon 2 (in Classroom A, as illustrated) may instruct Camera A to record, or Camera A may begin recording upon detecting Beacon 2. In this example, if User A is in Classroom B, Beacon 3 may instruct Camera A not to record, or Camera A may cease recording upon detecting Beacon 3. This is because User A is not otherwise associated with Classroom B, such that there is not a reason to record the interactions of User A with User B or other persons in Classroom B. Again, User A may override this function by pressing a mark button or providing another indication to record.
In embodiments of the invention, at least one beacon 204 may ensure the recording of video data in proximity thereto. Some beacons 204, such as those in the Hallway illustrated in
It should be appreciated that in the above-discussed examples, preventing recording may be done by stopping the video-capture element 306 (or ensuring that the video-capture element 306 is not recording), automatically deleting the video data, marking the video data for deletion (such as by adding or editing metadata), preventing the transfer of video data, or by other steps that ensure the video data is not created, saved, or transferred. Similarly, it should be appreciated that in the above-discussed examples, ensuring recording may be done by starting the video-capture element 306 (or ensuring that it is already started), automatically transferring the video data, marking the video data for transfer (such as by adding or editing metadata), transferring the video data, or by other steps that ensure the video data is created, saved, and transferred.
In some embodiments of the invention, one or more beacon 204 is a component of a proximity tag system for authenticating the devices, cameras, docks, and beacons 204 associated with the video data. The proximity tag system comprises a plurality of proximity tags and at least one proximity tag reader. Proximity tags are any devices that radiate an identifying signal, herein referred to as the proximity tag identifier, that can be read by a corresponding reader such as the proximity tag reader. Proximity tags can be active (meaning that they periodically broadcast their identifier), assisted passive (meaning that they broadcast their identifier only when interrogated by a signal from the reader), or passive (meaning that they have no power source and must be illuminated by a signal from the proximity tag reader in order to radiate their identifier). Other forms of proximity tags are also possible. Proximity tag identifier may be preprogrammed into proximity tags, or may be field-programmable, such that the identifier is assigned by the user 108 when the proximity tag is deployed. One common form of proximity tag system is the radio-frequency identification (RFID) tag and the corresponding RFID reader. Another form of proximity tag system utilizes a challenge-response protocol to avoid the spoofing of a proximity tag identifier. Other forms of proximity tag systems can include Bluetooth technology.
The proximity tag reader receives the proximity tag identifiers transmitted by proximity tag. The proximity tag reader may be integrated into body-wearable video camera 106, and proximity tag identifiers are then communicated by communications element to the other components of the video collection system 100. In other embodiments, body-wearable video camera 106 may instead (or in addition) contain a proximity tag, which is read by another proximity tag reader located in another component of the video collection system 100 such as the camera dock 104, the beacon 204, and/or the video collection manager 102. Depending on the type of proximity tag, a different type of reader may be required to receive the proximity tag identifiers. For example, an active reader is required to read passive tags. In some embodiments, the proximity tag reader can determine the distance to the transmitting tag based on signal strength or other information. In some embodiments, multiple proximity tag readers are present. In some such implementations, positional information about the tag can be determined based on a relative signal strength at each reader.
Embodiments of the invention may also be useful for providing oversight on the teachers (or other users 108) without a significant administrative burden. This would allow school administrators or even concerned parents to review a brief, random clip of video data. For example, a ten-minute clip during classroom discussion may be uploaded daily or upon request. This may ease the burden of selectively recording for review purposes, disciplinary purposes, regulatory compliance purposes, and other purposes that would impose a periodic burden on the users 108. It should be noted that school administrators may be a system administrator 112, as illustrated in
Another exemplary embodiment for the invention is in hospitals. In these embodiments, doctors and other hospital personnel would wear a body camera in the hospital. Doctor interactions with the patients would be recorded. This will help provide concrete and credible evidence in medical malpractice cases. As such, the doctor would be able to prove what information was given to the patient, what responses were given by the patient, etc. This provides a video record of the interactions between doctor and patient. It should be appreciated that a hospital or other medical facility may include various beacons 204 that ensure or prevent the recording. For example, all video data may be captured while the body-wearable video camera 106 is in a patient's room. Further, the data may be tagged with an indication of patient information and/or room information. As such, all interactions with that patient may be recorded and be configured to be stored together or otherwise associated.
In embodiments of the invention, the body-wearable video camera 106 only begins recording in certain circumstances. The body-wearable video camera 106 may therefore rely on trigger features to begin recording. For example, the patient may be wearing an RFID tag. When the body-wearable video camera 106 comes into proximity with the RFID tag, video recording is triggered to begin. Similarly, when the doctor leaves the proximity of the patient the body-wearable video camera 106 may stop recording (or transfer to the next patient RFID tag). Metadata and/or video data may be transferred to and stored with an electronic medical record of the patient. For example, certain metadata may indicate that the video data should be uploaded, such as location information in an operating room, or mark button presses indicative of substantive patient interactions.
Various information related to the video may be stored in metadata of the recorded video data from the body-wearable video camera 106 and/or the camera dock 104. Metadata associates one set of data with another set of data. The metadata may be embedded in the captured video data, stored externally in a separate file that is associated with the captured video data, otherwise associated with the captured video data, or all of the above. Embedding the beacon indication into the same file with the captured video data can be advantageous because it allows the metadata to travel as part of the data it describes. In some such embodiments, metadata is associated with a particular frame or frames of the video data. This is advantageous where, for example, the same video file contains more than one beacon indication as the user 108 moves around between areas. In other such embodiments, the metadata is associated with the video file as a whole. Externally stored metadata may also have advantages, such as ease of searching and indexing. The metadata may also be stored in a human-readable format, such that a user 108 can access, understand, and edit the metadata without any special software. For example, the metadata (either directly or in an easily readable format) may be presented to the administrator 112 so as to allow the administrator 112 to select various video files or sub-files for retrieval and retention.
Externally stored metadata may also be more easily and quickly transferred. In embodiments of the invention, as soon as the body-wearable video camera 106 is connected to the camera dock 104, the metadata for all or a portion of the video data is transferred first. The camera dock 104 and/or the video collection manager 102 may then make decisions on which video data to transfer, save, and delete based at least in part on the transferred metadata.
In embodiments of the invention, a triggering event may initiate the recording of video data. As a first example, a pressing of Code Blue button on other medical equipment may trigger recording. Upon the triggering of the Code Blue, the video collection manager 102 may instruct all body-wearable video cameras 106 on the floor or in the room to begin recording. In some of these embodiments, the video collection manager 102 may be in communication with the body-wearable video cameras 106 (such as via Wi-Fi, Bluetooth, or other wireless communication protocol). In other of these embodiments, the triggering of the Code Blue may power or otherwise initiate a beacon 204, or change the associated signal with at least one beacon 204.
As a second example, a triggering event may be tied to the deployment or removal of specific equipment or tools may initiate recording. A defibrillator being taken out of a holster may trigger the body-wearable video camera 106 to begin recording. Similarly, a crash cart being brought into a patient's room may have a beacon 204 therein which instructs all body-wearable video cameras 106 to begin recording. The beacon 204 may be located in proximity to the equipment or tool, such that a removal of the tool is detected by the beacon 204 and instructs the beacon 204 to begin recording. For example, the removal of the equipment may provide power to the beacon 204, complete a circuit associated with the beacon 204, allow for an infrared beam to be detected across a void that was previously occupied by the equipment, or otherwise be detected.
As yet another example, a washing station within the hospital may be equipped with a beacon 204. The beacon 204 would automatically trigger a recording and may tag which body-wearable video camera 106 is being used. The body-wearable video camera 106 being used may be checked against a schedule to ensure that the doctor is in the correct location for the procedure. The beacons 204 may therefore be used to track locations of the doctors, and other personnel, so that a record of what doctor was interacting with a patient can be better recorded.
In embodiments of the invention, patients that do not want to be recorded may be allowed to opt out of recording. This may be done in post-processing, such that a video may be subsequently destroyed if nothing of extraordinary is noted. In other embodiments, this may be done in pre-processing before the video is taken. For example, the patient may have an RFID tag to instruct the body-wearable video camera 106 not to record while in the presence of that RFID tag, or the beacon 204 associated with the patient's room may be altered to instruct no recording.
Still other fields of use may include factories, sales, military, sports, and other fields in which may meet any of certain commonalities. These commonalities could include extended periods of contact with a customer or other person. This may be useful for monitoring performance. Another commonality may be in high-risk litigation situations, in which retaining relevant video data can reduce liability. Yet another commonality are situations that include high performance, in which the video data may be retained for later review to help improve the performance.
Other examples of parameters associated with the body-wearable video camera 106 that may be used to determine recording, pausing, and/or post-proceeding deletion of recorded data include a time of day when the data is being recorded, the user 108 and privileges associated with the user 108, a memory capacity of a particular camera, a type of or location of the body-wearable video camera 106 (e.g., a head-mounted camera may be assigned different recording and processing features than a camera worn on a user's chest), etc.
In embodiments of the invention when the mark button is pressed, the body-wearable video camera 106 sends metadata and/or a still image to the video collection manager 102. This may be used to alert a security administrator 112 of the mark. For example, the metadata may include a location within the facility where the mark was pressed, the time of the press, the orientation of the body-wearable video camera 106 during the press, and other information related to the body-wearable video camera 106 or the image. In some embodiments, upon a press of the mark button the body-wearable video camera 106 may start live streaming the video data to the video collection manager 102 for immediate review (such as in an emergency situation). This may be done at the request of the security administrator 112 (e.g., a remotely given command via the video collection manager 102) or by an indication from the user 108 such as a long press, a series of multiple presses of the mark button, or by a certain audible mark.
In some embodiments of the invention, the video collection manager 102 (either automatically or by instruction from the administrator 112) may request certain video data before analyzing the metadata sent from the body-wearable video camera 106. Before the body-wearable video camera 106 is even plugged in to camera dock 104, an administrator 112 is interested in certain video fora user 108. So, the request is pushed to all or some of the camera docks 104. Additionally, or alternatively, the request could be placed in the video collection manager 102 or the cloud-based storage system 110. The user 108 may place their assigned body-wearable video camera 106 into any camera dock 104. As long as administrator 112 knows which camera it wants, the administrator 112 can send request from an administrator application. The user 108 does not have to drive to a particular camera dock 104. In some embodiments, the video collection system 100 may alert (such as via contact information, via an alert directly from the body-wearable video camera 106, or a general system alert) the user 108 and request that the user 108 go plug in to a camera dock 104. In some embodiments, the video collection system 100 may pull data directly from the body-wearable video camera 106 without having to dock into a camera dock 104. For example, the body-mountable video camera 106 may be equipped with Wi-Fi, which is power hungry, only to be utilized during these priority transfers.
An exemplary body-wearable video camera 106 and camera dock 104 is shown in
In the exemplary embodiment illustrated in
In embodiments of the invention, the body-wearable video camera 106 comprises an optical lens 302, a microphone 304, a video-capture element 306, a camera-memory element 308, the battery 300, a camera-processing element 310, and a housing 312. The optical lens 302 is associated with the video-capture element 306 to direct light toward the video capture element 306. The optical lens 302 may refract or reflect some of the light, or the optical lens 302 may allow the light to simply pass therethrough. The video-capture element 306 creates a digital recording indicative of the light that was received and captured by the optical lens 302. The digital recording is stored in the camera-memory element 308. The camera-memory element 308 may be a removable memory (such as an SD card) or a permanent memory (such as internal ROM, internal RAM, or a non-transitory computer readable medium). The body-wearable video camera 106 may further include a beacon detector 314 that is configured to detect, either passively or actively, the beacons 204 via at least one wireless technology. The body-wearable video camera 106 may further include the above-discussed mark button 316. The body-wearable video camera 106 may further include at least one indicator light 318 configured to provide status information to the user 108.
In some embodiments of the invention, such as those in which the body-wearable video camera 106 is configured to look like an identification badge as discussed above, the housing 312 is generally a rounded rectangular prism. The housing 312 comprises a main body 319 that presents a front plate 320 and a back plate 322. As illustrated, the transition between the front plate 320 and the back plate 322 may be rounded or arcuate. The rounded or arcuate transitions provide comfort to a person holding the body-wearable video camera 106. The main body 319 of the housing 312 could also be another shape, such as substantially a cylinder, substantially an oval cylinder, substantially an ellipsoid, or substantially a sphere.
Embodiments of the body-wearable video camera 106 may further comprise a location element 324, such as a global positioning systems (“GPS”) receiver. The location element 324 determines and records the GPS location of the body-wearable video camera 106 during at least a portion of the video collection. The location element 324 transmits information indicative of the location to the camera-processing element 310. The location information may then be stored on the memory element of the body wearable video camera and/or be transmitted to the camera dock 104 and/or video collection manager 102. The location element 324 may also determine and record the time associated with the video data. This information can be further saved as video metadata, as described above. The location information and time information provide further authentication to the video data. For example, the video collection manager 102 may request all video data from within a certain range of a geographic coordinate or within a certain area. Based upon the metadata of the video data, the camera dock 104 may transfer only the video data that meets the criteria to the video collection manager 102.
In embodiments of the invention, the body-wearable video camera 106 is configured to interface with the camera dock 104. The camera dock 104 provides power to recharge the battery 300 of the body-wearable video camera 106. The camera dock 104 may hold the body-wearable video camera 106 when not in use, or provide a cable to be attached to the body-wearable video camera 106. The camera dock 104 also communicatively couples with the body-wearable video camera 106. As such, the video data on the body-wearable video camera 106 may be selectively transferred to and stored on a dock-memory element 412. In other embodiments, the camera dock 104 may be a cable that is connected to a computing device.
In embodiments of the invention, the camera dock 104 includes a base 326 and a camera rest 328, as best illustrated in
The dock may further include ports for power and digital communications, not illustrated. In some embodiments, the camera dock 104 may further include a wireless communication element 408 for communicating with the video collection manager 102 and/or the body-wearable video camera 106. In some embodiments, the video collection system 100 may include hardwired docks and wireless docks. The hardwired docks may be utilized when a large data transfer is requested, and may be centrally located (such as in the office of
The camera dock 104 may further include a dock-processing element 410 that may perform the below discussed steps for selectively downloading and uploading the video data. The dock-processing element 410 therefore acts as an intelligent gateway, preventing and allowing various data to pass therethrough. The intelligent gateway therefore reduces the administrative and digital burden of transferring large video files for storage to the cloud-based storage system 110. By deciding which files to leave on the body-wearable video camera 106, which files to delete, which files to transfer to the camera dock 104, which files to save on the camera dock 104, and which files to transfer to the video collection manager 102, the dock-processing element 410 can significantly reduce the amount of data that is transferred over the network. The dock-processing element 410 reduces the burden on the network while not significantly reducing the needed video data that is ultimately stored.
In other embodiments, the camera dock 104 does not include a dock-processing element 410 and acts as a passive gateway. The passive gateway allows the camera to dock and provides a conduit for information flow from the body-wearable video camera 106 to the video collection manager 102. In some of these embodiments, the camera dock 104 has no dock-memory unit 412. In these embodiments, the dock is a mechanical cradle with the electrical contact 400. The body-wearable video camera 106 sits cradled in the camera dock 104 while an external power supply (not illustrated) is plugged into the camera dock 104, and an external USB-to-Ethernet adapter is plugged into the camera dock 104. There may be no or few electronics in the camera dock 104. The body-wearable video camera 106 will communicate directly (such as via Ethernet or Wi-Fi) with the video collection manager 102. Therefore, in embodiments of the invention, at least a portion of the discussed steps as performed by the camera dock 104 may instead performed by the body-wearable video camera 106 and/or the video collection manager 102.
In embodiments of the invention, the video collection system 100 includes a set of camera docks 104, each associated with one or more body-wearable video cameras 106. Each camera dock 104 includes the dock-memory element 412 configured to receive and store video data from the camera-memory element 308 for at least one body-wearable video camera 106. For example, each user 108 may have a camera dock 104 for their body-wearable video camera 106. The camera dock 104 may also receive metadata related to the video data, such as timestamps, location stamps, user information, video camera information, mark data, and the like.
In embodiments of the invention, the camera dock 104 keeps the video data local to the body-wearable video camera 106 and the camera dock 104 unless otherwise requested or needed. The camera-memory element 308, such as an internal SD Card or the like, stores the video data throughout the day (and as space permits). Either or both of the body-wearable video camera 106 or the camera dock 104 includes a circular buffer, commonly known as a “first in, first out” (or FIFO) buffer. The FIFO buffer may be one day, one week, two weeks, one month, two months, or longer. Other types of buffers may also be employed. The circular buffer may also use an intelligent FIFO buffer, in which unmarked video data is deleted before marked video data (as the marked video data is more likely to present important information). As can be appreciated, an amount of captured data (whether video data, audio data, or metadata) available to be recorded is dependent on the memory size, the video frame rate, the video resolution, the video quality, the video bit rate, etc. In some circumstances, it may be desirable for one or both of the body-wearable video camera 106 and camera dock 104 to include a buffer. In some embodiments, the buffer for the body-wearable video camera 106 may be shorter than the buffer for the camera dock 104, such that the buffer for the body-wearable video camera 106 records a lesser amount of data before overwriting than the camera dock 104's buffer. For example, the buffer for the body-wearable video camera 106 may by an 8-hour or one-week buffer, whereas the buffer for the camera dock 104 may be a one-week or one-month buffer. In alternative embodiments, the camera dock 104 buffer may record a lesser amount of data than the video camera 106 buffer.
In some embodiments, the body-wearable video camera 106 will utilize a reduced video resolution, video frame rate, video quality, and/or video bit rate. These reduced video parameters may be set by the video collection manager 102, by the camera dock 104, or internally by the body-wearable video camera 106 based upon the frequency of dockings, available memory, available battery life, whether the mark button has been pressed, and other considerations. Based upon the reduced rates, the camera dock 104 may then be able to store locally (e.g., on the dock-memory element 412) until or if the video collection manager 102 requests the metadata or the video data. The camera dock 104 may also automatically and selectively erase older video data. For example, video data that does not include mark button press, trigger, or sensor information may be deleted first as the likelihood of importance of that video data is reduced.
For example, if the video frame rate is 30 fps, the video resolution is 720p (1280×720), and the video quality is high, the video bit rate may be 4 mbps. At 4 mbps, a 32 GB memory can store 18 hours of video data. As another example, if the video frame rate is 10 fps, the video resolution is D1 (720×480), and the video quality is low, the video bit rate may be 0.2 mbps. At 0.2 mbps, a 32 GB memory can store 364 hours of video data (which is over 15 days). It should therefore be appreciated that the video collection system 100 may record, store, and/or transcode (discussed below) the video data to achieve a storage of the maximum amount of video data for the storage available. It should also be appreciated that the above are merely examples, and the actual video parameters may be different.
In yet other embodiments, metadata may be transmitted to the remote location, dock, or memory associated with the video collection manager 102 on a periodic, regular basis, such as at the end of each workday or shift. The video and/or audio data may continue to be stored on the body-wearable video camera 106 and in keeping with the FIFO buffer. The metadata may then undergo an analysis to identify any notable events or information that would prompt a need for uploading the video and/or audio data from the body-wearable video camera 106. For example, if the metadata shows the mark button was actuated, the video and/or audio data may be automatically uploaded to the video collection manager 102. As another example, for cameras equipped with or associated with a GPS (e.g., a GPS in a mobile device carried by the user 108 wearing the body camera or a GPS included with the body-wearable video camera 106) for documenting the location of the body-wearable video camera 106, if the GPS metadata shows the body-wearable video camera 106 was taken outside of a pre-set geofence, the video and/or audio data may be automatically uploaded to the video collection manager 102.
In embodiments of the invention, the body-wearable video camera 106 may upload only certain information or types of information, such as metadata, when the body-wearable video camera 106 is within range or proximity of an access point (e.g., a wireless camera dock). For example, if the body-wearable video camera 106 is employed in a fleet vehicle, such as an ambulance or delivery service, the metadata may be uploaded at the end of each workday when the ambulance or delivery service is returned to the firehouse, hospital, central work site, etc. where there is a wireless access point. In other embodiments, the metadata may include various tags, such as time of day, location of the body-wearable video camera 106 while recording (discussed above), automatic event triggering (discussed above), etc. In some situations, the administrator 112 may desire to upload any recorded data associated with a particular type of tag. For example, in law enforcement applications, a video camera worn by an officer may include a tag for whether a traffic stop is for a DUI versus speeding versus expired tags, etc. Depending on the type of traffic stop indicated by the officer at a central control element in the vehicle, the recorded video captured by the officer's body-wearable video camera 106 will include a particular tag. Consequently, depending on the type of tag, the video may be automatically and immediately uploaded to the remote location or the memory associated with the video collection manager 102. In addition, any type of data may be uploaded manually to the remote location or the memory associated with the video collection manager 102 on demand and at the request of the administrator 112.
In both automatic and manual uploading, only a portion of the recorded data may be uploaded, referred to as data segmentation. The administrator 112 may choose to upload only a portion or segment of the data. The user 108 may selectively choose to upload video data, audio data, and/or metadata, and may further choose to upload such selected data for a pre-set time period. Alternatively, the recorded data may be automatically uploaded based on a triggering event. As discussed herein, a triggering event could include manual actuation of the mark button on the body-wearable video camera 106, a location of the body-wearable video camera 106, a speed of the body-wearable video camera 106 (e.g., if an accelerometer or location element 324 with the body-wearable video camera 106 indicates the user 108 is running), etc.
In data segmentation, a portion of the captured and recorded data (whether it be video data, audio data, or metadata) is segmented from the original corresponding data based on the triggering event time (e.g., actuating the mark button), a pre-set prerecording time (e.g., 30 second, one minute, two minutes, or five minutes), and a pre-set post-recording time (e.g., 30 second, one minute, two minutes, five minutes, ten minutes, or twenty minutes). The data segmentation is achieved by identifying the start and stop times corresponding to the pre-set prerecording time and the pre-set post-recording time, parsing the raw video, audio, or metadata from the original, longer recording and corresponding to the start and stop times, and extracting and repackaging the video, audio, or metadata into a new, shorter recording. This video segmentation may be performed by either or both of the body-worn camera or the camera dock 104. Thus, in embodiments where the metadata of actuating the mark button, for example, causes automatic uploading of the associated video and audio data, then the video collection system 100 may only automatically upload a pre-set time before and after the mark button was actuated, as opposed to uploading all recorded data and/or all recorded data for the particular workday. This is advantageous in situations where it is time consuming to upload the data due to wireless access or transmission speeds.
For example, if a particular 15 minutes is desired, prior art systems would transfer the entire file that contains those 15 minutes. Embodiments of the invention, instead of transferring a large file (such as a 2 gigabyte file that has 8 hours of video data), the segmentation happens at the camera dock 104. The segmentation is performed to minimize upload data and reduce the strain on the network. The segmentation may be performed with any of various programs, such as FFmpeg for video manipulation, transcoding, or segmentation. In prior art systems, the restriction in the devices is the processing power. Usually, the processor is not robust enough to do to perform these functions, so the large files are transferred for processing. Thus, embodiments of the invention utilize the camera dock 104 to perform these functions locally to the docked body-wearable video camera 106. This segmentation may produce a subset of video data, and/or a sub-subset of video data that is transferred between the various components of the video collection system 100.
In embodiments of the invention, the video collection manager 102 is a dedicated device that communicates with the camera docks 104. In other embodiments, the video collection manager 102 is a remote application operating on a server (such as a cloud-based video collection manager 102). In still other embodiments, the video collection manager 102 is a local application operating on a computer system associated with the facility or organization that administers the video collection system 100 (such as a laptop computer, desktop computer, smartphone, or tablet computer).
The video collection manager 102 is communicatively coupled with the camera dock 104. The video collection manager 102 may be communicatively coupled to the camera dock 104 directly or indirectly. Examples of direct communication include a wired or wireless connection between the video collection manager 102 and the camera dock 104. Indirect connection includes an intermediary device for facilitating the communication. For example, the camera dock 104 may be communicatively coupled to a computer, which in turn communicates with the video collection manager 102. As another example, the camera dock 104 may include a Wi-Fi connection that connects through a wireless router to the video collection manager 102, or a mobile broadband connection.
In embodiments of the invention, the camera dock 104 sends at least a portion of the video data to the video collection manager 102. The camera dock 104 will upload only the metadata unless certain conditions are met. If the conditions are met, the camera dock 104 will upload the video data associated with that metadata. These conditions may be previously determined or set by the video collection manager 102 (or a user 108 operating the video collection manager 102 or associated computer platform). The metadata may trigger an instance where one wants to upload the video. For example, metadata that may trigger an upload include a long press of the mark button, any press of the mark button, a GPS location, or entry into an unauthorized or abnormal location. As an example, a human operator or automatic process of the video collection manager 102 may manage the available upload bandwidth to prioritize the upload of certain information based upon the above-discussed characteristics. Based upon the number of body-wearable video cameras 106 in the camera docks 104, and the amount of video data to potentially be uploaded, the video collection manager 102 may direct what video data will be uploaded and an order for upload, what video data should be retained on the local body-wearable video camera 106 and/or camera dock 104, what video data should be deleted, etc. The priorities may be ordered, such that the highest priority information is sent first (such as metadata), and then other priority information is sent following (such as segmentations that indicate the mark button was pressed, or that meet other criteria set by the administrator 112 and/or the video collection manager 102), and non-prioritized information may be sent last or not at all (depending on the load on the network and the above-discussed criteria).
As discussed above, the camera docks 104 charge batteries 300, store data, and upload data. When the camera is docked, the camera dock 104 will pull or request metadata from the body-wearable video camera 106. The metadata may then be sent to a cloud-based or remote server (such as the video collection manager 102) so that the metadata can be searched, stored, and analyzed. Because the user 108 docks the body-wearable video camera 106 at the end of every shift, uploaded metadata (such as time stamps, serial numbers, who recorded, mark button presses, and the like) can be analyzed to determine what (if any) video data should be uploaded and stored in long-term storage at the cloud-based storage system 110 or other computing system. Other video data that is not uploaded may be stored locally on the camera dock 104 for a certain period of time (such as one week) or until space requirements necessitate deletion. Therefore, the video collection system 100 is only transferring the video that is recommended for review or retention. For example, if it is desired to watch a video from two days ago that was not uploaded, the video collection manager 102 may request that the specific video data to be uploaded and displayed to a user 108.
In some embodiments, the video collection manager 102 is also communicatively coupled with the body-wearable video cameras 106. The video collection manager 102 may pre-request that video be uploaded straight from the body-wearable video camera 106 wirelessly in significant event situations. The video collection manager 102 may also request an upload of the metadata thus far collected during operation, or to upload the metadata remotely such as if the user 108 forgot to dock the body-wearable video camera 106 after the previous shift.
In some embodiments of the invention, the video data is transcoded by the camera dock 104, the video collection manager 102, or both. For example, after the video data is transferred from the body-wearable video camera 106 to the camera dock 104, the camera dock 104 may transcode the original video into another format that is smaller in size. As another example, after the video is transferred from the camera dock 104 to the video collection manager 102, the video collection manager 102 transcodes the original video into another video smaller in size. The reduction in the video “size” can be achieved by reducing the video frame, video resolution, video quality, and/or other video parameter during the transcoding process. The video data is transcoded to save the storage space required. This allows the video data to be preserved for a longer period of time.
The timing and breadth of the transcoding is based on a retention policy, which may include one or more criterion established by the administrator 112 and/or the video collection manager 102. As one example, for the first three months, the recordings in the video collection system 100 remain unchanged. After 3 months, the video files are transcoded into smaller files. After another 12 months, the smaller files will be deleted. As another example, the video data may be transcoded based upon the content. Video data that is marked as important may retained at full size while other video data is transcoded to a smaller size. This retains potentially important video data while allowing less important data to be reduced in size and/or deleted.
Embodiments of the invention may be advantageous for capturing events related to the school that take place where they may not have static cameras, such as field trips, playgrounds, athletic facilities, and outside of buildings. In some embodiments, the body-wearable video camera 106 may access and utilize a smartphone to transfer data while outside communication range with the video collection manager 102 and/or the communication dock. As illustrated in
Various methods of embodiments of the invention will now be discussed. A non-transitory computer readable storage medium having a computer program stored thereon may instruct the at least one processing element to implement the steps of at least one of the described methods. The non-transitory computer readable storage medium may be located within the housing 312 of the body-wearable video camera 106, within the camera dock 104, within the video collection manager 102, within a user device, within the at least one external camera, and/or within a generic computing device.
Some embodiments of the invention are directed to a computerized method as performed by the dock-processing element 410, as illustrated in
The system 700 comprising an exemplary hardware platform that can form one element of certain embodiments of the invention is depicted. Computer 702 can be a desktop computer, a laptop computer, a server computer, a mobile device such as a smartphone or tablet, or any other form factor of general- or special-purpose computing device. Depicted with computer 702 are several components, for illustrative purposes. In some embodiments, certain components may be arranged differently or absent. Additional components may also be present. Included in computer 702 is system bus 704, whereby other components of computer 702 can communicate with each other. In certain embodiments, there may be multiple busses or components may communicate with each other directly. Connected to system bus 704 is central processing unit (CPU) 706. Also attached to system bus 704 are one or more random-access memory (RAM) modules 708.
Also attached to system bus 704 is graphics card 710. In some embodiments, graphics card 710 may not be a physically separate card, but rather may be integrated into the motherboard or the CPU 706. In some embodiments, graphics card 710 has a separate graphics-processing unit (GPU) 712, which can be used for graphics processing or for general purpose computing (GPGPU). Also on graphics card 710 is GPU memory 714. Connected (directly or indirectly) to graphics card 710 is display 716 for user interaction. In some embodiments no display is present, while in others it is integrated into computer 702. Similarly, peripherals such as keyboard 718 and mouse 720 are connected to system bus 704. Like display 716, these peripherals may be integrated into computer 702 or absent. Also connected to system bus 704 is local storage 722, which may be any form of computer-readable media, and may be internally installed in computer 702 or externally and removably attached.
Finally, network interface card (NIC) 724 is also attached to system bus 704 and allows computer 702 to communicate over a network such as network 726. NIC 724 can be any form of network interface known in the art, such as Ethernet, ATM, fiber, Bluetooth, or Wi-Fi (i.e., the IEEE 802.11 family of standards). NIC 724 connects computer 702 to local network 726, which may also include one or more other computers, such as computer 728, and network storage, such as data store 730. Local network 726 is in turn connected to Internet 732, which connects many networks such as local network 726, remote network 734 or directly attached computers such as computer 736. In some embodiments, computer 702 can itself be directly connected to Internet 732.
The computer program of embodiments of the invention comprises a plurality of code segments executable by a computing device for performing the steps of various methods of the invention. The steps of the method may be performed in the order discussed, or they may be performed in a different order, unless otherwise expressly stated. Furthermore, some steps may be performed concurrently as opposed to sequentially. Also, some steps may be optional. The computer program may also execute additional steps not described herein. The computer program, system 100, and method of embodiments of the invention may be implemented in hardware, software, firmware, or combinations thereof, which broadly comprises server devices, computing devices, and a communications network.
The computer program of embodiments of the invention may be responsive to user input. As defined herein user input may be received from a variety of computing devices including but not limited to the following: desktops, laptops, calculators, telephones, smartphones, smart watches, in-car computers, camera systems, or tablets. The computing devices may receive user input from a variety of sources including but not limited to the following: keyboards, keypads, mice, trackpads, trackballs, pen-input devices, printers, scanners, facsimile, touchscreens, network transmissions, verbal/vocal commands, gestures, button presses or the like.
The server devices and computing devices may include any device, component, or equipment with a processing element and associated memory elements. The processing element may implement operating systems, and may be capable of executing the computer program, which is also generally known as instructions, commands, software code, executables, applications (“apps”), and the like. The processing element may include processors, microprocessors, microcontrollers, field programmable gate arrays, and the like, or combinations thereof. The memory elements may be capable of storing or retaining the computer program and may also store data, typically binary data, including text, databases, graphics, audio, video, combinations thereof, and the like. The memory elements may also be known as a “computer-readable storage medium” and may include random access memory (RAM), read only memory (ROM), flash drive memory, floppy disks, hard disk drives, optical storage media such as compact discs (CDs or CDROMs), digital video disc (DVD), and the like, or combinations thereof. In addition to these memory elements, the server devices may further include file stores comprising a plurality of hard disk drives, network attached storage, or a separate storage network.
The computing devices may specifically include mobile communication devices (including wireless devices), work stations, desktop computers, laptop computers, palmtop computers, tablet computers, portable digital assistants (PDA), smartphones, and the like, or combinations thereof. Various embodiments of the computing device may also include voice communication devices, such as cell phones and/or smartphones. In preferred embodiments, the computing device will have an electronic display operable to display visual graphics, images, text, etc. In certain embodiments, the computer program facilitates interaction and communication through a graphical user interface (GUI) that is displayed via the electronic display. The GUI enables the user 108 to interact with the electronic display by touching or pointing at display areas to provide information to the video collection system 100.
The communications network may be wired or wireless and may include servers, routers, switches, wireless receivers and transmitters, and the like, as well as electrically conductive cables or optical cables. The communications network may also include local, metro, or wide area networks, as well as the Internet, or other cloud networks. Furthermore, the communications network may include cellular or mobile phone networks, as well as landline phone networks, public switched telephone networks, fiber optic networks, or the like.
The computer program may run on computing devices or, alternatively, may run on one or more server devices. In certain embodiments of the invention, the computer program may be embodied in a stand-alone computer program (i.e., an “app”) downloaded on a user's computing device or in a web-accessible program that is accessible by the user's computing device via the communications network. As used herein, the stand-alone computer program or web-accessible program provides users 108 with access to an electronic resource from which the users 108 can interact with various embodiments of the invention.
Execution of the computer program of embodiments of the invention performs steps of the method of embodiments of the invention. Because multiple users 108 may be updating information stored, displayed, and acted upon by the computer program, information displayed by the computer program is displayed in real-time. “Real-time” as defined herein is when the processing element of the video collection system 100 performs the steps less than every 1 second, every 500 milliseconds, every 100 milliseconds, or every 16 milliseconds.
Although the invention has been described with reference to the embodiments illustrated in the attached drawing figures, it is noted that equivalents may be employed and substitutions made herein without departing from the scope of the invention as recited in the claims.
This application is a continuation of U.S. patent application Ser. No. 17/151,341, filed Jan. 18, 2021, entitled “COMPREHENSIVE VIDEO COLLECTION AND STORAGE,” which is a continuation of U.S. patent application Ser. No. 15/423,803, filed Feb. 3, 2017, now U.S. Pat. No. 10,904,474, issued Jan. 26, 2021, entitled “COMPREHENSIVE VIDEO COLLECTION AND STORAGE,” which claims priority benefit, with regard to all common subject matter, of commonly assigned U.S. Provisional Patent Application No. 62/291,744, filed Feb. 5, 2016, entitled “COMPREHENSIVE VIDEO COLLECTION AND STORAGE” and U.S. Provisional Patent Application No. 62/328,784, filed Apr. 28, 2016, entitled “COMPREHENSIVE VIDEO COLLECTION AND STORAGE.” These applications are hereby incorporated by reference in their entirety into the present application.
| Number | Date | Country | |
|---|---|---|---|
| 62291744 | Feb 2016 | US | |
| 62328784 | Apr 2016 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17151341 | Jan 2021 | US |
| Child | 18206419 | US | |
| Parent | 15423803 | Feb 2017 | US |
| Child | 17151341 | US |
