Patent Application
20180098031
This specification relates generally to video conferencing computer systems, for example, video conferencing servers that enable document sharing by transmitting document state information.
Various types of online collaborative services are currently in use, including web seminars (“webinars”), webcasts, and peer-level meetings. In general, online collaboration services are implemented using conventional Internet technologies, such as TCP/IP connections and HTTP web pages. Some services allow real-time point-to-point communications as well as multicast communications from one sender to many receivers. Applications for online collaboration services include meetings, training events, lectures, or other types of presentations from a computer to other computers over a network.
The traditional legal deposition process requires attorneys to plan depositions weeks or months in advance due to scheduling and travel conflicts. Additionally, the traditional legal deposition process requires the presence of a court reporter in order to generate the transcript. There are existing online collaborative services that implement remote legal deposition products by videoconferencing; however, the existing services generally require the presence of a court reporter.
This specification describes video conferencing computer systems. In some examples, a computer system is programmed for establishing, for a deposition, a videoconferencing session between users including at least a witness and a deposing attorney by transmitting display information to a respective user computer for each user over a data communications network. The computer system is programmed for presenting, during the deposition and at each user computer, a graphical user interface displaying: a first panel displaying a real-time video of the witness captured from a camera coupled to or integrated with the user computer of the witness; and a second panel displaying a view of a selected document from a number of electronic documents uploaded by the deposing attorney so that each user computer displays in real-time the view of the selected document. The computer system is programmed for storing, after the deposition, a video file of the real-time video of the witness and a timestamped record of a plurality of displayed documents displayed in the second panel during the deposition.
In some examples, a computer system is programmed for establishing a videoconferencing session between users by transmitting display information to a respective user computer for each user over a data communications network. The computer system is programmed for presenting, at each user computer, a graphical user interface displaying a view of a document so that each user computer displays in real-time the view of the selected document. The computer system is programmed for, in response to a controlling user manipulating the document in the videoconferencing session, updating the view of the document at each other user computer by transmitting document state information to each other user computer over the data communications network.
In some examples, a computer system is programmed for providing, to a user computer over a data communications network, a video viewing application. The computer system is programmed for receiving, from the video viewing application executing on the user computer, a search request including one or more search terms to search for in a video having a corresponding audio file. The computer system is programmed for, in response to receiving the search request, providing one or more search results to the video viewing application executing on the user computer, each search result indicating a portion of the video where a corresponding portion of the audio file has been transcribed to text matching the one or more search terms.
The example computer systems described in this document implement technological solutions for both technical problems and other problems. For example, compared to computer systems using conventional online collaborative services for legal depositions, the example computer systems can use less network bandwidth, less disk storage space, and fewer processing resources. The example computer systems can be used to allow the entire deposition process to be conducted remotely—thus eliminating travel considerations and easing scheduling difficulties. Additionally, the computer systems can produce as an output a recorded video which provides a better form of evidence than a transcript in a legal setting.
The computer systems described in this specification may be implemented in hardware, software, firmware, or combinations of hardware, software and/or firmware. The computer systems described in this specification may be implemented using a non transitory computer storage medium storing one or more computer programs that, when executed by one or more processors, cause the one or more processors to implement one or more aspects of a videoconferencing system. Computer storage media suitable for implementing the computer systems described in this specification include non-transitory computer storage media, such as disk memory devices, chip memory devices, programmable logic devices, random access memory (RAM), read only memory (ROM), optical read/write memory, cache memory, magnetic read/write memory, flash memory, and application specific integrated circuits. A computer storage medium used to implement the computer systems described in this specification may be located on a single device or computing platform or may be distributed across multiple devices or computing platforms.
Each of the user computers 106a-c is a device having one or more processors, memory, a display, and a user input device. For example, a user computer can be a laptop, a tablet, or a mobile phone. Typically, a user computer also has a camera and a microphone, which can be integrated with the user computer or in communication with the user computer by a cable or a wireless link. The user computers 106a-c communicate with the videoconferencing computer system 102 by exchanging messages over a data communications network 108.
The videoconferencing computer system 102 can be implemented as a server, e.g., providing a cloud computing service by transmitting web pages to user devices for display in web browsers. In operation, the videoconferencing computer system 102 provides one or more videoconferencing services to the users 104a-c. For example, the videoconferencing computer system 102 can send video and audio feeds of the users 104a-c, captured by cameras and microphones, to the user devices 106a-c so that the users 104a-c can see and hear one another.
In some examples, a first user 104a is a deposing attorney and a second user 104b is a witness, and the videoconferencing computer system 102 is programmed to facilitate a deposition of the witness 104b by the deposing attorney 104a. In some examples, the videoconferencing computer system 102 is programmed to provide real-time document sharing. The term “real-time” is used in this document to indicate services that are real-time or are near real-time as limited by latency in the system, e.g., processing or network latency. In some examples, the videoconferencing computer system 102 is programmed to provide a search service for transcribed video recordings.
In some examples, the videoconferencing computer system 102 includes a deposition facilitator 206 implemented by the processors 202 and memory 204. The deposition facilitator 206 is configured by appropriate programming for establishing, for a deposition, a videoconferencing session between a plurality of users 104a-c including at least a witness 104b and a deposing attorney 104a by transmitting display information to a respective user computer 106a-c for each user over a data communications network 108; presenting, during the deposition and at each user computer 104a-c, a graphical user interface 216 displaying: a first panel displaying a real-time video of the witness captured from a camera coupled to or integrated with the user computer of the witness; and a second panel displaying a view of a selected document from a plurality of electronic documents uploaded by the deposing attorney so that each user computer displays in real-time the view of the selected document; and storing, after the deposition, a video file of the real-time video of the witness in a repository 212 and a timestamped record 214 of a plurality of displayed documents displayed in the second panel during the deposition.
In some examples, the videoconferencing computer system 102 includes a real-time document sharer 208 implemented by the processors 202 and memory 204. The real-time document sharer 208 is configured by appropriate programming for establishing a videoconferencing session between a plurality of users 104a-c by transmitting display information to a respective user computer 106a-c for each user over a data communications network 108; presenting, at each user computer, a graphical user interface 218 displaying a view of a document so that each user computer displays in real-time the view of the selected document; and in response to a controlling user (for example, a deposing attorney 104a) manipulating the document in the videoconferencing session, updating the view of the document at each other user computer (106b-c) by transmitting document state information to each other user computer over the data communications network.
In some examples, the videoconferencing computer system 102 includes a video transcript searcher 210 implemented by the processors 202 and memory 204. The video transcript searcher 210 is configured by appropriate programming for providing, to a user computer 106a over a data communications network 108, a video viewing application 222; receiving, from the video viewing application executing on the user computer, a search request including one or more search terms to search for in a video having a corresponding audio file (for example, a video recorded by a user computer executing the video recording application 220); and in response to receiving the search request, providing one or more search results to the video viewing application executing on the user computer, each search result indicating a portion of the video where a corresponding portion of the audio file has been transcribed to text matching the one or more search terms.
Purpose of System
The system allows attorneys to conduct legal depositions remotely by using a web application that consists of a video meeting which is recorded and a document sharing mechanism. The video session is recorded and available for replay at a later time providing a better form of evidence than the transcript product of traditional depositions. The entire process can be setup and the deposition started in a matter of minutes.
How the System is an Improvement
The traditional legal deposition process requires attorneys to plan depositions weeks or months in advance due to scheduling and travel conflicts. Additionally it requires the presence of a court reporter in order to generate the transcript. There are existing remote legal deposition products that employ video—however they require the presence of a court reporter. The system proposes to improve on this process by allowing the entire deposition process to be conducted remotely—thus eliminating travel considerations and easing scheduling difficulties. Additionally, the product of the tool is a recorded video which provides a better form of evidence than a transcript in a legal setting.
Problems with Current Techniques
The legal industry conducts depositions in much the same manner as they were conducted prior to the system of the computer. There are several problems with that manner which can be solved through the use of technology:
Improvements by the System
Steps to Build the System
Purpose of System
The system allows all users of a web application to have the same view of a PDF document at the same time with little network overhead compared to current approaches to document sharing in real time applications.
How the System is an Improvement
Currently, in order for users of an application to have the same view of a PDF document one would need to use screen sharing software that may or may not require a program to be installed on their device and consumes a large amount of bandwidth as the user's screen is streamed. The system described in this document does not require any software to be installed (apart from the web browser already being used to interact with the application) and uses significantly less bandwidth than a screen sharing tool by sending messages about the state of the document over HTTP or web sockets.
Problems with Current Techniques
Currently, using screen sharing technology is how to achieve the effect of the proposed system. The problems with screen sharing technology are that it may require additional software installation or special permissions on the user's device and that it consumes a relatively large amount of bandwidth compared to the system.
Improvements by the System
The system improves on current techniques by using Javascript to display the document in the web application which means that additional software does not need to be installed on the user's device. Additionally, it communicates with the other users' devices by sending and receiving messages to a server using HTTP or web sockets which results in significantly less bandwidth consumption.
Steps to Build the System
How the System Works
When the system is built as described above, the user with control of the document can scroll through the document or highlight text in the document. When that happens the other users' view of the document will change to reflect the scrolling or text highlighting.
Additional Considerations
There are two additional considerations that can expand on the system:
Purpose of System
The system will allow users to navigate to a certain point in a recorded video by searching for a specific word spoken in the video.
How the System is an Improvement
Currently, if a user wants to find a portion of a recorded video that discusses a certain topic they would have to either 1) watch the video in its entirety until it reaches the desired point or 2) arbitrarily jump to different points in the video until the desired portion is found. When searching the Internet for searchable or indexable video, you find many articles about how to increase SEO rankings of websites with video, but not any products solving the problems addressed by the system.
Improvements by the System
The system improves the state of the art by making it much easier to jump to a specific point in a video. As video continues to become a more dominant form of media it will be used in manners it hasn't before. Take the legal industry for example, as video becomes more dominant and universally accepted it is likely it will start to replace transcription. In a transcript of a legal proceeding there is typically an index that will tell you on which pages of the transcript a certain word appears. The system is applying the same concept to video.
Steps to Build the System
Part 1—Transcription and Timestamping
Part 2—Indexable Video Viewer Application
How the System Works
The net effect of Part 1 from above should not result in a change to the user experience of recording a video in a web or mobile app. However, the changes in Part 1 make it possible to build a new experience in Part 2 that is not currently available. Users will now be able to take recordings and go the viewer described in Part 2 and search for a word spoken in the recording and jump directly to that point in the video.
Additional Considerations
You can add on to this system by modifying the video recording application that was modified in Part 1 above such that the server sends the transcribed text to the Client(s) to provide a real-time transcription experience.
The GUI 602 includes multiple live video feeds 604 and 606 to display users participating in a deposition videoconference. The GUI 602 includes an exhibit display 608 and an exhibit controller 610. A controlling user can use the controls displayed in the exhibit controller 610 to select exhibits (e.g., by navigating to files stored on a local or remote computer) to add to a list of available exhibits. The controlling user can then select an exhibit from the list for display in the exhibit display 608. The GUI 602 can include controls 612 for starting and stopping recording, for taking a break, and for ending the deposition.
The live transcription window 704 can be placed next to the exhibit display 608 or overlaid over a portion of the exhibit display or otherwise displayed in an appropriate area of the GUI 702. In some examples, the live transcription window 704 is activated by a tab as a fly-out over the exhibit display 608.
The transcript display window 906 displays rows 908, 910, and 912 of transcribed text. Each row displays a block of text spoken by a user. The transcript display window 906 creates a new row when a different user begins speaking. In some examples, each row 908, 910, and 912 displays a user identifier (e.g., the user's name) and a timestamp. In some examples, each row 802, 804, and 806 includes a set of controls to replay the portion of the deposition video file corresponding to the transcribed text displayed in the row.
Although specific examples and features have been described above, these examples and features are not intended to limit the scope of the present disclosure, even where only a single example is described with respect to a particular feature. Examples of features provided in the disclosure are intended to be illustrative rather than restrictive unless stated otherwise. The above description is intended to cover such alternatives, modifications, and equivalents as would be apparent to a person skilled in the art having the benefit of this disclosure.
The scope of the present disclosure includes any feature or combination of features disclosed in this specification (either explicitly or implicitly), or any generalization of features disclosed, whether or not such features or generalizations mitigate any or all of the problems described in this specification. Accordingly, new claims may be formulated during prosecution of this application (or an application claiming priority to this application) to any such combination of features. In particular, with reference to the appended claims, features from dependent claims may be combined with those of the independent claims and features from respective independent claims may be combined in any appropriate manner and not merely in the specific combinations enumerated in the appended claims.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the presently disclosed subject matter.
While the following terms are believed to be well understood by one of ordinary skill in the art, the following definitions are set forth to facilitate explanation of the presently disclosed subject matter.
All technical and scientific terms used herein, unless otherwise defined below, are intended to have the same meaning as commonly understood by one of ordinary skill in the art. References to techniques employed herein are intended to refer to the techniques as commonly understood in the art, including variations on those techniques or substitutions of equivalent techniques that would be apparent to one skilled in the art. While the following terms are believed to be well understood by one of ordinary skill in the art, the following definitions are set forth to facilitate explanation of the presently disclosed subject matter.
In describing the presently disclosed subject matter, it will be understood that a number of techniques and steps are disclosed. Each of these has individual benefit and each can also be used in conjunction with one or more, or in some cases all, of the other disclosed techniques.
Accordingly, for the sake of clarity, this description will refrain from repeating every possible combination of the individual steps in an unnecessary fashion. Nevertheless, the specification and claims should be read with the understanding that such combinations are entirely within the scope of the invention and the claims.
Following long-standing patent law convention, the terms “a”, “an”, and “the” refer to “one or more” when used in this application, including the claims. Thus, for example, reference to “a unit cell” includes a plurality of such unit cells, and so forth.
Unless otherwise indicated, all numbers expressing quantities of ingredients, reaction conditions, and so forth used in the specification and claims are to be understood as being modified in all instances by the term “about”. Accordingly, unless indicated to the contrary, the numerical parameters set forth in this specification and attached claims are approximations that can vary depending upon the desired properties sought to be obtained by the presently disclosed subject matter.
As used herein, the term “about,” when referring to a value or to an amount of a composition, mass, weight, temperature, time, volume, concentration, percentage, etc., is meant to encompass variations of in some embodiments ±20%, in some embodiments ±10%, in some embodiments ±5%, in some embodiments ±1%, in some embodiments ±0.5%, and in some embodiments ±0.1% from the specified amount, as such variations are appropriate to perform the disclosed methods or employ the disclosed compositions.
The term “comprising”, which is synonymous with “including” “containing” or “characterized by” is inclusive or open-ended and does not exclude additional, unrecited elements or method steps. “Comprising” is a term of art used in claim language which means that the named elements are essential, but other elements can be added and still form a construct within the scope of the claim.
As used herein, the phrase “consisting of” excludes any element, step, or ingredient not specified in the claim. When the phrase “consists of” appears in a clause of the body of a claim, rather than immediately following the preamble, it limits only the element set forth in that clause; other elements are not excluded from the claim as a whole.
As used herein, the phrase “consisting essentially of” limits the scope of a claim to the specified materials or steps, plus those that do not materially affect the basic and novel characteristic(s) of the claimed subject matter. With respect to the terms “comprising”, “consisting of”, and “consisting essentially of”, where one of these three terms is used herein, the presently disclosed and claimed subject matter can include the use of either of the other two terms.
As used herein, the term “and/or” when used in the context of a listing of entities, refers to the entities being present singly or in combination. Thus, for example, the phrase “A, B, C, and/or D” includes A, B, C, and D individually, but also includes any and all combinations and subcombinations of A, B, C, and D.
This application claims the benefit of U.S. Provisional Patent Application Ser. No. 62/403,966 filed Oct. 4, 2016, the disclosure of which is incorporated herein by reference in its entirety.
| Number | Date | Country | |
|---|---|---|---|
| 62403966 | Oct 2016 | US |
