This invention relates to recording multiple participants involved an activity, such as a sports activity. Recording the participants involved in the activity is a difficult task. For some activities, not all participants may be active at a given time. Additionally, a person may wish to view a particular activity occurring at an event when they are not present at the event. Even if the person is at the event, they may miss a particular participant's performance because they are not looking or too far away to see it (and thus lose the chance to experience it). Thus, a need exists for systems and methods which permit recording of multiple participants engaged in an activity that may be viewable by others which solves the aforementioned problems.
In accordance with a preferred embodiment hereof, this invention provide a system for automatic video recording of multiple subjects, the system comprising a plurality of remote devices, a base station, and at least one recording unit, wherein each one of the plurality of remote devices is collocated with one of the multiple subjects, each one of the plurality of remote devices is communicatively coupled with the base station, and the base station controls the at least one recording unit.
In accordance with another preferred embodiment hereof, this invention provides system for recording a sporting event with multiple participants, the system comprising one or more camera banks, wherein each the camera bank comprises at least one recording unit, the at least one recording unit comprising at least one camera, wherein the at least one camera of the at least one recording unit is capable of being automatically oriented at one or more of the multiple participants, and wherein the camera banks are controlled by a recording center communicatively coupled with the camera banks.
In accordance with another preferred embodiment hereof, this invention provides a method of automatically recording a sporting event with at least one participant, wherein the location of the at least one participant is variable during recording, the method comprising the steps of enabling recording by a recording system comprising a base station, at least one recording unit, and a remote device for, and collocated with, each participant; establishing unique communication between each remote device and the base station; communicating each participant's variable location data to the base station; computing variable camera orientations and recording-unit-to-remote-device distances for each participant; sending commands from the base station for adjusting orientation, turning velocity, zoom, and focus for each recording unit according to each participant's variable location and velocity; and recording images of at least one participant at variable locations.
This invention also provides each and every novel feature, element, combination, step, and/or method disclosed or suggested herein.
The systems and methods hereof relate to recording sporting events using automatic video recording systems. One preferred use of the system hereof is to record outdoor sporting events in which weather and/or terrain are important so that stationary cameras are inadequate to capture the movements of the participants. Some of the best examples of such outdoor sporting events include surfing and kiteboarding. Other examples include football and soccer where many of subjects are on a field. The systems and methods hereof include the ability to make videos for live broadcast and for saving, editing, and markup of the videos for many additional applications. It is noted that the systems and methods hereof could be used for indoor or other activities as well.
One particular preferred application of the systems and methods hereof is surfcam video streaming over the Internet. Currently, surfcam videos are videos captured by one or more substantially stationary wide-angle cameras set up at surfing venues which webcast substantially in real time. A surfcam video generally captures the current conditions of the surf at that location; the videos may or may not show a person actually surfing. A surfcam video may occasionally zoom in on a spot or pan across the surf area in the hope of better illustrating the quality of the surf or the conditions at the break of waves. Surfcam videos are typically webcast on websites or mobile device applications (referred to as “apps”) that inform surfers about the conditions to attract them to the locale. The surfcam videos attract viewers and are a tool for advertising surfing locales and local services (e.g., accommodations and surf shops). Using the systems and methods hereof significantly enhances the content and nature of surfcam videos. The systems and methods hereof permit high quality recording of professional or local surfers, competitions, and even training sessions. The systems and methods hereof permit webcasting surfcam videos that focus on activity rather than substantially static images of a locale. Accordingly, the videos generated with the systems and methods hereof are more interesting, and, thus, have the potential to be viewed by a larger audience and for a longer period of time than traditional surfcam videos. The systems and methods hereof may be applied to other sporting activities, including, for example, kiteboarding, skiing, snowboarding, and many others. The systems and methods hereof allow a greatly increased potential for using videos recorded with the systems hereof as vehicles for advertisement of a wide variety of goods and services.
For a detailed discussion of the operation and implementation of automatic video recording system 10 refer to co-owned and co-pending U.S. patent application Ser. No. 13/726,203, filed Dec. 23, 2012, titled “Portable System for High Quality Video Recording; co-owned and co-pending U.S. patent application Ser. No. 13/782,862, filed Mar. 1, 2013, titled “Apparatus and Method for Automatic Video Recording”; and co-owned and co-pending U.S. patent application Ser. No. 13/784,536, filed Mar. 4, 2013, titled “Multifunction Automatic Video Recording Device”; the contents of all of which are hereby incorporated by reference in their entirety.
Base station 18, positioner 32, and remote device 16 all comprise communication devices and antennas so that they may communicate with one another. In
As shown in
As
As subject 12 moves in the environment, the location of remote device 16 is communicated to base station 18 which communicates with positioner 32 to turn camera 46 so that camera 46 remains pointed at remote device 16 thereby keeping subject 12 in the field of view of the camera. Base station 18 and remote device 16 are preferably paired, meaning that they communicate exclusively with each other. Communication between these devices may be coded such that communication from and to other similar devices does not interfere with a paired set of remote device 16 and base station 18.
As shown in
When multiple remote devices are in the vicinity of base station 18 sending radio signals, base station 18 must be able to recognize from which remote device the communication packets are sent. In one preferred embodiment, at the startup of automatic video recording system 10, the various different remote devices are assigned different codes; base station 18 sends and receives the remote-device-specific code with each communication packet. Camera 46 is oriented by positioner 32. Since the single camera shown in
In a preferred embodiment, with reference to remote device 16, the locations of the remote device 16 and camera 46 are known based on global positioning signal reception. As the subject moves, base station 18 receives communication 52 from remote device 16 that includes location data and relative position pointing vector 48 is calculated. Alternative methods of determining relative position pointing vector 48 include using line of sight technology, visual recognition methods using image recognition software, or additional devices such as accelerometers, gyroscopes, and barometric sensors. All such methods, including global positioning, may be used in various combinations or individually, and are collectively referred for convenience as Location Determination Technology. Remote device 16 preferably comprises hardware appropriate to the type of Location Determination Technology used. For example, remote device 16 may comprise a global positioning antenna, infrared and/or visible light sources, etc. In a preferred embodiment, remote device 16 is powered by a battery and it is built using technology that makes it waterproof and shockproof. Remote device 16 may be wearable using a strap, belt, or other fastener. Remote device 16 may be worn attached to an arm, to an article of clothing, to headgear, to a leg, or to an ankle. Remote device 16 may be integrated into an article of headgear, carried in a pocket, etc.
When global positioning technology is used to determine the locations of a camera and multiple remote devices, during setup of the system, the remote devices are collocated with the camera. If the global positioning antennas of the remote devices had infinitely good precision, they would indicate the same location at this time. However, the precision of the global positioning systems and antennas is finite and it is likely that the locations of the remote devices will appear somewhat different due to random errors. In case of systems or applications where a single remote device is used, this results in an error bubble that, especially when the subject is close to the camera, may be significant. When multiple remote devices are used, averaging of their apparent locations and assigning the average location as the location of the camera reduces the error in its location.
Base station 18 preferably outputs positioning commands (turning angle and turning velocity commands) to positioner 32 and camera operation commands (focusing and zooming commands) to camera 46 directly or through positioner 32. As a result of these commands, positioner 32 causes camera 46 to point along relative pointing vector 48 at remote device 16; camera 46 focuses at the distance between remote device 16 and camera 46, and the zoom of the camera 46 is set such that the field of view of the camera 46 is larger than the subject. An appropriate process optimizes the size of the field of view (which is a compromise between the desire to zoom in as much as possible (and to show as much detail as possible) and keeping the subject within the shot without excessively rapid camera movements).
Each camera tracks and is oriented towards a corresponding subject or participant by a corresponding positioner 110, 120, 130, 140, and 150. All positioners are controlled by a base station 100 and provide feedback to base station 100. There are also direct camera controls for focusing and zooming from the base station 100 to each of the cameras.
The system of
While
In certain competitions (such as kite boarding), two competitors compete per heat and the competitors move freely and unpredictably within a fairly large area. Using the embodiment illustrated in
Automatic video recording system 10, as shown in
When the heat ends, the recording units may continue tracking and recording the participants, the recording units may be turned off, or they may be programmed to start recording other participants. The footage recorded may include sound recorded either by the operator of the system or some other person observing the heat, or the sound may come from sound recorded by the remote devices, or both. The recording may be streamed live to websites and/or television viewers, or it may be saved for later editing and/or broadcasting.
Base station 100 may be a computer and the scenario depicted in
A camera bank refers to a unit comprising a base station, one or more positioners, and cameras attached to each positioner. Using this term, the system shown in
Recording center 200 may be a computer and the scenario depicted in
For large area venues, one or even two camera banks may not be sufficient for recording good footage when competitors are at a significant distance. The automatic video recording system may comprise several camera banks programmed such that different camera banks provide footage for broadcast from different areas of the venue. When all competitors happen to be in an area that is reached for filming by a single camera bank, if that camera bank has a single recording unit, the camera may have to zoom out to show multiple competitors.
Referring to
In another embodiment an athlete wears a remote device that allows a camera to remain pointed at and zoomed in at the athlete. The video from the camera is streamed, live or delayed, to a website so that viewers may watch the video over the Internet. This solves the problem of having stationary, preprogrammed, or manually adjusted webcams which inherently provide less interesting video footage (see the discussion above regarding surfcams). Current webcams are traditionally zoomed out or pre-programmed to zoom in and pan independently of the athlete's motion. According to a preferred embodiment hereof, the systems hereof keep a camera pointed at an athlete through camera pan, tilt, focus, zoom, or a combination thereof. This feature allows interested parties to view live or recorded sessions of the athlete. For example, current surfing webcams are zoomed out when pointed at the waves from the beach. In some cases they are pre-programmed to zoom in and pan across the waves independently of any surfer activity. This provides less interesting footage than if the camera was zoomed in and following a surfer surfing the waves. The systems and methods hereof allow a webcam to be zoomed in and follow a surfer while broadcasting the video feed over a network such as the Internet. Using the systems and methods of the present invention, recorded video greatly improves the informative quality communicated to viewers and increases the appeal of the recorded video. For example, using the systems and methods of the present invention, a detailed image of the break of the waves may be seen by potential site visitors.
The system may also post-process the videos before or during broadcast (possibly with some delay) and apply digital zoom to show more detail of scenes of interest. In one embodiment, digital zoom is controlled by image recognition software that recognizes the subject of the video. The video is preferably cropped and adjusted so that the subject appears in a preferred relative on-screen size (for example, the height of the subject fills one third of the screen) and in a preferred location on screen (for example, centered horizontally and vertically the on screen).
In some embodiments, global positioning antennas may be part of each recording unit. In other embodiments one global positioning antenna is included in a recording unit or camera bank. This is sufficient to determine the location of each camera when the relative locations of the cameras within the recording unit or camera bank are known, like in embodiments where all cameras of a recording unit are mounted on a common platform. In a preferred embodiment, a global positioning antenna is associated with each camera and a differential positioning technique is employed for computing pointing vectors between cameras and remote devices. In this embodiment the placement of each recording unit may be optimized for the particular event, terrain, and/or other local circumstances. The communication between a base station and associated recording units may be wireless, providing additional flexibility in the placement of the cameras.
There are various options for recording sound with the videos. In a preferred embodiment sound is recorded by an operator of the automatic video recording system at the base station. Preferably, the operator is able to comment on the visuals being recorded as a sportscaster would do explaining to viewers the events that are happening. The operator may also have the ability to add visuals to the videos in the form of tagging them with the names of the participants or other pertinent information. Automatic tagging of the videos with time countdowns and the like is also a preferred option. The operator may also add advertisements to a screen as appropriate. Additionally, a computer system may automatically display advertisements on the screen as well.
In a preferred embodiment sound is also recorded using a microphone integrated with each remote device. In those embodiments where there is no operator recorded sound, sound recorded from each remote device may be the only sound that accompanies each video. In an embodiment where sound is also recorded by the operator, there may be an option presented to the viewer to choose which sound source they wish to hear, or, as long as a single video is shown, the sound coming from the subject in the video may be played at a different volume than the sound recorded by the operator (for example, the sound recorded by the remote device may be played back at a lower volume than the sounds recorded by the operator). The viewer may also select the video of a particular competitor or participant to view and to listen.
In some embodiments, sound may be recorded by microphones integrated with the cameras. In such embodiments, special care is preferably taken to reduce noise generated by the mechanical and electromechanical components of the positioners. The positioners are preferably embedded in a sound-proofing polymer to reduce their noise.
In a preferred embodiment of the present invention scheduled recording of videos after setup of the equipment is made available. Using the program of the event, or competition, the operator preferably inputs data concerning the timing of each heat and makes sure that each participant is equipped with an appropriate remote device. The recording units are turned on and off by appropriate signals from the base station.
At events that employ electronic controlled displays and other mass communication tools to organize the heats and inform the audience of the status of the competition, the systems hereof may be communicatively coupled with the data feed of the electronic controlled displays to automatically adjust the recording schedule to any change in the schedule of the event, including any changes that may occur as the event takes place.
The footage and sound recorded is then sent (uploaded) to hubs that may provide them to individual viewers in real time (with minimal delay) in various formats. Alternatively, the video footage and sound may be saved for later viewing, editing, etc. The hubs may be website servers or other computer processing systems. The formats may include viewing multiple videos on split screens, also permitting the viewer to select a single stream for viewing. Processing may include tagging, selecting scenes, overlaying, etc. Formats may include running apps on mobile devices and may include special features for those who are at the site of the event. Those being on the site may be recognized by mapping apps on mobile devices that employ global positioning technology or by image recognition.
The competitors may also wear point-of-view cameras that record and provide point-of-view footage for the recorded event. The point-of-view cameras may be worn on the wearer's head or upper body or may be affixed to sporting equipment (such as, for example, a surfboard, bicycle, etc.). The cameras may be connected to or integrated with the remote devices and the remote devices may broadcast the point-of-view footage in real time to the associated base stations.
In method 300 of
The camera or cameras of the recording unit record images of the activity at the location, step 310. The recorded footage (i.e., video and accompanying sound) are preferably uploaded to a processing computer in step 312. For multiple participants, the recorded images associated with that participant are identifiable from the recorded images of other participants; this identification may be based on input into a base station or into a recording center during programming of those devices for the recording session. In a preferred embodiment, the recorded activity is broadcast as streaming video on a web site in step 320 or made available to access through an application of mobile computing device (e.g., a smartphone or tablet computer) in step 330. Alternatively, the video may be saved and edited for content in step 340. For example, those scenes which are less compelling may be cut out. The edited video is then preferably made available for users of a dedicated website (i.e., a web site in which users register to access the website content) in step 350 or of dedicated mobile apps in step 360. Using the automated video recording systems, recording units, and camera banks described herein increases the informative value and entertainment value of the recorded videos whether streamed or edited for delayed or later viewing. It is therefore preferred to make available such content with relevant advertising. Advertising is associated both with streaming videos (step 315) and with videos edited and broadcast at a user's request (step 345). Applying this innovation provides value for advertisers advertising on web sites or on mobile devices that show surfcams and similar “condition cams” like those found at ski and snowboarding resorts.
Method 300 may be implemented by engaging professional or amateur sportsmen and sportswomen; such events may be advertised ahead of time for those who prefer the live (streaming video) broadcast. Professional or accomplished amateur sessions are more entertaining and more informative regarding the conditions and the experience at the venue of the session than simply showing the venue itself. Correspondingly, higher viewership is to be expected for such videos; this increases the value for advertisers. While traditional surfcams and other “condition cams” do attract some, usually local, advertisers, the video recordings made according to the present invention have the potential to attract more and more diverse advertisers.
Recording center 200 is preferably connected with processing computer 425 having input, output, memory, and storage. Processing computer 425 enables streaming of recorded footage or is configured to permit storage and editing of recorded footage. Processing computer 425 is preferably connected to network 430 (such as the Internet) to permit access to the recorded footage by streaming or by user's accessing a web site. Processing computer 425 may include multiple computers, servers, etc. The video footage is accessible by way of a number of devices, as shown. For example, the video footage may be accessed by television, computer, smartphone, tablet computer, etc.
It is noted that while the figures illustrate a runner, the activities with which the system and methods of the present invention may be used are not in any way limited to running. Other activities have been mentioned herein; it is noted that the mention of these other activities does not limit those activities with which the systems and methods of the present invention may be used.
Different embodiments, features and methods of the invention are described with the aid of the figures, however the particular described embodiments, features and methods should not be construed as being the only ones that constitute the practice of the invention and the described embodiments, features and methods are in no way substitutes for the broadest interpretation of the invention as claimed.
This application claims the benefit of U.S. Provisional Patent Application No. 61/610,459, filed Mar. 13, 2012, titled “Apparatus and Method for Webcasting and Video Recording Sporting Events Organized In Heats”, and U.S. Provisional Patent Application No. 61/610,470, filed Mar. 14, 2012, titled “Method of Advertising Using Automated Video Recording”, the contents of both of which are hereby incorporated by reference in their entirety and are not admitted to be prior art with respect to the present invention by the mention in this cross-reference section.
Number | Date | Country | |
---|---|---|---|
61610459 | Mar 2012 | US | |
61610470 | Mar 2012 | US |