1. Field
This disclosure relates to remotely controlled cameras for recording events in a stadium, arena, or theater environment.
2. Description of the Related Art
Sporting events and theatrical productions may be performed before live audiences in venues such as stadiums, arenas, and theaters. Such events may be recorded by one or more film or video cameras that are typically located outside of the seating regions of the venue. However, a camera located outside of the seating regions cannot reproduce the view of a fan or spectator within the venue. Thus, to provide a more realistic fan's perspective of an event, a camera may be placed within a seating region of the venue. To minimize the obstruction caused by a camera within a seating region, the camera may be remotely operated, which is to say the camera may be operated by a cameraman from a location other than the location of the camera.
Additionally, to capture a higher level of detail and excitement, remotely-operated cameras may be placed within or over the playing field, court, or stage where the event takes place. For example, remotely-operated cameras may be placed on the goal posts of a football field or the backboards on a basketball court, or may be caused to fly over the field on a SkyCam® or other camera platform.
When a camera is operated by a cameraman collocated with the camera, the cameraman may view the image captured by the camera through an optical viewfinder or on a viewfinder display. The cameraman may also simply look around the camera to view a much larger scene that is the context for the image captured by the camera. The cameraman may use the context to select the desired framing for the captured image. When filming live action, such as an athletic event, the cameraman may also use the context to anticipate the direction in which the action will move. The cameraman may also use the context to rapidly and smoothly point the camera to capture a different portion of the venue.
A cameraman operating a remote camera typically has a viewfinder display that shows the image captured by the camera, but does not have visibility of the context for that image. Thus the cameraman may have difficulty selecting the best image framing, difficulty tracking rapidly changing action, and difficulty aiming the camera to capture a different scene in a different portion of the venue.
Throughout this description, elements appearing in figures are assigned three-digit reference designators, where the most significant digit is the figure number where the element is introduced.
Description of Apparatus
Referring now to
The example of
The remotely-operated camera platform 100 includes a conventional (i.e. not 3D) primary scene camera 102 which captures an image over an angular field of view 104 centered on a line-of-sight 105. The field of view 104 may be fixed. The primary scene camera 102 may be equipped with a variable focal length or zoom lens (not identified), in which case the field of view 104 may be adjustable by setting the appropriate lens focal length.
The remotely-operated camera platform 100 includes a single context camera 106 which captures a context image over an angular field of view 108. The field of view 108 may be substantially larger than the field of view 104 of the primary scene camera 102. The context camera 106 may be optically aligned with the primary scene camera 102 such that the field of view 108 of the context camera 106 may encompass the field of view 104 of the primary scene camera 102. The context camera 106 may be optically aligned with the primary scene camera 102 such that the center of the field of view 108 may be nearly or exactly coincident with the line-of-sight 105 of the primary scene camera 102. The context camera 106 may be located, for example, on top of the primary scene camera 102 as shown.
The field of view 108 may be fixed, or may be adjustable if the context camera 106 is equipped with a zoom lens. When both the primary scene camera 102 and the context camera 106 are equipped with zoom lenses, the lenses may be coupled to synchronously change respective focal lengths such that the sizes of the fields of view 104 and 108 remain in constant or nearly constant proportion. As will be discussed subsequently, when the field of view 108 of the context camera 106 is fixed, digital zoom may be used to re-size the context image presented to the remote operator.
The remotely-operated camera platform 120 includes a conventional (i.e. not 3D) primary scene camera 122 which captures an image over an angular field of view 124 centered on a line-of-sight 125. The field of view 124 may be fixed or variable. The remotely-operated camera platform 120 includes a pair of context cameras 126L, 126R which, capture context images over respective angular fields of view 128L, 128R. The context cameras 126L, 126R may be optically aligned with the primary scene camera 122. The context cameras 126L, 126R may be located, for example, immediately to the left and right, respectively, of the primary scene camera 122 as shown.
Each of the fields of view 128L, 128R may be substantially larger than the field of view 124 of the primary scene camera 122. The fields of view 128L, 128R may overlap all or part of the field of view 124 of the primary scene camera 122, and may partially overlap each other. The fields of view 128L, 128R may be fixed or variable over a range from a widest field of view to a narrowest field of view. The context cameras 126L, 126R may be configured such that the narrowest fields of view overlap or are at least contiguous with the primary field of view 124. In this case, the widest fields of view may overlap.
The remotely-operated camera platform 140 includes a stereographic or 3D primary scene camera 142 comprising a left camera 142L and a right camera 142R which capture respective left and right images over respective angular fields of view 144L, 144R. The angular fields of view 144L, 144R may be centered on respective lines-of-sight 145L, 145R. The 3D primary scene camera 142 may be configured such that the lines-of-sight 145L, 145R converge or intersect at a scene object of interest 192 (such as a particular player). The fields of view 144L, 144R may be fixed. Each of the left camera 142L and the right cameras 142R may be equipped with a zoom lens (not identified), in which case the fields of view 144L, 144R may be adjustable by adjusting the focal length of the left and right lenses synchronously. One or both of the left camera 142L and the right camera 142R may be rotatable to cause the lines-of-sight 145L, 145R to intersect at any desired distance from the cameras.
The remotely-operated camera platform 140 includes a single context camera 146 which captures a context image over an angular field of view 148. The context camera 146 may be optically aligned with the 3D primary scene camera 142 such that the field of view 148 encompasses and is approximately centered on the fields of view 144L, 144R. The context camera 146 may be located, for example, on top of the 3D primary scene camera 142 as shown.
The field of view 148 may be substantially larger than the fields of view 144L, 144R of the primary scene camera 142. The field of view 148 may be fixed, or may be adjustable if the context camera 146 is equipped with a zoom lens. When both the 3D primary scene camera 142 and the context camera 146 are equipped with zoom lenses, the lenses may be coupled to synchronously change respective focal lengths such that the sizes of the fields of view 144L, 144R and 148 remain in proportion.
Referring now to
The camera platform 210 may include a primary scene camera 212, which may be a conventional camera or a 3D camera, and one or more context camera 214. The camera platform may be the camera platform 100, 120, 140, or some other camera platform.
The camera platform 210 may include a pointing system 216 to change a line-of-sight of both the primary scene camera 212 and the context camera 214. The pointing system may include, for example a remotely-controlled pan and tilt mechanism to adjust a pan or azimuth angle and a tilt or elevation angle of the line-of-sight. The primary scene camera 212 and the context camera 214 may be physically attached and coupled to a single pan and tilt mechanism. The primary scene camera 212 and the context camera 214 may be in close proximity but physically separate. In this case, the cameras may be coupled to separate pan and tilt mechanisms that operate synchronously. In either case, the lines-of-sight of the primary scene camera 212 and the context camera 214 may be optically aligned such that the fields of view of the two cameras are centered on or near the same point in the scene.
The camera platform 210 may be supported by a structure, such as a tripod, stand, pedestal, or dolly, which is not shown in
The primary scene camera 212 may be a conventional (2D) camera. A conventional primary scene camera 212 may include a lens 213 that may have fixed focal length or remotely-controlled variable focal length. A focus distance of the lens 213 may be remotely controlled, or may be automatically controlled by an autofocus system within the primary scene camera 212. In this patent, “automatically” means “without operator involvement”. An aperture setting of the lens 213 may be remotely controlled, or may be automatically controlled by an auto-exposure system within the primary scene camera 212.
The primary scene camera 212 may be a 3D camera. A 3D primary scene camera 212 may include left and right lenses (not shown). The focal length, focus distance, and aperture of the left and right lenses may be remotely controlled. The focus distance and aperture of the left and right lenses may be automatically controlled by an autofocus system and an auto-exposure system, respectively. The focal length, focus distance, and aperture of the left and right lenses may be controlled synchronously, which is to say the focal length, focus distance, and aperture of the left and right lenses may be closely matched at any setting.
The resolution and format of the primary scene camera 212 may be determined by the intended use of the video images captured by the camera. For example, for live broadcasting, the primary scene camera may be a 525i conventional television camera or a 720p, 1080i, or 1080p HDTV camera. For cinematic recording, the primary scene camera may have substantially higher resolution.
The camera platform 210 may include one, two, or more context cameras 214. Each context camera 214 may be a conventional (2D) camera. Each context camera 214 may include a lens 215 that has a fixed focal length or a variable focal length. When the focal length of lens 215 is variable, the focal length may be remotely controlled or set based on the focal length of the primary scene camera lens or lenses. For example, the focal length of the lens 215 may be set such that a field of view of the context camera 214 and a field of view of the primary scene camera 212 remain in constant, or nearly constant, proportion for any setting of the primary scene camera focal length.
The resolution and format of the one or more context cameras 214 may be the same or different from the primary scene camera 212. For example, each of the one or more context cameras may be conventional 525i television cameras and the primary scene camera 212 may be an HDTV camera.
A focus distance of the lens 215 of the context camera 214 may be remotely controlled, may be automatically controlled by an autofocus system within the context camera 214, or may be set equal to the focus distance of the lens or lenses in the primary scene camera 212. An aperture setting of the lens 215 may be remotely controlled, may be automatically controlled by an auto-exposure system within the context camera 214, or may be controlled based on an aperture set for the lens or lenses of the primary scene camera 212.
The control station 220 may include a display system 222 to present images from the primary scene camera 212 and the context camera 214 to an operator. The display system 222 may be configured to display the image from the primary scene camera with sufficient resolution and quality for the operator to verify that the focus distance and aperture of the primary scene camera are appropriately adjusted. The display system 222 may be configured to display the image from the context camera with sufficient resolution and quality for the operator to anticipate the action occurring in the venue and to efficiently move the line-of-sight of the primary scene camera to different scenes within the venue. Several embodiments of the display system 222 will be discussed subsequently.
The control station 220 may include an operator interface 228 to receive operator commands for controlling the pointing system 216 and the primary scene camera 212. Operator commands may be received for independently controlling the pan and tilt mechanism within the pointing system 216 and, where available, for controlling the location of the camera platform within the venue. Operator commands may be received for setting a focal length of the primary scene camera and for setting a focus distance and/or aperture of the primary scene camera when those parameters are not automatically controlled. Operator commands may directly control the focal length and aperture settings of the context camera 214, or may indirectly control the focal length and aperture settings of the context camera 214 when those parameters are set based on the parameters of the primary scene camera 212.
A nearly unlimited number of configurations are possible for the operator interface 228. For example, an operator interface for remotely controlled cameras may mimic the physical layout of an actual camera, with camera controls located on movable arms coupled to a pan and tilt mechanism. With this operator interface, the remote operator uses essentially the same body motions and control actions as when controlling an actual camera. An operator interface may include other types of controls, such as a joystick, trackball, or other pointing device to enter commands for the pan and tilt mechanism and rotary or linear slide controls for entering commands for camera functions.
Referring now to
The first monitor 322 may have sufficient resolution and image quality to allow an operator to confirm that the primary scene camera is properly focused on the scene being captured. For example, when the primary scene camera 312 is a 720p, 1080i, or 1080p HDTV camera, the first monitor 322 may be a compatible HDTV display. When the primary scene camera 312 is a 3D camera, the first monitor 322 may be a 3D display or a 2D display showing either of the left or right images from the primary scene camera. The resolution of the second monitor 324 may be matched to the resolution of the context camera 314 and may be the same or lower than the resolution of the first monitor 322.
The second monitor 324 may have a substantially larger viewing area than the first monitor 322. As shown in
When the first monitor is positioned in front of the second monitor as shown in
The primary scene camera 312 may include a zoom mechanism 313. Typically, the zoom mechanism 313 is implemented optically (i.e. by a variable focal length lens) and controlled by the operator from the control station. In order to maintain a constant ratio of the field of view of the context camera to the field of view of the primary scene camera, the context camera 314 may also have a zoom function 315. The zoom function 315 of the context camera 314 may be implemented optically. The zoom function 315 of the context camera 314 may be implemented by a digital zoom (i.e. using digital signal processing to crop the image captured by the context camera and then expand the cropped image to fill the area of the second monitor 324). The digital zoom processing may be implemented within the context camera 314 or the control station 320. Digital zoom processing may reduce the resolution of the image presented on the second display (since less than all of the resolution of the context camera is actually displayed). The resolution of the digitally-zoomed image may be sufficient to inform the operator of the context of the image captured by the primary scene camera 312. The zoom function 315 of the context camera 314 may be implemented by a combination of a variable focal length lens and digital processing. In any event, the zoom mechanism 313 of the primary scene camera 312 and the zoom function 315 of the context camera 314 may be synchronized such that the images presented on the first monitor 322 and the second monitor 324 remain in proportion.
Referring now to
The control station 420 may include a first monitor 422 to display the image captured by the primary scene camera 412 and a second monitor 424 to display the image captured by the context camera 414. As shown in
The primary scene camera 412 may have a zoom function which may typically be an optical zoom. The context camera 414 may have a fixed field of view. The context camera 414 may have a zoom function 415 implemented optically, digitally, or optically and digitally in combination. The zoom function 415 may be synchronized with the zoom 413 of the primary scene camera 412 or may be independently controlled.
The images presented on the first and second monitors 422, 424 may have different magnification, such that a scene object shown on both monitors will appear substantially larger on the first monitor 422 than on the second monitor 424. To assist the operator in understanding the context shown on the second monitor 424, a video processor 426 may add a rectangular graphic 428 to the image captured by the context camera 414. The extent of the rectangular graphic 428 may define an extent of the image displayed on the first monitor 422. The rectangular graphic 428 may be a dashed line, as shown, or a solid line and may be distinguished from the image captured by the context by brightness, color, or some other technique. The size of the rectangular graphic may vary with the zoom function 413 of the primary scene camera 412. In lieu of or in addition to the rectangular graphic 428, the video processor 426 may alter the brightness or some other image feature to distinguish the extent of the image captured by the primary scene camera.
Referring now to
The control station 520 may include a single monitor 525. The image captured by the primary scene camera 512 and the image captured by the context camera 514 may be combined by a video processor 526 for display on the monitor 525. As shown in
The images captured by the primary scene camera 512 and the context camera 514 may be presented on the monitor 525 with same magnification, such that scene objects do not abruptly change size when moving the peripheral portion 524 and the central portion 522. To provide the same magnification, a ratio of the field of view of the context camera 514 to the field of view of the primary scene camera 512 may be approximately the same as a ratio of the size of the monitor 525 to the size of the central portion 522.
The primary scene camera 512 may include an optical image zoom mechanism 513 controlled by the operator from the control station. In order to maintain a constant ratio of the field of view of the context camera to the field of view of the primary scene camera, the context camera 514 may also have a zoom function 515 which may be implemented optically, digitally, or by a combination of optical and digital techniques. The zoom mechanism 513 of the primary scene camera 512 and the zoom function 515 of the context camera 514 may be synchronized such that the images presented on the central portion 522 and the peripheral portion 524 of the monitor 525 remain in proportion.
Referring now to
The control station 620 may include a first monitor 622 to display the image captured by the primary scene camera 612. A video processor 626 may combine the images captured by the left and right context cameras 614L, 614R into a single “panoramic” context image 627 for display on a second monitor 624. Techniques for combining overlapping images into a single panoramic image are well known for still images and readily adaptable for video images.
As shown in
The primary scene camera 612 may have a zoom function (not shown) which may typically be an optical zoom. The context cameras 614L, 614R may have fixed fields of view. The context cameras 614L, 614R may have a zoom function implemented optically, digitally, or optically and digitally in combination. The zoom function of the context cameras 614L, 614R may be synchronized with the zoom of the primary scene camera 612 or may be independently controlled.
When the first and second monitors 622, 624 are disposed as shown in
As shown in
When the first monitor is positioned in front of the second monitor as shown in
Referring now to
The control station 720 may include a first monitor 722 to display the image captured by the primary scene camera 712. The control station 720 may include a second monitor 724L and a third monitor 724R to display images captured by the left and right context cameras 714L, 714R respectively.
As shown in
As shown in
The primary scene camera 712 may have a zoom function (not shown) which may typically be an optical zoom. The context cameras 714L, 714R may have fixed fields of view. The context cameras 714L, 714R may have a zoom function implemented optically, digitally, or optically and digitally in combination.
When the first monitor 722 is positioned adjacent to or in front of the second and third monitors 724L, 724R as shown in
Closing Comments
Throughout this description, the embodiments and examples shown should be considered as exemplars, rather than limitations on the apparatus and procedures disclosed or claimed. Although many of the examples presented herein involve specific combinations of method acts or system elements, it should be understood that those acts and those elements may be combined in other ways to accomplish the same objectives. With regard to flowcharts, additional and fewer steps may be taken, and the steps as shown may be combined or further refined to achieve the methods described herein. Acts, elements and features discussed only in connection with one embodiment are not intended to be excluded from a similar role in other embodiments.
As used herein, “plurality” means two or more. As used herein, a “set” of items may include one or more of such items. As used herein, whether in the written description or the claims, the terms “comprising”, “including”, “carrying”, “having”, “containing”, “involving”, and the like are to be understood to be open-ended, i.e., to mean including but not limited to. Only the transitional phrases “consisting of” and “consisting essentially of”, respectively, are closed or semi-closed transitional phrases with respect to claims. Use of ordinal terms such as “first”, “second”, “third”, etc., in the claims to modify a claim element does not by itself connote any priority, precedence, or order of one claim element over another or the temporal order in which acts of a method are performed, but are used merely as labels to distinguish one claim element having a certain name from another element having a same name (but for use of the ordinal term) to distinguish the claim elements. As used herein, “and/or” means that the listed items are alternatives, but the alternatives also include any combination of the listed items.