Patent Grant
10670246
The disclosure generally relates to a method for providing a follow spot system, specifically to methods for integrating control of a follow spot with control of a lighting rig and to adding automation to such a system.
Follow spots are a well-known part of many entertainment productions and are commonly used in theatres, television studios, concerts, theme parks, night clubs and other venues. Some follow spots are manually controlled luminaires where the operator has control over the direction the luminaire is pointing, typically to illuminate a performer, and to the color, size and other optical parameters of the luminaire. A production may include many follow spots, each with its own operator, as shown in
In such systems, the skill of the operators 62 may not be similar, e.g., some operators may be slow to follow the performer or inaccurate in their use of the follow spot. Attempting to synchronize color or intensity changes between the multiple operators may be difficult and/or inaccurate. Additionally, a lighting designer may wish to situate the follow spots in locations where it would be difficult or unsafe to place an operator. For example, above the stage or in areas where there is insufficient height or space for an operator. Even if it is possible to safely situate the operator, he may be uncomfortable and forced to remain in a cramped position for the duration of the event.
In one embodiment, a follow spot controller includes a memory, a processor, and a communication interface. The communication interface includes a first communication link that communicates with a lighting control desk and a second communication link that communicates unidirectionally with an automated luminaire. The processor senses a physical orientation of the follow spot controller. The processor also receives control parameters sent to the automated luminaire from the lighting control desk, creates modified control parameters by replacing pan and tilt parameters in the received control parameters with pan and tilt parameters based on the physical orientation of the follow spot controller, and sends the modified control parameters to the automated luminaire.
In another embodiment, a follow spot control system includes a memory and a processor. The processor senses a physical orientation of the follow spot controller and sends operator pan and tilt parameters to a first automated luminaire based on the physical orientation of the follow spot controller. The processor also sends individual calculated pan and tilt parameters to other automated luminaires based on (i) the pan and tilt parameters of the first automated luminaire and (ii) a three-dimensional model of a surface of a performance area and locations and mounting orientations of the other automated luminaires relative to the performance area.
In yet another embodiment, a method of controlling a plurality of follow spots includes creating a three-dimensional model that includes one or more surfaces of a performance area; locations and mounting orientations for automated luminaires, relative to the performance area; and location and mounting orientation for a camera, relative to the performance area. The method also includes calculating a vector that represents the center of a light beam that is projected by a first automated luminaire, based on its location and mounting orientation, and calculating a target point on a surface of the performance area based on the vector. The method further includes calculating individual pan and tilt parameters for each of the other automated luminaires based on the luminaire target point, and sending the individual pan and tilt parameters to the other automated luminaires.
For a more complete understanding of this disclosure, reference is now made to the following brief description, taken in conjunction with the accompanying drawings in which like reference numerals indicate like features.
Preferred embodiments of the disclosure are illustrated in the figures, like numerals being used to refer to like and corresponding parts of the various drawings.
The disclosure generally relates to a method for providing remote control of a follow spot system. A physical orientation of a follow spot controller is sensed and used to control one or more automated luminaires. A three-dimensional model may be used to translate operator control of a first automated luminaire into pan and tilt control of other automated luminaires.
In recent years, it has become common to use automated luminaires on entertainment productions. These are luminaires where the pan and tilt position of the luminaire light beam can be remotely controlled from a lighting desk by an operator. Many products also provide control over other parameters such as the focus, beam size, beam shape and beam pattern. Attempts have been made in the past to combine these two technologies such that the effect of a follow spot can be achieved by using a remotely controlled automated light. However, such attempts have often failed or been less than satisfactory because of the slow response time of the system or the difficulty an operator had in accurately aiming a luminaire at a small spot on a stage and moving the light around in a manner which appears natural and organic, rather than mechanical and robotic. Jerky robotic movement is annoying to the audience, distracts them from the performer, and reduces their enjoyment of the performance.
Follow spot controller 200 provides a bridge between first and second lighting control links 232 and 236 and may override or replace a limited set of parameters sent from lighting control desk 126 to automated luminaires 120. For example, follow spot controller 200 may override just the pan and tilt parameters for one or more of the automated luminaires 120 and 122, thereby controlling which directions the automated luminaires are pointing, while lighting control desk 126 retains control of the other parameters of the automated luminaires such as light intensity, size, color, and so on. In this way, an operator of follow spot controller 200 may concentrate solely on directing the pan and tilt parameters of one or more of the automated luminaires 120 and 122 and not be concerned about other parameters. In other embodiments, the override may include other light characteristics, such as an iris or focusing of the light beam and/or its intensity. In such embodiments, the overridden characteristics may be selectable by an operator of the follow spot controller 200 or an operator of the control desk 126. In such embodiments, the overridden characteristics may be selected based upon cue data stored in the follow spot controller 200 or in the control desk 126.
Follow spot controller 200 may control a single automated luminaire or may simultaneously control multiple automated luminaires. In the case where multiple automated luminaires 122 and/or 120 are being controlled, follow spot controller 200 may substantially continuously compensate for the different locations of each of the luminaires relative to the performance area 240 and adjust the pan and tilt parameters sent to each luminaire such that each luminaire is directed to the same spot on the performance area 240 based on the pan and tilt parameters of the manually controlled follow spot. Such substantially continuous compensation is described in more detail with reference to
Follow spot controller 200 may incorporate a display screen that displays a live video signal received via communication link 234 from a camera 124 mounted on an automated luminaire 122 (or several cameras on several luminaires (not shown)). The communication link 234 may be a wired, wireless, or optical communication link. Such a live video display may allow the operator controlling follow spot controller 200 to see the performance area 240 and the lighting and more accurately control the pan and tilt position of the automated luminaires 122 and/or 120. Such a system allows the follow spot controller 200 to be situated in a convenient and safe location for the operator. Follow spot controller 200 may be mounted on a tripod or stand 238 to locate the follow spot controller 200 at a comfortable height for the operator.
In some embodiments, the communication link 234 is an analog video signal. In other embodiments, the communication link 234 is a digital communication link that carries a digital video signal. In still other embodiments, the communication link 234 may be bidirectional, allowing an operator of the follow spot controller 200 to control set up and other parameters of the camera 124.
In further embodiments, multiple follow spot controllers 200 may be used in a single production. Each follow spot controller 200 would have its own attendant operator and would control one or more automated luminaires 122.
In some embodiments, the follow spot controller 200 includes additional user-operated controls such as faders or knobs 214 mounted on the handle 216, the position or other state of which controls a parameter of the automated luminaire 120 and/or 122. In other embodiments, grips of the handle 216 are user-operated controls that rotate relative to the handle 216, their rotational state providing control of other parameters, such as focus, intensity, or beam angle. Such additional controls may be assignable to any desired function (or parameter) of the automated luminaire 120. For example, one fader may control a brightness of the luminaire, while another controls a beam size. Additionally, yet further user-operated controls 212 may be provided on the console 204 and their rotational state used to control still other parameters.
In some embodiments, the console 204 provides the ability to store and recall cues containing information such as pan and tilt, color, size, or any other parameters of the luminaires under its control. The console 204 may also contain a display 206 that provides information and feedback relating to the control and working of the system, as well as function buttons 210 and indicators 208.
Follow spot controller 200 may also include a display screen 202 showing a live video signal from a camera, as described earlier. In some embodiments, the operator may select between different video feeds using the control functionality of console 204.
In some embodiments, the follow spot controller 200 is fixed in position, while in other embodiments it is gimballed so that it can be panned and tilted to point at different locations on the performance area 240 or around the house (performance facility). In installations where the controller is located to provide the operator a direct view of the performance area 240, the operator can point the follow spots by dead reckoning while directly observing the performance area 240 by eye. In installations where the operator cannot directly view the performance area 240, the operator may rely on the display screen 202 and a camera mounted on the follow spot controller 200, where the camera is positioned to allow a view of the performance area 240. In still other embodiments, the operator may rely on the display screen 202 and the camera 124 mounted on the automated luminaire 122.
In some embodiments, the controller does not physically move. Instead, the operator controls the follow spots' motion via a joystick or other interface device. In such embodiments, the follow spot controller 200 and the display screen 202 are stationary, but the displayed view changes with the direction of the follow spots based on the user's manipulation of the joystick.
In other embodiments the control is combined. The follow spots' motion matches the pointing of the follow spot controller 200 when the performer or target point 242 is viewable from the location of the controller or by the camera relied on by the controller. When the target point 242 is outside that range, the display screen 202 presents a three-dimensional (3-D) rendered view (or virtual view), allowing the follow spots to follow a performer or target point 242 that is not in view of the operator or the camera.
In some embodiments, the follow spot controller 200 automatically or manually switches control of the luminaires 120 and/or 122 back to the main control desk 126 and then, at a later time, allows the operator of the follow spot controller 200 to take back control of the luminaires 120 and 122.
In other embodiments, such a separately mounted camera may be mounted in a fixed orientation, providing a static view of the performance area 240.
The processor 502 is further electrically coupled to and in communication with a communication interface 506 and one or more sensors, actuators, and/or controls 508. The communication interface 506 is coupled to, and configured to communicate with, automated luminaires 120 and 122 via first lighting control communication link 232. The communication interface 506 also is coupled to, and configured to communicate with, lighting control desk 126 via second lighting control communication link 236.
The processor 502 is further electrically coupled to and in communication with a video interface 510, which is in turn electrically coupled to a video camera via communication link 234. The video interface 510 is further electrically coupled to the display screen 202.
The control system 500 is suitable for implementing processes, follow spot control, continuous compensation, and other functionality as disclosed herein, which may be implemented as instructions stored in the memory 504 and executed by the processor 502.
The memory 504 comprises one or more disks, tape drives, and/or solid-state drives and may be used as an over-flow data storage device, to store programs when such programs are selected for execution, and to store instructions and data that are read during program execution. The memory 504 may be volatile and/or non-volatile and may be read-only memory (ROM), random access memory (RAM), ternary content-addressable memory (TCAM), and/or static random-access memory (SRAM).
As described previously, an operator of the follow spot controller 200 may take over control of some, or all, of the control parameters of one or more of the luminaires 120 and 122. In particular, the follow spot controller 200 may control the pan and tilt parameters of one or more of luminaires 120 and 122 and direct them to illuminate a target point 242 on performance area 240. In other embodiments, controls of the follow spot controller 200 may control other parameters of one or more of the luminaires 120 and 122, e.g. brightness, focus, beam size, and/or color. Target point 242 may indicate a performer, and the operator may then move the handles on follow spot controller 200 such that the connected luminaire or luminaires continues to illuminate the performer as he/she moves around the performance area 240.
The performance area 240 may include a stage or dais, a surrounding area, and/or some or all of the facility in which a performance takes place.
In some embodiments, a modified automated luminaire may be used as a follow spot controller according to the disclosure.
Additionally, the automated luminaire 300 functions as a follow spot controller 200 as described with reference to
As described previously, an operator of the combined luminaire and follow spot controller 400 may take over control of some or all of the control parameters of one or more of the luminaires 120. In such a circumstance, the automated luminaire becomes a follow spot controller. In particular, combined luminaire and follow spot controller 400 may control the pan and tilt positions of one or more of luminaires 120 such that they are collectively and individually directed to illuminate a target point, 242, on performance area 240. Thus the control of automated follow spots can be controlled by the manual control of a single follow spot. Target point 242 may indicate a performer, and the operator may then move the handles on combined luminaire and follow spot controller 400 to illuminate the performer with luminaires 120 as she moves around the performance area 240.
As described briefly with reference to
Such a 3-D model may be determined from manual measurements of the surface and locations and mounting orientations. In other embodiments, the extent and locations and mounting orientations may be determined using sensors placed in or on the performance area 240, the automated luminaires 120 and 122, and/or the camera 124. In still other embodiments, the extent and locations of mounting orientations may be determined by the operator moving the center of the light beam projected by the luminaire 122 to each of a plurality of predetermined calibration points in the performance area 240, and indicating to the system the illuminated calibration point.
As the operator moves the luminaire 122 associated with the camera 124, the control system calculates a 3-D vector representing the center of a light beam projected by the luminaire 122. Based on the calculated 3-D vector and, in some embodiments, the location and mounting orientation relative to the performance area 240 of the camera 124, the control system calculates a location of the target point 242 on the performance area 240.
Based on the calculated location of the target point 242 and the locations and mounting orientations relative to the performance area 240 of the automated luminaires 120, the control system calculates individual pan and tilt parameters for each automated luminaire 120 that will result in light beams that also intersect the performance area 240 at the target point 242. These calculations are performed substantially continuously in real time to provide continuous compensation of orientations of the automated luminaires 120, based on the operator's manipulation of the follow spot controller 200.
For the purposes of this disclosure, substantially continuously means sufficiently frequently to prevent perceivably jerky movement of the automated luminaires 120 and/or 122. In some embodiments, such calculated pan and tilt parameters are sent to each automated luminaire 120 at least once every 100 milliseconds. In a preferred embodiment, such calculated pan and tilt parameters are sent to each automated luminaire 120 at least once every 23 milliseconds.
In embodiments where independent camera 134 is used, pan and tilt parameters may also be calculated for the camera 134 that will result in the camera 134 automatically tracking to provide a view of the performance area 240 at the target point 242. Such camera pan and tilt parameters may be recalculated substantially continuously as described above, or with a period comparable to the recalculation of pan and tilt parameters for the automated luminaires 120.
Based on the calculated location of the target point 242 and the location and mounting orientation of the camera relative to the performance area 240 of the automated luminaires 120, the follow spot controller 200 calculates individual pan and tilt parameters for each automated luminaire 120 that will result in light beams that also intersect the performance area 240 at the target point 242.
In some embodiments the follow spot controller 200 (or modified automated luminaire 400) may also control one or more of beam zoom, iris, and light intensity for each controlled automated luminaire 120 or 122. Such control of beam zoom and/or iris would enable the follow spot controller 200 to maintain a constant beam size from each controlled luminaire on a performer as the performer moves within the performance area 240. Further, such control of intensity would enable the follow spot controller 200 to maintain a consistent light intensity on performers as they move within the performance area 240. In applications where the performance is being captured by a video or film camera it is of benefit to maintain a consistent light level on the performer, so that the camera does not have to be adjusted as the performer moves.
In such embodiments, the performer's position establishes a target point 242 in the 3-D model, as calculated from an operator's use of the follow spot controller 200 to point a controlled luminaire at the performer. The follow spot controller 200 may use an initial beam zoom, iris, and/or light intensity for each controlled luminaire, along with a varying throw distance from each controlled luminaire to the calculated moving target point in the 3-D model, to determine changes to make to the beam zoom, iris, and/or light intensity for each controlled luminaire. In such embodiments, an operator of the lighting control desk 126 (or the follow spot controller 200 or modified automated luminaire 400) may choose to allow any one, or any combination, of beam zoom, iris, and light intensity of controlled luminaires to be automatically adjusted by the follow spot controller 200 in order to maintain one or both of beam size and target light intensity, in addition to pan and tilt, for controlled luminaires.
In some embodiments, such a 3-D model is used to provide an operator with a virtual view of the performance area, for example where neither the operator nor any camera has a view of the performance area 240. In various embodiments, such continuous compensation may be provided by a control system in any of follow spot controller 200, modified automated luminaire 300, or modified automated luminaire 400. In other embodiments such continuous compensation is provided by a control system of the lighting control desk 126. In various embodiments, such continuous compensation is enabled and disabled from one of the follow spot controller 200 or lighting control desk 126, and may be enabled for selected ones of the automated luminaires 120.
While the disclosure has been described with respect to a limited number of embodiments, those skilled in the art, having benefit of this disclosure, will appreciate that other embodiments may be devised which do not depart from the scope of the disclosure herein. The disclosure has been described in detail, it should be understood that various changes, substitutions and alterations can be made hereto without departing from the spirit and scope of the disclosure.
This application claims priority to U.S. Provisional Application No. 62/480,967 filed Apr. 3, 2017, by Pavel Jur̆ik, et al., entitled, “An Improved Follow Spot System”, which is incorporated by reference herein as if reproduced in its entirety.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4527198 | Callahan | Jul 1985 | A |
| 4947302 | Callahan | Aug 1990 | A |
| 5023709 | Kita et al. | Jun 1991 | A |
| 6079862 | Kawashima et al. | Jun 2000 | A |
| 6331756 | Belliveau | Dec 2001 | B1 |
| 7354304 | Livingston | Apr 2008 | B2 |
| 9526156 | LaDuke et al. | Dec 2016 | B2 |
| 9593830 | Conti et al. | Mar 2017 | B2 |
| 20090144646 | Reese | Jun 2009 | A1 |
| 20090146982 | Thielman | Jun 2009 | A1 |
| 20100181938 | Boleko Ribas | Jul 2010 | A1 |
| 20110285854 | LaDuke et al. | Nov 2011 | A1 |
| 20120126722 | Archdale | May 2012 | A1 |
| 20130128054 | Densham | May 2013 | A1 |
| 20130155672 | Vo | Jun 2013 | A1 |
| 20140343699 | Engelen | Nov 2014 | A1 |
| 20150003084 | Eichel | Jan 2015 | A1 |
| 20150016106 | Belliveau | Jan 2015 | A1 |
| 20150048233 | Dumas | Feb 2015 | A1 |
| 20150084514 | Anthony | Mar 2015 | A1 |
| 20150091446 | Ohta et al. | Apr 2015 | A1 |
| 20150345762 | Creasman | Dec 2015 | A1 |
| 20160112652 | David | Apr 2016 | A1 |
| 20160178991 | Wan | Jun 2016 | A1 |
| 20170009969 | Conti et al. | Jan 2017 | A1 |
| 20170045211 | Conti et al. | Feb 2017 | A1 |
| 20170068237 | Yamaguchi | Mar 2017 | A1 |
| 20170138730 | Ohtomo | May 2017 | A1 |
| 20180051869 | Belliveau | Feb 2018 | A1 |
| 20180160507 | Feeney | Jun 2018 | A1 |
| 20190029088 | Clout | Jan 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 202353867 | Jul 2012 | CN |
| 203086829 | Jul 2013 | CN |
| 2535909 | Aug 2016 | GB |
| 2008104927 | Sep 2008 | WO |
| 2017008023 | Jan 2017 | WO |
| Entry |
|---|
| Farnik, Martin, et al.; U.S. Appl. No. 15/944,498; Filing Date: Apr. 3, 2018; Title: Follow Spot Control System; 31 pages. |
| Office Action dated Jun. 28, 2018; U.S. Appl. No. 15/944,498, filed Apr. 3, 2018; 6 pages. |
| Office Action dated Aug. 7, 2018; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 26 pages. |
| Farnik, Martin, et al.; U.S. Appl. No. 16/188,475, filed Nov. 13, 2018; Title Follow Spot Control System; 50 pages. |
| Office Action dated Sep. 20, 2018; U.S. Appl. No. 15/944,498, filed Apr. 3, 2018; 20 pages. |
| Office Action dated Jan. 22, 2019; U.S. Appl. No. 15/944,498, filed Apr. 3, 2018; 23 pages. |
| Office Action dated Jan. 22, 2019; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 39 pages. |
| Office Action dated Jan. 22, 2019; U.S. Appl. No. 16/188,475, filed Nov. 13, 2018; 31 pages. |
| European Examination Report; Application No. 18165531.7; dated Mar. 5, 2019; 4 pages. |
| Office Action dated Aug. 19, 2019; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 40 pages. |
| Final Office Action dated May 2, 2019; U.S. Appl. No. 15/944,498, filed Apr. 3, 2018; 21 pages. |
| Advisory Action dated Jun. 27, 2019; U.S. Appl. No. 15/944,498, filed Apr. 3, 2018; 6 pages. |
| Final Office Action dated May 2, 2019; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 38 pages. |
| Advisory Action dated Jul. 3, 2019; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 3 pages. |
| Final Office Action dated May 2, 2019; U.S. Appl. No. 16/188,475, filed Nov. 13, 2018; 33 pages. |
| Advisory Action dated Jul. 3, 2019; U.S. Appl. No. 16/188,475, filed Nov. 13, 2018; 3 pages. |
| Chinese Office Action; Application No. 201810292105.7; dated Jun. 25, 2019; 16 pages. |
| Final Office Action dated Jan. 9, 2020; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 41 pages. |
| Notice of Allowance dated Jan. 30, 2020; U.S. Appl. No. 16/004,223, filed Jun. 8, 2018; 17 pages. |
| Extended European search Report; Application No. 19179007.0; dated Dec. 5, 2019; 10 pages. |
| Chinese Office Action; Application No. 201810292105.7; dated Mar. 31, 2020; 4 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20180224099 A1 | Aug 2018 | US |
| Number | Date | Country | |
|---|---|---|---|
| 62480967 | Apr 2017 | US |
