Patent Grant
10465882
The present invention is directed generally to lighting control. More particularly, various inventive methods and apparatus disclosed herein relate to an interactive system for control of a lighting environment.
In certain lighting system implementations it may be desirable to adjust the lighting parameters of one or more light sources to achieve a desired lighting effect at one or more locations in a lighting environment. For example, it may be desirable to adjust the pan and/or tilt of a light source such as a light source of a “moving head” type spot lighting fixture. Also, for example, it may be desirable to adjust the direction of a LED-based light source (with or without adjusting the pan and/or tilt of such LED-based light source). For example, a LED-based light source may include a plurality of LEDs that generate collimated light beams in different directions and/or from different locations. Selective LEDs of the LED-based light source may be illuminated to direct one or more light beams at one or more locations in a lighting environment. Also, for example, a LED-based light source may additionally or alternatively include one or more redirectable optical elements each provided over one or more LEDs that may be selectively actuated to direct light output from the LED(s) to a desired location.
In certain control situations a user may prefer to have the option to control a desired lighting effect (e.g., the location of a lighting effect, the incoming direction of light creating the lighting effect, the intensity of the lighting effect) instead of or in addition to controlling the lighting source directly (e.g., directly adjusting pan/tilt and/or LED light source output). The Applicants have recognized that lighting effect based control of a light source should be represented in a manner that enables a user to understand the applied lighting effect and that also optionally provides an indication of what other lighting effects might be obtainable.
Thus, there is a need in the art to provide apparatus and methods that enable the user to control and specify one or more desired lighting effects in a lighting system and that, optionally, may provide an indication of capabilities and restrictions of the lighting system.
The present disclosure is directed to inventive methods and apparatus for interactive control of a lighting environment. For example, in some embodiments an interactive system for controlling redirectable lighting in a lighting environment may be provided. The system may enable a user to control and specify one or more desired lighting effects and may optionally provide an indication of capabilities and restrictions of the lighting system. Also, for example, in some embodiments a method of controlling a lighting system for lighting an environment may be provided and include manipulation of a lighting representation in an interactive display and corresponding manipulation of light output of a light source. Also, for example, in some embodiments, systems and methods may be provided that enable the display of adjustable lighting parameters in a virtual environment.
Generally, in one aspect, an interactive system for controlling redirectable lighting in a lighting environment is provided that includes an interactive display having a representation of the lighting environment. The representation includes at least one repositionable lighting representation. The lighting representation is associated with at least one redirectable light source and includes a light source representation and a lighting effect representation. The light source representation includes at least one of a source variable size and a source variable shading corresponding to a lighting parameter of the redirectable light source. The lighting effect representation includes at least one of an effect variable size and an effect variable shading corresponding to a lighting effect of the redirectable light source at a current position of the repositionable lighting effect representation.
In some embodiments, the source variable size corresponds to a beam width of the light source. In some versions of those embodiments the light source representation includes both the source variable size and the source variable shading. In some versions of those embodiments the source variable shading corresponds to a dimming level of the light source.
In some embodiments, the effect variable size corresponds to a size of the lighting effect at the current position. In some versions of those embodiments the lighting effect representation includes both the effect variable size and the effect variable shading. In some versions of those embodiments the effect variable shading corresponds to an illumination level of the current position. The light source representation can be encapsulated within the light effect representation.
In some embodiments, a plurality of the redirectable light source are provided and the lighting representation is selectively associable with at least one of the plurality of the redirectable light source. Also, the lighting parameter can be adjustable via manipulation of the lighting representation on the display.
Generally, in another aspect, an interactive system for controlling redirectable lighting in a lighting environment is provided that includes an interactive display having a representation of the lighting environment. The representation includes a plurality of light sources, at least one repositionable lighting representation, and a repositionable directional fiducial marking. The repositionable directional fiducial marking is associated with the repositionable lighting representation and indicates a direction of light for the lighting representation.
In some embodiments, the fiducial marking extends from adjacent one of the plurality of light sources toward the repositionable lighting representation and is individually repositionable to other of the light sources. In some versions of those embodiments the fiducial marking is a line.
In some embodiments, the repositionable lighting representation corresponds to a current position of the repositionable lighting representation and to which of the light sources the fiducial marking extends toward.
In some embodiments, the repositionable lighting representation includes an outer shape and an inner shape encapsulated within the outer shape.
In some embodiments, the repositionable lighting representation includes a light source representation and a lighting effect representation. In some versions of those embodiments the light source representation includes at least one of a variable size and a variable shading corresponding to a lighting parameter of one of the light sources. In some versions of those embodiments the lighting effect representation includes at least one of a variable size and a variable shading corresponding to a lighting effect at a current position of the repositionable lighting representation. In some versions of those embodiments the variable size corresponds to a beam width. In some versions of those embodiments the light source representation includes both the variable size and the variable shading. In some versions of those embodiments the variable size corresponds to a size of the lighting effect. In some versions of those embodiments the lighting effect representation includes both the variable size and the variable shading. In some versions of those embodiments the variable shading corresponds to an illumination level of the current position.
Generally, in another aspect, a method of controlling a lighting system for lighting an environment is provided and includes: moving a lighting representation to a virtual location on an interactive display, the virtual location representative of a real location in the lighting environment; directing a light output of a lighting source to the real location; adjusting at least one of a size and a shading of the lighting representation on the interactive display; and adjusting at least one of a beam width, a color, and an intensity of the light output in response to the adjusting of at least one of the size and the shading of the lighting representation.
In some embodiments, the method further includes the step of adjusting a fiducial marking associated with the repositionable lighting representation on the virtual screen, wherein adjusting the fiducial marking adjusts directionality of artificial light incident at the real location. In some versions of those embodiments adjusting the fiducial marking adjusts directionality of the light output. In some versions of those embodiments adjusting the fiducial marking directs a second light output of a second light source to the real location.
In some embodiments, the method further includes the step of moving a distal end of a fiducial marking extending from adjacent the lighting effect representation from adjacent a first virtual light source location to adjacent a second virtual light source location—the first virtual light source location corresponding with the lighting source and the second virtual light source location corresponding with a separate second lighting source—and directing a light output of the second lighting source to the real location.
In some embodiments, the lighting effect representation includes an outer shape and an inner shape encapsulated within the outer shape.
In some embodiments, the repositionable lighting representation includes a light source representation and a lighting effect representation. In some versions of those embodiments at least one of the size and the shading of the light source representation is adjusted. In some versions of those embodiments at least one of the size and the shading of the lighting effect representation is adjusted. In some versions of those embodiments adjusting the shading of the lighting effect representation automatically adjusts the shading of the light source representation. The beam width can optionally be adjusted in response to adjusting the size of the lighting effect representation. The beam width can also be adjusted in response to adjusting the size. In some versions of those embodiments the intensity is adjusted in response to adjusting the shading.
Generally, in another aspect, a method of displaying lighting parameters in a virtual environment is provided and includes the steps of: identifying a location of a lighting effect within a virtual environment indicative of a real word environment; determining at least one of a first size and a first shading of a first shape to correspond to a lighting parameter of a light source; determining at least one of a second size and a second shading of a second shape to correspond to the lighting effect of the light source at the location; and overlaying the first shape and the second shape over the location in the virtual environment.
In some embodiments, the first shape is encapsulated within the second shape. In some versions of those embodiments the method further includes the step of positioning a fiducial marking between the light source and the first shape and the second shape.
In some embodiments, the first size, the first shading, the second size, and the second shading are all determined.
In some embodiments, the step of identifying the location includes identifying a location of the light source in the real world environment and identifying a direction of a light output of the light source. In some versions of those embodiments the step of identifying the location further includes identifying the distance between the light source and an actual location in the real world environment. The step of identifying the location optionally includes registering real world objects with virtual objects in the virtual environment.
In some embodiments, the method further includes the step of adjusting at least one of the second size and the second shading of the second shape to correspond to adjustment of the lighting effect.
In some embodiments, the virtual environment is an augmented reality environment.
Generally, in another aspect, a method of displaying lighting parameters in a virtual environment is provided and includes the steps of: identifying a direction of a light output of a light source in a real world environment; identifying a distance between the light source and an actual illumination location in the real world environment; positioning a lighting effect representation within a virtual environment indicative of the real word environment, wherein the positioning is based on the direction and the distance; and configuring the lighting effect to be indicative of lighting conditions at the actual illumination location, wherein the configuring is based on the distance.
In some embodiments, the configuring includes determining a size of the lighting effect representation.
In some embodiments, the configuring includes determining a shading of the lighting effect representation.
As used herein for purposes of the present disclosure, the term “LED” should be understood to include any electroluminescent diode or other type of carrier injection/junction-based system that is capable of generating radiation in response to an electric signal. Thus, the term LED includes, but is not limited to, various semiconductor-based structures that emit light in response to current, light emitting polymers, organic light emitting diodes (OLEDs), electroluminescent strips, and the like. In particular, the term LED refers to light emitting diodes of all types (including semi-conductor and organic light emitting diodes) that may be configured to generate radiation in one or more of the infrared spectrum, ultraviolet spectrum, and various portions of the visible spectrum (generally including radiation wavelengths from approximately 400 nanometers to approximately 700 nanometers). Some examples of LEDs include, but are not limited to, various types of infrared LEDs, ultraviolet LEDs, red LEDs, blue LEDs, green LEDs, yellow LEDs, amber LEDs, orange LEDs, and white LEDs (discussed further below). It also should be appreciated that LEDs may be configured and/or controlled to generate radiation having various bandwidths (e.g., full widths at half maximum, or FWHM) for a given spectrum (e.g., narrow bandwidth, broad bandwidth), and a variety of dominant wavelengths within a given general color categorization.
For example, one implementation of an LED configured to generate essentially white light (e.g., a white LED) may include a number of dies which respectively emit different spectra of electroluminescence that, in combination, mix to form essentially white light. In another implementation, a white light LED may be associated with a phosphor material that converts electroluminescence having a first spectrum to a different second spectrum. In one example of this implementation, electroluminescence having a relatively short wavelength and narrow bandwidth spectrum “pumps” the phosphor material, which in turn radiates longer wavelength radiation having a somewhat broader spectrum.
It should also be understood that the term LED does not limit the physical and/or electrical package type of an LED. For example, as discussed above, an LED may refer to a single light emitting device having multiple dies that are configured to respectively emit different spectra of radiation (e.g., that may or may not be individually controllable). Also, an LED may be associated with a phosphor that is considered as an integral part of the LED (e.g., some types of white LEDs). In general, the term LED may refer to packaged LEDs, non-packaged LEDs, surface mount LEDs, chip-on-board LEDs, T-package mount LEDs, radial package LEDs, power package LEDs, LEDs including some type of encasement and/or optical element (e.g., a diffusing lens), etc.
The term “light source” should be understood to refer to any one or more of a variety of radiation sources, including, but not limited to, LED-based sources (including one or more LEDs as defined above), incandescent sources (e.g., filament lamps, halogen lamps), fluorescent sources, phosphorescent sources, high-intensity discharge sources (e.g., sodium vapor, mercury vapor, and metal halide lamps), lasers, other types of electroluminescent sources, pyro-luminescent sources (e.g., flames), candle-luminescent sources (e.g., gas mantles, carbon arc radiation sources), photo-luminescent sources (e.g., gaseous discharge sources), cathode luminescent sources using electronic satiation, galvano-luminescent sources, crystallo-luminescent sources, kine-luminescent sources, thermo-luminescent sources, triboluminescent sources, sonoluminescent sources, radioluminescent sources, and luminescent polymers.
A given light source may be configured to generate electromagnetic radiation within the visible spectrum, outside the visible spectrum, or a combination of both. Hence, the terms “light” and “radiation” are used interchangeably herein. Additionally, a light source may include as an integral component one or more filters (e.g., color filters), lenses, or other optical components. Also, it should be understood that light sources may be configured for a variety of applications, including, but not limited to, indication, display, and/or illumination. An “illumination source” is a light source that is particularly configured to generate radiation having a sufficient intensity to effectively illuminate an interior or exterior space. In this context, “sufficient intensity” refers to sufficient radiant power in the visible spectrum generated in the space or environment (the unit “lumens” often is employed to represent the total light output from a light source in all directions, in terms of radiant power or “luminous flux”) to provide ambient illumination (i.e., light that may be perceived indirectly and that may be, for example, reflected off of one or more of a variety of intervening surfaces before being perceived in whole or in part).
The term “spectrum” should be understood to refer to any one or more frequencies (or wavelengths) of radiation produced by one or more light sources. Accordingly, the term “spectrum” refers to frequencies (or wavelengths) not only in the visible range, but also frequencies (or wavelengths) in the infrared, ultraviolet, and other areas of the overall electromagnetic spectrum. Also, a given spectrum may have a relatively narrow bandwidth (e.g., a FWHM having essentially few frequency or wavelength components) or a relatively wide bandwidth (several frequency or wavelength components having various relative strengths). It should also be appreciated that a given spectrum may be the result of a mixing of two or more other spectra (e.g., mixing radiation respectively emitted from multiple light sources).
For purposes of this disclosure, the term “color” is used interchangeably with the term “spectrum.” However, the term “color” generally is used to refer primarily to a property of radiation that is perceivable by an observer (although this usage is not intended to limit the scope of this term). Accordingly, the terms “different colors” implicitly refer to multiple spectra having different wavelength components and/or bandwidths. It also should be appreciated that the term “color” may be used in connection with both white and non-white light.
The term “color temperature” generally is used herein in connection with white light, although this usage is not intended to limit the scope of this term. Color temperature essentially refers to a particular color content or shade (e.g., reddish, bluish) of white light. The color temperature of a given radiation sample conventionally is characterized according to the temperature in degrees Kelvin (K) of a black body radiator that radiates essentially the same spectrum as the radiation sample in question. Black body radiator color temperatures generally fall within a range of from approximately 700 degrees K (typically considered the first visible to the human eye) to over 10,000 degrees K; white light generally is perceived at color temperatures above 1500-2000 degrees K.
The term “lighting fixture” is used herein to refer to an implementation or arrangement of one or more lighting units in a particular form factor, assembly, or package. The term “lighting unit” is used herein to refer to an apparatus including one or more light sources of same or different types. A given lighting unit may have any one of a variety of mounting arrangements for the light source(s), enclosure/housing arrangements and shapes, and/or electrical and mechanical connection configurations. Additionally, a given lighting unit optionally may be associated with (e.g., include, be coupled to and/or packaged together with) various other components (e.g., control circuitry) relating to the operation of the light source(s). An “LED-based lighting unit” refers to a lighting unit that includes one or more LED-based light sources as discussed above, alone or in combination with other non LED-based light sources. A “multi-channel” lighting unit refers to an LED-based or non LED-based lighting unit that includes at least two light sources configured to respectively generate different spectrums of radiation, wherein each different source spectrum may be referred to as a “channel” of the multi-channel lighting unit.
The term “controller” is used herein generally to describe various apparatus relating to the operation of one or more light sources. A controller can be implemented in numerous ways (e.g., such as with dedicated hardware) to perform various functions discussed herein. A “processor” is one example of a controller which employs one or more microprocessors that may be programmed using software (e.g., microcode) to perform various functions discussed herein. A controller may be implemented with or without employing a processor, and also may be implemented as a combination of dedicated hardware to perform some functions and a processor (e.g., one or more programmed microprocessors and associated circuitry) to perform other functions. Examples of controller components that may be employed in various embodiments of the present disclosure include, but are not limited to, conventional microprocessors, application specific integrated circuits (ASICs), and field-programmable gate arrays (FPGAs).
In various implementations, a processor or controller may be associated with one or more storage media (generically referred to herein as “memory,” e.g., volatile and non-volatile computer memory such as RAM, PROM, EPROM, and EEPROM, floppy disks, compact disks, optical disks, magnetic tape, etc.). In some implementations, the storage media may be encoded with one or more programs that, when executed on one or more processors and/or controllers, perform at least some of the functions discussed herein. Various storage media may be fixed within a processor or controller or may be transportable, such that the one or more programs stored thereon can be loaded into a processor or controller so as to implement various aspects of the present invention discussed herein. The terms “program” or “computer program” are used herein in a generic sense to refer to any type of computer code (e.g., software or microcode) that can be employed to program one or more processors or controllers.
The term “addressable” is used herein to refer to a device (e.g., a light source in general, a lighting unit or fixture, a controller or processor associated with one or more light sources or lighting units, other non-lighting related devices, etc.) that is configured to receive information (e.g., data) intended for multiple devices, including itself, and to selectively respond to particular information intended for it. The term “addressable” often is used in connection with a networked environment (or a “network,” discussed further below), in which multiple devices are coupled together via some communications medium or media.
In one network implementation, one or more devices coupled to a network may serve as a controller for one or more other devices coupled to the network (e.g., in a master/slave relationship). In another implementation, a networked environment may include one or more dedicated controllers that are configured to control one or more of the devices coupled to the network. Generally, multiple devices coupled to the network each may have access to data that is present on the communications medium or media; however, a given device may be “addressable” in that it is configured to selectively exchange data with (i.e., receive data from and/or transmit data to) the network, based, for example, on one or more particular identifiers (e.g., “addresses”) assigned to it.
The term “network” as used herein refers to any interconnection of two or more devices (including controllers or processors) that facilitates the transport of information (e.g. for device control, data storage, data exchange, etc.) between any two or more devices and/or among multiple devices coupled to the network. As should be readily appreciated, various implementations of networks suitable for interconnecting multiple devices may include any of a variety of network topologies and employ any of a variety of communication protocols. Additionally, in various networks according to the present disclosure, any one connection between two devices may represent a dedicated connection between the two systems, or alternatively a non-dedicated connection. In addition to carrying information intended for the two devices, such a non-dedicated connection may carry information not necessarily intended for either of the two devices (e.g., an open network connection). Furthermore, it should be readily appreciated that various networks of devices as discussed herein may employ one or more wireless, wire/cable, and/or fiber optic links to facilitate information transport throughout the network.
The term “user interface” as used herein refers to an interface between a human user or operator and one or more devices that enables communication between the user and the device(s). Examples of user interfaces that may be employed in various implementations of the present disclosure include, but are not limited to, switches, potentiometers, buttons, dials, sliders, a mouse, keyboard, keypad, various types of game controllers (e.g., joysticks), track balls, display screens, various types of graphical user interfaces (GUIs), touch screens, microphones and other types of sensors that may receive some form of human-generated stimulus and generate a signal in response thereto.
It should be appreciated that all combinations of the foregoing concepts and additional concepts discussed in greater detail below (provided such concepts are not mutually inconsistent) are contemplated as being part of the inventive subject matter disclosed herein. In particular, all combinations of claimed subject matter appearing at the end of this disclosure are contemplated as being part of the inventive subject matter disclosed herein. It should also be appreciated that terminology explicitly employed herein that also may appear in any disclosure incorporated by reference should be accorded a meaning most consistent with the particular concepts disclosed herein.
In the drawings, like reference characters generally refer to the same parts throughout the different views. Also, the drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention.
In certain lighting system implementations it may be desirable to adjust the lighting parameters of one or more light sources to achieve a desired lighting effect at one or more locations in a lighting environment. For example, it may be desirable to adjust the pan and/or tilt of a light source such as a light source of a moving head type spot lighting fixture. Also, for example, it may be desirable to adjust the direction of light output of a LED-based light source (with or without adjusting the pan and/or tilt of such LED-based light source). In certain control situations a user may prefer to have the option to control a desired lighting effect instead of or in addition to controlling the lighting source directly. Applicants have recognized and appreciated that lighting effect based control of a light source should be represented in a manner that enables a user to understand the applied lighting effect and that also optionally provides an indication of what other lighting effects might be obtainable.
Thus, there is a need in the art to provide apparatus and methods that enable the user to control and specify one or more desired lighting effects in a lighting system and that optionally provides an indication of capabilities and restrictions of the lighting system.
More generally, Applicants have recognized and appreciated that it would be beneficial to provide various inventive methods and apparatus related to interactive system for control of a lighting environment.
In view of the foregoing, various embodiments and implementations of the present invention are directed to lighting control.
In the following detailed description, for purposes of explanation and not limitation, representative embodiments disclosing specific details are set forth in order to provide a thorough understanding of the claimed invention. However, it will be apparent to one having ordinary skill in the art having had the benefit of the present disclosure that other embodiments according to the present teachings that depart from the specific details disclosed herein remain within the scope of the appended claims. Moreover, descriptions of well-known apparatus and methods may be omitted so as to not obscure the description of the representative embodiments. Such methods and apparatus are clearly within the scope of the claimed invention. For example, aspects of the methods and apparatus disclosed herein are described in conjunction with control of a lighting system in a retail environment. However, one or more aspects of the methods and apparatus described herein may be implemented in other settings such as, for example, offices, theatre, and home environments. Implementation of the one or more aspects described herein in alternatively configured environments is contemplated without deviating from the scope or spirit of the claimed invention.
Referring to
In some embodiments, the augmented reality display device 30 may be a portable electronic device which has at one side a display 31 and at a side opposite the display a camera. In some embodiments the display may provide an image of the environment captured by the camera of the display device 30 and may overlay the image with one or more overlay items such as those described herein. For example, the image captured by the camera of the display device 30 may be overlaid with one or more representations of a lighting effect, a light output direction, and/or a lighting source. In alternative embodiments the display device 30 may overlay an image that is captured by a remote camera and/or an image that does not necessarily correspond to the location at which the display device 30 is currently located (e.g., the user may modify lighting parameters from a remote location). In some embodiments the display may provide a 3D rendering, schematic representation, or other representation of the environment and may include one or more representations of a lighting effect, a light output direction, and/or a lighting source. Display device 30 is provided herein as an example of a display and user interface that may be utilized to implement one or more of the systems and/or methods described herein. However, one of ordinary skill in the art, having had the benefit of the present disclosure, will recognize and appreciate that in alternative embodiments additional and/or alternative displays and user interfaces may be utilized that provide a representation of an actual lighting environment, enable manipulation of lighting parameters of a lighting system within the lighting environment, and optionally provide an indication of capabilities and restrictions of the lighting system.
As described herein, the user 1 may utilize the display device 30 to provide a desired lighting effect for the selected location (e.g., via direct input to a user interface of the display device 30). Based on the provided input, the display device may in some embodiments immediately generate control signals and provide them to the lighting fixtures 12 and/or 16 (e.g., via a network utilizing one or more communication protocols such as DMX, Ethernet, Bluetooth, ZigBee, and/or Z-Wave) so that the user 1 is able to immediately see the real world effect of the selected control parameters. In another embodiment, the lighting system is not immediately controlled, but may be later adjusted based on selected control parameters (either directly via display device 30 or through a separate controller).
Referring to
The illustrated lighting representation 41 has an outer circle 42 and an inner circle 44. The inner circle 44 may be indicative of one or more properties of the light source of the LED lighting fixture 12. For example, the size of the inner circle 44 may be indicative of the beam width of the light output of the LEDs of the LED lighting fixture that are active and directed at the mannequin. Also, for example, the shading of the inner circle 44 may be indicative of the dimming value of such LEDs. For example, greylevels between black and white may be mapped to the dimming level of the lamp. Accordingly, by viewing the shading of the inner circle 44 a user will be able to ascertain if the dimming level may be increased and/or decreased to alter the illumination at the effect location. The outer circle 42 is indicative of one or more properties of the lighting effect provided by the output from LED lighting fixture 12 at the lighting effect location (e.g., the face of the mannequin 3 in
Illustrated extending from the spot lighting fixture 16 is a stick 45. The stick 45 is interposed between the spot lighting fixture 16 and a lighting representation 46 on the wall 5. The stick 45 provides an indication of the direction of the light output provided by the spot lighting fixture 16 and the lighting representation 46 attached to the stick 45 provides an indication of the area illuminated by the light output provided by the spot lighting fixture 16.
The lighting representation 46 has an outer circle 47 and an inner circle 49. The inner circle 49 is indicative of one or more properties of the light source of the spot lighting fixture 16. For example, the size of the inner circle 49 may be indicative of the beam width and the shading of the inner circle 49 may be indicative of the dimming value. The outer circle 47 is indicative of one or more properties of the lighting effect provided by the output from spot lighting fixture 16 at the lighting effect location. For example, the size of the outer circle 47 may be indicative of the size of the lighting effect and the shading of the outer circle 47 may be indicative of the illumination provided to the illuminated object at the lighting effect location.
Although outer circles 42, 47 and concentric inner circles 44, 49 are illustrated in
The location and/or viewing angle(s) (generally indicated by arrow 135) of the display device 130 are also determinable. For example, the location of the display device 130 within the coordinate system may be provided via configuration by a user (e.g. entering of the coordinates by a user) or utilizing one or more location methods. Also, for example, the viewing angle(s) of the display device may be determined via an orientation sensor such as, for example, a digital compass (e.g., a magnetometer, gyrocompass, and/or hall effect sensors) a gyroscope, an accelerometer, and/or a three-axis electronic compass. The sensor(s) of the display device 130 may include a GPS sensor or other sensor which is capable of determining the location of the display device 130 within the environment; an electronic compass or other sensor that is capable of determining the direction in which the camera of the display device 130 is directed; and a zoom controller of the camera or other sensor that may detect the angle of view of the camera.
These locations, distances, and/or angles may be utilized in detecting and defining the location of light spots on the display device 130 or other control device utilizing lighting representations presented on a display. For example, in some embodiments a virtual reality display of the actual environment may be created utilizing, for example, a schematic representation of the actual environment and/or a 3D model of the environment. In other embodiments an augmented reality display may be created.
At step 204, registration occurs to align virtual objects with real objects in the augmented reality display. For example, in some embodiments markers and video processing may be utilized to register virtual objects with real objects in the augmented reality display. Markers may be placed in the real environment and their locations configured. The markers are then detected in the augmented video display utilizing video processing. Also, for example, in some embodiments a rough 3D model of the real environment may be made and, utilizing video processing, elements of the real environment (e.g., corners of a room) may be detected and mapped to the rough 3D model. Also, for example, in some embodiments geometric reasoning may be utilized. For example, detected location and aiming parameters of the display device 130 may be measured and mapped onto the coordinates of the environment. The camera and/or display properties of the display device 130 may also be taken into account.
At step 205, two virtual shapes are created in virtual space at the location of the lighting effect. The virtual shapes may include inner and outer concentric shapes. In some embodiments the inner virtual shape may be sized, shaded, colored, and/or shaped to represent a property of the light source and the outer virtual shape may be sized, shaded, colored, and/or shaped to represent a property of the lighting effect. For example, the diameter of the inner shape may be an indication for the beam width and the greyness of the inner shape may be an indication of the dimming level of the light source. Also, for example, the diameter of the outer shape may be an indication for the effect size and the greyness of the outer shape may represent the illumination of the lighting target. These virtual shapes are mapped together with the real picture in the display of the augmented reality device.
At step 206, a virtual stick is drawn that connects the virtual shapes with the light source. As described herein, the virtual stick may be made to be movable in various embodiments. For example, when moving the virtual shapes, the effect end of the stick may be configured to move with the virtual shapes and the light source end of the stick to stay in location. When moving the stick, the effect end of the stick may be configured to remain at the same location while the lamp end of the stick moves (e.g., to another light source). Although a solid line stick is illustrated in the Figures, it is understood that other fiducial markings may be utilized instead of and/or in addition to a solid line stick. For example, in some embodiments a dashed line may be provided, an irregularly shaped solid and/or dashed line, and/or a dashed or solid line made up of a plurality of symbols. Also, although the solid line stick is shown extending completely between and connecting the virtual lighting representation and the virtual light source, in some embodiments the stick (or other marking) may only extend partially between the virtual lighting representation and the virtual light source. Also, for example, in some embodiments the stick (or other marking) may only be associated with a lighting representation (indicating the direction of artificial light thereon) without the light source necessarily being represented in the virtual display.
The user need not be necessarily present in the real environment when controlling and/or configuring lighting in the real environment. The particular moment of time when the image or model of the real environment was obtained may be a moment in time that does not relate to the moment in time at which the user indicates desired lighting effects in a lighting system and optionally receives an indication of capabilities and restrictions of the lighting system. For example, an image of the real environment may be stored in a database together with the information of the lighting system and information of the environment. Or, in another example, a device may include a camera for obtaining the image of the real environment, and after obtaining the image the device may be relocated to another room and/or the user may move the device to a more comfortable position before providing the user input. The depiction of the real environment may be a schematic drawing of the environment or the depiction may be a recording of the environment, for example, a photograph taken at a particular moment in time.
In some embodiments, the real environment and/or lighting system model may be obtained via known technologies, such as for example the so-termed darkroom calibration or technologies that utilize coded light from the light sources and an image sensor to detect the footprints of the light sources and to detect the identification codes of the light sources. In other embodiments the real environment and/or lighting system model may be composed by a person, for example, a technician who installed the lighting system in the environment.
The display 331 represents the mannequin 303 and five separate redirectable light sources 316A-E and 312. The redirectable light sources 316A-E may be, for example, light sources of motorized spot type lighting fixtures. The light source 312 may be, for example, an LED-based lighting fixture that includes redirectable light output via the manipulation of one or more LEDs and/or optical components thereof. In some embodiments one or more non-redirectable light sources may be provided. Optionally, such non-redirectable light sources may include at least one adjustable parameter (e.g., intensity, beam width, color). Each of the redirectable light sources 316A-E, 312 is associated with a stick 340A-E, 345 extending therefrom and a lighting representation 341A-E, 346 at an opposing end of the stick 340A-E, 345. Each lighting representation 341A-E, 346 includes an outer circle 342A-E, 347 and an inner circle 344A-E, 349.
The size of each inner circle 344A-E, 349 is indicative of the beam width of the respective light source 316A-E, 312. The shading of each inner circle 344A-E, 349 is indicative of the dimming level of the respective light source 316A-E, 312. The size of each outer circle 342A-E, 347 is indicative of the size of the effect generated at the aiming location of the respective light source 316A-E, 312. The shading of each outer circle 344A-E, 349 is indicative of the illumination level at the aiming location of the respective light source 316A-E, 312. In
In
In
In
During the redirection action of the user, the pan and tilt values of the lighting source 316A are changed in the direction of the new effect position, and based on coordinates of the source and distance between light source and light effect, the location of the lighting representation is determined and mapped to the virtual screen. This results in new positions of the lighting representation 341A and gives the user the possibility to place the lighting representation 341A on the new position of the mannequin 303. The stick 340A is also adapted to the new position of the lighting representation 341A on the screen.
In some embodiments the pan and tilt values of the lighting source 316A may be derived from the movement of a user's finger on a touchscreen or from the movement of a pointer on a screen via another input device. For example, an initial movement of the lighting representation 341A to the mannequin 303 on a virtual screen by a user will cause a controller to direct the lighting source 316A to initially pan and/or tilt in a direction generally toward the mannequin 303 in the real environment. After the initial pan and/or tilt, the new position of the lighting effect in the real environment may be determined utilizing, for example, a distance sensor of the lighting source 316A and/or other inputs discussed herein. The new position of the lighting representation 341A may then be updated and positioned on the display 331. The new position may be different from the intended target (e.g., the position of the finger on the touchscreen), and, if so, the controller may direct the lighting source 316A to pan and/or tilt farther and then determine the position of the lighting effect in the real environment and update the position on the display 331. After one or more iterations of adjusting the light source 316A, determining the real world location of the lighting effect, updating the location on the display 331, and further adjusting the light source if the location is different than the intended target, the real world and virtual location of the lighting effect will match the intended target.
One potential sequence of events while adjusting the lighting representation 341A to the mannequin 303 on a virtual screen by a user involves a user tapping the lighting representation 341A then dragging his finger in the direction of arrow 307. In response, the lighting source 316A is adjusted in the direction of arrow 307, but the real world lighting effect is initially located on the wall located behind the mannequin 303. The user may continue to drag his finger further in the direction of arrow 307 and the real world lighting effect will continue on the wall behind the mannequin 303 until it is intersected by the mannequin 303. At that time the lighting representation 341A is correctly positioned and its location will be updated in the display 331 to reflect that it is atop the mannequin 303. The location and the size of the effect may be determined based on the determined distance between the lighting source 316A and the mannequin 303 and the virtual display characteristics (shading, size) of the effect aspect of the lighting representation 341A may be determined based in part on that distance.
In
In
In the illustrated embodiment the effect end of the stick 340C remains at the same position, while the light source end is moved to a new location. If only a few possibilities for moving the light source end are valid (e.g. discrete number of light sources), the stick 340C may jump to the nearest possible light source while being moved, until it is released at the desired light source. In the case of a light on a crane, the stick may move smoothly, while the crane follows the movement of the light source end of the stick. In some alternative embodiments, when moving the stick close to a light source representation on the display 331, the light source becomes active (representation changes appearance and/or real world light source may instantly show a preview of the effect), and when the user releases the stick 340C it automatically connects to the closest light source. Optionally, areas that are non-accessible by the stick 340C (e.g., light sources that are too far away and/or are blocked by obstacles) may be greyed out indicating to the user an available range and/or areas that are accessible by the stick 340C may be highlighted.
By using known touchscreen, gesture interaction methods, and/or other inputs (e.g., a keyboard, stylus, and/or a mouse) other properties of the light effect may optionally be changed. For example, one or more of color temperature, color, beam shape, and filters or gobos that can be placed in front of the light source may be altered. For example, the beam shape may be altered by double clicking on the lighting representation and selecting from a plurality of predefined beam shape options. Optionally, when the beam shape is altered the shape of the lighting representation may be altered to correspond with such beam shape. Also, optionally, when the color or color temperature is altered, the color of the lighting representation may be altereed to correspond with such selected color.
Also, sequences that change the temporal or spatial behaviour of the light effect can be activated via user input. Light source parameters may also optionally be locked via user input to prevent changes such as, for example locking the pan, tilt, and/or dimming level of a light source. When a parameter is locked, the system may prevent on screen interactions that are counter to such parameter. For example, when moving a stick, the stick may not jump to a light source having a locked pan parameter that does not correspond with the necessary pan parameter to create a lighting effect at the desired location.
Also, constraints may be placed on certain lighting effects. For example, a constraint to “keep intensity to approximately 1000 lux” may be placed on a lighting effect. When the lighting effect is redirected, the distance to the light source and thus the intensity may change. This change may optionally be automatically compensated by adjusting the dimming level of the light source.
When multiple lighting representations are pointed to the same location, the lighting representations (circles in the Figures) may be stacked on each other in the display. In some embodiments by tapping several times on the stacked lighting representations, the user can browse through the individual lighting representations in the stack.
In some embodiments the lighting representations may be fixable on a certain object in the real environment, such that the lighting representations will follow the object when it is moved in the real environment. For example, one or more actors may be tracked across a stage. Also, for example, a product on a shelf may be illuminated even when it is picked up now and then, and put back at a slightly different location. The interface may offer an interaction mechanism for users to indicate which objects should be illuminated, and with which lighting properties. Properties such as, for example, the lighting intensity and spot size may be fixed to a certain object.
While several inventive embodiments have been described and illustrated herein, those of ordinary skill in the art will readily envision a variety of other means and/or structures for performing the function and/or obtaining the results and/or one or more of the advantages described herein, and each of such variations and/or modifications is deemed to be within the scope of the inventive embodiments described herein. More generally, those skilled in the art will readily appreciate that all parameters, dimensions, materials, and configurations described herein are meant to be exemplary and that the actual parameters, dimensions, materials, and/or configurations will depend upon the specific application or applications for which the inventive teachings is/are used. Those skilled in the art will recognize, or be able to ascertain using no more than routine experimentation, many equivalents to the specific inventive embodiments described herein. It is, therefore, to be understood that the foregoing embodiments are presented by way of example only and that, within the scope of the appended claims and equivalents thereto, inventive embodiments may be practiced otherwise than as specifically described and claimed. Inventive embodiments of the present disclosure are directed to each individual feature, system, article, material, kit, and/or method described herein. In addition, any combination of two or more such features, systems, articles, materials, kits, and/or methods, if such features, systems, articles, materials, kits, and/or methods are not mutually inconsistent, is included within the inventive scope of the present disclosure.
All definitions, as defined and used herein, should be understood to control over dictionary definitions, definitions in documents incorporated by reference, and/or ordinary meanings of the defined terms.
The indefinite articles “a” and “an,” as used herein in the specification and in the claims, unless clearly indicated to the contrary, should be understood to mean “at least one.”
The phrase “and/or,” as used herein in the specification and in the claims, should be understood to mean “either or both” of the elements so conjoined, i.e., elements that are conjunctively present in some cases and disjunctively present in other cases. Multiple elements listed with “and/or” should be construed in the same fashion, i.e., “one or more” of the elements so conjoined. Other elements may optionally be present other than the elements specifically identified by the “and/or” clause, whether related or unrelated to those elements specifically identified. Thus, as a non-limiting example, a reference to “A and/or B”, when used in conjunction with open-ended language such as “comprising” can refer, in one embodiment, to A only (optionally including elements other than B); in another embodiment, to B only (optionally including elements other than A); in yet another embodiment, to both A and B (optionally including other elements); etc.
As used herein in the specification and in the claims, the phrase “at least one,” in reference to a list of one or more elements, should be understood to mean at least one element selected from any one or more of the elements in the list of elements, but not necessarily including at least one of each and every element specifically listed within the list of elements and not excluding any combinations of elements in the list of elements. This definition also allows that elements may optionally be present other than the elements specifically identified within the list of elements to which the phrase “at least one” refers, whether related or unrelated to those elements specifically identified. It should also be understood that, unless clearly indicated to the contrary, in any methods claimed herein that include more than one step or act, the order of the steps or acts of the method is not necessarily limited to the order in which the steps or acts of the method are recited.
Also, reference numerals appearing in the claims between parentheses, if any, are provided merely for convenience and should not be construed as limiting the claims in any way.
This application is the U.S. National Phase application under 35 U.S.C. § 371 of International Application No. PCT/IB2012/057304, filed on Dec. 14, 2012, which claims the benefit of [e.g., U.S. Provisional Patent Application No. or European Patent Application No.]61/570319, filed on Dec. 4, 2011. These applications are hereby incorporated by reference herein.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/IB2012/057304 | 12/14/2012 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2013/088394 | 6/20/2013 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5307295 | Taylor | Apr 1994 | A |
| 6448987 | Easty et al. | Sep 2002 | B1 |
| 6587131 | Nakai | Jul 2003 | B1 |
| 6611297 | Akashi et al. | Aug 2003 | B1 |
| 7242152 | Dowling et al. | Jul 2007 | B2 |
| 7251637 | Caid | Jul 2007 | B1 |
| 7400458 | Farr | Jul 2008 | B2 |
| 7495671 | Chemel et al. | Feb 2009 | B2 |
| 7710271 | Frumau | May 2010 | B2 |
| 7765486 | Jaeger | Jul 2010 | B2 |
| 8264168 | Feri et al. | Sep 2012 | B2 |
| 8937444 | Ogg et al. | Jan 2015 | B2 |
| 9001203 | Shimada | Apr 2015 | B2 |
| 9678653 | Manyam | Jun 2017 | B1 |
| 9696867 | Holz | Jul 2017 | B2 |
| 20010030668 | Erten | Oct 2001 | A1 |
| 20020140745 | Ellenby | Oct 2002 | A1 |
| 20020181070 | Hewlett | Dec 2002 | A1 |
| 20030184602 | Kuroki | Oct 2003 | A1 |
| 20040160199 | Morgan | Aug 2004 | A1 |
| 20050010318 | Lev-Ami et al. | Jan 2005 | A1 |
| 20050123171 | Kobayashi | Jun 2005 | A1 |
| 20050231134 | Sid | Oct 2005 | A1 |
| 20050272506 | Sumi | Dec 2005 | A1 |
| 20060168183 | Fuller, III et al. | Jul 2006 | A1 |
| 20060227151 | Bannai | Oct 2006 | A1 |
| 20070070069 | Samarasekera | Mar 2007 | A1 |
| 20080062682 | Hoelen et al. | Mar 2008 | A1 |
| 20080070684 | Haigh-Hutchinson | Mar 2008 | A1 |
| 20080140231 | Blackwell | Jun 2008 | A1 |
| 20080183337 | Szabados | Jul 2008 | A1 |
| 20080259590 | De Goederen-Oei | Oct 2008 | A1 |
| 20080267450 | Sugimoto | Oct 2008 | A1 |
| 20080316730 | Diederiks | Dec 2008 | A1 |
| 20090009984 | Mangiardi et al. | Jan 2009 | A1 |
| 20090016046 | Witsenburg et al. | Jan 2009 | A1 |
| 20090046454 | Bertram et al. | Feb 2009 | A1 |
| 20090284187 | Diederiks | Nov 2009 | A1 |
| 20100053198 | Vinkenvleugel et al. | Mar 2010 | A1 |
| 20100090619 | Adamson | Apr 2010 | A1 |
| 20100149109 | Elias | Jun 2010 | A1 |
| 20100208033 | Edge | Aug 2010 | A1 |
| 20100277107 | Baaijens | Nov 2010 | A1 |
| 20100301776 | Feri | Dec 2010 | A1 |
| 20100308755 | Van Liempd et al. | Dec 2010 | A1 |
| 20100312366 | Madonna | Dec 2010 | A1 |
| 20100315390 | Bergman et al. | Dec 2010 | A1 |
| 20110035404 | Morgan | Feb 2011 | A1 |
| 20110074672 | Diederiks et al. | Mar 2011 | A1 |
| 20110112691 | Engelen | May 2011 | A1 |
| 20110141010 | Sakata | Jun 2011 | A1 |
| 20110273114 | Ogg | Nov 2011 | A1 |
| 20110280449 | Campbell, Jr. | Nov 2011 | A1 |
| 20120014558 | Stafford | Jan 2012 | A1 |
| 20120081030 | Berkvens | Apr 2012 | A1 |
| 20120095745 | Le Guevel-Scholtens | Apr 2012 | A1 |
| 20120161643 | Henig et al. | Jun 2012 | A1 |
| 20120242676 | George | Sep 2012 | A1 |
| 20130212509 | Van Seggelen et al. | Aug 2013 | A1 |
| 20130221872 | Gan | Aug 2013 | A1 |
| 20140354160 | Aggarwal | Dec 2014 | A1 |
| 20150154808 | Engelen | Jun 2015 | A1 |
| 20150286724 | Knaapen | Oct 2015 | A1 |
| 20160120009 | Aliakseyeu | Apr 2016 | A1 |
| Number | Date | Country |
|---|---|---|
| 102090151 | Jun 2011 | CN |
| 2010078854 | Apr 2010 | JP |
| 2011527812 | Nov 2011 | JP |
| 2010004448 | Jan 2010 | WO |
| 2011092609 | Aug 2011 | WO |
| 2012049656 | Apr 2012 | WO |
| 2012131544 | Oct 2012 | WO |
| Number | Date | Country | |
|---|---|---|---|
| 20140343699 A1 | Nov 2014 | US |
| Number | Date | Country | |
|---|---|---|---|
| 61570319 | Dec 2011 | US |
