Patent Application
20250214724
This application claims the benefit of Indian Provisional Patent Application No. 202311089528, filed Dec. 28, 2023, which application is incorporated by reference herein.
The present disclosure relates generally to video surveillance systems and more particularly to drone-based video surveillance systems.
A number of video surveillance systems employ fixed video cameras that are physically mounted at desired positions in the field with wired power and data communication capabilities. In some cases, such fixed video cameras include pan, tilt and/or zoom capabilities that can be used to adjust their field of view (FOV). Some video surveillance systems also employ mobile video cameras such as video cameras that are attached to drones. Drones are able to fly essentially anywhere in order to place a video camera at a desired location, for example. Drones are battery-powered, and as such may run low on battery power before completing their commanded flight, which may include the drone flying to a desired location that is not adequately covered by the fixed video cameras, remaining at the desired location for a period of time to observe and capture a video stream showing an event, and then returning to its original location. While drones are often able to communicate wirelessly, such as via WiFi or cellular networks (e.g. 4G, 5G), the drones may fly through regions in which these communication protocols are not effective or available. What would be desirable are methods and systems that allow a drone to land on a fixed security camera in order to allow the drone battery to be recharged using power from the fixed security camera and/or to download data such as a video stream captured by the drone to a network via the data communication capabilities of the fixed video camera.
The present disclosure relates generally to video surveillance systems and more particularly to drone-based video surveillance systems. An example may be found in a fixed security camera. The illustrative security camera includes a housing that houses a video camera for capturing one or more video streams, one or more power ports and one or more data ports. At least one of the one or more power ports receives power to power the video camera. At least one of the one or more data ports transmits one or more of the video streams captured by the video camera onto a network. A drone landing pad is supported by the housing of the video camera and includes a drone power port and a drone data port. The drone power port is operatively coupled to the security camera for receiving power from the security camera and is configured to operatively connect to a power port of a drone to recharge a power source of the drone using power from the security camera when the drone lands on the drone landing pad of the security camera. The drone data port is operatively coupled to the security camera and is configured to operatively connect to a data port of the drone when the drone lands on the drone landing pad and is configured to transfer drone data from the drone to the security camera.
Another example may be found in a method for operating a drone. The method includes identifying a location of a fixed security camera, wherein the security camera includes a drone landing pad that includes a drone power port for providing power to the drone from the security camera and a drone data port for receiving drone data from the drone. The drone is landed on the drone landing pad such that the drone is connected to the drone power port and the drone data port of the drone landing pad. With the drone landed on the drone landing pad, a power source of the drone is recharged via the drone power port and drone data is transferred from the drone to the security camera via the drone data port. The drone is flown from the drone landing pad.
Another example may be found in a system. The illustrative system includes a drone and a fixed security camera. The drone includes a power source, a power port and a data port. The security camera includes a housing that houses a video camera for capturing one or more video streams, one or more power ports and one or more data ports. At least one of the one or more power ports receives power to power the video camera. At least one of the one or more data ports transmits one or more of the video streams captured by the video camera onto a network. A drone landing pad includes a drone power port. The drone power port is operatively coupled to the security camera for receiving power from the security camera and is configured to operatively connect to a power port of a drone to recharge a power source of the drone using power from the security camera when the drone lands on the drone landing pad of the security camera.
The preceding summary is provided to facilitate an understanding of some of the innovative features unique to the present disclosure and is not intended to be a full description. A full appreciation of the disclosure can be gained by taking the entire specification, claims, figures, and abstract as a whole.
The disclosure may be more completely understood in consideration of the following description of various examples in connection with the accompanying drawings, in which:
While the disclosure is amenable to various modifications and alternative forms, specifics thereof have been shown by way of example in the drawings and will be described in detail. It should be understood, however, that the intention is not to limit the disclosure to the particular examples described. On the contrary, the intention is to cover all modifications, equivalents, and alternatives falling within the spirit and scope of the disclosure.
The following description should be read with reference to the drawings, in which like elements in different drawings are numbered in like fashion. The drawings, which are not necessarily to scale, depict examples that are not intended to limit the scope of the disclosure. Although examples are illustrated for the various elements, those skilled in the art will recognize that many of the examples provided have suitable alternatives that may be utilized.
All numbers are herein assumed to be modified by the term “about”, unless the content clearly dictates otherwise. The recitation of numerical ranges by endpoints includes all numbers subsumed within that range (e.g., 1 to 5 includes 1, 1.5, 2, 2.75, 3, 3.80, 4, and 5).
As used in this specification and the appended claims, the singular forms “a”, “an”, and “the” include the plural referents unless the content clearly dictates otherwise. As used in this specification and the appended claims, the term “or” is generally employed in its sense including “and/or” unless the content clearly dictates otherwise.
It is noted that references in the specification to “an embodiment”, “some embodiments”, “other embodiments”, etc., indicate that the embodiment described may include a particular feature, structure, or characteristic, but every embodiment may not necessarily include the particular feature, structure, or characteristic. Moreover, such phrases are not necessarily referring to the same embodiment. Further, when a particular feature, structure, or characteristic is described in connection with an embodiment, it is contemplated that the feature, structure, or characteristic is described in connection with an embodiment, it is contemplated that the feature, structure, or characteristic may be applied to other embodiments whether or not explicitly described unless clearly stated to the contrary.
As shown, the fixed security cameras 12 each include a landing pad 14, individually labeled as 14a, 14b, 14c and 14d. As shown, each fixed security camera 12 has a landing pad 14. In some instances, the video surveillance system 10 may include a large number of fixed security cameras 12, some of the fixed security cameras 12 including a landing pad 14 and some of the fixed security cameras 12 not including a landing pad 14. While not shown, each of the fixed security cameras 12 may be operably coupled with a monitoring station that receives video clips and/or video streams from each of the security cameras 12.
The illustrative video surveillance system 10 may include one or more drones 16, although only a single drone 16 is shown. In some instances, the drone 16 may be configured to augment the surveillance capabilities of the video surveillance system 10 by including a video camera. The drone 16 may be instructed to fly to a particular location in order to capture a video clip of a suspected or possible event, for example. In some instances, the drone 16 may be commanded to fly to a particular location to capture video of an area that is outside the field of view of any of the fixed security cameras 12. In some instances, the drone 16 may be commanded to fly to a particular location to provide additional video surveillance capability even if there are one or more fixed security cameras 12 in the vicinity of the particular location.
In some instances, the drone 16 may not have sufficient power reserves to complete its commanded flight, which may include the drone 16 flying to a desired location, remaining at the desired location for a period of time to observe and capture a video stream showing an event, and then returning to its original location. The original location may be a charging or docking station, for example. In some instances, the original location may not be a fixed spot, but may instead be a default flight pattern that the drone 16 defaults to when not otherwise commanded. It will be appreciated that because the drone 16 is battery-powered, the drone 16 may periodically need additional power. In some instances, the landing pads 14 of the fixed security cameras 12 may provide additional physical landing zones for the drone 16. In some instances, as will be discussed, the drone 16 may be able to recharge its on-board battery using electrical power provided by the landing pads 14. In some instances, as will be discussed, the drone 16 may be able to download data such as but not limited to a video stream or video clip to the corresponding security camera 12. In some instances, the security camera 12 may store the video stream or video clip. In some instances, the security camera 12 may transmit the video stream or video clip to a recording device and/or operator console via its own in-build networking capabilities.
The housing 18 also houses a controller 30 that is configured to control operation of the security camera 12. In some instances, the controller 30 may control operation of the power port(s) 22 in providing power to the landing pad 14. In some instances, the controller 30 may control operation of the data port(s) 26 in receiving video streams and possibly other data from the drone 16 (via the landing pad 14) as well as uploading the video streams and possibly other data from the drone 16 to the network 28. A memory 32 is operably coupled to the controller 30. In some instances, the memory 32 may be configured for storing video streams from the video camera 20. The memory 32 may be configured for storing video streams and possibly other data from the drone 16. In some cases, the video streams stored in the memory 32 may be uploaded to the network 28 immediately, periodically, upon request, or at any other suitable time. In some cases, the controller 30 of the security camera 12 may execute an ONVIF/RTSP client that connects to an ONVIF/RTSP server running on the drone 16 via the drone landing pad 14. The ONVIF/RTSP client of the security camera 12 may start getting the streams from the ONVIF/RTSP server of the drone 16 via the drone data port 36 after the drone lands on the drone landing pad 14. The security camera 12 can then add the received drone video stream as an additional stream in the memory 32 of the security camera 12, and may send the drone video stream (along with video streams from the video camera 20 of the security camera 12) to an RTSP client hosted on a Network Video Recorder (NVR) on the network 28.
In the example shown, the landing pad 14 is supported by the housing 18 of the security camera 12. The landing pad 14 includes a drone power port 34 that is operatively coupled to the security camera 12 for receiving power from the security camera 12. The drone power port 34 is configured to operatively connect to a power port of the drone 16 to recharge a power source of the drone 16 using power from the security camera 12 when the drone 16 lands on the drone landing pad 14 of the security camera 12. In some cases, the landing pad 14 includes a drone data port 36 that is operatively coupled to the security camera 12. The drone data port 36 is configured to operatively connect to a data port of the drone 16 when the drone 16 lands on the drone landing pad 14 and is configured to transfer drone data from the drone 16 to the security camera 12. In some instances, the drone data may include one or more video streams captured by a camera of the drone, and in some cases other drone data such as done information (e.g. drone ID, drone battery capacity, drone range, drone CPU capability, drone memory capacity, drone commanded flight path, drone camera resolution, drone camera frame rate, drone temperature(s), drone remaining battery charge, drone processor utilization history, drone memory utilization history, drone fault logs, etc.).
In some instances, the drone data from the drone 16 and the one or more video streams captured by the video camera 20 may be transmitted to the network 28 through a common data port of the security camera 12. The common data port, which may be one of the one or more data ports 26, may include a common Power Over Ethernet (POE) port of the security camera 12. In some instances, the power used to power the security camera 12 and the power delivered to the drone 16 via the drone power port 34 of the drone landing pad 14 are provided by a common power port that is the common Power Over Ethernet (POE) port of the security camera 12. In other words, the common POE port may function as both data port and power port for both the security camera 12 and the landed drone 16.
In some instances, the drone data from the drone 16 and the one or more video streams captured by the video camera 20 may be transmitted to the network 28 through different data ports 26 of the security camera 12. In some instances, the different data ports may include different Power Over Ethernet (POE) ports of the security camera 12. In some cases, a network switch (not shown) may be provided in the security camera 12 that switches between the different data ports of the different Power Over Ethernet (POE) ports of the security camera 12. In some instances, the power used to power the security camera 12 and the power delivered to the drone 16 via the drone power port 34 of the drone landing pad 14 are provided by different power ports of the security camera, wherein the different power ports each include the different Power Over Ethernet (POE) ports of the security camera, but this is not required.
In some instances, the drone data received by the security camera 12 via the drone data port 36 may be stored in the memory 32 of the security camera 12, and may subsequently be transmitted to the network 28 via one or more data ports 26 of the security camera 12 upon request from the network 28. In some instances, the drone data may be streamed directly from the drone 16 to the network 28 through the drone data port 36 and one or more data ports 26 of the security camera 12.
In some instances, the drone landing pad 14 may include one or more alignment features 38 that help guide the drone 16 when the drone 16 is landing on the drone landing pad 14 of the security camera 12. In some instances, the one or more alignment features 38 may include one or more visual alignment features that a camera of the drone 16 may use to align the drone 16 with the drone landing pad 14. For example, the visual alignment features may include a square or other shape disposed on an upper surface of the landing pad 14. In some instances, the one or more alignment features 38 may include one or more magnets that may be detected by magnetic sensors in the drone 16. In some cases, the one or more magnets in the security camera 12 may be electromagnetics that can be selectively energized and de-energized by the security camera 12. In some cases, the electromagnets may be de-energized once the drone 16 has successfully landed on the drone landing pad 14 to reduce electromagnetic noise. In some cases, the electromagnets may remain energized after the drone 16 has successfully landed on the drone landing pad 14 to attract corresponding magnetic material on the drone 16 to help hold the drone 16 in position on the drone landing pad 14. In some cases, the one or more alignment features 38 may include one or more LED lights that a camera of the drone 16 may identify and use to align the drone 16 with the drone landing pad 14. In some cases, the one or more alignment features 38 may include one or more beacon signals (e.g. BLE beacon signals) that the drone 16 can identify and use to guide the drone to the drone landing pad 14. In some cases, the drone 16 may use a combination of one or more alignment features 38 to guide the drone to the security camera 12 and align the drone 16 with the drone landing pad 14.
When the alignment features 38 include visual alignment features, the alignment element 46 may be a camera that is configured to detect the visual alignment features. When the alignment features 38 include magnets, the alignment element 46 may include magnetic sensors and/or a material that is reactive to the magnets. This may include a ferrous material such as iron or steel, or may include one or more additional magnets. In some instances, the magnet(s) forming the alignment features 38 and/or the magnet(s) forming the alignment element 46 may include natural magnets. In some instances, the magnet(s) forming the alignment features 38 and/or the magnet(s) forming the alignment element 46 may include electromagnets that are only actuated when it is desired to guide the drone 16 into position on the landing pad 14.
The illustrative drone 16 includes a controller 48 that is configured to control operation of the drone 16. This may include planning and coordinating flight activities of the drone 16. This may include determining whether the drone 16 has sufficient power reserves to complete its commanded mission or whether recharging may be necessary. The controller 48 may oversee recharging when the drone 16 is disposed on the landing pad 14. The controller 48 may oversee data transfer when the drone 16 is disposed on the landing pad 14.
In some instances, the landing pad 50 may be a flat surface that bears several conductive elements that may be contacted by corresponding conductive elements disposed on an underside, or perhaps on a landing foot, of the drone 16. As shown, the landing pad 50 includes a Tx plate 52 that is configured to permit transmission through the Tx plate 52. The landing pad 50 includes an Rx plate 54 that is configured to permit receiving data through the Rx plate 54. Together, the Tx plate 52 and the Rx plate 54 function as the drone data port 36, allowing data to be transmitted between the landing pad 50 to the drone data port 42. The landing pad 50 includes a positively charged conductive plate 56 and a negatively charged conductive plate 58 that together function as the drone power port 34, allowing power to be transmitted from the landing pad 50 to the drone power port 40. In some instances, each of the Tx plate 52, the Rx plate 54, the positively charged conductive plate 56 and the negatively charged conductive plate 58 may be operably coupled with a POE port, sometimes through controller 48.
The illustrative landing pad 50 includes several magnets 60 that function as the alignment features 38. While a total of four magnets 60 are shown, this is merely illustrative. The landing pad 50 may include only two magnets 60, only three magnets 60, or may include five or more magnets 60. In some instances, the pattern in which the magnets 60 are laid out may vary, depending on the overall shape of the landing pad 50. As an example, a square landing pad 50 may have four magnets 60, with each magnet 60 disposed within one of the four corners of the square landing pad 50. A triangular landing pad 50 may have a total of three magnets 60, with each magnet 60 disposed in an apex of the triangular landing pad 50. In some cases, the pattern of the magnets (and/or other alignment feature) may uniquely identify the orientation of the Tx plate 52, the Rx plate 54, the positively charged conductive plate 56 and the negatively charged conductive plate 58 of the landing pad 50 so that the drone can properly orient its drone ports to match when landing. In some cases, the magnets may attract corresponding magnetic material on the drone to help hold the drone in position when the drone is landed on the landing pad 50.
In some instances, the method 62 may include transferring at least some of the drone data from the security camera to a network via a network port of the security camera, as indicated at block 74. In some instances, the method 62 may include estimating a remaining flight duration for a current commanded flight of the drone, as indicated at block 76. The power source of the drone may be recharged via the drone power port to a level that is expected to accommodate the estimated remaining flight duration plus a safety margin, as indicated at block 78. In some instances, when the drone includes a camera, the method 62 may include identifying a relative position of one or more visual alignment features of the drone landing pad to the drone via the camera of the drone, as indicated at block 80. The drone may be guided toward the drone landing pad based at least in part on the relative position of the one or more identified visual alignment features to the drone, as indicated at block 82.
In some instances, the locations of security cameras with a drone landing pad within a facility are provided to the drone, as indicated at block 96. The drone navigates closer to a desired security camera, as indicated at block 98. An algorithm within the drone is activated that informs the drone as to the specific markings for a particular camera that the drone is looking for, as indicated at block 100. The drone performs an iterative distance optimization procedure to locate and land the drone on the landing pad of the desired security camera, as indicated at block 102.
Having thus described several illustrative embodiments of the present disclosure, those of skill in the art will readily appreciate that yet other embodiments may be made and used within the scope of the claims hereto attached. It will be understood, however, that this disclosure is, in many respects, only illustrative. Changes may be made in details, particularly in matters of shape, size, arrangement of parts, and exclusion and order of steps, without exceeding the scope of the disclosure. The disclosure's scope is, of course, defined in the language in which the appended claims are expressed.
| Number | Date | Country | Kind |
|---|---|---|---|
| 202311089528 | Dec 2023 | IN | national |
