Patent Application
20210006754
The present disclosure relates to security systems, and in particular relates to security systems having dynamic camera placement.
In many areas, closed circuit video surveillance systems may be inefficient. For example, in shipping yards, trailer yards, rail yards or other similar storage facilities, the size and dynamic nature of the storage area may cause the use of closed circuit camera systems to be inefficient and unsecure. In particular, these yards have several problems for traditional security systems. The yards may be massive, covering many acres of land. To outfit this with a closed-circuit television surveillance system would take massive investment and hundreds of cameras just to capture some of the area. In many cases, typical yards only install a few cameras, but having a limited number of cameras for such a large area makes it unlikely to capture enough detail of any potential incident to make the installation of the cameras worthwhile.
Further, in yards such as rail yards, trailer yards, or shipping yards, the entrances or exits are vague. It would be very easy for criminals to enter from just about any direction. Thus, positioning the limited number of cameras at entry or exit points is not very effective, since many events may be missed. Due to the size of such storage yards, a criminal may also easily hide from single point cameras by simply approaching from other directions.
Yards may also shift over time. They may overflow into adjacent areas, fields or parking lots. They may shrink. Yards may grow up or out. They may “move” with time, for example lanes/alleys, parking locations may drift, making static mounting points for cameras and security challenging.
In other examples, the use of fixed position cameras may be expensive or logistically problematic. It may be difficult or expensive to run power and video cables to cameras. Conditions around a camera location may also change over time, resulting in a need to move such cameras. Therefore, in many cases static camera networks can be challenging.
The present disclosure will be better understood with reference to the drawings, in which:
The present disclosure provides a method at an image capture apparatus, the method comprising: receiving, at the image capture apparatus, a trigger to begin image capture; based on the trigger, starting image capture for a fixed duration; and providing image capture data to a processing service.
The present disclosure further provides an image capture apparatus comprising: a processor; a communications subsystem; and at least one sensor for capturing images, wherein the image capture apparatus is configured to: receive, at the image capture apparatus, a trigger to begin image capture; based on the trigger, start image capture for a fixed duration; and provide image capture data to a processing service.
The present disclosure further provides a computer readable medium for storing program instructions, which, when executed by a processor of an image capture apparatus, cause the image capture apparatus to: receive, at the image capture apparatus, a trigger to begin image capture; based on the trigger, start image capture for a fixed duration; and provide image capture data.
The embodiments of the present disclosure are described below using the environment of a storage yard as an example. However, the present disclosure is not limited to use within such storage yards, and the embodiments can be used in other scenarios, such as for securing a home or business, providing security temporarily in a location, or providing security in an outdoor venue or location, among other options.
As indicated above, storage yards such as rail yards, trailer yards, shipping yards, among other locations may be difficult to secure. Further, other areas associated with the transportation of goods, including truck stops, warehousing locations among others may also be difficult to secure.
For example, reference is made to
Fixed infrastructure points within the storage yard 110 may exist. For example, a building 140 or a fixed structure 150 such as a lamppost, security pole, or crane, among other options, may exist within the storage yard 110.
Under traditional security models, cameras may be affixed within the storage yard 110. For example, they may be affixed to building 140 or fixed structure 150.
Further, an entrance point 160 may also have cameras and/or security personnel located therein.
However, a thief may easily circumvent such security by breaching the fence 130 and entering the yard. Due to the size of typical yards, this may be a relatively straightforward process. A thief may easily circumvent fixed cameras such as those on building 140 or fixed structure 150, and even if some images from these cameras capture the thief, the limited number of images may not provide enough detail or resolution to identify the thief, goods being taken, or other similar information.
Therefore, in accordance with one embodiment of the present disclosure, a dynamic and distributed image capture system is provided. In particular, in one embodiment, a subset of containers 120 or 122 may have associated therewith an image capture apparatus that can be triggered to start or stop capturing images and communicate the results to a centralized server.
Such image capture apparatus may, in some embodiments, be a power limited device, such as a battery-operated device, to allow the system to be deployed without a fixed power supply. However, because the image capture device is power limited, it cannot continuously capture images without quickly draining the battery or otherwise taxing the power source.
In one embodiment, the image capture apparatus uses fleet management tracking devices on the shipping containers 120 or 122. Specifically, in many instances shipping containers or truck trailers are equipped with sensors that may have communication capabilities and provide information about such shipping container or trailer. For example, the sensors may provide temperature readings, location readings through a positioning system such as the global positioning system (GPS), vibration sensors, accelerometers, gyroscopes, among other sensor information.
In one embodiment of the present disclosure, an image sensor apparatus, such as a camera may be added to such tracking device. In a further embodiment, an image capture apparatus may be provided as a standalone solution, outside of any tracking system.
Reference is now made to
Image sensor apparatus 210 comprises a processor 220 and at least one communications subsystem 230, where the processor 220 and communications subsystem 230 cooperate to perform the methods of the embodiments described herein. Communications subsystem 230 may, in some embodiments, comprise multiple subsystems, for example for different radio technologies.
Communications subsystem 230 allows device 210 to communicate with other devices or network elements. Communications subsystem 230 may use one or more of a variety of communications types, including but not limited to cellular, satellite, Bluetooth™, Bluetooth™ Low Energy, Wi-Fi, wireless local area network (WLAN), near field communications (NFC), Zigbee, wired connections such as Ethernet or fiber, among other options.
As such, a communications subsystem 230 for wireless communications will typically have one or more receivers and transmitters, as well as associated components such as one or more antenna elements, local oscillators (LOs), and may include a processing module such as a digital signal processor (DSP). As will be apparent to those skilled in the field of communications, the particular design of the communication subsystem 230 will be dependent upon the communication network or communication technology on which the image sensor apparatus is intended to operate.
Processor 220 generally controls the overall operation of the image capture device 210 and is configured to execute programmable logic, which may be stored, along with data, using memory 240. Memory 240 can be any tangible, non-transitory computer readable storage medium, including but not limited to optical (e.g., CD, DVD, etc.), magnetic (e.g., tape), flash drive, hard drive, or other memory known in the art.
Alternatively, or in addition to memory 240, image sensor apparatus 210 may access data or programmable logic from an external storage medium, for example through communications subsystem 230.
In the embodiment of
Examples of sensors in the embodiment of
Communications between the various elements of image sensor apparatus 210 may be through an internal bus 260 in one embodiment. However, other forms of communication are possible.
Image sensor apparatus 210 may be affixed to any fixed or portable platform. For example, image sensor apparatus 210 may be affixed to shipping containers, truck trailers, truck cabs in one embodiment. In other embodiments, image sensor apparatus 210 may be affixed to any vehicle, including motor vehicles (e.g., automobiles, cars, trucks, buses, motorcycles, etc.), aircraft (e.g., airplanes, unmanned aerial vehicles, unmanned aircraft systems, drones, helicopters, etc.), spacecraft (e.g., spaceplanes, space shuttles, space capsules, space stations, satellites, etc.), watercraft (e.g., ships, boats, hovercraft, submarines, etc.), railed vehicles (e.g., trains and trams, etc.), and other types of vehicles including any combinations of any of the foregoing, whether currently existing or after arising, among others.
In other cases, image sensor apparatus 210 could be carried by a user.
In other cases, sensor apparatus 210 may be affixed to stationary objects including buildings, lamp posts, fences, cranes, among other options.
Such sensor apparatus 210 may be a power limited device. For example image sensor apparatus 210 could be a battery operated device that can be affixed to a shipping container or trailer in some embodiments. Other limited power sources could include any limited power supply, such as a small generator or dynamo, a fuel cell, solar power, among other options.
In other embodiments, sensor apparatus 210 may utilize external power, for example from the engine of a tractor pulling the trailer, from a land power source for example on a plugged in recreational vehicle or from a building power supply, among other options.
External power may further allow for recharging of batteries to allow the sensor apparatus 210 to then operate in a power limited mode again. Further, recharging methods may also include other power sources, such as, but not limited to, solar, electromagnetic, acoustic, or vibration charging.
Referring again to
Due to the nature of the storage yard 110, the cameras would likely be distributed around the yard. Further, since shipping containers may be stacked or parallel or perpendicular or at other angles to each other, the image capture mechanism may provide various angles to allow for a comprehensive security solution, as described below.
Reference is now made to
Further, a plurality of fixed image sensor apparatus may exist within the network in some embodiments. These are shown, for example, as fixed sensor apparatus 320 and fixed sensor apparatus 322.
In the embodiment of
Further, fixed sensor apparatus 320 and fixed sensor apparatus 322 may communicate with access point 330 or base station 332 in some embodiments. In other embodiments, the fixed sensor apparatus 320 and/or fixed sensor apparatus 322 may communicate through other mechanisms over Internet 334, such as a fixed connection or any other wired or wireless communications.
While the embodiment of
Further, the information from any of sensor apparatus 310, 312, 314, 320 and 322 may be provided to one or more servers 340 or 342. For example, if the sensor apparatus 310 and 312 belong to a first company, such apparatus may communicate with a first company's server 340. Sensor apparatus 314 may belong to a second company and may therefore communicate with a second company's server 342.
In other embodiments, a single company may have a plurality of servers. A server, central server, processing service, endpoint, Uniform Resource Identifier (URI), Uniform Resource Locator (URL), back-end, and/or processing system may be used interchangeably in the descriptions herein. The server functionality typically represents data processing/reporting that are not closely tied to the location of movable image capture apparatuses 310, 212, 314, etc. For example, the server may be located essentially anywhere so long as it has network access (e.g., 334 ) to communicate with image capture apparatuses 310, 212, 314, etc.
In accordance with one embodiment of the present disclosure, the various fixed or mobile apparatuses may also communicate with each other. Thus, apparatus 310 may communicate directly with apparatus 312 or apparatus 314 in some embodiments. Further, apparatus 310 may communicate with fixed apparatus 320 or 322 in some embodiments.
Further, the owners of the servers 340 and 342 may have agreements to allow communication between such servers for use in security applications.
The example architecture of
In other cases, apparatus 310 may be out of range of access point 330 and may therefore utilize another apparatus such as apparatus 312 as a relay for providing information to server 340.
As described above, in many cases, an image sensor apparatus may be a limited power device. For example, the device may operate using a battery. Because of the limited power, the image sensor apparatus does not continually capture images. Continual image capture would drain the battery far too quickly and provide information which may not be relevant most the time. Thus, in accordance with the embodiments described herein, a sensor apparatus may act based on a trigger.
In particular, reference is now made to
The process of
For example, if the sensor apparatus 210 is affixed to the rear of a trailer, then a door status sensor associated with sensor apparatus 210 may be provided to detect when a door of the trailer is opened. In such case, the door opening event may trigger the sensor apparatus to start recording information.
In other cases, vibration sensors may indicate that someone has entered or left the trailer.
In other cases, motion sensors may detect motion near the vicinity of the sensor apparatus.
In other cases, heat sensors may detect the presence of a person or anomaly within or outside of the trailer.
Other examples are possible.
Further, in some cases, the trigger at block 412 could be a signal from another transmitter. Such transmitter may, for example, be a centralized location or monitoring station which is directing the sensor apparatus to wake up.
The trigger may also be a signal from another nearby sensor apparatus indicating that there may be an issue and sensors in the vicinity should wake up.
In some embodiments, the trigger may be dependent on location. For example, the sensor apparatus 210 may not start to monitor for triggers until it enters a particular area or geofence. Thus, in accordance with one embodiment, the process of
The present disclosure is not limited to any particular trigger.
From block 412 the process proceeds to block 420 in which image capture may occur. Such image capture may be continuous in some embodiments. For example, the trigger event may indicate to the processor to start capturing continuous video for the next five minutes. The captured information may be conveyed to a central server in some embodiments to alert security and to provide information to security. In other embodiments the captured information may be stored on the image sensor apparatus for later processing.
Other examples may include capturing a periodic image for a time duration. Specifically, the processor may cause a camera to take a picture every second for the next three minutes. Duration may also indicate a single picture being taken, a series of photos being taken periodically at a predetermined time between shots, a continuous series of photos, or pictures being taken by a profile that may include irregular sampling times.
In other cases, the image capture may continue until the sensor apparatus 210 is told to stop capturing images.
Other examples would be apparent to those skilled in the art.
From block 420, the process proceeds to block 430 in which a check is made to determine whether or not any other sensor apparatus is needed to capture images. In particular, depending on the original trigger event at block 412, it may be desirable to capture images from a nearby sensor apparatus as well as the current sensor apparatus.
For example, if the trailer detects a door opening event that is unexpected, then the sensor apparatus on the trailer may ask nearby trailers to start taking pictures to capture images of the person that opened the trailer. By employing nearby trailers, the likelihood of obtaining a good quality picture of the person that opened the trailer door is enhanced by a covering various egress routes and allowing for different lighting conditions within the trailer yard.
If, as determined at block 430, other sensors need to be woken, then the process proceeds to block 440 in which a message is sent. Such message at block 440 may either be sent to a central controller which could then activate other sensors within the vicinity of the triggered sensor. For example, a sensor apparatus may periodically report to a central server to indicate its status and location. Such location could then be used to find image sensors apparatuses within a radius, or predefined distance, of the original trigger event. Moreover, the radius or distance may be defined by a geofence or other spatial definition that could project only from a particular range of direction from the sensor apparatuses (e.g, where the camera has a view such as the back of the trailer and somewhat to the sides depending on the lens configuration). Examples may include a wedge shape, circle, rectangle, square, or the distance may be irregular.
Alternatively, the message at block 440 may be sent directly to the other sensor apparatuses in the nearby vicinity.
From block 440, the process may proceed to block 450 and end.
Further, from block 430, if other sensors do not need to be informed of the event then the process proceeds to block 450 and ends.
An example of messages that may be sent between devices is provided with regard to the embodiment of
In the embodiment of
Further, apparatus 512 may need to relay the message 522 to other apparatuses within the vicinity in some embodiments. This is shown, for example, by decision block 530 which checks whether to relay the information.
If the apparatus 512 needs to relay the information, as determined at block 530, then a wake-up trigger 532 may be provided to a second image capture apparatus 514.
Again, image capture apparatus 514 receives wake-up trigger 532 and may start capturing images, shown by block 540. Apparatus 514 may similarly decide whether to relay the wake-up trigger, as shown by block 542.
The contents of wake-up trigger 520 may depend on the particular scenario or deployment situation. However, one example of information that may be contained in wake up trigger 520 is provided in Table 1 below.
As seen in Table 1 above, the wake-up trigger may include various information. Example information may include an event identifier to allow for the unique identification of a particular event and to allow a server or centralized controller to stitch various captured images from the event together. The event identifier may, for example, be part of a device identifier along with a number that may be incremented by the apparatus. For example, if a first sensor detects the event, it may store its own device identifier along with a sequence number that may be appended to the device identifier to provide an event ID. Other examples of providing unique event identifiers would be apparent to those skilled in the art.
The wake up trigger of Table 1 above may further include a device identifier for the device that originated the trigger in some embodiments.
The wake-up trigger 520 may further include the position of the apparatus that activated the trigger. For example, on portable devices, this may be determined through a position acquisition system such as a GPS system. In other embodiments, the position may be based on the access point or networks that the device can see. Other options for positioning are possible.
In some embodiments, wake up trigger 520 may include a range. This may be used, for example, to ask apparatuses within a particular range of the original apparatus that initiated the trigger to wake up. Such other apparatuses would therefore utilize their own position information and to determine whether they are within the range of the original apparatus' position in order to start capturing images or not.
In some cases, the event or alert types may be provided in wake up trigger 520. Thus, various events may cause different behavior among various apparatuses and the determination of whether to activate image capture may partially depend on the alert type provided in wake-up message 520 in some embodiments.
Further, wake up message 520 may include information such as which server to report the captured image to. For example, if a plurality of sensor owners have trailers within a shipping yard, then the images may be desired at a single server in order to allow for the security to correctly capture and mesh all of the images together.
In some embodiments, trigger 520 may include a time that the event occurred and a duration for reporting.
In some embodiments, trigger 520 may provide a timeslot that a particular device should use for communicating captured images. This may be used, for example, to avoid collisions in communications from the various image sensor apparatuses.
In other embodiments, more or less information than that shown in Table 1 could be provided between devices or between servers and devices. The example wake-up trigger in Table 1 above is therefore only provided for illustration purposes.
Once the images are captured, they may be reported to a server. For example, Table 2 provides information that may be provided to a server.
From Table 2 above, each image capture apparatus may convey image data to a server. The message with the image data may include various information.
For example, from Table 2 above, the message may include the event identifier that was either created at the image capture device or was received as a trigger at the image capture device.
The message may further include a unique device identifier in some embodiments.
The message may further include the position of the image sensor apparatus that captured the images. As the image sensor apparatus may be movable, such information allows the receiving server to pinpoint the location that the image data was captured.
The message may further include a bearing indicating the direction in which the camera or image capture device was pointing. Specifically, the bearing may be known from an internal compass type sensor on the image capture apparatus, or may be known from image processing on the captured images when compared to a database, among other options. The bearing may indicate the direction in which the camera is pointing to allow images to be stitched together.
Further if the image capture device has multiple cameras, image data from the different cameras can be separated and the bearings for each camera provided. Thus, for example, if a trailer mounted sensor has a camera pointed into the trailer and one pointed behind the trailer, image data from both may be conveyed to the server, where image data pointing into the trailer is distinguished in the message from image data from behind the trailer.
By receiving multiple messages such as those provided in Table 2, a server can stitch together the information to create a profile for an event.
Based on the above, a dynamic security network that can be activated by a central controller such as a yard manager, or may activate automatically when a problem is detected, is created.
For example, a robber enters a yard with 1000 trailers. Assume 100 these trailers have a sensor apparatus 210 installed. This means that that there are 100 different angles and points of security inside a medium-sized shipping yard. By coordinating such security, the yard is provided with a relatively low cost and highly effective security network.
For example, in one embodiment, a yard worker may detect a threat and could ask all 100 trailers to take pictures or record a short video using a command console at a central location.
In another embodiment, an event such as a vibration or a door opening for a container may trigger a single device to take pictures or videos of what is happening. The situation made then be escalated to ask that pictures be taken by other devices within the nearby vicinity.
In another embodiment, the detection of the event by one device leads to an alert which wakes up all devices within a defined radius to take photos or videos. For example, such radius may be defined in meters, yards or kilometers or miles. In other embodiments the radius may be the communications range of the trigger signal.
In another embodiment, photos may be taken from outside the container to detect the actors involved.
In other embodiments, the photos or images may be taken inside a container to detect what is occurring inside the container, what goods are being taken, what is being moved, among other options.
In a further embodiment, photos or images may be taken and then uploaded to a server and the server may then stitch together the photos or videos. For example, this may be done through a unique identifier in some embodiments. The photos or videos that are uploaded to the server may further include other information, including GPS or compass directions and therefore the meshing of the images may create a virtual crime scene from many angles.
For example, one simplified server that may perform the stitching is provided with regards to
In
Processor 620 is configured to execute programmable logic, which may be stored, along with data, on server 610, and shown in the example of
Alternatively, or in addition to memory 640, server 610 may access data or programmable logic from an external storage medium, for example through communications subsystem 630.
Communications subsystem 630 allows server 610 to communicate with other devices or network elements.
Communications between the various elements of server 610 may be through an internal bus 660 in one embodiment. However, other forms of communication are possible.
Server 610 may compile all image data related to an event or for a particular location during a time interval, and display such data, for example on an interactive map. For example, image data may include a location for the data, and may further include an orientation for the image capture. Such data may then be placed on a map. Reference is now made to
In the embodiment of
In some cases, a time bar 720 which may allow icons 710 to appear or disappear depending on whether images were being captured during the time interval indicated by the time bar.
Other options for stitching the image data together are possible. For example, in one embodiment the actual image that was captured may be displayed on the map, and images may change as the time bar is moved.
While the above describes a storage yard such as a trailer yard or rail yard, in other embodiments the above disclosure could be utilized in the world at large. In this case, the sensor apparatus may become part of a mobile surveillance device. It could therefore be utilized by others to capture areas of interest. For example, in some cases, law enforcement may activate image sensor apparatuses within a predetermined area in order to capture images. For example, this may be activated during a bank robbery in order to try to determine the direction that the bank robbers left, capture the license plate of the bank robber or capture images of the faces of the bank robbers. Other examples are possible.
The embodiments described herein solve various issues. Specifically, the embodiments provide a low-cost solution since the image sensor apparatuses may already be part of containers, on vehicles or in other fixed situations. In the shipping yard example, the yard is typically covered relatively well since such shipping containers tend to get randomly distributed.
The embodiments described may provide image capture for various angles for a crime scene, increasing chances of seeing a face or providing more details with regard to the event.
The use of many devices would provide investigators with more details. Further, the use of sensing apparatus may not be obvious to robbers or other actors since they form part of the infrastructure.
Also, in some embodiments, the security system shifts as the storage yard shifts.
The embodiments described herein are examples of structures, systems or methods having elements corresponding to elements of the techniques of this application. This written description may enable those skilled in the art to make and use embodiments having alternative elements that likewise correspond to the elements of the techniques of this application. The intended scope of the techniques of this application thus includes other structures, systems or methods that do not differ from the techniques of this application as described herein, and further includes other structures, systems or methods with insubstantial differences from the techniques of this application as described herein.
While operations are depicted in the drawings in a particular order, this should not be understood as requiring that such operations be performed in the particular order shown or in sequential order, or that all illustrated operations be performed, to achieve desirable results. In certain circumstances, multitasking and parallel processing may be employed. Moreover, the separation of various system components in the implementation descried above should not be understood as requiring such separation in all implementations, and it should be understood that the described program components and systems can generally be integrated together in a signal software product or packaged into multiple software products.
Also, techniques, systems, subsystems, and methods described and illustrated in the various implementations as discrete or separate may be combined or integrated with other systems, modules, techniques, or methods. Other items shown or discussed as coupled or directly coupled or communicating with each other may be indirectly coupled or communicating through some interface, device, or intermediate component, whether electrically, mechanically, or otherwise. Other examples of changes, substitutions, and alterations are ascertainable by one skilled in the art and may be made.
While the above detailed description has shown, described, and pointed out the fundamental novel features of the disclosure as applied to various implementations, it will be understood that various omissions, substitutions, and changes in the form and details of the system illustrated may be made by those skilled in the art. In addition, the order of method steps are not implied by the order they appear in the claims.
When messages are sent to/from an electronic device, such operations may not be immediate or from the server directly. They may be synchronously or asynchronously delivered, from a server or other computing system infrastructure supporting the devices/methods/systems described herein. The foregoing steps may include, in whole or in part, synchronous/asynchronous communications to/from the device/infrastructure. Moreover, communication from the electronic device may be to one or more endpoints on a network. These endpoints may be serviced by a server, a distributed computing system, a stream processor, etc. Content Delivery Networks (CDNs) may also provide may provide communication to an electronic device. For example, rather than a typical server response, the server may also provision or indicate a data for content delivery network (CDN) to await download by the electronic device at a later time, such as a subsequent activity of electronic device. Thus, data may be sent directly from the server, or other infrastructure, such as a distributed infrastructure, or a CDN, as part of or separate from the system.
Typically, storage mediums can include any or some combination of the following: a semiconductor memory device such as a dynamic or static random access memory (a DRAM or SRAM), an erasable and programmable read-only memory (EPROM), an electrically erasable and programmable read-only memory (EEPROM) and flash memory; a magnetic disk such as a fixed, floppy and removable disk; another magnetic medium including tape; an optical medium such as a compact disk (CD) or a digital video disk (DVD); or another type of storage device. Note that the instructions discussed above can be provided on one computer-readable or machine-readable storage medium, or alternatively, can be provided on multiple computer-readable or machine-readable storage media distributed in a large system having possibly plural nodes. Such computer-readable or machine-readable storage medium or media is (are) considered to be part of an article (or article of manufacture). An article or article of manufacture can refer to any manufactured single component or multiple components. The storage medium or media can be located either in the machine running the machine-readable instructions, or located at a remote site from which machine-readable instructions can be downloaded over a network for execution.
In the foregoing description, numerous details are set forth to provide an understanding of the subject disclosed herein. However, implementations may be practiced without some of these details. Other implementations may include modifications and variations from the details discussed above. It is intended that the appended claims cover such modifications and variations.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 15468898 | Mar 2017 | US |
| Child | 17026790 | US |
