The technical field generally relates to home delivery security. More particularly, the technical field relates to systems and methods for recording a delivery of goods to a customer's home.
As the number of online purchases continues to grow in popularity, there has been a corresponding increase in delivery services. The home delivery of goods involves a delivery driver or other agent of the retail establishment to enter the recipient's property and to place the goods on a doorstep, garage, lock box, or other location in proximity to the house for depositing a package.
In one aspect, a delivery monitoring system comprises a portable camera positioned on a delivery person; a camera activation application executed by a mobile electronic device to control a video-generating operation of the portable camera; and a special-purpose processor that outputs a data instruction to an electronic locking device to unlock an entrance to a location for delivering an item by the delivery person only when the portable camera is recording video.
In another aspect, a method for security during a delivery operation comprises activating a portable camera to generate video during the delivery operation; establishing a network connection between the camera and a storage device for uploading the video; and unlocking an entrance to a location for delivering an item during the delivery operation in response to a determination that a video stream is initiated between the portable camera and the storage device.
The above and further aspects of examples of the present inventive concepts may be better understood by referring to the following description in conjunction with the accompanying drawings, in which like numerals indicate like structural elements and features in various figures. The drawings are not necessarily to scale, emphasis instead being placed upon illustrating the principles of features and implementations.
As delivery services increase in popularity, users desire for goods purchased via online e-commerce transactions to be delivered to a location that is safe from theft, undesirable environmental conditions, or risks of burglary or other crimes when a personal delivery is made to the home, business, or other selected location. Many users would permit a delivery person to enter their homes to deliver packages, even in the absence of a personal recipient of the delivery, but only if acceptable security protocols were implemented to reduce or eliminate such risks.
In brief overview, embodiments of the present inventive concepts include a body camera that streams video over a network while simultaneously storing a copy of the video on the body camera's disk, for example, as a stored or archived electronic copy of the video. The archived video may be of a higher quality than the live stream. The body camera always records video locally, regardless of whether an exception or communication-related interruption occurs during video streaming of the network. The archived video is later uploaded to a cloud hosted file storage. A software application executed at a customer's mobile electronic device such as a smartphone can play the archived video once it has been uploaded successfully. This will permit customers remote from their homes to monitor in real-time or near real-time and/or review stored video of a delivery of an item to the customers' homes for purposes of security or other reasons.
As shown in
In some embodiments, the wearable camera 22 is a body mounted camera, for example, constructed and arranged for mounting to a person's body, more specifically, to a wearer's head, shoulder, chest, clothing, or any other region of the body that permits the camera 22 to capture frames, video streams, audio, and so on of a field of view in front and/or sides of the delivery person during a delivery of a package 18 or the like to an intended recipient's designated location. The camera 22 is oriented to capture live video during the delivery. In some embodiments, the camera 22 is a vest mounted camera.
The wearable camera 22 includes well-known components for capturing images via a field of view, at least some of which are illustrated in
In some embodiments, the mobile electronic device 30 may be a smartphone, laptop computer, electronic notebook, or other personal computing device. Accordingly, the mobile electronic device 30 has a display and a user interface.
One such functionality module includes a camera activation application 24 that communicates with the wearable camera 22 via a communication link 202 such as Bluetooth™ or related network communication exchange.
Another functionality module may include a location module 25, which receives and processes global positioning satellite (GPS) verification data or the like related to a location of the mobile electronic device 30, for example, by communicating with a GPS network, WiFi network device, geofence, or other location technology.
Another functionality module may include a credential module 26 that requests WiFi credentials and/or other authorization-related data from the location-based WiFi network 42, for example, to establish a communication path for a camera video feed taken during a delivery operation. In some embodiments, the WiFi credential module 26 includes a WiFi detection module that generates a signal when WiFi detection is present, which is used by the system to determine whether to activate the camera 22 to begin capturing a video feed, and/or to determine whether to stop a video feed when a WiFi signal is not detected, or no longer detected during a delivery operation.
Another functionality module may include a WiFi credential module 26 includes a video monitoring module 27 that determines when the camera 22 is activated and generating video and communicates electronically with the electronic home device controller 44 and/or electronic locking device 40 to unlock the electronic locking device 40 only when it is established that the camera 22 is recording and the delivery person is a predetermined distance from the door or entrance to the building where the delivery is to be made. In some embodiments, the video monitoring module 27 determines whether the integrity of a network connection is sufficient for transmitting a video stream to the video server 50. For example, the video monitoring module 27 may receive data indicating that the quality of the WiFi network connection 204A, 206A shown in
Another functionality module may be executed by a special purpose computer hardware processor that verifies if a smart lock 40 is successfully locked or unlocked after a command is generated and received for locking or unlocking the door. This functionality module may be executed and stored at a computer server or the like that is in communication with the mobile electronic device 30 and/or other computer elements of the system. Related features of such functionality modules may include the computer server verifying that the lock was successfully unlocked or if any issues arise with unlocking an electronic locking device 40.
The data storage 36 may include one or more databases or the like that store relevant data for performing home delivery security functions, in accordance with some embodiments. Such data can be accessed by the wearable camera 22, the processor 32, the program memory 34, and/or by a remote computer over a network such as the Internet. Although a data storage 36 is shown as part of a computer, a data storage device 36 may in some embodiments be remote from the computer, for example, located in a cloud or other remote location, and in communication with the processor 32 and memory 34 via direct connection or a network.
After the wearable camera 22 is activated by the mobile electronic device 30, the camera 22 can be used to capture video of a delivery operation, for example, when the delivery person approaches a home of a recipient of a package 18, enters the home, delivers the package 18 in the home, and exits the home. In some embodiments, the delivery person in possession of both the camera 22 and mobile electronic device 30 is a predetermined distance from the home, at which point the home's WiFi network may detect the mobile electronic device 30 for triggering the start of a live capture by the camera 22. In some embodiments, the camera 22 is activated when it is a predetermined distance from the door of the structure where the item(s) are to be delivered. The captured video can be uploaded to a video server 50 or the like by a WiFi network 42 (shown by paths 204A and 206A) or a long term evolution (LTE) hotspot or other cellular network 43 (shown by paths 204B and 206B). In some embodiments, the video may also be stored locally at the camera 22, for example, a compressed version of the video stream, a 1080p quality version stored on a local flash memory device on the mobile electronic device 30, and/or other storage devices. In embodiments where the delivery person returns to a delivery vehicle and is within range of an LTE hotspot or the like in or proximal the delivery vehicle, the camera 22 is constructed and arranged to upload a compressed quality version of the video to the video server 50, and replaces a streamed version of the video.
In some embodiments, a single data stream is exchanged between the wearable camera 22 and the video server 50 to provide video data for both a live video stream and a backup video. The data stream is output to the video server 50 during an item delivery operation, for example, by the delivery person 12. Here, captured video can be simultaneously stored locally at the camera 22, for example, a compressed version of the video stream, a 1080p quality version stored on a local flash memory device on the mobile electronic device 30, and/or other storage device. Here, the video server 50 can provide to the customer requesting a copy of video of some or all of a particular delivery a highest possible quality segment selected from a plurality of segments. After all high-quality segments have been uploaded, for example, for a given delivery operation, the backup video can be processed for availability to the customer.
The WiFi network 42 may include other electronic devices, such as smart devices, Internet of Things (IoT) sensors, for establishing data communications therebetween. One such smart device may include an electronic locking device 40 and am electronic home device controller 44, also referred to as a smart hub, which controls the smart devices such as the electronic locking device 40, both of which can be exchange data via the WiFi network 42 and/or other data communications network or direct connection. During a delivery, the delivery person's mobile electronic device 30 can be used to unlock the electronic locking device 40 (via data paths 208, 210). As described herein, the electronic locking device 40 only unlocks the door or other entry barrier when the system determines that the camera 22 is activated to generate video. In other embodiments, a requirement for unlocking the door is to determine that the video server 50 has received a source of the generated video.
At block 302, the camera activation application 24 is executed by the mobile electronic device 30. In particular, a delivery person 12 approaches a home, commercial building, or other location designated to receive a package including an item 18 or related order for delivery. The delivery person 12 includes in possession a wearable camera 22, a mobile electronic device 30, and the ordered item 18 as the delivery person 12 approaches the location of interest. In some embodiments, the location of interest is a home or business or other building having a door configured with a lock. In some embodiments, the delivery location may be a lockbox or other container configured with a security lock or the like that is controlled electronically by the smart hub 44 or other programmable apparatus.
At or near the front door of the home or other location of interest, the delivery person 12 may initiate an operation performed by the camera activation application 24. For example, the camera activation application 24 may display at a user interface of the mobile electronic device 30 a display button, icon, or other selectable element that permits a user to initiate a delivery operation from a touchscreen or other computer peripheral device. For example, a “begin delivery” button may be displayed for selection, but is only displayed if the location module 25 confirms a GPS verification and that the delivery is being attempted within a predetermined time period. The time period can be established by estimating the time expected for the delivery person to arrive at the delivery location, for example, based on historical data, navigation tools, or other time generating application. In this example, the predetermined time can be compared to the actual arrival time, and if the actual arrival time is determined to be greater than the predetermined time, the button is not displayed. Similarly, the button is not displayed if the GPS verification is not confirmed.
At block 304, the WiFi credential processor 26 of the mobile electronic device 30 may request customer WiFi credentials such as network name, password, encryption data, and so on from a WiFi network device, such as a WiFi server that is part of the local WiFi network 42. In some embodiments, the delivery location does not have a WiFi network. Here, the method 300 proceeds directly to block 306.
At block 306, in some embodiments, the camera activation application 24 connects with the camera 22 via a Bluetooth™ connection or the like. In doing so, the WiFi credentials (if available) are output from the mobile electronic device 30 to the camera 22. Other embodiments may include any known network connection, such as WiFi, mobile hotspot, or the like executed by the mobile electronic device, e.g., a smartphone or the like. The requisite credentials can be transferred from the mobile electronic device 30, or other computer used as part of the method using Bluetooth Low Energy (BLE), Long Term Evolution (LTE), or other network device and associated protocols supported by the mobile electronic device 30 and/or wearable camera 22.
At decision diamond 308, a determination is made whether the camera 22 can connect to the WiFi network 42. If yes, then the method 300 proceeds to block 310, where captured video is streamed through the WiFi network 42 to a video server 50 or other storage device. However, if at decision diamond 308 a determination is made that a WiFi network is not available or that the camera 22 cannot connect with the WiFi network 42, then the method 300 proceeds to block 312, where another network such as an LTE network is used to stream the captured video.
At block 314, after the video server 50 confirms that the video stream has been initiated, the smart door lock or related electronic locking device 40 is automatically unlocked. Here, the mobile electronic device 30 may output a command to unlock the door. The command is received by the smart hub 44, which in response controls the electronic locking device 40. In some embodiments, security data such as passwords, credentials, and so on are programmed at the mobile electronic device 30 prior to delivery. In some embodiments, the locking device 40 is locked or unlocked by a command signal output from the mobile electronic device 30, which is processed by a server, which in some embodiments is the video server 50, and which in turn processes the command, for example, by approving a door unlock, and outputs the authorized command to the smart hub 44, which communicates with the locking device 40 via a z-wave protocol or the like to unlock the locking device 40. Such security data may be available for processing by the delivery person's mobile electronic device 30 with prior authorization by the home owner or other authorized user, which allows the mobile electronic device 30 to be used to unlock the door in order to deliver the package 18.
At block 316, the package 18 is delivered after the delivery person is granted access to the predetermined delivery location, e.g., the recipient's home or lockbox.
Referring again to
At block 402, the delivery person exits the home or other location where a package is delivered.
At block 404, the door is locked after the delivery person exits the home. In some embodiments, the smart door lock or related electronic locking device 40 is automatically locked in response to the mobile electronic device 30 outputting a command to the smart hub 44 or directly to the electronic locking device 40 to lock the door, for example, after the delivery is complete and the delivery associate has exited the home. Various sensors, location detection devices, or the like can communicate with the camera and/or other electronic mobile device of the delivery person, such as a GPS device, to determine the location of the delivery person relative to the home or other delivery location. In doing so, the delivery monitoring system 10 can automatically stop the operation of the camera and/or cease the collection, streaming, and/or other output of video captured during the delivery.
Prior to the foregoing, the delivery person may execute a delivery application displayed on the mobile electronic device, for example, shown in
At block 406, the delivery person can select a button, icon, or the like displayed on the mobile electronic device application, which indicates that the delivery operation has ended, and for the camera 22 to cease generating live video feeds. If the door is determined not to be secured, for example, by sensors or the like, then the application will not allow the delivery associate to select the delivery termination button. For example, the application may not display such a button, icon, or the like if the door is not locked.
At block 408, the communication link 202 between the camera 22 and the mobile electronic device 30 is disconnected.
At block 410, the WiFi credentials collected at block 304 are deleted.
In some embodiments, all videos generated before, during, and after the delivery operation are uploaded to the video server 50. The generated videos may be high quality, for example, 1080p, or of a lower quality. As described herein, the videos may be stored locally, then stored, or the videos may be streamed to a separate storage location. In other cases, the video may be generated at a high quality, but stored and/or transferred to a storage location at a lower quality due to a conversion processor in the camera 22 or coupled to the camera 22 in situations where the network is not feasible or otherwise capable of transmitting high quality video.
At block 504, a notification signal is generated, for example, by the camera activation application 24 to the camera 22 via the communication link 202, or by a special-purpose processor in the camera 22, that, in response a detection of no WiFi signal, adds a notification to the video feed and instructs the camera 22 to continue record.
At block 506, the captured video is stored locally instead of being output to the video server 50. In some embodiments, the captured video is stored as a different location than via WiFi to the video server 50, for example, streamed in a low-quality format to the delivery person's vehicle, which may include a storage device for temporarily storing the video in the absence of a WiFi signal. Here, a low-resolution video stream is generated, for example, changed from a high-resolution to low-resolution. For example, the delivery vehicle may have a dedicated LTE hotspot to which the camera 22 can automatically connect in order to establish an internet connection over which the low-resolution video can be uploaded to the video server 50. At block 508, the video may be archived.
In some embodiments, the locally stored video is automatically output to the video server 50 along with the notification when a WiFi signal is detected and WiFi communications resume. In embodiments where the delivery person returns to a delivery vehicle and is within range of an LTE hotspot or the like in or proximal the delivery vehicle, the camera 22 is constructed and arranged to uploaded a compressed quality version of the video to the video server 50, and replaces a streamed version of the video.
A number of implementations have been described. Nevertheless, it will be understood that the foregoing description is intended to illustrate, and not to limit, the scope of the inventive concepts which are defined by the scope of the claims. Other examples are within the scope of the following claims.
This application is a continuation of U.S. patent application Ser. No. 16/450,044, filed Jun. 24, 2019, entitled “BODY MOUNTED CAMERA SYSTEM FOR MONITORING DELIVERIES”, which claims priority to U.S. provisional patent application Ser. No. 62/692,294, filed Jun. 29, 2018 and entitled “Body Mounted Camera System for Monitoring Deliveries”, which are incorporated herein in their entirety by reference.
Number | Name | Date | Kind |
---|---|---|---|
6323782 | Stephens | Nov 2001 | B1 |
9230250 | Parker | Jan 2016 | B1 |
9282297 | Siann et al. | Mar 2016 | B2 |
9573684 | Kimchi | Feb 2017 | B2 |
9734644 | Samad | Aug 2017 | B2 |
10198711 | Jones | Feb 2019 | B2 |
10217306 | Lampert | Feb 2019 | B2 |
10291538 | Lin | May 2019 | B2 |
10321182 | Herz | Jun 2019 | B2 |
10366586 | Leizerovich et al. | Jul 2019 | B1 |
10389983 | Fu | Aug 2019 | B1 |
10489742 | Cheruku et al. | Nov 2019 | B2 |
11087602 | Lark | Aug 2021 | B2 |
20050007451 | Chiang | Jan 2005 | A1 |
20050104730 | Yang | May 2005 | A1 |
20120262581 | Carter | Oct 2012 | A1 |
20140025524 | Sims et al. | Jan 2014 | A1 |
20140258168 | Crawford | Sep 2014 | A1 |
20150120015 | Fadell et al. | Apr 2015 | A1 |
20150310381 | Lyman et al. | Oct 2015 | A1 |
20160026853 | Wexler et al. | Jan 2016 | A1 |
20160098670 | Oz et al. | Apr 2016 | A1 |
20160173833 | Siann et al. | Jun 2016 | A1 |
20160307380 | Ho et al. | Oct 2016 | A1 |
20180073274 | Johnson et al. | Mar 2018 | A1 |
20180108191 | Ho et al. | Apr 2018 | A9 |
20180121875 | Satyanarayana Rao et al. | May 2018 | A1 |
Entry |
---|
Technological Disruption and Innovation in Last-Mile Delivery; 2016. (Year: 2016). |
Real-time multi-target tracking by a cooperative distributed vision system; Takashi; 2002. (Year: 2002). |
International Search Report & Written Opinion in PCT/US2019/038687 dated Sep. 5, 2019, 7 pages. |
NPL Google Search; 2020 (Year: 2020). |
International Preliminary Report on Patentability in International Application No. PCT/US2019/038687, dated Jan. 7, 2021, 6 pages. |
Remote Retail Monitoring and Stock Assessment using Mobile Robots; 2014 (Year:2014). |
Number | Date | Country | |
---|---|---|---|
20210407268 A1 | Dec 2021 | US |
Number | Date | Country | |
---|---|---|---|
62692294 | Jun 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | 16450044 | Jun 2019 | US |
Child | 17397330 | US |