Patent Grant
10354678
This application is based upon and claims priority to Chinese Patent Application No. 201510462792.9, filed Jul. 31, 2015, the entire contents of which are incorporated herein by reference.
The present disclosure generally relates to the field of computer technologies, and more particularly, to a method and device for collecting sounds associated with surveillance images.
Cameras can be used to monitor the occurrences of various events, and the monitoring function of cameras is widely applied to, for example, traffic surveillance, supermarket surveillance, or community surveillance, and the like.
During surveillance using cameras in a monitoring device, if a sound-making surveilled object in the surveillance images (i.e., an image of the sound-making surveilled object is visible in the surveillance images) is relatively far from the monitoring device, the monitoring device cannot clearly collect the sound from the surveilled object, and thus the surveillance information is not complete.
Aspects of the disclosure provide a method for collecting sounds associated with surveillance images. The method includes identifying a sound-making surveilled object in the surveillance images, the surveillance images being captured by a camera of a monitoring device; determining whether a sound acquiring device meets a preset condition corresponding to that a signal strength of the sounds collected by the sound acquiring device from the identified surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the identified surveilled object; and, when determining that the sound acquiring device meets the preset condition, controlling the sound acquiring device to collect the sounds from the identified surveilled object.
In an embodiment, the method further includes, when determining that the sound acquiring device does not meet the preset condition, collecting the sounds from the identified surveilled object by the monitoring device.
In an embodiment, identifying the sound-making surveilled object in the surveillance images includes detecting a movement of the surveilled object that corresponds to a predetermined sound-making movement, the predetermined sound-making movement including the surveilled object entering a surveillance area or the surveilled object having moving lips; or determining whether the surveilled object is a predetermined sound-making object, the predetermined sound-making object including a door, a window, or a home appliance; or detecting, by a detection device associated with the surveilled object, one or more parameters, and identifying the sound-making surveilled object based on the one or more parameters from the detection device, the one or more parameters including an on/off state, a temperature, a change of a heat source, or a physiological feature of the surveilled object.
In an embodiment, determining whether the sound acquiring device meets the preset condition includes determining whether the signal strength of the sounds from the identified surveilled object collected by the monitoring device is smaller than a preset sound threshold; and, when determining that the signal strength of the sounds from the identified surveilled object collected by the monitoring device is smaller than the preset sound threshold, determining that the sound acquiring device meets the preset condition.
In an embodiment, determining whether the sound acquiring device meets the preset condition includes: identifying a sound acquiring device closest to the sound-making surveilled object among all sound acquiring devices associated with the monitoring device, and determining the identified sound acquiring device as the sound acquiring device meeting the preset condition; or controlling all sound acquiring devices associated with the monitoring device to collect the sounds from the sound-making surveilled object, and determining a sound acquiring device that detects a strongest signal strength of the sounds from the sound-making surveilled object as the sound acquiring device meeting the preset condition; or determining at least one mobile device associated with the monitoring device as the sound acquiring device meeting the preset condition.
In an embodiment, identifying the sound acquiring device closest to the sound-making surveilled object among all the sound acquiring devices associated with the monitoring device includes: identifying the sound acquiring device closest to the sound-making surveilled object among all the sound acquiring devices associated with the monitoring device by performing an indoor positioning process; or determining a location of the sound-making surveilled object by performing an image recognition process, and determining a sound acquiring device for monitoring the sounds from the sound-making surveilled object according to respective surveillance area ranges corresponding to the sound acquiring devices.
Aspects of the disclosure provide a device for collecting sounds associated with surveillance images. The device includes a processor and a memory for storing instructions executable by the processor. The processor is configured to identify a sound-making surveilled object in the surveillance images, the surveillance images being captured by a camera of a monitoring device, to determine whether a sound acquiring device meets a preset condition corresponding to that a signal strength of the sounds collected by the sound acquiring device from the surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the surveilled object, and to, when determining that the sound acquiring device meets the preset condition, control the sound acquiring device to collect the sounds from the identified surveilled object.
In an embodiment, the processor is configured to, when determining that the sound acquiring device does not meet the preset condition, collect the sounds from the identified surveilled object by the monitoring device.
Aspects of the disclosure provide a non-transitory computer-readable storage medium having stored therein instructions that, when executed by a processor of a monitoring device, causes the monitoring device to perform a method for collecting sounds associated with surveillance images. The method includes: identifying a sound-making surveilled object in the surveillance images, the surveillance images being captured by a camera of a monitoring device; determining whether a sound acquiring device meets a preset condition corresponding to that a signal strength of the sounds collected by the sound acquiring device from the surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the surveilled object; and, when determining that the sound acquiring device meets the preset condition, controlling the sound acquiring device to collect the sounds from the identified surveilled object.
In an embodiment, the instructions that, when executed by the processor of the monitoring device, causes the monitoring device to perform a method further including, when determining that the sound acquiring device does not meet the preset condition, collecting the sounds from the identified surveilled object by the monitoring device.
The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.
Reference will now be made in detail to exemplary embodiments, examples of which are illustrated in the accompanying drawings. The following description refers to the accompanying drawings in which the same numbers in different drawings represent the same or similar elements unless otherwise represented. The implementations set forth in the following description of exemplary embodiments do not represent all implementations consistent with the present disclosure. Instead, they are merely examples of devices and methods consistent with aspects related to the present disclosure as recited in the appended claims.
In step 101, when surveillance images are captured by a camera of a monitoring device, whether there is a sound-making surveilled object in the surveillance images is detected.
Generally, a monitoring device can collect not only surveillance images but also sounds made by a surveilled object in the surveillance images.
In step 102, if there is a sound-making surveilled object in the surveillance images identified in step 101, whether a sound acquiring device meets a preset condition is determined. The preset condition corresponds to that a signal strength of sound from the identified surveilled object detected by the sound acquiring device is greater than a signal strength of the sound from the identified surveilled object detected by the monitoring device.
At present, even though a monitoring device can clearly collect surveillance images, the monitoring device may not effectively collect the sounds from a surveilled object in the surveillance images. For example, if the surveilled object in the surveillance images makes very weak sounds or the surveilled object in the surveillance images is relatively far from the monitoring device, the sounds from the surveilled object cannot be clearly collected by the monitoring device, and may even be automatically filtered by the monitoring device. Thus, in some examples, an additional sound acquiring device meeting a preset condition is required to collect the sounds from the surveilled object.
The preset condition here may be various conditions that correspond to that a signal strength of the sounds collected by the sound acquiring device from the surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the surveilled object. When the preset condition is met, the sound acquiring device meeting the preset condition is turned on to collect the sounds from the surveilled object.
The sound acquiring device here may be devices having sound collecting members such as a mobile phone, an audio apparatus, or a Bluetooth headset.
In step 103, when determining that the sound acquiring device meets the preset condition, the sound acquiring device is controlled to collect the sounds from the surveilled object. Thus, the audio signal is recorded based on the sound from the identified surveilled object collected by the sound acquiring device.
When the monitoring device detects that the surveilled object in the surveillance images makes sounds but the sounds from the surveilled object are too weak or the surveilled object is too far from the monitoring device, the monitoring device cannot clearly collect the sounds from the surveilled object. At this time, the monitoring device may control the sound acquiring device meeting the preset condition to collect the sounds from the surveilled object.
In view of the above, in the method for collecting sounds associated with surveillance images provided by embodiments of the present disclosure, a sound-making surveilled object in the surveillance images is identified, and a sound acquiring device which collects sounds of a greater signal strength from the surveilled object than the signal strength of the sounds collected by the monitoring device from the surveilled object is controlled to collect the sounds from the surveilled object. Thus, the present disclosure can solve the problem that a monitoring device cannot clearly collect sounds from a surveilled object which is relatively far from the monitoring device. The monitoring device controls the sound acquiring device to collect the sounds from the surveilled object, and thus the surveillance information becomes more complete.
In step 102a, whether the signal strength of the sounds associated with the surveillance images collected by the monitoring device is less than a preset sound threshold is determined.
When the sounds from the surveilled object in the surveillance images are too weak or the surveilled object in the surveillance images is too far from the monitoring device, the sounds made by the surveilled object cannot be clearly collected by the monitoring device. Thus, the preset sound threshold here refers to a threshold determining whether the monitoring device can clearly collect the sounds from the identified sound-making surveilled object. When the signal strength of the sounds from the identified sound-making surveilled object collected by the monitoring device is less than the preset sound threshold, the monitoring device is considered as incapable of effectively collecting the sounds associated with the surveillance images temporarily.
In step 102b, if the signal strength of the sounds associated with the surveillance images collected by the monitoring device is less than the preset sound threshold, a sound acquiring device other than the monitoring device is determined as meeting the preset condition.
When the signal strength of the sounds from the identified sound-making surveilled object collected by the monitoring device is less than the preset sound threshold, the monitoring device is considered as incapable of effectively collecting the sounds associated with the surveillance images temporarily. Thus, the sound acquiring device meeting the preset condition will be used to collect the sounds associated with the surveillance images instead of the monitoring device.
In view of the above, in the method for collecting sounds associated with surveillance images provided by embodiments of the present disclosure, a sound-making surveilled object in the surveillance images is identified, and a sound acquiring device which collects sounds of a greater signal strength from the surveilled object than the signal strength of the sounds collected by the monitoring device from the surveilled object is controlled to collect the sounds from the surveilled object. Thus, the present disclosure can solve the problem that a monitoring device cannot clearly collect sounds from a surveilled object which is relatively far from the monitoring device. The monitoring device controls the sound acquiring device to collect the sounds from the surveilled object, and thus the surveillance information becomes more complete.
In addition, when the monitoring device cannot clearly collect the sounds made by the surveilled object, the monitoring device may send a collection instruction to a sound acquiring device meeting a preset condition to instruct the sound acquiring device to collect the sounds from the surveilled object. The preset condition requires that the sound acquiring device is closest to the surveilled object, or that the sound acquiring device collects the strongest sound signal, or that the sound acquiring device is a mobile device associated with the monitoring device.
In a first implementation 101a, whether there is an image change element corresponding to making sounds in the surveillance images is detected. For example, a movement of the surveilled object that corresponds to a predetermined sound-making movement is detected. The predetermined sound-making movement includes the surveilled object entering a surveillance area or the surveilled object having moving lips.
In a second implementation 101b, whether an object in the surveillance images is a predetermined sound-making object is determined. The predetermined sound-making object includes at least one of a door, a window, or a home appliance.
Sometimes, when a door, a window, or a home appliance in surveillance images makes sounds (for example when a person is knocking at a door, a TV is turned on, or a fan runs), no significant changes will occur in the surveillance images. Thus, in some examples, a predetermined sound-making object is an object of a designated type which does not move and the camera needs to determine whether to acquire sounds of the object according to the recognized type of the object.
In a third implementation 101c, according to a designated index or one or more parameters reported by a detection device, a sound-making surveilled object in the surveillance images is identified. The detection device is a device associated with the monitoring device for detecting the designated index or the one or more parameters, and the designated index or the one or more parameters include an on/off state, a temperature, a change of a heat source, or a physiological feature of the surveilled object.
When the sounds made by the surveilled object in the surveillance images are too weak, the monitoring device may determine which surveilled object in the surveillance images is a sound-making surveilled object via a detection device. The detection device here refers to a device for detecting states of the surveilled objects and is installed around the surveilled objects or on the surveilled objects.
For example, the detection device is installed on a switch of a home appliance. When the home appliance is turned on, the detection device sends the turning-on state data back to the monitoring device. After receiving the data, the monitoring device determines that the home appliance is a sound-making surveilled object, and sends a collection instruction to a sound acquiring device meeting a preset condition to instruct the sound acquiring device meeting the preset condition to collect the sounds from the home appliance. In another example, the detection device may be installed nearby a window or a door. When the door or the window is open, and the detection device senses the temperature changes of the ambient air, the detection device feeds the temperature change data back to the monitoring device. After receiving the data, the monitoring device determines that the window or the door is a sound-making surveilled object, and sends a collection instruction to a sound acquiring device meeting a preset condition to instruct the sound acquiring device meeting the preset condition to collect the sounds from the door or the window.
In a first implementation 102b1, a sound acquiring device closest to the sound-making surveilled object is identified among all sound acquiring devices associated with the monitoring device, and the identified sound acquiring device is determined as the sound acquiring device meeting the preset condition.
When the preset condition corresponds to that the sound acquiring device is closest to the surveilled object, the monitoring device may identify a sound acquiring device closest to the sound-making surveilled object according to the surveillance images, and determine the sound acquiring device as the sound acquiring device meeting the preset condition.
In a second implementation 102b2, all sound acquiring devices associated with the monitoring device are controlled to collect the sounds from the sound-making surveilled object, and a sound acquiring device which collects a strongest sound signal is determined as the sound acquiring device meeting the preset condition.
When the preset condition corresponds to that the sound acquiring device collects the strongest sound signal, the monitoring device may send a collection instruction to all sound acquiring devices to instruct all of the sound acquiring devices to collect the sounds from the surveilled object in the surveillance images. After receiving the collection instruction, all the sound acquiring devices start to collect the sounds from the surveilled object and send signals representing the collected sounds to the monitoring device. The monitoring device receives and checks all the sounds collected by the sound acquiring devices, determines a sound acquiring device which collects the strongest sound signal, and determines the sound acquiring device as the sound acquiring device meeting the preset condition.
In a third implementation 102b3 (
The monitoring device may be associated with mobile devices which move inside a house, such as a mobile terminal, a home cleaning robot, or a remotely controlled plane. When the surveilled object is too far from the monitoring device, one or more of these mobile devices are determined as the sound acquiring devices meeting the preset condition.
A possible implementation is shown in
In a first implementation 102b1a, by performing an indoor positioning process, the sound acquiring device closest to the sound-making surveilled object is identified among all sound acquiring devices associated with the monitoring device.
Monitoring device may be installed in a plurality of rooms, and the monitoring devices may be connected via wireless or wired networks to form an indoor positioning system. Thus, persons, animals, or home appliances and the like in the interior of the rooms may be surveilled. When a sound-making surveilled object appears in surveillance images of a monitoring device, a sound acquiring device closest to the surveilled object can be identified from all the sound acquiring devices associated with the monitoring device, and the monitoring device can send a collection instruction to the sound acquiring device to instruct the sound acquiring device to collect the sounds from the surveilled object.
In a second implementation 102b1b, by performing an image recognition process, a location of the sound-making surveilled object is determined, and a sound acquiring device for monitoring the sounds from the sound-making surveilled object is determined according to respective surveillance area ranges corresponding to the sound acquiring devices.
Each sound acquiring device has individual surveillance area range. The surveillance range data of all sound acquiring devices may be recorded in the monitoring device. According to the surveillance images, the monitoring device can determine a surveillance area range of a sound acquiring device in which the sound-making surveilled object is, and thus the monitoring device can determine the sound acquiring device for monitoring the surveilled object.
Still referring to
In a first implementation 103a, when the sound acquiring device meeting the preset condition is a sound acquiring device closest to the sound-making surveilled object, the sound acquiring device is controlled to collect sounds.
When the monitoring device cannot collect the sounds associated with the sound-making surveilled object in the surveillance images temporarily, the monitoring device can send a collection instruction to a sound acquiring device closest to the sound-making surveilled object to instruct the sound acquiring device to collect the sounds made by the surveilled object.
In a second implementation 103b, when the sound acquiring device meeting the preset condition is a sound acquiring device which collects the strongest sound signal, the sound acquiring device is controlled to collect sounds.
When the monitoring device cannot collect the sounds associated with the sound-making surveilled object in the surveillance images temporarily, the monitoring device can send a collection instruction to a sound acquiring device which collects the strongest sound signal to instruct the sound acquiring device to collect the sounds made by the surveilled object.
In a third implementation 103c, when the sound acquiring device meeting the preset condition is a mobile device associated with the monitoring device, the mobile device is controlled to move to a location adjacent to the sound-making surveilled object in the surveillance images, and the mobile device is controlled to collect sounds at the location.
When the monitoring device determines that the sound acquiring device meeting the preset condition is a mobile device associated with the monitoring device, the monitoring device may send the mobile device a moving instruction for instructing the mobile device to move to a location nearby the sound-making surveilled object in the surveillance images, and a collection instruction for instructing the mobile device to collect the sounds from the sound-making surveilled object.
The following are embodiments of the device of the present disclosure, which may be used to perform the embodiments of the method of the present disclosure. For the undisclosed details in the embodiments of the device, refer to the embodiments of the method of the present disclosure.
The detection module 201 is configured to, when surveillance images are collected by a camera of a monitoring device, detect and identify a sound-making surveilled object in the surveillance images.
The determination module 202 is configured to, if the detection module 201 detects that there is a sound-making surveilled object in the surveillance images, determine a sound acquiring device meeting a preset condition corresponding to that a signal strength of the sound from the identified surveilled object detected by the sound acquiring device is greater than a signal strength of the sound from the identified surveilled object detected by the monitoring device.
The control module 203 is configured to control the sound acquiring device determined by the determination module 202 to collect the sounds from the surveilled object.
A possible implementation is shown in
As shown in
The first detection submodule 201a is configured to detect whether there is a movement of the surveilled object that corresponds to a predetermined sound-making movement in the surveillance images. The predetermined sound-making movement includes a surveilled object entering into the surveillance images or a surveilled object whose lips move.
The second detection submodule 201b is configured to detect whether the surveilled object in the surveillance images is a predetermined sound-making object. The predetermined sound-making object includes a door, a window, or a home appliance.
The third detection submodule 201c is configured to, according to one or more parameters reported by a detection device, detect whether there is a sound-making surveilled object in the surveillance images. The detection device is a device associated with the monitoring device for detecting the one or more parameters, and the one or more parameters include on/off states, air quality parameters, temperature, parameters indicating changes of heat sources, or physiological feature parameters of the surveilled object.
In a possible implementation, still referring to
The fourth detection submodule 202a is configured to detect whether sounds associated with the surveillance images collected by the monitoring device are smaller than a preset sound threshold.
The first determination submodule 202b is configured to, if the fourth detection submodule 202a detects that the sounds associated with the surveillance images collected by the monitoring device are smaller than the preset sound threshold, determine the sound acquiring device meeting the preset condition.
In a possible implementation, still referring to
The first identifying submodule 202b1 is configured to identify a sound acquiring device closest to the sound-making surveilled object among all sound acquiring devices associated with the monitoring device, and determine the identified sound acquiring device as the sound acquiring device meeting the preset condition.
The second identifying submodule 202b2 is configured to control all sound acquiring devices associated with the monitoring device to collect the sounds from the sound-making surveilled object, and determine a sound acquiring device which collects a strongest sound signal as the sound acquiring device meeting the preset condition.
The second determination submodule 202b3 is configured to determine at least one mobile device associated with the monitoring device as the sound acquiring device meeting the preset condition.
In a possible implementation, still referring to
The third identifying submodule 202b1a is configured to, by an indoor positioning technology, identify the sound acquiring device closest to the sound-making surveilled object among all sound acquiring devices associated with the monitoring device.
The fourth determination submodule 202b1b is configured to, by an image recognition technology, determine a location where the sound-making surveilled object is, and determine a sound acquiring device for monitoring the sounds from the surveilled object making sounds according to respective surveillance area ranges corresponding to the sound acquiring devices.
In a possible implementation, still referring to
The first control submodule 203a is configured to, when the sound acquiring device meeting the preset condition is a sound acquiring device closest to the sound-making surveilled object, control the sound acquiring device to collect sounds.
The second control submodule 203b is configured to, when the sound acquiring device meeting the preset condition is a sound acquiring device which collects the strongest sound signal, control the sound acquiring device to collect sounds.
The third control submodule 203c is configured to, when the sound acquiring device meeting the preset condition is a mobile device associated with the monitoring device, control the mobile device to move to a location adjacent to the sound-making surveilled object in the surveillance images, and control the mobile device to collect sounds at the location.
In view of the above, in the device for collecting sounds associated with surveillance images provided by embodiments of the present disclosure, a sound-making surveilled object in the surveillance images is identified, and a sound acquiring device which collects sounds of a greater signal strength from the surveilled object than the signal strength of the sounds collected by the monitoring device from the surveilled object is controlled to collect the sounds from the surveilled object. Thus, the present disclosure can solve the problem that a monitoring device cannot clearly collect sounds from a surveilled object which is relatively far from the monitoring device. The monitoring device controls the sound acquiring device to collect the sounds from the surveilled object, and thus the surveillance information becomes more complete.
In addition, when the monitoring device cannot clearly collect the sounds made by the surveilled object, the monitoring device may send a collection instruction to a sound acquiring device meeting a preset condition to instruct the sound acquiring device to collect the sounds from the surveilled object. The preset condition corresponding to that the sound acquiring device is closest to the surveilled object, or that the sound acquiring device collects the strongest sound signal, or that the sound acquiring device is a mobile device associated with the monitoring device.
With respect to the devices in the above embodiments, the specific manners for performing operations for individual modules therein have been described in detail in the embodiments regarding the methods, which will not be elaborated herein.
An exemplary embodiment of the present disclosure provides a device for collecting sounds associated with surveillance images, which is capable of realizing the method for collecting sounds associated with surveillance images provided by the present disclosure. The device for collecting sounds associated with surveillance images includes a processor and a memory for storing instructions executable by the processor. The processor is configured to, when surveillance images are collected by a camera of a monitoring device, detect whether there is a sound-making surveilled object in the surveillance images; if a sound-making surveilled object in the surveillance images is identified, determine a sound acquiring device meeting a preset condition corresponding to that a signal strength of the sounds collected by the sound acquiring device from the surveilled object is greater than a signal strength of the sounds collected by the monitoring device from the surveilled object; and control the sound acquiring device to collect the sounds from the surveilled object.
It is noted that the various modules, sub-modules, units, or components described in the present disclosure can be implemented using any suitable technology. In an example, a module, submodule, unit, or component can be implemented using circuitry such as an integrated circuit (IC). In an example, a module, submodule, unit, or component can be implemented as processing circuitry executing software instructions.
Referring to
The processing component 402 typically controls overall operations of the device 400, such as the operations associated with display, telephone calls, data communications, camera operations, and recording operations. The processing component 402 may include one or more processors 418 to execute instructions to perform all or part of the steps in the above described methods. Moreover, the processing component 402 may include one or more modules which facilitate the interaction between the processing component 402 and other components. For instance, the processing component 402 may include a multimedia module to facilitate the interaction between the multimedia component 408 and the processing component 402.
The memory 404 is configured to store various types of data to support the operation of the device 400. Examples of such data include instructions for any applications or methods operated on the device 400, contact data, phonebook data, messages, pictures, video, etc. The memory 404 may be implemented using any type of volatile or non-volatile memory devices, or a combination thereof, such as a static random access memory (SRAM), an electrically erasable programmable read-only memory (EEPROM), an erasable programmable read-only memory (EPROM), a programmable read-only memory (PROM), a read-only memory (ROM), a magnetic memory, a flash memory, a magnetic or optical disk.
The power component 406 provides power to various components of the device 400. The power component 406 may include a power management system, one or more power sources, and any other components associated with the generation, management, and distribution of power in the device 400.
The multimedia component 408 includes a screen providing an output interface between the device 400 and the user. In some embodiments, the screen may include a liquid crystal display (LCD) and a touch panel (TP). If the screen includes the touch panel, the screen may be implemented as a touch screen to receive input signals from the user. The touch panel includes one or more touch sensors to sense touches, swipes, and gestures on the touch panel. The touch sensors may not only sense a boundary of a touch or swipe action, but also sense a period of time and a pressure associated with the touch or swipe action. In some embodiments, the multimedia component 408 includes a front camera and/or a rear camera. The front camera and the rear camera may receive an external multimedia datum while the device 400 is in an operation mode, such as a photographing mode or a video mode. Each of the front camera and the rear camera may be a fixed optical lens system or have focus and optical zoom capability.
The audio component 410 is configured to output and/or input audio signals. For example, the audio component 410 includes a microphone (“MIC”) configured to receive an external audio signal when the device 400 is in an operation mode, such as a call mode, a recording mode, and a voice recognition mode. The received audio signal may be further stored in the memory 404 or transmitted via the communication component 416. In some embodiments, the audio component 410 further includes a speaker to output audio signals.
The I/O interface 412 provides an interface between the processing component 402 and peripheral interface modules, such as a keyboard, a click wheel, buttons, and the like. The buttons may include, but are not limited to, a home button, a volume button, a starting button, and a locking button.
The sensor component 414 includes one or more sensors to provide status assessments of various aspects of the device 400. For instance, the sensor component 414 may detect an open/closed status of the device 400, relative positioning of components, e.g., the display and the keypad, of the device 400, a change in position of the device 400 or a component of the device 400, a presence or absence of user contact with the device 400, an orientation or an acceleration/deceleration of the device 400, and a change in temperature of the device 400. The sensor component 414 may include a proximity sensor configured to detect the presence of nearby objects without any physical contact. The sensor component 414 may also include a light sensor, such as a CMOS or CCD image sensor, for use in imaging applications. In some embodiments, the sensor component 414 may also include an accelerometer sensor, a gyroscope sensor, a magnetic sensor, a pressure sensor, or a temperature sensor.
The communication component 416 is configured to facilitate communication, wired or wirelessly, between the device 400 and other devices. The device 400 can access a wireless network based on a communication standard, such as WiFi, 2G, or 3G, or a combination thereof. In one exemplary embodiment, the communication component 416 receives a broadcast signal or broadcast associated information from an external broadcast management system via a broadcast channel. In one exemplary embodiment, the communication component 416 further includes a near field communication (NFC) module to facilitate short-range communications. For example, the NFC module may be implemented based on a radio frequency identification (RFID) technology, an infrared data association (IrDA) technology, an ultra-wideband (UWB) technology, a Bluetooth (BT) technology, and other technologies.
In exemplary embodiments, the device 400 may be implemented with one or more application specific integrated circuits (ASICs), digital signal processors (DSPs), digital signal processing devices (DSPDs), programmable logic devices (PLDs), field programmable gate arrays (FPGAs), controllers, micro-controllers, microprocessors, or other electronic components, for performing the above described methods for collecting sounds associated with surveillance images.
In exemplary embodiments, there is also provided a non-transitory computer-readable storage medium including instructions, such as included in the memory 404, executable by the processor 418 in the device 400, for performing the above-described methods for collecting sounds associated with surveillance images. For example, the non-transitory computer-readable storage medium may be a ROM, a RAM, a CD-ROM, a magnetic tape, a floppy disc, an optical data storage device, and the like.
Other embodiments of the present disclosure will be apparent to those skilled in the art from consideration of the specification and practice of the invention disclosed here. This application is intended to cover any variations, uses, or adaptations of the present disclosure following the general principles thereof and including such departures from the present disclosure as come within known or customary practice in the art. It is intended that the specification and examples be considered as exemplary only, and a scope and spirit of the present disclosure are indicated by the following claims.
It will be appreciated that the present disclosure is not limited to the exact configurations that has been described above and illustrated in the accompanying drawings, and that various modifications and changes can be made without departing from the scope thereof. It is intended that the scope of the present disclosure only be limited by the appended claims.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2015 1 0462792 | Jul 2015 | CN | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 5625572 | Yonekura | Apr 1997 | A |
| 9613508 | Park | Apr 2017 | B2 |
| 20110087535 | Yoshizawa | Apr 2011 | A1 |
| 20110208516 | Kuboyama | Aug 2011 | A1 |
| 20120002047 | An et al. | Jan 2012 | A1 |
| 20120203078 | Sze | Aug 2012 | A1 |
| 20140135588 | Al-Ali | May 2014 | A1 |
| 20140307096 | Park | Oct 2014 | A1 |
| 20150181171 | Park | Jun 2015 | A1 |
| 20150279181 | Park | Oct 2015 | A1 |
| 20160125879 | Lovitt | May 2016 | A1 |
| 20160148493 | Arakawa | May 2016 | A1 |
| Number | Date | Country |
|---|---|---|
| 101786272 | Jul 2010 | CN |
| 102056053 | May 2011 | CN |
| 102385389 | Mar 2012 | CN |
| 103002250 | Mar 2013 | CN |
| 103595953 | Feb 2014 | CN |
| 103841360 | Jun 2014 | CN |
| 104574745 | Apr 2015 | CN |
| 105049807 | Nov 2015 | CN |
| 200501470 | Feb 2006 | EA |
| 9-81233 | Mar 1997 | JP |
| 2005-252660 | Sep 2005 | JP |
| 2009-105612 | May 2009 | JP |
| 2010-232888 | Oct 2010 | JP |
| 2010-233145 | Oct 2010 | JP |
| 2011-193392 | Sep 2011 | JP |
| 2013-16929 | Jan 2013 | JP |
| 5189536 | Apr 2013 | JP |
| 2014-137767 | Jul 2014 | JP |
| 10-2006-0109153 | Oct 2006 | KR |
| 10-2015-0060626 | Jun 2015 | KR |
| WO 2014161402 | Oct 2014 | WO |
| WO 2017020507 | Feb 2017 | WO |
| Entry |
|---|
| Russian Office Action dated Jun. 15, 2017 in Russian Patent Application No. 2016115037 (with English translation). |
| Russian Search Report dated Jun. 14, 2017 Russian Patent Application No. 2016115037 (with English translation). |
| Combined Chinese Office Action and Search Report dated Sep. 20, 2017 in Chinese Patent Application No. 201510462792.9 (with English translation of Category of Cited Documents). |
| Von Thomas Jüngling, “Diese Hightech-polizei Schützt Sie vor Einbrechern”, retrieved from the internet: https.//www.welt.de/wirtschaft/webwelt/article133042130/Diese-Hightech-Polizei-schuetzt-Sie-vor-Einbrechern.html , XP002765325, Oct. 8, 2014, pp. 1-8 (with English abstract). |
| Extended European Search Report dated Jan. 3, 2017 in European Patent Application No. 16179302.1. |
| Korean Notice of Allowance dated Jul. 14, 2017 in Korean Patent Application No. 10-2016-7004628 (with English translation). |
| Office Action dated Feb. 25, 2019, in Indian Patent Application No. 201637009190 (with English-language translation). |
| Number | Date | Country | |
|---|---|---|---|
| 20170032805 A1 | Feb 2017 | US |
