This application claims priority under 35 U.S.C. §119(a) to a Korean Patent Application filed on July 29, 2014 in the Korean Intellectual Property Office and assigned Serial No. 10-2014-0096196, the entire content of which is incorporated herein by reference.
1. Field of the Disclosure
The present disclosure relates generally to a method and device for mapping a sensor location and an event operation using a monitoring device and, more particularly, to a method and device for inputting a monitoring location and a monitoring operation at an occurrence of an event using an image captured by a monitoring device.
2. Description of the Related Art
When a sensor senses a preset input, a monitoring device receives the input from the sensor and performs a predetermined operation. For example, the monitoring device monitors a location relating to the sensor. Sensing the preset input by the sensor is expressed as an occurrence of an event. In this case, a user directly inputs coordinates including numbers, etc. in order to preset the location to be monitored.
The present disclosure provides a method and device that can set up an operation according to an occurrence of an event without a device having a separate user interface. Further, the present disclosure provides a method and device that can set up an event using an image acquired by a monitoring device in cases where one sensor supports the occurrence of several events. In addition, the present disclosure provides a method and device that can set up an initial location of a monitoring operation and a monitoring device using an image acquired by the monitoring device.
In accordance with an aspect of the present disclosure, a method of a monitoring device connectable with a sensor device monitoring surroundings thereof is provided. The method includes searching for a sensor device; acquiring images for the surroundings of the monitoring device; registering location information corresponding to the sensor device, discovered through searching, using the images; and registering monitoring information including an operation performed in response to an event occurring in the discovered sensor device.
In accordance with another aspect of the present disclosure, a monitoring device connectable with a sensor device is provided. The monitoring device includes a camera configured to acquire an image; a communication unit configured to transmit/receive a signal in a wired or wireless manner; a storage unit configured to register information; and a controller configured to search for a sensor device, acquire images for the surroundings of the monitoring device, register location information corresponding to the sensor device, discovered through searching, using the images, and register monitoring information including an operation performed in response to an event occurring in the discovered sensor device.
In accordance with an aspect of the present disclosure, a chipset for a monitoring device connectable with a sensor device monitoring surroundings thereof is provided. The chipset is configured to search for a sensor device; acquire images for the surroundings of the monitoring device; register location information corresponding to the sensor device, discovered through searching, using the images; and register monitoring information including an operation performed in response to an event occurring in the discovered sensor device.
The above and other aspects, features, and advantages of the present disclosure will be more apparent from the following detailed description, taken in conjunction with the accompanying drawings, in which:
The term “comprise” used in the present disclosure and the appended claims does not mean excluding other elements or operations. Singular nouns used in the present disclosure and the appended claims include plural nouns unless the context clearly indicates otherwise. For instance, the term “sensor device” may indicate one sensor, or may include two or more sensors. Also, the term “image” may indicate one or more images, or may include one or more videos. The suffix “unit” used to indicate an element in present disclosure and the appended claims is introduced or used interchangeably only for the purpose of description of the present disclosure and thus does not provide a unique meaning or a function distinguished from each other.
The term “event” used in the present disclosure and the appended claims indicates sensing, by a sensor device, an input in a preset range. According to an embodiment of the present disclosure, it may be defined as an occurrence of an event that a sensor device including a temperature sensor measures a temperature of 45 degrees Celsius or more.
The term “location information” used in the present disclosure and the appended claims may include a relative location, coordinates, or an area with respect to a monitoring device. The coordinates may be displayed in the form of a pan, a tilt, and a zoom of a camera of the monitoring device. The area may correspond to a partial section of a panoramic image. The location may include the coordinate or area.
The term “monitoring information” used in the present disclosure and the appended claims may include a condition under which a sensor device generates an event, and an operation that a monitoring device performs when the event occurs.
Hereinafter, various embodiments of the present disclosure will be described with reference to the accompanying drawings. In the following description, only parts required to understand operations according to embodiments of the present disclosure will be described and a description of other parts will be omitted so as not to obscure the subject matter of the present disclosure. In this case, the features of the present disclosure are not limited to the above described examples, but may cover modifications in form and additional functions of each element, which are described below. In the accompanying drawings, the size of a few elements may be enlarged for illustration purposes, and may not be illustrated in proportion to the size.
Referring to
The sensor devices 120, 130, 140, 150, and 160 may include, for example, a terrestrial magnetism sensor, a temperature sensor, an atmospheric pressure sensor, a proximity sensor, an illumination sensor, a global positioning system (GPS), an acceleration sensor, a motion sensor, an angular-velocity sensor, a speed sensor, a gravity sensor, a tilt sensor, a gyro sensor, or the like, but are not limited to the enumerated examples. The sensor devices 120, 130, 140, 150, and 160 may transfer identifiers including their device information to an external device through wireless communication or a light-source information display (e.g., an LED).
The monitoring device 110 may include separate user equipment 170 having an input unit and a display unit. The user equipment 170 may include a display constituted with one or more touch screens and may correspond to an electronic device configured to display content (e.g., images). For example, the user equipment 170 may correspond to a personal computer (PC), a portable multimedia player (PMP), a personal digital assistant (PDA), a smart phone, a cellular phone, or a digital picture frame. Also, the user equipment 170 may correspond to a dedicated device for the monitoring device 110. The user equipment 170 may transmit/receive data to/from the monitoring device 110 through a wired or wireless connection therebetween. Although the monitoring device 110 is illustrated as including the separate user equipment 170 in
Referring to
In step 220, the monitoring device acquires images of the surroundings thereof using a camera. In cases where the monitoring device has one camera, the camera may take photographs while rotating therearound 360 degrees. In cases where the monitoring device has three cameras sharing the same rotation center, each of the cameras may take photographs while rotating therearound 120 degrees. In cases where the monitoring device has a plurality of cameras with different rotation centers, each of the cameras may take photographs while rotating therearound 360 degrees. Photographing may correspond to at least one of capturing a still image and filming a video.
In step 230, using the acquired images, the monitoring device registers location information corresponding to the sensor device discovered through the search. The registered location information may include information on where the monitoring device performs monitoring when an event occurs by the discovered sensor device.
Referring to
In
In
Referring to
In step 420, the monitoring device senses an input for selecting at least one of the displayed areas. For example, the monitoring device may sense an input for selecting an area 405 or an input for selecting areas 405 and 406 in
In
Referring to
Various embodiments of an operation of registering location information have been described above with reference to
Although the monitoring information is registered after the location information in the above description, the location information may also be registered after the monitoring information, or the monitoring information and the location information may also be simultaneously registered, without being limited thereto. After registering the location information and the monitoring information, the monitoring device determines, in
When the occurrence of the event is sensed, the monitoring device performs monitoring using the registered location information in step 260. The monitoring device may periodically acquire an image for each location (e.g., area or coordinate) while performing the monitoring, and may increase a corresponding monitoring time for a location (e.g., area or coordinate) where the change of an image is sensed.
The monitoring device may perform a calculation by accumulating the monitoring time for each location (e.g., area or coordinate). While not performing the monitoring, the monitoring device may set the direction of the camera of the monitoring device such that the camera is oriented toward the location (e.g., area or coordinate) having the longest monitoring time accumulated.
Referring to
The camera 610 may acquire images of the surroundings of the monitoring device. The images may correspond to one or more still images or videos.
The communication unit 620 may transmit/receive a signal in a wired or wireless manner. The communication unit 620 may search for a sensor device by receiving a signal or light.
The storage unit 630 may register an application program corresponding to a function performed by the monitoring device and information generated while the function is performed in the monitoring device.
The input unit 640 senses a user input and transfers the same to the controller 660. The display unit 650 may display the entirety or a portion of an image. The display unit 650 may display a scroll bar together when displaying only a portion of an image. The input unit 640 may be formed as a touch screen in combination with the display unit 650, or may be formed as a typical keypad. In addition, the input unit 640 may be configured as a function key, a soft key, or the like which is selected in order to perform a function. The monitoring device may have the input unit 640 and display unit 650 in the form of separate user equipment, and the input unit 640 and the display unit 650 may transmit/receive a signal to/from the other units of the monitoring device in a wired or wireless manner.
The controller 660 controls overall states and operations of the components constituting the monitoring device. The controller 660 may perform event management, device control, image comparison, streaming, capturing, and the like in order to register information and perform monitoring.
Although it has been described in
For example, the controller 660 may search for a sensor device, acquire images for the surroundings of the monitoring device, register location information corresponding to the sensor device discovered through the search using the images, register monitoring information including an operation performed in response to an event occurring in the discovered sensor device, and perform monitoring using the registered location information when sensing the occurrence of the event caused by the discovered sensor device. The location information corresponding to the discovered sensor device may include information on where the monitoring device monitors according to the occurrence of the event caused by the discovered sensor device.
In addition, the controller 660 may display the acquired images, sense an input for selecting at least one point included in the displayed images, and register the coordinates of the selected point as the location information corresponding to the sensor device. Furthermore, the controller 660 may display the acquired images in two or more subdivided areas, sense an input for selecting at least one of the displayed areas, and register an area identifier corresponding to the selected area as the location information corresponding to the sensor device. Also, the controller 660 may determine the location or coordinates corresponding to the sensor device on the basis of a preset form included in the acquired images and register the location or coordinates as the location information corresponding to the sensor device. In this case, the controller 660 may determine an operation performed in response to an event occurring in the sensor device based on at least one of a motion, a color, and a pattern included in a preset form and register the determined operation.
Referring to
In step 730, the controller 710 transfers images acquired through a camera and device information of a sensor device acquired through a communication unit to the touch screen 720. The images may correspond to a panoramic image obtained by photographing the surroundings of the monitoring device while rotating the camera 360 degrees.
In step 740, the touch screen 720 may display the transferred images and device information in such a manner that a user can access.
In step 750, the user may input location information corresponding to the sensor device and monitoring information based on the displayed images and device information. The monitoring information may include an operation performed in response to an event occurring in the sensor device.
In step 760, the touch screen 720 may forward the input location information and the monitoring information to the controller 710.
Referring to
In step 820, the monitoring device searches for a sensor device. In the search process, the monitoring device may acquire device information (including a sensor identifier) of the sensor device on the basis of the signal or light transmitted by the sensor device.
In step 830, the monitoring device acquires images (e.g., images or a video) by photographing the surroundings thereof. In cases where the monitoring device has one camera, the camera may take photographs while rotating 360 degrees. The images or video acquired by photographing may be shared with another monitoring device. In addition, the monitoring device may have a plurality of cameras, in which case the cameras may photograph the surroundings in cooperation with each other. For example, in cases where there are two cameras rotating about the same point, each camera may take photographs in a range of 180 degrees.
Referring to
Referring to
In
In step 850, the monitoring device determines whether the registration of new information corresponding to the matched form has been requested. When it is determined that the registration of the information has been requested, the monitoring device proceeds to step 860. In contrast, unlike in
In step 860, the monitoring device determines device information, location information, or monitoring information of the sensor device. The device information may correspond to a universally unique identifier (UUID) or an internet protocol (IP) address of the sensor device responsive to the search. The location information may include information on a pan, a tilt, or a zoom of the camera. The location information may be determined in view of an angle of a user's face. The monitoring information may be determined in view of the user's motion.
Table 1 below represents a correspondence relation between an operation included in monitoring information and location information.
Table 1 above shows matching relations between a form (e.g. a persons' motion), a sensor identifier, an operation included in monitoring information, and a direction (e.g., pan, tilt, and zoom) of a camera. In Table 1 above, “capture” indicates acquiring a still image while performing monitoring, and “streaming” indicates displaying, on a display unit of the monitoring device, a video acquired while performing monitoring. According to an embodiment of the present disclosure, the storage unit of the monitoring device may store the form, the operation, and the direction of the camera by matching them, and when the form included in the acquired images matches that stored in the storage unit, the storage unit may determine location information or monitoring information corresponding to a sensor based on the operation and the direction of the camera which match the form.
Referring to
In step 1015, the monitoring device may register device information of a sensor device responding to the search. The device information may correspond to a UUID or an IP address of the sensor device responding to the search.
In step 1020, the monitoring device may determine whether the sensor device responding to the search supports multiple events. When it is determined that the sensor device responding to the search supports multiple events, the monitoring device may proceed to step 1025 to display a list of the events supported by the sensor device responding to the search.
Referring to
In step 1030, the monitoring device may sense an input for selecting an event from the displayed list. For example, a long press 1110 in
Referring to
In
In step 1045, the monitoring device determines whether to additionally specify event information or location information. When receiving an input of additional specification, the monitoring device may proceed to step 1030 and may specify a plurality of pieces of event information or location information according to the repetition of the additional specification. In this case, the monitoring device may repetitively specify only one of the event information and the location information, in which a plurality of events and a single location or a single event and a plurality of locations may match each other.
Referring to
In step 1310, the monitoring device may compare the image captured at each location with an image captured in the previous cycle to determine whether there is a difference therebetween. When it is determined that there is a difference therebetween, the monitoring device may increase a monitoring time for the corresponding location in step 1315. In contrast, when it is determined that there is no difference therebetween, the monitoring device may decrease a monitoring time for the corresponding location in step 1320.
In step 1325, the monitoring device performs monitoring based on the increased or decreased time. Alternatively, unlike in steps 1315 and 1320, the monitoring device may also maintain the monitoring time. Furthermore, the monitoring device may also include the number of locations where an image is changed in the standard for changing the monitoring time. For example, in the case of monitoring two locations, if all images for the two locations are changed, the monitoring device may maintain the monitoring time for both locations as it is, or may increase the monitoring time. In addition, a user may also increase only the monitoring time for a preset location. The monitoring time may have a maximum threshold and a minimum threshold, and may be configured to be varied between the maximum threshold and the minimum threshold.
Referring to
When the monitoring device changes the monitoring time in step 1315 or step 1320 in
An event operating time may be set separately from the monitoring time. That is, the monitoring time may be set to occur until the event operating time lapses after an event occurs. For example, in cases where a monitoring time for two locations is set to 10 seconds and an event operating time is set to 100 seconds, if there is no change in monitoring time, monitoring is performed on the two places for 50 seconds and then terminated.
Table 2 below is a chart relating to determining the initial direction of a camera in view of a monitoring frequency.
Referring to Table 2 above, sensors S1 and S2 correspond to location L1. The monitoring device, while not performing monitoring, may set the camera to be oriented toward L1 with the highest monitoring frequency for each location of 40.0%. Accordingly, the camera initially faces the direction in which monitoring is most likely to be performed when an event occurs, which leads to a reduction in initial time for performing monitoring in response to an event. Although the initial direction of the camera is determined based on the monitoring frequency, the initial direction of the camera may be alternatively determined based on the accumulated monitoring time. For example, the monitoring device may set the camera to be oriented toward a location with the longest accumulated monitoring time.
Although certain embodiments have been described and illustrated in the present disclosure and the accompanying drawings, these are provided merely to describe and to facilitate a thorough understanding of the present invention, and are not intended to limit the scope of the present disclosure. Therefore, it should be construed that all modifications of the present disclosure are included within the scope of the present disclosure as defined by the appended claims, and their equivalents.
Number | Date | Country | Kind |
---|---|---|---|
10-2014-0096196 | Jul 2014 | KR | national |