The present invention relates to an information processing apparatus that measures the amount of activity of a person who exists in a predetermined region, an information processing method, and a program.
In order to make a space in a facility comfortable, in Patent Document 1, it is studied to control air conditioning in consideration of the movement of a person in the facility. To be specific, in Patent Document 1, the movement of a person is measured by the use of a sensor such as a laser device, and air conditioning is controlled based on the movement of the person. At this time, in Patent Document 1, by providing each person with identification information and tracking the person, the movement of the person is measured, and the amount of activity of the person is also measured based on the moving speed.
The amount of activity calculated based on the movement of a person stated above is useful information because it may be used not only for air conditioning control but also for various purposes. For example, it is possible to control lighting equipment in accordance with the amount of activity of a person, and it is also possible to use the amount of activity of a person for anomaly detection, security, and marketing.
However, with the technique of Patent Document 1 stated above, it is required to track a person in order to calculate the amount of activity and, if such tracking processing is difficult, it is impossible to calculate the amount of activity. For example, in a case where a large number of people exist and form a crowd or in a case where the accuracy of a sensor for detecting a person is low, it is difficult to detect and track individual persons.
Accordingly, an object of the present invention is to provide an information processing apparatus which can solve the abovementioned problem that it is difficult to obtain the amount of activity of a person.
An information processing apparatus according to an aspect of the present invention includes: a detecting unit configured to detect a proportion of an existing person for each predetermined region; and a calculating unit configured to, on a basis of the proportion of the person in each predetermined region, calculate a value based on an amount of activity of the person.
Further, an information processing method according to another aspect of the present invention includes: detecting a proportion of an existing person for each predetermined region; and on a basis of the proportion of the person in each predetermined region, calculating a value based on an amount of activity of the person.
Further, a computer program according to another aspect of the present invention includes instructions for causing an information processing apparatus to realize: a detecting unit configured to detect a proportion of an existing person for each predetermined region; and a calculating unit configured to, on a basis of the proportion of the person in each predetermined region, calculate a value based on an amount of activity of the person.
With the configurations as described above, the present invention makes it possible to obtain the amount of activity of a person with ease.
A first example embodiment of the present invention will be described with reference to
The information processing system according to the present invention is a system used for calculating the amount of activity of a person P who exists in a target space R set indoors or outdoors and moreover using the amount of activity. As an example, the information processing system is used for calculating the amount of activity of a person who exists in a target room and controlling air conditioning in the room based on the amount of activity. Meanwhile, the calculated amount of activity may be used for any purpose; for example, used for controlling lighting in a target space, and may be used for anomaly detection, security, and marketing activity in a target space.
As shown in
The measurement device 10 includes, as shown in
First, in the conversion information storing unit 15, conversion information representing the relation between the moving speed and the amount of activity of the person P is stored as shown in
First, the person detecting unit 11 (a detecting unit) accepts captured images of the space R captured by the camera C at constant time intervals. For example, the person detecting unit 11 accepts and temporarily stores a captured image of the space R in which a plurality of persons P exist as shown in
Next, the person detecting unit 11 divides the target space R into a plurality of regions r on the first captured image R1, and detects the proportion of the person P existing in each region r. To be specific, first, as shown in
Next, the person detecting unit 11 detects, for each region r set as described above, the proportion of the person P existing in the region r. In this example embodiment, the person detecting unit 11 detects the proportion of the person P existing in the region r in accordance with the proportion of the upper body of the person P shown in the region r. Therefore, the person detecting unit 11 first detects the upper body (for example, head, chest, arms) of the person P existing in the first captured image R1. As an example, the upper body of the person P is distinguished based on the shape and color of an object shown in a captured image, but may be detected by any method. Then, the person detecting unit 11 examines in what proportion the detected upper body of one person P is shown in the region r, and detects the proportion as the proportion of the person P existing in the region r. In the example of
The person detecting unit 11 detects the proportion of the person P in each region r in the same manner as described above, regarding the second captured image accepted from the camera C after a lapse of a predetermined time. At this time, positions to set the respective regions r in the second captured image R2 are identical to those in the first captured image R1. For example, upon accepting the second captured image R2 later as shown in
Then, the person detecting unit 11 passes the proportion of the person P in each region r on the first captured image R1 and the proportion of the person P in each region on the second captured image R2 that are detected in the abovementioned manner to the amount-of-activity calculating unit 12.
The amount-of-activity calculating unit 12 (a calculating unit) calculates the amount of activity in the target space R in the following manner by using the proportion of the person P in each region r of the temporally consecutive first captured image R1 and second captured image R2, that is, the captured image R1 before the person P moves and the captured image R2 after the person P moves.
First, the amount-of-activity calculating unit 12 sets particles p (objects) in the space R based on the proportion of the person P in each region r on the first captured image R1. At this time, the amount-of-activity calculating unit 12 sets the particles p in association with the position of each region r on the first captured image R1. For example, as shown in
Next, the amount-of-activity calculating unit 12 predicts the amount of movement of the particles p in each region r set on the first captured image R1. In this example embodiment, as shown by “prediction” in
Next, the amount-of-activity calculating unit 12 detects the amount of movement of the particle p by the use of the predicted amount of movement of the particle p based on the proportion of the person P in the first captured image R1 and the proportion of the person P in each region r in the second captured image R2 captured after a lapse of a predetermined time described above. In the second captured image R2, in a case where the person P has moved as shown by a large arrow in
As an example, in the example shown in
Next, the amount-of-activity calculating unit 12 resets the particle p based on the weight of the particle p. Herein, in accordance with the value of the weight of the particle p, the particle p is eliminated or the particle p is increased. For example, as shown by “filter/resampling” in
Then, the amount-of-activity calculating unit 12 detects the predicted amount of movement of each reset particle p as the amount of movement of the particle p at the time of capturing the second captured image R2, and calculates the amount of activity from the amount of movement. At this time, the amount-of-activity calculating unit 12 calculates the amount of activity per particle p by the use of the conversion information shown in
Further, the amount-of-activity calculating unit 12 can also total the particles p for each amount of activity and calculate a histogram of the amount of activity as shown in
In the initial state, the amount-of-activity calculating unit 12 described above does not necessarily need to set the particles p in the space R based on the proportion of the person P in each region r on the first captured image R1. In this case, the amount-of-activity calculating unit 12 may assume that an optional number of particles p are randomly arranged in advance on the space R, that is, on a captured image, and predict the amounts of movement of the particles p. After that, the amount-of-activity calculating unit 12 detects the amounts of movement of the particles p by the use of the predicted amounts of movement of the particles p arranged in advance and the proportion of the person P in each region r in the second captured image R2.
Further, the amount-of-activity calculating unit 12 then repeats prediction and detection of the amount of movement of the particle p and calculation of the amount of activity as described above. That is to say, the amount-of-activity calculating unit 12 predicts the later amount of movement of the particle p set in accordance with the proportion of the person P in each region r in the second captured image R2, detects the amount of movement of the particle p in accordance with the proportion of the person P in each region r in a subsequently captured image captured after that, and calculates the amount of activity from the amount of movement.
The outputting unit 13 (an outputting unit, a controlling unit) performs output depending on the result of calculation by the amount-of-activity calculating unit 12 described above. For example, the outputting unit 13 outputs a histogram calculated as shown in
Further, the outputting unit 13 may automatically control equipment for air conditioning or lighting installed in the space R based on the result of calculation by the amount-of-activity calculating unit 12. For example, by using the calculated histogram as shown in
Next, an operation of the above information processing system will be described with reference to a flowchart of
First, upon accepting a first captured image R1 that is a captured image obtained by capturing a space R from the camera C, the measurement device 10 detects a person P in the first captured image R1 (step S1). Specifically, as shown in
Subsequently, the measurement device 10 sets a particle p in the space R based on the proportion of the person P of each region r on the first captured image R1 (step S2). At this time, the measurement device 10 sets 100 particles p per person and sets, for each region r on the first captured image R1, more particles p in the lower part of the region r as the proportion of the person P is larger as shown in
Subsequently, the measurement device 10 predicts the amount of movement of the particle p (step S3). For example, assuming that each particle p moves based on a linear motion with constant velocity, a predetermined equation of motion, or the like, the measurement device 10 predicts the position of the particle p at the time of capturing a next captured image (after a lapse of a predetermined time) and predicts the amount of movement as shown by an arrow in
Subsequently, upon accepting a second captured image R2 that is the next captured image from the camera C after a lapse of a predetermined time, the measurement device 10 detects the person P in the second captured image R2 in the same manner as described above (step S4). Then, the measurement device 10 detects, for each region r set by dividing the target space R on the second captured image R2, the proportion of the person P existing therein in the same manner as described above.
Subsequently, the measurement device 10 evaluates the amount of movement of the particle p predicted as described above based on the proportion of the person P of each region r on the second captured image R2 (step S5). To be specific, the measurement device 10 gives less weight to the particle p associated with the region r where the proportion of the person P is smaller, and gives more weight to the particle p associated with the region r where the proportion of the person P is larger. Then, the measurement device 10 resets the particle p based on the weight of the particle p (step S6). Herein, the measurement device 10 eliminates the particle p or increases the particle p in accordance with the value of the weight of the particle p as shown in
Subsequently, the measurement device 10 detects the predicted amount of movement of each particle p as the amount of movement of the particle p at a moment of capturing the second captured image R2, and calculates the amount of activity from the amount of movement (step S7). Then, the measurement device 10 calculates a histogram of the amount of activity as shown in
Subsequently, the measurement device 10 outputs the calculated value based on the amount of activity to the output device 20, and controls various kinds of equipment in accordance with the calculated value (step S8). After that, in the case of continuing the processing (step S9, Yes), the measurement device 10 predicts the amount of movement of the reset particle p by using the second captured image R2 in the same manner as described above, determines the amount of movement of the particle p by using a subsequent captured image, and calculates a value based on the amount of activity (return to step S3).
As described above, according to the present invention, for each region obtained by dividing the space R, the amount of movement of a person existing therein is detected based on the proportion of the person, and the amount of activity of the person is calculated. Therefore, it is possible to detect the amount of movement of a person without tracing the person, and it is possible to detect the amount of activity of the person with high accuracy by a simple method. As a result, it becomes possible to easily use information of the amount of activity of a person for various purposes.
Although a case of detecting the proportion of the person P existing in each region r obtained by dividing the target space R into a plurality of regions by the use of a captured image obtained by capturing the space R with the camera C is illustrated as an example above, the detection method is not limited to using a captured image and may be any method. For example, by placing pressure sensors at predetermined intervals on the floor of the space R and acquiring a detection value detected when the person P steps the pressure sensor, it is possible to detect the proportion of the person P of each region r in the space R.
Next, a second example embodiment of the present invention will be described with reference to
As shown in
The detecting unit 110 and the calculating unit 120 mentioned above may be structured by execution of a program by an arithmetic logic unit of the information processing apparatus 100, or may be structured by an electronic circuit.
Then, the information processing apparatus 100 thus configured operates to execute processing of: detecting a proportion of a person existing for each predetermined region; and, based on the proportion of the person of each predetermined region, calculating a value based on an amount of activity of the person.
According to the present invention, it is possible to, based on the proportion of an existing person for each region obtained by dividing a space, detect the amount of movement of the person, and calculate the amount of activity of the person. As a result, it is possible to acquire the amount of activity of a person in a predetermined space with ease and with high accuracy, and use for various purposes is facilitated.
The whole or part of the example embodiments disclosed above can be described as the following supplementary notes. Hereinafter, the overview of the configurations of the information processing system, the information processing method and the program will be described. Meanwhile, the present invention is not limited to the following configurations.
An information processing apparatus comprising:
a detecting unit configured to detect a proportion of an existing person for each predetermined region; and
a calculating unit configured to, on a basis of the proportion of the person in each predetermined region, calculate a value based on an amount of activity of the person.
The information processing apparatus according to Supplementary Note 1, wherein the calculating unit is configured to set a predetermined object corresponding to the proportion of the person of each predetermined region and detect an amount of movement of the object, and calculate the value based on the amount of activity of the person on a basis of the amount of movement of the object.
The information processing apparatus according to Supplementary Note 1 or 2, wherein the calculating unit is configured to set a number of objects corresponding to the proportion of the person of each predetermined region and detect an amount of movement of the object, and calculate the value based on the amount of activity of the person on a basis of the amount of movement of the object.
The information processing apparatus according to Supplementary Note 2 or 3, wherein:
the detecting unit is configured to detect the proportion of the existing person for each predetermined region in each of a first state and a second state of the person that are temporally consecutive; and
the calculating unit is configured to, on a basis of the proportion of the person of each predetermined region in each of the first state and the second state, set the object corresponding to the proportion of the person and detect the amount of movement of the object.
The information processing apparatus according to Supplementary Note 4, wherein the calculating unit is configured to predict the amount of movement of the object corresponding to the proportion of the person of each predetermined region in the first state, and detect the amount of movement of the object on a basis of the predicted amount of movement of the object and the proportion of the person of each predetermined region in the second state.
The information processing apparatus according to Supplementary Note 5, wherein the calculating unit is configured to weight the object whose amount of movement has been predicted on a basis of the proportion of the person of each predetermined region in the second state, and calculate the value based on the amount of activity of the person on a basis of the weighted amount of movement of the object.
The information processing apparatus according to Supplementary Note 5 or 6, wherein the calculating unit is configured to predict the amount of movement of a number of objects corresponding to the proportion of the person of each predetermined region in the second state, and calculate the value based on the amount of activity of the person on a basis of the predicted amount of movement of the object.
The information processing apparatus according to any of Supplementary Notes 1 to 7, comprising an outputting unit configured to output the calculated value based on the amount of activity of the person.
The information processing apparatus according to any of Supplementary Notes 1 to 8, comprising a controlling unit configured to perform control of predetermined equipment on a basis of the calculated value based on the amount of activity of the person.
An information processing method comprising:
detecting a proportion of an existing person for each predetermined region; and
on a basis of the proportion of the person in each predetermined region, calculating a value based on an amount of activity of the person.
The information processing method according to Supplementary Note 10, wherein a predetermined object corresponding to the proportion of the person of each predetermined region is set and an amount of movement of the object is detected, and the value based on the amount of activity of the person is calculated on a basis of the amount of movement of the object.
The information processing method according to Supplementary Note 10 or 10.1, wherein a number of objects corresponding to the proportion of the person of each predetermined region is set and an amount of movement of the object is detected, and the value based on the amount of activity of the person is calculated on a basis of the amount of movement of the object.
The information processing method according to Supplementary Note 10.1 or 10.2, wherein:
the proportion of the existing person for each predetermined region in each of a first state and a second state of the person that are temporally consecutive is detected; and
on a basis of the proportion of the person of each predetermined region in each of the first state and the second state, the object corresponding to the proportion of the person is set and the amount of movement of the object is detected.
The information processing method according to claim 10.3, wherein the amount of movement of the object corresponding to the proportion of the person of each predetermined region in the first state is predicted, and the amount of movement of the object is detected on a basis of the predicted amount of movement of the object and the proportion of the person of each predetermined region in the second state.
The information processing method according to Supplementary Note 10.4, wherein the object whose amount of movement has been predicted is weighted on a basis of the proportion of the person of each predetermined region in the second state, and the value based on the amount of activity of the person is calculated on a basis of the weighted amount of movement of the object.
The information processing method according to Supplementary Note 10.4 or 10.5, wherein the amount of movement of a number of objects corresponding to the proportion of the person of each predetermined region in the second state is predicted, and the value based on the amount of activity of the person is calculated on a basis of the predicted amount of movement of the object.
The information processing method according to any of Supplementary Notes 10 to 10.6, comprising outputting the calculated value based on the amount of activity of the person.
The information processing method according to any of Supplementary Notes 10 to 10.7, comprising performing control of predetermined equipment on a basis of the calculated value based on the amount of activity of the person.
A computer program comprising instructions for causing an information processing apparatus to realize:
a detecting unit configured to detect a proportion of an existing person for each predetermined region; and
a calculating unit configured to, on a basis of the proportion of the person in each predetermined region, calculate a value based on an amount of activity of the person.
The abovementioned program can be stored by the use of various types of non-transitory computer-readable mediums and supplied to a computer. A non-transitory computer-readable medium includes various types of tangible storage mediums. A non-transitory computer-readable medium includes, for example, a magnetic recording medium (for example, a flexible disk, a magnetic tape, a hard disk drive), a magnetooptical recording medium (for example, a magnetooptical disk), a CD-ROM (Read Only Memory), a CD-R, a CD-R/W, a semiconductor memory (for example, a mask ROM, a PROM (Programmable ROM), an EPROM (Erasable PROM), a flash memory, and a RAM (Random Access Memory). Moreover, a program may be supplied to a computer by various types of transitory computer-readable mediums. A transitory computer-readable medium includes, for example, an electric signal, an optical signal, and an electromagnetic wave. A transitory computer-readable medium can supply a program to a computer via a wired communication channel such as an electric cable and an optical fiber or via a wireless communication channel.
Although the present invention has been described above with reference to the example embodiments and so on, the present invention is not limited to the example embodiments. The configurations and details of the present invention can be changed in various manners that can be understood by one skilled in the art within the scope of the present invention.
The present invention is based upon and claims the benefit of priority from Japanese patent application No. 2018-178790, filed on Sep. 25, 2018, the disclosure of which is incorporated herein in its entirety by reference.
Number | Date | Country | Kind |
---|---|---|---|
2018-178790 | Sep 2018 | JP | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/JP2019/032670 | 8/21/2019 | WO | 00 |