The present invention relates to an information output apparatus, an information output method, and a program.
In recent years, image processing has been employed for various purposes. For example, Patent Document 1 describes a system configured in such a way that a reach range of splash from a first target person is deviated from a breathing area of a second target person by adjusting an environment in a space, wherein a position and an orientation of a face of each of the first target person and the second target person are determined by image processing.
In order to reduce a risk of catching an infectious disease, it is important to avoid a situation in which a person may catch an infectious disease. However, it is difficult to recognize whether each person is in a situation in which the person may catch an infectious disease. One of objects of the present invention is to make it easy to recognize whether each person is in a situation in which the person may catch an infectious disease.
The present invention provides an information output apparatus including:
an acquisition means for acquiring a captured image acquired by photographing a space;
a detection means for detecting a person from the captured image;
a determination means for determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
a display control means for displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
Further, the present invention provides an information output method including:
by a computer,
acquiring a captured image acquired by photographing a space;
detecting a person from the captured image;
determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
Further, the present invention provides a program causing a computer to function as:
an acquisition means for acquiring a captured image acquired by photographing a space;
a detection means for detecting a person from the captured image;
a determination means for determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
a display control means for displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
According to the present invention, it becomes easy to recognize whether each person is in a situation in which the person may catch an infectious disease.
In the following, example embodiments according to the present invention are described by using the drawings. Note that, in every drawing, a similar component is designated with a similar reference sign, and description thereof is omitted as necessary.
When acquiring a captured image acquired by photographing a space, an information output apparatus analyzes the captured image, and generates and outputs a circular display image as illustrated in
The information output apparatus has a feature that a radius of a circle to be displayed on the above-described circular display image is determined based on at least either one of “a state of a space at a time of generating a captured image”, and “a state of each person at a time of generating a captured image”. Specifically, a size of a circle illustrated in
A risk of infection may change according to a state of a space (e.g., a temperature, humidity, an amount of ultraviolet rays, and the like), or a state of each person (e.g., a height, presence or absence of a disease, an age, a body temperature, and the like) at that occasion. In the information output apparatus according to the present example embodiment in which a radius of a circle to be displayed on the above-described circular display image is determined based on at least either one of “a state of a space at a time of generating a captured image”, and “a state of each person at a time of generating a captured image”, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration various states at that occasion.
Next, one example of a hardware configuration of the information output apparatus is described.
As illustrated in
The bus 5A is a data transmission path along which the processor 1A, the memory 2A, the peripheral circuit 4A, and the input/output interface 3A mutually transmit and receive data. The processor 1A is, for example, an arithmetic processing apparatus such as a CPU and a graphics processing unit (GPU). The memory 2A is, for example, a memory such as a random access memory (RAM) and a read only memory (ROM). The input/output interface 3A includes an interface for acquiring information from an input apparatus, an external apparatus, an external server, an external sensor, and the like, an interface for outputting information to an output apparatus, an external apparatus, an external server, and the like, and the like. The input apparatus is, for example, a keyboard, a mouse, a microphone, and the like. The output apparatus is, for example, a display, a speaker, a printer, a mailer, and the like. The processor 1A can issue a command to each module, and perform an arithmetic operation, based on an arithmetic operation result of each module.
Next, a functional configuration of the information output apparatus is described.
Processing illustrated in a flowchart in
In S11, the acquisition unit 11 acquires a captured image acquired by photographing a space.
A space to be captured is a space where a person may be present. For example, a space on a street, a space within a facility, and the like are exemplified, but the space is not limited thereto.
A captured image is generated by an imaging apparatus 20. A captured image may be a video, namely a moving image, or a photo, namely a still image The imaging apparatus 20 is, for example, a surveillance camera installed at any position on a street or within a facility. As illustrated in
In addition to the above, the imaging apparatus 20 may be a camera installed on a moving body such as an automobile, a bicycle, and a flying object, and configured to photograph various spaces while moving. At this occasion, the imaging apparatus 20 is also installed on the moving body at a position and in an orientation where a person present within a space is captured.
In addition to the above, the imaging apparatus 20 may be a camera carried by a person (also including a video camera and a mobile terminal equipped with a camera function such as a smartphone, a tablet terminal, and a mobile phone).
The acquisition unit 11 may acquire a captured image generated by the imaging apparatus 20 by real-time processing, or may acquire by batch processing. A means for inputting a captured image generated by the imaging apparatus 20 to the information output apparatus 10 by real-time processing or batch processing can be achieved by using any available technique.
In S12, the detection unit 12 detects a person from a captured image. The detection unit 12 can achieve detection of the person by using any available technique.
In S13, the determination unit 13 determines a radius of a circle to be displayed on a circular display image according to a predetermined condition. For example, the determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on at least either one of a state of a space at a time of generating a captured image, and a state of each person detected from a captured image.
A state of a space at a time of generating a captured image is defined by an item that may affect a risk of infection. As such an item, for example, a temperature, humidity, an amount of ultraviolet rays, and the like are exemplified, but the item is not limited thereto. The determination unit 13 may acquire actual measurement values of these items by various sensors installed in a space, and recognize a state of the space, based on the actual measurement values. In addition to the above, the determination unit 13 may acquire, from various servers, predicted values or actual measurement values of these items, and recognize a state of the space, based on the predicted values or the actual measurement values.
The determination unit 13 determines a radius according to a recognized state of a space, based on “information indicating a relation between a state of a space and a value of a radius” (such as a table and an arithmetic formula) being held in advance. Note that, the information is defined in such a way that a large radius is determined, as a risk of infection (a risk of infecting another person, a risk at which a person is infected by another person) increases, and a small radius is determined, as a risk of infection decreases.
Further, a state of each person detected from a captured image is defined by an item that may affect a risk of infection. As such an item, for example, a height, presence or absence of a disease, an age, a body temperature, and the like are exemplified, but the item is not limited thereto. The determination unit 13 may analyze a captured image, or an actual measurement value by another sensor installed in a space, and determine a state of these items for each detected person.
Then, the determination unit 13 determines a radius according to a recognized state of each person, for each person, based on “information indicating a relation between a state of a person and a value of a radius” (such as a table and an arithmetic formula) being held in advance. Note that, the information is defined in such a way that a large radius is determined, as a risk of infection (a risk of infecting another person, a risk at which a person is infected by another person) increases, and a small radius is determined, as a risk of infection decreases.
Note that, in the following example embodiments, a specific example of processing of determining the radius is described.
In S14, the generation unit 14 generates a circular display image in which a circle whose radius has a value determined by the determination unit 13, and which surrounds a position of each of detected persons is displayed on an image indicating a position of each of detected persons.
When a radius of a circle to be displayed on a circular display image is determined based on a state of a space at a time of generating a captured image, a radius (size) of a circle illustrated in
In S15, the display control unit 15 transmits/inputs, to a display apparatus, a circular display image generated by the generation unit 14, and causes the display apparatus to display the circular display image. As the display apparatus, a display, a projection apparatus, a smartphone, a tablet terminal, a mobile phone, a personal computer, and the like are exemplified, but the display apparatus is not limited thereto.
When acquiring a captured image acquired by photographing a space, the information output apparatus 10 according to the present example embodiment can analyze the captured image, and generate and output a circular display image as illustrated in
Then, the information output apparatus 10 determines a radius of a circle to be displayed on the above-described circular display image, based on at least either one of “a state of a space at a time of generating a captured image”, and “a state of each person at a time of generating a captured image”. Specifically, a large radius is determined, as a risk of infection (a risk of infecting another person, a risk at which a person is infected by another person) increases, and a small radius is determined, as a risk of infection decreases. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration various states at that occasion.
An information output apparatus 10 according to the present example embodiment determines a radius of a circle to be displayed on a circular display image, based on at least one of a temperature, humidity, and an amount of ultraviolet rays of a space at a time of generating a captured image. In the following, the information output apparatus 10 is described in detail.
A determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on at least one of a temperature, humidity, and an amount of ultraviolet rays of a space at a time of generating a captured image.
As illustrated in
Note that, in the illustrated example, it is determined whether each of the values is higher than the reference value in an order of a temperature, humidity, and an amount of ultraviolet rays of a space. As a modification example, the determination may be performed in another order.
Further, in the illustrated example, a radius of a circle to be displayed on a circular display image is determined based on all of a temperature, humidity, and an amount of ultraviolet rays of a space. As a modification example, a radius of a circle to be displayed on a circular display image may be determined by similar processing, based on a part of a temperature, humidity, and an amount of ultraviolet rays of a space.
Further, in the illustrated example, each of a temperature, humidity, and an amount of ultraviolet rays is classified into two states (“a state in which a value is higher than the reference value”, and “a state in which a value is lower than the reference value”), based on a value thereof, and a risk of infection is determined based on a result of these classifications. As a modification example, each of a temperature, humidity, and an amount of ultraviolet rays may be classified into three or more states, and a risk of infection may be determined based on a result of these classifications.
Further, in the illustrated example, each of a temperature, humidity, and an amount of ultraviolet rays is classified into two states (“a state in which a value is higher than the reference value”, and “a state in which a value is lower than the reference value”), based on a value thereof, a risk of infection is determined based on a result of these classifications, and then, a radius of a circle to be displayed on a circular display image is determined based on the determined risk of infection. As a modification example, each of a temperature, humidity, and an amount of ultraviolet rays may be classified into two states (“a state in which a value is higher than the reference value”, and “a state in which a value is lower than the reference value”), based on a value thereof, and a radius of a circle to be displayed on a circular display image may be determined based on a result of these classifications. Specifically, a radius of a circle to be displayed on a circular display image may be determined from the above-described classification result, without performing determination on a risk of infection.
Other configuration of the information output apparatus 10 according to the present example embodiment is similar to that of the first example embodiment.
As described above, in the information output apparatus 10 according to the present example embodiment, an advantageous effect similar to that of the first example embodiment is achieved. Further, in the information output apparatus 10 according to the present example embodiment, it is possible to determine a radius of a circle to be displayed on a circular display image, based on at least one of a temperature, humidity, and an amount of ultraviolet rays of a space at a time of generating a captured image. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration a state of a space at that occasion.
An information output apparatus 10 according to the present example embodiment determines a radius of a circle to be displayed on a circular display image, based on a height of each person at a time of generating a captured image. In the following, the information output apparatus 10 is described in detail.
A determination unit 13 determines a height of each person detected from a captured image, based on the captured image. Then, the determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on the determined height of each person.
As illustrated in
Processing of determining a height of a person by an image analysis can be achieved by any available technique. For example, in a case where an imaging apparatus 20 is a surveillance camera installed at any position on a street or within a facility, any object (such as a mailbox, a bending machine, or a traffic light) installed within a photographing area is always present within a captured image. An actual height of the object may be measured in advance, and input to the information output apparatus 10. Then, the information output apparatus 10 may estimate a height of each person, based on a relative positional relation among each person detected within a captured image and the object, a height of the object within the image, and an actual height of the object.
In addition to the above, a feature value of an external appearance and a height of each of a plurality of persons may be registered in advance in a database. Then, the determination unit 13 may recognize a person detected by collating a feature value of an external appearance of a person detected from the captured image with a feature value of an external appearance registered in the database, and acquire a height of the recognized person from the database.
Note that, in the illustrated example, a height is classified into two states (“a state in which a height is higher than the reference value”, and “a state in which a height is equal to or lower than the reference value”), based on a value thereof, and a risk of infection is determined based on a result of these classifications. As a modification example, a height may be classified into three or more states, and a risk of infection may be determined based on a result of these classifications.
Further, in the illustrated example, a height is classified into two states (“a state in which a height is higher than a reference value”, and “a state in which a height is equal to or lower than the reference value”), based on a value thereof, a risk of infection is determined based on a result of these classifications, and then, a radius of a circle to be displayed on a circular display image is determined based on the determined risk of infection. As a modification example, a height may be classified into two states (“a state in which a height is higher than the reference value”, and “a state in which a height is equal to or lower than the reference value”), based on a value thereof, and a radius of a circle to be displayed on a circular display image may be determined based on a result of these classifications. Specifically, a radius of a circle to be displayed on a circular display image may be determined from the above-described classification result, without performing determination on a risk of infection.
Other configuration of the information output apparatus 10 according to the present example embodiment is similar to that of the first and second example embodiments.
As described above, in the information output apparatus 10 according to the present example embodiment, an advantageous effect similar to that of the first and second example embodiments is achieved. Further, in the information output apparatus 10 according to the present example embodiment, it is possible to determine a radius of a circle to be displayed on a circular display image for each person, based on a height of each person detected from a captured image. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration a height of each of persons present within a captured image.
An information output apparatus 10 according to the present example embodiment determines a radius of a circle to be displayed on a circular display image, based on presence or absence of a disease of each person at a time of generating a captured image. In the following, the information output apparatus 10 is described in detail.
A determination unit 13 determines presence or absence of a disease of each person detected from a captured image, based on the captured image. Then, the determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on the determined presence or absence of a disease of each person.
As illustrated in
Processing of determining presence or absence of a disease of a person by an image analysis can be achieved by using any available technique. For example, the determination unit 13 may extract a joint point of a person by analyzing a captured image (preferably, a moving image), and estimate a pose of the person, based on a result of the extraction. Then, the determination unit 13 may determine that a person in which a pose at a time of coughing or sneezing is detected has a disease. Extraction of a joint point can be achieved by using any available technique such as an OpenPose.
In addition to the above, a feature value of an external appearance and presence or absence of a disease of each of a plurality of persons may be registered in advance in a database. Then, the determination unit 13 may recognize a person detected by collating a feature value of an external appearance of a person detected from a captured image with a feature value of an external appearance registered in the database, and acquire information indicating presence or absence of a disease of the recognized person from the database.
Note that, in the illustrated example, a risk of infection is determined based on a determination result on presence or absence of a disease, and then, a radius of a circle to be displayed on a circular display image is determined based on the determined risk of infection. As a modification example, a radius of a circle to be displayed on a circular display image may be determined based on a determination result on presence or absence of a disease. Specifically, a radius of a circle to be displayed on a circular display image may be determined from the above-described determination result on presence or absence of a disease, without performing determination on a risk of infection.
Other configuration of the information output apparatus 10 according to the present example embodiment is similar to that of the first to third example embodiments.
As described above, in the information output apparatus 10 according to the present example embodiment, an advantageous effect similar to that of the first to third example embodiments is achieved. Further, in the information output apparatus 10 according to the present example embodiment, it is possible to determine a radius of a circle to be displayed on a circular display image for each person, based on presence or absence of a disease of each person detected from a captured image. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration presence or absence of a disease of each person at that occasion.
An information output apparatus 10 according to the present example embodiment determines a radius of a circle to be displayed on a circular display image, based on an age of each person at a time of generating a captured image. In the following, the information output apparatus 10 is described in detail.
A determination unit 13 determines an age of each person detected from a captured image, based on the captured image. Then, the determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on the determined age of each person.
It is known that, as an age increases, a body is weakened, and a risk of infection increases. In view of the above, regarding “information indicating a relation between a state of a person and a value of a radius” described in the first example embodiment, it is defined in such a way that a large radius is determined, when an age is higher than a reference value, and a small radius is determined, when an age is equal to or lower than the reference value.
Processing of determining an age of a person by an image analysis can be achieved by using any available technique. For example, the determination unit 13 may estimate an age of a person, based on a feature (a position of a part such as an eye, a nose, and a mouth, a degree of wrinkles, and the like) of a face of each person included in a captured image.
In addition to the above, a feature value of an external appearance and an age of each of a plurality of persons may be registered in advance in a database. Then, the determination unit 13 may recognize a person detected by collating a feature value of an external appearance of a person detected from the captured image with a feature value of an external appearance registered in the database, and acquire an age of the recognized person from the database.
Note that, in the illustrated example, an age is classified into two states (“a state in which an age is higher than the reference value”, and “a state in which an age is equal to or lower than the reference value”), based on a value thereof, and a risk of infection is determined based on a result of these classifications. As a modification example, an age may be classified into three or more states, and a risk of infection may be determined based on a result of these classifications.
Further, in the illustrated example, an age is classified into two states (“a state in which an age is higher than the reference value”, and “a state in which an age is equal to or lower than the reference value”), based on a value thereof, a risk of infection is determined based on a result of these classifications, and then, a radius of a circle to be displayed on a circular display image is determined based on the determined risk of infection. As a modification example, an age may be classified into two states (“a state in which an age is higher than the reference value”, and “a state in which an age is equal to or lower than the reference value”), based on a value thereof, and a radius of a circle to be displayed on a circular display image may be determined based on a result of these classifications. Specifically, a radius of a circle to be displayed on a circular display image may be determined from the above-described classification result, without performing determination on a risk of infection.
Other configuration of the information output apparatus 10 according to the present example embodiment is similar to that of the first to fourth example embodiments.
As described above, in the information output apparatus 10 according to the present example embodiment, an advantageous effect similar to that of the first to fourth example embodiments is achieved. Further, in the information output apparatus 10 according to the present example embodiment, it is possible to determine a radius of a circle to be displayed on a circular display image for each person, based on an age of each person detected from a captured image. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration an age of each of persons present within a captured image.
An information output apparatus 10 according to the present example embodiment determines a radius of a circle to be displayed on a circular display image, based on a body temperature of each person at a time of generating a captured image. In the following, the information processing apparatus 10 is described in detail.
A determination unit 13 determines a body temperature of each person detected from a captured image, based on the captured image. Then, the determination unit 13 determines a radius of a circle to be displayed on a circular display image, based on the determined body temperature of each person.
When a body temperature is higher than a reference value (example: 37° C.), there is a possibility that the person is infected with an infectious disease. In view of the above, regarding “information indicating a relation between a state of a person and a value of a radius” described in the first example embodiment, it is defined in such a way that a large radius is determined when a body temperature is higher than the reference value, and a small radius is determined when a body temperature is equal to or lower than the reference value.
Processing of determining a body temperature of a person can be achieved by using any available technique. For example, a body temperature of each person may be determined based on a thermal image generated by an infrared camera.
In addition to the above, a feature value of an external appearance and a body temperature measured on that day of each of a plurality of persons may be registered in advance in a database. Then, the determination unit 13 may recognize a person detected by collating a feature value of an external appearance of a person detected from a captured image with a feature value of an external appearance registered in the database, and acquire a body temperature of the recognized person from the database.
Note that, in the illustrated example, a body temperature is classified into two states (“a state in which a body temperature is higher than the reference value”, and “a state in which a body temperature is equal to or lower than the reference value”), based on a value thereof, and a risk of infection is determined based on a result of these classifications. As a modification example, a body temperature may be classified into three or more states, and a risk of infection may be determined based on a result of these classifications.
Further, in the illustrated example, a body temperature is classified into two states (“a state in which a body temperature is higher than the reference value”, and “a state in which a body temperature is equal to or lower than the reference value”), based on a value thereof, a risk of infection is determined based on a result of these classifications, and then, a radius of a circle to be displayed on a circular display image is determined based on the determined risk of infection. As a modification example, a body temperature may be classified into two states (“a state in which a body temperature is higher than the reference value”, and “a state in which a body temperature is equal to or lower than the reference value”), based on a value thereof, and a radius of a circle to be displayed on a circular display image may be determined based on a result of these classifications. Specifically, a radius of a circle to be displayed on a circular display image may be determined from the above-described classification result, without performing determination on a risk of infection.
Other configuration of the information output apparatus 10 according to the present example embodiment is similar to that of the first to fifth example embodiments.
As described above, in the information output apparatus 10 according to the present example embodiment, an advantageous effect similar to that of the first to fifth example embodiments is achieved. Further, in the information output apparatus 10 according to the present example embodiment, it is possible to determine a radius of a circle to be displayed on a circular display image for each person, based on a body temperature of each person detected from a captured image. According to the information output apparatus 10 as described above, it becomes possible to accurately recognize whether each person is in a situation in which the person may catch an infectious disease, taking into consideration a body temperature of each person at that occasion.
Note that, in the present specification, “acquisition” includes at least one of “fetching data stored in another apparatus or a storage medium by an own apparatus (active acquisition)”, based on a user input, or based on a command of a program, for example, requesting or inquiring another apparatus and receiving, accessing to another apparatus or a storage medium and reading, and the like, “inputting data to be output from another apparatus to an own apparatus (passive acquisition)”, based on a user input, or based on a command of a program, for example, receiving data to be distributed (or transmitted, push-notified, or the like), and acquiring by selecting from among received data or information, and “generating new data by editing data (such as converting into a text, rearranging data, extracting a part of pieces of data, and changing a file format) and the like, and acquiring the new data”.
A part or all of the above-described example embodiments may also be described as the following supplementary notes, but is not limited to the following.
1. An information output apparatus including:
an acquisition means for acquiring a captured image acquired by photographing a space;
a detection means for detecting a person from the captured image;
a determination means for determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
a display control means for displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
2. The information output apparatus according to supplementary note 1, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on a state of the space at a time of generating the captured image.
3. The information output apparatus according to supplementary note 2, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on at least one of a temperature, humidity, and an amount of ultraviolet rays of the space at a time of generating the captured image.
4. The information output apparatus according to any one of supplementary notes 1 to 3, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner for the each detected person, based on a state of each of the detected persons at a time of generating the captured image.
5. The information output apparatus according to supplementary note 4, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on a height of the detected person determined based on the captured image.
6. The information output apparatus according to supplementary note 4 or 5, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on presence or absence of a disease of the detected person determined based on the captured image.
7. The information output apparatus according to any one of supplementary notes 4 to 6, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on an age of the detected person determined based on the captured image.
8. The information output apparatus according to any one of supplementary notes 4 to 6, wherein
the determination means determines a radius of a circle to be displayed over the captured image in an overlapping manner, based on a body temperature of the detected person determined based on a thermal image generated by an infrared camera.
9. An information output method including:
by a computer,
acquiring a captured image acquired by photographing a space;
detecting a person from the captured image;
determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
10. A program causing a computer to function as:
an acquisition means for acquiring a captured image acquired by photographing a space;
a detection means for detecting a person from the captured image;
a determination means for determining a radius of a circle to be displayed over the captured image in an overlapping manner according to a predetermined condition; and
a display control means for displaying an image in which a circle surrounding each of the detected persons is displayed over the captured image in an overlapping manner.
Number | Date | Country | Kind |
---|---|---|---|
2021-013451 | Mar 2021 | JP | national |