Patent Application
20240029493
The present invention relates to a visitor reception system, an information processing apparatus, an information processing method, and a program.
One example of an intercom system having a function of calling and speaking to a resident is described in Patent Document 1. The intercom system in Patent Document 1 includes a face recognition unit that performs face recognition on a visitor, based on a captured image acquired from an intercom slave unit installed outside a house, and an output control unit that performs an output according to an authentication result to a master unit inside the house. With this configuration, reception appropriate for a resident is implemented by determining a visitor and thereby displaying a mark on a master unit, and not performing a calling operation of notifying a resident of a visit when face recognition fails.
Further, Patent Document 2 describes an intercom system including a slave unit that can read authentication data by communicating with a cellular phone possessed by a visitor, and a master unit including a display that displays a registration content when the read authentication data coincide with registered authentication data.
An intercom system described in Patent Document 3 includes a slave unit that performs infrared communication with a communication terminal apparatus possessed by a visitor, and receives identification information about the communication terminal apparatus, and a master unit that receives the identification information transferred from the slave unit, determines the visitor, based on the identification information, transmits, to the slave unit, an immediate reply being prepared by a visited person for the visitor, and instructs the slave unit to provide the immediate reply to the visitor.
Patent Document 4 describes a system for performing an identification inquiry of a visitor at a visit destination. A portable terminal of a visitor includes a non-contact IC card that records identification information about the visitor, and a biometric authentication functional unit that registers biometric identification information for authentication about the visitor. A visit reception apparatus reads the identification information from the non-contact IC card of the portable terminal of the visitor, instructs the biometric authentication functional unit to execute authentication, receives an authentication result, and changes information to be output to a screen display apparatus according to the result.
In all of the systems described in the documents described above, a visitor is determined for a person scheduled for a visit. However, a person who is not scheduled for a visit is included in visitors. Thus, even when any of a person expected to visit and a person not expected to visit visits, it is desired that safety during reception can be secured.
The present invention has been made in view of the circumstance described above, and an object thereof is to be able to secure safety during reception even when any of a person expected to visit and a person not expected to visit visits.
In each aspect according to the present invention, each configuration below is adopted in order to solve the above-mentioned problem.
A first aspect relates to an information processing apparatus.
A first information processing apparatus according to the first aspect is a computer that constitutes a visitor terminal held by a visitor, and includes:
A second information processing apparatus according to the first aspect is a computer that constitutes a visited person terminal, and includes:
A third information processing apparatus according to the first aspect is a computer that constitutes a visited person terminal held by a visited person, and includes:
A second aspect relates to an information processing method executed by at least one computer.
The information processing method according to the second aspect is an information processing method implemented by each unit of any one of the first to third information processing apparatuses according to the first aspect described above.
Note that, another aspect according to the present invention may be a program causing at least one computer to execute each unit of any one of the first to third information processing apparatuses according to the first aspect described above, or may be a computer-readable storage medium that stores such a program. The storage medium includes a non-transitory tangible medium.
The computer program includes a computer program code causing a computer to execute the information processing method on the information processing apparatus when the computer program code is executed by the computer.
Note that, any combination of the components above and expression of the present invention being converted among a method, an apparatus, a system, a storage medium, a computer program, and the like are also effective as a manner of the present invention.
Further, various components according to the present invention do not necessarily need to be an individually independent presence, and a plurality of components may be formed as one member, one component may be formed of a plurality of members, a certain component may be a part of another component, a part of a certain component and a part of another component may overlap each other, and the like.
Further, a plurality of procedures are described in order in the method and the computer program according to the present invention, but the described order does not limit an order in which the plurality of procedures are executed. Thus, when the method and the computer program according to the present invention are executed, an order of the plurality of procedures can be changed within an extent that there is no harm.
Furthermore, a plurality of procedures of the method and the computer program according to the present invention are not limited to being executed at individually different timings. Thus, another procedure may occur during execution of a certain procedure, an execution timing of a certain procedure and an execution timing of another procedure may partially or entirely overlap each other, and the like.
According to each of the aspects described above, even when any of a person expected to visit and a person not expected to visit visits, safety during reception can be secured.
Hereinafter, example embodiments of the present invention will be described with reference to the drawings. Note that, in all of the drawings, a similar component has a similar reference sign, and description thereof will be not appropriately included. Further, in each of the following drawings, a configuration of a portion unrelated to essence of the present invention is not included and not illustrated.
“Acquisition” in an example embodiment includes at least one of acquisition (active acquisition), by its own apparatus, of data or information being stored in another apparatus or a storage medium, and inputting (passive acquisition) of data or information output from another apparatus to its own apparatus. Examples of the active acquisition include reception of a reply by making a request or an inquiry to another apparatus, reading by accessing another apparatus or a storage medium, and the like. Further, examples of the passive acquisition include reception of information to be distributed (transmitted, push-notified, or the like), and the like. Furthermore, “acquisition” may include acquisition by selection from among pieces of received data or pieces of received information, or reception by selecting distributed data or distributed information.
In a visited person house, the intercom master unit 20 is installed inside the house, and an intercom slave unit 10 (not illustrated in
A visitor U1 acquires connection information recorded in the QR code 12 by capturing the QR code 12 by using the camera 102 of the visitor terminal 100. The connection information includes information needed for the visitor terminal 100 to perform communication with the master unit 20.
In another example, the visitor terminal 100 may read and acquire, by Near Field Communication (NFC), connection information recorded in a storage medium such as a non-contact IC card installed in the slave unit 10 in the visited person house or around the slave unit 10.
The computer 1000 includes a bus 1010, a processor 1020, a memory 1030, a storage device 1040, an input/output interface 1050, and a network interface 1060.
The bus 1010 is a data transmission path for allowing the processor 1020, the memory 1030, the storage device 1040, the input/output interface 1050, and the network interface 1060 to transmit and receive data with one another. However, a method for connecting the processor 1020 and the like to one another is not limited to bus connection.
The processor 1020 is a processor implemented by a central processing unit (CPU), a graphics processing unit (GPU), and the like.
The memory 1030 is a main storage apparatus implemented by a random access memory (RAM) and the like.
The storage device 1040 is an auxiliary storage apparatus implemented by a hard disk drive (HDD), a solid state drive (SSD), a memory card, a read only memory (ROM), or the like. The storage device 1040 stores a program module that implements each function (for example, a connection information acquisition unit 120, a visitor information transmission unit 122, a visitor information acquisition unit 220, a display processing unit 222, an unlocking command transmission unit 224, a control unit 226, and the like described below) of the visitor terminal 100, the master unit 20, and the portable terminal 200 of the visited person. The processor 1020 reads each program module onto the memory 1030 and executes the program module, and each function associated with the program module is implemented. Further, the storage device 1040 may also store each piece of data of the visitor terminal 100, the visited person terminal 210, and the like.
The program module may be stored in a storage medium. The storage medium that stores the program module may include a non-transitory tangible medium usable by the computer 1000, and a program code readable by the computer 1000 (the processor 1020) may be embedded in the medium.
The input/output interface 1050 is an interface for connecting the computer 1000 and various types of input/output equipment. The input/output interface 1050 also functions as a communication interface that performs short-range wireless communication, such as Bluetooth (registered trademark) and Near Field Communication (NFC).
The network interface 1060 is an interface for connecting the computer 1000 to a communication network. The communication network is, for example, a local area network (LAN) and a wide area network (WAN). A method of connection to the communication network by the network interface 1060 may be wireless connection or wired connection.
Then, the computer 1000 is connected to necessary equipment (for example, the camera 102 and the display 104 of the visitor terminal 100, a display 202, a speaker, and a microphone of the visited person terminal 210, the display 22, the conversation button 24, a speaker, and a microphone of the master unit 20, the intercom slave unit 10, or the like) via the input/output interface 1050 or the network interface 1060.
The display 104 and the display 202 of the visitor terminal 100 and the visited person terminal 210 are, for example, a liquid crystal display, an organic electro luminescence (EL) display, and the like, and may be a touch panel integrated with a reception means for receiving an operation of a user.
An application that implements the information processing apparatus 100 is installed in the visitor terminal 100, and each function of each component of the information processing apparatus 100 in
Further, also in a case of an application use, a user is preferably registered in advance, and the application may be usable after a login to the visitor reception system 1 by using user registration information. Further, for use of the visitor terminal 100 or the application, use of the visitor terminal 100 or the application is preferably implemented when comparison with biometric authentication information being already registered in advance is performed and authentication succeeds.
The biometric authentication information includes, for example, at least any one of an iris, a vein, an auricle, a fingerprint, a voiceprint, and the like. The authentication apparatus (not illustrated) extracts a feature value of the biometric authentication information from an image captured by the camera 102 or a sound collected from the microphone, and performs authentication processing by performing comparison with the biometric authentication information about the user of the visitor terminal 100 being already registered in advance.
The visitor terminal 100 includes the connection information acquisition unit 120 and the visitor information transmission unit 122.
The connection information acquisition unit 120 acquires connection information for communicating with the visited person terminal 210 (the intercom master unit 20 in
The visitor information transmission unit 122 transmits visitor information being stored in advance to the visited person terminal 210 (the intercom master unit 20 in
The connection information for communicating with the visited person terminal 210 (the intercom master unit 20 in
The short-range wireless communication is, for example, Bluetooth (registered trademark) and the like, which is not limited thereto. The connection information includes information needed to establish communication between the visited person terminal 210 (at least one of the portable terminal 200 of the visited person and the intercom master unit 20) and the visitor terminal 100, and identification information about the visited person terminal 210 (at least one of the portable terminal 200 of the visited person and the intercom master unit 20).
However, in order to cause the intercom master unit 20 to function as the visited person terminal 210, a program having a function of the visited person terminal 210 needs to be stored in the memory 1030 in an executable state by the processor 1020 of the intercom master unit 20. In other words, the intercom master unit 20 needs to be associated with the present visitor reception system 1. When the intercom master unit 20 is not associated with the visitor reception system 1, the portable terminal 200 of the visited person is used as the visited person terminal 210.
As illustrated in
The visitor terminal 100 in which the application of the visitor reception system 1 is installed can communicate with the intercom master unit 20 in the visited person house by using connection information, but a suspicious person U11 operates the intercom slave unit 10 without using the visitor terminal 100, and thus visitor information cannot be transmitted to the intercom master unit 20 unlike the visitor terminal 100. Thus, a visited person U3 can distinguish between a visitor who uses the application of the visitor reception system 1 and a visitor who does not use the application. Then, a visitor (suspicious person U11) who does not use the visitor reception system 1 can be dealt with by an automatic response or without opening a door 6.
As illustrated in
By capturing an image of the QR code 12 by using the camera 102 of the visitor terminal 100, and processing the image, the connection information acquisition unit 120 can acquire the connection information recorded in the QR code 12.
The visitor information transmission unit 122 establishes communication with the visited person terminal 210 (the intercom master unit 20 in
The visitor information may include at least one of belonging (for example, a company name, a store name, a group name, a company code, information about a type of business, and the like) of a user of the visitor terminal 100, and a name (for example, may not be a real name, and may be a business name or a nickname). Furthermore, the visitor information may include various types of certificate information about a user of the visitor terminal 100. The certificate information may include, for example, various types of qualification information, such as information indicating possession of a qualification related to a technician such as electrical work and a qualification related to a technician such as an inspection of gas and water, information certifying that a person is not contracting an infectious disease (may also include information such as an antibody check result, an antigen check result, and vaccine injection information), information about a passage history, or the like.
The visitor information transmission unit 122 transmits a face image of a visitor to the visited person terminal 210 (the intercom master unit 20 in
First, when the visitor U1 visits a visited person house, the visitor U1 activates the application of the visitor reception system 1 in the visitor terminal 100. Then, in order to read the QR code 12 attached to the slave unit 10 installed outside the visited person house or around the slave unit 10, the connection information acquisition unit 120 activates the camera 102 of the visitor terminal 100, and outputs a guidance (a screen display and/or a sound output) for reading the QR code 12. When the visitor U1 operates the visitor terminal 100 and captures the QR code 12 according to the guidance, the connection information acquisition unit 120 processes the captured image of the QR code 12, and acquires connection information from the QR code 12 (step S1001).
Alternatively, the connection information acquisition unit 120 may acquire the connection information through NFC communication with a communication apparatus (for example, a non-contact IC card) provided on the visited person house.
Then, the visitor information transmission unit 122 establishes communication with the visited person terminal 210 (the intercom master unit 20 in
The visited person terminal 210 (the intercom master unit 20 in
As described above, according to the present example embodiment, the connection information acquisition unit 120 acquires connection information for communicating with the visited person terminal 210 from the QR code 12, and the visitor information transmission unit 122 transmits visitor information to the visited person terminal 210 by using the connection information, and thus the visitor information acquisition unit 220 receives the visitor information transmitted from the visitor terminal 100, and the display processing unit 222 displays the visitor information on the display 22.
In this way, the visited person U3 can confirm the information about the visitor U1 being displayed on the intercom master unit 20 and deal with the visitor U1. In this way, even when any of a person expected to visit and a person not expected to visit visits, the visitor information is transmitted to the visited person terminal 210 by using the visitor terminal 100, and thus safety during reception can be secured. Further, a person who calls without communicating with the visited person terminal 210 can be recognized as the suspicious person U11, and thus an appropriate response such as not dealing with the suspicious person U11 can be selected.
Further, since only the connection information is acquired from the QR code 12, personal information about the visited person U3 is not included and an individual is not determined by an outside, and thus safety can be guaranteed.
In the present example embodiment, a configuration of at least one of a portable terminal 200 of a visited person and an intercom master unit 20 in the visitor reception system 1 will be described.
An application that implements the information processing apparatus 210 is installed in the portable terminal 200 of the visited person, and each function of each component of the information processing apparatus 210 in
The information processing apparatus 210 (the portable terminal 200 of the visited person or the intercom master unit 20) includes a visitor information acquisition unit 220, a display processing unit 222, and an unlocking command transmission unit 224.
The visitor information acquisition unit 220 acquires visitor information from a visitor terminal 100.
The display processing unit 222 displays an image including the visitor information acquired by the visitor information acquisition unit 220 on a screen (a display 202 or a display 22).
When an unlocking command of an entranceway (door 6) is input after the image is displayed by the display processing unit 222, the unlocking command transmission unit 224 transmits the unlocking command to the entranceway.
However, the unlocking command transmission unit 224 is not necessarily needed. When a visited person U3 can confirm a visitor U1, the visited person U3 may go to the door 6 and manually unlock the door 6.
First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person. When the visitor U1 visits a visited person house and presses a call button 14 of an intercom slave unit 10 (step S1 in
When the visited person U3 presses a conversation button 24 of the intercom master unit 20 and deals with the call of the visitor U1 over the master unit 20 (step S13), the visitor U1 tells the visited person U3 an important matter over the slave unit 10 (step S3). At this time, the slave unit 10 captures the visitor U1 by a camera 16, and displays a captured image on the display 22 of the master unit 20. At this time, for example, the visitor U1 may provide an identification card of himself/herself, for example, a staff identity card 30 or the like to the camera 16. The visited person U3 can visually confirm a face image and the staff identity card of the visitor U1 being displayed on the display 22 of the intercom master unit 20. Up to this point, it is a reception method between the visitor U1 and the visited person U3 in a general intercom system.
When the visited person U3 presses the conversation button 24, the master unit 20 further activates a short-range communication function such as Bluetooth, and is in a waiting state of a connection request from another apparatus (step S15). The visited person U3 requests the visitor U1 to read a QR code 12 over the master unit 20 (step S17).
As described in the first example embodiment, the visitor U1 activates the application (described as a “digital staff” identity card application in
Then, as described in the first example embodiment, the visitor U1 reads the QR code 12 according to a guidance of the application by the visitor terminal 100, acquires connection information with the master unit 20, establishes communication with the master unit 20, and transmits visitor information to the master unit 20. In the present example embodiment, the series of procedure is also referred to as “personal authentication” (step S7).
The master unit 20 establishes connection with the visitor terminal 100 in response to the connection request from the visitor terminal 100, then receives the visitor information transmitted from the visitor terminal 100, and displays the received visitor information on the display 22 (step S19).
The display processing unit 222 displays, on the same screen on the display 22, the face image of the visitor U1 captured by the camera 16 of the slave unit 10 and a face picture included in the visitor information received from the visitor terminal 100. The two images may be displayed side by side, or the face picture included in the visitor information may be displayed over the face image of the visitor U1 captured by the camera 16 of the slave unit 10.
The display 22 displays the face image of the visitor U1 captured by the camera 16 of the slave unit 10 and the visitor information (such as a company name, a name, and a face picture) received from the visitor terminal 100. At this time, the portable terminal 200 of the visited person U3 may also establish connection with the visitor terminal 100, receive the visitor information from the visitor terminal 100, and transmit the visitor information to the display 202. Then, the visitor information received from the visitor terminal 100 is displayed on the display 202 of the portable terminal 200 of the visited person U3 (step S21).
In
In this way, the intercom master unit 20 can receive the captured image of the visitor U1 who actually visits the visited person house and the visitor information registered in advance in the visitor terminal 100, and display the captured image and the visitor information on the display 22. Then, the visited person U3 can confirm, on the screen of the display 22 of the intercom master unit 20, whether the visitor U1 is a person (i.e., the person concerned) coinciding with the visitor information transmitted from the visitor terminal 100.
According to the present example embodiment, the display processing unit 222 can display, on the same screen, a face picture that is recorded in advance in the visitor terminal 100 and has already been subjected to personal authentication and an image acquired by capturing a person who actually visits by the intercom slave unit 10, and thus unauthorized behavior such as spoofing can be confirmed by the screen when the unauthorized behavior is performed.
The control unit 124 changes display information or a processing content according to belonging of a visitor. For example, the control unit 124 displays a predetermined screen on a display 104 when visitor information is transmitted to a portable terminal 200 of a visited person and then there is no response from the portable terminal 200 of the visited person. At this time, the control unit 124 changes the predetermined screen to be displayed according to belonging of a visitor.
For example, when belonging of a visitor indicates an acquaintance, the predetermined screen includes a message notifying that the visited person is absent. Furthermore, a user interface (UI) such as an operation button that receives an operation for notifying the portable terminal 200 of the visited person of a matter to the absent visited person and the like as a message may be included. Furthermore, for example, when belonging of a visitor indicates a home-delivery company, the predetermined screen includes a message that requests a package to be placed into a delivery box. Further, when belonging of a visitor indicates a newspaper salesman, the predetermined screen may not be displayed. A specific example will be described in an example embodiment described below.
The control unit 124 can determine belonging of a visitor, based on visitor information (for example, a company code and the like) that has already been subjected to personal identification, identification information about an application installed in the visitor terminal 100, or the like. Alternatively, display information and a processing content may be decided for each application.
An operation of the information processing apparatus 210 will be described by using
First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person U3. A visitor U1 installs an application (described as a “door intercom application” in
Then, the visitor U1 captures and reads a QR code 12 installed near a gate 8 of a visited person house by a camera 102 according to a guidance of the visitor terminal 100 (step S105). A QR code reading screen 302 is displayed on the visitor terminal 100. In the visitor terminal 100, a connection information acquisition unit 120 acquires connection information from the QR code 12, and a visitor information transmission unit 122 makes a connection request with the portable terminal 200 of the visited person U3 by using the connection information acquired by the connection information acquisition unit 120 (step S107). At this time, the control unit 124 of the visitor terminal 100 may display a call screen 304 on the display 104.
Then, when the visited person U3 is at home, and communication between the visitor terminal 100 and the portable terminal 200 of the visited person U3 is established (step S109), the visitor terminal 100 transmits visitor information to the portable terminal 200 of the visited person U3, and causes the portable terminal 200 of the visited person U3 to perform an output (an output of a call sound or a display of a call screen 402) for calling the visited person U3 (step S111). The call screen 402 displays fewer face pictures of the visitor U1 included in the visitor information received from the visitor terminal 100. Furthermore, the call screen 402 may include a response button 406 for the visited person U3 to respond, and a visitor information display portion 408 that displays information, such as a name of the visitor U1, included in the visitor information.
When the visited person U3 confirms a notification content of the call screen 402 (step S113), and presses the response button 406 (step S115), a response notification is transmitted from the portable terminal 200 of the visited person U3 to the visitor terminal 100. In the visitor terminal 100, the control unit 124 displays, on the display 104, a home response screen 306 indicating a content of the response notification received from the portable terminal 200 of the visited person U3. The visitor U1 confirms the response content (step S117). A content of the response notification may include a content indicating that the visited person U3 is at home, such as “Please wait a minute.”, for example. Alternatively, the content may include a content indicating that the visited person U3 is at home but cannot deal, such as “I am not available since I am currently busy.”. Furthermore, the content may include a content causing the visitor U1 to record a matter, such as “Please tell me what brings you here.”, for example. Then, the portable terminal 200 of the visited person U3 may receive sound data about the visitor U1 from the visitor terminal 100, and record the sound data in association with the visitor information.
On the other hand, when the visited person U3 is absent, the portable terminal 200 of the visited person U3 does not respond to the connection request from the visitor terminal 100. Thus, when there is no response for a predetermined period of time or longer in the visitor terminal 100 (step S121), the control unit 124 displays, on the display 104, an absence response screen 308 indicating a possibility of absence of the visited person U3 (step S123).
According to the present example embodiment, the visited person U3 can confirm, on the call screen 402, the visitor information about the visitor U1 being displayed by a display processing unit 222, and then deal with the visitor U1. Furthermore, in the visitor terminal 100, when the visited person U3 is absent, the control unit 124 can detect absence of a response and display the absence response screen 308 on the display 104 of the visitor terminal 100.
When a visitor information transmission unit 122 of the visitor terminal 100 transmits visitor information to the portable terminal 200 of the visited person U3, and there is no response from the portable terminal 200 of the visited person U3, the visitor information is further transmitted to an authentication service server 5 via a communication network 2 such as a cellular phone communication network.
A situation where there is no response from the portable terminal 200 of the visited person U3 is when the visited person U3 is absent, or is at home but cannot respond since the visited person U3 is in the middle of something. As described above, the visitor terminal 100 establishes connection with the visited person terminal 210 (at least any one of an intercom master unit 20 and the portable terminal 200 of the visited person) by reading a QR code. When the visited person U3 is absent, connection between the information processing apparatus 100 and the intercom master unit 20 can be established, but connection with the portable terminal 200 of the visited person U3 cannot be established.
The following methods are conceivable as a decision method of absence of a response from the visited person terminal 210.
Information transmitted from the visitor terminal 100 to the authentication service server 5 further includes, as information about a visit destination, for example, identification information about the portable terminal 200 of the visited person U3 included in connection information, in addition to visitor information transmitted to the information processing apparatus 210.
The authentication service server 5 stores the visitor information received from the visitor terminal 100, the identification information about the portable terminal 200 of the visited person U3 being a visit destination, and reception date and time information in association with one another. The authentication service server 5 accumulates the received visitor information as visitor history information of the portable terminal 200 of the visited person U3 for each portable terminal 200 of the visited person U3. The authentication service server 5 transmits the visitor history information of the portable terminal 200 of the visited person U3 to the portable terminal 200 of the visited person U3 in response to an inquiry from the portable terminal 200 of the visited person U3. Alternatively, a message notifying that there is a visitor may be transmitted to the portable terminal 200 of the visited person U3. The authentication service server 5 may provide a user-specific Web page for each account of the portable terminal 200 of the visited person U3, and the visitor history information may be able to be viewed by logging into the special Web page.
A visitor information acquisition unit 220 of the information processing apparatus (visited person terminal) 200 is connected to the authentication service server 5 via the communication network 2 such as a cellular phone communication network, and acquires the visitor history information associated with the identification information about the portable terminal 200 of the visited person U3. A display processing unit 222 displays, on a display 202, a visit history screen 410 that displays the acquired visitor history information. The visitor history information displayed on the visit history screen 410 includes, for example, a visit date and time, belonging of a visitor, a name, a face image, and the like.
When the information processing apparatus 210 is the intercom master unit 20, the visited person U3 may be able to display the visit history screen 410 on the display processing unit 222 and confirm the visitor history information after returning home.
An operation of the information processing apparatus 210 will be described by using
First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person U3. A visitor U1 installs an application (described as a “door intercom application” in
Then, the visitor U1 captures and reads a QR code 12 installed near a gate 8 of a visited person house by a camera 102 according to a guidance of the visitor terminal 100 (step S105). A QR code reading screen 302 is displayed on the visitor terminal 100. In the visitor terminal 100, a connection information acquisition unit 120 acquires connection information from the QR code 12, and the visitor information transmission unit 122 makes a connection request with the portable terminal 200 of the visited person U3 by using the connection information acquired by the connection information acquisition unit 120 (step S107). At this time, in the visitor terminal 100, a control unit 124 may display a call screen 304.
When the visited person U3 is absent, the portable terminal 200 of the visited person U3 does not respond to the connection request from the visitor terminal 100. Thus, when there is no response for a predetermined period of time or longer in the visitor terminal 100 (step S121), the control unit 124 displays, on a display 104, an absence response screen 308 indicating a possibility of absence of the visited person U3 (step S123).
Furthermore, the visitor information transmission unit 122 transmits visitor information and identification information about the portable terminal 200 of the visited person U3 being a visit destination in association with each other to the authentication service server 5 via the communication network 2 such as a local communication network (step S124).
Then, the visitor information acquisition unit 220 of the portable terminal 200 of the visited person U3 accesses the authentication service server 5 and acquires visitor history information, and the display processing unit 222 displays the visit history screen 410 on the display 202 (step S131). As described above, the authentication service server 5 may notify the portable terminal 200 of the visited person U3 that there is a visitor, and the portable terminal 200 of the visited person U3 may access the authentication service server 5 and acquire (pull-type) the visitor history information, or may transmit (push-type) the visitor history information from the authentication service server 5 to the portable terminal 200 of the visited person U3.
According to the present example embodiment, when there is no response from the visited person terminal 210, the visitor terminal 100 transmits visitor information from the visitor information transmission unit 122 to the authentication service server 5, and thus history information about a visitor can be managed in the authentication service server 5. Then, the visitor information acquisition unit 220 of the portable terminal 200 of the visited person U3 accesses the authentication service server 5 and acquires the history information, and the display processing unit 222 can display the history information on the display 202. In this way, the visited person U3 can confirm the information about the visitor U1 during absence.
The information processing apparatus 210 in
A person being a target for public personal identification among visitors is exemplified below, for example, which is not limited thereto.
A visitor is classified into, for example, (c1) a person that has already been subjected to the personal identification publicly described above, (c2) an acquaintance including a friend and a relative, and (c3) other outsiders including a person who performs door-to-door sales, a suspicious person, and the like.
The control unit 226 may decide which classification a visitor is put into by at least any one of the following methods.
Processing contents by visitor by the control unit 226 are exemplified below, which are not limited thereto. The plurality of processing contents below may be combined within a consistent range.
First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person U3. The visitor U5 who is a home-delivery company installs an application (described as a “digital staff identity card” in
Then, the digital staff identity card application is activated by the visitor terminal 100 (step S103). Then, the visitor U5 captures and reads a QR code 12 installed near a gate 8 of a visited person house by a camera 102 according to a guidance of the visitor terminal 100 (step S105). A QR code reading screen 302 is displayed on the visitor terminal 100. In the visitor terminal 100, a connection information acquisition unit 120 acquires connection information from the QR code 12, and a visitor information transmission unit 122 makes a connection request with the portable terminal 200 of the visited person U3 by using the connection information acquired by the connection information acquisition unit 120 (step S107). At this time, in the visitor terminal 100, a control unit 124 may display a call screen 304.
Then, when the visited person U3 who is a recipient of a package 60 is at home, and communication between the visitor terminal 100 and the portable terminal 200 of the visited person U3 is established (step S109), the visitor terminal 100 transmits visitor information to the portable terminal 200 of the visited person U3. Herein, the portable terminal 200 of the visited person U3 determines the visitor, based on the visitor information received by the control unit 226.
Then, when the visitor U5 is determined as a home-delivery company, based on the business code and the like, the control unit 226 permits an output (an output of a call sound and a display of a call screen 440) for calling the visited person U3. Then, a display processing unit 222 displays the call screen 440 on a display 202 (step S111). The call screen 440 displays at least a face picture of the visitor U5 included in the visitor information received from the visitor terminal 100. Furthermore, the call screen 440 may include a response button 442 for the visited person U3 to respond, and a visitor information display portion 444 that displays information, such as belonging and a name of the visitor U5, included in the visitor information.
When the visited person U3 confirms a notification content of the call screen 440 (step S113), and presses the response button 442 (step S115), a response notification is transmitted from the portable terminal 200 of the visited person U3 to the visitor terminal 100. In the visitor terminal 100, the control unit 124 displays, on a display 104, a home response screen 306 indicating a content of the response notification received from the portable terminal 200 of the visited person U3. The visitor U1 can confirm the response content (step S117). A content of the response notification may include a content indicating that the visited person U3 is at home, such as “Please wait a minute.”, for example. Alternatively, the content may include a content indicating that the visited person U3 is at home but cannot deal, such as “I am not available since I am currently busy.”. Then, the visited person U3 goes to an entrance, and receives the package 60 from the visitor U5 (step S119).
On the other hand, when the visited person U3 is absent, the portable terminal 200 of the visited person U3 does not respond to the connection request from the visitor terminal 100. Thus, when there is no response for a predetermined period of time or longer in the visitor terminal 100 (step S121), the control unit 124 displays, on a display 104, an absence response screen 308 indicating a possibility of absence of the visited person U3 (step S123).
The absent response screen 308 may display a message notifying absence and also include a contact button 310. When pressing of the contact button 310 is received, the control unit 124 displays a contact content selection screen 320 on the display 104 (step S127). The contact content selection screen 320 includes a take back button 322, a package drop button 324, and a memo button 326. When the take back button 322 is pressed, the visitor terminal 100 receives a fact that the package 60 is taken back as a content for contact. When the package drop button 324 is pressed, a fact that the package 60 is placed at a predetermined placement place is received as a content for contact. When the memo button 326 is pressed, the control unit 124 further displays a screen (not illustrated) that receives an input of a message content to the visited person U3, and receives an operation input of text or a sound input of the visitor U5.
Then, the visitor information transmission unit 122 transmits, to the portable terminal 200 of the visited person U3, the contact content to the visited person U3 being received on the contact content selection screen 320 (step S129). When the portable terminal 200 of the visited person U3 receives the contact content transmitted from the visitor terminal 100, the display processing unit 222 displays a notification screen 430. In this example, a message indicating that the package 60 is taken back is displayed on the notification screen 430. When a package drop is selected, a message indicating that the package 60 is placed at a predetermined placement place is displayed. When a message memo is recorded, a message recorded in the message memo is displayed on the notification screen 460.
Note that, a contact content may be directly transmitted from the visitor terminal 100 to the portable terminal 200 of the visited person U3, or, as described in the fourth example embodiment, a contact content from the visitor U5 may be transmitted to the authentication service server 5, and the portable terminal 200 of the visited person U3 may access the authentication service server 5 and receive the contact content.
First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person U3. The visitor U7 who is a deliverer of a product of a convenience store installs an application (described as a “digital staff identity card” in
Then, the digital staff identity card application is activated by the visitor terminal 100 (step S103). Then, the visitor U5 captures and reads the QR code 12 installed near the gate 8 of the visited person house by the camera 102 according to a guidance of the visitor terminal 100 (step S105). The QR code reading screen 302 is displayed on the visitor terminal 100. In the visitor terminal 100, the connection information acquisition unit 120 acquires connection information from the QR code 12, and the visitor information transmission unit 122 makes a connection request with the portable terminal 200 of the visited person U3 by using the connection information acquired by the connection information acquisition unit 120 (step S107). At this time, in the visitor terminal 100, the control unit 124 may display the call screen 304.
Then, when the visited person U3 who is a recipient of a product 72 is at home, communication between the visitor terminal 100 and the portable terminal 200 of the visited person U3 is established, and the visitor terminal 100 then transmits visitor information to the portable terminal 200 of the visited person U3. Herein, the portable terminal 200 of the visited person U3 determines the visitor, based on the visitor information received by the control unit 226.
Then, when the visitor U7 is determined as a deliverer of a convenience store, based on the business code and the like, the control unit 226 permits an output (an output of a call sound and a display of the call screen 450) for calling the visited person U3, and also causes the display processing unit 222 to perform an automatic response notification. The display processing unit 222 displays the call screen 450 on the display 202 (step S111). The call screen 450 displays fewer face pictures of the visitor U7 included in the visitor information received from the visitor terminal 100. Furthermore, the call screen 450 may include the visitor information display portion 454 that displays information, such as belonging and a name of the visitor U7, included in the received visitor information.
The visitor U3 confirms the notification content of the call screen 450 (step S113). Meanwhile, the control unit 226 notifies the visitor terminal 100 of an automatic response. When the notification of the automatic response is received (step S131), the control unit 124 displays an automatic response screen 330 in the visitor terminal 100 (step S133).
The automatic response screen 330 may display a message instructing the product 72 to be put into a delivery box 70, and also include a contact button 332. When pressing of the contact button 332 is received, the control unit 124 displays a contact content selection screen 340 on the display 104 (step S137). The contact content selection screen 340 includes a package drop button 342 and a memo button 344. When the package drop button 342 is pressed, a fact that the product 72 is put in the delivery box 70 is received as a content for contact. When the memo button 344 is pressed, the control unit 124 further displays a screen (not illustrated) that receives an input of a message content to the visited person U3, and receives an operation input of text or a sound input of the visitor U5.
Then, the visitor information transmission unit 122 transmits, to the portable terminal 200 of the visited person U3, the contact content to the visited person U3 being received on the contact content selection screen 340 (step S139). When the portable terminal 200 of the visited person U3 receives the contact content transmitted from the visitor terminal 100, the display processing unit 222 displays a notification screen 460. In this example, a message notifying that the product 72 is put in the delivery box 70 is displayed on the notification screen 460. When a message memo is recorded, a message recorded in the message memo is displayed on the notification screen 460.
Note that, a contact content may be directly transmitted from the visitor terminal 100 to the portable terminal 200 of the visited person U3, or, as described in the fourth example embodiment, a contact content from the visitor U5 may be transmitted to the authentication service server 5, and the portable terminal 200 of the visited person U3 may access the authentication service server 5 and receive the contact content.
According to the present example embodiment, the control unit 226 changes a processing content by visitor, and thus appropriate reception can be implemented depending on a visitor. For example, in the operation example 2, when the control unit 226 determines that a visitor U6 is a deliverer of the product 72 of a convenience store, the visited person U3 can instruct the deliverer to put the product 72 into the delivery box 70 without reception by notifying an automatic response to the visitor terminal 100.
The information processing apparatus (visited person terminal) 200 includes a connection information acquisition unit 230 and a visitor information acquisition unit 220. The connection information acquisition unit 230 acquires connection information for communicating with the visitor terminal 100 by processing an image captured by a camera 204 included in the portable terminal 200 of the visited person U3. The visitor information acquisition unit 220 requests and acquires visitor information from the visitor terminal 100 by using the acquired connection information. The visitor information acquired by the visitor information acquisition unit 220 may be displayed as a visitor information display screen 510 on a display 202.
According to the present example embodiment, qualification certificate information, infectious disease certificate information, and the like about a visitor can be confirmed in the portable terminal 200 of the visited person U3. Further, visitor information received by the portable terminal 200 of the visited person U3 can also be used for verification of validity of a visitor later. Further, when a digital staff identity card 40 provided with a digital signature and the like are received as in an example embodiment described below, validity of the digital staff identity card 40 can be confirmed by verifying the digital signature at a time of the reception.
In this example, the visitor reception system 1 further includes a television 80. A visited person U3 is assumed to often watch the television 80 at home. Thus, in the present example embodiment, when a visit of a visitor is detected in a portable terminal 200 of the visited person U3, a message notifying the visit is displayed on the television 80 from the portable terminal 200 of the visited person U3.
In the present example embodiment, for example, a case where a visitor U9 who has already been registered in advance, such as a pharmacist, and has already been subjected to personal identification visits will be described as an example. First, an application of the visitor reception system 1 is activated in advance in the portable terminal 200 of the visited person U3. The visitor U9 who is a pharmacist installs the application of the visitor reception system 1 in advance in a portable terminal 100. Then, the visitor U7 performs personal identification by face authentication on the visitor terminal 100 at a time of a visit (step S101), and, when the authentication succeeds, the visitor terminal 100 can be used. For example, information such as a pharmacy name to which the pharmacist being the user of the visitor terminal 100 who succeeds in the authentication belongs, a pharmacist name, a face image (face authentication information), and a business code is stored. Herein, a business code in visitor information about the visitor U9 indicates a pharmacist.
Then, after the application is activated in the visitor terminal 100, the visitor U5 captures and reads a QR code 12 installed near a gate 8 of a visited person house by a camera 102 according to a guidance of the visitor terminal 100 (step S105). In the visitor terminal 100, a connection information acquisition unit 120 acquires connection information from the QR code 12, and a visitor information transmission unit 122 makes a connection request with the portable terminal 200 of the visited person U3 by using the connection information acquired by the connection information acquisition unit 120.
After communication between the visitor terminal 100 and the portable terminal 200 of the visited person U3 is established, the visitor terminal 100 transmits the visitor information to the portable terminal 200 of the visited person U3 (step S141). Herein, the portable terminal 200 of the visited person U3 determines the visitor, based on the visitor information received by a control unit 226.
Then, when the visitor U9 is determined as a pharmacist, based on the business code and the like (step S145), the control unit 226 permits an output for calling the visited person U3. Then, the control unit 226 causes a display processing unit 222 to display a message on a screen of the television 80 (step S147). The screen displays, together with a message notifying a visit of a visitor, at least belonging and a name of the visitor U9 included in the visitor information received from the visitor terminal 100. Furthermore, a face image of the visitor U9 may be displayed on the television 80.
The portable terminal 200 of the visited person U3 and the television 80 may be connected by, for example, a wireless local area network (LAN) in a house (so-called wireless fidelity (Wi-Fi). The visited person U3 can confirm the information about the visitor being displayed on the screen of the television 80, and deal with the visitor by using the portable terminal 200 of the visited person U3 (step S149). The visited person U3 may speak to the visitor U9 by using the portable terminal 200 of the visited person U3. For example, the visited person U3 may request the visitor U9 to put medicine into a delivery box 70, or may open a door 6 and deal with the visited person U9.
According to the present example embodiment, even a visited person who hardly notices a notification by the portable terminal 200 of the visited person U3 is made more likely to notice presence of a visitor since a function of notifying a visit is provided to the television 80 and the like. Even a person who does not carry the portable terminal 200 of the visited person U3 such as an old person can be encouraged to use the present visitor reception system 1.
In the visitor reception system 1, a connection information acquisition unit 120 of the visitor terminal 100 acquires connection information by reading the QR code 12 provided on a building. Then, the visitor information transmission unit 122 is connected to the authentication service server 5 via a communication network 2 such as a cellular phone communication network by using the connection information, and transmits visitor information. The authentication service server 5 performs authentication processing on the visitor information received from the visitor terminal 100. For example, the visitor U1 installs an application, and then registers authentication information as personal identification information in advance in the authentication service server 5. Then, the authentication service server 5 compares the received visitor information with the registered authentication information, and decides whether the visitor is a registered visitor.
When the authentication succeeds, the authentication service server 5 notifies the information processing apparatus 210 of a manager U13 of the building of the authentication success via the communication network 2. Then, a display control unit 222 of the information processing apparatus 210 displays the authentication success, the manager U13 performs an operation of permitting an entry of the visitor U1 into the building, and the unlocking command transmission unit 224 transmits an unlocking command to a door 6 of the building.
When the authentication fails, the authentication service server 5 notifies the information processing apparatus 210 of the manager U13 of the building of the authentication failure via the communication network 2. Then, the display control unit 222 of the information processing apparatus 210 displays the authentication failure, and the manager U13 may inform the visitor U1 that an entry of the visitor U1 into the building is not permitted via an intercom slave unit 10 or the like.
Furthermore, the authentication service server 5 may provide the visitor information received from the visitor U1 to, for example, a main office of an entrepreneur to which the visitor U1 belongs. The manager U15 of the main office of the entrepreneur can confirm the visitor information. In this way, for example, the manager U15 of the main office of the entrepreneur can confirm that unauthorized behavior such as spoofing is not performed by the visitor U1.
According to the present example embodiment, also at a time of an entry into a building and the like, the visitor terminal 100 can request the authentication service server 5 to perform authentication of the visitor U1. Further, an authentication result is also provided to a manager of an entrepreneur to which the visitor U1 belongs, and thus the manager can also confirm that unauthorized behavior such as spoofing is not performed by the visitor.
First, at a main office of an entrepreneur to which a visitor U1 belongs, for example, a manager U15 requests an authentication service server 5 to create a digital staff identity card 40 using a mechanism for a digital signature (procedure P1). The digital staff identity card 40 is provided with a digital signatures 42 encrypted by using a private key 44. The authentication service server 5 distributes the digital staff identity card 40 and a transport key 48 to a visitor terminal 100, and distributes a public key 46 to an intercom master unit 20 (procedure P5).
For example, the digital signature 42 may be set for each individual such as a police officer, or may be set for each company by the authentication service server 5 executing for a general company and the like.
The visitor U1 logs into the visitor reception system 1 by using the visitor terminal 100 by face authentication and inputting a user ID and a password, and registers the digital staff identity card 40 distributed from the authentication service server 5 in the visitor terminal 100 (procedure P3). The procedure up to this point completes advance preparation.
Then, at a time of a visit, the visitor U1 activates a digital staff identity card application of the digital staff identity card 40 by the visitor terminal 100 (procedure P7). Note that, use of the visitor terminal 100 can be permitted by performing personal identification by face authentication, and the application can be activated (or the visitor reception system 1 can be logged in).
Then, a QR code 12 is read by using a camera 102 of the visitor terminal 100 by the application (procedure P9), and a connection information acquisition unit 120 acquires connection information. Then, when communication with the intercom master unit 20 is performed and connection succeeds, the digital staff identity card 40 is encrypted by using the transport key 48 (provided with a digital key 50) (procedure P11), and the visitor information transmission unit 122 transmits the digital staff identity card 40 to the intercom master unit 20 (procedure P13).
Then, the intercom master unit 20 decrypts the received digital staff identity card 40 by using the transport key 48 (procedure P15), and further decrypts the digital signature 42 by using the public key 46 (procedure P17). Then, after validity of the digital staff identity card 40 is confirmed (procedure P19), visitor information about a company name, a name, and the like of the visitor U1 being recorded in the digital staff identity card 40 is displayed on a display 22 (procedure P21).
For example, in the case of the individual smartphone 100a, for example, biometric authentication information is registered by eKYC and the like, personal authentication is also performed in a public institution such as a public office, based on a national identification number card and the like, and digital information about the national identification number card is registered in the smartphone 100a (mobile national identification number).
The mobile national identification number may include a personal identification function, infectious disease certificate information, qualification certification information (for example, information about a health insurance card), and the like.
On the other hand, for the smartphone 100b provided from the company, the authentication service server 5 registers, in the smartphone 100b, face authentication information managed by a directory for each company to which a user U1b belongs, and the digital staff identity card 40 provided with the digital signature 42 authenticated by the authentication service server 5.
A company name to which the user U1b belongs, and a name (for example, a business name) are stored as the visitor information in the digital staff identity card 40.
Note that, a function of the digital staff identity card 40 may be put together in the individual smartphone 100a.
According to the present example embodiment, visitor information subjected to appropriate authentication processing can be stored in the visitor terminal 100.
While the example embodiments of the present invention have been described with reference to the drawings, the example embodiments are only exemplification of the present invention, and various configurations other than the above-described example embodiments can also be employed.
For example, the QR code 12 may have, for example, a seal shape, and may be sold at least one by one in combination with an application of the portable terminal 200 of the visited person U3 of the visitor reception system 1 or alone. Alternatively, an image of the QR code 12 may be able to be downloaded from a predetermined Web site, printed, and attached.
Information recorded in a QR code is encrypted in such a way as to be decrypted by an application of the portable terminal 200 of the visited person. For example, a scratch card in which an activation code (for example, a code formed of a combination of a predetermined number of digits of letters and numbers) is hidden is sold together with a QR code. An application is downloaded, installed, and activated in the portable terminal 200 of the visited person. In initial setting of the application, a reading screen of the QR code is displayed on the portable terminal 200 of the visited person. The visited person reads the QR code according to a guidance of the screen. At this time, a screen that prompts an input of the activation code described on the scratch card is displayed on the portable terminal 200 of the visited person. The visited person peels a coating of the scratch card, acquires the activation code, and inputs the activation code. The portable terminal 200 of the visited person can decrypt the QR code by receiving the input of the activation code, and can acquire identification information for connection with Bluetooth of the portable terminal 200 of the visited person being recorded in the QR code.
The portable terminal 200 of the visited person stores identification information about himself/herself in the memory 1030, for example. The visited person attaches a sticker of a QR code to the intercom slave unit 10.
Meanwhile, decoding information (processing logic) for decrypting a QR code common to the present visitor reception system 1 is included in the application of the visitor terminal 100, and stored in the memory 1030 of the visitor terminal 100. When the QR code is read, the visitor terminal 100 performs decryption by using the decoding information, and acquires identification information for connection with Bluetooth of the portable terminal 200 of the visited person being recorded in the QR code. Then, a connection request including the identification information for connection with Bluetooth of the portable terminal 200 of the visited person is transmitted toward the portable terminal 200 of the visited person.
When the portable terminal 200 of the visited person receives the connection request transmitted from the visitor terminal 100, the portable terminal 200 confirms the identification information for connection with Bluetooth included in the connection request, confirms that the identification information for connection with Bluetooth of the portable terminal 200 of the visited person is included, and then responds to the connection request. In this way, connection between the visitor terminal 100 and the portable terminal 200 of the visited person is established.
Furthermore, in another example, when a display (not illustrated) is provided in the intercom slave unit 10 and the like, an image of the QR code 12 may be transmitted from the portable terminal 200 of the visited person U3 to the slave unit 10, and stored in the memory 1030 of the slave unit 10, and, when a visitor is detected (for example, when pressing of the call button 14 is detected, and the like), the QR code may be displayed on the display of the slave unit 10.
The invention of the present application is described above with reference to the example embodiments and the examples, but the invention of the present application is not limited to the example embodiments and the examples described above. Various modifications that can be understood by those skilled in the art can be made to the configuration and the details of the invention of the present application within the scope of the invention of the present application.
Note that, when information about a user (a visitor and a visited person) is acquired and used in the present invention, this is lawfully performed.
A part or the whole of the above-described example embodiment may also be described in supplementary notes below, which is not limited thereto.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2020/047520 | 12/18/2020 | WO |
