Patent Application
20220014514
The present disclosure relates to an information processing method, an information processing program, an information processing device, and an information processing system.
The development of an information communication technology has been remarkable in recent years, and not only personal computers, smartphones, and tablets, but also all things such as automobiles, home appliances, and sensor devices are connected to communication networks such as the Internet. In this way, it is expected that an internet of things (IoT) society in which trillions of devices on the earth are connected to the communication networks will arrive in the near future (refer to Patent Literature 1).
Patent Literature 1: JP 2016-515328 A
However, as disclosed in Patent Literature 1, in the current IoT technology, an internet service provider (ISP) manages network addresses (typically, IP addresses) of devices which are connected to the Internet. For example, in a case where a predetermined device is connected to the Internet, the ISP allocates an IP address (particularly, a global IP address) to the predetermined device. Then, the predetermined device can access a WEB server on the Internet by using the IP address allocated by the ISP. In this manner, in a case where a device is connected to a communication network such as the Internet, intervention of a business operator who manages the IP address such as the ISP is required.
On the other hand, in order to improve user convenience for connection to communication networks, currently, a technology in which a device can issue an IP address of the device itself without through the ISP who manages the global IP address or a DHCP server that manages a private IP address has been developed. Examples of such IP addresses include EVER/IP (registered trademark). According to the technology, a device A having a communication function can issue an IP address of the device A itself on the basis of a public key authenticated by an authentication station without through the ISP or the like. In addition, a device B having a communication function can issue an IP address of the device B itself on the basis of a public key authenticated by the authentication station without through the ISP or the like. Further, when any one of the device A and the device B can know the IP address of the other side, communication is established between the device A and the device B. In this manner, in order for the device A and the device B to be connected in a communicable manner, it is necessary for at least one of the device A and the device B to grasp the IP address of the other side in advance.
In this regard, it is considered that a user of the device A grasps the IP address of the device B, and manually inputs the IP address of the device B to the device A. However, the work of manually inputting the IP address of the device B to the device A after grasping the IP address of the device B is very time-consuming work. From the above-described viewpoint, there is room for further improving user convenience.
An object of the disclosure is to provide an information processing method, an information processing program, an information processing device, and an information processing system which are capable of improving user convenience in communication connection between devices.
An information processing method according to an aspect of the disclosure includes:
a step of generating a two-dimensional pattern associated with a network address of a first device;
a step of causing a display unit of the first device to display the two-dimensional pattern;
a step of acquiring image data representing the two-dimensional pattern from an imaging unit of a second device; and
a step of specifying the network address based on the acquired image data.
According to the above-described method, the network address of the first device is automatically specified by the second device from the image data representing the two-dimensional pattern displayed on the display unit of the first device. In this manner, it is not necessary to conduct work such as manual inputting of the network address of the first device to the second device after grasping the network address of the first device, and thus it is possible to provide an information processing method capable of improving user convenience in communication connection between the first device and the second device.
In addition, the above-described information processing method may further include: a step of transmitting predetermined information to the first device by using the network address.
According to the above-described method, communication connection between the first device and the second device can be established by using the network address of the first device.
In addition, the above-described information processing method may further include:
a step of transmitting image data representing a display screen of the second device to the first device by using the network address; and
a step of causing the display unit of the first device to display the display screen of the second device on the basis of the transmitted image data representing the display screen of the second device.
According to the above-described method, it is possible to cause the display unit of the first device to display the display screen of the second device. In this manner, for example, the display screen of the second device can be shared by a plurality of persons through the display unit of the first device.
In addition, the above-described information processing method may further include:
a step of receiving image data representing a display screen of a third device that is connected to the second device in a communicable manner, from the third device;
a step of transmitting the image data representing the display screen of the third device to the first device by using the network address; and
a step of causing the display unit of the first device to display the display screen of the third device based on the transmitted image data representing the display screen of the third device.
According to the above-described method, the image data representing the display screen of the third device connected to the second device in a communicable manner is transmitted to the first device through the second device. In this manner, it is possible to cause the display unit of the first device to display the display screen of the third device that is not directly connected to the first device.
In addition, the above-described information processing method may further include:
a step of determining whether or not the second device exists in vicinity of the first device; and
a step of permitting communication connection between the first device and the second device in a case where the second device exists in the vicinity of the first device.
According to the above-described method, in a case where the second device exists in the vicinity of the first device, communication connection between the first device and the second device is permitted. In this manner, a situation in which communication connection between the first device and an external device existing at a location spaced apart from the first device is established may be appropriately prevented.
In addition, the step of determining whether or not the second device exists in the vicinity of the first device may include
a step of determining that the second device exists in the vicinity of the first device in response to a user input operation on the first device.
According to the above-described method, it is determined that the second device exists in the vicinity of the first device in correspondence with the user input operation on the first device. In this manner, it is possible to determine whether or not the second device exists in the vicinity of the first device by a relatively simple method.
In addition, the step of determining whether or not the second device exists in the vicinity of the first device may include
a step of determining that near field communication between the first device and the second device is established.
According to the above-described method, it is determined that the second device exists in the vicinity of the first device in correspondence with establishment of near field communication (NFC) between the first device and the second device. In this manner, it is possible to determine whether or not the second device exists in the vicinity of the first device by a relatively simple method.
In addition, the step of determining whether or not the second device exists in the vicinity of the first device may include:
a step of causing the display unit of the first device to display predetermined display information;
a step of acquiring user input information by the second device through a user input operation on the second device;
a step of transmitting the user input information from the second device to the first device; and
a step of determining whether or not the second device exists in the vicinity of the first device based on comparison between the transmitted user input information and the predetermined display information.
According to the above-described method, the user input information is acquired by the second device through the user input operation on the second device. Then, it is determined whether or not the second device exists in the vicinity of the first device on the basis of comparison between the user input information and the predetermined display information. In this manner, it is possible to determine whether or not the second device exists in the vicinity of the first device by using the predetermined display information displayed on the display unit of the first device.
In addition, the predetermined display information may be a one-time password.
According to the above-described method, it is possible to reliably determine whether or not the second device exists in the vicinity of the first device by using the one-time password displayed on the display unit of the first device.
In addition, the information processing method may further include a step of receiving configuration information of the second device.
In addition, the two-dimensional pattern may be a one-dimensional or two-dimensional bar code.
In addition, the two-dimensional pattern may include a plurality of divided regions. Each of the plurality of divided regions may have color information associated with a part of the network address.
The first device may be a projector.
An information processing method according to another aspect of the disclosure that is executed by a processor of a device including a display unit, includes:
a step of generating a two-dimensional pattern associated with a network address of the device; and
a step of causing the display unit to display the two-dimensional pattern.
According to the above-described method, it is possible to provide an information processing method capable of improving user convenience in communication connection between devices.
In addition, the above-described information processing method may further include: a step of generating the network address of the device by the processor of the device before the step of generating the two-dimensional pattern.
In addition, an information processing program causing a computer to execute the information processing method is provided. Further, a computer-readable storage medium storing the information processing program is provided.
An information processing device according to still another aspect of the disclosure includes: at least one processor; a memory that stores a computer-readable command; and a display unit. When the computer-readable command is executed by the processor, the information processing device is configured to execute the information processing method.
According to the above-described configuration, it is possible to provide an information processing device capable of improving user convenience in communication connection between devices.
An information processing system according to still another aspect of the disclosure includes: a first device including a display unit; and a second device including an imaging unit.
The First Device
generates a two-dimensional pattern associated with a network address of the first device, and
causes the display unit to display the two-dimensional pattern.
The Second Device
acquires image data representing the two-dimensional pattern from the imaging unit, and
acquires the network address based on the acquired image data.
According to the above-described configuration, it is possible to provide an information processing system capable of improving user convenience in communication connection between the first device and the second device.
According to the disclosure, it is possible to provide an information processing method, an information processing program, an information processing device, and an information processing system which are capable of improving user convenience in communication connection between devices.
Hereinafter, an embodiment will be described with reference to the accompanying drawings. First, an information processing system 6 according to the embodiment of the invention (hereinafter, simply referred to as “this embodiment”) will be described with reference to
In addition, it is assumed that a user U who carries the second device 2 and another user who is viewing the display unit 16 of the first device 1 exist in a closed space K (for example, a conference room or the like).
The kind of the first device 1 is not particularly limited, and all members which are connected to the communication network 4 by using a network address and are provided with a display unit, a processor, a memory, and a network interface become a target. For example, the first device 1 may be a personal computer, a smartphone, a tablet, or a projector. Further, the first device 1 may be a smart home appliance (for example, a smart television), a car navigation system that is mounted on a vehicle, or an office device (for example, a printer or a multifunction device).
Similarly, the kind of the second device 2 is not particularly limited, and all members which are connected to a communication network by using a network address and are provided with a processor, a memory, an imaging unit such as a camera, and a network interface become a target. For example, the second device 2 may be a personal computer, a smartphone, a tablet, or a wearable device (for example, a smart watch, an AR glass, or the like) worn on a user's body (for example, the arms, the head, or the like).
Next, a hardware configuration of the first device 1 (an example of the information processing device) will be described below with reference to
The control unit 10 is configured to control an operation of the first device 1, and includes a memory and a processor. The memory is configured to store a computer-readable command (for example, an information processing program). For example, the memory may be constituted by a read only memory (ROM) that stores various programs or the like, a random access memory (RAM) including a plurality work areas which store various programs or the like executed by a processor, and the like. In addition, the memory may be constituted by a flash memory or the like. For example, the processor includes at least one among a CPU, a micro processing unit (MPU), and a graphics processing unit (GPU). The CPU may be constituted by a plurality of CPU cores. The GPU may be constituted by a plurality of GPU cores. The processor may be configured to develop a program designated from various kinds of programs stored in the storage device 12 or the ROM onto the RAM, and to execute various kinds of processes in cooperation with the RAM. Particularly, when the processor executes an information processing program incorporated in the memory, the first device 1 is configured to execute the information processing method according to this embodiment.
For example, the storage device 12 is a storage device (storage) such as a hard disk drive (HDD), a solid state drive (SSD), and a flash memory, and is configured to store programs or various pieces of data. The information processing program according to this embodiment which is transmitted from a server on the Internet may be stored in the storage device 12.
The network interface 13 is configured to connect the first device 1 to the communication network 4. Specifically, the network interface 13 may include various kinds of wired connection terminals for establishing communication with an external device such as a server through the communication network 4. In addition, the network interface 13 may include various kinds of processing circuits, antennas, and the like for establishing communication with a radio router or a radio base station. For example, the standard of radio communication is Wi-Fi (registered trademark), Bluetooth (registered trademark), ZigBee (registered trademark), LPWA, or a fifth generation mobile communication system (5G).
The display unit 16 may be a display device such as a liquid crystal display, and an organic EL display. In addition, in a case where the first device 1 is a projector, the display unit 16 includes a screen, and an image projection unit configured to project an image (light) onto the screen.
The input operation unit 14 is configured to receive an input operation of a user who operates the first device 1, and to generate an instruction signal corresponding to the input operation. Examples of the input operation unit 14 include a touch panel that is disposed to be superimposed on the display unit 26, an operation button formed in a housing, and a mouse and/or a keyboard. After an instruction signal generated by the input operation unit 14 is transmitted to the control unit 10 through the bus 18, the control unit 10 executes a predetermined operation in correspondence with the instruction signal. The display unit 16 and the input operation unit 14 may be connected to the first device 1 through an input/output interface such as a USB.
Next, a hardware configuration of the second device 2 will be described below with reference to
The control unit 20 is configured to control an operation of the second device 2, and includes a memory and a processor. The memory is configured to store a computer-readable command. For example, the memory includes a ROM and a RAM. For example, the processor includes at least one among a CPU, an MPU, and a GPU. The processor may be configured to develop a program designated from various kinds of programs incorporated in the storage device 22 or the ROM onto the RAM, and to execute various kinds of processes in cooperation with the RAM.
For example, the storage device 22 is a storage device (storage) such as an HDD, an SSD, and a flash memory, and is configured to store a program or various pieces of data. The network interface 23 is configured to connect the second device 2 to the communication network 4. Specifically, the network interface 23 may include various kinds of wired connection terminals for establishing communication with an external device such as a server through the communication network 4. In addition, the network interface 23 may include various kinds of processing circuits, antennas, and the like for establishing communication with a radio router or a radio base station. An example of the standard of the radio communication is similar to the above-described standard.
The display unit 26 may be a display device such as a liquid crystal display and an organic EL display, or may be a head-mounted display mounted on the head of the user U. The input operation unit 24 is configured to receive an input operation of a user who operates the second device 2, and to generate an instruction signal corresponding to the input operation. Examples of the input operation unit 24 include a touch panel that is disposed to be superimposed on the display unit 26, an operation button formed in a housing, and a mouse and/or a keyboard.
Next, the information processing method according to this embodiment will be described below with reference to
Next, the control unit 10 generates a two-dimensional pattern associated with an IP address (for example, global IP address) of the first device 1 (step S2). Then, the control unit 10 causes the display unit 16 to display the generated two-dimensional pattern (step S3).
For example, the IP address of the first device 1 is an IP address (128 bits) corresponding to IPv6 displayed in 32 digits of a hexadecimal digit. The IP address may be generated on the basis of a public key of the first device 1 authenticated by an authentication station. Specifically, after generating a secret key (512 bits) of the first device 1 and a public key (256 bits) corresponding to the secret key, the control unit 10 generates a hash value (256 bits) on the basis of the public key and a predetermined hash function. In a case where the generated hash value satisfies a predetermined condition, the control unit 10 generates an IP address of the first device 1 on the basis of the hash value. Then, the first device 1 acquires a digital certificate associated with the public key from the authentication station. In this manner, since the public key of the first device 1 is authenticated by the authentication station, the IP address generated on the basis of the public key is also indirectly authenticated by the authentication station. In this embodiment, it is assumed that the IP address (128 bits) of the first device 1 is generated already. On the other hand, after the determination as detection of the predetermined action in step S1, the control unit 10 may generate the IP address of the first device 1.
In addition, the generated two-dimensional pattern includes at least information (128-bit information) relating to the IP address of the first device 1. In addition, the two-dimensional pattern may include information relating to the first device 1 other than the IP address. The two-dimensional pattern may be a one-dimensional bar code or a two-dimensional bar code (QR code (registered trademark)). For example, as illustrated in
In addition, as illustrated in
Returning to
Next, the control unit 20 transmits a signal (communication connection request signal) for making a request for communication connection with the first device 1 to the second device 2 through the communication network 4 (refer to
Then, after receiving the communication connection request signal from the second device 2 (step S8), the control unit 20 of the first device 1 executes a process of determining whether or not the second device 2 exists in the vicinity of the first device 1 (step S9). An example of the determination process in step S9 will be described below with reference to
As illustrated in
Note that, in step S23, when not receiving the user input information in a predetermined period (for example, in 60 seconds) after the one-time password 34 is displayed on the display unit 16, the control unit 10 may execute the process in step S27. Further, in a case where the determination result in step S24 is NO, the control unit 10 may cause the display unit 16 to display a content representing that the user input information and the one-time password 34 do not match each other, and may cause the display unit 16 to display a new one-time password (step S20). In this case, in a case where the determination result in step S24 becomes NO again, the control unit 10 may execute processes in steps S26 and S27.
In addition, as a second example of the determination process in step S9, the control unit 10 of the first device 1 may determine that the second device 2 exists in the vicinity of the first device 1 in correspondence with an input operation of the user U on the first device 1. Specifically, the control unit 10 causes the display unit 16 to display a message promoting pressing of a predetermined operation button of the first device 1. Then, in a case where the predetermined operation button is pressed in a predetermined period (for example, in 30 seconds), the control unit 10 may determine that the second device 2 exists in the vicinity of the first device 1. According to the second example, it is possible to determine whether or not the second device 2 exists in the vicinity of the first device 1 by a relatively simple method.
Further, as a third example of the determination process in step S9, the control unit 10 of the first device 1 may determine that the second device 2 exists in the vicinity of the first device 1 in correspondence with establishment of near field communication (NFC) between the first device 1 and the second device 2. Specifically, the control unit 10 causes the display unit 16 to display a message promoting touching on the second device 2 with an interface for NFC (hereinafter, referred to as “NFC interface”) of the first device 1. Then, in the case of detecting a touch action of the second device 2 on the NFC interface of the first device 1 in a predetermined period (for example, in 30 seconds), the control unit 10 may determine that the second device 2 exists in the vicinity of the first device 1. According to the third example, it is possible to determine whether or not the second device 2 exists in the vicinity of the first device 1 by a relatively simple method.
Next, returning to
Next, in step S14, the control unit 20 of the second device 2 transmits image data that is stored in a memory and represents a display screen displayed on the display unit 26 of the second device 2 to the first device 1 through the communication network 4 (refer to
According to this embodiment, after the two-dimensional pattern displayed on the display unit 16 of the first device 1 is imaged by the camera 25, the IP address of the first device 1 is automatically specified by the second device 2 from the image data representing the two-dimensional pattern imaged by the camera 25. In this manner, after grasping the IP address of the first device 1, it is not necessary for the user U to perform time-consuming work such as manual inputting of the IP address of the first device 1 to the second device 2. In this manner, convenience of the user U in communication connection between the first device 1 and the second device 2 may be improved.
Further, after the IP address of the first device 1 is automatically specified by the second device 2 from the image data imaged by the camera 25, the display screen 35 (refer to
In addition, in this embodiment, in a case where the second device 2 exists in the vicinity of the first device 1, communication connection between the first device 1 and the second device 2 is permitted. In this manner, a situation in which communication connection between the first device 1 and an external device existing at a location spaced apart from the first device 1 (particularly, not existing in the closed space K) is established may be appropriately prevented. In this regard, it is possible to determine whether or not the second device 2 exists in the vicinity of the first device 1 (particularly, whether or not the second device 2 exists in the space K) by using the one-time password 34 (refer to
Note that, in a series of processes illustrated in
Next, an information processing system 6a according to a first modification example of this embodiment will be described with reference to
According to this modification example, after a two-dimensional pattern displayed on the display unit 16 of the first device 1 is imaged by a camera of the second device 2a, the IP address of the first device 1 is automatically specified by the second device 2a from image data representing the two-dimensional pattern imaged by the camera. Further, the second device 2a is connected to the first device 1 in a communicable manner by using the specified IP address. Accordingly, as illustrated in
In this manner, a plurality of persons may share the display screen 35 of the second device 2a and the display screen 36 of the second device 2b through the display unit 16 in the closed space K. In this manner, a user U1 who carries the second device 2a may give a presentation to a plurality of persons by using the display screen 35 displayed on the display unit 16. In addition, a user U2 who carries the second device 2b may give a presentation to a plurality of persons by using the display screen 36 displayed on the display unit 16.
Note that, the information processing system 6a may include three or more second devices. In this case, divided regions in a number corresponding to the number of the second devices may be set in the display unit 16 of the first device 1.
Next, an information processing system 6b according to a second modification example of this embodiment will be described with reference to
According to this modification example, after a two-dimensional pattern displayed on the display unit 16 of the first device 1 is imaged by the camera of the second device 2, an IP address of the first device 1 is automatically specified by the second device 2 from image data representing the two-dimensional pattern imaged by the camera. Further, the second device 2 is connected to the first device 1 in a communicable manner by using the specified IP address. In this manner, it is possible to cause the display unit 16 of the first device 1 to display the display screen of the second device 2. Further, as illustrated in
As described above, the display screen 37 of the third device 8 that is not directly connected to the first device 1 may be displayed on the display unit 16. In addition, the display screen 37 of the third device 8 may be shared by a plurality of persons through the display unit 16 in the closed space K. In this manner, a user U who carries the third device 8 may give a presentation to the plurality of persons by using the display screen 37 displayed on the display unit 16.
In addition, in order to realize the first device 1 according to this embodiment by software, an information processing program may be incorporated in the storage device 12 or the ROM in advance. Similarly, in order to realize the second device 2 according to this embodiment by software, the information processing program may be incorporated in the storage device 22 or the ROM in advance. In addition, the information processing program may be stored in a computer-readable storage medium such as a magnetic disk (for example, an HDD and a floppy disk), an optical disc (for example, a CD-ROM, a DVD-ROM, and a Blu-ray (registered trademark) disc), a magneto-optical disc (for example, an MO), and a flash memory (for example, an SD card, a USB memory, and an SSD). In this case, the information processing program stored in the computer-readable storage medium may be incorporated in the storage device. Further, after the information processing program incorporated in the storage device is loaded on the RAM, a process may execute the information processing program loaded on the RAM. In this manner, the information processing method according to this embodiment is executed by the first device 1 (or the second device 2).
In addition, the information processing program may be downloaded from a server on a communication network such as the Internet through a network interface. Even in this case, similarly, the downloaded information processing program may be incorporated in the storage device.
While the embodiment of the invention has been described above, the technical scope of the invention should not be construed as being limited by description of this embodiment. This embodiment is illustrative only, and it should be understood by those skilled in the art that various modifications of the embodiment may be made within the scope of the invention described in the attached claims. The technical scope of the invention should be defined by the scope of the invention described in the attached claims and an equivalent range thereof.
In this embodiment, as an example of the network address of the first device 1 and the second device 2, the IP address that is a network address corresponding to an internet protocol has been described, but the network address is not limited to the IP address. For example, the network address of the first device 1 and the second device 2 may be a network address corresponding to a predetermined communication protocol other than the Internet protocol.
In addition, in this embodiment, the first device 1 and the second device 2 are connected to each other in a communicable manner through the communication network 4, but the first device 1 and the second device 2 may be connected to each other in a communicable manner without through the communication network 4. For example, the first device 1 and the second device 2 may be connected to each other in a communicable manner in an ad hoc mode, or may be connected to each other in a communicable manner through an access point that is not connected to the communication network.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/JP2018/042157 | 11/14/2018 | WO | 00 |
