This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2017-141817, filed on Jul. 21, 2017, in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.
The present disclosure relates to a device, an information processing system, and a method for controlling an interactive operation of the device.
Currently, many devices including personal computers (PCs) are connected via a network such as the Internet. Further, not only the Internet communications but also network services called clouds, web services, and Application Service Providers (ASP) are expanding. The Internet of Things (IoT) is also known, which connects things including devices other than the personal computers to the Internet.
With application of the IoT communication network, not only computers and computer networks but also everyday things can be readable, recognizable, position-identifiable, addressable and controllable.
Embodiments of the present disclosure described herein provide a device, an information processing system, and a method for controlling an interactive operation of the device. The device is connected to at least one other device via a network and includes circuitry configured to transmit interaction information related to interactive operation of a local device to the at least one other device via the network, receive interaction information related to interactive operation of the at least one other device via the network, store a first rule that associates the interactive operation of the at least one other device with the interactive operation of the local device to be executed by the local device, and control the interactive operation of the local device based on the stored first rule. The information processing system includes at least one device including the device and the at least one other device. The method includes receiving interaction information related to interactive operation of the at least one other device via the network, storing a first rule which associates the interactive operation of the at least one other device with the interactive operation of the local device to be executed by the local device, and controlling the device to execute the interactive operation based on the stored first rule.
A more complete appreciation of the disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings.
The accompanying drawings are intended to depict embodiments of the present invention and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted.
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the present invention. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “includes” and/or “including”, when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.
The network 14 is a segment of network such as a subnetwork, where data can be transmitted by a broadcast transmission. The data that is broadcasted by one of the IoT devices 10 connected to the network 14 reaches all the IoT devices 10 and the PC 12 connected to the network 14 and is not transmitted to other networks connected, for example, via a router. As described above, the subnetwork is an example of a predetermined management unit of network.
In response to detection of an event indicating specific operation such as power-on of the IoT device, which may be referred to as interactive operation, the IoT device 10 broadcasts information related to such detected event of the IoT device, as interaction information. The IoT device 10 executes interactive operation as defined by interaction information according to a predetermined rule in response to reception of the interaction information broadcasted from the other IoT devices 10. A detailed description of the rule will be given later.
The interactive operation is not limited to the interactive operation which causes the other IoT devices 10 to execute the interactive operation, such as an event giving an instruction to the other IoT devices 10 or an event requesting responses from the other IoT devices 10. The interaction information is broadcasted to the other IoT device 10 for simple operation such as power-on or autonomous operation.
The PC 12 is an example of the information processing apparatus that allows a user to set up the rule and transmits the rule to the IoT device 10 to which the rule is to be applied. The rule can be set up using the IoT device 10 such as the MFP 10D which has a user interface (UI). For example, the PC 12 or the IoT device 10 that has a UI may obtain functional information of the IoT device 10 that is connected to the network 14 and may allow the user to set up the rule considering the functions of the IoT device 10. Note that the IoT device 10 in
The IoT device 10 broadcasts the interaction information unconditionally to the other IoT devices 10 when the interactive operation occurs. Each one of the other IoT devices 10 connected to the same network 14 determines whether to execute interactive operation in response to the interaction information in accordance with the rule as will be described later.
As described above, in the information processing system 1 according to the present embodiment, interactive operation (such as an event) that occurred in one IoT device 10 causes the other IoT device 10 connected to the same network 14 to execute interactive operation according to interaction information transmitted from the one IoT device 10.
The term IoT device in the present embodiment refers to the device connected to the network 14 to implement the Internet of Things (IoT). In the present embodiment, the lighting 10A, the projector 10B, the air conditioner 10C, the MFP 10D, the electronic whiteboard 10E, and the video conference system 10 OF, are referred to as the examples of the IoT device 10, but the IoT device 10 is not limited to these examples and includes various devices such as a refrigerator, a television set, or a vending machine.
<Hardware Configuration>
The IoT device 10 in
The controller 601 includes a central processing unit (CPU) 611, a random access memory (RAM) 612, a read only memory (ROM) 613, a non-volatile random access memory (NVRAM) 614, and a hard disk drive (HDD) 615. The ROM 613 stores various programs and data. The RAM 612 stores programs and data temporarily. The NVRAM 614 stores data such as setting information. The HDD 615 stores various programs and data.
The CPU 611 implements the controls or functions of the entirety of the MFP 10D by performing processing according to the programs, data, setting information or the like that are read from a storage device such as the ROM 613, the NVRAM 614, and the HDD 615, and loaded into the RAM 612.
The external I/F 603 is an interface device with an external device. Examples of the external device include the operation panel 621, the storage medium 622, and the IC card reader 623. The MFP 10D communicates with the operation panel 621 and the IC card reader 623 via the external I/F 603. The operation panel 621 includes an input device that accepts input from a user, and a display that displays various types of information.
The MFP 10D reads or writes data from or to the storage medium 622 via external I/F 603. Examples of the storage medium 622 include an integrated circuit (IC) card, a floppy disk, a compact disk (CD), a digital versatile disk (DVD), a secure digital (SD) memory card, a universal serial bus (USB) memory, and a subscriber identification module (SIM) card.
The communication I/F 604 is an interface device to connect the MFP 10D to the network 14. The MFP 10D performs data communication via the communication I/F 604.
The printer 605 is a printing device that forms an image on an object to be conveyed in accordance with print data. Examples of the conveyed medium include paper, coated paper, thick paper, overhead projector (OHP) transparencies, plastic films, prepreg, and copper foil. The scanner 606 is a reading device that scans a document to obtain image data (electronic data).
<Functional Configuration>
The functional configuration of the information processing system 1 according to the present embodiment is explained below. A description of functional configuration that is not relevant to the present embodiment is omitted below as appropriate.
The IoT device 10 according to the present embodiment is implemented by functional blocks as illustrated in
The IoT device 10 of
The interaction process unit 21 executes interactive operation (i.e., the event) of the IoT device 10. For example, the interaction process unit 21 of the lighting 10A executes interactive operation such as “turn the lighting on with 50% brightness”. For another example, the interaction process unit 21 of the air conditioner 10C executes interactive operation such as “turn up the air conditioner”.
The interaction information transmission unit 22 broadcasts the interaction information relevant to the interactive operation executed by the interaction process unit 21.
A detailed description is given later of the interaction information. The interaction information reception unit 23 receives the interaction information broadcasted by the other IoT devices 10.
In response to reception of the interaction information from the interaction information reception unit 23, the control unit 24 refers to the rules stored in the rule storage unit 26 and when any rule that matches the received interaction information is found in the stored rules, executes the interactive operation according to the rule. A detailed description of the rule will be given later. A detailed description of the processes of the control unit 24 will be given later. The rule input unit 25 allows the user to set up and store the rule in the rule storage unit 26. For example, the rule input unit 25 displays a rule setup screen to the user and allows the user to input a new rule via the rule setup screen.
The IoT device 10 in
The term “primary or secondary” indicates whether the interaction information is the primary interaction information or the secondary interaction information. The “primary interaction information” indicates that the interaction information is of the primary interactive operation which is the interactive operation executed without receiving the interaction information from the other IoT device 10. The “secondary interaction information” indicates that the interaction information is of the secondary interactive operation which is the interactive operation executed by receiving the interaction information from the other IoT device 10.
The term “type of the interaction source device” indicates the type of IoT device 10 that transmitted the interaction information. The term “operation by the source device” indicates the interactive operation executed by the IoT device 10 that transmitted the interaction information. The term “operation by the local device” indicates the interactive operation to be performed by the IoT device itself, according to whether the received interaction information is primary or secondary, the type of the interaction source device, and the interactive operation executed by the source device.
For example,
Note that the rule with the same type of the interaction source device and the same interactive operation by the source device can be set up, when the interaction information is primary or secondary is different, or when the operation by the local device is different, although example is not given in
<Operation>
The information processing system 1 according to the present embodiment displays on the IoT device 10 equipped with the UI such as the MFP 10D or the PC 12, the rule setup screen such as illustrated in
To indicate that the rule is successfully registered, the rule input unit 25 or 31 displays a message on the rule setup screen as illustrated in
As described above, the IoT device 10 that is connected to the network 14 broadcasts the interactive operation executed by the interaction process unit 21 as the interaction information to the other IoT device 10 connected to the network 14. The interaction information transmission unit 22 skips the step 12 when no operation is detected on the local IoT device 10.
In the step S13, the interaction information reception unit 23 of the IoT device 10 determines whether interaction information is received from the other IoT device 10 using the broadcast transmission. In the step S14, in response to the interaction information from the other IoT device 10 received by the interaction information reception unit 23, the control unit 24 determines whether applicable rule exists.
The step S14 is the process to read the rules stored in the rule storage unit 26 and determine whether the rule applicable to the interaction information that the interaction information reception unit 23 received from the other IoT device 10 exists. The existence of the applicable rule for the interaction information received from the other IoT device 10 is determined by the existence of the rule applicable to the received interaction information in the rule storage unit 26.
When the control unit 24 determines that the applicable rule for the interaction information received from the other IoT device 10 exists in the step S15, the control unit 24 proceeds to the step S16 and controls the local device to execute the interactive operation specified in the rule. The interaction process unit 21 executes the interactive operation by the local device specified in the applicable rule.
In the step 17, the interaction information transmission unit 22 broadcasts the interaction operation performed by the interaction process unit 21 in the step S16 as the secondary interaction information, and then returns to the step 11. The process also returns to the step S11 when the interaction information reception unit 23 does not receive any interaction information from the other IoT device 10 in the step S13 or when no applicable rule is found in the step S15.
As described above, the IoT device 10 that is connected to the network 14 broadcasts the secondary interaction information after executing the interactive operation by the local device as specified in the applicable rule.
In the step S51, the projector 10B is turned on by the user. In the step S52, the interaction information transmission unit 22 of the projector 10B broadcasts the primary interaction information. The primary interaction information broadcasted in the step S52 includes the information indicating that the interaction information is the primary information, the information indicating that the interaction information is from the projector, and the information indicating that the projector is turned on.
The lighting 10A, the air conditioner 10C, and the MFP 10D receive the primary interaction information broadcasted from the projector 10B and determine the existence of the applicable rule in the step S53, and execute the interactive operation in the step S54. Note also that the determination of applicable rule in step 53 corresponds to the step S14 in
As
In the step 55 to the step S57, the lighting 10A, the air conditioner 10C, and the MFP 10D broadcast the interactive operation executed by the interaction process unit 21 in the step S54 as the secondary interaction information. Each of the lighting 10A, the projector 10B, the air conditioner 10C, and the MFP 10D determines the existence of the applicable rule as indicated in the step 53, and executes the interactive operation as described in the step S54 in response to the secondary interaction information.
The above-described embodiments are illustrative and do not limit the present disclosure. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present disclosure.
Each of the functions of the described embodiments may be implemented by one or more processing circuits or circuitry. Processing circuitry includes a programmed processor, as a processor includes circuitry. A processing circuit also includes devices such as an application specific integrated circuit (ASIC), digital signal processor (DSP), field programmable gate array (FPGA), and conventional circuit components arranged to perform the recited functions.
The present invention can be implemented in any convenient form, for example using dedicated hardware, or a mixture of dedicated hardware and software. The present invention may be implemented as computer software implemented by one or more networked processing apparatuses. The network can comprise any conventional terrestrial or wireless communications network, such as the Internet. The processing apparatuses can compromise any suitably programmed apparatuses such as a general purpose computer, a personal digital assistant, a mobile telephone (such as a WAP or 3G-compliant phone) and so on. Since the present invention can be implemented as software, each and every aspect of the present invention thus encompasses computer software implementable on a programmable device. The computer software can be provided to the programmable device using any storage medium for storing processor readable code such as a floppy disk, a hard disk, a compact disk read only memory (CD ROM), a magnetic tape device or a solid state memory device.
The hardware platform includes any desired kind of hardware resources including, for example, a central processing unit (CPU), a random access memory (RAM), and a hard disk drive (HDD). The CPU may be implemented by any desired kind of any desired number of processor. The RAM may be implemented by any desired kind of volatile or non-volatile memory. The HDD may be implemented by any desired kind of non-volatile memory capable of storing a large amount of data. The hardware resources may additionally include an input device, an output device, or a network device, depending on the type of the apparatus.
Alternatively, the HDD may be provided outside of the apparatus as long as the HDD is accessible. In this example, the CPU, such as a cache memory of the CPU, and the RAM may function as a physical memory or a primary memory of the apparatus, while the HDD may function as a secondary memory of the apparatus.
Number | Date | Country | Kind |
---|---|---|---|
2017-141817 | Jul 2017 | JP | national |