The present disclosure relates to an information providing method.
In recent years it has become possible to collect a large amount of sensor data from sensors placed in various places, and thus there is a demand to effectively use the collected sensor data, For example, if sensor data from various sensors placed in an indoor space such as a house is used, it is possible to provide services suitable to the user's situation (for example, see Japanese Patent Application Publication No. 2018-32272).
However, with the conventional art, there is little information that is related to how to use the sensor data, and it is therefore difficult to effectively use the sensor data for providing services.
The present disclosure provides, for example, an information providing method that can effectively use sensor data for providing services.
An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. An information device and a sensor are disposed in a home. The processor: obtains, from the memory, first content information output by the information device in the past; obtains, via the sensor, second content information currently being output by the information device; when (i) a type of content of the first content information and a type of content of the second content information are a same type of content, generates first information indicating that a user is interested in the type of content corresponding to the first content information and the second content information; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.
An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. An information device and a sensor are disposed in a home. The processor: obtains, from the memory, first content information output by the information device in a first past period; obtains, from the memory, second content information output by the information device in a second past period closer to a current time than the first past period; obtains, from the memory, information indicating a bedtime indicating a time the user went to bed in the past; obtains current device activity information for the information device; when (ii) a type of content of the second content information is different than a type of content of the first content information, (iii) the current device activity information indicates that the information device is inactive, and (iv) an amount of time from the current time to the bedtime is a given amount of time or longer, generates first information indicating that the user viewed content yesterday that is different in type than past content and that there is the given amount of time or longer before the bedtime of the user; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.
An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A first electronic device and a first sensor are disposed in a dining space of a home. The processor: obtains sensing information corresponding to a given period of time in the dining space via the first sensor; when (v) the sensing information from the dining space includes an active period of time in the dining space indicating at least one of a user being present in the dining space or the first electronic device being active and (vi) the sensing information from the dining space includes, after the active period of time in the dining space, an inactive period of time in the dining space that is a threshold amount of time or longer and indicates at least one of the user being absent in the dining space or the first electronic device being inactive, generates the first information indicating that an eating-related activity by the user in the dining space is completed; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.
An information providing method according to one aspect of the present disclosure is a method that uses a first information processing apparatus which includes a processor and memory. A first electronic device and a first sensor are disposed in a first space including at least one of a dining space or a lavatory space of a home. A second electronic device and a second sensor are disposed in a second space including an entrance space of the home. The processor: obtains, from the memory, past first sensing statistical information corresponding to the first space; obtains current first sensing information corresponding to the first space via the first sensor; obtains, from the memory, past second sensing statistical information corresponding to the second space; when (ix) a difference between a first time and a second time is a threshold amount of time or less and (x) a current time is equal to or earlier than a third time, generates first information indicating that it is almost a time that the user usually leaves the home, the first time being included in the current first sensing information and indicating at least one of the user being present in the first space or the first electronic device being active, the second time being included in the past first sensing statistical information and indicating at least one of the user being present in the first space or the first electronic device being active, and the third time being included in the past second sensing statistical information and indicating at least one of the user being present in the second space or the second electronic device being active; obtains, from a second information processing apparatus connected to the first information processing apparatus, information indicating first request content over a network; and when content of the first information is included in the first request content, outputs, to the second information processing apparatus, second information including information for identifying the user or the home, using the first information generated.
General and specific aspect(s) disclosed above may be implemented using a system, an apparatus, an integrated circuit, a computer program, or a computer-readable recording medium such as a CD-ROM, or any combination thereof.
Additional benefits and advantages of the disclosed embodiments will be apparent from the Specification and Drawings. The benefits and/or advantages may be individually obtained by the various embodiments and features of the Specification and Drawings, which need not all be provided in order to obtain one or more of such benefits and/or advantages.
The information providing method according to one aspect of the present disclosure can effectively use sensor data for providing services.
These and other advantages and features will become apparent from the following description thereof taken in conjunction with the accompanying Drawings, by way of non-limiting examples of embodiments disclosed herein.
Hereinafter, embodiments are specifically described with reference to the drawings.
Each of the following embodiments describes a general or specific example. The numerical values, shapes, materials, elements, the arrangement and connection of the elements, steps, order of the steps, etc., shown in the following embodiments are mere examples, and therefore do not limit the scope of the claims.
The figures are not necessarily precise illustrations. In the figures, elements that are essentially the same share like reference signs. Accordingly, duplicate description thereof is omitted or simplified.
First, an overview of service providing system 10 will be described with reference to
In service providing system 10 according to the present embodiment, sensor data from a plurality of indoor spaces is collected by a cloud server. Examples of an indoor space include a home, an office, a building, and the inside of a vehicle. Sensor data is data based on usual activity and/or unusual activity of a user in an indoor space.
Via an application programming interface (API), each of a plurality of service providers is capable of obtaining various information based on sensor data collected by the cloud server. An API is an information processing function of a cloud server that can be called from a computer and used.
Each service provider provides a service to a user based on information obtained via the API. Examples of services include an information providing service, an advertisement delivery service, a service for automated control of devices on a home network, or any combination thereof. Note that the service is not limited to these examples. For example, the service may be a product delivery service.
Next, the configuration of service providing system 10 will be described with reference to
Sensor group 300 is disposed in space 20, and includes at least one sensor. Sensor group 300 is connected to a communications network such as the internet via gateway 500. Note that gateway 500 is optional; sensor group 300 may be connected to a communications network without passing through gateway 500.
Sensor group 300 outputs a sensor value indicating, for example, movement information related to a movement of a user or information related to activity/user operation of device group 400. For example, sensor group 300 can output a sensor value indicating whether a luminaire is emitting light, a sensor value indicating whether an audio device is outputting sound, a sensor value indicating whether a user is present in space 20 or a predefined region of space 20, or any combination thereof.
Sensor group 300 can include, for example, a notion sensor, a door sensor, a sound sensor, or any combination thereof. Such sensors included in sensor group 300 can be realized as, for example, an image sensor, an infrared sensor, an ultrasound sensor, a visible light sensor, a vibration sensor, a touch sensor, a microphone, or any combination thereof. Such sensors can be provided on a wall, floor, or ceiling that defines space 20, or on an electronic device or furniture disposed in space 20. Moreover, the sensors may be provided in devices included in device group 400. For example, one sensor may be a touch sensor provided in the touch screen of a smartphone or the like. Note that the sensors are not limited to the above examples.
Device group 400 is disposed in space 20, and includes at least one electronic device. Device group 400 is connected to a communications network such as the internet via gateway 500. Note that gateway 500 is optional; device group 400 may be connected to a communications network without passing through gateway 500.
Device group 400 can include, for example, a display panel, a luminaire, an audio device, a refrigerator, a vacuum cleaner, or any combination thereof. Note that the one or more devices included in device group 400 are not limited to these examples.
First information processing apparatus 100 is disposed outside of space 20 and includes a processor and memory. For example, first information processing apparatus 100 corresponds to the cloud server illustrated in
Note that a cloud server refers to a server that is provided over the internet. An edge server refers to a server that is provided over a network in an area closer to the user than the internet is (such as a local area network (LAN)).
Second information processing apparatus 200 includes a processor and memory. For example, second information processing apparatus 200 is the service provider illustrated in
This example assumes that service providing system 10 illustrated in
Next, the functional configuration of first information processing apparatus 100 will be described with reference to
As illustrated in
Sensor data obtainer 101 obtains first sensor data including a first sensor value from sensor group 300. Part or all of first sensor data is stored in first memory 103. First sensor data may include data indicating whether a person is present in a given region in space 20, for example. First sensor data may include data indicating a state of sound output of an audio device, for example. First sensor data may include data indicating an operation state of a device. First sensor data may include data indicating whether a door of a refrigerator is open or closed.
First memory 103 stores part or all of the first sensor data obtained by sensor data obtainer 101.
Determiner 104 determines whether a first condition is satisfied or not. The first condition will be described in greater detail later.
Second memory 105 stores information for generating the first information. For example, second memory 105 stores a correspondence table in which content of the generated information is associated with mutually different conditions.
First information generator 106 generates first information when the first condition is satisfied. In the present embodiment, the first information indicates that the user is interested in a specific type of content, but the first information is not limited to this example.
Third memory 107 stores information for generating second information. In other words, third memory 107 stores information for identifying the user or space 20 corresponding to the first information generated by first information generator 106.
Second information generator 108 determines whether content of the first information is included in first request content included in information obtained from second information processing apparatus 200 via inputter/outputter 109. When content of the first information is included in the first request content, second information generator 108 generates the second information using the first information. The second information includes information for identifying the user or space 20 (for example, a user ID, a home address, an IP address, device identification information, etc.). For example, second information generator 108 generates the second information by reading, from third memory 107, information for identifying the user or space 20 corresponding to the first information generated by first information generator 106. Here, the second information may be information required for providing a service to the user or space 20. When content of the service to be provided is included in the first request, the second information corresponding to the content of the service may be provided. In a case in which the service is to be provided using a communications environment, one example of the second information is an IP address. In a case in which the service to be provided is for controlling a device, one example of the second information is device identification information. In a case in which the service to be provided is for controlling a device using a communications environment, one example of second information may be a combination of an IP address and device identification information.
Inputter/outputter 109 obtains information indicating the first request content (hereinafter “first request information”) from second information processing apparatus 200 connected to first information processing apparatus 100 over a network. Inputter/outputter 109 further outputs the second information generated by second information generator 108 to second information processing apparatus 200.
Note that determiner 104, first information generator 106, and second information generator 108 described above are realized as, for example, a processor and memory. When an instruction or a software program that is stored in the memory is executed, the processor functions as determiner 104, first information generator 106, and second information generator 108. Determiner 104, first information generator 106, and second information generator 108 may be realized as dedicated electronic circuitry.
First memory 103, second memory 105, and third memory 107 described above are realized as, for example, semiconductor memory and/or a disk drive or the like. Inputter/outputter 109 is realized as, for example, a network interface controller (NIC) or the like.
Next, the functional configuration of second information processing apparatus 200 will be described with reference to
As illustrated in
Fourth memory 201 stores information for generating the first request information.
Request generator 202 generates the first request information. More specifically, request generator 202 references information stored in fourth memory 201 to generate the first request information indicating the first request content.
The first request content indicates requirements that a user or space to which a given service is provided should meet. In the present embodiment, the first request content indicates a requirement that the user be interested in a specific type of content, but the first request content is not limited to this example.
Inputter/outputter 203 outputs the first request information generated by request generator 202 to first information processing apparatus 100. Inputter/outputter 203 further obtains the second information from first information processing apparatus 100.
Fifth memory 204 stores information for generating service information. For example, fifth memory 204 stores a correspondence table in which service content is associated with mutually different request content.
Service generator 205 generates first service information using the second information. The first service information is information for providing a service to the user in space 20 via device group 400.
In the present embodiment, the first service information is, for example, control information for causing a display panel to display information related to a specific type of content. Note that the first service information is not limited to this example.
Note that “service information” may also be referred to as “service content”. Service content includes service information such as music or advertisement information, and device control information for providing the service.
Outputter 206 references the second information and outputs the service information generated by service generator 205 to device group 400. Note that second information processing apparatus 200 may include memory for recording the association between information corresponding to the second information and information required for providing the service, obtain information required for providing the service by referencing the second information, and provide the service to the user or space 20.
Request generator 202 and service generator 205 described above are realized as, for example, a processor and memory. When an instruction or a software program that is stored in the memory is executed, the processor functions as request generator 202 and service generator 205. Request generator 202 and service generator 205 may be realized as dedicated electronic circuitry.
Fourth memory 201 and fifth memory 204 described above are realized as, for example, semiconductor memory and/or a disk drive or the like. Inputter/outputter 203 and outputter 206 are realized as, for example, a network interface controller (NIC) or the like.
Next, interaction in service providing system 10 will be described with reference to
As illustrated in
Here, if first information processing apparatus 100 obtains the first request information from second information processing apparatus 200 (S111), first information processing apparatus 100 determines whether there is a user or space that satisfies the first request content (S112). If first information processing apparatus 100 determines that there is a user or space that satisfies the first request content, first information processing apparatus 100 generates the second information (S113). First information processing apparatus 100 then outputs the generated second information to second information processing apparatus 200 (S114).
Second information processing apparatus 200 generates the first service information based on the second information (S121). The first service information is information for providing a first service to the user in space 20 via device group 400. Second information processing apparatus 200 then outputs the first service information to device group 400 (S122).
Note that the sequence diagram illustrated in
Next, processes performed by first information processing apparatus 100 (i.e., the information providing method) will be described in greater detail with reference to
As illustrated in
If the first condition is satisfied (Yes in S102), first information generator 106 generates the first information (S103). If the first condition is not satisfied (No in S102), first information generator 106 skips the process for generating the first information, that is to say, first information generator 106 does not generate the first information.
Next, inputter/outputter 109 obtains the first request information indicating the first request content from second information processing apparatus 200 (S111). Second information generator 108 determines whether there is a user or space that matches the first request content (S112). In other words, second information generator 108 determines whether the first request content includes the content of the first information or not.
When second information generator 108 determines that there is a user or space that matches the first request content (Yes in S112), second information generator 108 generates the second information using the generated first information (S113). Inputter/outputter 203 then outputs the generated second information to second information processing apparatus 200 (S114). When second information generator 108 determines that there is not a user or space that matches the first request content (No in S112), second information generator 108 skips the processes for generating and outputting the second information. In other words, second information generator 108 does not generate and output the second information.
In the present embodiment, the first condition includes at least (i) described below.
The first content information indicates an image, video, sound, or text output by an information device in the past, or any combination thereof. The second content information indicates an image, video, sound, or text currently being output by the information device, or any combination thereof. For example, a television receiver, radio receiver, set-top box, smartphone, or tablet computer or the like can be used as the information device that outputs the first and second content information.
The “type” of content information is also referred to as “genre”, and represents the category of the content information. For example, “news”, “sports”, and “movie” and the like can be used as the type of content information.
If (i) described above is satisfied, it is estimated that the user is interested in the type of content of the first and second content information.
Next, the determination process for such a first condition (S102 in
First, determiner 104 determines whether the first content information output by the information device in the past and the second content information currently being output by the information device are the same type of content (S1021). Stated differently, determiner 104 determines whether (i) described above is satisfied or not.
For example, the type of the first content information is obtained from first memory 103. In such cases, information indicating the type of content information output by the information device in the past is stored in first memory 103. For example, the type of the second content information is obtained from a sensor included in sensor group 300 or the information device included in device group 400.
When the first content information and the second content information are the same type of content information (Yes in S1021), determiner 104 determines that the first condition is satisfied (S1026). However, when the first content information and the second content information are not the same type of content information (No in S1021), determiner 104 determines that the first condition is not satisfied (S1027).
Note that the determination process for the first condition illustrated in
As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. An information device and a sensor are disposed in a home. The processor can obtain, from the memory, first content information output by the information device in the past; obtain, via the sensor, second content information currently being output by the information device; when (i) a type of content of the first content information and a type of content of the second content information are a same type of content, generate first information indicating that a user is interested in the type of content corresponding to the first content information and the second content information; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or the home, using the first information generated.
This makes it possible to determine whether the user is interested in a specific type of content, based on the type of content information output in the past and the type of content information currently being output. By outputting information for identifying the user or home to the service provider or the like, the service provider or the like can provide services suited to the user. It is therefore possible to effectively use sensor data to provide services.
Next, Embodiment 2 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that the user viewed content yesterday that is different in type from past content and there is a given amount of time or longer before the user's bedtime, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.
Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.
In the present embodiment, the first condition includes at least (ii) through (iv) described below.
In the present embodiment, the first content information indicates an image, video, sound, or text output by an information device in a first past period, or any combination thereof. The second content information indicates an image, video, sound, or text output by an information device in a second past period closer to the current time than the first past period, or any combination thereof.
The “type” of content information is also referred to as “genre”, and represents the category of the content information. For example, “news”, “sports”, and “movie” and the like can be used as the type of content information.
For example, a given span of time in the past, on or before the day before yesterday, can be used as the first past period, and a given span of time in the past, on or before yesterday, can be used as the second past period. Examples of a given span of time in the past that is on or before the day before yesterday include the day before yesterday, one week up to the day before yesterday, and one month up to the day before yesterday. Examples of a given span of time in the past that is on or before yesterday include yesterday, one week up to yesterday, and one month up to yesterday.
Note that a period from a point in time after the most current point in time included in the first past period, up to the current time, may be used as the second past period. Moreover, the first and second past periods may overlap so long as the overlapping period does not exceed a given proportion. One example of the given proportion is 50%. Moreover, the length of the first past period may be the same as the length of the second past period, and, alternatively, may be longer than the length of the second past period.
In addition to (ii) through (iv) described above, the first condition may include the following stipulation.
For example, the profile information is input in advance by the user and stored in first memory 103. The given personality trait is not particularly limited, and may be, for example, a personality trait indicating a tendency to follow the latest trends (informally commonly referred to as a “hipster”).
If at least (ii) through (iv) described above are satisfied, it is estimated that the user viewed content yesterday that is different in type from past content and there is a given amount of time or longer before the user's bedtime.
Next, the determination process for such a first condition (S102 in
First, determiner 104 determines whether the first content information output by the information device in the first past period and the second content information output by the information device in the second past period are the same type of content information (S2021). Stated differently, determiner 104 determines whether (ii) described above is satisfied or not.
For example, the type of the first and second content information is obtained from first memory 103. In such cases, information indicating the type of content information output by the information device in the past is stored in first memory 103.
When the first content information and the second content information are different types of content information (Yes in S2021), determiner 104 determines whether the amount of time from the current time to the user's bedtime is a given amount of time or longer (S2022).
Here, the bedtime is a statistical bedtime based on the user's past bedtime data. Next, the statistical bedtime will be described in greater detail with reference to
The bedtimes illustrated in
Using the above-described daily bedtimes, a statistical value (for example, the average value or the mean value) of bedtimes over a given span of time in the past (for example, a week, a month, or three months back from the current day, or the same month from last year) is calculated as the statistical bedtime.
The given span of time for determining the bedtime statistical value need not be limited in particular, and may be a period of an empirically or experimentally predefined length. Statistical bedtimes calculated as described above are stored in first memory 103.
Outlier values may be removed from the population when the statistical bedtimes are calculated. An outlier value can be calculated using, for example, a known statistics method. Furthermore, bedtimes corresponding to weekdays or holidays may be removed from the population when the statistical bedtimes are calculated.
As used herein, the term “current” is not limited to the precise current time, but includes times that would usually be considered to be essentially the current time. For example, the current time as defined by a system (commonly referred to as the system time) may be used as the “current time”.
When the amount of time from the current time to the user's bedtime is the given amount of time or longer (Yes in S2022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in
However, when the first content information and the second content information are the same type of content information (No in S2021), or the amount of time from the current time to the user's bedtime is less than the given amount of time (No in S2022), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in
For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).
Here, as the first service, second information processing apparatus 200 can cause the display panel to display, for example, information related to the second content information. For example, when the second content information is a news program, second information processing apparatus 200 can cause the display panel to display, for example, follow-up information to a news story reported in the second content information. In such cases, a notification indicating “a follow up to yesterday's news story” may be sent to the user. This allows the service provider to provide the user, who uncommonly watched a news program yesterday, with follow-up information to a news story reported in the news program, using the time up until the user's bedtime.
As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. An information device and a sensor are disposed in a home. The processor can: obtain, from the memory, first content information output by the information device in a first past period; obtain, from the memory, second content information output by the information device in a second past period closer to a current time than the first past period; obtain, from the memory, information indicating a bedtime indicating a time the user went to bed in the past; obtain current device activity information for the information device; when (ii) a type of content of the second content information is different than a type of content of the first content information, (iii) the current device activity information indicates that the information device is inactive, and (iv) an amount of time from the current time to the bedtime is a given amount of time or longer, generate first information indicating that the user viewed content yesterday that is different in type than past content and that there is the given amount of time or longer before the bedtime of the user; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or the home, using the first information generated.
This makes it possible to determine that the user watched content in the second past period that is different in type from the first past period and there is a given amount of time or longer before the user's bedtime, based on the difference in the type of content information output from the information device n the past and past bedtime information. Accordingly, it is possible to output information for identifying a user or home that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or home. It is therefore possible to effectively use sensor data to provide services.
Next, Embodiment 3 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that an eating-related activity by the user in the dining space is completed, and that a different first condition is used to generate such first information, The present embodiment will be described with focus on the differences from Embodiment 1.
Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.
In the present embodiment, the first condition includes at least (v) and (vi) described below.
The first condition may further include (vii) and (viii) described below.
The sensing information from the kitchen space is sensor data obtained during a given period of time by a sensor disposed in the kitchen space, or is information obtained by processing such sensor data.
The sensing information from the dining space is sensor data obtained during a given period of time by a sensor disposed in the dining space, or is information obtained by processing such sensor data.
Note that the given period of time is a period of time of a predefined length (for example, two hours) from a point in the past to the current time.
If at least (v) and (vi) described above are satisfied, it is estimated that the eating-related activity by the user in the dining space is completed.
Next, the determination process for such a first condition (S102 in
First, determiner 104 determines whether the sensing information from the kitchen space includes the kitchen active period of time (S3021). In other words, determiner 104 determines whether (vii) described above is satisfied or not.
When the sensing information from the kitchen space includes the kitchen active period of time (Yes in S3021), determiner 104 determines whether the sensing information from the kitchen space includes a kitchen inactive period of time of a threshold amount of time or longer after the kitchen active period of time (S3022). In other words, determiner 104 determines whether (viii) described above is satisfied or not.
When the sensing information from the kitchen space includes such a kitchen inactive period of time (Yes in S3022), determiner 104 determines whether the sensing information from the dining space includes a dining active period of time after the kitchen active period of time (S3023). In other words, determiner 104 determines whether (v) described above is satisfied or not.
When the sensing information from the dining space includes such a dining active period of time (Yes in S3023), determiner 104 determines whether the sensing information from the dining space includes a dining inactive period of time of a threshold amount of time or longer after the dining active period of time and (S3024). In other words, determiner 104 determines whether (vi) described above is satisfied or not.
When the sensing information from the dining space includes such a dining inactive period of time (Yes in S3024), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in
On the other hand, when the sensing information from the kitchen space does not include the kitchen active period of time (No in S3021), the sensing information from the kitchen space does not include the kitchen inactive period of time (No in S3022), the sensing information from the dining space does not include the dining active period of time (No in S3023), or the sensing information from the dining space does not include the dining inactive period of time (No in S3024), determiner 104 determines that the first condition is not satisfied (S1027). As a result, step S103 in
Next, specific examples of the sensing information from the kitchen space and the dining space will be given with reference to
The electronic device is included in device group 400 and is disposed in the kitchen space and/or the dining space. Examples of the electronic device include a luminaire and a cooking appliance (for example, an induction cooktop, gas cooktop, a microwave oven, a rice cooker, or a coffee maker or the like).
For example, when the given period is a period of two hours counting back from the current time, determiner 104 determines whether an active period (a double-headed arrow) is included in the two-hour period. When the two-hour period does include an active period, determiner 104 further determines whether an inactive period (no arrow) of a given amount of time (for example, 10 minutes) follows the active period.
The given amount of time is a period of time for excluding temporary interruptions, such as preparing food or eating, from the inactive period. An empirically or experimentally predefined amount of time may be used as the given amount of time, and, alternatively, an amount of time input in advance by the user may be used.
The times at which a door of the refrigerator was opened that are illustrated in
It is possible to determine active and inactive periods in the kitchen space and/or the dining space, in the same manner as with the active periods of the electronic device, by using the above-described detection periods.
For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).
Here, as the first service, second information processing apparatus 200 can cause the display panel to display, for example, information related to tooth brushing. In another example, as the first service, second information processing apparatus 200 may suggest video content for the user to watch if there is a given amount of time or longer remaining until the user's bedtime.
As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A first electronic device and a first sensor are disposed in a dining space of a home. The processor can: obtain sensing information corresponding to a given period of time in the dining space via the first sensor; when (v) the sensing information from the dining space includes an active period of time in the dining space indicating at least one of a user being present in the dining space or the first electronic device being active and (vi) the sensing information from the dining space includes, after the active period of time in the dining space, an inactive period of time in the dining space that is a threshold amount of time or longer and indicates at least one of the user being absent in the dining space or the first electronic device being inactive, generate the first information indicating that an eating-related activity by the user in the dining space is completed; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or the home, using the first information generated.
This makes it possible to determine that an eating-related activity by the user in the dining space is completed, using the sensing information from the first sensor disposed in the dining space, Accordingly, it is possible to output information for identifying a user or home that is in such a situation to, for example, the service provider, As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or home. It is therefore possible to effectively use sensor data to provide services.
Moreover, for example, in the information providing method according to the present embodiment, a second electronic device and a second sensor may be disposed in a kitchen space of the home, and the processor may further: obtain second sensing information corresponding to the given period of time in the kitchen space via the second sensor; and in the generating of the first information, when, in addition to (v) and (vi), (vii) the sensing information from the kitchen space includes an active period of time in the kitchen space that is earlier than the active period of time in the dining space and indicates at least one of the user being present in the kitchen space or the second electronic device being active and (viii) the sensing information from the kitchen space includes, after the active period of time in the kitchen space, an inactive period of time in the kitchen space that is a threshold amount of time or longer and indicates at least one of the user being absent in the kitchen space or the second electronic device being inactive, generate the first information.
This makes it possible to determine that the user has finished eating in the dining space after the user has finished preparing food in the kitchen space, which makes it possible to more accurately determine that an eating-related activity by the user in the dining space is completed.
Next, Embodiment 4 will be described. The present embodiment mainly varies from Embodiment 1 in that the first information indicates that it is almost the time that the user usually leaves his or her home, and that a different first condition is used to generate such first information. The present embodiment will be described with focus on the differences from Embodiment 1.
Note that the configuration of service providing system 10, the interactions in service providing system 10, and the processes performed by first information processing apparatus 100 according to the present embodiment are the same as in Embodiment 1, and will therefore be simplified or omitted in the illustrations and description.
In the present embodiment, the first condition includes at least (ix) and (x) described below.
The first space includes the dining space and/or the lavatory space of a home. A first sensor included in sensor group 300 and the first electronic device included in device group 400 are disposed in the first space. The first sensing information is sensor data obtained by the first sensor or information obtained by processing this sensor data. The first sensing statistical information is information obtained by statistically processing the first sensing information.
The second space includes the entrance space of the home. A second sensor included in sensor group 300 and the second electronic device included in device group 400 are disposed in the second space. The second sensing statistical information is information obtained by statistically processing the second sensing information. The second sensing information is sensor data obtained by the second sensor or information obtained by processing this sensor data.
If (ix) and (x) described above are satisfied, it is estimated that it is almost the time that the user usually leaves his or her home.
Next, the determination process for such a first condition (S102 in
First, determiner 104 determines whether the difference between the first time and the second time is a given amount of time or less (S4021). More specifically, determiner 104 determines whether the absolute value of the difference between the first time and the second time is a given amount of time or less. In other words, determiner 104 determines whether (ix) described above is satisfied or not.
The first time is a point in time included in the current first sensing information (i.e., is the current time), and indicates a time at which the user is present in the first space and/or a time at which the first electronic device in the first space is active. The current first sensing information is obtained from the first sensor disposed in the first space.
The second time is a point in time included in past first sensing statistical information (i.e., is a point in time in the past), and indicates a time at which the user was present in the first space and/or a time at which the first electronic device in the first space was active. The past first sensing statistical information is obtained by statistically processing first sensing information obtained in the past from the first sensor disposed in the first space, and is stored in first memory 103.
The given amount of time is an amount of time for discerning that the user's current activity is being performed close in time to an activity performed in the past. An empirically or experimentally predefined amount of time may be used as the given amount of time, and, alternatively, an amount of time input in advance by the user may be used.
Next, the second time will be described in greater detail with reference to
For example, in
Moreover, for example, in
Moreover, for example, in
We will now return to the description of the flowchart illustrated in
The third time is a point in time included in past second sensing statistical information (i.e., is a point in time in the past), and indicates a time at which the user was present in the second space and/or a time at which the second electronic device in the second space was active. The past second sensing statistical information is obtained by statistically processing second sensing information obtained in the past from the second sensor disposed in the second space, and is stored in first memory 103.
For example, in
When determiner 104 determines that the current time is equal to or earlier than the third time (Yes in S4022), determiner 104 determines that the first condition is satisfied (S1026). Consequently, processing from step S103 in
However, when the difference between the first time and the second time is greater than the given amount of time (No in S4021) or the current time is later than the third time (No in S4022), determiner 104 determines that the first condition is not satisfied (S1027), As a result, step S103 in
For example, the first information is generated (S103), whether the first request is satisfied is determined (S112), and the second information is generated (S113), based on the result of determining whether the first condition is satisfied or not as described above, just like in Embodiment 1. Then, based on the second information, second information processing apparatus 200 generates and outputs the first service information for providing the first service to the user in space 20 via device group 400 (S121 and S122).
Here, in the present embodiment, second information processing apparatus 200 can, as the first service, cause a display panel near a device that is likely to be active based on past activity history information for device group 400 to display current time information in a manner that is easily viewable by the user. For example, second information processing apparatus 200 may cause the display panel to display the current time information largely.
As described above, the information providing method according to the present embodiment is a method that uses first information processing apparatus 100 which includes a processor and memory. A first electronic device and a first sensor are disposed in a first space including at least one of a dining space or a lavatory space of a home. A second electronic device and a second sensor are disposed in a second space including an entrance space of the home. The processor can: obtain, from the memory, past first sensing statistical information corresponding to the first space; obtain current first sensing information corresponding to the first space via the first sensor; obtain, from the memory, past second sensing statistical information corresponding to the second space; when (ix) a difference between a first time and a second time is a threshold amount of time or less and (x) a current time is equal to or earlier than a third time, generate first information indicating that it is almost a time that the user usually leaves the home, the first time being included in the current first sensing information and indicating at least one of the user being present in the first space or the first electronic device being active, the second time being included in the past first sensing statistical information and indicating at least one of the user being present in the first space or the first electronic device being active, and the third time being included in the past second sensing statistical information and indicating at least one of the user being present in the second space or the second electronic device being active; obtain, from second information processing apparatus 200 connected to first information processing apparatus 100, information indicating first request content over a network; and when content of the first information is included in the first request content, output, to second information processing apparatus 200, second information including information for identifying the user or the home, using the first information generated.
This makes it possible to determine that it is almost the time that the user usually leaves his or her home, using the current sensing information and the past sensing statistical information. Accordingly, it is possible to output information for identifying a user or home that is in such a situation to, for example, the service provider. As a result, it is possible for a service provider or the like to provide services appropriate for the situation of the user or home. It is therefore possible to effectively use sensor data to provide services,
Next, Variation 1 of the above embodiments will be described. The present variation mainly varies from the embodiments in that services are provided via first information processing apparatus 100. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.
Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted.
As described above, with service providing system 10 according to the present variation, second information processing apparatus 200 can restrict disclosure of information related to space 20 to second information processing apparatus 200 since it is not necessary to directly communicate with device group 400 disposed in space 20, Accordingly, the privacy of users in space 20 can be protected.
Next, Variation 2 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the transmission of the first request information from second information processing apparatus 200 to first information processing apparatus 100 is performed before, rather than after, the generation of the first information (S103). The present variation will be described with reference to the figures, with focus on the differences from the embodiments.
Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted.
It is sufficient so long as the obtainment of the first request information (S111) is performed before the determining of whether the first request is satisfied (S112); the obtainment of the first request information (S111) is not limited to being performed before the obtainment of the first sensor data (S101). Moreover, since the first request has already been transmitted, second information processing apparatus 200 may request to obtain information regarding when to determine whether the first condition is satisfied (S102). If the first sensor data is consecutively received in a time series and whether the first condition is satisfied or not (S102) is determined upon each instance of reception of the first sensor data, it may be possible to obtain information at the point in time that the situation changes in a way to satisfy the first condition, by obtaining first sensor data information that does not meet the first condition immediately before first data that does satisfy the first condition is received. For example, the second information may be first sensor data information that (i) is obtained immediately before the first condition is satisfied and (ii) does not satisfy the first condition. Moreover, first information processing apparatus 100 may suggest to second information processing apparatus 200 to change the first condition, depending on the result of an analysis of statistical information on the first sensor data information that (i) is obtained immediately before the first condition is satisfied and (ii) does not satisfy the first condition,
As described above, with service providing system 10 according to the present variation, it is possible to output the second information regardless of the timing of the obtainment of the first request information, and possible to provide second information that is timely,
Next, Variation 3 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the second information includes, in addition to information for identifying a user or space, device activity information for a device related to a service. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.
Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted. The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in
Next, the process for generating the second information (S113 in
First information processing apparatus 100 selects a device related to the service identified by the first request information from among device group 400 disposed in space 20 in which the first information was generated (S1131). For example, first information processing apparatus 100 selects a device from among device group 400 based on the effect the service has on the user's five senses (sight, hearing, smell, touch, and taste) and the effect the device has on the user's five senses,
For example,
When, for example, service 1 is identified by the first request information, first information processing apparatus 100 selects, from among the devices illustrated in
Next, first information processing apparatus 100 obtains device activity information for the selected device(s) (S1132). The device activity information is information indicating whether the device is active. For example, the device activity information may be obtained directly from the device(s), or may be obtained via a sensor or sensors.
First information processing apparatus 100 then generates the second information including the device activity information (S1133).
As described above, according to the present variation, it is possible for the second information to include the device activity information for a device. Accordingly, second information processing apparatus 200 can provide a service that activates a device in an inactive state, and can avoid competition with services for devices that are operating. For example, when there are many devices that are in an active state, second information processing apparatus 200 can avoid causing multiple devices to confuse the senses of the user.
Although the second information includes the device activity information for selected devices in the present variation, this example is non-limiting. For example, the second information may include the device activity information for all devices. Moreover, the device activity information may be output separately from the second information.
The second information may moreover include only device activity information for devices that have been permitted to provide the device activity information by the user. Moreover, when there is a device that has been denied permission to provide the device activity information by the user, the second information may include information indicating that the device has been denied permission to provide the device activity information by the user. For example, when second information processing apparatus 200 provides a service using a device that has been denied permission to provide the operation information by the user, second information processing apparatus 200 may request permission from the user to provide the service.
Next, Variation 4 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that the second information includes, in addition to information for identifying a user or space, suitability information indicating service provision suitability. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.
Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted. The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in
Next, the process for generating the second information (S113 in
First information processing apparatus 100 obtains a service provision history for space 20 or the user (S1134). Service provision history is information associating services provided in the past to space 20 or the user with the date and time that those services were provided.
Next, first information processing apparatus 100 evaluates the suitability of the provision of the service identified by the first request information for space 20 or the user, based on the obtained service provision history (S1135). More specifically, for example, first information processing apparatus 100 evaluates the suitability of the provision of the service identified by the first request information based on the number of times the service was provided in a given span of time. As another example, first information processing apparatus 100 may evaluate the suitability of the provision of the service identified by the first request information based on another service that is currently being provided.
Next, specific examples of the evaluation of the suitability of the service provision will be given with reference to
The service provision availability information indicates, for each service, the number of times per day that service can be provided, as well as situations in which that service cannot be provided. For example, the service provision availability information illustrated in
According to the service provision history illustrated in
Moreover, the service provision availability information illustrated in
The information indicating services that are prohibited from being provided simultaneously indicates, more specifically, pairs of services that are prohibited from being or allowed to be provided simultaneously. A check indicates the two services are prohibited from being provided simultaneously, while a dash indicates the two services are allowed to be provided simultaneously.
For example, the information illustrated in
The information indicating services that are prohibited from being changed indicates, more specifically, services prohibited from being or allowed to be provided in place of a service that is already being provided. A check indicates that changing from the service on the left column to the service on the top row is prohibited, and a dash indicates that changing from the service on the left column to the service on the top row is allowed.
For example, in
In the service provision history illustrated in
Such an evaluation result is expressed as two or more levels. For example, two levels, namely “suitable” and “unsuitable”, can be used as the evaluation result, As another example, a number score from 0 to 10 or 0 to 100 can be used as the evaluation result.
Lastly, first information processing apparatus 100 generates the second information including suitability evaluation information indicating the evaluation result (S1136).
As described above, according to the present variation, it is possible for the second information to include suitability evaluation information. Accordingly, second information processing apparatus 200 can, for example, skip the provision of a service when the service's suitability evaluation is low, and can thus inhibit the provision of services at inappropriate times. As a result, service providing systems 10 and 10A can reduce excessive provision of services and inhibit interference between services.
Although the second information includes the suitability evaluation information in the present variation, this example is non-limiting. For example, in addition to or instead of the suitability evaluation information, the second information may include the service provision history information. Moreover, the service suitability information may be output separately from the second information.
Next, Variation 5 of the above embodiments will be described. The present variation mainly varies from the above embodiments in that, when first requests having the same request content have already been received from a plurality of second information processing apparatuses 200 (see Variation 2 above), the second information is output to a second information processing apparatus 200 selected based on priority level. The present variation will be described with reference to the figures, with focus on the differences from the embodiments.
Note that since the configurations of service providing system 10 according to the present variation are the same as in the above embodiments, repeated illustration and description will be omitted. The interaction in service providing systems 10 and 10A and the processes performed by first information processing apparatus 100 are as illustrated in
Next, the process for outputting the second information (S114 in
First information processing apparatus 100 sets the priority level of each of a plurality of second information processing apparatuses 200 (S1141). In other words, first information processing apparatus 100 sets the priority level for each of a plurality of second information processing apparatuses 200 that correspond to a plurality of first requests having the same request content. For example, the priority levels may be included in the first request information, and in such cases, the priority levels are set according to the priority levels included in the first request information. The priority levels may be set according to the situation of space 20 or the user that is obtained from sensor group 300 and device group 400. Moreover, the priority levels of the plurality of second information processing apparatuses 200 may be set based on bid amounts by the service providers for the provision of the second information.
Next, first information processing apparatus 100 selects one or more second information processing apparatuses 200 based on the set priority level (S1142). For example, first information processing apparatus 100 selects, from among a plurality of second information processing apparatuses 200 that correspond to a plurality of first requests having the same request content, the second information processing apparatus 200 having the highest priority level. Note that the number of second information processing apparatuses 200 selected is not limited to one.
First information processing apparatus 100 then outputs the second information to the selected second information processing apparatus 200 (S1143). Thereafter, first information processing apparatus 100 determines whether the service has been provided by the selected second information processing apparatus 200 within a given period (S1144). In other words, whether or not the selected second information processing apparatus 200 has provided the service within a given period starting when the second information is output is determined. An empirically or experimentally predefined period can be used as the given period. For example, the same period may be used across a plurality of services. Alternatively, individually set times for the plurality of services may be used as the given period.
When the service is provided within the given period (Yes in S1144), processing ends. However, when the service is not provided within the given period (No in S1144), processing proceeds to step S1141. This time in step S1141, the priority levels of the plurality of second information processing apparatuses 200 are updated such that the priority level of the second information processing apparatus 200 that did not provide the service is reduced. First information processing apparatus 100 then selects one or more second information processing apparatuses 200 based on the updated priority levels (S1142). Here, the system may be configured so that the service can only be provided to the user or space 20 when the priority level is set to the highest level. For example, if the second information is sent to both the second information processing apparatus 200 set to the highest priority level before the update and the second information processing apparatus 200 set to the highest priority level after the update, there is a chance that the service may be redundantly provided when, after a given period, the service is attempted to be provided by the second information processing apparatus 200 set to the highest priority level before the update. Accordingly, the system may be set so that only the second information processing apparatus 200 set to the highest priority level can use the second information. For example, this may be achieved by setting the system so that the second information may only be used at the time the service is executed, so that the encryption is changed after each update, and providing an encryption key corresponding to the second information processing apparatus 200 set to the highest priority level.
As described above, according to the present variation, first information processing apparatus 100 can select a second information processing apparatus 200 based on priority level. Accordingly, service providing systems 10 and 10A can select a second information processing apparatus 200 that is appropriate for the provision of the service from among a plurality of second information processing apparatuses 200 corresponding to a plurality of first requests having the same request content.
Next, the types of services in the service providing system according to the above embodiments will be described.
Group 1000 is, for example, a business, an organization, or a household or the like. The scale of group 1000 may be any scale. Group 1000 includes devices A and B included in plural devices 1010, and home gateway 1020. For example, plural devices 1010 are devices included in device group 400 according to the above embodiments. For example, home gateway 1020 is gateway 500 according to the above embodiments. Plural devices 1010 include devices that can connect to the internet (for example, smartphones, PCs, televisions, etc.) as well as devices that cannot connect to the internet themselves (for example, lights, washing machines, etc.). Even devices that cannot connect to the internet themselves but can connect to the internet via home gateway 1020 may be included. Moreover, user(s) 990A that use plural devices 1010 are in group 1000.
Data center operating company 1100 includes cloud server 1110. Cloud server 1110 is a virtual server that links with various devices over the internet. For example, cloud server 1110 is first information processing apparatus 100 according to the above embodiments. For example, cloud server 1110 manages big data which is difficult to manage with typical database management tools. Data center operating company 1100 performs operations of a data center, such as data management and management of cloud server 1110. Services performed by data center operating company 1100 will be described in greater detail later. Here, data center operating company 1100 is not limited to a company that only performs operations such as data management and operation of cloud server 1110. For example, when a device manufacturer that develops and produces one device among plural devices 1010 also performs data management and management of cloud server 1110, that device manufacturer corresponds to data center operating company 1100 (
Service provider 1200 has server 1210. As used herein, the scale of server 1210 may be any scale. For example, server 1210 may be memory included in a personal computer. Moreover, there are cases in which service provider 1200 does not have server 1210. For example, server 1210 is second information processing apparatus 200 according to the above embodiments.
Note that home gateway 1020 is not required in the service described above. For example, when cloud server 1110 does all of the data management, home gateway 1020 is not necessary. Furthermore, there are cases in which there are no devices that cannot connect to the Internet themselves, such as when all household devices are connected to the Internet.
Next, the flow of information in the above service will be described.
First, device A and device B in group 1000 transmit information they obtained to cloud server 1110 in data center operating company 1100. Cloud server 1110 accumulates the information from device A or device B ((a) in
Next, cloud server 1110 in data center operating company 1100 provides the accumulated information to service provider 1200 in fixed units. Here, fixed units may be units in which the data center operating company can organize the collected information and provide the collected information to service provider 1200, and may be units requested by service provider 1200. Although the term “fixed units” is used herein, the units need not be fixed; the amount of information provided may be variable according to the situation. The information is stored in server 1210 of service provider 1200 ((b) in
Note that user 990A and user 990B may be the same or different users.
For example, the techniques described above can be realized in the following types of cloud services. However, the techniques described above are not limited to being realized in the following examples.
In this type, service provider 1200 operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 that it manages.
In this type, data center operating company 1100 operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages OS 902 and application 901. Service provider 1200 provides service 904 using OS 902 and application 901 that it manages.
In this type, data center operating company 1100 manages OS 902 and operates and manages data center 903 (cloud server 1110). Service provider 1200 also manages application 901. Service provider 1200 provides service 904 using OS 902 managed by the data center operating company and application 901 that itself manages.
In this type, data center operating company 1100 manages application 901, manages OS 902, and operates and manages data center 903 (cloud server 1110). Service provider 1200 provides service 904 using OS 902 and application 901 that data center operating company 1100 manages.
In any of the above types, the service provision is performed by service provider 1200. Moreover, for example, the service provider or the data center operating company may develop, for example, the OS, application, or database of big data themselves, or may outsource the OS, application, or database of big data from a third party.
Although the service providing system according to one or more aspects of the present disclosure has been described based on embodiments, the present disclosure is not limited to these embodiments. Those skilled in the art will readily appreciate that various modifications may be made in these exemplary embodiments and that other embodiments may be obtained by arbitrarily combining the elements of the embodiments without materially departing from the novel teachings and advantages of the subject matter of the present disclosure. Accordingly, all such modifications and other embodiments are included in one or more aspects of the present disclosure.
For example, in the embodiments above, first information processing apparatus 100 that processes the sensor data and second information processing apparatus 200 that generates the service information are provided as separate apparatuses, but first information processing apparatus 100 and second information processing apparatus 200 may be configured as a single information processing apparatus. In such cases, since there is no need for interaction between first information processing apparatus 100 and second information processing apparatus 200, when the first condition is satisfied, processes from the generation of the first information to the output of the second information may be skipped.
The techniques of the present disclosure can be used as an information processing apparatus that provides information for providing a service to a user.
This is a continuation application of PCT International Application No. PCT/JP2019/038855 filed on Oct. 2, 2019, designating the United States of America, which is based on and claims priority of U.S. Provisional Patent Application No. 62/739,922 filed on Oct. 2, 2018, U.S. Provisional Patent Application No. 62/740,080 filed on Oct. 2, 2018, and U.S. Provisional Patent Application No. 62/740,097 filed on Oct. 2, 2018. The entire disclosures of the above-identified applications, including the specifications, drawings, and claims are incorporated herein by reference in their entirety.
Number | Date | Country | |
---|---|---|---|
62740097 | Oct 2018 | US | |
62740080 | Oct 2018 | US | |
62739922 | Oct 2018 | US |
Number | Date | Country | |
---|---|---|---|
Parent | PCT/JP2019/038855 | Oct 2019 | US |
Child | 17220404 | US |