Patent Application
20210278962
The present invention relates to an operation input device, a control device, and a non-transitory storage medium.
In recent years, devices of performing operations related to a plurality of functions have been developed. For example, WO 2018-066269 A1 discloses an operation device including four independent toggle switches.
However, each of the four toggle switches of the operation device disclosed in WO 2018-066269 A1 is fixedly associated with a single function. In the case of such a configuration, the number of switches increases with increase in the number of functions, which serve as operation targets. Therefore, the device tends to get larger in size with the increase in the number of functions.
To solve the above described problem, according to an aspect of the present invention, there is provided an operation input device comprising: an operation section configured to detect an operation performed by a user; a display section configured to display visual information; and a control section configured to identify a control target device serving as a control target on a basis of the operation performed by the user on the operation section, and control a function of the control target device, wherein the control section causes the display section to display an indicator related to a hierarchical structure including a plurality of layers, each of which is configured to be associated with at least one control target device, and the indicator includes information indicating a selected layer in the hierarchical structure, and information indicating execution states of respective functions of the control target devices associated with the layers.
To solve the above described problem, according to another aspect of the present invention, there is provided a control device comprising: a control section configured to identify a control target device serving as a control target among a plurality of control target devices on a basis of an operation performed by a user on an operation section, and control a function of the control target device, wherein the control section causes a display section to display an indicator related to a hierarchical structure including a plurality of layers, each of which is configured to be associated with at least one control target device, and the indicator includes information indicating a selected layer in the hierarchical structure, and information indicating execution states of respective functions of the control target devices associated with the layers.
To solve the above described problem, according to another aspect of the present invention, there is provided a non-transitory storage medium having a program stored therein, the program causing a computer to achieve a control function of identifying a control target device serving as a control target among a plurality of control target devices on a basis of an operation performed by a user on an operation section, and controlling a function of the control target device, wherein the control function causes a display section to display an indicator related to a hierarchical structure including a plurality of layers, each of which is configured to be associated with at least one control target device, and the indicator includes information indicating a selected layer in the hierarchical structure, and information indicating execution states of respective functions of the control target devices associated with the layers.
Hereinafter, referring to the appended drawings, preferred embodiments of the present invention will be described in detail. It should be noted that, in this specification and the appended drawings, structural elements that have substantially the same function and structure are denoted with the same reference numerals, and repeated explanation thereof is omitted.
<<1.1. System Configuration Example>>
First, a configuration example of a system 1 according to an embodiment of the present invention will be described.
(Operation Input Device 10)
The operation input device 10 according to the present embodiment is a device of receiving an operation performed by a user and controlling a function in response to the operation. In particular, the operation input device 10 according to the present embodiment controls execution of a function of a control target device 20 connected to the operation input device 10. The operation input device 10 according to the present embodiment is widely applicable to a situation where it is assumed to operate a plurality of functions. Examples of the situation include a situation where operations are performed on various kinds of functions (such as an air conditioner, a light, and an audio device) in a vehicle interior of a mobile object. Therefore, for example, the operation input device 10 according to the present embodiment may be installed at a position that allows an occupant (user) who is sitting on a seat to operate the operation input device 10 in the vehicle interior of the mobile object. However, the application of the operation input device 10 according to the present embodiment is not limited thereto. For example, the operation input device 10 according to the present embodiment may be used for operating various kinds of functions related to a home theater (such as a reproduction device, a display device, and an audio device).
As illustrated in
((Operation Section 110))
The operation section 110 according to the present embodiment detects operations performed by a user. Therefore, the operation section 110 includes various kinds of switches, dials, or the like. The operation section 110 inputs information related to the detected operation performed by the user, to the control section 130.
((Display Section 120))
The display section 120 according to the present embodiment displays various kinds of visual information under the control of the control section 130. For example, the display section 120 may display an image or the like that allows the user to perform an operation related to a desired function. For this reason, the display section 120 includes various kinds of displays.
((Control Section 130))
The control section 130 according to the present embodiment identifies a control target device 20 serving as a control target on the basis of the operation performed by the user on the operation section 110, and controls a function of the identified control target device 20. Details of the function of the control section 130 according to the present embodiment will be described later. Note that, for example, the function of the control section 130 is implemented by a processor such as a graphics processing unit (GPU).
((Connector Section 140))
The connector section 140 according to the present embodiment connects the control section 130 to the control target devices. For example, the connector section 140 includes combinations of a relay, a fuse, and the like. The number of combinations corresponds to the number of the connectable control target devices.
(Control Target Device 20)
The control target device 20 according to the present embodiment may be various kinds of devices that gets connected to the operation input device 10 and executes some kind of function under the control of the operation input device 10. For example, in the case where the system 1 is applied to the mobile object such as a vehicle, examples of the control target device 20 include the light, the audio device, and the air conditioner.
In addition, the control target device 20 according to the present embodiment may be a device that is freely attached to and removed from the operation input device 10 by the user. For example, in the case of the vehicle, sometimes the user may replace a part that has been installed since the delivery of the vehicle with another part that meets preference of the user, or sometimes the user may add a new part. In this case, the control target device 20 serving as a replacement for the pre-installed part and the newly installed control target device 20 get connected to the operation input device 10. This allows the user to operate these control target devices 20 via the operation input device 10.
The configuration example of the system 1 according to the present embodiment has been described above. Note that, the configuration described above with reference to
<<1.2. Details of Function>>
Next, functions of the operation input device 10 according to the present embodiment will be described in detail. As described above, in recent years, the devices of performing operations related to a plurality of independent functions have been developed. By using such a device, it is possible to aggregate interfaces for operating the respective functions and improve convenience for the users.
On the other hand, in the case where a single switch is fixedly associated with a single function as disclosed in WO 2018-066269 A1, the number of switches should be the same as the number of functions to be operated. Therefore, if many functions are operated by using a single operation input device, the operation input device gets larger in size with the increase in the number of functions, which are operation targets.
In addition, in this case, it is probably difficult for the user to remember which switch corresponds to which function among the many switches. Therefore, it may be considered that an illustration or text representing a corresponding function is attached to the switch itself. However, in the case where the user replaces a pre-installed part or adds a new part as described in the example of the vehicle, cumbersome processes are necessary.
The technical idea according to the present invention was conceived by focusing on the above-described points, and makes it possible to improve operability of the plurality of functions while avoiding the device from getting larger in size.
Next, features of the operation input device 20 that achieves the above-described effects will be described in detail. Note that, hereinafter, a case where the operation input device 20 according to the present embodiment is installed in the vehicle interior of the mobile object will be described as an example. In addition, hereinafter, the light, the audio device, and the air conditioner attached to the mobile object are considered as examples of the control target device 20.
To operate the plurality of control target devices 20 by using a relatively smaller number of structural parts, the control section 130 of the operation input device 10 according to the present embodiment manages the plurality of control target devices 20 by using a hierarchical structure including a plurality of layers. Each of the layers included in the hierarchical structure can be associated with at least one of the control target devices 20. In addition, one of features of the control section 130 according to the present embodiment is to display an indicator 124 related to the hierarchical structure on the display section 120.
For example, the indicator 124 according to the present embodiment may be represented by a plurality of cells 123 arranged in m number of rows and n number of columns. In this case, the value of m may correspond to the number of layers included in the hierarchical structure, and the value of n may correspond to the number of control target devices 20 that can be associated with the layers. For example, it is assumed that the hierarchical structure includes 5 layers and each of the layers can be associated with two of the control target devices 20. In this case, for example, as illustrated in
In addition, the indicator 124 according to the present embodiment may include information indicating a selected layer in the hierarchical structure. For example, the top of
In addition, the control section 130 according to the present embodiment may cause the display section 120 to display function images 122 corresponding to the respective control target devices 20 associated with currently selected layers. For example, it is assumed that the first column from the left of the first layer is associated with a control target device 20, which is a light attached to the left side of the mobile object, and the second column from the left of the first layer is associated with a control target device 20, which is a light attached to the right side of the mobile object. In this case, as illustrated in the top of
In addition, the indicator 124 according to the present embodiment may include information indicating execution states of respective functions of the control target devices 20 associated with the layers. Examples of the information indicating execution states include information indicating whether the function is executed or stopped. For example, in the case where the function of the control target device 20 is executed, the control section 130 may control the display section 120 in such a manner that display of the cell 123 associated with the control target device 20 is more emphasized than a cell 123 associated with a control target device 20 whose function is stopped.
For example, in the case of the example illustrated in the top of
Next, with reference to
For example, the number of the function operation sections 112 included in the operation section 110 according to the present embodiment may be the same as the number of the control target devices 20 that can be associated with the layers. In this case, the control section 130 according to the present embodiment may identify a control target device 20 associated with the function operation section 112 operated by the user, as the control target device 20 serving as the control target among the control target devices 20 associated with the selected layer.
In the case of the example illustrated in
For example, as described above, the top of
Here, in the case where the user performs an operation on the function operation section 112R as illustrated in the top of
In addition, the control section 130 performs control to switch on the light attached to the right side of the mobile object and performs control to emphasize display of the cell 123 in the first row and the second column of the indicator 124 as illustrated in the middle of
In addition, in the case where the user performs an operation on the function operation section 112L in the above-described state as illustrated in the middle of
In addition, the control section 130 performs control to switch off the light attached to the left side of the mobile object and performs control to cancel the emphasized display of the cell 123 in the first row and the first column of the indicator 124 as illustrated in the bottom of
As described above, the function operation section 112 according to the present embodiment may be configured to enter one of at least two states in response to an operation performed by the user such as the operation of pushing the function operation section 112 downward and the operation of pushing the function operation section 112 upward. In this case, the control section 130 according to the present embodiment may control whether to execute or stop the function of the control target device 20 serving as the control target, in accordance with the state of the function operation section 112, which has been changed through the operation performed by the user as described above.
Note that, the two states that the function operation sections 112 may enter are not limited to the above-described examples. For example, the function operation sections 112 according to the present embodiment may be a push-button switch that may enter an un-pushed state and a pushed state. In this case, the control section 130 may perform control to execute the function of the control target device 20 serving as the control target when the function operation section 112 changes from the un-pushed state to the pushed state, and the control section 130 may perform control to stop the function of the control target device 20 serving as the control target when the function operation section 112 changes from the pushed state to the un-pushed state.
Next, with reference to
For example, the top of
In addition, in this case, the control section 130 causes the display section 120 to display function images 122 corresponding to respective control target devices 20 associated with the second layer, which have newly entered into the selected state. Here, it is assumed that the first column of the second layer is associated with a control target device 20, which is a main speaker attached to the mobile object, and the second column of the second layer is associated with a control target device 20, which is a sub speaker attached to the mobile object. In this case, as illustrated in the middle of
On the other hand, in the case where the user operates the layer selection section 114 upward only once as illustrated in the middle of
As described above, it is possible for the user to select ant layer in the hierarchical structure by using the layer selection section 114 according to the present embodiment. Subsequently, it is possible to operate the functions of the control target devices 20 associated with the selected layer as illustrated in
Note that, the layer selection section 114 according to the present embodiment is not limited to the toggle switch. The layer selection section 114 according to the present embodiment may have various kinds of forms. For example, the layer selection section 114 according to the present embodiment may be a dial switch, a slide switch, or the like. In this case, the control section 130 may put a layer into the selected state in accordance with a direction and quantity of operating the layer selection section 114. In addition, for example, the layer selection section 114 according to the present embodiment may be the push-button switch. In this case, the control section 130 may sequentially changes a layer to be enter the selected state each time the layer selection section 114 is pushed.
Next, an example of setting the function images 122 according to the present embodiment will be described. As described above, the function images according to the present embodiment may be images indicating the respective control target devices 20 associated with the selected layer, which are images to be used by the user to identify a control target device 20 serving as the operation target. The control section 130 according to the present embodiment may have a function of automatically setting the function images 122 depending on the control target devices 20.
When the user operates the image setting section 116 in this state, the control section 130 acquires function information from control target devices 20 connected to respective relays corresponding to the first column and the second column of the first layer among relays included in the connector section 140, and sets function images 122 depending on the respective control target devices 20. Note that, the function information according to the present embodiment may be information indicating functional characteristics of the control target devices 20. Examples of the function information include classification of the function of the control target device 20, a product name of the control target device 20, the model number of the control target device 20, and the like.
For example, in the case of the example illustrated in the bottom of
In a similar way, the control section 130 determines that a control target device 20 connected to a relay of the connector section 140 corresponding to the second column of the first layer is the main speaker attached to the vehicle interior on the basis of function information acquired from the control target device 20, and sets a function image 122L corresponding to the main speaker for the second column of the first layer.
As described above, by using the control section 130 according to the present embodiment, it possible to automatically set the function image 122 on the basis of the function information acquired from the control target device 20, and it is also possible to reduce the user's burden of configuring the settings.
Note that, the above description is the example of automatically setting the function images 122 in the case where the relays of the connector section 140 are fixedly associated with respective combinations of a column and layer defined in the hierarchical structure.
However, the control section 130 may dynamically change the association between the relays and the combinations of the layer and the column according to the present embodiment. In addition, in this case, the control section 130 may associate a plurality of the control target devices 20, which are related to each other, with a same layer on the basis of the function information.
The top of
When the user operates the image setting section 116 in this state, the control section 130 acquires function information from control target devices 20 connected to respective relays of the connector section 140. Next, the control section 130 tries to detect a combination of control target devices 20 whose functions are related to each other, on the basis of the acquired function information from among the plurality of control target devices 20. Here, in the case where the combination of the control target devices 20 whose functions are related to each other is detected, the control section 130 associates the control target devices 20 with the layers and sets the function images 122 on the basis of the detected combination of the control target devices 20.
For example, in the case of the example illustrated in the middle of
Alternatively, for example, in the case of the example illustrated in the bottom of
As described above, the control section 130 according to the present embodiment makes it possible to automatically associate the plurality of control target devices 20 having functions related to each other with a same layer. This allows the user to easily find a desired function.
Note that, the examples illustrated in
On the other hand, it is also considered that some users want to set the function images 122 and associate the control target devices 20 with layers and columns in accordance with their preference. Therefore, the system 1 may be designed in a way that allows the user to manually set the function images 122 and manually associate the control target devices 20.
For example, the control section 130 according to the present embodiment may set a function image selected by the user for the control target device 20 associated with the selected layer, on the basis of an operation performed by the user on the operation section 10.
Next, the control section 130 identifies a control target device 20 serving as a target of setting the function image 122 on the basis of the function operation section 112 operated by the user. For example, in the case where the user operates the function operation section 112R as illustrated in the middle of
Next, as illustrated in the bottom of
In the case where the user further operates the function operation section 112R in this situation, the control section 130 cases the display section 120 to display another candidate for the function image 122R to be set for the control target device 20 associated with the second column of the first layer in a blinking manner as illustrated in the top of
Here, in the case where the user operates the image setting section 116 as illustrated in the top of
As described above, the control section 130 according to the present embodiment may set the function image 122 selected by the user for the control target device 20 associated with the selected layer, on the basis of the series of operations performed by the user beginning with the operation performed on the image setting section 116. Under such control, it is possible to customize the function image 122 in accordance with the user's preference.
Next, a description will be provided with regard to an example in which association among the control target devices 20, columns, and layers in the hierarchical structure is manually changed.
The top of
Here, when a predetermined operation performed by the user is detected, the control section 130 transitions to a mode of resetting the association among the control target devices 20, the columns, and the layers. Examples of the predetermined operation include simultaneous operations performed on the image setting section 116 and the function operation section 112.
For example, when the user operates the function operation section 112 while pressing the image setting section 116 as illustrated in the top of
When the user operates the layer selection section 114 in this situation, the control section 130 selects a layer in accordance with a content of the operation. For example, in the case where the user operates the layer selection section 114 downward once as illustrated in the middle of
In addition, in the case where the user operates the function operation section 112, the control section 130 moves the blinking display of the function image 122 to a position of a column corresponding to the operated function operation section 112. For example, in the case where the function operation section 112L is operated as illustrated in the bottom of
After the operation is performed as illustrated in the top of
The example in which the association among the control target devices 20, columns, and layers is manually changed according to the present embodiment has been described above. Under such control, it is possible for the user to freely change the association among the control target devices 20, the columns, and the layers in accordance with the user's preference.
However, the displays illustrated in
For example,
By using such blinking display, it is possible for the user to intuitively recognize the function image 122 serving as a target to be changed, and it is possible to prevent the function image 122 corresponding to the control target device 20 from being changed erroneously and unintentionally.
However, in the case of displaying the selected function image 122 in the blinking manner, there is a moment when no function image 122 is displayed on the display section 120.
Therefore, it is assumed that a time period during which the user looks at the display section 120 increases.
In view of the aforementioned issue, it is also possible for the control section 130 according to the present embodiment to control display in such a manner that the time period during which the user looks at the display section 120 decreases more.
In a way similar to the situation illustrated in the top of
At this time, the control section 130 according to the present embodiment may control the display section 120 in such a manner that the function images 122 and the like are expressed differently between the resetting mode and a normal mode of operating a function.
For example, in the case of an example illustrated in
Under such control, it is possible for the user to intuitively recognize that the normal mode is transitioned into the resetting mode.
For example, this makes it possible to prevent the user from perform an operation without noticing the transition of mode in the case where the user has touched the image setting section 116 unintentionally and the normal mode has been transitioned into the resetting mode, for example.
Note that, the reverse of display of the bright and dark regions illustrated in
For example, the transition of mode according to the present embodiment may be expressed by change in contrast, color, effect, or the like.
In addition to the control over display related to the above-described transition of mode, the control section 130 according to the present embodiment may control display in such a manner that the function image 122 selected through an operation performed by the user is emphasized.
For example, in the case of the example illustrated in
At this time, the control section 130 does not have to blink the function image 122R unlike the example illustrated in
Under such control, it is possible for the user to intuitively recognize the selected function image 122R. In addition, by always displaying the function image 122R, it is possible to reduce the time period during which the user looks at the display section 120.
Next, with reference to
In the example illustrated in
The numbers may correspond to the respective control target devices 20 connected to the connector section 140.
For example, it is assumed that the numbers “1” to “10” are assigned to respective relays of the connector section 140.
Here, for example, in the case where the first column of the first layer is associated with the control target device 20 connected to the relay to which the number “1” is assigned, the control section 130 performs control in such a manner that the cell 123 corresponding to the first column of the first layer is displayed in association with the number “1”.
In addition, for example, in the case where the second column of the first layer is associated with the control target device 20 connected to the relay to which the number “2” is assigned, the control section 130 performs control in such a manner that the cell 123 corresponding to the second column of the first layer is displayed in association with the number “2”.
The control section 130 may control display of the other cells 123 in similar ways.
In the case of controlling the display as described above, it is assumed that the user operates the layer selection section 114 downward in a state where the function image 122R is selected as illustrated in the middle of
Here, the function image 122R illustrated in the middle of
In this case, as illustrated in the bottom of
Under such control, it is possible for the user to continuously recognize which control target device 20 is associated with which cell 123 even in the case where the user has changed the association between the cell 123 and the number.
This makes it possible to prevent the user from detaching the control target device 20 erroneously and unintentionally, in the case of replacing the control target device 20 connected to the relay of the connector 140, for example.
Note that, the case where the numbers indicate association between the cells 123 and the control target devices 20 connected to the relay has been exemplified above, the association may be indicated by alphabets, marks, colors, or the like.
The detailed example of controlling display according to the present embodiment has been described above. As described above, the control performed by the control section 130 according to the present embodiment over the display can be flexibly modified.
Next, an example of arranging the operation section 110 included in the operation input device 10 according to the present embodiment will be described.
As described above, the operation section 110 according to the present embodiment may include the function operation sections 112, the layer selection section 114, and the image setting section 116.
For example,
For example, the layer selection section 114 according to the present embodiment may be arranged on a line extended from an axis representing a depth direction of the hierarchical structure of the indicator 124.
In the case of the example illustrated in
Therefore, as illustrated in
Such arrangement allows the user to intuitively associate the layer selection section 114 with the depth direction of the hierarchical structure of the indicator 124 and intuitively performs operations.
In addition, as illustrated in
On the other hand, for example, in the case of performing an operation in the normal mode without looking at the display section 120, the is a possibility that the user erroneously operates the function operation section 112 instead of the layer selection section 114, and vice versa.
In view of the aforementioned issue, the layer selection section 114 and the function operation section 112 according to the present embodiment may have different external shapes from each other.
The external shape includes shape, size, type of switch (such as the toggle switch or the push-button switch), and the like.
In the case of the example illustrated in
Such a difference in external shape makes it possible to effectively reduce a possibility that the user confuses the layer selection section 114 with the function operation sections 112.
Note that, to emphasize the difference between the layer selection section 114 and the function operation section 112, the layer selection section 114 and the function operation section 112 may provide different senses of touch when being operated by the user.
Next, an example of arranging the image setting section 116 according to the present embodiment will be described. Unlike the layer selection section 114 and the function operation sections 112, the image setting section 116 according to the present embodiment is not used in the normal mode.
Therefore, as illustrated in
Such arrangement makes it possible to effectively reduce prevent the user from erroneous operations.
In addition, to further improve the effect of preventing erroneous operations, the image setting section 116 according to the present embodiment may have a different external shape from the layer selection section 114 and the function operation sections 112.
In addition, the image setting section 116 according to the present embodiment may be arranged depending on a positional relation between the operation input device 10 and a steering wheel installed in the mobile object.
For example, it is assumed that the operation input device 10 is arranged on the left side or the right side of the steering wheel at a relatively close distance from the steering wheel.
In this case, there is a possibility that a partial region enters a blind spot of the user. The partial region is close to the steering wheel and is on an operation surface of the operation input device 10.
Therefore, for example, in the case where the operation input device 10 is arranged on the left side of the steering wheel, the image setting section 116 may be arranged in a region on the left side of the operation surface as illustrated in
The example of arranging the operation section 110 according to the present embodiment has been described above. As described above with reference to
Heretofore, preferred embodiments of the present invention have been described in detail with reference to the appended drawings, but the present invention is not limited thereto. It should be understood by those skilled in the art that various changes and alterations may be made without departing from the spirit and scope of the appended claims.
In the above- described embodiment the example in which the operation input device 10 is used for controlling various kinds of functions related to the mobile object has been descried as a major example, However, the range of application of the operation input device 10 is not limited to such an example. For example, the operation input device 10 may be implemented as a remote control for controlling functions of a plurality of home appliances in standard households. In this case, the home appliances serving as the respective control target devices 20 may be connected to the operation target device 10 through wireless communication.
Note that, a series of processes performed by the devices described in this specification may be achieved by any of software, hardware, and a combination of software and hardware. A program that configures software is stored in advance in, for example, a recording medium (non-transitory medium) installed inside or outside the devices. In addition, for example, when a computer executes the programs, the programs are read into RAM, and executed by a processor such as a CPU. The recording medium may be a magnetic disk, an optical disc, a magneto-optical disc, flash memory, or the like, for example. Alternatively, the above-described computer program may be distributed via a network without using the recording medium, for example.
This application is based upon and claims benefit of priority from U.S. Provisional Patent Application No. 62/985,442, filed on Mar. 5, 2020, the entire contents of which are incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| 62985442 | Mar 2020 | US |
