Patent Grant
12099666
The present disclosure relates to an information input/output system including an indication operation device such as, for example, an electronic pen and an information processing device that performs processing corresponding to an indication input performed by the indication operation device.
In recent years, there has been a system available in which various processes can be performed interactively between an indication operation device such as an electronic pen and an information processing device including a computer having a function for detecting an indication operation performed by the indication operation device. Examples of such function include a position detection function for detecting the position indicated by the electronic pen.
For example, Japanese Patent Laid-Open No. 2003-323455 (hereinafter referred to as “Patent Document 1”) discloses a related information providing device that provides, according to the timing of indication to a subject in a video, related information that is appropriate at that timing for an information provider. The interactive system according to Patent Document 1 is convenient since an information processing device can acquire related information regarding information being processed according to an indication operation performed by an indication operation device and can use the related information for display and processing at that time.
Incidentally, it would be convenient if the information corresponding to the indication operation performed by the indication operation device could be transferred to another device for display or usage on the other device, in addition to being used for display or processing at that time on the information processing device side.
Conventionally, however, as with Patent Document 1, it has been generally assumed that the information corresponding to the indication operation performed by the indication operation device is used for processing on the information processing device side. Accordingly, in order to transfer such information, the information acquired according to the indication operation performed by the indication operation device needs to be temporarily stored in the information processing device and then stored in a universal serial bus (USB) memory or a card-type memory and taken out therefrom, transferred, and the like. In this way, the transfer of such information has involved troublesome operations.
Therefore, it is desirable to provide an information input/output system that can easily acquire information corresponding to an indication operation performed by an indication operation device and transfer the information to another device.
In order to solve the problems described above, there is provided an information input/output system including an indication operation device, and an information processing device including a sensor, in which the indication operation device includes a first electrode, a second electrode, a signal generation circuit which, in operation, generates a signal to be transmitted to the information processing device, a first transmission circuit which, in operation, transmits the signal from the signal generation circuit to the sensor of the information processing device through the first electrode or the second electrode, a reception circuit which, in operation, receives information from the information processing device through the first electrode or the second electrode, an information storage device which, in operation, stores the information received by the reception circuit, and a transmitter which, in operation, transmits the information stored in the information storage device to an outside of the indication operation device, and the information processing device includes a processor which, in operation, processes the signal received from the indication operation device through the sensor, an acquisition circuit which, in operation, acquires information corresponding to a result of the processing performed by the processor, and a second transmission circuit which, in operation, transmits the information acquired by the acquisition circuit to the indication operation device through the sensor.
In the information input/output system having the configuration described above, the indication operation device transmits a signal from the signal generation circuit to the sensor of the information processing device through the first electrode or the second electrode. When the information processing device receives the signal from the indication operation device through the sensor, the information processing device processes the received signal, acquires information corresponding to the result of the processing, and transmits the acquired information to the indication operation device through the sensor. The indication operation device receives the information from the information processing device through the first electrode or the second electrode and stores the received information in the information storage device. Accordingly, the indication operation device can transmit the information stored in the information storage device to the outside of the indication operation device through the transmitter.
Therefore, according to the information input/output system having the configuration described above, when the indication operation device transmits a signal to the information processing device through the sensor, the information processing device transmits a signal corresponding to the result of the processing of the received signal to the indication operation device through the sensor. Accordingly, the indication operation device can store information from the information processing device in the information storage device and appropriately transfer the information to another device or the like through the transmitter. That is, when the indication operation device transmits a signal through the sensor, the information processing device transmits predetermined information to the indication operation device through the sensor, so that the indication operation device can store and retain the information and transfer the information to another device. With a simple operation, therefore, the indication operation device can acquire information from the information processing device and transfer the information.
Hereinafter, embodiments of an information input/output system according to the present disclosure will be described with reference to the drawings.
Example of Configuration of Information Processing Device 2
As illustrated in
As illustrated in
In this example, the position detection sensor 21 includes a rectangular sheet-shaped transparent substrate 211, which corresponds to the display screen of the display device 22. In this example, the transparent substrate 211 includes, on its front surface, a first conductor group 212 and a second conductor group 213. The first conductor group 212 includes a plurality of first conductors 212Y1, 212Y2, . . . , and 212Ym (m is an integer of 1 or greater), each of which extends in the horizontal direction (X-axis direction). The plurality of first conductors 212Y1, 212Y2, . . . , and 212Ym are disposed parallel to each other in the Y-axis direction at predetermined intervals. The second conductor group 213 includes a plurality of second conductors 213X1, 213X2, . . . , and 213Xn (n is an integer of 1 or greater), each of which extends in the vertical direction (Y-axis direction) perpendicular to the horizontal direction. The plurality of second conductors 213X1, 213X2, . . . , and 213Xn are disposed parallel to each other in the X-axis direction at predetermined intervals. In the following description, when there is no need to distinguish between the plurality of first conductors 212Y1, 212Y2, . . . , and 212Ym, the plurality of first conductors 212Y1, 212Y2, . . . , and 212Ym will be referred to as a first conductor 212Y. Similarly, when there is no need to distinguish between the plurality of second conductors 213X1, 213X2, . . . , and 213Xn, the plurality of second conductors 213X1, 213X2, . . . , and 213Xn will be referred to as a second conductor 213X.
The position detection sensor 21 and the display device 22 are connected to a processing circuit 200 of the information processing device 2. The processing circuit 200 has a configuration in which a conductor selection circuit 202, a selector switch circuit 203, a position detection circuit 204, a transmission information processing circuit 205, a display control circuit 206, a storage device 207, a short-range wireless communication device 208, and a communication device 209 are connected to a control circuit 201, which controls the entire information processing device 2.
Each of the plurality of conductors of the first conductor group 212 and the second conductor group 213 of the position detection sensor 21 is connected to the conductor selection circuit 202. The conductor selection circuit 202 selects one or a plurality of conductors among the plurality of conductors of the first conductor group 212 and the second conductor group 213 according to a control signal from the control circuit 201.
The conductor selection circuit 202 is connected to the selector switch circuit 203. A selector control signal from the control circuit 201 causes switching in the selector switch circuit 203 when a signal is received from the position detection sensor 21 (reception mode) and when information is transmitted from the position detection sensor 21 (transmission mode).
As will be described later, in the reception mode in which the position detection sensor 21 receives a signal from the electronic pen 3, the selector switch circuit 203 is switched to a terminal R according to the selector control signal from the control circuit 201 such that a conductor selected by the conductor selection circuit 202 is connected to an input terminal of the position detection circuit 204. In the transmission mode in which information is transmitted from the position detection sensor 21, the selector switch circuit 203 is switched to a terminal T according to the selector control signal from the control circuit 201 such that a conductor selected by the conductor selection circuit 202 is connected to an output terminal of the transmission information processing circuit 205. In the present embodiment, the control circuit 201 of the information processing device 2 is configured to synchronize the timing with the electronic pen 3 and execute the transmission mode and the reception mode in a time-division manner, as will be described later.
The position detection circuit 204 detects the signal level of the received signal supplied from each conductor selected by the conductor selection circuit 202, thereby detecting the position indicated by the electronic pen 3 from the result of the detection. Then, the position detection circuit 204 supplies information regarding the detected position to the control circuit 201. The control circuit 201 performs processing to be described later on the basis of the received information regarding the position indicated by the electronic pen 3.
In the present embodiment, the position detection circuit 204 performs a process of detecting pen pressure information and pen identification information (hereinafter referred to as “pen ID”) transmitted from the electronic pen 3 based on the received signal supplied from each conductor selected by the conductor selection circuit 202 and supplying the detected pen pressure information and pen ID to the control circuit 201. Further, the position detection circuit 204 also performs a process of detecting the tilt of the electronic pen 3 based on the received signal supplied from each conductor selected by the conductor selection circuit 202 and supplying information regarding the detected tilt to the control circuit 201.
The transmission information processing circuit 205 converts (modulates) transmission information supplied from the control circuit 201 into a signal suitable for transmission to the electronic pen 3 through the position detection sensor 21 and supplies the converted (modulated) signal to the conductor selected by the conductor selection circuit 202 through the selector switch circuit 203, thereby transmitting the signal to the electronic pen 3.
The display control circuit 206 is connected to the display device 22. The display control circuit 206 receives display image information from the control circuit 201 and performs control to display a display image corresponding to the display image information on the display screen of the display device 22.
The storage device 207 stores and reads out information on the basis of the control by the control circuit 201. In the present embodiment, a plurality of partial detection areas are preset in a detection region of the position detection sensor 21. The detection region of the position detection sensor 21 corresponds to the display region of the display device 22. In the example of
In the present embodiment, different function processes are set in advance in association with the individual areas in the detection region. Specifically, the control circuit 201 performs different function processes depending on which area of the detection region of the position detection sensor 21 the position indicated by the electronic pen 3 is. The storage device 207 includes storage regions, each of which is associated with a corresponding one of the writing input detection area AR0 and the partial detection areas AR1, AR2, and AR3.
The control circuit 201 performs different processing controls depending on which area of the detection region of the position detection sensor 21 the position indicated by the electronic pen 3 is. The control circuit 201 also performs processing control to write or read out information on the storage region of the storage device 207 associated with the area. A processing control program for performing these processing controls is installed in the control circuit 201.
Examples of the function processes set in association with the writing input detection area AR0 and the partial detection areas AR1, AR2, and AR3 within the detection region of the position detection sensor 21 will be described in detail later. The partial detection areas are not limited to these three partial detection areas AR1, AR2, and AR3 as in this example, and the number of partial detection areas may be one, two, or four or more. Further, each partial detection area may have any size and shape. For example, the position, size, and shape of each partial detection area can be specified by the electronic pen 3 on the position detection sensor 21. Moreover, for example, the information processing device 2 can display a list of menus of the functions that can be set in the respective partial detection areas on the display screen of the display device 22, and the functions to be set can be selected and indicated by the electronic pen 3 from the list.
The short-range wireless communication device 208 wirelessly communicates with a short-range wireless communication device disposed in the electronic pen 3 as will be described later. In the present embodiment, the short-range wireless communication device 208 is configured as a wireless communication device complying with the Bluetooth (registered trademark) standard. The control circuit 201 performs a process of storing information acquired through the short-range wireless communication device 208 in the storage device 207 and also performs a process of supplying an image corresponding to the acquired information to the display control circuit 206 to display the image on the display screen of the display device 22.
In the present embodiment, the communication device 209 connects to the Internet through a communication line and also performs communication (e.g., email) with a specific destination. The control circuit 201 performs a process of storing information acquired through the communication device 209 in the storage device 207 and also performs a process of supplying an image corresponding to the acquired information to the display control circuit 206 to display the image on the display screen of the display device 22.
Example of Configuration of Electronic Pen 3
The electronic pen 3 according to the present embodiment has a capacitance type configuration in which the electronic pen 3 interacts with the capacitive position detection sensor 21 of the information processing device 2. The electronic pen 3 according to this example includes a pen-shaped tubular casing 30, as illustrated in
Further, as denoted by dotted lines in
In this example, as illustrated in
A signal output terminal of the signal transmission circuit 302 is connected to the core body 31 through a switch circuit 304. Further, in this example, the signal output terminal of the signal transmission circuit 302 is connected to a terminal S of a selector switch circuit 305. A movable terminal M of the selector switch circuit 305 is connected to the peripheral electrode 32. A terminal R of the selector switch circuit 305 is connected to an input terminal of the signal reception circuit 303. A terminal G of the selector switch circuit 305 is connected to an earth electrode (ground electrode).
The control circuit 301 supplies a control signal SW1, which controls on/off of the switch circuit 304, to the switch circuit 304. The control circuit 301 supplies a selector control signal SW2, which switches the connection destination of the movable terminal M to the terminal S, the terminal R, or the terminal G, to the selector switch circuit 305.
The signal reception circuit 303 monitors whether or not a signal from the position detection sensor 21 is received through the peripheral electrode 32 when the selector switch circuit 305 is switched to the terminal R. When the signal reception circuit 303 does not detect the reception of the signal from the position detection sensor 21 through the peripheral electrode 32, the signal reception circuit 303 supplies this detection result to the control circuit 301. Then, when the signal reception circuit 303 detects the reception of the signal from the position detection sensor 21 through the peripheral electrode 32, the signal reception circuit 303 performs processing such as demodulation corresponding to the received signal and outputs a signal resulting from the processing to the control circuit 301.
The signal transmission circuit 302 outputs a signal including a position detection signal (burst signal) and additional information. This signal is transmitted from the core body 31. The position detection signal has a predetermined frequency for position detection performed by the position detection circuit 204 of the information processing device 2. The additional information includes pen pressure information, which corresponds to the pen pressure detected by the pen pressure detector 33, and the pen ID. Further, the signal transmission circuit 302 outputs a signal for detecting the tilt angle of the electronic pen 3. This signal is transmitted from the peripheral electrode 32. The tilt angle of the electronic pen 3 is the angle in the axial direction of the electronic pen 3 with respect to the detection surface of the position detection sensor 21.
The signal transmission circuit 302 generates and transmits a signal to be transmitted from the core body 31 and a signal to be transmitted from the peripheral electrode 32 under the control by the control circuit 301. In this case, the control circuit 301 causes the variable capacitor 33C to charge and discharge during a period in which the signal transmission circuit 302 transmits a burst signal for position detection as a signal to be transmitted from the core body 31. The control circuit 301 measures a period from the start of the discharge until the voltage across the variable capacitor 33C reaches a predetermined voltage, thereby detecting the capacitance of the variable capacitor 33C at that time. Based on the detected capacitance, the control circuit 301 detects the pen pressure.
Then, the control circuit 301 converts the detected pen pressure into, in this example, a multi-bit digital signal, and then controls the signal transmission circuit 302 to cause the signal transmission circuit 302 to output the pen pressure information corresponding to this digital signal, following the burst signal for position detection. Further, the control circuit 301 converts the pen ID read out from the pen ID storage device 36 into, in this example, a multi-bit digital signal, and controls the signal transmission circuit 302 to cause the signal transmission circuit 302 to output the pen ID, following the pen pressure information.
The information storage device 34 stores information received from the information processing device 2 through the position detection sensor 21 and the peripheral electrode 32 under the control by the control circuit 301. The information stored in the information storage device 34 is read out and then transmitted from the short-range wireless communication device 35 to the outside of the electronic pen 3 under the control by the control circuit 301. In this example, when the information stored in the information storage device 34 is transmitted from the short-range wireless communication device 35, the control circuit 301 checks the completion of the transmission and then erases the information stored in the information storage device 34.
It is noted that the information stored in the information storage device 34 is not necessarily erased automatically after the transmission thereof. For example, the electronic pen 3 may be provided with an operation unit such as a side switch, and the user may perform a specific operation as an erasure indication operation. For example, the user may long-press the operation unit as the erasure indication operation. In this case, the information stored in the information storage device 34 may be erased in response to the erasure indication operation.
The short-range wireless communication device 35 is an example of a transmitter and uses a wireless communication unit complying with, in this example, the Bluetooth (registered trademark) standard to wirelessly communicate with the short-range wireless communication device 208 of the information processing device 2, as described above. Needless to say, the short-range wireless communication device 35 can perform wireless communication not only with the information processing device 2 but also with any other personal computers and the like using a wireless communication unit complying with the Bluetooth (registered trademark) standard.
Although not illustrated in
The operations of the electronic pen circuit 300 of the electronic pen 3 according to the present embodiment will be described with reference to
In the electronic pen circuit 300 according to the present embodiment, when the electronic pen 3 and the position detection sensor 21 are not capacitive-coupled to each other, the control circuit 301 supplies the selector control signal SW2 to the selector switch circuit 305 to switch the selector switch circuit 305 to the terminal R (see
In the present embodiment, the control circuit 301 and the signal reception circuit 303 do not constantly monitor a signal received from the position detection sensor 21. Instead, as illustrated in the first half of
When the control circuit 301 detects the reception of the signal from the position detection sensor 21 based on the output of the monitoring from the signal reception circuit 303, the control circuit 301 switches the electronic pen circuit 300 from a standby state to an active state and performs control to supply a power supply voltage from the power supply unit to each unit. Then, as illustrated in
In the signal reception mode, the control circuit 301 supplies the selector control signal SW2 to the selector switch circuit 305 to switch the selector switch circuit 305 to the fixed terminal R as illustrated in
The control circuit 301 analyzes the signal received from the position detection sensor 21 on the basis of the signal from the signal reception circuit 303, determines the specifications of the information processing device 2 with which the electronic pen 3 is communicating, and on the basis of the determination result, determines the timing of signal interaction with the position detection sensor 21 of the information processing device 2 with which the electronic pen 3 is communicating. Then, the control circuit 301 controls the format of a signal to be output from the signal transmission circuit 302 such that the format matches the specifications of the information processing device 2 with which the electronic pen 3 is communicating, and interacts with the position detection sensor 21 at the determined timing.
Further, in the signal reception mode, when the control circuit 301 receives information transmitted from the information processing device 2 via the position detection sensor 21 and the peripheral electrode 32 and supplied from the signal reception circuit 303, the control circuit 301 also performs a process of storing the received information in the information storage device 34.
In the signal transmission mode, in the present embodiment, the control circuit 301 executes a position detection period Ta and a tilt detection period Tb in a time-division manner multiple times. In the position detection period Ta, a burst signal for position detection, pen pressure information, and pen ID are transmitted to the information processing device 2. In the tilt detection period Tb, the tilt angle of the electronic pen 3 is detected.
In the position detection period Ta, the control circuit 301 supplies the control signal SW1 to the switch circuit 304 to turn on the switch circuit 304 (see
Then, during the position detection period Ta, the signal transmission circuit 302 supplies, under the control by the control circuit 301, a signal including the position detection signal (burst signal) with a predetermined frequency for position detection performed by the information processing device 2, the pen pressure information corresponding to the pen pressure detected by the pen pressure detector 33, and the pen ID, to the core body 31 through the switch circuit 304 and transmits the signal to the position detection sensor 21 through capacitive coupling. At this time, since the peripheral electrode 32 is connected to the earth terminal, the earth terminal acts as a shield electrode for the core body 31 serving as the center electrode and prevents noise from entering the core body 31.
In the tilt detection period Tb, the control circuit 301 supplies the control signal SW1 to the switch circuit 304 to turn off the switch circuit 304 (see
The position detection circuit 204 of the information processing device 2 detects the distribution of the detected positions of the signal from the peripheral electrode 32 on the position detection sensor 21 and then detects the tilt of the electronic pen 3 from the result of the detection.
Examples of Function Processes Set in Association with Respective Partial Detection Areas AR1, AR2, and AR3
Before describing the function processes set in association with the respective partial detection areas AR1, AR2, and AR3, a processing operation of the information processing device 2 when the position indicated by the electronic pen 3 is within the writing input detection area AR0 will be described.
In the present embodiment, when the position detection circuit 204 detects that the position indicated by the electronic pen 3 is within the writing input detection area AR0, the control circuit 201 of the information processing device 2 stores information regarding the detected indicated position in the storage region associated with the writing input detection area AR0 of the storage device 207 as writing input information. At this time, in the present embodiment, the pen pressure information and the pen ID transmitted from the electronic pen 3 are also stored as the writing input information. Then, the control circuit 201 generates image information representing a writing trace based on the information regarding the detected indicated position and supplies the image information to the display control circuit 206. Accordingly, the display control circuit 206 displays an image Ps representing the writing trace on the display screen of the display device 22 as illustrated in
Next, examples of the function processes set in association with the respective partial detection areas AR1, AR2, and AR3 within the detection region of the position detection sensor 21 of the information processing device 2 in the present embodiment will be described.
In this example, the partial detection area AR1 is assigned a function of reading out writing input information that has been detected within the writing input detection area AR0 up to this point from the storage device 207 and transmitting the writing input information to the electronic pen 3. Specifically, in this example, when the position detection circuit 204 detects that the position indicated by the electronic pen 3 is within the partial detection area AR1, the control circuit 201 reads out the writing input information that has been detected within the writing input detection area AR0 up to this point from the storage device 207 and supplies the writing input information to the transmission information processing circuit 205.
In this case, in this example, the writing input information is read out from the storage region of the storage device 207 associated with the writing input detection area AR0. Therefore, in this example, it is not necessary to separately set the storage region associated with the partial detection area AR1 in the storage device 207, and the storage region associated with the writing input detection area AR0 also serves as the storage region associated with the partial detection area AR1. Alternatively, the storage region associated with the partial detection area AR1 may be set in the storage device 207 and the writing input information may also be stored in the set storage region such that the writing input information can be read out from this storage region.
Then, the control circuit 201 switches the selector switch circuit 203 to the terminal T and controls the conductor selection circuit 202 so as to select the first conductor 212Y and the second conductor 213X having an intersection point in the partial detection area AR1. Accordingly, the writing input information stored in the storage device 207 is transmitted to the electronic pen 3 located in the partial detection area AR1 of the position detection sensor 21. In the electronic pen 3, the peripheral electrode 32 receives the writing input information transmitted through the position detection sensor 21 and stores the writing input information in the information storage device 34.
By using the function assigned to this partial detection area AR1, the information processing device 2 can supply the information written and input by the electronic pen 3 to another information processing device on which the user can continue to perform the writing input.
For example, after the user performs the writing input forming the writing trace Ps in the writing input detection area AR0 on the position detection sensor 21 of the information processing device 2 with the electronic pen 3, the user moves the position indicated by the core body 31 of the electronic pen 3 to the partial detection area AR1, as illustrated on the left side of
Next, as illustrated on the right side of
The electronic pen 3 may transmit the writing input information stored in the information storage device 34 to the information processing device 2′ not from the short-range wireless communication device 35 but from the core body 31 or the peripheral electrode 32 through the position detection sensor 21′ as denoted by a dotted line on the right side of
In this case, when the information processing device 2′ detects electric-field coupling between the position detection sensor 21′ and the electronic pen 3, the information processing device 2′ transmits a request for acquisition of the storage information stored in the information storage device 34 to the electronic pen 3 and receives, through the position detection sensor 21′, the storage information transmitted from the electronic pen 3 in response to the acquisition request. When the electronic pen 3 receives the request for acquisition of the storage information stored in the information storage device 34 from the information processing device 2′, the electronic pen 3 determines whether or not the storage information to be transferred exists in the information storage device 34. When the storage information to be transferred exists, the electronic pen 3 reads out the storage information from the information storage device 34 and transmits the storage information through the position detection sensor 21′. When the storage information to be transferred does not exist, the electronic pen 3 transmits information indicating that the storage information to be transferred does not exist through the position detection sensor 21′.
Alternatively, the electronic pen 3 may transmit the storage information stored in the information storage device 34 to the information processing device 2′ through the position detection sensor 21′ not when the electronic pen 3 receives the acquisition request from the information processing device 2′, but when the electronic pen 3 detects electric-field coupling to the position detection sensor 21′ of the information processing device 2′.
Next, in this example, the partial detection area AR2 is assigned a function of reading out information stored in association with the pen ID from the storage device 207 and transmitting the information to the electronic pen 3. When it is assumed that different users use different electronic pens 3, the pen ID is equivalent to the user identification information. Therefore, in this example, information that needs to be communicated to each user is stored in advance in the storage region associated with the partial detection area AR2 of the storage device 207 in association with the pen ID of the electronic pen 3 used by each user. The information that needs to be communicated to each user may be information input by the electronic pen 3 with a specified destination that is managed by the information processing device 2 in association with the pen ID or information acquired through the communication device 209. In this case, the information acquired through the communication device 209 is information regarding a received email and includes received information addressed to the receiver that is managed by the information processing device 2 in association with the pen ID.
By using the function assigned to the partial detection area AR2, the information processing device 2 can transfer information, which has been prepared in advance in association with a user of a specific electronic pen 3, to this user. The user of the electronic pen 3 can display and view the transferred information on the information processing device 2′, which is a different information processing device from the information processing device 2.
That is, as illustrated on the left side of
Next, as illustrated on the right side of
Although not illustrated, in the case of the example of
Next, in this example, the partial detection area AR3 is assigned a function of reading out information stored in association with a predetermined keyword from the storage device 207 and transmitting the information to the electronic pen 3. In this example, the correspondence information between one or a plurality of predetermined keywords and information corresponding to each of the keywords is stored in advance in the storage region of the storage device 207 associated with the partial detection area AR3. In this case, information to be stored in association with a keyword may be information input by the electronic pen 3 or information acquired through the communication device 209.
By using the function assigned to the partial detection area AR3, information corresponding to a keyword can be transferred from the information processing device 2 to the electronic pen 3. The user of the electronic pen 3 can display and view the transferred information on the information processing device 2′, which is a different information processing device from the information processing device 2.
As illustrated on the left side of
When a keyword is selected by the electronic pen 3 from the list of keywords, the information processing device 2 transmits information corresponding to the keyword from the partial detection area AR3 of the position detection sensor 21 to the peripheral electrode 32 of the electronic pen 3. The electronic pen 3 receives the information corresponding to the selected keyword through the peripheral electrode 32 and stores the information in the information storage device 34. The electronic pen 3 may select a plurality of keywords. In this case, the information processing device 2 transmits pieces of information corresponding to the selected keywords to the electronic pen 3, and the electronic pen 3 stores these pieces of information in the information storage device 34.
Next, as illustrated on the right side of
Although not illustrated, in the case of the example of
The position indicated by the electronic pen 3 is not necessarily limited to one of the positions of the partial detection areas AR1 to AR3. Instead, the electronic pen 3 may indicate the positions of some or all of the partial detection areas AR1 to AR3 such that pieces of information corresponding to the respective partial detection areas indicated by the electronic pen 3 can be all stored in the information storage device 34.
Needless to say, the information processing device 2′ does not need to have the same configuration as the information processing device 2. However, it is preferable that the information processing device 2′ to which writing input information is transferred include the position detection sensor 21′. Meanwhile, the information processing device 2′ to which information corresponding to the pen ID in the example of
Operations of Electronic Pen 3 and Information Processing Device 2
Next, a flow of processing operations in the electronic pen 3 and the information processing device 2 for realizing the above-described functions will be described.
The control circuit 301 determines whether or not the electronic pen 3 is in the state of performing electric-field coupling to the position detection sensor 21 of the information processing device 2 (S1). When the electronic pen 3 is in the state of performing electric-field coupling to the position detection sensor 21 of the information processing device 2, signal interaction can be performed between the electronic pen 3 and the information processing device 2. This state includes not only the state in which the core body 31 of the electronic pen 3 is in contact with the detection surface of the position detection sensor 21 but also the hovering state in which the core body 31 of the electronic pen 3 is close to but slightly apart from the detection surface.
When the control circuit 301 determines at S1 that the electronic pen 3 is in the state of performing electric-field coupling to the position detection sensor 21 of the information processing device 2, the control circuit 301 determines whether or not the electronic pen 3 is in the period of the signal reception mode (S2). When the control circuit 301 determines at S2 that the electronic pen 3 is not in the period of the signal reception mode, the control circuit 301 determines whether or not the electronic pen 3 is in the period of the signal transmission mode (S4). Then, when the control circuit 301 determines at S4 that the electronic pen 3 is not in the period of the signal transmission mode, the control circuit 301 returns to S1 and repeats the processing from S1.
Then, when the control circuit 301 determines at S4 that the electronic pen 3 is in the period of the signal transmission mode, the control circuit 301 determines whether the electronic pen 3 is in the position detection period Ta or the tilt detection period Tb (S11 of
When the control circuit 301 determines at S11 that the electronic pen 3 is in the tilt detection period Tb, the control circuit 301 performs switching control to turn off the switch circuit 304 and connect the selector switch circuit 305 to the terminal S (S14). Next, the control circuit 301 performs control to cause the signal transmission circuit 302 to transmit a tilt detection signal through the peripheral electrode 32 (S15). After S15, the control circuit 301 returns to S1 and repeats the processing from S1.
When the control circuit 301 determines at S2 of
Then, when the control circuit 301 determines at S5 that a received signal has been detected, the control circuit 301 receives and processes the signal transmitted through the position detection sensor 21 and the peripheral electrode 32 (S6). Then, the control circuit 301 determines through the processing of S6 whether or not the received signal includes information that needs to be transferred (S7). The control circuit 301 determines whether or not the received signal includes information that needs to be transferred on the basis of whether or not the received signal is any of a signal corresponding to the specifications of the information processing device 2 and a timing control signal. When the control circuit 301 determines that the received signal is not any of the signal corresponding to the specifications of the information processing device 2 and the timing control signal, the control circuit 301 determines that the received signal includes information that needs to be transferred. Alternatively, information transmitted from the information processing device 2 may include information indicating whether or not the information needs to be transferred, and based on the information, the electronic pen 3 may determine whether or not the received signal includes information that needs to be transferred.
Then, when the control circuit 301 determines at S7 that the received signal is any of the signal corresponding to the specifications of the information processing device 2 and the timing control signal and does not include information that needs to be transferred, the control circuit 301 performs control corresponding to the received signal (S8). For example, according to the received signal, the control circuit 301 performs control such that the specifications of the electronic pen 3 correspond to the specifications of the information processing device 2 and also controls the timing for time-division processing.
Further, when the control circuit 301 determines at S7 that the received signal includes information that needs to be transferred, the control circuit 301 performs a process of storing the information received from the information processing device 2 in the information storage device 34 (S9). After S9, the control circuit 301 returns to S1 and repeats the processing from S1.
When the control circuit 301 determines at S1 that the electronic pen 3 is not in the state of performing electric-field coupling to the position detection sensor 21 of the information processing device 2, the control circuit 301 determines whether or not pairing for short-range wireless communication has been established with another device (S21 of
When the control circuit 301 determines at S21 that pairing for short-range wireless communication has been established with the other device, the control circuit 301 reads out information stored in the information storage device 34 and transmits the information to the other device paired with the electronic pen 3 (S22). After the transmission, the control circuit 301 returns to S1 and repeats processing from S1.
The control circuit 201 transmits signals (including a timing signal and a signal indicating the specifications) for capacitive-coupling to the electronic pen 3 (S31). In response to the transmitted signals, the capacitive-coupled electronic pen 3 transmits a signal such as a position detection signal. Accordingly, the control circuit 201 determines whether or not the signal from the electronic pen 3 has been received (S32). When the control circuit 201 determines that the signal has not been received from the electronic pen 3, the control circuit 201 returns to S31 and repeats the processing from S31.
When the control circuit 201 determines at S32 that the signal has been received from the electronic pen 3, the control circuit 201 processes the received signal (S33). The processing herein includes detection of the position indicated by the electronic pen 3 on the position detection sensor 21, detection of the tilt of the electronic pen 3, and acquisition of the pen pressure information and the pen ID.
Next, the control circuit 201 determines whether or not the detected position indicated by the electronic pen 3 is within the writing input detection area AR0 (S34). When the control circuit 201 determines at S34 that the detected position indicated by the electronic pen 3 is within the writing input detection area AR0, the control circuit 201 stores the detected indicated position, the detected tilt angle of the electronic pen 3, and the acquired pen pressure information and pen ID in the storage device 207 (S35). After S35, the control circuit 201 returns to S32 and repeats the processing from S32.
When the control circuit 201 determines at S34 that the detected position indicated by the electronic pen 3 is not within the writing input detection area AR0, the control circuit 201 determines whether or not the detected position indicated by the electronic pen 3 is within the partial detection area AR1 (S36). When the control circuit 201 determines at S36 that the detected position indicated by the electronic pen 3 is within the partial detection area AR1, the control circuit 201 reads out the position indicated by the electronic pen 3 and the tilt angle, the pen pressure information, and the pen ID of the electronic pen 3 stored up to this point from the storage device 207 and transmits them from the partial detection area AR1 of the position detection sensor 21 (S37). After S37, the control circuit 201 returns to S32 and repeats the processing from S32.
When the control circuit 201 determines at S36 that the detected position indicated by the electronic pen 3 is not within the partial detection area AR1, the control circuit 201 determines whether or not the detected position indicated by the electronic pen 3 is within the partial detection area AR2 (S41 of
When the control circuit 201 determines at S42 that the information corresponding to the pen ID acquired at S33 is stored in the storage device 207, the control circuit 201 reads out the information corresponding to the pen ID from the storage device 207 and transmits the information from the partial detection area AR2 of the position detection sensor 21 (S43). After S43, the control circuit 201 returns to S32 and repeats the processing from S32. When the control circuit 201 determines at S42 that the information corresponding to the pen ID acquired at S33 is not stored in the storage device 207, the control circuit 201 returns to S32 and repeats the processing from S32.
When the control circuit 201 determines at S41 that the detected position indicated by the electronic pen 3 is not within the partial detection area AR2, the control circuit 201 determines whether or not the detected position indicated by the electronic pen 3 is within the partial detection area AR3 (S44). When the control circuit 201 determines at S44 that the detected position indicated by the electronic pen 3 is within the partial detection area AR3, the control circuit 201 displays a list of selectable keywords and a message prompting the user to select and input a keyword on the display screen of the display device 22 (S45).
Next, the control circuit 201 determines whether or not the selection and input of the keyword have been accepted (S46). When the control circuit 201 determines that the selection and input of the keyword have been accepted, the control circuit 201 reads out the information stored in the storage device 207 in association with the selected keyword and transmits the information from the partial detection area AR3 of the position detection sensor 21 (S47). After S47, the control circuit 201 returns to S32 and repeats the processing from S32. When the control circuit 201 determines at S44 that the detected position indicated by the electronic pen 3 is not within the partial detection area AR3, the control circuit 201 also returns to S32 and repeats the processing from S32.
In this way, in the information input/output system 1 according to the above-described first embodiment, when the electronic pen 3 indicates a position within a partial detection area set in advance within the detection region of the position detection sensor 21 of the information processing device 2, information stored in the storage device 207 in association with the partial detection area is transmitted to the electronic pen 3 and stored in the information storage device 34 of the electronic pen 3.
Further, the information stored in the information storage device 34 can be transmitted to another information processing device by pairing the short-range wireless communication device 35 of the electronic pen 3 with a short-range wireless communication device of the other information processing device. That is, in the information input/output system 1 according to the present embodiment, the information stored in the storage device 207 of the information processing device 2 can be transferred to another information processing device via the electronic pen 3. Therefore, in the information input/output system 1 according to the present embodiment, various types of useful information can be transferred.
For example, in the above-described first embodiment, writing input information is stored in the storage region associated with the partial detection area AR1. Accordingly, unfinished writing input information that has been written on the information processing device 2 can be transferred to another information processing device via the information storage device 34 of the electronic pen 3. This is very convenient since the user can continue to perform the writing input of the unfinished writing input information, which has been written on the information processing device 2, on the other information processing device.
Further, information associated with the pen ID of the electronic pen 3 is stored in the storage region associated with the partial detection area AR2. Accordingly, the information associated with the pen ID can be transferred to another information processing device via the information storage device 34 of the electronic pen 3. Therefore, the information that needs to be communicated to the user of the electronic pen 3 can be easily communicated to the user via the electronic pen 3.
Further, pieces of information associated with keywords are stored in the storage region associated with the partial detection area AR3 and the user of the electronic pen 3 can select a keyword. Accordingly, information corresponding to the keyword desired by the user can be transferred to another information processing device via the information storage device 34 of the electronic pen 3.
In the first embodiment described above, not only the writing input information but also all the information to be transmitted to the electronic pen 3 are stored and retained in advance in the storage device 207 of the information processing device 2. Alternatively, the storage device may be a storage device included in an external device connected through the communication device 209. Specifically, when a predetermined partial detection area is indicated by the electronic pen 3, the information processing device 2 may transmit a request for acquisition of information corresponding to the indicated partial detection area to another device including a storage device. After that, the information processing device 2 may acquire the information transmitted from the other device in response to the acquisition request and transmit the information to the electronic pen 3.
Further, in the first embodiment described above, pieces of information associated with keywords are also stored in the storage device 207 in advance. Alternatively, a keyword selected by the electronic pen 3 or a keyword written and input by the electronic pen 3 may be transmitted to an Internet search site through the communication device 209, and a search result transmitted from the search site may be transmitted to the electronic pen 3. That is, the information corresponding to the keyword is not stored in advance, but may be searched for and acquired in real time, and the acquired information may be transmitted to the electronic pen 3.
The information to be transferred to the electronic pen 3 is not limited to the display information as with the above-described embodiment and may be audio information or the like. Further, the information to be transferred may be a predetermined program or the like.
In the first embodiment, the sensor connected to the information processing device is the position detection sensor capable of detecting an indicated position. Alternatively, the sensor may be the one that does not have a position detection function. The sensor used in the second embodiment does not have a position detection function. However, the sensor can detect an indication operation performed by an indication operation device such as an electronic pen by detecting the reception of a signal from the indication operation device, transmit it to an information processing device, and also transmit a signal from the information processing device to the electronic pen.
As illustrated in
Although not illustrated, the high-performance mobile phone terminal 5 includes a position detection sensor 5S of the capacitance type, which is superimposed on a display screen 5D, and is configured to be electric-field coupled to a core body 31A and a peripheral electrode 32A of the electronic pen 3A. Further, the high-performance mobile phone terminal 5 can detect the position indicated by the core body 31A of the electronic pen 3A and the tilt angle of the electronic pen 3A. The high-performance mobile phone terminal 5 includes a short-range wireless communication device and can wirelessly communicate with a short-range wireless communication device 35A of the electronic pen 3A. The electronic pen 3A includes an information storage device 34A and can transmit information stored in the information storage device 34A to the information processing device 2A through the short-range wireless communication device 35A.
In the information input/output system 1A according to the second embodiment, one or more sensors 21A can be connected to the information processing device 2A. In the example of
In the example of
In the sensor 21A according to this example, as illustrated in
As illustrated in
Each sensor 21A can be connected to a corresponding one of the plurality of input/output ports of the input/output port group 221. A port number is assigned to each of the plurality of input/output ports of the input/output port group 221. In this example, the four sensors 21A are connected to the respective input/output ports with the port numbers PO1, PO2, PO3, and PO4. In this case, in the example of
Alternatively, the sensors 21A and the information processing device 2A may be wirelessly connected to each other. In this case, identification information (ID) that identifies each sensor 21A is added to information to be transmitted from each sensor 21A to the information processing device 2A. Further, information transmitted from the information processing device 2A to the destination sensor 21A that receives the information includes the ID of the destination sensor 21A. Accordingly, based on the ID included in the information, the sensor 21A can determine whether or not the received information is the information addressed to itself.
In the following description, when the sensors 21A connected to the respective input/output ports with the port numbers PO1, PO2, PO3, and PO4 need to be distinguished from each other, the individual sensors 21A will be referred to as a sensor 21A-1, a sensor 21A-2, a sensor 21A-3, and a sensor 21A-4 as illustrated in
As illustrated in
In the example of
Specifically, in the example of
The Japanese map used herein may be a map printed on paper and attached to the plate-like board 4. In this case, the sensor 21A-1, the sensor 21A-2, the sensor 21A-3, and the sensor 21A-4 may be attached to this paper map by double-sided tape or the like. Alternatively, the board 4 may be configured as a display device. In this case, the sensor 21A-1, the sensor 21A-2, the sensor 21A-3, and the sensor 21A-4 may be attached to a display screen of the display device on which the Japanese map is displayed by double-sided tape or the like.
In addition, signs indicating identifiers such as numbers that identify the respective locations whose pieces of provision information INFO1, INFO2, INFO3, and INFO4 are stored in the storage device 224 may be added to or displayed on the map. Further, each of the sensor 21A-1, the sensor 21A-2, the sensor 21A-3, and the sensor 21A-4 may be assigned a corresponding identifiable number and disposed separately from the map.
As illustrated in
In the information processing device 2A, the signal from the sensor 21A is received through the input/output port of the input/output port group 221 to which this sensor 21A is connected, and then supplied to the signal transmission/reception circuit 222.
When the signal transmission/reception circuit 222 receives the signal from the input/output port group 221, the signal transmission/reception circuit 222 determines which port number PO1, PO2, PO3, or PO4 has received the received signal and then supplies information regarding the port number to the processing control circuit 223 as the result of the determination.
When the processing control circuit 223 receives the information regarding the port number that has received the received signal from the signal transmission/reception circuit 222, the processing control circuit 223 reads out and acquires information stored in association with the port number that has received the received signal from the storage device 224 and supplies the acquired information to the signal transmission/reception circuit 222.
Through the input/output port of the input/output port group 221 with the port number that has received the received signal, the signal transmission/reception circuit 222 transmits the information received from the processing control circuit 223 to the sensor 21A to which this input/output port is connected.
The sensor 21A receives the information from the information processing device 2A through the terminals 215A and 216A and transmits the information from the first electrode 212A and the second electrode 213A to the electronic pen 3A through electric-field coupling.
In the electronic pen 3A, as described above, the peripheral electrode 32A receives the information from the sensor 21A and stores the information in the information storage device 34A during the signal reception mode. Then, the electronic pen 3A transmits the information stored in the information storage device 34A to the high-performance mobile phone terminal 5 using the short-range wireless communication device 35A as indicated by an arrow in
Therefore, in the information input/output system 1A according to the second embodiment, when the user of the high-performance mobile phone terminal 5 brings the pen tip of the electronic pen 3A into contact with or close to the sensor 21A disposed at a location regarding which the user wants to see the information, the information processing device 2A can cause the information related to the location to be stored in the information storage device 34A of the electronic pen 3A. Then, the user brings the electronic pen 3A and the high-performance mobile phone terminal 5 into a state in which they can be wirelessly communicated with each other by using the short-range wireless communication device 35A of the electronic pen 3A. Accordingly, the information stored in the information storage device 34A of the electronic pen 3A can be displayed and viewed on the display screen 5D of the high-performance mobile phone terminal 5.
In the case of the second embodiment as well, as denoted by the dotted line in
Specifically,
As illustrated in
A first electrode 212B and a second electrode 213B are respectively formed on the surface of the substrate 211B1 and the surface of the substrate 211B2, which face each other via the air layer. In the example of
As illustrated in
In the sensor 21B according to this example, as illustrated in
In the above-described embodiments, the indication operation device uses a pen-type electronic pen. In the present disclosure, however, the indication operation device is not limited to the pen type.
In order to facilitate understanding of the configuration of the indication operation device 3B according to this example, functional portions of the indication operation device 3B similar to the constituent components of the electronic pen 3 according to the first embodiment described above are given the same reference signs with a suffix B added thereto.
As illustrated in
The electronic circuit 300B of the indication operation device 3B according to this example includes a signal generation circuit that generates a signal to be transmitted from the first electrode 31B or the second electrode 32B and a processing function that stores information received by the first electrode 31B or the second electrode 32B in the information storage device 34B. As with the above-described embodiments, the electronic circuit 300B controls the transmission of a signal from the signal generation circuit and the reception of information from an information processing device in a time-division manner.
When the indication operation device 3B according to this example is used in place of the electronic pen 3 in the information input/output system 1 according to the first embodiment, a signal from the signal generation circuit is transmitted from either or both of the first electrode 31B and the second electrode 32B, while when a signal is received from the information processing device through the sensor, the signal is received through the second electrode 32B.
When the indication operation device 3B according to this example is used in the information input/output system 1A according to the second embodiment and the indication operation device 3B is not used for the application of the position indication in the position detection sensor, a signal from the signal generation circuit may be transmitted from either or both of the first electrode 31B and the second electrode 32B. Further, when a signal is received from the information processing device through a sensor, the signal may be received by either or both of the first electrode 31B and the second electrode 32B.
Needless to say, the indication operation device 3B according to this example may also include a pressure detector and an ID storage device. The pressure detector detects the pressure applied to the first electrode 31B. The ID storage device stores device identification information corresponding to the pen ID. In this case, a transmission signal from the indication operation device 3B may include the pressure and the device identification information.
Although the short-range wireless communication device is used as the transmitter of the indication operation device in the above-described embodiments, another wireless communication unit can also be used. Further, the transmitter of the indication operation device is not limited to the wireless communication unit. For example, the electronic pen 3 or 3A or the indication operation device 3B may include an output terminal such as a universal serial bus (USB) terminal for outputting information stored in the information storage device to an external device.
It is to be noted that the embodiments of the present disclosure are not limited to the foregoing embodiments, and that various changes can be made without departing from the spirit of the present disclosure.
Aspects of the embodiments can be modified, if necessary to employ concepts of the various patents, applications and publications to provide yet further embodiments.
These and other changes can be made to the embodiments in light of the above-detailed description. In general, in the following claims, the terms used should not be construed to limit the claims to the specific embodiments disclosed in the specification and the claims, but should be construed to include all possible embodiments along with the full scope of equivalents to which such claims are entitled. Accordingly, the claims are not limited by the disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2020-033022 | Feb 2020 | JP | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 7599562 | Liu | Oct 2009 | B2 |
| 9029717 | Lu | May 2015 | B2 |
| 9503561 | Liu et al. | Nov 2016 | B2 |
| 10606406 | Park | Mar 2020 | B2 |
| 20060192772 | Kambayashi | Aug 2006 | A1 |
| 20140059169 | Ko et al. | Feb 2014 | A1 |
| 20160077655 | Oda | Mar 2016 | A1 |
| 20160320918 | Hara | Nov 2016 | A1 |
| 20170228049 | Yamamoto | Aug 2017 | A1 |
| 20190324560 | Wilson-Haynes | Oct 2019 | A1 |
| 20200033965 | Bakken et al. | Jan 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| 2003323455 | Nov 2003 | JP |
| 2018206093 | Dec 2018 | JP |
| 2016171114 | Oct 2016 | WO |
| 2018043203 | Mar 2018 | WO |
| Entry |
|---|
| International Search Report, mailed May 11, 2021, for International Application No. PCT/JP2021/005137. (6 pages) (with English translation). |
| Number | Date | Country | |
|---|---|---|---|
| 20240004486 A1 | Jan 2024 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 17841486 | Jun 2022 | US |
| Child | 18465850 | US | |
| Parent | PCT/JP2021/005137 | Feb 2021 | WO |
| Child | 17841486 | US |
