Mobile information input/output apparatus and versatile braille output apparatus

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is a schematic plan view showing a mobile phone in a first embodiment of the present invention;

FIG. 2 is a schematic plan view showing an operation device of the mobile phone in FIG. 1;

FIG. 3 is another schematic plan view showing the mobile phone in the first embodiment of the present invention;

FIG. 4 is an A-A′ cross sectional view in FIG. 3;

FIG. 5 are schematic prospective views showing a Braille display device shown in FIG. 3;

FIG. 6 is a block diagram showing the mobile phone in the first embodiment of the present invention;

FIG. 7 is a view showing a correlation between various events occurring on the mobile phone shown in FIG. 6 and corresponding processes;

FIG. 8 is a flowchart showing a basic control process performed by a CPU in FIG. 6;

FIG. 9 is a flowchart showing a Braille pattern data generation process branched from the basis control process;

FIG. 10 is a flowchart showing a normal standby process branched form the basis control process;

FIG. 11 is another schematic perspective view showing the Braille display device;

FIG. 12 is a flowchart showing an unread mail reading standby process branched from the basis control process;

FIG. 13 is another flowchart showing the normal standby process; and

FIG. 14 is a schematic perspective view showing a versatile Braille output apparatus in a second embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Hereinafter, the embodiments of the present invention will be discussed with reference to the drawings, as occasion demands.

First Embodiment

Firstly, with reference to FIG. 1, the structure of a mobile phone 10 in the present invention will be explained. FIG. 1 is a schematic plan view showing the mobile phone 10 on the front side.

In FIG. 1, the mobile phone 10 is one example of the “mobile information input/output apparatus” of the present invention, included in a not-illustrated phone communication network via an antenna 11 and adapted to send or receive emails and telephone calls with respect to the exterior. Incidentally, the mobile phone 10 is aimed at the visually impaired, and in the following explanation, a “user” indicates, unless otherwise noted, the visually impaired.

In FIG. 1, the mobile phone 10 is provided with: the above-mentioned antenna 11; a case 12; a display screen device 13; direction keys 14; a determination key 15; mode keys 16; and an operation device 500.

The case 12 is a resin body which can be carried in one hand, containing various control units and various electronic circuits or the like of the mobile phone 10. The case 12 is one example of the “case” of the present invention.

The display screen device 13 is a liquid crystal panel adapted to display various visual information associated with the mobile phone 10, such as, e.g., a phone number related to a phone call, an email address, and texts of an email. The display screen device 13 is one portion of a display device 700 described later.

The direction keys 14 are button switches which are used in various operations described later, as occasion demands, and whose surfaces are formed to be substantially as even as the case 12 (or formed not to project too much from the case 12). The direction keys 14 are used, for example, to vertically scroll a list related to a call history (or call register) or unread mail, or to select a particular third party in an electronic address book, or for similar cases.

The determination key 15 is a button switch, like the direction keys 14 or the like, which can be used for various determination operations in various operations described later.

The mode keys 16 are constructed as the button switches, like the direction keys 14 and the determination key 15, and adapted to be used for an operation of selecting various function modes of the mobile phone 10.

The operation device 500 is formed of button switches adapted to input various characters, such as kana, numbers, and alphabets, frequently used for the creation of an email and a phone call or the like. A plurality of characters are assigned in advance to the plurality of character keys (described later) constituting the operation device 500.

Incidentally, each of the direction keys 14, the determination key 15, the mode keys 16, and the operation device 500 is one example of the “operating device” of the present invention.

Next, with reference to FIG. 2, the detailed structure of the operation device 500 will be explained. FIG. 2 is a schematic plan view showing the operation device 500. Incidentally, in FIG. 2, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 2, the operation device 500 is provided with a plurality of character keys 500a, 500b, 500c, 500d, 500e, 500f, 500g, 500h, 500i, 500j, 500k, and 500l (i.e. one example of the “button” of the present invention).

The plurality of characters (kana, numbers, alphabets, or symbols, and so on) are assigned in advance to the individual character key, and in various operations described later, a user can use the character keys for input, as occasion demands. For example, characters of “1”, “@”, and “b” are assigned in advance to the character key 500a. Incidentally, the explanation about the individual character keys will be omitted.

In the embodiment, a Braille pattern which is specific to the individual character key is physically formed on the surface of the individual character key, and if holding the mobile phone 10 in one hand, a user can identify the individual key with, e.g., a thumb or the like of the hand. Incidentally, the above-mentioned direction keys 14, determination key 15, and mode keys 16 also have the physical Braille patterns formed in the same manner, assisting the user's operations. Incidentally, the Braille pattern is not necessarily formed on all the keys, but it may be formed only on a single or a plurality of reference keys in advance. In this case, it is preferable to somehow notify the user of a relative positional relationship between the reference key and another key.

Next, with reference to FIG. 3, the further structure of the mobile phone 10 will be explained. FIG. 3 is another schematic plan view showing the mobile phone 10 on the rear surface side (i.e. the rear side of the front surface side of FIG. 1). Incidentally, in FIG. 3, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 3, in one portion of the case 12 on the rear side of the mobile phone 10, a band-like groove 12a is formed from the upper left portion to the center right portion of the drawing. Incidentally, the groove 12a in the embodiment is defined as including not only a wall surface and a bottom surface, which define a band-like space formed by the groove 12a, but also the band-like space itself.

A disc-shaped fixing device 17 is grooved in the groove 12a, and moreover, a Braille display device 1100 is fixed on the disc-shaped fixing device 17. Incidentally, the detailed structure of the Braille display device 1100 will be described later.

The fixing device 17 is adapted to be displaced in the groove 12a in a predetermined range in an illustrated slide direction and to rotate in an illustrated rotational direction in an arbitrary position. The fixing device 17 is one example of the “fixing device” of the present invention.

Now, with reference to FIG. 4, the detailed structure of the fixing device 17 will be explained. FIG. 4 is an A-A′ cross sectional view in FIG. 3. Incidentally, in FIG. 4, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 4, the groove 12a (whose numerical reference is omitted) has a depression in which one portion of a side wall surface is depressed toward the exterior, and one portion of the fixing device 17 is a convex 17a opposed to the depression and capable of engaging the depression. The fixing device 17 can be displaced in the slide direction which extends the vertical direction to the sheet of paper by engaging the convex 17a in the depression. Moreover, engaging the convex 17a in the depression in this manner allows the rotation in the above-mentioned rotational direction.

The Braille display device 1100 has a substrate 1110 fixed by that the fixing device 17 pinches their both sides, and has two Braille pins 1113 and 1114 embedded around the center of the substrate 1110. Incidentally, each of the two Braille pins is one example of the “unit Braille block” of the present invention. In FIG. 4, the two Braille pins are both connected to a Braille driving device 1000 described later and are adapted to emerge in an illustrated emerging direction by virtue of the Braille driving device 1000.

Next, with reference to FIG. 5, the detailed structure of the Braille display device 1100 will be explained. FIG. 5 are schematic prospective views showing the Braille display device 1000. Incidentally, in FIG. 5, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 5, FIG. 5(a) shows a reference state of the Braille display device 1100. The substrate 1110 of the Braille display device 1100 is provided with six storage holes 1111a, 1111b, 1111c, 1111d, 1111e, and 1111f, and each of the six storage holes stores respective one of Braille pins 1111, 1112, 1113, 1114, 1115, and 1116. In the reference state, all the Braille pins are stored in the respective storage holes.

On the other hand, FIG. 5(b) shows a fully raised state of the Braille display device 1100. In the fully raised state, all the Braille pins are raised from the respective storage holes. The mobile phone 10 in the embodiment is adapted to individually control the emerging state of the Braille pins in each process described later and to express various Braille patterns. Incidentally, the individual one of the Braille pins is, namely, one example of the “unit Braille block” of the present invention.

Next, with reference to FIG. 6, the electric structure of the mobile phone 10 will be explained. FIG. 6 is a block diagram showing the mobile phone 10. Incidentally, in FIG. 6, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 6, the mobile phone 10 is provided with: a CPU 100; a communication device 200; an audio processing device 300; an audio source device 400; the operation device 500; a memory 600; a display device 700; a vibrator 800; a Braille conversion device 900; the Braille driving device 1000; and the Braille display device 1100, which are electrically connected to each other through a control bus 18.

The CPU 100 is a control unit for controlling the operation of the mobile phone 10, and is adapted to function as one example of the “function performing device” and the “controlling device” of the present invention. The CPU 100 is adapted to perform each process described later, in accordance with a control program stored in the memory 600.

The communication device 200 is a processing unit adapted to perform various high-frequency processing, intermediate-frequency processing and the like, related to the sending and reception of an email and a phone call, such as making or receiving a phone call, via the antenna 11. Incidentally, the operation of the communication device 200 is the same as that of a so-called general mobile phone, and the explanation thereof will be omitted in the embodiment.

The audio processing device 300 is an audio processing unit adapted to generate an audio signal to be outputted from a speaker 19 and supply it to the speaker 19, on the basis of audio signal data or the like related to a received sound supplied via the control bus 18 from the communication device 200 and audio signal data related to ringtone and sound effect supplied from via the control bus 18 from the audio source device 400.

The audio source device 400 is adapted to generate and supply audio data related to ringtone and sound effect or the like.

The operation device 500 is provided with the plurality of character keys, as described above. All the character keys are electrically connected to the control bus 18. The CPU 100 is adapted to specify which key is operated via the control bus 18 if an operation is performed through the operation device 500. Incidentally, it is not illustrated to prevent the complexity of the drawing, but the above-mentioned direction keys 14, determination key 15, and mode keys 16 are also electrically connected to the control bus 18. Namely, the CPU 100 can specify the operated key, as in the operation device 500, even with regard to the above-mentioned keys.

The memory 600 is a storage element including a nonvolatile storing device, such as a ROM, for storing therein control programs used for the CPU 100, and a volatile storing device, such as a RAM, for temporarily storing therein various data generated in various control processes realized by the various control programs.

The display device 700 is a liquid crystal apparatus including the above-mentioned display screen device 13, and includes a control circuit or the like for drive-controlling the display screen device 13 on the basis of image data and video data as for images and video to be displayed on the display screen device 13.

The vibrator 800 is a vibration generator for transmitting vibration to a user via the case 12, and is adapted to notify the user of a plurality of states of the mobile phone 10 by setting in advance a plurality of patterns of vibration.

The Braille conversion device 900 is adapted to generate Braille pattern data corresponding one-on-one to a character included in text information, such as, e.g. a title, sender, and message body, as for an incoming email, and text information or the like as for an email to be sent, generated through the operation of the operation device 500 or the like. The Braille conversion device 900 is one example of the “Braille pattern data generating device” of the present invention. Incidentally, in the embodiment, the Braille data pattern is drive data, used for the drive-control of the Braille display device 1100 performed by the Braille driving device 1000.

The Braille driving device 1000 is a drive mechanism including e.g. an electric actuator or the like, capable of making each of the Braille pins, which constitute the Braille display device 1100, emerge in the above-mentioned emerging direction, as occasion demands. Incidentally, the mechanism of displaying the Braille pattern via the Braille display device 1100 or the like can adopt various known aspects, and the detailed explanation thereof will be omitted here.

On the mobile phone 10, various control processes are performed by the CPU 100. Hereinafter, as the operation of the embodiment, the various control processes will be explained.

The mobile phone 10 having the above-mentioned structure can accurately and certainly notify a user of various events generated passively (i.e. in real time, regardless of the user's operation) on the mobile phone 10 by the drive-control of the Braille display device 1100 and the vibrator 8900 in the basic control process.

Now, with reference to FIG. 7, the processes for the passive various events will be explained. FIG. 7 is a view showing a correlation between the various events and the corresponding processes.

In FIG. 7, as the passive events, there are set a phone event and an email event. Namely, the phone event indicates the presence or absence of an incoming call from a third party, generated mainly in a user's absence or without the user's knowing (including the presence or absence of a message received by an answering machine). The email event namely indicates the presence or absence of an unread mail received mainly in a user's absence or without the user's knowing, or in an unread state though the user has already known the incoming mail.

In FIG. 7, four types of event states can be considered from the combination of the phone event and the email event; namely, beginning at the top, a case where there is no missed call nor unread mail (hereinafter referred to as a “first event condition”), a case where there is only a missed call (hereinafter referred to as a “second event condition”), a case where there is only an unread mail (hereinafter referred to as a “third event condition”), and a case where there are both a missed call and an unread mail (hereinafter referred to as a “fourth event condition”).

In the first event condition, the vibrator 800 is controlled into an inactive state, and the Braille display device 1100 is controlled into the above-mentioned reference state (i.e. in the state that all the Braille pins are stored in the storage holes).

In the second event condition, the vibrator 800 is controlled to vibrate in a pattern PTA, which is a vibration pattern set in advance as notifying the presence of a missed call. Moreover, the Braille display device 1100 is controlled into the reference state.

In the second event condition, the vibrator 800 is controlled to vibrate in a pattern PTB, which is a vibration pattern set in advance as notifying the presence of an unread mail. Moreover, the Braille display device 1100 is controlled into the fully raised state (i.e. in the state that all the Braille pins are raised).

In the fourth event condition, the vibrator 800 is controlled to vibrate in the pattern PTA, and the Braille display device 1100 is controlled into the fully raised state to show a difference from the second event condition.

Next, with reference to FIG. 8, the details of the basic control process will be explained. FIG. 8 is a flowchart showing the basic control process.

In FIG. 8, the CPU 100 judges whether or not there is a missed call (step A10). If there is a missed call (the step A10: YES), the CPU 100 further judges whether or not there is an unread mail (step A11).

If there is an unread mail (the step A11: YES), the CPU 100 operates the vibrator 800 in the pattern PTA (step A12), and also controls the Braille driving device 1000 to thereby drive-control the Braille display device 1100 into the fully raised state (step A13).

After the drive-control of the Braille display device 1100 and the vibrator 800, the CPU 100 drive-controls the display device 700 to thereby perform a missed call display, such as, e.g., displaying a message of “you have a missed call” on the display screen device 13 (step A14). Incidentally, this situation is equivalent to a situation where the above-mentioned fourth event condition is satisfied.

After the missed call display, the CPU 100 performs a call history information reading standby process, as one of sub routines. Incidentally, the explanation of the call history information reading standby process will be omitted. Incidentally, after the process in the step A14, the CPU 100 performs a Braille pattern data generation process, in parallel with the call history information reading standby process, as one of the sub routines. The Braille pattern data generation process will be discussed later.

On the other hand, if it is judged there is no unread mail in the process in the step A11 (the step A11: NO), the CPU 100 operates the vibrator 800 in the pattern PTA (step A15), enables the display device 700 to perform the missed call display (step A16), and performs the call history information reading standby process. Incidentally, this situation is equivalent to a situation where the above-mentioned second event condition is satisfied.

On the other hand, if there is no missed call (the step A10: NO), the CPU 100 judges whether or not there is an unread mail (step A17). If there is no unread mail (the step A17: NO), namely, in case of the above-mentioned first event condition, the CPU 100 performs a normal standby process. Incidentally, the normal standby process will be discussed later.

In the process in the step A17, if it is judged that there is an unread mail (the step A17:YES), namely, if the above-mentioned third event condition is satisfied, the CPU 100 operates the vibrator 800 in the above-mentioned pattern PTB (step A18), and drive-controls the Braille display device 1100 into the fully raised state (step A19).

After operating each of the vibrator 800 and the Braille display device 1100 in the appropriate pattern and mode, the CPU 100 performs the Braille pattern data generation process. After the Braille pattern data generation process, the CPU 100 drive-controls the display device 700 to display the unread mail in an enhancement state on the display screen device 13 (step A20). Incidentally, a user is the visually impaired and the display of information onto the display screen device 13 seems nonsense; however if the information is displayed on the display screen device 13, a surrounding third party may give an appropriate notification to the user, so that it is practically useful.

Next, with reference to FIG. 9, the Braille pattern data generation process will be explained. FIG. 9 is a flowchart showing the Braille pattern data generation process.

In FIG. 9, firstly, the CPU 100 temporarily stores, into the memory 600, mail data as for an email obtained via the communication device 200 (step B10). After storing the mail data into the memory 600, the CPU 100 analyzes the stored mail data and obtains the text information included in the email defined by the mail data (step B11). At this time, more specifically, kanji included in the email is converted into hiragana, and symbols are ignored. In the end, what is obtained is the text information formed of kana, numbers, and alphabets, i.e. the text information formed of only characters which can be expressed in Braille.

After obtaining the text information, the CPU 100 transfers the obtained text information to the Braille conversion device 900 (step B12). On the forwarding Braille conversion device 900, under the control of the CPU 100, the Braille pattern data corresponding to the transferred text information is generated correspondingly one-on-one to the characters constituting the text information.

The Braille conversion device 900 further sequentially stores the generated Braille pattern data into the memory 600 for each unread mail in accordance with the control of the CPU 100 (step B13). If the Braille pattern data as for all the mail data temporarily stored in the memory 600 is stored into the memory 600, the Braille pattern data generation process ends.

Next, with reference to FIG. 10, the normal standby process will be explained. FIG. 10 is a flowchart showing the normal standby process. Incidentally, in FIG. 10, the same or repeated processes as those in FIG. 9 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands. Incidentally, in the normal standby process, of course, functions assigned one-on-one to various operations performed in a standby state are performed, but showing all of their processing procedures is redundant. Also, for the purpose of preventing the complexity of the drawing, in FIG. 10, only a process as for the operation of a phone number (i.e. numbers) in a phone call will be explained.

In FIG. 10, the CPU 100 judges whether or not there is a user's operation (step C10). If there is no user's operation (the step C10: NO), the CPU 100 moves the process from the normal standby process as a sub routine to the basic control process as a main routine, and repeats the above-mentioned basic control process. Incidentally, in the process in the step C10, whether or not there is a user's operation is judged on the basis of, e.g., whether or not a time-out period set in advance has passed since the start of the normal standby process. Incidentally, as is clear from the basic control process, if there is no missed call, no unread mail, nor user's operation, the mobile phone 10 is practically controlled into the standby state.

If there is a user's operation (the step C10: YES), the CPU 100 judges whether or not the operated key is a key to which a number is assigned (hereinafter referred to a “number key”, as occasion demands) on the operation device 500 (step C11). Namely, the number key indicates any of the keys or the character keys other than the character keys 500j and 500l, out of the character keys provided for the operation device 500.

If the operated key is not the number key (the step C11: NO), the CPU 100 performs a process corresponding to the operation content. Incidentally, as already specified, the details of the various processes corresponding to the operation content will be omitted.

If the operated key is the number key (the step C11: YES), the CPU 100 drive-controls the display device 700, to thereby display a number corresponding to the operated number key on the display screen device 13 (step C12). At the same time, the CPU 100 stores, into the memory 600, number information for identifying the numbers (step C13). On the other hand, the number information stored in the memory 600 is transferred to the Braille conversion device 900 by the control of the CPU 100 (the step B12).

On the Braille conversion device 900, as already specified, the Braille pattern data corresponding to the transferred number information is generated. The CPU 100 controls the Braille conversion device 900 to supply the generated Braille pattern data to the Braille driving device 1000 (step C14).

The Braille driving device 1000 raises the Braille pins to be raised, out of the Braille display device 110, on the basis of the supplied Braille pattern data, to thereby display the Braille pattern (step C15).

Now, with reference to FIG. 11, an operation example of the Braille display device 1100 in the step in the step C15 will be explained. FIG. 11 is a schematic perspective view showing the Braille display device 1100. Incidentally, in FIG. 11, the same or repeated positions as those in FIG. 5 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 11, the Braille display device 1100 is normally set in the reference state (see the top), and in the process in the step C15 of FIG. 11, the Braille display device 1100 is controlled into a raised state which indicates that the Braille to be displayed from now is numbers (see the second top). Namely, the Braille pins 1112, 1114, 1115, and 1116 are raised. After that, all the Braille pins are stored into the storage holes once (see the third top), and then it is set into a state indicating the number of “1”; namely, only the Braille pin 1111 is raised (see the bottom).

As described above, in the embodiment, when one character is displayed, firstly, the attribute of the character to be displayed (e.g. classifications of numbers, characters, or alphabets, etc.) is displayed, and secondly the target character is displayed. Therefore, a user can recognize which Braille is currently displayed, without misunderstanding and quickly.

Incidentally, considering that it is necessary to pass through a plurality of display stages (i.e. as shown in FIG. 11, a stage of displaying the attribute, a stage of displaying the character, and a stage indicating their boundary (reference state)) in order to display one character, and further considering that there is likely a great difference in level of Braille proficiency for each user, the display period of the Braille patterns at a plurality of display stages, or the raising rate or lowering rate (i.e. storage rate) of each Braille pin, may be varied by the appropriate operation from the mode keys 16, the direction keys 14, or the operation device 500. For example, if a user has a high level of Braille proficiency, the display period may be changed to be shorter, or the raising or lowering rate may be changed to be faster. Such a change can be easily realized, for example, by controlling the output of an actuator, the drive duty control of an electro magnetic valve, or controlling a voltage to be applied to an electrode, which are associated with the Braille driving device 1000.

Back in FIG. 10, at this time point, if the operated number key is a key corresponding to “1”, the Braille pattern corresponding to “1” is displayed by the Braille display device 1100. After the display of the Braille pattern corresponding to “1”, the CPU 100 returns the process to the step C10, and repeats the series of processes.

Next, with reference to FIG. 12, the details of the unread mail reading standby process will be explained. FIG. 12 is a flowchart showing the unread mail reading standby process. Incidentally, in FIG. 12, the same or repeated positions as those in FIG. 10 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 12, if there is a user's operation (the step C10: YES), the CPU 100 judges whether or not the determination key 15 is operated (step D10). If the determination key 15 is not operated (the step D10: NO), as in FIG. 10, the CPU 100 performs the process corresponding to the operation content.

On the other hand, the unread mail is already enhancement-displayed (though which is not directly related to the user) by the process in the step A20 in the basic control process in FIG. 8, and in the embodiment, the determination key 15 is operated in this state, so that it is judged that the user's will to confirm the unread mail is displayed. Therefore, if the determination key 15 is operated (the step D10: YES), the CPU 100 controls the display device 700 to display the content of the unread mail on the display screen device 13 (step D11). Incidentally, in this step, the above-mentioned enhancement-displayed email is a display target. If there are a plurality of unread mails, for example, an email corresponding to the top (e.g. received at the earliest time point) or bottom (e.g. received at the latest time point) of an unread mail list may be a display target. In any cases, the user cannot visually confirm the display screen device 13, so that in which order to display unread mails in Braille may be set, individually and specifically, so as to reduce a load of the user who is the visually impaired, on the basis of experiments, experiences, or simulations or the like, in advance.

After the process in the step D11, the CPU 100 reads the Braille pattern data as for the unread mail stored in the memory 600 (step D12), and supplies the Braille pattern data to the Braille driving device 1000 to thereby display the unread mail as the Braille pattern through the Braille display device 1100 (the step C15). During the display of the unread mail, the characters constituting the unread mail described above are displayed in order by the Braille display device 1100 in the aspect described in FIG. 11.

On the other hand, during the display of the unread mail, sometimes, the user may feel like (s)he does not have to confirm the unread mail. Thus, the CPU 100 always judges whether or not there is an end operation while confirming the unread mail (step D13). The aspect of the end operation is not limited at all, and for example, it may be a predetermined operation of the mode keys 16, or the like.

If the end operation is performed (the step D13: YES), the CPU 100 moves the process to the basic control process. Incidentally, at this time point, the unread mail on which the end operation is performed is considered to be already used for the confirmation by the Braille display, and it is released from treatment as the unread mail.

If there is no end operation (the step D13: NO), the CPU 100 judges whether or not all the displays about one unread mail (i.e. a sent date and time, sender, subject, message body, etc.) are ended (step D14). If it is still during the display period of one unread mail (the step D14: NO), the CPU 100 returns the process to the step D13, and repeats the series of processes. If the displays about one unread mail are ended (the step D14: YES), the CPU 100 judges whether or not there is a next unread mail.

If there is no unread mail (i.e. if the Braille pattern data corresponding to the unread mail is not stored in the memory 600) (the step D15: NO), the CPU 100 moves the process to the basic control process. If there is the Braille pattern data as for the unread mail in the memory 600 (the step D15: YES), the CPU 100 returns the process back to the step D11 and repeats the series of processes.

Next, with reference to FIG. 13, another aspect of the normal standby process will be explained. FIG. 13 is another flowchart showing the normal standby process. Incidentally, in FIG. 13, the same or repeated positions as those in FIG. 10 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands. Incidentally, in the normal standby state, of course, functions assigned one-on-one to various operations performed in a standby state are performed, but showing all of their processing procedures is redundant. Also, for the purpose of preventing the complexity of the drawing, in FIG. 13, only a process as for an operation in newly creating an email will be explained.

In FIG. 13, the CPU 100 judges whether or not the user's operation is the operation of a mail creation key (step E10). The mail creation key herein may be set, for example, as one portion of the mode keys 16 in advance, or may be alternately defined by the operation of the determination key 15 or the like, which promotes the selection of a relevant menu on a menu screen linked from the mode keys 16.

If the user's operation is not the operation of the mail creation key (the step E10: NO), the CPU 100 performs the process corresponding to the operation content, as described above. If it is the operation of the mail creation key (the step E10: YES), the CPU 100 notifies the user of the selection of a mail creation mode, as audio information or the like obtained by controlling, e.g., the audio source device 400 and the audio processing device 300 or the like (step E11).

If notifying the selection of the mail creation mode, the CPU 100 holds the process until obtaining the user's input (step E12). In the input standby state, the CPU 100 judges whether or not an operation is performed by the operation device 500, i.e. whether or not the key associated with the email creation is operated (step E13).

If an operation is not performed by the operation device 500 (the step E13: NO), the CPU 100 judges whether or not another operation (i.e. an operation unrelated to the email creation) is performed (step E17). If another operation is not performed (the step E17: NO), the CPU 100 returns the process to the step E12 and maintains the input standby state. If another operation is performed (the step E17: YES), the CPU 100 performs the process corresponding to the operation content.

On the other hand, if an operation is performed by the operation device 500 (the step E13: YES), the CPU 100 determines a possible character (step E14). The plurality of characters are assigned in advance to each of the character keys constituting the operation device 500, so that merely operating (pressing) the character key does not make it certain which character a user desires to input. Thus, the CPU 100 determines one of the characters assigned to the operated character key as the possible character; for example, if the character key 500b is operated, the CPU 100 determines “a” to be the possible character. The determined possible character is displayed on the display screen device 13 through the drive-control of the display device 700 (the step C12).

After having the possible character displayed on the display screen device 13, the CPU 100 stores the text information related to the possible character into the memory 600 (the step B11), and further transfers the text information to the Braille conversion device 900 (the step B12). On the Braille conversion device 900, as already explained, the Braille pattern data as for the possible character is generated.

After the Braille pattern data as for the possible character is generated by the Braille conversion device 900, the CPU 100 transfers the generated Braille pattern data to the Braille driving device 1000. Then, through the drive-control of the Braille display device 1100 by the Braille driving device 1000, the possible character is displayed as the Braille pattern (the step C15).

After the possible character is displayed as the Braille pattern, the CPU 100 judges whether or not the possible character is determined as an input character (step E15). Here, whether or not to be determined as an input character is judged on the basis of whether or not the user has performed an operation (determination operation) for determining the possible character. Such a determination operation can adopt a plurality of aspects set in advance; however, for example, the operation of the key for promoting displacement to the right direction (e.g. the direction key located in the most right position) out of the direction keys 14 may be set as what corresponds to the determination operation.

If the user does not perform the determination operation (the step E15: NO), more specifically, if the operation for promoting the change of the possible character is performed through, for example, the operation of any of the direction keys 14, the CPU 100 returns the process to the step E14, determines another character which is assigned to the character key in which the operation is detected in the process in the step E13, and repeats the series of processes. On the other hand, if the user has performed the determination operation (the step E15: YES), the character displayed through the Braille display device 1100 is considered to be one character which constitutes the email, and the CPU 100 displaces a cursor position (input position) associated with the display screen device 13, returns the process to the step E12, and continues the process after the input standby status.

As explained above, according to the mobile phone 10 in the embodiment, the emerging state of each of the Braille pins on the Braille display device 1100 is variably controlled by the various processes performed by the CPU 100. Thus, the various information associated with the mobile phone 10, such as, e.g., the content confirmation of an incoming email, creation of an email, and a phone call, is provided for the user who is the visually impaired.

Particularly, here, on the Braille display device 1100, a contact point with the user (i.e. one example of the “perceptive point” of the present invention) is set on the rear side of the mobile phone 10 in accordance with the arrangement aspect of the Braille display device 1100. Therefore, if holding the mobile phone 10 in one hand, the user can perform the operations of the operation device 500, the direction keys 14, the determination key 15, and the mode keys 16 or the like, which are located on the front side, with, e.g. the thumb or the like, while perceiving the Braille pattern displayed by the Braille display device 1100 with the rest of the fingers holding the rear side. Namely, in the same manner as the unimpaired do, the user can hold and operate the mobile phone 10 in one hand, and the operability is remarkably improved as compared to the case where the both hands are forced to be used. As described above, according to the mobile phone 10 in the embodiment, it is possible to remarkably improve the operability in providing the information for the user in Braille.

Moreover, as shown in FIG. 3, on the mobile phone 10, at least each of the Braille pins used for the user's perception on the Braille display device 1100 disposed on the rear side of the mobile phone 10 can be displaced in the predetermined slide direction and it can be rotated in the predetermined rotational direction with the substrate 1110 by the operation of the fixing device 17. Thus, the position of the Braille display device 1100 with respect to the case 12 can be easily optimized depending on the user's physical features, such as the size and shape of the hand, and the user's way, feature, posture, and the like to hold the mobile phone 10. Namely, even from these points, the effect of the present invention is also effectively supported, which is improving the operability in providing the information for the user in Braille.

Incidentally, this is not practiced in the embodiment, but, for example, in FIG. 3, the convex 17a of the fixing device 17 may be made in a pin shape, and the depression in the groove 12a of the case 12 may be molded into a hole shape which fits the pin-shaped convex 17a of the fixing device 17, to thereby construct the mobile phone 10 so that the fixing device 17 can rotate in the vertical direction with respect to the sheet of paper of FIG. 3 (i.e. so as to be three-dimensionally displaced with respect to the case 12), with the pin-shaped convex as the rotation axis (i.e. with the A-A′ line in FIG. 3 as the rotation axis line).

Incidentally, in the embodiment, the aspect of raising the Braille pins on the Braille display device 1100 is not particularly specifically demonstrated, but for example, all the Braille pins may be simultaneously raised, or the Braille pins may be raised, with a time difference one another or in predetermined units. If there is the time difference, the time difference may be set from the right to the left, or from the left to the right, with respect to the A-A′ line in FIG. 3 as if, for example, the user traced the Braille pins with the finger. In this case, by increasing the number of the Braille pins on the Braille display device 1100 to thereby control the Braille pins so as to change the raising state of the Braille pins more continuously, the finger's tracing feeling can be recreated more precisely.

Incidentally, aside from whether or not the time difference is provided for the raising timing among the Braille pins, for example, some user may have an opposite feeling, compared to the normal case that the user senses Braille, with the Braille pins raised on the rear surface of the mobile phone 10. Alternatively, depending on whether the hand used to hold the mobile phone 10 is a right hand or a left hand, the feeling may be opposite in the same manner. In case that happens, e.g., the mode keys 16 or the like of the mobile phone 10 may have such a function assigned that converts the Braille pattern to a pattern which is left-right symmetric, up-down symmetric, or point-symmetric with respect to an arbitrary point. In this case, in response to the operation of the key, the Braille conversion device 900 may convert the once generated Braille pattern data so that it corresponds to the above-mentioned symmetric pattern. Alternatively, the Braille conversion device 900 may generate the Braille pattern data corresponding to such a symmetric pattern from the beginning.

Incidentally, some user may change the hand used to hold the mobile phone 10 during use or at each time of use for some reasons (e.g. change the left hand to the right hand). In that case, it is inefficient to force the user to operate the mode keys 16 or the like at each time. Moreover, considering that the user is the visually impaired, it can be said that some measures should be taken.

Thus, although this is not illustrated in FIG. 3, the mobile phone 10 may be provided with a single small sensor, preferably a plurality of small sensors or the like which can specify the relative position of the fixing device 17 or the Braille display device 1100 (or the substrate 1110) or the like with respect to the case 12 (e.g. a planar or three-dimensional rotation angle of the fixing device 17 with respect to the case 12, or an absolute position of the fixing device 17 on the case 12, or the like), with its electrical connection status with the CPU 100 maintained.

In this case, during actual use, the CPU 100 may keep monitoring the position of the fixing device 17 or the Braille display device 1100 detected by the sensors, and on the basis of the detected position, the CPU 100 may judge which hand of the user is currently used to operate the mobile phone 10, in accordance with a correlation with the actually used hand and the position, which is obtained in advance experimentally, experientially, or by simulation or the like, or in accordance with algorithm or the like set in advance.

Moreover, the CPU 100 may further judge whether the Braille pattern is to be displaced symmetrically with respect to the display aspect at the current time point as described above, or to be displaced as normal (which herein means that the pattern is not dare to be symmetric), in accordance with the judgment result about the hand used for the actual use, and make the Braille pattern emerge which is suitable for the hand the user uses to hold the mobile phone 10, automatically without a special operation by the user.

Incidentally, in the embodiment, on the Braille display device 1100, the raising direction of the Braille pins is set on the rear side of the mobile phone 10. However, the setting position of the perceptive point is not limited to the rear side as long as the user performs the various operations associated with the mobile phone 10 (the operations of the direction keys 14, the determination key 15, the mode keys 16, and the operation device 500 or the like) with the mobile phone 10 held in one hand and the user can easily and certainly perceive or sense the Braille pattern displayed in accordance with the emerging state of the Braille pins. For example, the mobile phone 10 may be constructed such that the Braille pins are raised, for example, on the side surface portion. Alternatively, in view of the three-dimensional shape of the case 12, if the two sides (i.e. front and rear sides) can be hardly defined, the raising direction of the Braille pins is not necessarily set with the particular concept of two sides. As long as the user holds the equipment in one hand and can easily perform the two different operations in one hand which are to operate the equipment and to perceive the Braille pattern, the physical, electrical, mechanical, or mechanistic aspect of the Braille display device and its position may be arbitrarily determined.

Second Embodiment

Next, with reference to FIG. 14, a versatile Braille output apparatus 20 will be explained as a second embodiment of the present invention. FIG. 14 is a schematic perspective view showing the versatile Braille output apparatus 20. Incidentally, in FIG. 14, the same or repeated positions as those in FIG. 1 carry the same numerical references, and the explanation thereof will be omitted, as occasion demands.

In FIG. 14, the versatile Braille output apparatus 20 is one example of the “versatile Braille output apparatus” of the present invention, having a finger-cot shaped substrate 21 which is made of resins and is relatively soft.

The user can insert the finger into the substrate 21 in the illustrated insertion direction. While the user's finger is inserted, stretchable rubber bands 22 located in two positions of the substrate 21 can fix the user's finger to the versatile Braille output apparatus 20. Namely, the substrate 21 and the rubber bands 22 constitute one example of the “jointing device” of the present invention.

The side surface of the substrate 21 is connected to a connecter 24 through a signal cable 23, and the signal cable 23 is electrically connected to a not-illustrated driving system and control system inside the substrate 21.

On the internal surface of the substrate 21 which is cylindrically formed, the same types of Braille pins as those in the above-mentioned first embodiment of the Braille display device 1100 are set to emerge with respect to the internal surface, near a place on which the ball of the fingertip abuts while the finger is inserted. The driving system and the control system included in the substrate 21 include the Braille driving device 1000 for driving the Braille display device 1100, the Braille conversion device 900, and the CPU 100 or the like, and these devices can variably control the emerging state of the Braille pins.

In such a structure, the connecter 24 obtains, from various electronic equipment electrically connected with the connector 24, such as, e.g. a mobile phone, PDA, and various remote controllers, information corresponding to functions performed on the electronic equipment, e.g. the various key operations or the like in the first embodiment described above, as an electrical signal or the like. The information corresponding to the functions performed on the electronic equipment is displayed as the Braille pattern through the process or control associated with the Braille conversion device 900, the Braille driving device 1000, and the Braille display device 1100, as in the above-mentioned embodiment.

As described above, the versatile Braille output apparatus 20 has such a structure that the portion associated with the Braille display is independent, compared to the first embodiment. As long as the versatile Braille output apparatus 20 is the electronic equipment adapted to supply the information corresponding to the performed functions, preferably, the character information corresponding to the performed functions as an electrical signal through the connecter 24, the same effects as those in the first embodiment can be provided for the user without limiting the connection target. Namely, it is possible to remarkably improve the operability in providing the information for the user in Braille.

The invention may be embodied in other specific forms without departing from the spirit or essential characteristics thereof. The present embodiments are therefore to be considered in all respects as illustrative and not restrictive, the scope of the invention being indicated by the appended claims rather than by the foregoing description and all changes which come within the meaning and range of equivalency of the claims are therefore intended to be embraced therein.

The entire disclosure of Japanese Patent Application No. 2006-122678 filed on Apr. 26, 2006 including the specification, claims, drawings and summary is incorporated herein by reference in its entirety.

Mobile information input/output apparatus and versatile braille output apparatus

Information

Publication Number

Date Filed

Date Published

Inventors

Original Assignees

CPC

US Classifications

International Classifications

Abstract

Description

Claims

Priority Claims (1)