Patent Grant
11514817
The field of invention generally relates to braille learning systems and devices for blind and visually impaired individuals and more specifically relates to a smart interactive electronic braille learning device for inputting and outputting braille content.
Braille is used by blind and visually impaired individuals for reading and writing text. There are a wide range of systems that are available for these purposes. With the advancement in the technology, many of the visually impaired individuals have started using portable braille devices for taking notes. These portable braille devices include input and output interfaces for entering and displaying braille content respectively. The input interface is typically a braille keyboard while the output interface is a refreshable braille display. Each Braille cell typically includes a plurality of electromechanically controlled pins or dots which can be selectively moved up and down to enable tactile braille reading.
There are millions of visually impaired people in the world. Considering that a tactile medium is the only way in which the visually impaired can read and write, it is extremely important for them to learn Braille. There is a direct correlation of low braille literacy and unemployment among the visually impaired. Even in developed countries, braille literacy rates are extremely low. The pedagogy of braille education for all these people has not seen a change since a very long time. The conventional method of learning Braille is not suited for self-learning and requires continuous one to one support from a special education teacher. There is an acute shortage of teachers trained to cater to the needs of visually impaired (VI) students. Mainstream teachers and parents cannot participate in the education of VI students
Education for visually impaired has not undergone the shift to digitization of learning pedagogy unlike those for sighted students. There is a lack of on-demand learning content, and collaborative classroom learning. There is no interactive content with instant feedback or live monitoring and analytics on learning outcomes. There is a huge opportunity to improve the efficiency and quality of education for the Visually Impaired.
The patent document JPH06289774A titled “Braille learning device” discloses a device for learning braille such that the contents of braille are confirmed by audio when the characters and the sentences on a braille sheet is traced by a finger. The learner learns braille by himself through the perception of braille on the static braille sheet and the audio output. There are sensors in the device which identify the sheet number hence plural braille sheets can be used and many texts can be studied using this device. However the device does not mention digitizing of braille pedagogy to accomplish step-wise learning.
Patent document U.S. Pat. No. 5,725,379A titled “Braille learning apparatus” relates to a braille learning apparatus for use with a computer. It comprises of a set of tactile flash cards having a pattern of braille dots embossed on it and electrically connected contacts at specific positions. There is a correspondence between the pattern of the braille dots on the card and the contact position which can be sensed by flash card reader. However, it does not mention the learning of braille using audio-tactile means.
The Russian patent document RU2662139C1 titled “Device for fine dotted braille training of blind and visually impaired children” discloses a hand-held device with better training and increased speed of associating tactile-practical perception of braille code with an audio symbol by a child. It contains a PCB with speaker, an indicator and chip for converting braille alphabetic character into audio symbols of Russian alphabet and numeric signs of Braille to audio symbols of numerals.
Thus, there is a need to digitize the pedagogy of Braille and deliver it in an audio-tactile format using hardware, software and braille content to make braille learning easy and possible even without the help of a teacher.
The present invention provides a completely digitized, smart and interactive touch based system for Braille learning. It includes a digitized version of the entire braille pedagogy that is followed across the globe. The system includes audio-tactile input and output modules that allow users to interface with it. The input modules include a braille keyboard and digitized version of braille slate and stylus. The braille keyboard facilitates learning how to type in Braille. Slate and stylus are a primitive tools used by Visually impaired people for writing achieved by means of embossing dots on the back side of paper. The digitized version of slate eliminates need for paper and facilitates learning how to write in Braille.
The output modules include plurality of enlarged and regular braille display cells. The enlarged cells are essentially scaled up versions of a regular braille display cells. The enlarged cells help users who are beginners or early learners to easily identify position and combinations of dots for different characters. The user then moves to reading on the regular braille display cells. It helps user learn to read by developing the tactile sensitivity in their fingertips.
The foregoing and other features of embodiments will become more apparent from the following detailed description of embodiments when read in conjunction with the accompanying drawings.
The embodiments of the present invention will now be described in detail with reference to the accompanying drawings. However, the present invention is not limited to the embodiments. The present invention can be modified in various forms. Thus, the embodiments of the present invention are only provided to explain more clearly the present invention to the ordinarily skilled in the art of the present invention. In the accompanying drawings, like reference numerals are used to indicate like components.
The specification may refer to “an”, “one” or “some” embodiment(s) in several locations. This does not necessarily imply that each such reference is to the same embodiment(s), or that the feature only applies to a single embodiment. Single features of different embodiments may also be combined to provide other embodiments.
As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless expressly stated otherwise. It will be further understood that the terms “includes”, “comprises”, “including” and/or “comprising” when used in this specification, specify the presence of stated features, integers, steps, operations, elements and/or components, but do not preclude the presence or addition of one or more other features integers, steps, operations, elements, components, and/or groups thereof. As used herein, the term “and/or” includes any and all combinations and arrangements of one or more of the associated listed items.
Unless otherwise defined, all terms (including technical and scientific terms) used herein have the same meaning as commonly understood by one of ordinary skill in the art to which this disclosure pertains. It will be further understood that terms, such as those defined in commonly used dictionaries, should be interpreted as having a meaning that is consistent with their meaning in the context of the relevant art and will not be interpreted in an idealized or overly formal sense unless expressly so defined herein.
The present invention is a completely digitized, smart, interactive touch-based system for Braille learning. The invention is optimized to deliver a complete braille literacy solution helping a user to learn to read, write and type in Braille. The system may also be used as a platform for delivering any kind of interactive audio-tactile content thus serving as an educational tool for the visually challenged.
According to the present invention, the external power supply (101) provides electric power to the Power and battery management system (102) which in turn powers the entire system. The Power and battery management (102) system regulates and switches the input supply voltage to necessary lower voltage levels required by the individual modules namely the battery (104), the microcontroller (106), the actuator drivers (107) and (109), audio amplifier (112) and vibration motor driver (118). In the absence of the external power supply (101), the power and battery management system (102) detects the same and the system is now powered via the battery (104). It also monitors the health and the charge level of battery and ensures the charging and discharging happen within the permissible voltage levels.
The power switch (103) is used to turn the system ON or OFF. It is a simple toggle/rocker switch. A rocker switch is better ergonomically compared to a push button type switch, as a user can easily identify the state (ON/OFF) by the position of the switch. On indication LED (105) is used to indicate the state of the system visually to a sighted user/companion. Glowing LED indicates that the system is ON. Proximity touch sensor (120) is placed near the power switch (103) and is provided as another mode of input to the system. It serves the purpose of indicating the state of the system to a visually impaired user via vibration. It reads an input when the user taps/touches the pad, the same is read by the microcontroller (106) which then sends a signal to the vibration motor driver (118) to intermittently rotate the vibration motor (119) producing vibration. A single touch makes the vibration motor run for a short burst indicating that the system is ON. A double touch is used to repeat the last audio instruction. The vibration motor driver (118) causes the vibration motor (119) to rotate intermittently causing a controlled vibration based on the signal from the microcontroller (106). The vibration is used as another haptic mode of output to indicate different states like incorrect answer, acknowledgement of an input etc.
The digital braille slate (116) is incorporated as an input method for the system allowing a user to input braille by means of writing. It is a digitized version of a conventional braille slate which is used by visually impaired people to write braille on paper. The user places the paper inside the slate (116) and dots are embossed on it using a stylus. The user then has to remove the paper out from the slate and flip it to read the dots embossed.
The amplifier module (112) amplifies the audio signals received from the microcontroller (106) and directs them to the speaker (113). An audio jack (114) is provided to route the audio signal out of the system to an external speaker or a headphone. A volume control knobs (115) helps to attenuate the sound output level.
According to the present invention, the smart interactive system further comprises large braille display (110) having two large braille cells. They are enlarged refreshable braille cells of 3×2 matrices each. The smart interactive system (100) further comprises the standard braille display (108) and a row of standard braille cells. These standard braille cells are 6 in number, all in one row. Each standard braille cell is of 8 dots with 4*2 matrices. The digital braille slate (116), the large braille display (110) and the standard braille display (108) as mentioned earlier could include any number of braille cells by increasing the row size to fit the required number of braille cells. All the communication that happens between the functional modules is through I2C serial communication.
According to the present invention, the actuator drivers (107) and (109) make up the bulk of the electronics for both the large cell and standard cell display. These actuator drivers (107) and (109) are powered by the Power and battery management system (102) and interface with the microcontroller (106) through serial communication and are responsible for driving the electromagnetic actuators of the large and standard braille displays (108) and (110), as required. A different combination of actuators triggered forms a combination of dot pattern representing a particular braille character.
According to an embodiment of the present invention, a large braille display (110) includes 2 large braille cells. Each braille cell on the display includes 6 pins arranged in 3 rows and 2 columns matrix. Each pin can be raised and lowered individually via dedicated electro-mechanical actuators facilitating display of different characters. The matrix is scaled up compared to the conventional standard size of a braille cell, thus making it highly convenient for users to identify individual dots, patterns and combinations. The raising and lowering of individual pins is achieved by a linear actuation mechanism of the electromagnetic actuators.
The actuator feedback (111) includes a series of proximity sensors used to make the system of two large braille cells a closed loop system. The proximity sensors could be either based out of contact, capacitive, inductive or Hall Effect based. The proximity sensors detect the position of the actuators that is, whether they are linearly extended or retracted and communicate the same to the microcontroller (106). If the system of actuators behaves in a way other than the intended, actuator feedback system (111) sends relevant signals to the microcontroller (106) which sends corrective signals accordingly back to the actuator driver (109) thereby making the entire system response more accurate and reliable.
According to an embodiment of the present invention, the standard braille display (108) consists of a row of refreshable tactile braille display cells. Any kind of braille text can be displayed on the standard braille display and the user can read them with their fingertip. While the large braille display (110) helps a user to identify and learn dot patterns, repeated practice of reading over the standard braille display (108) would help them develop the tactile sensitivity on their fingertip needed to read braille. Any system of known prior art technologies of refreshable braille display can be used for this module.
The proposed system also includes a USB port/s, and a LAN port, wireless Wi-Fi and Bluetooth connectivity. All the above mentioned modules interface with a central microcontroller (106). The microcontroller (106) in turn controls all the modules, as per predefined software, together forming a complete voice and tactile data input-output learning system.
According to the proposed solution, the smart interactive system is the only system that teaches braille reading, writing and typing through interactive audio-tactile lessons. The proposed system involves a wide range of multilingual content which are structured as lessons of gradually increasing levels of difficulty.
The content helps the user to self-improve each of the aforementioned braille literacy skills through real-time corrective feedback and reinforcement of the corrections over time. The system also allows the user to practice and build their braille proficiency through multiple game-based content pieces aimed at improving reading, writing and typing rates and vocabulary. Furthermore, in a classroom setting users receive leaderboard info for each lesson making the learning experience engaging and collective. Each lesson is modeled as a directed graph of elementary lesson interactions encoded as a JSON which the software can parse and execute.
As shown in
The present invention addresses the pain points of low braille literacy among the visually impaired by helping them learn how to read, write and type in braille. The proposed system could be used directly by the children and young people with visual impairment to self-learn braille and be remotely monitored by the teachers or parents. The system introduces collective and competitive learning, provide access to various braille based content and bring in easy tracking of progress.
All equivalent relationships to those illustrated in the drawings and described in the application are intended to be encompassed by the present invention. The examples used to illustrate the embodiments of the present invention, in no way limit the applicability of the present invention to them. It is to be noted that those with ordinary skill in the art will appreciate that various modifications and alternatives to the details could be developed in the light of the overall teachings of the disclosure, without departing from the scope of the invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201841006427 | Feb 2018 | IN | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/IB2019/051370 | 2/20/2019 | WO |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2019/162848 | 8/29/2019 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 924012 | Stamps et al. | Jun 1909 | A |
| 5161975 | Andrews | Nov 1992 | A |
| 5725379 | Perry | Mar 1998 | A |
| 9105196 | Dobbs | Aug 2015 | B2 |
| 20040091842 | Carro | May 2004 | A1 |
| 20050117952 | Damery et al. | Jun 2005 | A1 |
| 20160232817 | Djugash | Aug 2016 | A1 |
| Number | Date | Country | |
|---|---|---|---|
| 20210082313 A1 | Mar 2021 | US |
