Patent Application
20140251396
The present invention relates to an electronic travel aid (ETA) for visually impaired and blind people (subject). Advantageously, the electronic travel aid of the invention has been developed with minimum physical interface and is adapted to perform real-time navigation without digital camera and complex hardware. Importantly also the electronic travel aid relates to real-time situations with speech messages stored in flash memory for aiding the visually impaired/blind people. The electronic travel aid can be provided involving wireless or wired technology and is directed to serve as a low-cost, robust, reliable and user-friendly solution for blind/visually impaired navigation.
As per 2009 survey conducted by World Health Organization (WHO), there are 314 million visually impaired and 45 million blind people world-wide. Certainly reliable and affordable solution for providing mobility aid to the visually impaired has significant social and commercial interest for government, laboratories and industry.
Existing electronic travel aids (ETAs) are inclined to use computer vision based navigation with stereo digital cameras and multiple sensors, like ultrasonic, optical, LASER, sonar etc. Inventors have used Global Positioning System (GPS), Radio Frequency identification, Bar-code technology in blind navigation.
Existing high end systems are promising, but are much bulkier, costlier, have maximum physical interface and require long training.
Although there are several obstacle detector/surveillance systems and/or electronic travel/mobility aid system available in the market to assist the visually impaired there is a need in the art to develop such systems that on hand would be economical and hence would be affordable and on the other hand will be simple involving minimum physical interface and would be able to perform real-time navigation without the involvement of digital camera and complex hardware and yet relate to real-time situations with possible speech alerts and also including safety indicators for detecting smoke, liquid and metal favoring wide scale acceptance as an aid to the visually impaired/blind people.
Thus the primary object of the present invention is to provide for electronic travel aid (ETA) for Visually impaired and blind people with minimum physical interface for real time navigation of real-time situations which would enable detection of object/obstacle from ground level height to head level height in front, left and right direction.
Another object of the present invention is directed to provide for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time situations which would enable detection of staircase and assistance for up stair & down stairs with better and safe indication system.
Another object of the present invention is to provide for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time situations comprising safety indicators for the detection of smoke, liquid and metal and including means for conveying the said detected condition to the subject through speech based announcement means incorporated in the said system.
Yet another object of the present invention is to provide for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time situations that would enable detection of non-formal/formal obstacles distance scaling for detected obstacles including provision of speech based announcement.
A further object of the present invention is directed to providing for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time situations which would have the desired flexibility of any language for speech warning messages thereby further benefiting the visually challenged persons from every walk of life.
Yet another object of the present invention is directed to provide for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time situations which could be adapted to favor both wired or wireless communication with the subject.
Another object of the present invention is to provide for electronic travel aid (ETA) for visually impaired and blind people with minimum physical interface for real time navigation of real-time, situations that would be reliable, cost-effective and consume less power in being light weight, portable and strong to resist weathering, and which would also require less training time to be a user-friendly solution for blind navigation.
The basic aspect of the present invention is thus directed to an electronic travel aid enabling real-time navigation for visually impaired and blind people comprising:
a walking stick like implement/cane comprising selectively disposed object/obstacle detection sensor means and safety indicating sensors selected from anyone or more of smoke detection sensor, liquid detection sensors, metal detection sensor; microcontroller and transceiver means adapted to receive the sensor inputs and generating outputs for assisting the visually impaired and blind people; and operative power source.
A further aspect of the present invention is directed to an electronic travel aid comprising:
transmitter part embedded in said walking stick like implement/cane preferably having a grip means at the front including (a) ground level to waist level object/obstacle detection sensor means comprising eight ultrasonic sensors mounted within comprising of four ultrasonic sensors mounted on front side, two sensors on back side, one sensor on left side and one sensor on right side and (b) said safety indicating sensors comprising embedded ultrasonic sensor pairs including smoke/fire detection sensor, liquid detection sensor and metal detection sensor (c) said microcontroller and wireless transceiver means;
operatively connected receiver part comprising wireless transceiver, microcontroller and audio means adapted to generate audio outputs preferably selected from buzzer, pre-recorded messages/speeches, audio recording and playback flash memory for generating outputs for assisting the visually impaired and blind people; and
operative power source including preferably operable at single positive 9V DC power supply.
A still further aspect of the present invention is directed to an electronic travel aid wherein the disposition of the said four ultrasonic sensors mounted on front side, two sensors on back side, one sensor on left side and one sensor on right side and (b) said safety indicating sensors comprising embedded ultrasonic sensor pairs including smoke/fire detection sensor, liquid detection sensor and metal detection sensor are selectively provided based on the height of the travel aid keeping in view the height/comfort of the visually impaired and blind person.
A still further aspect of the present invention is directed to an electronic travel aid comprising means for data collection and processing (DCPS) involving (i) DCPS vision section comprising a network of said ultrasonic sensor pairs adapted for object/obstacle detection from ground level to waist level height of the subject in front, left and right side including staircase detection, up stair and down stair application (ii) DCPS safety section comprising said network of smoke, liquid and metal detection sensors adapted to avoid life threatening injuries by conveying to the subject the presence of smoke, fire, gas, presence of liquid/water spillage on the floor and also the presence of metallic fencing, metallic casing, metallic floor and (iii) DCPS decision and control section comprising an 8-bit microcontroller adapted for processing real-time data collected by the sensors placed in said vision and safety sections thus enabling real-time navigation performed with scaled obstacle distance warning and effective usage of interrupts of adapted to invoke the stored pre-recorded speech messages based on the real-time detected and understood situations through repeated sampling of data before communicating a decision; and means for speech/audio announcement section (SAS) including speech announcement which are operatively connected through wireless/wired modes with language flexibility for conveying detected conditions to the subject preferably involving audio recording and playback flash memory with capacity to store speech messages with desired duration with a specific control on the number of messages that may be increased by reducing the duration of each message also involving universal language to record speech warning messages to thereby invoke a relevant message from flash memory to be conveyed to the subject through a headphone/ear phone for the purpose of alerting the subject on the detected obstacle/situation.
A still further aspect of the present invention is directed to an electronic travel aid wherein the wireless mode of connectivity is through half duplex wireless communication including a radio frequency modem preferably 2.4 GHz operated Radio Frequency (RF) modem and a baud rate 9600 bits per second (bps) communication and said wired mode of communication includes detachable connector between DCPS and SAS.
A still further aspect of the present invention is directed to an electronic travel aid wherein front four sensors adapted for detection of ground level to waist level object/obstacle in front direction with the lower three ultrasonic sensors in front direction enable detection of up staircase, the Left and right sensors are adapted for detection of left and right side object/obstacle and two ultrasonic sensors are mounted on lower back-side are exclusively used for detection of down staircase.
A still further aspect of the present invention is directed to an electronic travel aid wherein the said lower three ultrasonic sensors in front direction enable detection of up staircase, an interrelated structured pattern of distance variation detected by these three sensors is involved for detection of staircase with repeated sampling of data for concluding staircase detection and subject can up stair and can understand the end of staircase with the help of stored speech messages and wherein the two ultrasonic sensors mounted on lower back-side of said cane are exclusively used for detection of down staircase and the subject can down stair and can understand the end of staircase with the help of stored speech messages.
A still further aspect of the present invention is directed to an electronic travel aid wherein said sensor means for the detection of staircase comprise first front lower sensor (s1), second front lower sensor (s2), third front lower sensor (s3), Front upper sensor (s4), first rear lower sensor (s5), second rear lower sensor (s6), left side sensor (s7) and right side sensor (s8) and said microcontroller and transceiver means is adapted to detect staircase based on said sensor inputs based on:
d(s4)≅d(s3)+x+e (1)
d(s3)≅d(s2)+x+e (2)
d(s2)≅d(s1)+x+e (3)
A still further aspect of the present invention is directed to an electronic travel aid which is adapted to calculate dynamic distance of the object/obstacle from subject involving ultrasonic sensor and microcontroller means and also the floor status including dry, wet, metallic, non-metallic as well as generate safety indications on detection of smoke/fire.
Yet another aspect of the present invention is directed to an electronic travel aid comprising two liquid detection sensors and one metal detection sensor wherein two probes of the first liquid detection sensor are mounted spaced apart on the bottom periphery of the said walking implement/cane and the said metal detection sensor is mounted inside at about 2 cm height from ground, two probes of the second liquid detection sensor are insulated and mounted above metal detection sensor such as to distinguish between metal and liquid based on the following:
A still further aspect of the present invention is directed to an electronic travel aid comprising non formal distance scaling involving gait analysis of visually challenged subjects and determining average step length (40 cm) while normal walking which is related to measure distance of obstacle in the front direction for non-formal distance scaling wherein full distance detection range in front direction is divided into integer multiples of said average step length (40 cm) and following:
d(s) detected obstacle distance
m no. of steps required to reach obstacle
p remainder
whereby based on values of m and p, generate required non-formal distance scaling.
A further aspect of the present invention is directed to an electronic travel aid adapted for generating dynamic distance of the object/obstacle from subject involving said ultrasonic sensor and microcontroller and integrating non-formal distance scaling with speech messages with choice of full range non-formal distance scaled warning messages in terms of hand or step (Gait analysis based) distances preferably indicative of
According to yet another aspect of the present invention is directed to an electronic travel aid comprising microcontroller means adapted for way-finding with reduced information overload whereby in each sensor cycle (ψ), eight ultrasonic sensors are fired in consistent sequence to generate:
ψ=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt (6)
where,
F(s1,s5,s6) simultaneous firing of s1, s5 and s6 ultrasonic sensors
wt waiting time (35 ms)
and wherein such two sensor cycles ψ(i) and ψ(i+1) for recording average distance values detected by individual sensor are involved and implemented with reduced information overload (WRIO), by generating a logical map of surrounding correlating sensor outputs and offer optimized need basis information to the subject with, minimal occlusion of external acoustic signals such that when it infers the presence of the up or down staircase it is adapted to invoke the dedicated routine, where it adaptively fires respective sensors and performs dedicated processing of staircase related data to lead to a practical decision.
A still further aspect of the present invention is directed to an electronic travel aid wherein it maintains a safety margin distance for walking and adapted to avoid collision with possible obstacles in front, left and right direction preferably with variable frequency buzzer beeps for staircase navigation.
A still further aspect of the present invention is directed to an electronic travel aid adapted for maintaining said reduced information overload comprising:
ψ(i)=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt
ψ(i+1)=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt
The present invention is described in greater detail in relation to the non-limiting examples and the accompanying figures.
a): Detection of up staircase and assistance for up stair, 7(b): Detection of down staircase and assistance for down stair, 7(c): Detection of metallic floor and assistance for navigation.
The above electronic travel aid (ETA) for visually impaired and blind people is thus specifically provided to perform real-time navigation without digital camera and complex hardware and is a true embedded system integrating eight ultrasonic sensor pairs, one smoke (in turn fire) detection sensor, two liquid detection sensors, one metal detection sensor, audio recording and playback flash memory, headphone and buzzer with microcontroller. VENUCANE detects obstacles in front, left and right directions in the range of 5 meters. It can understand floor status (dry/wet/metallic/non-metallic). It can also detect smoke (in turn fire) in the range of 5.30 meters. It keeps conveying all detected and understood situations to subject with pre-recorded speech messages. It offers a wireless/wired low-cost, robust, reliable and user-friendly solution for blind navigation.
VENUCANE is much like white cane. Subject holds the VENUCANE in front of himself/herself while walking. It is audio assisted true embedded navigation system for visually impaired and blind people. VENUCANE is operated at single positive 9V DC power supply.
Reference is invited to accompanying
VENUCANE offers both, wireless or wired connectivity between transmitter and receiver. The actual photographs of the VENUCANE system are shown in
The electronic travel aid (ETA) for visually impaired and blind people/VENUCANE according to the present invention uses a different approach for blind navigation involving:
Detection of Object/Obstacle from Ground Level Height to Head Level Height in Front, Left and Right Direction by Customized Cane Design:
Accompanying
Using four front sensors, detection of ground level to waist level object/obstacle in front direction is done. Left and right sensors are mounted at waist level height. Detection of left and right side object/obstacle is done using these two side sensors. With offered VENUCANE usage training subject can hold the cane at center putting fingers on grip to detect the head level object/obstacle in any direction. In such situations grip holding keeps correct sensor alignment. Back-side two sensors are used for down stair.
Arrangement of four front side and two rear side ultrasonic sensors on the VENUCANE are used for detection of narrow openings, up and down staircase. VENUCANE infers presence of up staircase in front direction from 139 cm.
VENUCANE uses a new scheme of integration of sensor cycles outcome, beam width calculations and Standard Residential Code for staircase building for detection of up and down staircase. When an ordered structured pattern of distance variation is detected as per formulated mathematical model, presence of up or down staircase is announced. After detecting the drop-off of the top step, VENUCANE ensures presence of pothole or the down staircase using s1, s5 and s6. As per Standard Residential Code for staircase building, table 2 shows maximum dimensions for stair width, tread depth (part of the staircase that is stepped on) and riser height (vertical portion between each tread on the stair). Subject can go upstairs or downstairs with audio assistance and can understand the end of staircase with the help of speech message. An algorithm for detection of staircase is presented below.
d(x) distance detected by a sensor (cm)
x tread depth (cm)
e error between theoretical and actual reading
Riser height and tread depth
d(s4)≅d(s3)+x+e (1)
d(s3)≅d(s2)+x+e (2)
d(s2)≅d(s1)+x+e (3)
Two ultrasonic sensors are mounted on lower back-side of VENUCANE. These two sensors are placed as per distance details shown in table 1 and are exclusively used for detection of down staircase. Subject can down stair and can understand the end of staircase with the help of stored speech messages. Range of these two sensors are deliberately kept from 0 cm to 20 cm. VENUCANE uses ultrasonic sensors for object/obstacle detection, staircase detection, up stair and down stair application. An ultrasonic sensors work on echoes from sound waves, ambient light/conditions does not affect them. Ultrasonic sensor distance range (5 meter) and performance is extremely better than infra-red sensors (Prior art: RecogizeCane). Infra-red sensors support very small distance range (few centimeters) for operation, may be falsely triggered at ambient light/conditions and give wrong results.
While walking on indoor or outdoor environment, surrounding as well as floor/surface information is very important for subject. For understanding such information, VENUCANE uses smoke (in turn fire) detection sensor, liquid detection sensors and metal detection sensor. Life threatening injuries can be avoided by having such information well in advance.
With the help of smoke and gas detector sensor, subject can understand the presence of smoke/fire/gas leakage from a far distance.
With the help of metal detector sensor, subject can understand metallic floor, metallic fencing/casing etc.
Presence of liquid can be understood with the help of liquid detection sensor. Nowadays marbled tiles are commonly used for flooring. If water spills on these surfaces, even a normal person will not be able to notice it. If the floor is wet and becomes slippery, subject may fall down and it may lead to life threatening injuries. In such situations, VENUCANE alerts the subject in advance. Liquid detection sensor probes are mounted on the bottom periphery of the cane. VENUCANE gives highest priority to safety of the subject. Table 3 shows VENUCANE supported priority structure for safety indicators.
In VENUCANE, Safety indications are implemented using external interrupts of microcontroller. Smoke detection is implemented with external interrupt 0 and liquid as well as metal detection is implemented with external interrupt 1 of microcontroller. VENUCANE uses different approach for correct understanding of presence of liquid and metal on the floor.
Liquid detection sensors works on the conductivity principle. Liquid detection sensor has two probes (wires). When these probes comes on the liquid (water, milk, oil, mud, etc) based on conductivity, sensor understands the presence of liquid. Metals are the prime conductors. When these probes come on metal, due to metal conductivity, liquid detection sensor wrongly identify metal as liquid. (Prior art: RecognizeCane)
VENUCANE uses two liquid detection sensors and one metal detection sensor for correct understanding of liquid and metal on the floor. Two probes of first liquid detection sensor are mounted on the bottom periphery of the VENUCANE with some spacing. Metal detection sensor is mounted inside at 2 cm height from ground. Two probes of second liquid detection sensor are insulated and are mounted above metal detection sensor. VENUCANE discriminates presence of liquid and metal based on Table 4.
As per prior art, many inventors have detected the distant object/obstacle around the subject. Inventors have represented the distance of the obstacle from subject with tactile sensors, haptics or buzzer based audio frequency clips. Some have used text to speech conversion for announcing such distance.
VENUCANE calculates dynamic distance of the object/obstacle from subject using ultrasonic sensor and microcontroller. It can understand 5 meters distant object/obstacle in any direction. VENUCANE can announce calculated real time distance as it is in meters or centimeters using speech messages. To make distance understanding more appealing VENUCANE uses non-formal obstacle scaling approach. Sample non-formal obstacle distance scaling is shown in Table 5.
Based on Gait analysis of visually challenged subjects, average step length (40 cm) is found while normal walking and can be related with distance of obstacle in the front direction for non-formal distance scaling. Full distance detection range in front direction can be divided into integer multiples of 40 cm.
Based on values of m and p, effectively non-formal distance scaling can be accomplished. Gait analysis based sample non-formal distance scaling messages for front direction are presented in table 6.
Choice of full range non-formal distance scaled warning messages in terms of hand or step (Gait analysis based) distances is given to the subject. Default operation uses hand distance based non-formal distance scaling.
As per prior art, many inventors used vibration array, buzzer based audio frequency clips or text to speech conversion for announcing any detected condition to the subject. VENUCANE uses pre-recorded speech messages for conveying any detected condition to the subject. VENUCANE uses audio recording and playback flash memory. It can store sixty-four speech messages each of 7.5 sec. duration. Number of messages can be increased by reducing the duration of each message. Microcontroller processes real-time data collected by ultrasonic, smoke detection, liquid detection and metal detection sensor and takes the correct decision. Based on decision, relevant message is invoked from the flash memory and conveyed to the subject through headphone.
New algorithms for way-finding with reduced information overload is implemented with used microcontroller. As per eq. (6), in each sensor cycle (ψ), eight ultrasonic sensors are fired in consistent sequence.
ψ=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt (6)
where,
F(s1,s5,s6) simultaneous firing of s1, s5 and s6 ultrasonic sensors
wt waiting time (35 ms)
Such two sensor cycles ψ(i) and ψ(i+1) are used for recording average distance values detected by individual sensor. In real time environment the rate of generation of new information is quite high and conveying such huge information directly to the subject may create confusion and affect mobility.
A new algorithm is implemented for Way-finding with Reduced Information Overload (WRIO), which constructs the logical map of surrounding correlating sensor outputs and offers optimized need basis information to the subject with minimal occlusion of external acoustic signals. When it infers the presence of the up or down staircase it invokes the dedicated routine, where it adaptively fires respective sensors and performs dedicated processing of staircase related data to lead to a practical decision. Variable frequency buzzer beeps are used for staircase navigation. VENUCANE constructs a logical map of surrounding with 500 cm radial distance in front, left and right direction of the subject. System maintains a safety margin distance for walking and helps to avoid collision with possible obstacles in front, left and right direction.
Record output of sensor cycles ψ(i) and ψ(i+1)
ψ(i)=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt
ψ(i+1)=F(s1,s5,s6)+wt+F(s2,s7,s8)+wt+F(s3,s4,s5)+wt
Compare detected situations, calculated obstacles distances and their approximate directions.
Construct a logical map of surrounding correlating sensor outputs.
Estimate safety distance margins from possible obstacles in constructed surrounding map.
Prioritize received surrounding information.
Choose desired cue from available options of communication medium (speech messages and variable frequency buzzer beeps) to convey optimum information to the subject.
Staircase navigation and safety indicators are implemented with variable frequency buzzer beeps and external interrupts respectively.
Generation of optimum information and cues for relevant surrounding environment.
As per prior art, for speech assisted navigation, many inventors are using text to speech conversion. In such cases inventors are converting text into English language only. As VENUCANE uses flash memory to store the pre-recorded speech messages, there is no barrier for usage of any language. Any appealing universal language can be used for recording speech warning messages. VENUCANE offers a simple mechanism for recording and storing such speech warning messages.
VENUCANE has two major sections:
This section forms the transmitter part of VENUCANE and it is placed within the hollow VENUCANE. DCPS further has three sections.
In VENUCANE, vision is implemented using a network of eight pairs of ultrasonic sensors. Sensor placement is shown in
Description of different components of the system as disclosed in accompanying
1. Front upper ultrasonic sensor; 2. Front first bottom ultrasonic sensor; 3. Front second lower ultrasonic sensor; 4. Front third lower ultrasonic sensor; 5. Back-side first lower ultrasonic sensor; 6. Back-side second lower ultrasonic sensor; 7. Left upper ultrasonic sensor; 8. Right upper ultrasonic sensor; 9. Smoke detection sensor (inside cane); 10. Window for smoke detection sensor; 11. Liquid detection sensors (inside cane); 12. First liquid detection sensor probes; 13. Second liquid detection sensor probes; 14. Metal detection sensor (inside cane); 15. Audio recording and playback flash memory (VENUCANE receiver); 16. MICROCONTROLLER Microcontroller Card (inside cane); 17. Wireless transceiver; 18. Buzzer (inside VENUCANE handle); 19. 9V DC Battery (inside VENUCANE handle); 20. On-off switch; 21. Center grip.
Placement and distance details of lower three ultrasonic sensors in front direction are shown in table 1. VENUCANE uses this arrangement for detection of up staircase. An interrelated structured pattern of distance variation detected by these three sensors is used for detection of staircase. Repeated sampling of data is done for concluding staircase detection. Subject can up stair and can understand the end of staircase with the help of stored speech messages. Two ultrasonic sensors are mounted on lower back-side of VENUCANE. Placement and distance details of these sensors are shown in table 1 and are exclusively used for detection of down staircase. Subject can down stair and can understand the end of staircase with the help of stored speech messages. Range of these two sensors is intentionally kept from 0 cm to 20 cm. VENUCANE uses ultrasonic sensors for object/obstacle detection, staircase detection, up stair and down stair application. VENUCANE calculates dynamic distance of the object/obstacle from subject using ultrasonic sensor and microcontroller. It can understand 5 meters distant object/obstacle in any direction. VENUCANE can announce calculated real time distance as it is in meters or centimeters using speech messages. To make distance understanding more appealing VENUCANE uses non-formal obstacle scaling approach. Sample non-formal obstacle distance scaling is shown in Table 7.
As ultrasonic sensors work on echoes from sound waves, ambient light/conditions does not affect them. Ultrasonic sensor distance range (5 meter) and performance is extremely better than infra-red sensors. Infra-red sensors support very small distance range (few centimeters) for operation, may be falsely triggered at ambient light/conditions and give wrong results.
While walking on indoor or outdoor environment, surrounding as well as floor/surface information is very important for subject. For understanding such information, VENUCANE uses smoke (in turn fire) detection sensor, liquid detection sensors and metal detection sensor. Life threatening injuries can be avoided by having such information well in advance. With the help of smoke and gas detector sensor, subject can understand the presence of smoke/fire/gas leakage from a far distance. With the help of metal detector sensor, subject can understand metallic floor, metallic fencing/casing etc. Presence of liquid can be understood with the help of liquid detection sensor. Now days marbled tiles are commonly used for flooring. If water spills on these surfaces, even a normal person will not be able to notice it. If the floor is wet and becomes slippery, subject may fall down and it may lead to life threatening injuries. In such situations, VENUCANE alerts the subject in advance. Liquid detection sensor probes are mounted on the bottom periphery of the cane. VENUCANE gives highest priority to safety of the subject. Table 8 shows VENUCANE supported priority structure for safety indicators.
In VENUCANE, Safety indications are implemented using external interrupts of microcontroller. Smoke detection is implemented with external interrupt 0 and liquid as well as metal detection is implemented with external interrupt 1 of microcontroller. Liquid detection sensors works on the conductivity principle. Liquid detection sensor has two probes (wires). When these probes comes on the liquid (water, milk, oil, mud, etc) based on conductivity, sensor understands the presence of liquid. Metals are the prime conductors. When these probes come on metal, due to metal conductivity, liquid detection sensor wrongly identify metal as liquid. VENUCANE uses two liquid detection sensors and one metal detection sensor for correct understanding of liquid and mental on the floor. Two probes of first liquid detection sensor are mounted on the bottom periphery of the VENUCANE with some spacing. Metal detection sensor is mounted inside at 2 cm height from ground. Two probes of second liquid detection sensor are insulated and are mounted above metal detection sensor. VENUCANE discriminates presence of liquid and metal based on Table 9.
VENUCANE considers output of second liquid detection sensor only when both, liquid and metal detection sensor gives positive answer. Using table 2 VENUCANE takes correct decision. Second liquid detector sensor is also used for understanding the level of liquid on the floor. When Obstacles are detected in front, left and right direction, VENUCANE put on the buzzer within for 1 minute indicating all side obstacle situations.
An 8-bit microcontroller, clocked at 11.0592 MHz. is used for processing real-time data collected by all above mentioned sensors. Real-time navigation is performed with scaled obstacle distance warning and effective usage of interrupts of microcontroller. Repeated sampling of data is performed before taking a decision. Microcontroller invokes the stored pre-recorded speech messages based on the real-time detected and understood issues.
VENUCANE uses pre-recorded speech messages for conveying any detected condition to the subject. VENUCANE uses audio recording and playback flash memory. It can store sixty-four speech messages each of 7.5 sec. duration. Number of messages can be increased by reducing the duration of each message. Microcontroller processes real-time data collected by ultrasonic, smoke detection, liquid detection and metal detection sensor and takes the correct decision. Based on decision, relevant message is invoked from the flash memory and conveyed to the subject through headphone. As VENUCANE uses flash memory to store the pre-recorded speech messages, there is no barrier for usage of any language. Any appealing (for subject) universal language can be used for recording speech warning messages. VENUCANE offers a simple mechanism for recording and storing such speech warning messages.
Based on communication between these two sections, DCPS and SAS, VENUCANE has two modes of operation:
A. Wireless mode
B. Wired mode
In wireless mode, a wireless connectivity is used for sharing decisions and invoking relevant speech messages between DCPS and SAS. In this mode half duplex wireless communication is implemented using 2.
4 GHz operated Radio Frequency (RF) modem. A baud rate of 9600 bits per second (bps) is used for this communication.
In wired mode, there is detachable connector between DCPS and SAS. This connector carries the decisions to invoke relevant message stored in the speech section. In this mode both wireless transceivers at transmitter and receiver end are disabled.
Based on subject requirement any mode can be chosen for navigation. Mode selection switch is given in the VENUCANE. Both modes are comfortable for navigation. Wireless mode reduces physical interface with the subject.
VENUCANE is designed considering ergonomic issues. Subject should hold the VENUCANE in front of him/her, perpendicular to the ground. There should be at least 20 to 30 cm distance between subject and cane for comfortable walking. Method of usage of VENUCANE is shown in
Testing of all used sensors, their functions and features are performed on individual and as a system. Ultrasonic sensor pairs, liquid detection sensor, metal detection sensor and fire detection sensor are tested for their range, accuracy and repeatability. Range details and sensor connections with microcontroller are presented in Table 10.
Obstacle distance scaling is done in a chunk of 70 cm each. For better appreciation of distance, 70 cm distance is treated as one-hand long distance from subject.
To evaluate the performance, VENUCANE is tested on trained and novice people in the indoor and outdoor environment. Basic training is required on VENUCANE for its smooth usage. A total of eight performances have been recorded. Four performances without staircase and four with staircase are recorded on a set of four blind folded subjects in indoor and outdoor like environment. In this set two are trained subjects and two are novice subjects.
Test Environment with Repeated Turns:
After blindfolding, the subject is asked to walk where different type of obstacles has been placed in front, left and right direction within 15 meter range. Obstacles and other situations set-up is prepared for indoor test environment as shown in
Details of obstacle placement and distance for test environment are given in table 11.
Time taken by the trained and novice subjects for successfully walking through this test environment is measured and travel speed for trained and novice subject has been calculated and presented in table 12.
Test Environment with Up and Down Staircase:
This performance test is carried on two trained and two novice subjects.
After blindfolding, the subject is asked to walk where different type of obstacles has been placed in front, left and right direction within 30 meter range. Obstacles and other situations sample set-up with metallic floor, up and down staircase is chosen for this test environment as shown in
Details of this test environment are given in table 13
Time taken by the trained and novice subjects for successfully walking through this test environment is measured and travel speed for trained and novice subject has been calculated and presented in table 14.
Above readings are recorded by imparting a training of 14 hours (one week) to blindfolded subjects. Regular use of VENUCANE will improve the travel speed of trained subject.
During above two tests, while navigating, VENUCANE invoked sample non-formal distance scaling and situation based speech messages are presented in table 15
The electronic travel aid (ETA) for visually impaired and blind people/VENUCANE thus performs integration of relevant sensors for conforming obstacle distance and detected situation. VENUCANE is further adapted to involve repeated data sampling and averaging methods to resolve any obstacle distance or situation conflict.
It is thus possible by way of the present invention to provide for electronic travel aid (ETA) for visually impaired and blind people, to assist visually impaired and blind subjects with vision disability with the following unique and technically advanced features including:
Advantages of electronic travel aid (ETA) for visually impaired and blind people/VENUCANE include:
1. Obstacle detection in front, left and right direction
2. Obstacle detection from ground level to head level height in front left and right direction
3. Staircase navigation
4. Speech based announcement for detected obstacle/condition
5. Non-formal distance scaling for detected obstacles
6. Safety indicators for smoke, liquid and metal
7. Less training time
8. Low power consumption
9. Light weight
13. Minimum physical interface with the subject
| Number | Date | Country | Kind |
|---|---|---|---|
| 1288/KOL/2011 | Sep 2011 | IN | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/IN2012/000654 | 9/28/2012 | WO | 00 | 3/28/2014 |
