Patent Application
20130253818
Embodiments herein generally relate to guidance systems and more particularly to indoor guidance systems for the visually impaired, and to systems and methods for supplying a user with guidance based on knowledge of features of the indoor surroundings and dependent upon the location.
Over one million people in the United States and several million more people worldwide are legally blind. Even more people suffer from low or reduced vision. For this large population, simple daily tasks such as traveling, leaving the house to attend social events, or simply running errands, can be quite daunting tasks. The vision aids that have been developed in the past are large and bulky, and have drawn attention to the fact that the user has a visual impairment.
Guidance systems are known, but are generally not designed for the visually impaired. Likewise interfaces for the visually impaired are known, but have not been applied to indoor guidance.
Indoor mapping and guidance is the newest innovation in assistive technologies, providing electronic maps and guidance for large facilities, such as shopping malls or department stores. These existing systems are in their infancy, and lack many beneficial features. Additionally, they do not provide specific assistance for individuals who are blind or visually impaired, which is one of the main goals of the system discussed herein.
Positioning techniques using a wireless communication infrastructure vary depending on the types of infrastructure and service coverage. A satellite-based global positioning system (GPS) has a problem in that the sensitivity of a reception signal is degraded in an indoor area, such that it fails to acquire a signal, so it is not possible to determine a location. A cellular-based positioning technique for determining the location of a user by using location information and a measurement signal of a mobile communication base station has an advantage of allowing determination of a location even in an indoor area, as well as in an outdoor area, but its positioning accuracy varies depending on the disposition density of base stations and it has a relatively low location accuracy. A wireless local area network based positioning technique is a typical method for resolving the difficulties of indoor positioning. Such technique calculates the location of a terminal by using a reference location of an access point and a measurement signal.
There remains a need for a new and useful handheld system that avoids or minimizes the disadvantages of past navigation aids. This invention provides such a new and useful handheld aid.
The system disclosed herein describes an indoor guidance system. The system uses a mobile device (Smartphone, tablet, etc.) to provide maps and visual and voice guidance to assist individuals in navigating through indoor locations. Special maps are transmitted to the mobile device upon entering the facility, or downloaded in advance. The software and maps provide assistance to the user, to guide them through the facility. The system uses a combination of GPS and other technologies (Bluetooth, infrared, Wi-Fi, RFID, etc.) to provide extremely detailed and accurate location information to the user.
According to one embodiment herein, a system for aiding a user to navigate within a facility is disclosed. The system comprises a hand-held device carried by the user that, upon activation by the user, downloads an electronic map of the facility and produces direction signals. The electronic map comprises a layout of the facility and includes key areas. At least one dedicated wireless transceiver is disposed in each key area of the facility and the transceiver interacts only with the hand-held device. A processor is operatively coupled to the hand-held device. The processor establishes a current physical location of the user with respect to the electronic map. The processor receives from the user a destination location within the facility and provides to the user output signals and directions to the destination location within the facility. As the user moves through the facility, the processor receives, from the at least one dedicated wireless transceiver, a plurality of signals to determine the user's current physical location within the facility. The processor processes each individual current physical location reading to refine the current physical location of the user's location in the facility with respect to the electronic map.
According to another embodiment herein, a handheld system for aiding a visually impaired user to navigate within a building is disclosed. The handheld system comprises a housing. A position detector is connected to the housing and provides data of a user's location within the building. The position detector receives signals from at least one dedicated wireless transceiver that interacts only with the position detector within the building. A direction detector provides data of the user's direction of motion. An input receiver receives a destination within the building as determined by the user. A processor is coupled to the position detector and the direction detector and the processor correlates the position and direction data with information of features of the building as stored as an electronic map in a memory in the housing. The processor establishes a physical location of the user in the building. An output device provides directions to the user.
According to another embodiment herein, a method of providing assistance to users in navigating indoor locations is disclosed. The method comprises using a handheld device having a wireless positioning system to establish a current physical location of a user with respect to a map of an indoor location stored within the handheld device. A destination location within the indoor location selected by the user is received by the handheld device. Output signals and directions to the destination location within the indoor location are provided to the user. As the user moves through the indoor location, the wireless positioning system receives signals from at least one dedicated wireless transceiver that interacts only with the hand-held device within the indoor location to determine the user's current physical location within the indoor location. Then, each individual current physical location reading is processed to refine the current physical location of the user's location in the indoor location with respect to the electronic map.
These and other features are described in, or are apparent from, the following detailed description.
Various exemplary embodiments of the systems and methods are described in detail below, with reference to the attached drawing figures, in which:
Embodiments herein use a combination of wireless sensors (Bluetooth, Infrared, Wi-Fi, GPS, etc.) in combination with electronic maps to provide assistance to users for navigating indoor locations. This is an advantage over current systems that use either static maps, or proprietary sensors. By nature this system is designed to be flexible and to leverage existing technologies. For users with no disability, the embodiments provide a useful way to navigate unfamiliar areas, such as large department stores or shopping malls. For users with visual impairment, the system provides assistive technology that can give the user improved life experiences and self-sufficiency.
The system comprises a hand-held device carried by the user that, upon activation by the user, downloads an electronic map of the facility and produces direction signals. The electronic map comprises a layout of the facility and includes key areas. At least one dedicated wireless transceiver is disposed in each key area of the facility and the transceiver interacts only with the hand-held device. A processor is operatively coupled to the hand-held device. The processor establishes a current physical location of the user with respect to the electronic map. The processor receives from the user a destination location within the facility and provides to the user output signals and directions to the destination location within the facility. As the user moves through the facility, the processor receives, from the at least one dedicated wireless transceiver, a plurality of signals to determine the user's current physical location within the facility. The processor processes each individual current physical location reading to refine the current physical location of the user's location in the facility with respect to the electronic map.
Referring to
In some embodiments, the sensor 25 may use radio-frequency electromagnetic fields to transfer data from the sensor 25 to a mobile handheld device 30, for the purposes of automatic location tracking. Some sensors 25 require no battery and are powered by the electromagnetic fields used to read them. Others use a local power source and emit electromagnetic radiation at radio frequencies that can be received by the handheld device 30. The sensor contains electronically stored information that can be read from up to several feet away.
A user obtains the map 13 of the facility on the mobile handheld device 30. The map 13 could be available on the Internet for advance download, or may be downloaded to the mobile device 30 once the user nears the facility. The maps should be designed to integrate with existing mapping software, such as Google Maps or Microsoft Bing. Additionally, the maps should also support integrations with current products for the blind/visually impaired including Digit-Eyes, VoiceOver and The vOICe. The user could obtain the map 13 by opening the mapping software, and accepting the transmitted electronic map 13. Continuing the multiplex movie theater example, the user could then follow this general process:
As mentioned above, in some embodiments, every seat in every auditorium may be a key area 16. Accordingly, in some embodiments, a sensor 25 could be placed in every seat in every auditorium, allowing people to find not only the correct auditorium, but also a specific object, such as finding a free seat in a darkened auditorium. This would benefit both sighted and visually impaired users. Other similar applications may be directed to finding a free seat on a bus, finding the correct seat at a sporting or musical event, amusement park, etc.
It is further contemplated that the technology described herein may be incorporated into augmented reality imagery for use in head-mounted displays or hand-held devices. The physical location information can be augmented in real-time context with environmental elements by computer-generated sensory input such as sound, video, or graphics.
The disclosure herein uses an example of a movie theater; however, the mapping opportunities are endless, such as shopping malls, department stores, museums, art galleries, stadiums, office. It is contemplated that individual homes could be mapped, so that visually impaired people could get around their own house or their friends' houses easier. It could also provide warning about steps, curbs, etc. in the environment.
The concepts described herein can use and support a variety of technologies and approaches; that is, the concepts are not limited to Smartphones. It is contemplated that supermarkets, department stores, etc. could make inexpensive, dedicated devices available at the front door of their establishment so that customers could use the technology to navigate around the establishment just for the duration of their current shopping trip.
GPS-based location estimation is not extremely accurate indoors (although near a window it can be fairly accurate). Wireless-fidelity (WiFi) based location technologies, cell-tower technologies, and other similar technologies sometimes work very well indoors, but also can be inaccurate.
In order to solve such problems, a positioning system using a combination of technologies in an indoor space. The use of a global positioning system and indoor sensors with position detection ensures obtaining of a location accuracy level of 1 m to 3 m. While most users are not aware of the locations of the sensors 25 installed for the purpose of radio communication, the locations are included in the electronic map 13 so the processor of the mobile device 30 can determine the location of a user. By obtaining positional information from multiple sensors 25 (each of which may rely upon a different and/or more advanced technology for determining its location) the physical location of the user as he or she moves through the indoor environment is continually refined and improved. The sensor 25 may be a dedicated wireless transceiver that receives a wireless signal only from the mobile device 30 and provides a location signal only to the processor of the mobile device 30.
According to another embodiment herein, a method of providing assistance to users in navigating indoor locations is disclosed. The method comprises using a handheld device having a wireless positioning system to establish a current physical location of a user with respect to a map of an indoor location stored within the handheld device. A destination location within the indoor location selected by the user is received by the handheld device. Output signals and directions to the destination location within the indoor location are provided to the user. As the user moves through the indoor location, the wireless positioning system receives signals from at least one dedicated wireless transceiver that interacts only with the hand-held device within the indoor location to determine the user's current physical location within the indoor location. Then, each individual current physical location reading is processed to refine the current physical location of the user's location in the indoor location with respect to the electronic map.
The embodiments herein help to continually refine the identification of the physical location of the mobile handheld device 30 by receiving continual inputs from many different sensors 25. More specifically, as shown in flowchart form in
In item 102, after establishing the current physical location of the user, the user selects a destination location within the indoor location and puts it in the handheld device.
As shown in item 104, output signals and directions to the destination location within the indoor location are provided to the user. Then, in item 106, as the user moves through the indoor location, the wireless positioning system receives signals only from at least one dedicated wireless transceiver within the indoor location to determine the user's current physical location within the indoor location.
In item 108, the method then processes (e.g., performs statistical operations on) the current physical location readings to refine the current physical location of the user. each individual current physical location reading is processed to refine the current physical location of the user's location in the indoor location with respect to the electronic map As shown by the arrow from item 108 to item 104, the processing loops back to continue to provide instructions as the user moves through the indoor location and refines the location and instructions.
Further, the embodiments herein also provide a mechanism to accommodate or adjust for errors in location detection. The position detector can provide confidence measures that are associated with their estimation location of the sensors.
Thus, in item 106, one or more of the individual current physical location readings can include a positional confidence measure. Then, when processing the individual current physical location readings in item 108, the position detector weights each individual current physical location reading by the positional confidence measure to refine the current physical position of the user.
In item 108, some embodiments herein can refine the position of the user by taking an average (or performance other statistical calculations, such as mean, standard deviation, etc.) of all positions received from the different sensors 25 that may supply it with positional information. Other embodiments herein use the physical position readings weighed by the confidence measure of the positional information. Therefore, rather than just taking a single reading to establish (or reestablish) the position of the user, the embodiments herein take an average (or some other statistical measure) of all readings that are received. These readings can also be weighted according to a number of different parameters (GPS confidence, positional distance between the sensor 25 and the handheld device 30, etc.). Therefore, with embodiments herein, the location of the user is refined by each new positional reading from each new interaction with a sensor 25.
Another exemplary embodiment is shown in
The handheld device 200 includes a wireless communication device 210 that communicates with sensor 232-234 and/or global positioning system (GPS). A position detector 206 is connected to the housing 202 and provides data of a user's location within the building. The position detector 206 receives signals from at least one sensor 232-234 within the building via the wireless communication device 210. A direction detector 212 provides data of the user's direction of motion. An input receiver 204 receives a destination within the building as determined by the user. A processor 208 is coupled to the position detector 206 and the direction detector 212 and the processor 208 correlates the position and direction data with information of features of the building as stored as an electronic map in a memory 214 in the housing 202. The processor 208 establishes a physical location of the user in the building. An output device 204 provides directions to the user. The handheld device 200 can comprise any commonly available device including, cell phones, PDAs, smart phones, portable computers, etc.
The processor 208 can establish the current physical location of the user, using the data input/output GUI 204, for example when the user enters a certain location. After initially establishing the physical location of the user, the processor 208 receives, through the input/output 204 or the wireless communication device 210, instructions for a location to travel to. The sensors 232-235 each have a physical position locator noted on an embedded electronic map that corresponds to current physical position of each of the sensors 232-235.
As the user moves through the location, the processor 208 also receives, through the input/output GUI 204, the wireless communication device 210 etc.), current physical position readings from the sensors 232-234. Each individual current physical position reading is received from each corresponding sensor when the user is within a certain distance of the sensor 232-234. As mentioned above, the processor 208 processes each individual current physical position reading to refine the current physical location of the user.
With the embodiments herein the positional information is transferred to the handheld device 200, in item 106, through the wired/wireless connection, an infrared (IR) connection, RFID, and/or GPS.
In
The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of this disclosure. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises” and/or “comprising,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof.
The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The descriptions of the various embodiments of the present invention have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
It will be appreciated that the above-disclosed and other features and functions, or alternatives thereof, may be desirably combined into many other different systems or applications. Various presently unforeseen or unanticipated alternatives, modifications, variations, or improvements therein may be subsequently made by those skilled in the art which are also intended to be encompassed by the following claims. The claims can encompass embodiments in hardware, software, and/or a combination thereof. Unless specifically defined in a specific claim itself, steps or components of the embodiments herein cannot be implied or imported from any above example as limitations to any particular order, number, physical position, size, shape, angle, color, or material.
