Patent Application
20100253525
Soldiers in urban combat are increasingly overwhelmed with information on the battlefield. As technology improves, so do the amount of electronic systems that a soldier has access to. For example soldiers have access to navigation screens, voice communication systems, and communication viewers as well as various types of optics. Each of these additional systems may detract from the soldier's situational awareness due to distraction and information overload. A heightened level of situational awareness keeps the soldier alive and brings them home safely. A soldier must always be able to anticipate the enemy and rapidly respond to the identified threat.
Currently soldiers are given many tools to augment their human senses through the modification of incoming signals and then relaying those signals to the appropriate sense. For example when a soldier looks through thermal-imaging binoculars to see in the dark, a visual signal is modified and then shown to the soldier through visible means. Other examples include, but are not limited to the use of a directional microphone or the use of a chemical alarm. These tools fail because each device consumes some or all of the soldier's senses, thus distracting the soldier from his/hers duties.
Another set of tools allows for soldiers to relay information through the use of vibration or electric shock on the skin or the tongue of the soldier. These tools have been used to pass both navigational information and basic tactical squad level hand signal communications. The method, while beneficial, falls short of warning soldiers of threats.
Systems and methods for human performance augmentation are disclosed herein. A method for human performance augmentation includes collecting sensory data using at least one sensor on a user. When sensory data is collected, a processor processes the collected data into actionable situational intelligence. Once processed, the user is alerted through a tactile interface in communication with the processor. The tactile interface provides multimodal stimulation to the user.
An example system for human performance augmentation includes at least one microsensor configured to collect sensory data, the microsensor having a processor. The system further includes a tactile interface in communication with at least one microsensor, such that when altered the tactile interface provides multimodal stimulation to the user.
As will be readily appreciated from the foregoing summary, the invention provides an improved system and method for human performance augmentation.
The preferred and alternative embodiments of the present invention are described in detail below with reference to the following drawings:
In one embodiment of the invention, a microsensor(s) 12 is used to collect sensor data outside the normal human sensing range/medium. For example, the sensor may collect infra-red or ultra-wideband radio frequency motion data that would allow the wearer to detect threats through barriers opaque to visible light and in a 360 degree range which is far beyond the capabilities of an unaided soldier. The microsensor(s) 12 is coupled to a processor 15 in order to determine the most critical sensory information. The role of the processor is important in that it preferably processes disparate and complex sensor data into useful information and then determines which information is critical for situational awareness in order to avoid information overload. For example, the sensors may detect motion through the walls on both sides of the soldier while additional sensors detect metal weapons, explosive residues, or even whispered commands to attack coming from the right side. The processor combines this data and extracts the pertinent information, determines that the motion on the right side is a threat and then the wearer is alerted. The information is then relayed to a user through a tactile or skin based human machine interface 18. The microsensor(s) 12 preferably detects situational intelligence such as, but not limited to: 360° degree thermal imaging and motion detection, 360° degree wall-penetrating ultra wideband radio frequency motion detection, gunfire acoustic vectoring, tracking of friendly forces, nuclear, biological and chemical detection and tracking, and biometric sensing of the wearer's health and alertness. In one embodiment the microsensor(s) 12 use a bio-metric technique similar to an insect's compound eye to provide full range detection of a threat over 360° degrees. The low-resolution compound eye while having poor image recognition capabilities allows fast and accurate threat and motion detection over a wide field of view when coupled with advanced bio-mimetic signal processing algorithms. The microsensors 12 allow for the wearer to detect and respond to threats from all sides. The microsensor(s) 12 are further described in
The processor 15 may either be included in the microsensor(s) 12 or can be a stand alone component. The processor 15 receives various sensed information signals from the microsensor(s) 12 and then creates signals for the tactile interface 18. The microsensor(s) 12 is in signal communication with the tactile interface 18. The tactile interface 18 interacts, through actuators, with the skin in a number of ways including, but not limited to vibration, acceleration, pressure, deformation, temperature, texture, thermal conductivity, and/or viscosity. The actuators are varied based on time between each signal and an array of locations of the signal. For example the intensity, location and timing of a vibration can be increased to show a higher threat level. The multimodal interface gives the wearer multiple auxiliary senses that enhance performance but do not degrade situational awareness. The tactile interface 18 includes a number of actuators that are affixed to the skin with an adhesive or optionally integrated into the clothing or armor to allow for close contact with the skin.
In one embodiment, a user has the human performance augmentation system and is operating in a hostile environment. The user has multiple microsensor(s) including a motion detector and a nuclear, biological, and chemical (NBC) sensor. The NBC sensor identifies a chemical plume at 90° degrees magnetic and 800 meters away. The processor identifies the signal from the sensor and prepares the necessary signal for the tactile interface. The tactile interface, affixed to the user's forearm, is activated and using an array of pressure alerts the user. The tactile interface applies pressure in the magnetic direction of the chemical plume and applies 8 short bursts of pressure to signify the plume is at 800 m. The location and distance will be automatically updated as the user continues to move in space. The user in this case still maintains situational awareness and the ability to use his/her arms, eyes, and ears without being comprised by a loud siren, multiple messages coming across his/her screen/radio and while trying to put on protective gear such as a MOPP suit. If traveling in a squad all users would be notified if a single member of the squad senses a chemical plume.
While the preferred embodiment of the invention has been illustrated and described, as noted above, many changes can be made without departing from the spirit and scope of the invention. Accordingly, the scope of the invention is not limited by the disclosure of the preferred embodiment. Instead, the invention should be determined entirely by reference to the claims that follow.
