A portion of the disclosure of this patent document contains material, which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in the Patent and Trademark Office patent files or records, but otherwise reserves all copyright rights whatsoever.
This application generally relates to a virtual reality simulator, and in particular, magazine simulators for guns that provide an interface with virtual reality systems.
It has long been desired to provide personnel training to improve their skills in aiming and firing shotguns, rifles, handguns, and other weapons. Law enforcement and military training often place trainees into situations that require quick visual and mental assessment of the situation as well as an appropriate response with a weapon. Trainees are often subjected to adverse situations to test their abilities to effectively react.
Traditional training methods in marksmanship and firing tactics for hunters and other sportsmen, police, military personnel, and others, leave much to be desired from the aspects of realism, cost and practicality. Many firing ranges have limited capacity. Moreover, most existing firing ranges do not provide protection for the shooter against the natural elements such as rain or snow. Because of the noise levels normally associated with firing ranges, they are typically located in remote areas requiring people to have to drive to remote locations. The ammunition, targets and use costs for the range, make such training expensive. Furthermore, when live ammunition is used, expense, risks, administrative problems, safety concerns, and government rules and regulations are more burdensome. For training in marksmanship and tactics, it is beneficial to have an indoor range where shooters can fire simulated projectiles against simulated moving targets.
Video games are increasingly more realistic where users may be placed into immersive virtual environments. First-person-view shooting games offer players the ability to perform actions such as walking, crouching, shooting, etc., using a mouse and keyboard. However, these games are usually played in front of a computer where the user is sitting in a chair and are adequate for personnel training. Virtual reality systems may improve gaming experience where the player's movement in the game is dependent on their actions in physical space which makes the game more immersive than a traditional video game. Despite the realism provided by virtual reality systems, players are often provided with game controllers that are either tethered or have the look and feel of toys. As such, existing virtual reality game controllers that are representative guns differ from actual guns in feel and balance, and thus reduces the effectiveness of the training for real life.
There is thus a need to provide an improved shooting simulator and process.
The present invention provides a magazine simulator. According to one embodiment, the magazine simulator comprises a box magazine that is removably inserted into a gun, the box magazine including a switch that is articulated with a trigger mechanism of the gun, and a tracker interface coupled to the box magazine, the tracker interface including an electrical connection interface with a virtual reality tracker that communicates with a virtual reality computing device, wherein the electrical connection interface transmits electrical signals to the virtual reality tracker based on articulations of the switch.
The switch may be configured to transmit electrical signals to the tracker interface that are associated with articulations of the switch from pulling of the trigger mechanism. In one embodiment, the box magazine is configured for insertion into a magazine well of the gun. The box magazine may further include weights that modify balance and feel. The box magazine may also further include compressed gas or weights controlled by servo motors that generate force feedback based on the articulations of the switch. The switch may be further configured with a trigger connection that is coupled to the trigger mechanism of the gun, wherein the trigger connection moves and engages with the switch upon pull of the trigger mechanism. The switch can be adjustably configured with a plurality of pull distances associated with the trigger mechanism. In certain embodiments, the gun may comprise an electronic control weapon.
The electrical connection interface may comprise a pin pad. The pin pad may include an electrical pin that corresponds to a signal from the switch associated with a pull of the trigger mechanism. The switch may be further articulated with a safety mechanism of the gun. The switch can be configured to transmit electrical signals to the tracker interface that are associated with articulations of the switch from switching of the safety mechanism between on and off positions. The pin pad includes an electrical pin that corresponds to a signal from the switch associated with the switching of the safety mechanism. The pin pads may be configured with contact connections of the virtual reality tracker. The virtual reality tracker may map the electrical signals into commands for the virtual reality computing device. The virtual reality computing device may also process the commands and renders corresponding images to a headset unit. The virtual reality tracker may include one or more sensors that detect a position of the gun within x, y and z coordinates of a space, and orientation including yaw, pitch and roll.
According to another aspect of the present invention, a virtual reality system is provided. The virtual reality system may comprise a magazine simulator that is removably inserted into a gun, the magazine simulator including a box magazine, a tracker interface, and a virtual reality tracker, wherein the box magazine includes a switch that transmits signals to the tracker interface based on articulations of a trigger mechanism of the gun, and the tracker interface connects the signals to the virtual reality tracker. The virtual reality system further comprises a virtual reality computing device that is communicatively coupled to the magazine simulator, the virtual reality computing device executing instructions for rendering virtual reality scenarios to a trainee and depicting data in the virtual reality scenarios based on commands that are generated from the virtual reality tracker based on the signals.
According to one embodiment, the virtual reality system comprises a gun including a magazine simulator and a virtual reality computing device that is communicatively coupled to the magazine simulator. The virtual reality computing device executing instructions that determine a location of a trainee based on a location of the magazine simulator, monitor for movements and signals from the magazine simulator, render virtual reality scenarios to the trainee and depicting data in the virtual reality scenarios based on the monitored movements and signals from the magazine simulator, and render proximity rings based on the tracker location and data structures indicating shapes, sizes, and distances from the trainee during a virtual reality scenario and in playback of the virtual reality scenario during a review mode.
The virtual reality computing device may further generate a review mode including a playback of the virtual reality scenario, wherein the review mode allows observation of the trainee and movements of the trainee from a plurality of perspectives during the playback. The plurality of perspectives may include at least a trainee perspective and vantage perspectives. Given ones of the virtual reality scenarios may include predetermined perspectives based on environment parameters of the given ones of the virtual reality scenarios. In one embodiment, the review mode includes overlay and control features utilized to review performance of the trainee in the virtual reality scenarios, the overlay and control features including a menu of options for selecting: vantage point, proximity rings, simulation boundaries, or objects/weapons highlights.
The virtual reality computing device to generate instructor audio that plays microphone output to the trainee during the virtual reality scenarios. The virtual reality computing device may also prescribe different actions to the proximity rings. In one embodiment, the different actions may include appropriate courses of action by the trainee that are based on the indicated distances with respect to a subject. The proximity rings may be rendered in given colors based on distance. The virtual reality scenarios may further include branching options that determine outcomes of the virtual reality scenarios based on instructor selections.
According to one embodiment, the virtual reality computing device executes instructions that perform the method comprising determining a location of a trainee based on a location of a magazine simulator that is communicatively coupled to the virtual reality computing device, wherein the magazine simulator is attached to a gun. The virtual reality computing device further executes instructions that perform monitoring for movements and signals from the magazine simulator, rendering virtual reality scenarios to the trainee and depicting data in the virtual reality scenarios based on the monitored movements and signals from the magazine simulator, and rendering proximity rings based on the tracker location and data structures indicating shapes, sizes, and distances from the trainee during a virtual reality scenario and in playback of the virtual reality scenario during a review mode.
A review mode may be generated including a playback of the virtual reality scenario, wherein the review mode allows observation of the trainee and movements of the trainee from a plurality of perspectives during the playback. The plurality of perspectives may include at least a trainee perspective and vantage perspectives. The given ones of the virtual reality scenarios may include predetermined perspectives based on environment parameters of the given ones of the virtual reality scenarios. The review mode may include overlay and control features utilized to review performance of the trainee in the virtual reality scenarios, the overlay and control features including a menu of options for selecting: vantage point, proximity rings, simulation boundaries, or objects/weapons highlights.
Instructor audio may also be generated that plays microphone output to the trainee during the virtual reality scenarios. Different actions may be prescribed to the proximity rings. In one embodiment, the different actions include appropriate courses of action by the trainee that are based on the indicated distances with respect to a subject. The proximity rings may be rendered in given colors based on distance. The virtual reality scenarios may also include branching options that determine outcomes of the virtual reality scenarios based on instructor selections.
The invention is illustrated in the figures of the accompanying drawings which are meant to be exemplary and not limiting, in which like references are intended to refer to like or corresponding parts.
Subject matter will now be described more fully hereinafter with reference to the accompanying drawings, which form a part hereof, and which show, by way of illustration, exemplary embodiments in which the invention may be practiced. Subject matter may, however, be embodied in a variety of different forms and, therefore, covered or claimed subject matter is intended to be construed as not being limited to any example embodiments set forth herein; example embodiments are provided merely to be illustrative. It is to be understood that other embodiments may be utilized and structural changes may be made without departing from the scope of the present invention. Likewise, a reasonably broad scope for claimed or covered subject matter is intended. Throughout the specification and claims, terms may have nuanced meanings suggested or implied in context beyond an explicitly stated meaning. Likewise, the phrase “in one embodiment” as used herein does not necessarily refer to the same embodiment and the phrase “in another embodiment” as used herein does not necessarily refer to a different embodiment. It is intended, for example, that claimed subject matter include combinations of exemplary embodiments in whole or in part. Among other things, for example, subject matter may be embodied as methods, devices, components, or systems. Accordingly, embodiments may, for example, take the form of hardware, software, firmware or any combination thereof (other than software per se). The following detailed description is, therefore, not intended to be taken in a limiting sense.
The present application discloses systems, devices, and methods that employ virtual reality to train police officers or military in the use of weapons like guns or electronic control weapons (e.g., those available from Taser™) in specific scenarios or situations. A trainee may be given an actual weapon or a training weapon that simulates an actual weapon and is connected to a virtual reality system. The trainee may wear goggles or headsets that are connected to the virtual reality system which plays a training scenario. Throughout the training scenario, the trainee's use of his weapon may be tracked and provided to the virtual reality system. The virtual reality system may include features used to review the trainee's performance, including a review mode which allows a reviewer to mark up the display, show different perspectives, how the weapon was held and pointed, and proximity rings which show how close the weapon got to various people in the virtual reality scenario.
The disclosed system may include replacement gun magazine simulators that are connected to a virtual reality computing device. A magazine simulator may be inserted into an actual weapon (e.g., guns, air guns, or conducted electrical weapons capable of firing electro-shock projectiles, such as electronic control weapons) in place of a traditional magazine and bullets, or in a training weapon. The magazine simulator can track positioning and firing data and relay them to the virtual reality computing device. The magazine simulator may allow the user to holster and unholster the weapon, making it more useful in simulating real training
Signals from switches 108, 108′, or 110 may be transmitted to tracker interfaces 104, 104′, respectively, and activate corresponding electrical switches to pin pads 302 and 502. Articulations from gun 200 or electronic control weapon 400 that are communicated to any ones of switches 108, 108′, or 110 are not limited to trigger pulls and safety positions and may include other actions, events or signals that may be generated from weapons. Pin pad 302 and 502 may provide an electrical connection interface with tracker 106.
Signals from pin pads 302 and 502 on tracker interfaces 104 and 104′ may be convey to tracker 106 via pogo pin connector 602. Pogo pin connector 602 may comprise a plurality of spring-loaded pins that support electrical connection with pins on pin pads 302, 502. Signals from the pins on pin pads 302, 502 may be mapped into commands based on contact connections with corresponding pins on pogo pin connector 602. The commands generated on tracker 106 may be received and interpreted by the virtual reality computing device.
Tracker interfaces 104 and 104′ may be mated with tracker 106 by inserting stabilizing pin 306 and 506, respectively, into a stabilizing pin recess (not illustrated) of tracker 106. The stabilizing pins 306, 506 provide proper alignment and contact between pin pads 302, 502 and pogo pin connector 602. Tracker 106 may further include image sensors and/or non-optical sensors (e.g., utilizing sound waves or magnetic fields) that can be installed in hardware to track the movement of a user's body. According to another embodiment, optical markers may be placed on tracker 106 (or alternatively on magazines 102, 102′, or tracker interfaces 104, 104′) for motion tracking using cameras to track movement of a user.
Tracker interfaces 104, 104′ may be secured to tracker 106 by securing screwing bolts 304, 504 to mount 604. Screwing bolts 304, 504 may be tightened and loosened from mount 604 via a thumbwheel 114 as illustrated in
The box magazine 1002 may be coupled to tracker interface 1004. The tracker interface 1004 may include trigger output 1012 and safety output 1014. Trigger detect switch 1016 may include a circuit component that opens and closes an electrical circuit to trigger output 1012. Similarly, safety detect switch 1018 may include a circuit component that opens and closes an electrical circuit to safety output 1014. According to other embodiment, trigger detect switch 1016 and safety detect switch 1018 may be in another housing that is coupled to box magazine 1002, or tracker interface 1004, or both. The electrical connections or signals corresponding to trigger output 1012 and safety output 1014 may be carried to given pins on pin pad 1020.
Tracker interface 1004 may be further coupled to tracker 1006. Tracker 1006 includes pin connector 1022, power source 1024, sensors 1026, wireless transmitter 1028, and microcontroller 1030. Pin pad 1020 may be communicatively or electrically connected to pin connector 1022. Power source 1024 may be connected to microcontroller 1030 and used by microcontroller 1030 to provide a voltage source to components within box magazine 1002 and tracker interface 1004 via pin connector 1022. As such, microcontroller 1030 may receive signals from closed electrical circuits connected to pin connector 1022 and transmit the signals to virtual reality computing device 1010 via wireless transmitter 1028. Virtual reality computing device 1010 may process or render the signals using processor(s) 1032 and transmit corresponding images to headset unit 1008 from wireless interface 1034.
Microcontroller 1030 may also provide power to sensors 1026 and wireless transmitter 1028 from power source 1024. Sensors 1026 can detect a position of tracker 1006 within the x, y and z coordinates of a space, as well as orientation including yaw, pitch and roll. From a user's perspective, a gun connected to tracker 1006 may be tracked when pointed up, down, left and right, tilted at an angle, or moved forward or backwards. Sensors 1026 may communicate where the gun is oriented to microcontroller 1030 which sends the data to virtual reality computing device 1010 for processing by processor(s) 1032 and renders corresponding images for transmission by wireless interface 1034 to headset unit 1008.
Headset unit 1008 may comprise a head mounted display, also including components similar to tracker 1006, that a user can place over the user's eyes. The headset unit 1008 may be configured to communication with the virtual reality computing device 1010 to provide display according to a virtual reality simulation program. Additionally, the headset unit 1008 may be configured with positioning and/or motion sensors to provide user motion inputs to virtual reality computing device 1010. When wearing the headset unit 1008, the view may shift as the user looks up, down, left and right. The view may also change if the user tilts their head at an angle or move their head forward or backward without changing the angle of gaze. Sensors on headset unit 1008 may communicate to processor(s) 1032 where the user is looking, and the processor(s) 1032 may render corresponding images to the head mounted display. Sensors, as disclosed herein, can detect signals of any form, including electromagnetic signals, acoustic signals, optical signals and mechanical signals.
Virtual reality computing device 1010 includes processor(s) 1032, wireless interface 1034, memory 1036, and computer readable media storage 1038. Processor(s) 1032 may be configured to execute virtual reality training software stored within memory 1036 and/or computer readable media storage 1038, to communicate data to and from memory 1036, and to control operations of the virtual reality computing device 1010. The processor(s) 1032 may comprise central processing units, auxiliary processors among several processors, and graphics processing units. Memory 1036 may include any one or combination of volatile memory elements (e.g., random access memory (RAM). Computer readable media storage 1038 may comprise non-volatile memory elements (e.g., read-only memory (ROM), hard drive, etc.). Wireless interface 1034 may comprise a network device operable to connect to a wireless computer network for facilitating communications and data transfer with tracker 1006 and headset unit 1008.
The virtual reality training software may comprise an audio/visual interactive interface that enables a trainee to interact with a three-dimensional first-person-view environment in training scenarios with tracker devices, such as a weapon including a virtual reality-enabled magazine assembly (e.g., comprising box magazine 1002, tracker interface 1004, and tracker 1006). Virtual reality computing device 1010 may receive signals or commands from tracker 1006 and headset unit 1008 to generate corresponding data (including audio and video data) for depiction in the virtual reality environment.
Proximity rings may be configured for visually rendering different distances around a trainee that are visible in the headset unit. According to one embodiment, different actions may be prescribed for each proximity ring. That is, appropriate course of action may be determined based on a subject's distance from the trainee. Each proximity ring may be presented in a given color and distance that may be selected by the user. A user may select preferred units and enter distances for up to three rings.
Controls may be selected for each hand, as illustrated in
The user may also selected a microphone device to be used to receive instructor audio. Instructor audio allows an instructor to speak into a microphone to play directly into a virtual reality headset unit while a trainee is wearing it during a training session. Volume of the instructor audio may also be selected by dragging a slider control. A “mute audio” may also be available to turn off this feature during scenario or review mode. While training is taking place, an instructor may be able to see what the trainee is looking at in the headset unit from a computer or secondary screen and speak to the trainee to provide instruction.
Referring back to
Once again referring to
During execution of a scenario, the instructor may access a menu of options by, for example, clicking in the top left corner of the screen. The menu may include options for proximity rings, simulation boundaries, and objects/weapons highlights. Proximity rings, as illustrated in
For example, proximity rings 1702, 1704, and 1706 may be displayed to the trainee and recorded for review mode. Each of proximity rings 1702, 1704, and 1706 may be color coded and labeled with approximate radius distances away from the trainee. According to one embodiment, the proximity rings may be color coded based on distance safety. For example, proximity ring 1706 may be colored green to indicate a safe distance while proximity ring 1704 may be colored yellow to indicate a cautionary distance, proximity ring 1702 may be colored red to indicate a high-risk distance.
Simulation boundaries may indicate a “training area” where the virtual reality system is only able to track trainee activity. The simulation boundary may be based on a limitation of the physical environment where the virtual reality system is configured. Objects/weapons highlights may visually emphasize any weapons or objects in the scenario held by either the trainee or other people. Instructors may also have the capability to pause, resume, restart, or quit the scenario at any point.
Proximity ring arrays are generated based on the proximity ring distances, step 1808. The proximity ring arrays may comprise data structures representative of the shape, size, and distances of the proximity rings. A tracker location is determined, step 1810. Tracker location may be a location of a magazine simulator including a virtual reality tracker that is determined by the virtual reality computing device. The tracker location may be used to approximate a location of a trainee to place the proximity rings. The proximity ring arrays are rendered based on the tracker location, step 1812.
The virtual reality computing device may monitor for movements of the tracker, step 1814. If the tracker has moved, the virtual reality computing device may return to step 1810 to determine the tracker location and update the rendering of the proximity ring arrays at step 1812. The method may further determine whether the proximity rings are disabled, step 1816. If proximity rings are not disabled, the virtual reality computing device may continue to monitor whether the tracker moved at step 1814. In the case that proximity rings are disabled, the virtual reality computing device proceeds to remove the proximity rings from rendering, step 1818. The virtual reality computing device returns to determine if proximity rings are enabled at step 1804.
The virtual reality computing device may generate a review mode including a playback of the virtual reality scenario, wherein the review mode allows observation of the trainee and movements of the trainee from a plurality of perspectives.
A selection of the scenario for review is received, step 1904. A given scenario may include predetermined vantage points based on parameters of the scenario, such as environment. For example, a scenario in a house may include vantage points from a plurality of rooms. Vantage points of the scenario are retrieved, step 1906. Playback of the scenario is started from a default vantage point, step 1908. The virtual reality computing device may determine if a vantage point has been changed based on a user selection, step 1910. The scenario will continue playback of the scenario from a current vantage point if there are no changes to the vantage point, step 1912. If the vantage point has been changed, the virtual reality computing device may continue playback from coordinates of a selected vantage point, step 1914.
At step 1916, the virtual reality computing system determines if playback of the scenario is restarted. If yes, playback of the scenario is started from the current vantage point, step 1918. Otherwise, the virtual reality computing device may proceed to determine whether to end playback, either by end of scenario or by user command, step 1920. If playback is determined to end, the playback of the scenario is ended, step 1922. Otherwise, the method continues to determine if vantage point has been changed at step 1910.
Vantage point may allow an instructor to review training scenarios from different angles. For example,
The virtual reality training software may further generate analytics data from training sessions.
It should be understood that various aspects of the embodiments of the present invention could be implemented in hardware, firmware, software, or combinations thereof. In such embodiments, the various components and/or steps would be implemented in hardware, firmware, and/or software to perform the functions of the present invention. That is, the same piece of hardware, firmware, or module of software could perform one or more of the illustrated blocks (e.g., components or steps). In software implementations, computer software (e.g., programs or other instructions) and/or data is stored on a machine-readable medium as part of a computer program product and is loaded into a computer system or other device or machine via a removable storage drive, hard drive, or communications interface. Computer programs (also called computer control logic or computer-readable program code) are stored in a main and/or secondary memory, and executed by one or more processors (controllers, or the like) to cause the one or more processors to perform the functions of the invention as described herein. In this document, the terms “machine readable medium,” “computer-readable medium,” “computer program medium,” and “computer usable medium” are used to generally refer to media such as a random access memory (RAM); a read only memory (ROM); a removable storage unit (e.g., a magnetic or optical disc, flash memory device, or the like); a hard disk; or the like.
The foregoing description of the specific embodiments will so fully reveal the general nature of the invention that others can, by applying knowledge within the skill of the relevant art(s) (including the contents of the documents cited and incorporated by reference herein), readily modify and/or adapt for various applications such specific embodiments, without undue experimentation, without departing from the general concept of the present invention. Such adaptations and modifications are therefore intended to be within the meaning and range of equivalents of the disclosed embodiments, based on the teaching and guidance presented herein. It is to be understood that the phraseology or terminology herein is for the purpose of description and not of limitation, such that the terminology or phraseology of the present specification is to be interpreted by the skilled artisan in light of the teachings and guidance presented herein, in combination with the knowledge of one skilled in the relevant art(s).
This application claims the priority of U.S. Provisional Application No. 62/874,234, entitled “MAGAZINE SIMULATOR FOR USAGE WITH WEAPONS IN A VIRTUAL REALITY SYSTEM,” filed on Jul. 15, 2019, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
8690575 | Gurule et al. | Apr 2014 | B1 |
8920172 | Wilmink | Dec 2014 | B1 |
20060105299 | Ferris et al. | May 2006 | A1 |
20080127538 | Barrett et al. | Jun 2008 | A1 |
20130133234 | Eftekharzadeh | May 2013 | A1 |
20140065577 | Quinlan et al. | Mar 2014 | A1 |
20150260474 | Rublowsky | Sep 2015 | A1 |
20160305740 | O'Donnell | Oct 2016 | A1 |
20170108310 | Zimmerman | Apr 2017 | A1 |
20170307333 | Northrup | Oct 2017 | A1 |
20190213901 | Kur et al. | Jul 2019 | A1 |
20200408480 | Kur | Dec 2020 | A1 |
20210148671 | Pong | May 2021 | A1 |
Entry |
---|
PCT International Search Report and The Written Opinion of the International Searching Authority, dated Oct. 29, 2020, International Searching Authority. |
Number | Date | Country | |
---|---|---|---|
20210018291 A1 | Jan 2021 | US |
Number | Date | Country | |
---|---|---|---|
62874234 | Jul 2019 | US |