The present claimed invention generally relates to robotics. More specifically the present invention relates to human proxy robot systems.
While the content herein is applicable to robots with some or even a great deal of autonomy as taught in the previous application, it is particularly pertinent to cases where the robot is largely devoid of artificial intelligence (AI), essentially representing an extension of the human handler.
Put another way, this specification is about human telepresence in space, and especially in such near-space locations as the earth's moon. During his or her turn in control of a given proxy robot, the human handler sees and feels and acts through the “person” of that robot: guiding the proxy in exploring; mining; doing science experiments; constructing; observing the earth, planets or stars; launching spaceships to further destinations; rescuing other robots or humans; or simply enjoying an earthrise over the moon's horizon.
In the prior art are several patents dealing with omni-directional and spherical treadmills, all involving simulated virtual reality (VR) generated by a computer program as opposed to the simulation of the actual environment being experienced by a proxy robot in its remote environment as taught in the present invention. Carmein U.S. Pat. No. 5,562,572 discloses ways to make an omni directional treadmill for VR and other purposes, but the methods and apparatus employed do not anticipate the specification to follow. Nor are his treadmill designs very stable, with the human constrained by balance cuffs, support struts, hand grips and the like just to stay upright.
Carmein '572 also makes brief mention of how the omni-directional treadmill of his invention may be utilized in telepresence in a one-paragraph description of FIG. 18 (FIG. 39 in C.I.P. '256 below), but fails to claim or adequately teach how a human can be productively linked in practice to a robot in some remote location. In the present specification and a companion application pertaining to handler environment simulation, prior art weaknesses, defects and “science fiction” will be overcome as methods and apparatus for a complete human handler-proxy robot system are disclosed.
Latypov U.S. Pat. No. 5,846,134 features a spherical shell inside of which a human walks in treadmill fashion, but this concept is quite distinct from the spherical treadmill disclosed in the current application, where the human handler of a proxy robot stands and moves on the top exterior of a sphere with diameter sufficiently large (typically 30 feet in diameter) that the handler, to all intents and purposes, is moving on a flat surface if that is the remote terrain being simulated.
U.S. Pat. No. 5,980,256, also by Carmein, is a continuation-in-part of '572 above and U.S. Pat. No. 5,490,784. The latter pertains to spherical capsules within which humans can walk (albeit uphill) in any direction, but does not apply to the present invention. The circular form in Carmein's ('256) FIG. 23 does not denote a turntable, but rather defines a circular track unlike the current invention. While Carmein's FIG. 37 and description are somewhat akin to the motion simulator in the current specification's FIG. 7, the point is moot in any case since such motion simulators are well-established in the prior art.
Butterfield U.S. Pat. No. 6,135,928. This patent, which expired in 2008, discloses a spherical treadmill for VR gaming, but it is so small at 6-7 ft. diameter as to never seem flat to its human “rider,” who requires a restraining harness and support system just to stay upright. In the Butterfield patent, the sphere basically represents a human-powered trackball, operating in exactly that manner to input x- and y-axis orientation and movement to a VR game on a computer.
Put another way, Butterfield's focus is virtual reality, for fantasy games, while the application below is all about the best-possible simulation of actual reality in a remote location. As a consequence, the Stephens specification does not utilize a small, inflatable sphere as a computer trackball or mouse as taught by Butterfield, but rather uses a much larger and firmer motor-driven spherical treadmill to replicate the terrain upon which a proxy robot is walking, climbing or carrying out various tasks. (Butterfield does depict how a “hill” can be created by moving the user off-center, but the problem with such a small sphere is that there is a constant “hill” created by the small-diameter sphere itself.)
These and other distinctions over the current art will become evident from study of the specification and drawings to follow.
The specification to follow discloses novel systems, methods and apparatus to simulate the environment of the proxy robot's mission, to assure the best possible outcome of that mission.
One object of the present invention is to describe a viable methodology for human space exploration utilizing proxy robot surrogates in space controlled by humans on earth.
A second object of the present invention is to provide human telepresence on the moon and other locations near earth utilizing proxy robots capable of being controlled by one or more human handlers in real or near-real time.
A third object of the present invention is to provide telepresence on the moon and other locations in space utilizing proxy robots in such manner that each proxy robot functions as a human telepresence, a surrogate for one or more humans back on earth or at some other remote location.
A fourth object of the present invention is to provide human telepresence on the moon and other locations in space utilizing human proxy robots capable of providing accurate visual, aural, olfactory, tactile and other sensual data to a human handler such that the handler experiences the experience of actually being there in the body of the proxy robot.
A fifth object of the present invention is to monitor and capture all movements of a human handler by means of motion capture technology modified for this purpose in such manner that each change in joint angle, body posture or position can be relayed as “follow me” data to a proxy robot for emulation.
A sixth object of this invention is to monitor and capture all movements of a human handler by means of strain sensors in the handler's clothing, gloves, stockings, booties or elastic bands worn by the handler over joints such that each change in joint angle, body posture or position can be relayed as “follow me” data to a proxy robot for emulation.
A seventh object of this invention is to provide human telepresence on the earth, on the moon and at other locations near earth utilizing human proxy robots which receive tactile data from their human handlers and follow each and every move of each handler in “follow me” commands.
An eighth object of this invention is to provide for teams of human proxy robots under direct human control to carry out missions on the earth, on the moon and at other locations in near earth locations, where individual robotic team members are operated by humans specialized in fields including geology; planetary science; life science; emergency response, whether human or robotic; human medicine; robot maintenance and repair; mining; and sample analysis.
A ninth object of this invention is to provide for teams of human proxy robots operating under direct human control to carry out missions on the earth, on the moon and at other near earth locations, where individual robotic team members are operated by humans specialized in fields such as construction of communication or observation platforms, assembly of telescopes and other instruments, landing and launch areas, shelters and habitations for human dwellers, or mines or resource processing facilities.
A tenth object of this invention is to provide a middle course between robotic and manned space missions that goes far in satisfying the need for human presence while avoiding the inherent risks and enormous cost to send human astronauts to places like the moon, with exploration undertaken by means of robot proxies operated by specialists on earth who see what the proxy sees and feel what it feels, while working and making judgement calls in their particular specialty.
An eleventh object of the present invention is to describe a viable methodology for human space exploration utilizing proxy robot surrogates in space controlled by humans in non-earth locations including space stations, orbiting modules, spacecraft, and lunar or planetary bases.
A twelfth object of the present invention is the provision of two-way data and communication channels between proxy robots and their handlers, including channels from proxy to human with video, sensory, positional and analytical data.
A thirteenth object of the present invention is the provision of two-way data and communication channels between proxy robots and their handlers, including channels from handler to proxy with “follow me” positional data and mission commands.
A fourteenth object of the present invention is the provision of send/receive headsets for human handlers operating proxy robots as a team, whereby the handlers can communicate among themselves and with other mission specialists while operating their individual proxies.
A fifteenth object of the present invention is the provision of replica tools for the human handler of exactly the same size and shape as the tools available to the proxy robot, but made to match the weight of each tool in its remote location.
A sixteenth object of the present invention is to provide a treadmill for the human handler with provision for changing the pitch and roll of the treadmill to match conditions in the remote location of the proxy robot.
A seventeenth object of the present invention is to provide a treadmill for the human handler with provision for changing the pitch and roll of the treadmill to match conditions in the remote location of the proxy robot, where pitch, roll and other positional data are continually adjusted in the handler environment from computer-driven mechanisms analyzing video and other signals from the proxy robot.
An eighteenth object as in seventeen above, wherein doppler radar transceivers operating via radio frequency, light, infra-red or even sonar where applicable could be located in appropriate locations such as above the robot's eye cameras and in the front of the robot's boots.
A nineteenth object of the present invention is to provide a flow of data from human handler to proxy robot, wherein joints in the arm, wrist, hand, fingers, torso, legs, feet and neck of the human handler continually send positional and joint angle data to the robot for “follow me” repication by the proxy robot.
Object twenty as in object nineteen, wherein sensors would continuously monitor the side-to-side angle (heading), up-down angle (pitch), and sideways tilt (roll) of the human's head, allowing all of these angles to be faithfully replicated by the proxy robot.
A twenty-first object of the present invention is to provide outer wear for the human handler such that, wherever the proxy robot is stiff and inflexible, the human should feel the same inflexibility.
A twenty-second object of the present invention is the provision of a two-way communication headset to be worn by the human handler to allow handler communication with human colleagues, including mission personnel and other team members.
A twenty-third object of the present invention, where the human handler's microphone can also be used for voice commands to the mission computer, like saying “Freeze, Freeze” to stop the robot in its tracks and go offline, and “Restore, Restore” to restore the link and continue human-robot interaction.
A twenty-fourth object of the present invention is the provision of a “gravity harness” connected to a number of bungee cords or cables with springs, all calibrated to render the effective weight of the human handler the same as that of the handler's proxy robot at its remote location.
A twenty-fifth object of the present invention is the provision of a video display for the human handler showing real- or near-real time video from the camera “eyes” of the handler's proxy robot.
A twenty-sixth object of the present invention, wherein the video in the preceeding object is three-dimensional, with the human handler's goggles or other display including provision for 3-D rendering such as polarization, left-right switching, color differentiation, vertical striation or some other known way to channel video from the robot's right camera to the handler's right eye and left camera robot video to the left eye of the handler.
A twenty-seventh object of the present invention is the provision of a video display screen as in the two preceding objects, wherein the display screen also includes information from the remote location such as ambient temperature, ambient luminosity, pitch forward, roll right-left, heading in degrees from true north, latitude and longitude, surface conditions, proxy battery status, and an area of the screen for alerts and warnings.
A twenty-eighth object of the present invention is the provision of a video display screen as in the preceding object, including a frontal and right profile view of the proxy robot's body in simple outline or stick figure form.
A twenty-ninth object of the present invention is the provision of a method and apparatus whereby the handler can change heading on a treadmill, causing the handler's proxy robot to change heading while the human handler stays safely on the treadmill, accomplished by placing the treadmill on a turntable which changes heading to match the average orientation of the handler's boots, with two or more markers on each boot signaling the orientation of that boot.
A thirtieth object of the present invention according to object twenty-nine, wherein an overhead reader scans or otherwise notes the position of the markers atop the handler's boots, such that when the second boot has changed heading, the reader sends a command to the turntable to rotate to a new heading averaged between the heading readings from both boots.
A thirty-first object of the present invention in accordance with object thirty, where the operational medium between the markers and reader is some method of radio transmission such as RFID, Bluetooth, WiFi, Zigbee, near-field or any number of other RF means; and wherein the reader contains transceivers that “ping” both points on each boot to triangulate their orientation and relative locations.
A thirty-second object of the present invention is further to the matter disclosed in objects thirty and thirty-one, wherein other triangulation methods can include laser transmission and reflection, radar and sonar, and the markers on the boots might themselves be transmitters of RF, sound or light, in which case the reader would incorporate one or more receivers to plot the orientation of each boot.
A thirty-third object of the present invention is a method and apparatus for varying the pitch and/or roll of a treadmill for a human proxy robot handler, wherein attached to the treadmill frame are four legs which are extendable via hydraulic, pneumatic or other means from a relatively short profile to many times that height; such that pitch (front to back tilt) may be varied by extending either front or back legs; roll (right-left tilt) can be varied by extending the legs on either side; and combinations of pitch and roll can be created by varying the length of each leg.
A thirty-fourth object of the present invention is another method and apparatus for varying the pitch and/or roll of a treadmill for a human proxy robot handler, wherein the treadmill is mounted by suitable means to a stand which rests on four or more short legs, and each leg in turn rests on a ball joint and ball-cupped foot which may be mounted to the floor, and wherein pitch and roll are controlled by four winches, each connected to a cable, wire or rope, and various corners of the treadmill stand are lifted to achieve the appropriate amount of pitch and/or roll.
A thirty-fifth object of the present invention adds stability to the device disclosed in object thirty-four above by including telescoping or coiled spring elements in each short leg to allow all legs to continue to touch the floor under any combination of pitch and roll.
A thirty-sixth object of the present invention adds stability to the device disclosed in object thirty-four above in the form of four bungee cords or cables with series springs radiating outward from each corner of the stand, with each cord connected to a suitable hook to maintain the entire platform centered and stable under various conditions of pitch and/or roll.
A thirty-seventh object of the present invention is a method and apparatus for varying the pitch and roll of a treadmill by housing that treadmill and a human proxy robot handler in a modified or custom made motion simulator, complete with gravity harness and large video screen, and wherein pitch and/or roll can be modified by varying the length of four or more large hydraulically extending arms supporting the motion simulator.
A thirty-eighth object of the present invention is the provision of an environment simulator including a treadmill with variable pitch and roll and infinitely variable heading; wherein the treadmill takes the form of a large sphere with a diameter many times average human height.
A thirty-ninth object of the present invention is the provision of a spherical treadmill environment simulator as in object thirty eight above, wherein the sphere rests upon several large bearings and is rotated by a plurality of rollers in contact with the surface of the sphere so as to turn the sphere in any direction when commanded by circuitry monitoring both the steps of a human handler and the pitch and roll of terrain immediately ahead in the remote location.
A fortieth object of the present invention is the provision of a spherical treadmill environment simulator as in object thirty eight above, wherein the treadmill itself moves the handler to a location on the surface of the sphere which exhibits pitch and roll matching terrain conditions in the remote location of the handler's proxy robot.
A forty-first object of the present invention is the provision of a spherical treadmill environment simulator as in object thirty eight above, with the added feature of the simulator receiving data from sources on the “person” of the proxy robot including 3-D video from its camera “eyes,” terrain-level radar data from its boots, and an additional radar view from a point above the robot's video cameras.
A forty-second object of the present invention is the provision of a spherical treadmill environment simulator as in object thirty eight above, wherein video from the remote location is routed to a video terrain analyzer which turns the near-real-time video stream into data about the terrain ahead, both immediate and the general lay of the land upcoming.
A forty-third object of the present invention is the provision of a spherical treadmill environment simulator as in object forty-two above, where the mentioned video data is combined with signals from the proxy robot's boot view and head view radar and routed to a “terrain just ahead” circuit where they are bundled with handler step motion data and fed to a processor which turns all the input into meaningful signals to drive the spherical treadmill's roller motors.
A forty-fourth object of the present invention is the provision of a spherical treadmill environment simulator as in object thirty-eight above, including a gravity harness suspended from a platform by a number of bungee cords or cables with springs, and with the additional provision for moving the gravity harness to follow the movement of the handler about on the sphere to maintain direct overhead lift and an effective human handler weight equal to that of the remote proxy robot.
A forty-fifth object of the present invention includes the movable gravity harness lift described in object forty-four above, but with the lifting and positioning done by a movable, extendable boom or robotic arm which receives data from a processor and maintains direct overhead upward torque on the human handler in her gravity harness.
A system for controlling a human-controlled proxy robot surrogate is presented. The system includes a plurality of motion capture sensors for monitoring and capturing all movements of a human handler such that each change in joint angle, body posture or position; wherein the motion capture sensors are similar in operation to sensors utilized in motion picture animation, suitably modified to track critical handler movements in near real time. A plurality of controls attached to the proxy robot surrogate is also presented that relays the monitored and captured movements of the human handler as “follow me” data to the proxy robot surrogate in which the plurality of controls are configured such that the proxy robot surrogate emulates the movements of the handler.
The objects and advantages of the invention will be realized and attained by means of the elements and combinations particularly pointed out in the claims. It is to be understood that both the foregoing general description and the following detailed description are exemplary and explanatory and are not restrictive of the invention, as claimed.
A description of the preferred embodiments with reference to the figures is here presented.
Referring to
Proxy robot 1 is also holding a bar tool 4 in its right hand 3, but in this case the tool is real, made from steel or a similar substance capable of performing real work. Note as well that the robot is being made to walk up a slight hill 7, the incline of which is duplicated by mechanisms controlling a treadmill 8, which in this figure and those to come may, in an exemplary embodiment, be a manual treadmill controlled by the human handler's feet. Alternatively, the controlling mechanism is a motorized treadmill that automatically re-centers the handler after each step. Such control of handler pitch, roll and heading will be covered in the discussion under the figures to come.
Pitch and other positional aspects of handler's treadmill 8 are continually adjusted in the handler environment from computer-driven mechanisms analyzing video and other signals from the proxy robot. For example, satellite triangulation might have sufficient resolution to indicate an average terrain rise of so many centimeters per meter; moreover, Doppler radar transceivers operating via radio frequency, light, infra-red or even sonar where applicable could be located in appropriate locations 26, 27 such as above the robot's eye cameras and in the front of the robot's boots, respectively.
Some data, such as that just discussed, flows from proxy robot location to human base. Just as vital is data flowing from handler to proxy robot. For example, joints 10 in the arm and wrist of human handler 2 continually send positional and joint angle data to the robot for “follow me” replication by the proxy. Similar data is sent from hand and finger joints 12 in the human handler for replication in the same joints or hinges 11 in the robot. Torso and leg angles in the human 14 are also sent as data to the proxy for replication 13, and joint angles in the feet of the handler 16 are translated into data for replication in the proxy 15.
There are a number of means by which joint angle and similar data can be monitored and sent. One possibility is via clothing with built-in strain gauges at critical joints; another is from similar strain gauges in special elastic bands fitted for wear on the knees, ankles, elbows and so forth. Gloves, stockings and “booties” can also contain strain gauges. Another approach involves gyroscopic position marking, especially of the head's various angles. While only one side of human and proxy are depicted, is to be appreciated that similar data emanates from the right arm and leg of the human to control those sections of the proxy as well.
Depending on the need of the mission and complexity of the proxy robot, data may be sent from many more points on the human for replication by the proxy. Vital sensors would continuously monitor the side-to-side angle (yaw or heading), up-down angle (pitch), and sideways tilt (roll) of the human's head, represented by point 18 in the drawing. All of these angles would be faithfully replicated by the proxy robot, as represented by point 17. This latter interchange of data is extremely important, since it duplicates the human function of scanning, analyzing and just “looking around.”
Another method of sending “follow me” movement and positional data from handler to proxy was discussed in U.S. Patent Application 61/613,935; namely, the use of motion capture technology to monitor the same critical joint and movement areas by camera or other means. Depicted in the drawings are three appropriately modified motion capture cameras 37-39 spaced at 120-degree angles around the handler to capture the handler's every move. Data from these cameras is sent to a computer for analysis which is translated to near-real time movement commands to the proxy robot.
There are approximately 230 joints in the human body, but a number far fewer than this can suffice for robots and their human handlers. Wherever the robot is stiff and inflexible, the human will feel the same inflexibility in this exemplary embodiment, as noted by rigid areas 19 on the arm and torso of the proxy and the same areas 20 on the handler. Area 21 on the human handler comprises a display of video from the camera “eyes” 28 of the proxy robot. Other important data may be displayed on the handler's goggles as well, the subject of the figure to follow.
A two-way communication headset worn by the handler includes headphones 22 and microphone 29, and provides a means of handler communication with human colleagues, including mission personnel and other team members. The handler's microphone 29 can also be used for voice commands not directly intended for the proxy robot. A prime example of the latter is a command to take the handler off-line: for a change of handlers, a coffee or bathroom break, a quick meal or other purposes. So the handler might say “Freeze, Freeze” to stop the robot in its tracks and go offline, and “Restore, Restore” to restore the link and continue human-robot interaction.
A “gravity harness” 23 complete with protruding portions 24 to allow maximum handler flexibility is connected to a number of bungee cords 25 (or cables with springs) calculated to render the weight of the human handler the same as that of the handler's proxy robot at its remote location.
For example, earth's moon has approximately ⅙ earth gravity, so if a particular proxy robot weighs 120 kilograms on earth it would weigh a mere 20 kg on the moon. So the object is to render the weight equivalent of the human handler that same 20 kg, regardless of his or her actual weight. Put another way, if the handler weighs 70 kg, the gravity harness would effectively reduce that weight to 20 kg if that is the weight of the proxy on the moon.
In an exemplary embodiment, as this video would almost certainly be three-dimensional, the handler's goggles include such provision for 3-D rendering as polarization, left-right switching, color differentiation, vertical striation or some other known way to channel video from the robot's right camera to the handler's right eye and left camera robot video to the left eye of the handler.
The display screen can also include such important information from the remote location as ambient temperature, ambient luminosity, pitch forward (incline in this case), roll right-left (slight tilt to the right showing), heading in degrees from true north, latitude and longitude, surface conditions, and proxy battery status, all represented by 31 in the drawing.
Area 32 of the display might contain alerts and warnings, in this case a message about an abrupt 3.51 meter rise (the big rock) some 4.7 meters ahead of the proxy, while area 32 of the screen could show a frontal and right profile view of the proxy robot's body in simple outline or stick figure form. The latter could be vital in depicting a proxy robot fall or entanglement.
In
In
In
In practical terms there are many ways that reader 68 can track the points on the handler's boots. One possibility is by radio transmission (RFID, Bluetooth, WiFi, Zigbee, near-field or any number of other RF means), wherein the reader contains transceivers that “ping” both points on each boot and triangulate their relative locations. Other triangulation methods can include laser transmission and reflection, radar and sonar. Or the points on the boots might themselves be transmitters of RF, sound or light, in which case the reader would incorporate one or more receivers to plot the orientation of each boot.
Still under
So the purpose of each pressure switch 69 is to tell the proxy robot that the heel, sole or both portions of the handler's boot is firmly on the ground, at which point the proxy will follow suit. Having pressure switches 69 under each portion also guides the proxy in the navigation of rough terrain, steep angles and so forth.
While
Let us first consider pitch. If we want to tilt the treadmill up from front to back 80, front legs 74 and 75 should be in their compressed state, while back legs 73 and 76 will be totally or partially extended to achieve the desired rise to the rear of the treadmill. Front-up, rear-down pitch 81 is achieved by doing the opposite: extend front legs 74 and 75 and compress back legs 73 and 76.
In the case of roll, we can tilt (roll) the treadmill downward toward the right side 84 by compressing legs 75 and 76 while extending legs 73 and 74, or conversely tilt downward toward the left side 85 by compressing legs 73 and 74 while extending legs 75 and 76.
The accurate simulation of some remote terrain might involve a degree of both pitch and roll: for example, as the proxy robot climbs an irregular incline. Simulating this condition might involve fully compressing left rear leg 73, fully extending right front leg 75, and partially extending legs 74 and 76—all in accordance with terrain data received from video and sensors on the proxy robot.
In this figure, pitch and roll are controlled by four winches 97-100, each connected to a cable, wire or rope 93-96, and one or more corners of the treadmill stand 88 are lifted to achieve the appropriate amount of pitch and/or roll. For example, if the incline of the terrain depicted in
In the example above, the treadmill would rest solely on its two rear legs, but the angle of each leg would no longer be perpendicular to the floor. This is the reason for ball joints 91, allowing the some weight of the treadmill and stand to rest on the rear legs even as their angle changes relative to the floor.
Always having at least one and usually at least two feet on the floor will help secure the semi-hanging treadmill, stand and human controller, but there are at least two additional possibilities to further stabilize the device. The first is to have telescoping elements 92 in each short leg to allow all legs to continue to touch the floor under any combination of pitch and roll. These are not the hydraulic or pneumatic jacks of
A second method of platform stabilization is depicted in the form of lines 115-118 radiating outward from each corner of the stand 88. These lines are connected to a suitable hook 119, and may represent bungee cords or ropes or cables with series springs to maintain the entire platform centered and stable under various conditions of pitch and/or roll.
Within the pod of motion simulator 101 we see the human handler of
As a consequence, the goggles 113 worn by the handler in this drawing are likely for 3-D viewing, while a two-way headset 114 may still be employed for mission and team communication as well as voice commands like “Freeze, Freeze.” Although the same ends could be accomplished via a microphone and speakers not directly connected to the person of the handler, the headset 114 serves the additional purpose of isolating the handler from ambient noise including operational sounds of the motion simulator.
The sphere 130 can be made of a lightweight but strong material such as plastic, aluminum or composite coated with rubber or a similar no-slip substance. It rests upon three or more large bearings 134, with each bearing seated in a socket 134a which is mounted firmly in place to the support floor under sphere 130. Bearings 134 and their lubricated sockets 134a assure movement of the sphere with minimum friction, allowing pressure wheel motors 131 and 133 to be relatively small and economical.
In the upper (simulator stage) portion of the sphere 130, a human handler 135 is taking a step to direct her proxy robot's course. As this takes place, data indicating handler heading 141, step distance 142 and step moment (time duration and velocity) 143 is sent to handler step motion circuitry 136 which sends appropriate data representing each parameter to both the proxy robot as part of a “follow me” data string 139 and to a processor 137 that feeds either digital or analog data to motor control circuitry 138a, 138b and 159, with description to follow later.
If the proxy robot is walking on flat terrain, the human handler will occupy position 135a at the very top, center of sphere 130. Although that handler will be atop a very slight rise equal to the rise atop that section of the sphere, the simulation from a sphere five times the human's height will be of a relatively flat surface.
But if the robot is walking up a rise akin to the example in
Downward pitches on the same heading at −10, −20 and −45 degrees can be simulated from positions to the left of the sphere, at 135e, 135f and 135g, respectively. If the handler's position moves left in the direction of arrow 146, there will be leftward roll (left tilt) in that position. For example, position 135h would exhibit severe roll, tilting some 25 degrees to the left. Moving the operating stage in the opposite direction (hidden from view) will result in roll to the right (right tilt). From the foregoing, it can be seen that any conceivable combination of pitch and roll can be found at various locations on the surface of the spherical treadmill 130.
Since the pitch and roll conditions in the simulator beneath the human controller are determined by feedback 152 from the proxy robot's remote location, suitable means must be present to change the location of the handler staging area to one matching the average pitch and roll of the remote terrain. In the drawing, data is received from at least three sources on the “person” of the proxy robot: 3-D video from its camera “eyes” 153, terrain-level radar data from its boots 157, and an additional radar view 158 from a point above the robot's video cameras.
The video feed from the remote location is routed directly to display devices for the human handler and other mission personnel. Video can also go to a video terrain analyzer 153 which turns the near-real-time video stream into data 156 about the terrain ahead, both immediate (next step) and the general lay of the land upcoming.
These three data streams—video analysis 156, boot view radar 157a and “third eye” radar 158a are routed to a “terrain just ahead data” circuit 154 where they are bundled with data from handler step motion data circuit 136 and fed to a processor 137 which turns all the input into meaningful signals to drive the above-mentioned motor control circuitry 138a, 138b and 159.
Motor control circuits 138a and 138b convert the data from processor 137 into positive or negative direct current to drive motors 131 and 133 and their respective pressure rollers 131a and 133a in either direction when so instructed by processor 137, causing the sphere to turn under the handler's feet to compensate for steps the handler takes forward, backward or in any direction whatever. But since it is also acting from signals representing such upcoming terrain conditions as pitch 144, 145 and roll 146, it is the function of the roller motors to effectively move the sphere under the handler as each step is taken to place that person in average pitch and roll conditions matching the remote terrain to the greatest extent possible.
Motor mounts 132 are illustrated to show a possible position for a pressure solenoid that can activate whenever a roller motor is called into service, pushing, for example motor 131 and its attendant roller 131a harder into the sphere to gain traction. The advantage of using solenoids in this manner is that the non-active roller(s)—from motor 133 and its roller 133a in the example—provides less drag for the active motor and roller to overcome. Of course there may be instances when both roller motors (or possibly four roller motors, one every 90-degrees, with roller motor pairs spaced 180 degrees apart) may be called into action simultaneously. But in this case there will be less drag to overcome as motion overcomes inertia, even with all solenoids pushing the motors' rollers into the sphere. Although roller motors 131 and 133 are depicted as mounted against the upper floor 140, they can also be mounted at the sphere's equator or in any other convenient position.
As described in previous drawings, the human handler would be strapped into a gravity harness suspended from a platform 148, 149 by a number of bungee cords or cables with springs 147. A rotation collar 149b allows the platform to rotate freely in any direction. As the handler is effectively moved about on the staging surface of the upper sphere, it is important that the gravity harness follow those movements to maintain the handler's correct effective weight, by lifting from a position directly above the handler and harness. In the drawing, three handler positions are depicted: 135a which is relatively flat, 135b with a positive pitch 10 degrees, and 135c with a forward incline of some 20 degrees.
Roller motors 131 and 133 can place the handler in any of the above positions or virtually anywhere else on the simulator stage, but an additional mechanism is needed to move the gravity harness as the handler is moved. This mechanism is an extendable boom or robotic arm 162 shown at the top of
At the tip of the boom is a winch 161. The motorized winch maintains constant torque (upward pull) on the handler at some predetermined level. For example, if the handler is to match the 40 lb. lunar weight of a 240 lb. robot, that handler's weight should be effectively 40 lbs. So a 160 lb. human handler would require a constant upward pull of 120 lbs., and a downward pull by gravity of 40 lbs. It is the job of winch 161 to maintain this effective weight. The winch pays out as much cable 150 as necessary to constantly maintain the desired upward pull on the handler, and it receives data from processor 137 via boom motor control circuit 159. The cable positions 150, 150a and 150b are maintained directly over handler positions 135a,135b and 135c, respectively, by lateral movement of the boom, which can extend/retract; swing right or left, and tilt up or down in accordance with data instructions from processor 137 and boom motor control 159.
Maintaining constant torque solves one problem; namely, that the length of cable 150 must change the further the handler is moved from the “flat” position 135a at top center. So when processor 137 and roller motors 131, 133 act to place the handler in position 135c, for example, the length of cable 150 would leave the handler dangling in mid-air. But not really, since such dangling weight would equal 160 lbs downward. Immediately, the constant torque mechanism would tell the winch to let out more cable until the handler once again exerts 40 lbs downward and 120 lbs upward.
The winch weight-reducing apparatus is only necessary in remote locations with far less gravity than earth, a situation particularly true on the moon. For earth-bound projects, for example, the handler harness would require no gravity compensating apparatus, nor would it be useful on planets with greater gravity than earth.
Simply activating opposing roller motor pairs with motors spaced at ten degree intervals would permit the same ten degree resolution of movement by the sphere, but the ability to activate two neighboring motors such as 257, 258 when necessary as well as their counterparts on the other side of the sphere can reduce that resolution to five degrees of accuracy. But in point of fact, extremely fine resolution of movement, on the order of one degree or less, can be achieved through the application of more voltage on a motor such as 257 and less on its neighbor 258 as well as their opposing counterparts.
In this drawing, the motor control circuits 138a and 138b of
Motor and roller assembly 251 is shown in blowup form in insert 251a, wherein motor 266 is attached to roller 267, and the roller motor assembly itself is attached to a motor mount 268 attached to sphere 130. The motor mount includes a swivel 268a and spring 269 that pulls the roller motor assembly away from the surface 282 of the sphere, creating a gap 273 whenever the roller motor is not in use. This swivel and spring combination assures that inactive rollers are kept off of the surface of the sphere so that they don't add unwanted friction that impedes sphere rotation. Obviously, the swivel and spring are for illustration purposes only, and merely representative of a family of devices that can be employed for the stated purpose.
Also shown in insert 251a is a push solenoid 270 mounted 280 to sphere 130. The solenoid has an inner plunger 271, usually an iron rod that can be repelled or attracted by a magnetic coil in the solenoid. In this insert, the solenoid is not activated and the plunger is withdrawn nearly completely into the solenoid core.
Insert 265 illustrates a mode wherein the roller motor assembly is activated such that the roller comes into pressure contact with the surface 283 of sphere 130. This is shown in blowup form in insert 265a, where roller 274 is pressed against sphere surface 283 by energized solenoid 278 mounted 280 to the sphere. Note that plunger 279 is now extended from the solenoid core by magnetic repulsion, causing the motor mount 276 to rotate inward (counter clockwise) on its swivel 276a, stretching spring 277. In this active mode, positive or negative current applied to motor 274 by motor array controller 250 will cause the motor to turn in one direction, rotating the pressure roller 275 in the same direction, and causing sphere 130 to turn in the opposite direction.
Photovoltaic (PV) solar panels may also be included on shoulder/breastplate 184. Although the figure depicts 6 individual cells or sections in breastplate 184F (front), this is for illustration purposes only, and any number of sections or cells may be employed. Photovoltaic panels may also be placed on the top facing surfaces of the feet 185R and 185L.
From battery bank 187, electrical power 188 is routed to mobility motors, processors, communication systems, cameras and other sensors, size-changing apparatus and other systems and devices in the robot requiring electrical energy. A charge station connector 189 is included on the battery bank to receive power from another charge manager located in the robot's normal charging station.
If battery power is very low, robot power routing may be prioritized—either automatically or from the mission base—in such manner that communication systems and cameras, for example, may receive power when some other robotic system do not. This will allow mission personnel to analyze the situation and seek remedies.
The inclusion of solar energy systems as described in
For example, if positive DC current is applied to motor 191 in the torso of the pictured proxy robot, the motor will commence rotation, turning its two oppositely-threaded shafts 196 and 1997 in a counter-clockwise (CCW) direction (see threaded portions 201 and 202 in
Conversely, applying negative DC current to motor 191 will cause clockwise (CW) rotation of the oppositely-treaded shafts 196 and 197, causing these shafts to exit each treaded tube 198-199 and extend the dimensions of the torso.
The same applies to all other motors 192-195 and their corresponding shafts 196-197 with opposing threads and threaded tubes 198 and 199, but in the case of all other adjustable sections, normal operation would be to adjust right and left halves in pairs. For this reason there are two motors 192 in the upper arms with shafts and threaded tubes; two motors 193, et al in lower arms; two motors 194 et al in upper legs and two motors 195 in lower leg sections. In the drawing, darkened areas at the joints 190, shoulders and hips simply indicate structural connection points to complete the robotic skeleton.
Thus it can be seen that positive or negative DC current may be applied to either torso motor 191 or any of the arm or leg pairs, not only to adjust the overall height of the proxy robot from a minimum of around 5 feet to a maximum of 6.5 feet or greater, but also to adjust body proportions to match those of a human handler with, for example, long legs and short torso; long arms and legs and average torso, or long torso and shorter legs—combinations that real people bring to each mission. More will appear on this subject under
Power-assisted proxy robot adjustment means like those described above might enable programmed readjustment of robot dimensions with each change of handler. For example, 5 handlers might be continuously operating a single robot in shifts, twenty-four hours per day, seven days a week (earth time). At each shift change, the new handler could enter a code or swipe a card (etc) which would not only serve as a security pass but also feed that particular handler's human dimensions into a program that would automatically readjust the robot to the dimensions of the new handler. The closer the physical match between handler and robot, the simpler and safer it movement and productive operation, and the more the handler will feel “at home” in the body of her/his robotic partner.
Of course, manual dimension adjustments might be made to a proxy robot with motorized or otherwise powered controls as well, not only to override or circumvent programmed adjustment but also for testing or field adjustments for whatever reason. In one example of the latter, particular conditions in a mine or crater, say, might need the services of a “taller” robot, while work in a confined space might warrant minimizing all dimensions.
To extend the apparatus of
The two sides of each motor coil are directed to a proxy dimension motor controller 210, which in turn receives data 219 representing programmed dimensions 216 which can be either entered locally 217 at the site of the proxy robot, whether in factory, home base or some remote location, or, more likely, as remote input 218 within the communication data stream from the mission base.
Note as well direct inputs 211-215 to each motor or pair. This allows dimension changing by the application of appropriate positive or negative DC current directly into the robot—for testing, emergency situations, work-arounds and so forth.
To the right of the taller human-proxy robot pair is another, shorter human handler 222 of five foot height, matched by proxy robot 223 of that same height. While it is obvious that humans 220 and 222 are not the same individual, the same cannot be said of robots 221 and 223, which very well may be the same proxy robot adjusted electronically to match the heights and other dimensions of the two rather distinct human handlers.
Note that the proxy robot's outer skin 224, 225 remains smooth and intact over the surface of the robotic frame. This outer skin renders the robot's internal circuits, power supplies and mechanisms clean and free from contaminates like dust, liquids and so forth, made possible through the use of an elastic, pleated or otherwise stretchable proxy robot skin constructed of plastic, rubber or some other flexible material.
Note as well compartments 226-229 in the larger proxy robot iteration 221. These contain electronics, mechanics, batteries, etc, and are mounted with vertical space between pairs 226-228 and 227-229. But in shrunken proxy robot iteration 223, the extra vertical space between the same compartment pairs 226a-228a and 227a-229a has nearly disappeared.
The principals discussed under
Typically pump 230 is electrical; nevertheless, in dealing with proxy robots, whether semi-autonomous or under direct human handler control, it is possible to consider even a manual pump that can be operated by either another proxy robot or even the subject proxy robot itself: when it begins to feel “tired” it pumps a plunger, squeezes a fluid-filled ball or whatever to revitalize itself! Considerations such as this make it possible to envision robots operating completely from compressed fluid, with perhaps a single electric pump or even no electric compressor pump at all, with the robot receiving a full pressure charge periodically from a station at its mission base.
Still under scenario one, pressurized hydraulic fluid is available to a series of pressure valves 231-235 which take on the functions of the dimension-changing screw motors presented under
The second scenario is also hydraulic, but in this case tank 241 serves to simply provide extra hydraulic fluid, and what were pressure valves 231-235 become individual pumps that each generate pressure sufficient to maintain a required set of strut dimensions. In this scenario, tank pump 230 simply assures sufficient fluid supply to each individual strut pump.
Scenario three works basically like scenario one, but in this case compressed gas replaces the hydraulic fluid. So pressure pump 230 is an “air” (gas) compressor that maintains the gas in tank 241 at a constant pressure, and pressure valves 231-235, pistons 238-239 and cylinders 236-237 are all pneumatic rather than hydraulic. Although robot mobility is not the focus of the present discussion, it is to be understood that systems for robot motion can also be hydraulic or pneumatic in nature as well as operating from electric motors so some combination of the above.
The block diagram under
Specifically, numbered items 231-235 are either pressure pumps or pressure valves as described in
The two sides of each pump motor or electrical valve coil are directed to a proxy dimension motor controller 250, which in turn receives data 251 representing programmed dimensions 252 which can be either entered locally 253 at the site of the proxy robot, whether in factory, home base or some remote location, or, more likely, as remote input 254 within the communication data stream from the mission base.
Note as well direct inputs 245-249 to each motor or pair. This allows dimension changing by the application of appropriate positive or negative DC current directly into the robot for testing, emergency situations, work-arounds and so forth.
This specification focuses on the creation of an environment for a human handler reflecting as closely as possible the remote environment of the handler's proxy robot. Simulating a remote environment is extremely valuable in training human handlers of proxy robots, both singly and in teams.
For training purposes, the content herein is applicable to robots with some or even a great deal of autonomy as taught in the previous application. But for actual missions this specification is particularly pertinent to cases where the robot is largely devoid of artificial intelligence (AI), essentially representing an extension of the human handler.
Put another way, this specification is about human telepresence in space, and especially in such near-space locations as the earth's moon. During his or her turn in control of a given proxy robot, the human handler sees and feels and acts through the “person” of that robot: guiding the proxy in exploring; mining; doing science experiments; constructing; observing the earth, planets or stars; launching spaceships to further destinations; rescuing other robots or humans; or simply enjoying an earthrise over the moon's horizon.
The present invention claims priority to Provisional U.S. Patent Application No. 61,599,204 filed on Feb. 15, 2012, entitled “Space Exploration with Human Proxy Robots;” Provisional U.S. Patent Application No. 61,613,935 filed on Mar. 21, 2012, entitled “Remote Environment Simulator for Human Proxy Robot Handlers;” and co-pending non-provisional U.S. patent application Ser. No. 13/479,128 filed on May 23, 2012. The application to follow has basis in all of the earlier filings, with special emphasis on the creation of an environment for a human handler reflecting as closely as possible the remote environment of the handler's proxy robot.
Number | Date | Country | |
---|---|---|---|
61599204 | Feb 2012 | US | |
61613935 | Mar 2012 | US |