Patent Application
20060224280
1. Technical Field of the Invention
The invention relates to systems for remotely controlling a vehicle, such as a land or sea vehicle.
2. Background of the Related Art
There are situations where it is advantageous to remotely operate a vehicle, without a human operator being onboard the vehicle. One example of such a situation is when handling actual or potential explosive devices. Remote control systems for such vehicles have often been awkward to operate. Accordingly, it will be appreciated that improvements in such systems would be desirable.
According to an aspect of the invention, a remote control system for control of a vehicle allows the user to access auxiliary functions while maintaining physical contact with controls for controlling movement of the vehicle.
According to another aspect of the invention, a remote control system for control of a vehicle includes camera controls that are accessible to the hands of the operator while the operator maintains physical contact with the vehicle movement controls and controls for moving an accessory of the vehicle. The camera controls may include controls for controlling one or more of camera pan angle, camera tilt angle, and/or degree of camera zoom. The camera controls may also include (or may alternatively include) one or more controls that allow setting of one or more camera preset configurations (selecting predetermined values of camera orientation (pan and/or tilt) and/or degree of camera zoom).
According to still another aspect of the invention, a control system for remotely controlling a vehicle includes: hand controls for remotely controlling movement of the vehicle, and for controlling one or more cameras mounted on the vehicle; and a display for displaying output from the one or more cameras. The hand controls are configured to be moved to control movement of the vehicle. The hand controls include camera-control switches for controlling the one or more cameras. The hand controls are configured to receive both hands of a user. The camera-control switches are operable by the user without the user removing the hands from the hand controls.
According to a further aspect of the invention, a method of remotely controlling a vehicle, includes the steps of: controlling movement of the vehicle and one or more accessories of the vehicle using hand controls of a remote control system; and controlling positioning of one or more cameras of the vehicle using camera switches on the hand controls.
To the accomplishment of the foregoing and related ends, the invention comprises the features hereinafter fully described and particularly pointed out in the claims. The following description and the annexed drawings set forth in detail certain illustrative embodiments of the invention. These embodiments are indicative, however, of but a few of the various ways in which the principles of the invention may be employed. Other objects, advantages and novel features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the drawings.
In the annexed drawings, which are not necessarily to scale:
A remote control system for remotely controlling a vehicle includes a pair of hand controls to be engaged by hands of a user, and a visual display that provides feedback regarding actions of the remotely-controlled vehicle. The hand controls may be moveable in order to cause movement of the overall vehicle and accessories of the vehicle. Numerous switches on the hand controls may be operable for other purposes while the user maintains a gripping or other physical engagement with the hand controls. The other controls may include switches, buttons, and/or slides, for performance of any of a wide variety of other tasks. For example, other controls may be used to control pan, tilt, and zoom functions of one or more cameras on the vehicle. There may be buttons or switches corresponding to a number of preset positions for the one or more cameras. The additional controls may include an actuatable switch, such as a slider, to control sensitivity of inputs provided by moving the hand controls. The visual display may show visual output from the one or more cameras mounted on the vehicle, as well as a wide variety of other information, such as position of vehicle accessories, position of the controllers, and status of the vehicle. By enabling a user to remotely control the vehicle without needing to remove hands from the hand controls, and without needing to shift his or her gaze from the visual display, a user may advantageously be able to remotely operate the vehicle in an efficient way, substantially intuitively controlling the remote vehicle. The remote control system allows precise remote control, with visual feedback, of vehicles in any of a wide variety of situations, including vehicles operating in dangerous environments.
The remote control unit 10 includes a computer 20, a display 22, a pair of hand controls 24 and 26, and a control unit transceiver 28. The computer 20, which may be a standard computer such as a personal computer, is coupled to the other components 22-28 for communicating information to and from a user of the remote control unit 10. The hand controls 24 and 26 are used to allow the user to input commands to the vehicle 12. The commands may include effecting overall movement of the vehicle 12 by a movement system 30 of the vehicle 12, moving attachments or accessories 32 of the vehicle 12, for instance to perform an operation, and/or positioning or operating sensors 33 of the vehicle 12, for instance a roof camera 36 and a cab camera 38. Information input by the user into the hand controls 24 and 26 is suitably processed by the computer 20, so that suitable signals are transmitted by the control unit transceiver 28 to a vehicle transceiver 40. Various information may be transmitted from the vehicle 12 to the remote control unit 10 via the transceiver 40. Such information may include position information regarding the overall position of the vehicle 12, the position of various parts of the attachments or accessories 32 of the vehicle 12, and images or other information received by the sensors 33. Further information regarding the status of the vehicle, such as the vehicle's speed, may also be transmitted. Information from the vehicle 12 may be processed by the computer 20, and may be visually displayed on the display 22 for use by the user or operator of the remote control system 10. Thus, the remote control system 10 allows interactive remote operation of the vehicle 12.
The vehicle 12 illustrated in
Turning now to
In the illustrated embodiment, the hand controls 24 and 26 are respective joystick controllers 54 and 56. The joystick controllers 54 and 56 have respective bases 60 and 62, with respective joysticks 64 and 66 movable relative to the bases 60 and 62. The joysticks 64 and 66 have various controllers (buttons, switches, and sliders), which are used to control camera movements and the input sensitivity of movement of the joysticks 64 and 66. These controllers (also referred to as switches or control switches) are described in greater detail below.
The joystick controller 54 is used for control of general motion of the vehicle 12, and for control of the cab camera 38. In controlling overall motion of the vehicle 12, the joystick 64 may be tilted forward to move the vehicle 12 forward, may be tilted backward to move the vehicle 12 backward, and may be tilted to the left or right to turn or pivot the vehicle 12.
The joystick controller 56 is used for controlling movement of the attachment 32 (the bucket 34 and the arm 35) of the vehicle 12, and for controlling operation of the roof camera 36. Tilting the joystick 66 forward lowers the attachment arm 35 of the attachment 32. Tilting the joystick 66 backwards raises the attachment arm 35 of the attachment 32. Movement of the joystick 66 to the left and right raises the bucket 32 (tilting it upward) and lowering the bucket 32 (tilting it downward, such as to dump contents of the bucket 32).
It will be appreciated that alternatively the joystick controller 54 may be used to operate the roof camera 36, and the joystick controller 56 may be used to operate the cab camera 38.
The control of movement of the vehicle 12 and the attachment 32 by tilting of the joysticks 64 and 66 may correspond to movements used by an onboard operator of the vehicle 12, to cause similar movements of the vehicle 12 and the attachment 32. This advantageously makes operation of the remote control system 10 more closely correspond to actual operation of the vehicle 12 by an onboard operator. This allows a user experienced with on-board operation of the vehicle 12 to more quickly, easily, and accurately transition to operation of the vehicle 12 by use of the remote control system 10. However, it will be appreciated that the configuration of the hand controls 24 and 26 need not necessarily correspond to the configuration and/or operation of onboard controls (if any) of the vehicle 12.
Additional operations may be accomplished by other movements of the joysticks 64 and/or 66. For instance, twisting of one or both of the joysticks 64 and 66 may be used to perform an operation in the vehicle 12 and/or the attachment 32. As one specific example, twisting of one of the joysticks 64 and 66 may be used to operate a claw on the attachment 32.
Additional controls on the joystick 64 include a trigger 80 and a movement throttle slider 84. The trigger 80 may be actuated by a finger of the operator, such as the index finger, in order to engage an additional function. For example, depression of the trigger 80 may enable a faster rate of camera control utilizing the camera zoom buttons 72 and 76, and/or the camera pan-and-tilt hat switch 74. In addition, depressing the trigger 80 before pressing one of the camera preset buttons 77-79 may allow access to another set of camera presets. Alternatively, the control system 10 may be configured such that the trigger 80 engages an independent function.
The movement throttle slider 84 controls sensitivity of movement actuated by tilting the joystick 64. In some circumstances, it is desired that the movement of the vehicle 12 and/or the attachment 32 be finely adjustable. Accordingly, the movement throttle slider 84 may be used to increase or decrease the sensitivity of movement caused by tilting of the joystick 64. For example, when it is desired to move the vehicle 12 close to an object, such as a wall, without hitting the object, the vehicle 12 may be brought within a few meters of the object using the regular coarse settings of the movement systems actuated by tilting the joystick 64. Then, the movement throttle slider 84 may be adjusted so that further tilting of the joystick 64 may result in only very small movements of the vehicle 12. This allows the operator to make small adjustments in the position of the vehicle 12, while still retaining the option to make larger and faster movements of the vehicle 12 when fine adjustments are not necessary. The movement slider 84 may be a slider switch that may be actuatable by the user, without letting go of the joystick 64.
It will be appreciated that a movement throttle slider may also be provided on the joystick 66 in order to provide the ability to make fine adjustments in the positioning of the accessory 32.
The direction and amount of zoom in the cameras 36 and 38 are illustrated graphically in the camera position illustrations 90 and 92. The illustrations 90 and 92 show graphic illustrations of the direction and amount of zoom of the cameras 36 and 38, relative to respective side and top views of the vehicle 12. In the side image 90, the angles of tilt of the cameras 36 and 38 are illustrated by relative tilt of triangles 96 and 98 that appear to emanate from representation of the respective cameras 36 and 38. The pan angles of the cameras 36 and 38 are illustrated by position of triangles 106 and 108 in the top image 92. The size of the triangles 96, 98, 106, and 108 graphically illustrate the amounts of zoom in the corresponding cameras 36 and 38. A smaller triangle graphically indicates a greater amount of zoom for the corresponding camera, and a narrower field of view (FOV). A larger triangle graphically indicates a decrease in amount of zoom for the corresponding camera, and a wider field of view (FOV). To aid in differentiating between the triangles 96 and 98, the triangles 96 and 98 may be displayed in different colors, or in another visually different manner.
Control position images 114 and 116 may be used to indicate the actuation of some or all of the parts of the respective hand controls 24 and 26. For example, tilting of the joysticks 64 and 66 may be indicated by highlighting, or changing or adding colors to various arrows 124 and 126 in the images 114 and 116. Actuation of the various camera-control switches may also be indicated in the images 114 and 116, by any of a variety of visual indicators provided on corresponding portions of the control indicators 114 and 116.
Status of various parts of the vehicle 12 and/or the control system 10 may be indicated in a status region 130 of the display 22. This region may display status and/or information regarding linking status and/or operability of various components of the vehicle 12; the speed of the vehicle 12; latitude, longitude, location, and/or altitude of the vehicle 12; and/or configuration of the input devices, such as the hand controls 24 and 26.
It will be appreciated that the large amount of visual information supplied in the display configuration that is shown in
It will be appreciated that the display shown in
It will be appreciated that suitable computer software may be configured to run on the computer processor 41, for generation of the display shown in
The remote control system 10 has been described above as operating through use of software on a single computer 20. The computer system 20 may utilize any of a variety of suitable operating systems, for example, including graphical user interface systems such as WINDOWS. Software for executing the above-described functions on the computer system 20 may be written in any of a variety of suitable computer systems.
The software may be executed on a single computer, for instance on a single processor. Alternatively, execution of the software and/or the functions described above may occur in multiple computers, for instance linked to one another over a network, such as the Internet, wide area networks (WANs), local area networks (LANs) and/or other suitable networks, etc., or any combination of two or more such networks. The computer 20 may have suitable components, such as network cards, modems, or other such communication devices, for communicating over a network.
Software that contains processing logic for accomplishing the above-described functions may be embodied in any suitable computer-readable medium for use by or in connection with an instruction execution system such as a computer/processor based system or other system that can fetch or obtain the logic from the computer-readable medium and execute the instructions or action statements contained therein. In the context of this document, a “computer-readable medium” may be any suitable medium that can contain, store, or maintain the processing logic for use by or in connection with an instruction execution system. The computer-readable medium may include any one of many physical media, such as, for example, electronic, magnetic, optical, electromagnetic, infrared, or semiconductor media. More specific examples of suitable computer-readable media include, but are not limited to, portable magnetic computer diskettes such as floppy diskettes or hard drives, random access memory (RAM), read-only memory (ROM), erasable-programmable read-only memory, or portable compact disks.
The remote control system 10 described herein may allow for intuitive hands-on remote operation of the vehicle 12. It will be appreciated that remote operation of a vehicle may be desirable in any of a variety of hazardous situations, such as when dealing with explosives or dangerous environments, such as in environments possibly contaminated by dangerous chemicals or biological agents. Other possible situations suitable for using the remote control system include situations in the presence of hostile, armed persons, such as in combat and in hostage situations. By providing a remote control system 10 that enables a user to receive much visual information via display, and to operate many aspects while maintaining hands on the hand controls 24 and 26, and attention of the operator on the visual display 22, remote operation of the vehicle 12 may be enhanced.
Although the invention has been shown and described with respect to a certain preferred embodiment or embodiments, it is obvious that equivalent alterations and modifications will occur to others skilled in the art upon the reading and understanding of this specification and the annexed drawings. In particular regard to the various functions performed by the above described elements (components, assemblies, devices, compositions, etc.), the terms (including a reference to a “means”) used to describe such elements are intended to correspond, unless otherwise indicated, to any element which performs the specified function of the described element (i.e., that is functionally equivalent), even though not structurally equivalent to the disclosed structure which performs the function in the herein illustrated exemplary embodiment or embodiments of the invention. In addition, while a particular feature of the invention may have been described above with respect to only one or more of several illustrated embodiments, such feature may be combined with one or more other features of the other embodiments, as may be desired and advantageous for any given or particular application.
