This invention relates generally to remote video inspection systems, and in particular to a comprehensive remote inspection system that utilizes modular units, including a computation module, and that can communicate with a central computer workstation.
Inspection units for remotely inspecting the interior portions of a body cavity of a living thing such as a person for medical diagnosis or a medical procedure, or for inspection or possibly repair of interior portions of industrial equipment, such as a boiler, a pipe or an engine, are known. Such systems are commonly large and inconvenient to move to a remote site for inspection operations. For on-site inspections, such systems typically are housed in large cases, or may even require a motor vehicle for transportation.
These systems, as described, have deficiencies in aspects such as portability and convenience that are general needs in the industry. There is a need for borescope and endoscope systems that provide improved convenience for the user while offering greater technical capabilities, better maintainability, and more favorable economics.
The borescope and endoscope systems that can be manufactured, provided, and operated according to principles of the invention offer improved convenience, for example, rapid set-up time and a very short interval to become operational, interchangeability between flexible probes, or for one-step remote inspection, and improved technical capabilities. Borescope and endoscope systems according to principles of the invention are intended for remotely inspecting the interior portions of a body cavity of a living thing such as a person for medical diagnosis or a medical procedure, or for inspection or possibly repair of interior portions of inanimate objects or equipment, such as a boiler, a pipe or an engine. In some embodiments, the system of the invention is designed to provide an operational system within 15 seconds of being carried to a location at which an object of interest is to be inspected.
In one aspect, the invention relates to a modular remote visual inspection system used to view a portion of an interior of an object of interest. The system comprises a base module, an interconnection module having two ends, a unitary display module and control module, and a demountable inspection module having two ends. The base module comprises an optical source module, a computation module, and a power module. The interconnection module provides electrical and optical signal paths. A first end of the interconnection module is in electrical and optical communication with the base module and the unitary display module and control module in electrical and optical communication with a second end of the interconnection module. A proximal end of the inspection module is in at least optical communication with the unitary display module and control module, and a distal end of the inspection module is configured to make observations of an object of interest. The base module, the interconnection module, the unitary display module and control module, and the demountable inspection module cooperate to permit a view of a portion of an interior of an object of interest.
In one embodiment, the base module, the interconnection module, the unitary display module and control module and the demountable inspection module are configured to be stowed in an interconnected relationship. In one embodiment, the base module, the interconnection module, the unitary display module and control module and the demountable inspection module are configured to be deployed for use without alteration of the interconnected relationship that existed when stowed. In one embodiment, the interconnection module, the unitary display module and control module and the demountable inspection module are configured to be transported in one hand of a user. In one embodiment, the modular remote visual inspection system is configured to be operational within 15 seconds of being carried to a location at which the object of interest is to be inspected.
In one embodiment, the system further comprises a container module for storing the system therein and for transporting the system to an inspection location. In one embodiment, the container module comprises a body and a lid.
The foregoing and other objects, aspects, features, and advantages of the invention will become more apparent from the following description and from the claims.
The objects and features of the invention can be better understood with reference to the drawings described below, and the claims. The drawings are not necessarily to scale, emphasis instead generally being placed upon illustrating the principles of the invention. In the drawings, like numerals are used to indicate like parts throughout the various views.
The borescope or endoscope system of the invention is designed to provide a user with a compact, readily transported, self-contained, robust system that is ready for operation upon reaching a location where an inspection of interest is to be performed. The system of the invention can also be described with reference to apparatus of Everest VIT, Inc. of Flanders, N.J., as a complete integrated VideoProbe inspection system that includes a PC workstation and spare interchangeable probes in a shippable, weatherproof outer package. The remote video inspection system can inspect a body cavity or other suitable remote target area and can generate a finished video image, either streaming or still, of the target area. The system can also create, record, and transmit or send inspection reports without additional hardware. The system includes the capability to communicate with a central data processing facility, directly or by way of a network (such as the Internet), both to transmit information relating to the inspection of interest, as well as to obtain information available from the central processing facility as needed, such as data, computer programs or software modules, and documents in electronic format. The system can send information to an on-line database (i.e., an engine inspection record database). The remote video inspection system 100 can provide measurements, and can be controlled by a user to annotate images and/or data, and to prepare reports. The remote video inspection system is modular, and will be described with regard to the various modules.
Modularity provides a number of significant advantages. A system that requires four or five modular elements can be assembled and operated using any embodiment of the first module element, any embodiment of the second module element, and so forth using one of each of the four or five required elements. Modular systems are economical to upgrade, as only the module wherein the improvement is being implemented needs to be changed. Modular systems are economical to repair and maintain, and require limited, or essentially no downtime, because a faulty module element can be exchanged and fixed “offline” while the system continues to operate. Modularity facilitates the provision of spare parts in the field; components that are often exhausted, or that may be changed frequently to attain some specific goal are readily provided in multiple numbers or in variants. Modularity also makes it easy to configure a system to accomplish any one of a variety of tasks as the need arises.
Container Module
As shown at a high level in
The container module 102 is a weatherproof outer package that is designed to be of convenient dimension and weight, for ease and convenience of handling, transport, and storage. The container module 102, when closed, also provides protection for the remainder of the remote video inspection system from impacts with other objects, as well as protection from vibration and other hazards of transportation. In addition, the remote video inspection system can be operated using the container module 102 as a holder or working area for the remaining components, to be discussed hereinafter. As shown in
The container module 102 in one embodiment is of a rectangular shape, with rounded edges and corners. The container module can optionally comprise any or all of a latch, a provision for locking the container module 102, for example with a padlock or with a lock having a key available to airline security personnel, a position adapted to receive a shipping label, and provision to receive an identification tag. The container module 102 in some embodiments is configured so as to be capable, when the telescoping handle is extended, of rolling on the wheels thereof within the confines of an aisle of a commercial airplane. The container module 102 can optionally be configured so as to be capable, when the telescoping handle is stowed, to fit conveniently into travel compartments, such as an airline storage bin, and to be of such dimensions as to be acceptable as carry on luggage on a commercial airplane. The container module 102 is designed to contain a number of operation modules, to be described in greater detail below, as well as spare parts, tools, auxiliary power sources, supplies, documentation and other items that are useful in operating the remote video inspection system. As depicted in
The container module 102 is sized to define a space for the storage of multiple spare flexible probes as a single kit. Preferably, the walls of the container module 102 are double-walled to effectively protect contained equipment with minimum weight. In various embodiments, foam inserts may optionally be used for further protection of the contents of the container module 102. In one embodiment, the lid 106 of the container module 102 protects the contents from rain when open. In some embodiments, the lid 106 locks open and provides a horizontal working surface. In some embodiments, the lid 106 also provides additional features such as a cup holder, a keyboard holding means, such as a tray, as well as means for storing the keyboard. In some embodiments, the lid 106 is limited in its opening angle such that motion of the lid does not cause the center of gravity of the lid 106 to travel beyond a “tip-over” point, so as to prevent the system from becoming mechanically unstable.
The container module in various embodiments can have storage for one or more endoscopes in the enclosed case; a lid that can be an integrated rain shield; a container with integrated handset mounting mechanism in the lid, on an extension pole, on the container handle or in a similar manner.
Base Module
In
As depicted in
The base module 110 provides on-board MPEG-2, MPEG-4, or DV video compression. In other embodiments, other video known video compression methods and formats can be employed. In addition, in some embodiments, audio content can also be recorded using any conventional format, including generating digital audio such as .wav files. The base module 110 also can include various connectivity options, e.g., serial ports, USB ports, Firewire® (IEEE 1394) port, etc., for connecting to other electronic systems, for example, a personal digital assistant. The base module 110 comprises an infrared communication port for receiving commands from an IR device, such as a battery powered remote control unit. In some embodiments, the infrared communication port is compatible with the IrDA® (Infrared Data Association) communication standard. As such, the inventive system is extremely flexible and open in terms of both electronic and software architecture.
Further as is shown in the embodiment of
The system has a modular light source, that allows the user to change a light engine (e.g., a lamp, a ballast, and a mounting mechanism) conveniently and quickly. Different light engines can be employed in different embodiments. Light engines that provide white light can be based on LEDs, arc discharge lamps (such as xenon, high pressure mercury, or metal halide lamps) of the type available from Welch Allyn, Inc. of Skaneateles, N.Y., or white laser constructed from red, green and blue lasers. Light engines that provide UV or IR illumination can be based on based on LEDs, filtered arc discharge lamps, or lasers. The light sources are also configurable at the time of manufacture.
In some embodiments, the base module 110 includes an AC output receptacle to permit other accessories to be connected to a source of power. The base module 110 can also comprise one or more outputs for DC voltages, such as 9 volts, 12 volts, or other voltage values for powering external devices that require DC power. The light source module comprises an illumination lamp, such as a xenon arc lamp, that is oriented to enable tabletop or backpack use without affecting light output and color shift by keeping the lamp axis constant or minimizing the deviation in lamp axis angle which results from the base module 110 being oriented in more than one position depending on how it is used (in the container module 102 or in a configuration of a backpack). In some embodiments, the light source can be located in a distal end of an insertion tube, or it can be located in a handset. In some embodiments, the light is an LED. The base module 110 comprises a cooling fan and an optional dust filter to accommodate the thermal loads that the illumination lamp of the light source module presents during operation. The base module 110 is designed to be substantially waterproof.
The base module 110 comprises insulation that shields the user from the battery. The base module 110 comprises a control circuit that causes initiation of an automatic charging mode in which the battery charges when an AC power source is connected to the base unit 110, and that allows “hot” plugging and unplugging of the battery and the AC power source (e.g., the user sees no change in the operation of the system of the invention when a selected one of a battery or the AC power source is connected or disconnected, provided that power is available from some source.) In some embodiments, a “Low battery” indication is provided on the battery and/or on the display module or other user interface. In some embodiments, the base module 110 provides a cooling path for the battery, for example using the base module 110 power supply fan.
The base module is dimensioned to fit within the container module. In the embodiment depicted in
The self contained base module 110 includes a probe (or insertion tube) storage reel that can be detachably or permanently attached to the base module 110 or to another portion of the system. The probe storage reel is designed for quick disassembly in the event that it is useful to release the insertion tube from the reel, for example if there should be a problem. In some embodiments, the base module 110 includes controls on the exterior of the base module 110 in addition to controls present in the unitary display module/controller module.
In some embodiments, additional mechanical features of the base module 110 include a protective bumper that reduces impact or shock loads during shipping or during use; and non-skid feet that are raised in the corners, permitting the base module 110 to rest on curved surfaces, as needed, e.g., a large generator or other area. The base module 110 is preferably durable and weather-proof, having a rain-resistant design with no electrical connectors on the top surface thereof and the raised feet on the bottom to prevent contact with surface moisture. In some embodiments, the base module 110 easily accepts a borescope adapter to supply light to a borescope and to receive camera signals. The base module 110 in some embodiments can comprise a pocket or net to allow accessory storage or other general purpose storage when the base module 110 is used in a portable mode of operation.
Display Module
The display module 130 and the control module 250 are provided in a unitary structure. The handset combines the display and control features that are necessary and useful for a user of the remote video inspection system 100 to monitor and control the operation of the remote video inspection system 100 and to observe, evaluate and record the results of an inspection. The handset also provides electrical, optical, mechanical and fluid communication as necessary between the various cables and replaceable probes, which are described herein below in greater detail, that are used in the operation of the remote video inspection system 100. Commonly assigned U.S. Pat. No. 5,373,317 to Salvati et al. describes an embodiment of a unitary device, similar to the handset of the present invention, that includes both a display module and a manually operated control module, and that performs interconnect functions between the cables and replaceable probes of a borescope. U.S. Pat. No. 5,373,317 is incorporated herein by reference in its entirety.
As shown in
Control Module
The manually operated control module 250 shown in
The system can provide a controlled power down process. In this process, the system responds to a power-off command, such as the de-activation of a power switch, the pressing of a power button, or a selection from a menu. In the power down process, the articulation cables are returned to their center or neutral positions to straighten the end of the probe and/or each of the articulation cables is placed in a slack condition to avoid holding the end of the probe in a bent position. The power down process also shuts down most or all of the system. In some embodiments, the system employs a “smart” articulation cable calibration system. The system has independent control of each cable. The system measures the strain and slack on each cable to balance the load, and the system centers the articulation over the life of the product. This process can be user activated or the process can be caused to happen automatically under control of a computer.
The handset is ergonomically designed such that the grip section is hand-sized and includes a non-slip grip area. Interchangeable insertion tubes for the flexible endoscopic or borescopic probe are provided that can be selectively and interchangeably be connected to the handset. According to one embodiment, manual control 250 comprises articulation motors that are retained in a proximal end of the manual control 250, the articulation motors located so as to provide balance to the handset. The manually operated control module is ergonomically designed for ease and convenience of use by either the right hand or the left hand of a user. In addition, the handset also includes flat areas on a bottom portion to permit the handset to rest on a surface, for example, a table top, the handset further having additional hand clearance at the bottom to aid the user/operator in picking the handset up. The handset in one embodiment includes at least one set of integrated rings for storage hooks or for carrying straps and includes an integrated mounting feature. See
As alluded to above, in some embodiments, the handset comprises an integrated mounting feature that allows the handset to be supported on the extended telescoping handle. See
The handset comprises a light guide having a large diameter with a bright inner core that provides an optimized optical match and light transfer to a variety of probe light guide having a variety of sizes. The handset in some embodiments comprises a source of illumination to illuminate an inspection port or to illuminate paperwork, for the convenience of and under the control of the user. See
The remote video inspection system can be implemented using light guides of various types. In some embodiments, the light guides comprise a selected one of coherent bundles of optical fibers, semi-coherent bundles of optical fibers (e.g., concentric random bundles that maintain the central lamp hotspot to maximize light output of small bundle probes), and random bundles of optical fibers. In various embodiments, the ends of the bundles are fused, or are epoxied, or the bundles are fused on one end and epoxied on the other. In another embodiment, the light guide is a solid core lightguide, for example comprising plastic or quartz. One preferred embodiment is a semi-coherent fused bundle of optical fibers.
Interconnection Modules and Inspection Modules (e.g., Interchangeable/Replaceable Insertion Tubes)
In the embodiment shown in
The connector 272 also provides communication of electrical power as needed to the unitary display module 130/manually operated control module 250 to operate the display module 130; and optical communication of light generated at the light source to the target by way of optical fibers in the cable 270, the unitary display module 130/manually operated control module 250, and a insertion tube 260 having an optical transmission path, such as an optical fiber. At the other end of the cable 270 is another connector 274 that connects the cable 270 to the optical light source, to the supply of electrical power, and to the computation module. In some embodiments, the connectors 272 and 274 are threaded connectors or quick connect connectors that make a rugged and secure connection while allowing connection or disconnection with speed and convenience.
In different embodiments, the system can comprise retractable tubes and cords. The mechanism for the retraction can be a slip ring based power cord, umbilical cord or insertion tube. The system will retract the power cord, signal cables, light guides, and/or the articulation tube using the slip ring mechanism. A user can pull out the length required for the application at hand. Upon completion of the inspection system activity, the user can activate a cord or tube retraction or rewind feature. Each cord or tube may have a separate handle or automated return mechanism that the user can activate to stow the cord/tube. The return mechanisms may be powered by springs or motors as appropriate.
It is desirable to minimize the number of conductors in cable 270 for size, weight, and reliability reasons. In a preferred embodiment, cable 270 comprises high speed serial digital links which connect base module 110 and unitary display module 130/manually operated control module 250. Digital video data, generated in one embodiment by a video DSP in 130/250, is input into a serializing IC, such as the National Semiconductor DS92LV16 in a parallel format, such as ITU-R BT.656 (hereinafter “BT.656”). BT.656 is the international standard for interconnecting digital television equipment operating to the 4:2:2 standard defined in ITU-R BT.601. It defines blanking, embedded sync words, the video multiplexing formats used by both the parallel (now rarely used) and serial interfaces, the electrical characteristics of the interface and the mechanical details of the connectors. The digital video signal is typically generated using a high frequency video clock operating in the megahertz range. Other high frequency signals that are sent to the serializing IC include a serial data signal, and a synchronization signal. The serializing IC also receives a communications signal from a microcontroller which monitors user inputs. The serializing IC latches the data on its parallel inputs on the rising edge of the video data clock. It then serializes the video, audio, and communication data for transmission to base module 110. In some embodiments, it is useful to use a minimal number of conductors for data transmission. In a preferred embodiment, a single twisted pair of electrical conductors or an optical fiber is used to transmit the serialized information. In the base module 110, a deserializer receives the serial data signal, recovers the video clock, and outputs the original parallel signals in parallel format. In a similar manner, video data for the display module 130 along with communications data being sent from base module 110 to unitary display module 130/manually operated control module 250 can be sent on a minimal number of conductors. The serializer and deserializer functions are often contained within a single IC simplifying the implementation of the serial link.
The clock generation and synchronization of all the video devices is a challenging problem because in some embodiments, the system has multiple inputs and multiple displays all having different pixel clock rates. In one embodiment, a 27 MHz clock is required for a video encoder for generating the s-video output. When the s-video input is being used, a 27 MHz clock frequency is output from the video decoder which performs the A/D conversion on the s-video signal, but can vary somewhat in frequency. A timing generator in the unitary display module 130/manually operated control module 250 generates the CCD imager clocking signals. When a PAL s-video output signal is desired, a 28.375 MHz clock is needed by the timing generator. When an NTSC s-video output is desired, a clock frequency of approximately 34 MHz is required. The LCD display in the display module 130 requires a clock frequency of 34.6 MHz or less. Additionally, most LCD displays require at least 18 bits of color data, one bit each for horizontal and vertical synchronization signals, one bit for an active video signal, one bit for an active video signal, and one bit for the video data clock for a total of 22 parallel bits of data. Few if any serializers and deserializers available today can accept more than 18 bits of parallel data for output on a single twisted pair cable. The invention contemplates that when serializer/deserializer ICs having sufficient capacity are available at an economical price, those devices will be employed. However, implementations using serializer/deserializer ICs with fewer bits, such as 16 or 18, are possible by using higher parallel clock rates and using more than one clock cycle to convey the data needed for each LCD pixel. In one embodiment, a master clock in base module 110 is switchably provided by a 27 MHz reference clock (used when the s-video input is inactive) and the 27 MHz video decoder clock (used when the s-video input is active). This master clock is input to a programmable clock generator, such as the Integrated Circuit Systems ICS307-02 IC. The clock generator is programmed to generate an output clock having a frequency of twice that needed by the CCD timing generator (2×28.375 MHz=56.75 MHz in PAL mode, 2×34 MHz=68 MHz in NTSC mode). Data for each pixel of the LCD display of display module 130, which is output by a processor in base module 110, requires 2 clock cycles for each LCD pixel. This allows the 22 bits of LCD video data to be divided into 2 segments, each segment comprising no more than 18 bits, which is accepted by the serializer IC. For example, in one embodiment, each segment comprises 11 bits, allowing the use of presently-available serializers. This data transmission protocol provides as many as 14 additional unused input bits (e.g., 2×18=36 available bits, less the 22 bits needed for data transmission) so that the serializer can accept a communication signal for transmission to a microcontroller in the display module 130. The deserializer in unitary display module 130/manually operated control module 250 receives this data and recovers the 56.75 MHz or 68 MHz output clock. Circuitry in display module 130 re-combines the deserializer parallel data output on sequential clock cycles to form the 22 bits of data needed by the LCD display. A clock divider divides the 56.75 MHz or 68 MHz recovered clock by 2 to generate, respectively, a 28.375 MHz or 34 MHz clock which is used to clock data into the LCD and to drive the CCD timing generator circuit. The video data output by the DSP in unitary display module 130/manually operated control module 250 is output at this same frequency and is used to drive the serializer in unitary display module 130/manually operated control module 250 which sends the camera video, microphone audio, and communications data back to the base module 110. If the programmable clock generator cannot generate the exact frequency needed to keep the internal system devices synchronized to an external source, the clock generator is re-programmed periodically to slightly adjust the system clock frequencies to maintain synchronization. This approach minimizes the number of clock generators needed by the system, allows synchronization of the system to external sources, allows the generation of PAL (25 frames/sec) or NTSC (30 frames/sec) frame rates with one hardware set, keeps all internal video devices synchronized, and allows two low cost twisted pair cables in module 270 to transport audio, video, and communications data in digital format bi-directionally with none of the degradations associated with analog transmission and without the many conductors that would be needed for the transmission of parallel digital data.
In some embodiments, the remote visual inspection system has the ability to track and to log the motion of the tip of an insertion tube in three dimensions, such as in orthogonal coordinates such as the x-, y- and z-directions of a conventional Cartesian coordinate system. The motion of the tip can be calculated by observing the angular orientation of the tip at an instant in time and monitoring the amount by which an insertion tube is advanced or with drawn in a brief interval immediately thereafter. With current motion sensors and analog-to-digital converters, such measurements can be performed with cycle time of milliseconds of less. By deducing the location of the tip of an insertion tube at a specified time, various useful functions can be implemented, including such functions as identifying a location in three dimensional space of an artifact that is observed; identifying a location so that later observations at the same location can be performed; identifying a location so that another observation of the same location from a different direction or path of access can be performed; and correlating a location with an image.
As to the interchangeable probes or insertion tubes 260, the articulation cables extending from the handset are preferably made at least partially from tungsten to improve articulation performance and reduce stretch of the articulation cable material. In an alternative embodiment or optionally, the handset is coupled in fluid communication with the insertion tube 260, so that the insertion tube 260 is articulated by pneumatic or hydraulic pressure applied by way of the fluid. The insertion tube 260 comprises a double braid construction to enable small bending radii, and hence small diameter storage. In some embodiments, the inner braid is provided to control the stiffness of the probe. Probes may be designed and constructed to vary in stiffness by controlling the relative angle between the strands forming a braid layer. The use of two braided layers can in some instances also provide improvements in shielding EMI.
The probes selectively and interchangeably interface with the handset by means of a positive locking mechanism in order to prevent accidental release thereof. Preferably, a wide range of diameters are available for use in the interchangeable probes to fit a wide range of applications and permitting a variety of diameters.
In some embodiments, the replaceable probe 260 is stored in coiled form on a reel. A reel is stored in a container or case that is attachable to the base module 110 and is removable with the base module 110 from the container module 102. In an alternative embodiment, the reel can be left in the container module 102. A spare reel can be provided to handle additional diameters of replaceable probe 260. By using more than one reel, there can be multiple probes provided in a single container module 102. In some embodiments, the reel is a push-in style reel, such that there is no need to hand wind a probe or to reel up a probe, but merely to push in a deployed length of a probe into a reel from storage.
System Software
The system can contain, save and display third party documents for use either with the inspection process or for instructing the user about the system. The system can be additionally configured into a network. The system provides the ability to communicate and send inspection-related information to an on-line database (i.e., an engine inspection record database, or an electronic medical records (EMR) database), or to send real-time video to an expert situated at a different location for review and feedback.
In some embodiments, the system of the invention can display third party documents to a user. The documents can comprise information relating to the operation of the system of the invention (such as user manuals for third party components or software employed with the system), information relating to the object to be inspected, or other third party documents, such as maps showing the location of the object to be inspected or directions and instructions for reaching or obtaining access to the object to be inspected. The documents can be in any of a variety of formats, including text such as ASCII text, images such as JPEG, TIFF or other well known image formats, formats that are defined by third parties but that are used with permission, such as use of the Adobe Acrobat™ Reader and the use of the PDF file format (used under the license posted on the website at http://www.adobe.com/products/eulas/pdfs/Gen_WWCombined_Languages—8.9.01—11.14.pdf), or file formats generated by any of a variety of word processors such as Microsoft Word™, Corel WordPerfect™, Sun StarOffice Writer™, and other commercially available word processing programs.
In some embodiments, the system of the invention comprises a report generation module, such as software that can use the data obtained during an inspection of an object to create a report. The report generation module comprises a user interface module that receives input from a user by way of a keyboard or keypad, a pointing device such as a mouse or joystick, and/or a speech recognition system such as a microphone and speaker and associated speech recognition software and speech synthesis software. The report generation module can generate a report that comprises one or more of text, figures or images, tables, graphs, and data files. The report generation module can receive commands from a user, or can receive formatting commands from a defined format source such as a database, regarding the formatting or display of the elements of the report. The formatting commands can include for example, size, color and font of textual material; size, color and resolution of figures or images; parameters to be used in constructing tables; types of graphs (e.g., line, scatter plot, histogram, pie chart, 2-D, or 3-D format) and properties thereof such as fonts, symbols, axis identifiers, series identifiers or keys and the like; and a format of a datum, units in which a datum is to be expressed, and a sequence in which a series of data are to be presented in a data compilation. As described hereinabove, the system of the invention can publish a report by displaying it to a user, by sending it to another repository by way of an electronic or optical communication for later display or printing, or by delivering or displaying the report remotely by way of a communication link such as a hard-wired connection, a wireless connection, or communication over a network such as the Internet, a satellite communication network, or a radio/television communication network.
In some embodiments, the system of the invention comprises a distortion correction module. The distortion correction module can be a software-based module or a hardware-based module. The distortion correction module comprises one or more submodules that manipulate image data obtained by the remote video inspection system 100 to remove distortions relating to size, angle, non-linearity, color rendition, contrast, focus, aliasing, unevenly-distributed illumination, and optical color separation, and to correct or remove artifacts produced in an image by features of the system itself, such as the well known pincushion distortion introduced by use of a fisheye lens. In some embodiments, the distortion correction module can determine the identity or type of insertion tube tip that is present, and can apply a distortion correction appropriate to the identified type of tip.
In some embodiments, the system of the invention comprises user defined menus. The user-defined menus are generated by software in response to user prompts, for example by changing the default display of a pull-down menu system to display the items that a user considers to be the menu items most important or most often used in a specific inspection operation, in the preparation of a report, in setting up the system for operation, or in other aspects of the operation of the system, such as communication with a remote system or a remote database. The user-defined menus can include menu items that are pre-programmed into the system, as well as items that the user specifically codes into the system, for example by defining the action of the function keys of a computer keyboard, or by defining a combination of keys, such as the simultaneous activation of the “Alt” key and a specific letter or number, to activate a specific menu command. The user can also define a macro or sequence of button activations, joystick motions, and/or menu functions to achieve a desired function that can be mapped to a specific button or menu function.
Referring to
The possibility of using interchangeable insertion tubes presents some challenges. Different insertion tubes can comprise different components, such as different CCD imager types, different harnesses connecting to the CCD imagers, and different electronic circuits adjacent to the CCD imagers in the distal end of the insertion tube. They also can comprise illumination bundles with different light-transmission characteristics. Many insertion tubes also comprise associated detachable optical measurement tip adapters that preferably are calibrated with the individual insertion tube to achieve more accurate measurement results. In some embodiments, insertion tubes of different diameters use articulation cables with varying mechanical properties such as stretch or break strength. The insertion tubes can comprise articulation actuators with varying properties or parameters such as leadscrew pitch or length. These differences are accommodated in various embodiments. The main imager DSP and associated electronics are contained in display module 130/manually operated control module 250. Additional circuitry may be included in pod 262 to perform such functions as outgoing CCD clock waveshaping and amplification of the returning analog video signal with a tailored frequency response to best match the specific imager and harness in that particular insertion tube. In some embodiments, a non-volatile memory is included in the pod for storage of parameters related to the signal processing required to produce an image with proper color balance, sharpness, etc. from the particular insertion tube being used. This memory also contains measurement calibration data sets for each of the optical measurement tip adapters that have been calibrated with the insertion tube. This memory also contains parameters related to articulation such as maximum travel limits, torque limits, articulation rates, calibrated articulation center position and the like. Various metrics such as a history of thermal excursions on the distal tip (for probes that have thermal sensors in the distal end of the probe), number of articulation cycles, total on-time, etc. may also be stored in this memory. Various other data such as the insertion tube serial number, service history, build date, build configuration, diameter, length, feature set keys, thermal warning limits, thermal sensor parameters, CCD voltage requirements and the like may also be stored in this memory. The data in the memory is accessed by a microcontroller in display module 130/manually operated control module 250 and loaded into the CCD DSP, sent over the serial link to base module 110, or used locally as appropriate. Data can be written to the memory by the microcontroller in a similar manner.
In another embodiment for making corrections, the distortion noted over time is used to construct a correction function or correction table in a memory. When a desired angular displacement is requested by a user, the system compensates for the distortions by operating the motor 2240 at a proportionally changed rate, so as to maintain an actual response that conforms to the expected response on the part of the user.
The handset also comprises a motor drive connector 2260 that connects the motors 2250 with the articulation cables, as explained hereinabove with regard to
As shown in
As previously described, the pod 2960 is in electrical communication with the handset. The EEPROM 2966 is in bi-directional digital communication with a microprocessor 2945 that controls data acquisition from the insertion tube 2970 and processing of the acquired data. The pre-amplifier 2964 is in electrical communication with an analog-to-digital converter (A/D) 2940. An analog video signal provided by the pre-amplifier is digitized by the A/D 2940. The output of the A/D is a parallel output, shown in the embodiment as a 10-bit wide output. A hash mark crossing a connector with a numerical value thereabove is intended to indicate the number of parallel lines that the connection represents. In this regard, a connection from the A/D 2940 to the CCD digital signal processor (DSP) 2935 has a hash mark thereon and the numerical value 10 thereabove. The waveshaping circuitry 2962 receives a 7-bit signal representing 7 different clocks needed to drive a CCD imager of the type used, (e.g., 4 vertical, 2 horizontal, and 1 reset gate clocks) from the CCD timing generator 2930. The CCD timing generator 2930 also provides a timing signal for the CCD DSP 2935 and for the A/D 2940, thereby synchronizing the A/D 2940 and the CCD DSP 2935. The microprocessor 2945 is bi-directionally connected to the CCD DSP 2935 to permit the adjustment of various processing parameters of the CCD DSP 2935 as needed when an insertion tube 2970 is replaced or changed, and to permit the CCD DSP 2935 to send data to the microprocessor 2945.
A National Semiconductor DS92LV16 serializer/deserializer 2905 is used to transmit information from the handset to the base module by way of the cable, and is also used to receive information sent from the base module to the handset by way of the cable. As described hereinabove, there are advantages to limiting the number of conductors required to communicate between the handset and the base module. In the present embodiment, a twisted pair of conductors 2910 carries serialized digital signals from the base module to the handset, and a twisted pair of conductors 2912 carries serialized digital signals from the handset to the base module. In one embodiment, the serializer/deserializer 2905 receives the following digital signals from the handset components and converts the signals into a serial stream of bits: one bit of synchronization signal from the CCD DSP 2935; 8 bits of video data from the CCD DSP 2935; one bit of clock signal from the CCD DSP 2935; optionally, 3 bits of audio data from the combination of a microphone 2955 which generates an audio analog signal that is then digitized in an A/D 2950; and command signals from the microprocessor 2945. In this embodiment, the deserializer portion of the serializer/deserializer 2905 receives a digital stream from the base module, and separates and formats the information contained in the digital stream into the following signals: a one-bit video clock signal at a selected one of approximately 56.75 MHz for PAL video formatting or approximately 68 MHz for NTSC video formatting; 11 bits of LCD data for operating an LCD display; and command signals for use by the microprocessor 2945. As will be explained with regard to
There are also input and output signals associated with the base module. The audio/video processor 3025 provides 3 bits of digital audio signals to the digital-to-analog converter (D/A) 3045 which generates analog audio, that is provided to an audio output terminal. The audio/video processor 3025 provides 8 bits of digital video signals to a video encoder 3040. A clock signal having approximately 27 MHz frequency is provided to the video encoder 3040, which provides an output signal in the s-video format. The approximately 27 MHz frequency clock signal is also provided to the programmable clock generator 3015, which uses the signal to generate the PAL and/or NTSC video clocks, and to the audio/video processor 3025. The approximately 27 MHz clock signal is provided by one of a video decoder 3030 that accepts an s-video input, or by a 27 MHz reference clock. A switch 3050 is used to connect one, and only one, of the two 27 MHz signal sources to the programmable clock generator 3015, the video encoder 3040, and the audio/video processor 3025. When the s-video input 3030 is active, a synch signal is provided from the input 3030 to the microprocessor 3020.
Additional System Capabilities
The system according to the invention comprises a diagnostic capability or self-test capability to troubleshoot which modules or components of the system need to be repaired or replaced, including a diagnostic module to perform the testing. The diagnostic module in some embodiments is a software module that performs tests under the supervision of a user, or that performs tests at predefined times, such as system start-up, or at a time when the system is idle after the system has operated for at least a defined time period (e.g., a specified number of hours).
In some embodiments, the inspection system according to the invention comprises a system with stereo audio output. In some embodiments, the inspection system according to the invention comprises a system with a game mode, in which the system can be used to play video games.
The system can add, change or modify the behavior of software modules (e.g., programs, data stashes, drives, interface modules such as .dll or .ocx files) and can adjust or control hardware functions by changing software commands or data or by reprogramming one or more computers. The system can use any of the components thereof, including but not limited to a PC Card, a device situated in a device bay, external interfaces such as Firewire® or USB, a PCI slot or other similar expansion capabilities of a PC to add any of the following hardware or software functions or capabilities to the system: expanded or reconfigured memory; acceleration hardware and/or software to improve process speed or add expansion capabilities; a modem; a printer; an IRDA interface; a hard drive; a network connection, such as a LAN or WAN; a docking station to factory or end users network; the use of voice over internet protocol (VoIP); connections to or by way of cellular telephone or land line; hardware devices such as an eddy current probe, or an ultrasonic probe; an engine turning tool or electronic turnover tool (e.g., a device used to rotate the rotors of turbine engines in steps to allow the easy inspection and counting of each blade); the ability to play video games or to play music, such as MP3 files; the provision of user maintenance manuals; the provision of a user report generation capability; the provision of automatic fault detection, which detection can interface with a database of users manual, and or one or more pass/fail criteria; a programming capability such as a macro function that allows users to set up repeating operations, for example controlled articulation that allows viewing an object, such as a blade of a jet engine, that is larger than a field of view; the provision of user configurable system, such as menus, and the provision of diagnostic features and functions that a user can download as needed. It is contemplated that these functions can be added at the time of manufacture (as an option) or by the user in the field at a later time.
Those of ordinary skill will recognize that many functions of electrical and electronic apparatus can be implemented in hardware (for example, hard-wired logic), in software (for example, logic encoded in a program operating on a general purpose processor), and in firmware (for example, logic encoded in a non-volatile memory that is invoked for operation on a processor as required). The present invention contemplates the substitution of one implementation of hardware, firmware and software for another implementation of the equivalent functionality using a different one of hardware, firmware and software. To the extent that an implementation can be represented mathematically by a transfer function, that is, a specified response is generated at an output terminal for a specific excitation applied to an input terminal of a “black box” exhibiting the transfer function, any implementation of the transfer function, including any combination of hardware, firmware and software implementations of portions or segments of the transfer function, is contemplated herein.
While the present invention has been explained with reference to the structure disclosed herein, it is not confined to the details set forth and this invention is intended to cover any modifications and changes as may come within the scope and spirit of the following claims.
This application claims priority to and the benefit of co-pending U.S. provisional patent application Ser. No. 60/443,521, filed Jan. 29, 2003, and of co-pending U.S. provisional patent application Ser. No. 60/520,996, filed Nov. 18, 2003, each of which applications is hereby incorporated by reference in its entirety.
Number | Date | Country | |
---|---|---|---|
60443521 | Jan 2003 | US | |
60520996 | Nov 2003 | US |