Patent Application
20130196296
The present invention pertains to methods and systems for introducing potential new workers to the field of welding, and more particularly, to computer generated virtual environments that simulate welding processes.
In recent decades, welding has become a dominant process in the manufacture and construction of various products. Applications for welding are widespread and used throughout the world for the construction of ships, buildings, bridges, vehicles, and pipe lines, to name a few examples. Many welding tasks can be automated reducing the need for skilled labor. However, automated welding applications must be set up and managed by knowledgeable welders. Other welding applications aren't confined to a factory floor. Applications, including the construction of pipe lines or buildings, are welded in the field and require the mobility of an experienced welder. Accordingly, there is ongoing need for trained personnel who can adapt to the challenges of welding processes.
The demand for skilled welders remains high, despite reductions in manufacturing, in many regions of the world. In the United States, the average age of the welding professional is increasing, with many individuals approaching retirement age. Over the next decade, the number of available experienced welders is expected to significantly decline as workers retire from the welding profession. Many young people entering the workforce today are choosing advanced education over skilled trades and many of those workers entering the trades are dissuaded from a career in welding despite good working conditions. Programs and organizations promoting S.T.E.M. (Science Technology Engineering Math) and S.T.E. (Science and Technology/Engineering) education are valuable in revitalizing the interest of individuals in technology related fields.
The embodiments of the present invention pertain to a computer program product and processor based computing system that provides processing means for executing coded instructions and input means for interacting with said processing means to create a virtual welding environment. The system establishes an objective to change a functional or operational state of a virtual article, and directs the end user to perform at least one virtual welding operation for changing its functional state.
One embodiment provides a tablet-based computing device. The tablet-based computing device includes a touch-screen display and computer memory storing at least one welding software application providing a virtual welding process. The tablet-based computing device further includes processing means operable to execute coded instructions of the at least one welding software application to generate an interactive virtual welding environment and to display the interactive virtual welding environment on the touch-screen display. The tablet-based computing device also includes an input means configured to interact with the touch-screen display when manipulated by a user to direct at least a spatial orientation of a virtual welding tool in the virtual welding environment while performing a virtual welding activity corresponding to the virtual welding process.
Another embodiment provides a tablet-based computing device or tablet. The tablet includes a display, wireless communication means, and computer memory storing at least one software application. The tablet also includes processing means operable to execute coded instructions of the at least one software application. The coded instructions are executed to access at least one virtual reality welding system via the wireless communication means to download user virtual welding activity information from the at least one virtual reality welding system to the tablet. The coded instructions are also executed to generate a summary of user virtual welding progress based on the user virtual welding activity information, and display the summary of user virtual welding progress on the display.
A further embodiment provides a method of virtual welding. The method includes generating a dynamic virtual welding environment within a computer-based platform and displaying stereoscopic three-dimensional (3D) images of at least a portion of the dynamic virtual welding environment on a display screen of the computer-based platform. The method further includes viewing the stereoscopic three-dimensional images using 3D glasses, resulting in at least a portion of the dynamic virtual welding environment appearing to project out of the display screen into 3D space. The method also includes virtually welding a virtual weldment of the projected portion of the dynamic virtual welding environment in 3D space using a mock welding tool while viewing the stereoscopic three-dimensional images using 3D glasses.
Referring now to the drawings wherein the showings are for purposes of illustrating embodiments of the invention only and not for purposes of limiting the same,
The simulating device 10 may generate a virtual environment 9 having virtual articles 16 that resemble components of a particular manufacturing or construction process. In one embodiment, the virtual environment 9 may comprise a welding environment 9a depicting one or more articles for assembly together via a welding process. Accordingly, the virtual tools 26 may comprise a welder 32 and welding torch 34. In this manner, the simulating device 10 displays virtual articles 16 being welded together by a virtual welder 32 as interactively controlled by the end user 11. The simulating device 10 may be realized as a training platform for exposing individuals to a particular manufacturing process, or may be realized as a game played to achieve a stated objective, both of which will be discussed further in a subsequent paragraph. It is expressly noted that while the embodiments of the present invention are described in the context of a virtual welding environment 9a and one or more welding process, persons of skill in the art will understand its application to other industrial or commercial processes.
With continued reference to
The simulating device 10 and, more particularly, the processor based computing device 24 may be communicated to and used in conjunction with other similarly or dissimilarly constructed systems. Input to and output from the simulating device 10, termed I/O, may be facilitated in this embodiment by networking hardware including wireless as well as hard wired (directly connected) devices. Communication between simulating devices 10, or systems, may be accomplished remotely as through a network, like a wide area network (WAN) or local area network (LAN) via network hubs, repeaters, or by any means chosen with sound judgment. Communications may be established through, but are not limited to: direct connection of multiple simulating devices 10, web-based connectivity, virtual private networks, and/or SSL (Secure Sockets Layer) encrypted communication. It is noted that the relationship between simulating devices 10 may be peer-to-peer, client-server, or any hybrid combination thereof without departing from the scope of coverage of the embodiments of the subject invention. In this manner, information may be transmitted between systems 10 as is useful for simulating or interacting with the virtual environment 9, 9a. In one embodiment, network communications may be used to download virtual articles 16 or virtual tools 26 for changing the game scenario. Alternatively, new environments may be downloaded for training a different manufacturing process, the details of which will be discussed further below. It is further contemplated in another embodiment that the simulating device 10 may generate a virtual environment 9, 9a that may be acted upon by multiple end users 11 each working from the same system or separate systems networked together. Still, any manner of communicating one or more simulating devices 10 together may be utilized without departing from the intended scope of coverage of the embodiments of the subject invention.
With continued reference to
With reference now to
Still referring to
In one embodiment, the input device 13 may be commercially available for purchase and use. One example may include a manually moveable device, like a computer mouse having an optical sensor for detecting movement along an adjacent surface. Another example of input device 13 may comprise a gaming joystick or controller, which may include a connector for plugging into an I/O port or may include wireless means for communication. The Wii wireless controller manufactured by Nintendo® is one exemplary type of input device, although other commercially available controller devices may be utilized as are suitable for use with a particular processor based computing device 24. Other embodiments contemplate customized controllers, which may be fashioned to physically look like a particular virtual tool 26, e.g. a welding torch 34. Interaction with the simulating device 10 is thereby enhanced by a physical object having a real world feel and look that resemble the virtual tools 26 depicted on the imaging device 22. It is noted that the customized controller may be substantially similar in size, shape and/or weight to the real world tool for which the controller is intended to resemble. Other embodiments include an attachment that connects to the commercially available input device 13 and resembles a particular virtual tool 26 to enhance the end user's experience in interacting with the virtual environment 9. In one embodiment, the attachment may be an overlaying component and/or a component that attaches to and extends from the input device 13. However, it is expressly noted that any configuration of customized controller or attachment may be chosen as is appropriate for use with the embodiments of the subject invention. Accordingly, at least part of the simulating device 10 may be packaged as a kit for use with any type of processor based computing device 24, commercially available or otherwise. In another embodiment of the subject invention, the kit may include a welding coupon that may resemble a virtual article 16 displayed in the virtual environment 9, 9a. Accordingly, the welding coupon may function as a guide in the real world for assisting the end user in acting in the virtual environment 9, 9a. The kit may also comprise tracking means like that mentioned above. In other words, a tracking unit may be provided in addition to the input device 13 for sensing the end user's 11 movement during play.
With reference to
From the aforementioned description, it follows that the themed virtual article 16a of the scenario has some deficiency that requires repair or assembly before becoming operational. During game initialization, i.e. game start up, the themed virtual article 16a may be instantiated having an inoperative state or, in other words, is created not working properly or not working at all. In the present examples, the initial “inoperative” state may be represented and simulated by one or more broken brackets, a stack of unassembled I-beams, a cracked pipe, or any repairable element fitting the scenario theme. Accomplishing the game objective therefore requires the end user 11 to interact with the virtual environment 9a to perform virtual welding that changes the operational state of the themed virtual article 16a. It is noted here that accomplishing the game objective may require successful completion of multiple levels of play. That is to say winning the game requires successfully changing the operational state of each virtual article 16a in every level of play.
At an introductory level, the game displays one or more virtual articles 16 that correspond to the scenario selected by the end user 11. The end user 11 is then instructed to perform a particular type of weld relating to the deficiency of the virtual article 16. It may be assumed that the end user 11 has little or no welding experience. Accordingly, a tutorial may be provided that presents information to the end user 11 about the welding process or welding techniques needed for achieving the objective for that level. Display of the tutorial may be initiated or controlled by the end user 11 via a graphical user interface (GUI), in one example, as selected by a “help” button. In the alternative, tutorial screens may automatically be presented if the end user's performance falls below a satisfactory level. In one exemplary manner, the instructions may be displayed in written form, an example of which may include a setup screen. Instructions may also be provided audibly and, more specifically verbally, to describe the process and/or motions needed to complete setup and a particular welding task. In either case, the instructions may be presented in one of a plurality of languages to accommodate individuals residing in different regions of the world. One embodiment is contemplated where the game graphically or pictorially presents tutorial information. In this instance, literacy of the end user 11 is not required to play the game.
Game play proceeds as the end user 11 engages the input device 13 to mimic movements characteristic of performing a weld. Progression through the game may depend on how well the end user 11 performs a virtual weld, which may relate to the level of virtual weld quality. In this manner, advancing to the next level, as will be discussed further in a subsequent paragraph, requires successful completion of the previous game stage. In making that determination, one or more parameters may be measured to determine the level of virtual weld quality. In processes well known in the real world, weld quality depends on many factors like the distance between the torch tip and the weld joint, which may vary with the type of welding process, the materials being welded, the welder settings, and the like. Corresponding real world parameters may be coded into the computer program product for judging the end user's 11 performance and for determining the quality of the virtual weld.
Completion of a particular game level may require the end user 11 to perform the one or more virtual welds to predetermined performance standards as determined by the computer program product. Performance parameters may be programmed into the computer program product that correlate to good welding practices and may consist of: weld torch 34 position, roll and pitch angles of orientation and travel speed. Sensor data from the input device 13 may be compared to preprogrammed parameters to determine whether or not the end user 11 has stayed within acceptable limits. In one particular embodiment, weld quality may be determined by monitoring the distance between the torch tip in relation to the center of the weld seam while maintaining proper pitch and roll angles during the virtual welding process. However, it is to be construed that other parameters may be utilized in determining if the end user 11 has successfully completed a virtual weld.
In one embodiment, the simulating device 10 provides or calculates a score resulting from game play. The score, which may also be a grade, may be derived from the performance data of the end user 11. Performance data may pertain to how well the end user 11 performs the virtual weld, that is to say how closely the end user 11 maintains the virtual tools 26 or welding torch 34 within limits for acceptable welding practices. Examples may include but should not be limited to, welding torch angle or distance to the virtual article 16 The score or grade may also be derived from end user selections made with respect to the problem-based scenarios as will be discussed further in a subsequent paragraph.
Simulating device 10 may provide feedback to help the end user 11 in performing the virtual welds. In the real world, a welder receives feedback by observing the weld bead as the torch travels along the weld joint. The simulating device 10 may similarly depict a virtual weld bead correlating to the end user's movement of the virtual welding torch 34. In one embodiment, the shape of the virtual weld bead is determined by factors including torch angle, travel speed and distance to the work piece, as well as welding power source settings, although other factors may be incorporated as is appropriate for use with the embodiments of the subject invention. In this manner, the end user 11 can make adjustments during the virtual welding process for laying down an acceptable weld bead thereby simulating real world activity.
Referencing
The performance guides 41 may display the actual numerical values of the torch position, which in the current embodiment shows pitch and roll angles. The values displayed may show the angles as measured from an absolute reference like the vertical or horizontal plane. Alternatively, the performance guides 41 may display angle values that relate to offsets from the ideal torch position or orientation. The performance guide 41 may indicate which values are outside the range for achieving an acceptable weld. In one embodiment, the performance guides 41 may flash, changer color and play an audible sound that indicates when the welding torch 34 is out of position. In this way, the end user 11, through repeated use, learns correct welding techniques. As the end user 11 gains experience, he or she will naturally maintain the welding torch 34 at the proper orientation throughout the entire welding process. At one point, it may no longer be necessary to display the performance guides 41. Accordingly, the computer program product may be programmed to selectively turn the guides 41 “on” or “off.”
As previously mentioned, the game may incorporate different levels of play. The levels may be differentiated by scenario, i.e. by changes in the themed subject articles 16a being welded. Alternatively, the levels of play in a particular scenario may differ by the types of weld joints and/or the number of virtual article pieces to be welded together. For example, a more fundamental level may simulate welding a single lap joint embodied by overlaid frame components of building structure. Another level of play may simulate performing a pipe weld as found on a motorcycle tailpipe or pipeline. Still, other examples are contemplated wherein overhead or vertical butt joints are to be welded for repairing the frame of motor vehicle. At each game level, the welding objectives must each be performed to within predetermined quality boundaries in succession, before proceeding to the next level. In this way, basic welding skills may be taught by progressively introducing increasingly complicated weld joint configurations and more advanced welding techniques.
The game objective may be accomplished when the end user 11 successfully performs, i.e. meets or exceeds predetermined limits of weld quality for, all of the virtual welds in a given scenario. That is to say that the end user 11 performs each weld on every level to a minimum standard for quality. Alternative game objectives may be included that are accomplished by exceeding a virtual weld performance average over the various levels. Consequently some levels of play may be performed below the performance minimums with others commensurately above. The game objective is met as long as the weighted average for the entire game exceeds a predetermined minimum.
In judging the end user's 11 performance, the simulating device 10 may track the movements of the end users 11 through the input device 13 and compare the data with parameters stored in memory, or coded into the computer program product. The data and/or parameters may be stored in a database, or by any means of data storage chosen with sound judgment. In one embodiment, the simulating device 10 records and stores information about the end user's 11 performance for comparison at a time subsequent to the virtual activity. In other embodiments, comparison with the welding quality parameters is performed in real time with the results being dynamically displayed or catalogued for subsequent review. In addition to the data collected via the input device 13, other types of data may be captured, which include: time and date data, user name, scenario, as well as game status data. It will be appreciated that any type of data may be tracked and stored as needed for determining and reporting the results of game play.
With reference now to
As the end user 11 advances, the level of instruction may be adjusted accordingly. At beginner levels, the level of instruction may focus on fundamentals relating to, for example, welding theory, basic welding practices and/or welder set up. Other training levels may provide tutorials related to various weld joint configurations and/or welding with different types of materials and electrodes. More advanced levels may concentrate on particular welding processes and techniques. Of course, each level may be enhanced by one or more scenarios simulating real world activity as described above.
In one embodiment, the welding training may include problem-based scenarios. The problem-based scenario may be characterized by incorporating an operational deficiency in a virtual article 16 that must be discovered, analyzed, and a solution formulated by the end user 11. Knowledge learned from a previous lesson or level of training may be relied on for solving the problem. In one example, a race car may be depicted and described as not functioning properly. The virtual environment 9a may be programmed to present visual, and/or audible, clues that allow the end user 11 to discern the particular problem presented for the given scenario. After analyzing the problem, the end user 11 is directed to devise a solution that, in an exemplary manner, may incorporate: selecting the appropriate welding process, adjusting the welding power supply settings, choosing a particular electrode and then performing a virtual weld. A proper repair therefore requires not only the physical motion of implementing a suitable virtual weld, but also selecting the appropriate welding process and associated parameters. A successful repair or assembly may be indicated, whereby the virtual race car drives away or drives in a race. If an improper or incomplete repair has been made, the race car may perform poorly or not at all with further clues provided to the end user 11 as to what problems remain that need to be fixed. In this manner, welding training encompasses not only the training of muscle memory to successfully perform a particular weld, but also teaches the end user 11 how to properly analyze the virtual article(s) 16 for selecting the appropriate welding process needed to correct its operational deficiency. Welding training may also encompass learning that extends beyond the training of muscle memory by incorporating weld puddle modeling that teaches the end user 11 to make adjustments during the welding process.
As mentioned above, a grade may be derived from the end user's analysis of the problem-based scenario. In one embodiment, the end user 11 may be given information regarding the virtual article's 16a base material and instructed to select an electrode appropriate for use with that base material. In the real world, selection of an electrode affects the integrity of a weld joint. Similarly selecting the right electrode in the virtual welding environment 9a affects the score or grade of the end user's 11 performance. Additionally, the end user 11 may be required to calculate the heat input to ensure that the base material properties are not permanently altered by multi-pass welds. In another embodiment, the simulating device 10 may provide the end user 11 with information related to material thickness and/or joint configuration. Accordingly, the end user 11 may be required to determine the appropriate travel speed for the virtual welding power supply settings selected in order to properly make the virtual weld. It is noted here that the information may be expressly stated or indicated by virtual cues from which the end user 11 may infer important factors needed for analyzing the problem. A combination of the aforementioned is also contemplated by the embodiments of the subject invention. It will be recognized that the simulating device 10 therefore functions to educate and evaluate proficiency in learning for science, technology, engineering and/or math as promoted by various educational and governmental institutions.
It may be required that each level of training must be satisfactorily completed before advancing to subsequent levels. In one embodiment, tests may be given related to both welding knowledge and/or virtual welding performance. Data, i.e. test data or performance data, from the current scenario may be tracked, stored and compared against preprogrammed welding parameters in a manner consistent with that described above. In areas where minimum levels of achievement have not been reached, the end user 11 may be given opportunity to review tutorials and/or practice welding a particular weld joint. Once proficiency has been demonstrated, the end user 11 may advance to progressively more difficult levels teaching new skills.
Various elements, features, and functions described herein may be embodied in a tablet-based computing device. A tablet-based computing device, or tablet, is generally a mobile, one-piece device having a touch-screen display that a user may interact with via the user's finger or a stylus. Gestures of the user's finger or the stylus serve as a primary means of control and input. However, the tablet may provide additional means of control and input such as, for example, buttons, a virtual or attachable keyboard, or input from one or more sensors. For example, a stylus may have one or more accelerometers and serve as the input device 13, in accordance with an embodiment.
One embodiment provides a tablet-based computing device or tablet. The terms “tablet-based computing device” and “tablet” are used interchangeably herein. The tablet-based computing device includes a touch-screen display and computer memory storing at least one welding software application providing a virtual welding process. The tablet-based computing device further includes processing means operable to execute coded instructions of the at least one welding software application to generate an interactive virtual welding environment and to display the interactive virtual welding environment on the touch-screen display. The tablet-based computing device also includes an input means configured to interact with the touch-screen display when manipulated by a user to direct at least a spatial orientation of a virtual welding tool in the virtual welding environment while performing a virtual welding activity corresponding to the virtual welding process. The virtual welding process may include one of flux cored arc welding (FCAW), gas metal arc welding (GMAW), gas tungsten arc welding (GTAW), and shielded metal arc welding (SMAW). The input means may include a stylus that does not have a motion sensor or a position sensor. The input means may be configured to interact with the touch-screen display when manipulated by a user to direct at least a spatial position of a virtual welding tool in the virtual welding environment while performing a virtual welding activity corresponding to the virtual welding process. In accordance with an alternative embodiment, instead of having a separate input means, the touch-screen display is configured to be manipulated by a finger of a user to direct at least a spatial orientation of a virtual welding tool in the virtual welding environment while performing a virtual welding activity corresponding to the virtual welding process. Furthermore, the touch-screen display may be configured to be manipulated by a finger of a user to direct at least a spatial position of a virtual welding tool in the virtual welding environment while performing a virtual welding activity corresponding to the virtual welding process. The virtual welding environment may include a virtual asset to be welded using the virtual reality welding process. The virtual asset may be, for example, an automobile, a bridge, a wind turbine tower, or a building.
The touch-screen display 820 and the computer memory 840 are operatively connected to the processor 830. In accordance with an embodiment, the computer memory 840 stores a welding software application (WSA) 850 that provides a virtual welding process (e.g., a flux cored arc welding (FCAW) process, a gas metal arc welding (GMAW) process, a gas tungsten arc welding (GTAW) process, or a shielded metal arc welding (SMAW) process. The WSA 850 provides coded instructions that may be executed on the processor 830.
In accordance with an embodiment, the WSA 850 provides coded instructions to generate and display an interactive virtual welding environment on the tablet 800. The virtual welding environment may include a virtual welding tool and a virtual part to be welded, along with various other virtual entities such as, for example, controls, indicators, and assets. The type of virtual welding tool, virtual part to be welded, and various other virtual entities in the virtual welding environment may be dependent upon the virtual welding process. For example, if the WSA 850 corresponds to a SMAW process, then the virtual welding tool will be a stick welding tool.
The virtual controls may allow the user to change a set up of the virtual welding process (e.g., amperage, voltage, wire feed speed, etc.), for example. The virtual indicators may provide displayed indications to the user with respect to, for example, pitch and roll angles of the virtual welding tool. Other indicators are possible as well, as known to one skilled in the art. The virtual assets may correspond to the type of entity that is being welded (e.g., a car, a boat, an air plane, a tractor, a bridge, a wind turbine, or a building).
In accordance with an embodiment, even though a WSA corresponds to a particular welding process, the WSA may allow the selection of different assets in the virtual welding environment. Therefore, for a WSA providing a SMAW welding process, the user may be able to select to weld on a part of a car, a boat, an air plane, a tractor, a bridge, a wind turbine, or a building, for example. Other types of virtual assets are possible as well, in accordance with various other embodiments.
The user may use the stylus 810 or his finger to interact with the touch-screen display 820 to perform a virtual welding activity on the tablet 800 corresponding to the virtual welding process provided by the WSA 850. For example, the user may direct the position and orientation of a virtual welding tool, displayed on the touch-screen display 820, with respect to a virtual weld joint to simulate the creation of a weld bead along the weld joint. The user is relying on the interaction of the stylus (or finger) with the touch-screen display to manipulate the displayed virtual weld tool. Therefore, no position sensors or motion sensors are needed to sense the position or orientation of the stylus or the finger.
The computer memory 840 may also store other WSA's corresponding to other virtual welding processes. As a result, a user may select which WSA to execute on the tablet 800, at any given time. In this manner, a user may have a full complement of virtual welding processes from which to select and practice his virtual welding techniques.
Another embodiment provides a tablet-based computing device or tablet. The tablet includes a display, wireless communication means, and computer memory storing at least one summarizing software application. The tablet also includes processing means operable to execute coded instructions of the at least one summarizing software application. The coded instructions are executed to access at least one virtual reality welding system via the wireless communication means to download user virtual welding activity information from the at least one virtual reality welding system to the tablet. The coded instructions are also executed to generate a summary of user virtual welding progress based on the user virtual welding activity information, and display the summary of user virtual welding progress on the display. The user virtual welding activity information and the summary of user virtual welding progress may correspond to a single user of the at least one virtual reality welding system, or to a plurality of users of the at least one virtual reality welding system.
The computer memory 1140 stores a summarizing software application (SSA) 1145 that provides an information summarizing capability. In accordance with an embodiment, the SSA 1145 provides coded instructions that may be executed on the processor 1130 to access the virtual reality welding system 1200 over the external communication infrastructure 1300 via the wireless communication device 1110 to retrieve user virtual welding activity information stored on the virtual reality welding system 1200. The user virtual welding activity information may be stored on the virtual reality welding system 1200 in the form of one or more electronic files, for example.
Furthermore, the SSA 1145 provides coded instructions that may be executed on the processor 1130 to generate a summary of user virtual welding progress based on the user virtual welding activity information, and display the summary on the display 1120. The summary may be displayed on the tablet 1100 in a report format, for example. Other formats are possible as well, in accordance with various other embodiments.
Again, the user virtual welding activity information may include, for example, information identifying the types of welding processes the user has performed on the virtual reality welding system 1200 along with information related to a performance of the user for each of the welding processes. The summary of user virtual welding progress generated by the tablet 1100 may include, for example, average performance information, or consolidated performance information for a user of the virtual reality welding system 1200. For example, an average pitch angle of how the user held a mock welding tool of the virtual reality welding system 1200 during a particular virtual welding process may be generated by the SSA 1145 and displayed as part of the summary. Furthermore, a consolidated presentation of pitch angle vs. roll angle of how a user held the mock welding tool during a particular virtual welding process may be generated by the SSA 1145 and displayed as part of the summary.
The summary of user virtual welding progress may also include graphical information showing how a performance parameter associated with a user has changed (e.g., improved) over time. For example, a graph of the average travel speed of a mock welding tool over a plurality of successive welding activities performed by a user for a particular welding process may be generated by the SSA 1145 and displayed as part of the summary. The graph may indicate how the average travel speed started out varying between too fast and too slow and then eventually settled to a desired travel speed during the course of, for example, twenty (20) successive welding activities for a particular welding process, thus providing an indication of how long it took for the user to settle into applying the correct travel speed to the mock welding tool of the virtual reality welding system 1200.
User virtual welding activity information may be accessed for a single user, or for a plurality of users, from one or more virtual reality welding systems, in accordance with an embodiment. For example, a welding instructor, using the tablet 1100, may access user virtual welding activity information for all of his welding students across a plurality of virtual reality welding systems 1200. The SSA 1145 on the tablet 1100 may create a summary for each welding student and may also create a consolidated summary which shows progress for all of the welding students, for example, in a comparative manner (e.g., a ranking of the welding students).
A further embodiment provides a method of virtual welding. The method includes generating a dynamic virtual welding environment within a computer-based platform and displaying stereoscopic three-dimensional (3D) images of at least a portion of the dynamic virtual welding environment on a display screen of the computer-based platform. The computer-based platform may be one of a desktop personal computer, a tablet-based computer device, a laptop computer, a notebook computer, or a workstation, for example. The method further includes viewing the stereoscopic three-dimensional images using 3D glasses, resulting in at least a portion of the dynamic virtual welding environment appearing to project out of the display screen into 3D space. The method also includes virtually welding a virtual weldment of the projected portion of the dynamic virtual welding environment in 3D space using a mock welding tool while viewing the stereoscopic three-dimensional images using 3D glasses. In accordance with an embodiment, a position and an orientation of the mock welding tool is tracked in 3D space in real time using one or more of inertial tracking techniques or magnetic tracking techniques, for example. The method also includes calibrating the mock welding tool to the projected virtual welding environment in 3D space by, for example, correlating a position of at least one point on the mock welding tool in 3D space to a position of at least one point on the projected virtual weldment in 3D space.
The virtual welding environment is dynamic in the sense that it may be acted upon and modified in response to the user performing a virtual welding activity in real time. As the user moves the mock welding tool along the joint to create the virtual welded joint 1312 appearing to the user in 3D space, the computer-based platform 1300 updates the dynamic virtual welding environment 1310 in real time and continues to display stereoscopic 3D images of the environment on the display screen 1320 such that the user may observe his actions and the resultant creation of the virtual welded joint 1312 in real time in 3D space using 3D glasses.
In accordance with an embodiment, the appearance of the resultant virtual welded joint 1312 is realistically simulated as being dependent on the user's technique of manipulating the mock welding tool 1330, as would be the case in the real-world during a real welding activity. For example, if the user moves the tip of the mock welding tool 1330 away from the joint 1312, the displayed deposited weld bead will appear as being deposited away from the joint 1312. Furthermore, if the user moves the tip of the mock welding tool 1330 too quickly along the joint 1312, the resultant displayed deposited weld bead may have a distorted stacked-dime appearance.
For the mock welding tool 1330 to effectively interact with the virtual welding environment, as viewed as projected into 3D space by the user, the mock welding tool is tracked in 3D space and is correlated to the projected virtual welding environment in 3D space by the computer-based platform 1300. The mock welding tool may be tracked by the computer-based platform 1300 in 3D space by employing, for example, inertial tracking techniques or magnetic tracking techniques. An inertial tracking technique may employ accelerometers on the mock welding tool which report position and motion information back to the computer-based platform 1300 via wired means (e.g., a universal serial bus connection) or wireless means (e.g., a Bluetooth™ connection). A magnetic tracking technique may employ coil sensors on the mock welding tool and a magnetic source providing a magnetic field to be detected by the coil sensors. In a similar manner, the coil sensors may report position and motion information back to the computer-based platform 1300 via wired or wireless means.
To correlate or calibrate the position of the mock welding tool 1330 to the “projected position” of the virtual welding environment 1310 in 3D space, the computer-based platform 1300 may direct the user to successively place the tip of the mock welding tool 1330 at two or more points on an element of the projected environment. For example, the computer-based platform 1300 may direct the user to place the tip of the mock welding tool at pre-determined points “A”, “B”, and “C” on the virtual weldment 1311 in succession (see
While the claimed subject matter of the present application has been described with reference to certain embodiments, it will be understood by those skilled in the art that various changes may be made and equivalents may be substituted without departing from the scope of the claimed subject matter. In addition, many modifications may be made to adapt a particular situation or material to the teachings of the claimed subject matter without departing from its scope. Therefore, it is intended that the claimed subject matter not be limited to the particular embodiments disclosed, but that the claimed subject matter will include all embodiments falling within the scope of the appended claims.
This U.S. patent application claims priority to and is a continuation-in-part of U.S. patent application Ser. No. 12/504,870 filed on Jul. 17, 2009, which is incorporated herein by reference in its entirety, and which claims priority to U.S. provisional patent application Ser. No. 61/090,794 filed on Aug. 21, 2008.
| Number | Date | Country | |
|---|---|---|---|
| 61090794 | Aug 2008 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | 12504870 | Jul 2009 | US |
| Child | 13804115 | US |
