Patent Application
20170092012
1. Technical Field
Aspects of the present invention relate to the generation of reports including three-dimensional (3D) objects and a method for incorporating additional 3D views to an existing 3D object during report generation, creating an augmented universal 3D (u3d) file to be imported into a report.
2. Description of Related Art
There are many industries and services that rely on the generation of three-dimensional (3D) images (objects) to transmit information. For example, many medical images are three-dimensional, and need to be transmitted from the person creating the image (e.g., radiologist) to a physician. Similarly, an engineer working on a component at a worksite location may need to transmit a three-dimensional image of the component to co-workers at another location.
In many situations, these 3D objects are included in a portable document format (PDF) document that is transmitted to other personnel for their use. The individual creating the PDF document is limited in the amount of information that may be associated with any 3D object. In many situations, it would be desirable to allow the document creator to embellish or modify the 3D model to highly those areas of the model that need attention by the readers of the document. For example, a radiologist sending a 3D image to an attending physician may want to add a different texture to a portion of the image, or modify the view of a particular portion of the model.
Heretofore, the personnel creating the report were unable to modify or embellish any of the information related to the embedded 3D objects. This is considered to be a severe limitation to the usefulness of including 3D objects in reports that are shared among a group of recipients.
The needs in the prior art are addressed by aspects of the present invention, which relate to a method for incorporating additional three-dimensional (3D) views to an existing 3D object during report generation.
In accordance with aspects of the present invention, a declarative specification method is used to include additional 3D editing and manipulation information within the actual universal 3D (u3d) file being imported into the report, creating an augmented u3d file. Defined as a new ADI (Additional Data Inclusion) format, the methodology in accordance with aspects of the present invention allows for additional views, cutting planes, texture planes and the like to be added to the description of a given 3D object, providing additional information to the report reader.
The inventive technique functions by parsing the u3d file that is to be imported into a report, and then parsing the available ADIs to create a set of additional descriptors relevant for that particular 3D object.
In one embodiment, aspects of the present invention take the form of a system that augments an existing u3d file to include additional information associated with a 3D object defined by the existing u3d file, where the system comprises a file source that defines an Additional Data Inclusion (ADI) file format, an ADI parser coupled to the file source, the ADI parser including high-level specification programs defining additional illustration data to be included in the description of the 3D object, and an ADI converter that transforms the ADI specifications created by the ADI parser into u3d format and incorporating the transformed ADI specifications into the existing u3d file to create an augmented u3d file.
Another embodiment can be defined as a system for generating a portable document format (PDF) document report including at least one active 3D object. In this embodiment, the system includes an input template including a plurality of template fragments to be used by a report creator in developing a specific report format, a template parser coupled to the input template and accessible by the report creator to configure selected template fragments into the specific report format, including instructions to import identified u3d files into the generated report, a source of active 3D objects, a data converter that translates information defining a selected 3D object into the u3d file format, a PDF report generator responsive to the specific report form and imported u3d files to generate a 3D PDF output report and a composer, accessible by the report creator, that augments information in at least one of the identified u3d files prior to importing the u3d file to the PDF report generator.
Additionally, aspects of the present invention are embodied as a method for augmenting an existing u3d file to include additional data in an Additional Data Inclusion (ADI) file format, the method comprising: (1) providing a file source that defines an Additional Data Inclusion (ADI) file format; (2) selecting, from the file source, additional information to be used to augment an existing u3d file; (3) creating a high-level ADI specification including a set of program steps defining additional illustration data to be included in the description of the 3D object; and (4) converting the high-level ADI specification into u3d format and incorporated the converted data into the existing u3d file to create an augmented u3d file.
Other and further aspects and embodiments of the present invention will become apparent during the course of the following discussion and by reference to the accompanying drawings.
Referring now to the drawings,
There are currently a variety of different techniques for including three-dimensional (3D) objects within documents created in a higher-level language. Indeed, there are a number of systems available for incorporating 3D objects in portable document format (PDF) documents, where these systems allow for the “reader” of the document to manipulate the 3D object. In this regard, the disclosure of U.S. patent application Ser. No. 14/870,380, Attorney Docket Number 2014P26357US, which is incorporated herein by reference in its entirety and is assigned to Siemens, the assignee herein, describes a system and method for using an XML input template to import 3D objects in a manner where the recipient does not require vendor-specific software to activate the 3D capabilities of the object.
In general, PDF reports can have 3D objects, along with other active and passive objects. Also, as stated above, the 3D models can have views for the report reader to rotate and/or zoom into or out of the 3D object, so as to view the object from various angles or sides. However, there has been no way for the document creator to “edit”, so to speak, the 3D file to include other parameters that may be of interest.
In accordance with aspects of the present invention, it is now possible to include different 3D views to an existing 3D object. A 3D semantic view defines a particular cutting plane of a 3D object from a given camera angle. This cutting plane can be augmented with a given image and dynamic transparency settings that are aligned with the cutting plane. The semantic views are used to provide a better visualization of this augmented 3D information to readers of the generated report (such as doctors, CAD engineers, etc.) in many different scientific and engineering domains.
As shown in
An “interactive” PDF report generator 3 receives the input data from template parser 2 and then retrieves the 3D objects called for in the template from a 3D data source 4. As shown in
In accordance with aspects of the present invention, this system is enhanced by including 3D PDF composer 10 which is able to include a high-level specification to describe view information, as well as clipping plans and texture planes, within the u3d file created by data converter 5.
As mentioned above, composer 10 is based upon the creation of a novel Additional Data Inclusion (ADI) format. As shown in
ADI parser 14 is used to develop the details of the specific types of additional information to be included. At a first level, parser 14 includes a set of three categories, shown as ADI Plan 20, ADI Color Map 22 and ADI Cluster 24. ADI Plan 20 itself includes three plan-related specific elements: ADI view 26, ADI clipping plane 28 and ADI texture plane 30. These elements will be discussed below in association with
In accordance with aspects of the present invention, the individual creating the PDF report utilizes the tools within composer 10 to augment the original parameters associated with a 3D object to include additional views, cutting planes, textures, and the like to supply additional information to those individuals receiving the generated report. Once all of the desired additional information has been identified by the individual creating the PDF report, ADI converter 16 is used to convert this information into u3d file format, creating an “augmented u3d” file. The augmented u3d file is then sent to PDF report generator 3, which functions to create an augmented 3D PDF file 40 as the generated output report of the system.
An exemplary specification that allows for defining additional clipping planes (via ADI Clipping Plane element 28) is shown in
Inasmuch as the conventional u3d file format does not have any properties for specifying clipping planes, the attributes associated with clipping plane 200 are stored as scene meta-data of the u3d file (within 3D data file 4).
Presuming that this is the only information to be added to the existing 3D object, ADI parser 14 passes this ADI specification to ADI converter 16, which will then convert the data into u3d file format, and present the augmented file to PDF generator 3. Similar to
Summarizing, the utilization of a composer for “Additional Data Inclusion” (ADI)-formatted data to an existing u3d file allows for a person creating a report including the 3D object to augment the file with additional information (views, clipping planes, textures, etc.) that is desired to be passed on to the readers of the report. The inventive method specifies 3D semantic views, which define a particular cutting plane of a given 3D object from a given angle. This cutting plane is augmented with image information, where the transparency settings are aligned with the 3D object.
The inclusion specification method in accordance with aspects of the present invention is able to combine D graphics data with images, and is able to specify the augmented 3D models by real images. The method supports image transparency in augmented 3D models and, therefore, is able to provide “see-through” images (i.e., 100% transparency) automatically within internal 3D models, enabling previously hidden elements to become visible to the reader of the generated report.
Although illustrative embodiments of aspects of the present invention have been described herein with reference to the accompanying drawings, it is to be understood that the invention is not limited to those precise embodiments, and that various other changes and modifications may be effected therein by one skilled in the art without departing from the scope of spirit of aspects of the present invention.
