Embodiments of the invention relate to three-dimensional (3D) scanning of large spaces.
Scanning a large space in 3D can be advantageous for a number of reasons. Having a digital, 3D rendering of a space allows a future user of the space to “virtually” walk through the space prior to actual use. In the instance of a commander of a naval ship, for example, it is beneficial for the commander to understand the layout and feel of the ship before embarking on a mission. Having a 3D scanned image of a space can also aid in generating accurate bids for future construction work on a space. For these advantages to be fully realized, though, the 3D scanned images should be accurate, and 3D scanning a large space accurately presents a number of challenges.
In many cases, a large space cannot easily be cleared out to prepare for scanning, and the logistics become very difficult to navigate. Thus, a system and method is needed to scan large spaces by providing the ability to scan smaller parts of the larger space and stitch the scans together.
An aspect of the present invention is drawn to an imaging system that includes: a first imaging data receiving component that receives first three-dimensional image data of a first area and a portion of a second area; a first data storage component that stores the first three-dimensional image data; a second imaging data receiving component that receives second three-dimensional image data of the second area and a portion of the first area; a second data storage component that stores the second three-dimensional image data; a stitching component that stitches the first three-dimensional image data together with the second three-dimensional image data to produce stitched three-dimensional image data of the first area and the second area; and a stitched data storage component that stores the stitched three-dimensional image data. The first area is optically isolated from the second area with the exception of through a throughway. The portion of the second area comprises a portion of the second area as optically viewed from the first area through the throughway. The portion of the first area comprises a portion of the first area as optically viewed from the second area through the throughway.
The accompanying drawings, which are incorporated in and form a part of the specification, illustrate example embodiments and, together with the description, serve to explain the principles of the invention. In the drawings:
The present invention provides a system and method to accurately 3D scan a large space.
As shown in
Now suppose that rooms 102, 104, and 106 are being 3D imaged. Using conventional 3D imaging techniques, the user performing the imaging scans room 102, then walks into room 104 and scans room 104, then walks into room 106 and scans room 106. The user may believe that the space has been accurately captured, however the scan has not accounted for the additional thickness of wall 108 because wall thicknesses are typically assumed to be conventional. As a result, as shown in
This variation in wall thickness, which may seem minor in isolation, may become a major problem when scanning large spaces and presumably minor measurement issues are compounded, resulting in a digital space that does not accurately represent the physical space. This inaccuracy can result in inaccurate bids for construction purposes, and lost time and money when parts and supplies are ordered based on the digital representation of the space. Thus, a system and method is needed to accurately 3D scan a large space.
As shown in the figure, floor plan 200 includes rooms 202, 204, 206, 208, 210, 212, and 214, and hallways 216 and 218. Floor plan 200 is large, and in order to scan the entire space in a single imaging session, significant preparation is involved. The space may need to be cleaned to avoid inaccuracies during scanning. Additionally, any personnel in the space will have to be removed, and registration targets may need to be deployed in each room to provide reference points during the scanning process. In addition, a detailed scanning plan should be generated to assure the space is scanned appropriately.
Scanning a large space like floor plan 200 in this manner not only includes the potential of compounding small errors as discussed with reference to
Embodiments of the present invention provide for using any known type of 3D scanner to scan a first room within a large space, and a portion of a second room adjacent to the first room, visible through a throughway or portal. The 3D scanner is then used to scan the second room. The 3D images of the first room and second room are stitched together using registration targets in the second room that are visible from the scan of the second room and also visible from the scan of the portion of the second room from the first room. Stitching 3D images together in this manner provides for more accurate images that can be recorded piecemeal rather than scanning a large space in a single scanning session.
Aspects of the present invention will now be discussed with reference to
As shown in the figure, method 300 starts (S302) and a first 3D image is received (S304). This will be further described with reference to
As shown in the figure, system 400 includes an imaging system 402, a stitching system 432, and a display system 434.
Imaging system 402 further includes an imaging data receiving component 404, an imaging data receiving component 406, a storage component 408, and a storage component 410. Imaging data receiving component 404 communicates with storage component 408 via communication channel 418, and imaging data receiving component 406 communicates with storage component 410 via communication channel 424.
Imaging system 402 may be any known 3D scanning technology designed to record and store 3D images. Non-limiting examples of conventional 3D scanning technology include, Light Distance and Ranging (LiDAR), depth cameras, structure from motion (SfM), simultaneous localization and mapping (SLAM), and Kinect.
Imaging data receiving components 404 and 406 may be any type of device or system within imaging system 402 that receives the three-dimensional image data associated with the desired 3D images.
Storage components 408 and 410 may be any type of device or system within imaging system 402 that stores the data received by imaging data receiving components 404 and 406, respectively. Non-limiting examples of storage components 408 and 410 include RAM, ROM, EEPROM, CD-ROM or other optical disk storage, magnetic disk storage or other magnetic storage devices.
In this example embodiment, only two imaging data receiving components are shown for purposes of discussion, however it is possible to have more or fewer imaging data receiving components within imaging system 402. In addition, in this embodiment, only two storage components are shown for purposes of discussion, however it is possible to have more or fewer storage components within imaging system 402.
In this example embodiment, imaging system 402 is illustrated as a single element for purposes of discussion. However, it should be noted that an imaging system used in accordance with aspects of the present invention may be a plurality of imaging systems, either identical or fundamentally different, so long as the generated image data is compatible for stitching. If multiple imaging systems are used, the work of scanning a large space may be distributed in parallel by multiple independent teams. As such, a large ship may be scanned in a short amount of time.
In this example embodiment, imaging data receiving component 404, imaging data receiving component 406, storage component 408, and storage component 410 are illustrated as individual devices. However, in some embodiments, at least two of imaging data receiving component 404, imaging data receiving component 406, storage component 408, and storage component 410 may be combined as a unitary device.
Stitching system 432 further includes stitching component 412 and storage component 414. Stitching component 412 communicates with storage component 408 via communication channel 420 and with storage component 410 via communication channel 426.
Stitching component 412 may be any device or system designed to receive a plurality of 3D images and create a single 3D image from the plurality of 3D images by aligning registration targets between the 3D images.
Display system 434 communicates with storage component 414 via communication channel 430. Display system 434 is any device or system that can display the 3D image to a viewer. Non-limiting examples of display system 434 include televisions, computer monitors, tablet computer displays, mobile phone displays, and virtual reality displays.
In this embodiment, imaging system 402, stitching system 432, and display system 434 are illustrated as individual devices. However, in some embodiments, imaging system 402, stitching system 432, and display system 434 may be combined as a unitary device.
As shown in the figure, a space 500 includes a room 502, a room 504, a throughway 506, and registration targets 508, 510, 512, 514, 516, and 518. Registration targets 508, 510, 512, 514, 516, and 518 may be any object that is distinctive and can be identified. They may be distinctive items already in a space, like a post or a beam, or they may be items placed specifically in the space for registration purposes.
For purposes of discussion, suppose a 3D scan of space 500 was desired. Furthermore, suppose space 500 is sufficiently large that it is not possible to conduct a 3D scan of the entire space 500 in a single scanning session. In addition, room 502 cannot be fully viewed from within room 504, and room 504 cannot be fully viewed from within 502, so rooms 502 and 504 are optically isolated from each other. Therefore, room 502 will be scanned during one scanning session, and room 504 will be scanned during a second scanning session.
To prepare for scanning room 502, registration targets 508, 510, and 512 are placed in room 504 such that they can be scanned from room 502 through throughway 506. To prepare for scanning room 504, registration targets 514, 516, and 518 are placed in room 502 such that they can be scanned from room 504 through throughway 506.
As shown in the figure, imaging system 402 has conducted a 3D scan at a first time resulting in 3D image 520, which includes a 3D image of room 502 and a 3D image of a portion of room 504 viewable through door 506. 3D image 520 includes registration targets 508, 510, 512, 514, 516, and 518.
Returning to
Returning to
Referring to
Returning to
Referring to
As shown in the figure, imaging system 402 has conducted a 3D scan, resulting in 3D image 524, which includes a 3D image of room 504 and a 3D image of a portion of room 502. The 3D image 524 includes registration targets 508, 510, 512, 514, 516, and 518.
As shown in the figure, imaging system 402 has conducted a 3D scan a second time t2, resulting in 3D image 526, which includes a 3D image of room 504. It should be noted that in some embodiments, the second 3D image data may be received (S308) right when the first 3D image data is received (S304), such that t1 is substantially the same as t2, whereas in other embodiments, the second 3D image data may be received (S308) long after the first 3D image data is received (S304), such that t1 is much earlier than t2.
The 3D image 526 includes registration targets 508, 510, and 512. It may be necessary to scan room 504 without scanning the adjacent portion of room 502 for various reasons. In one embodiment, room 502 may be in use at the time room 504 is scanned, requiring door 506 to be closed. In another embodiment, the individual scanning room 504 may have unintentionally closed door 506 prior to the scan. In another embodiment, registration targets 514, 516, and 518 may have been removed from room 502, thus providing no incentive to scan the adjacent portion of room 502 when scanning room 504.
Returning to
Returning to
Referring to
Returning to
Referring to
As shown in
To stitch the images together, stitching component 412 identifies registration targets in one image and then attempts to identify the equivalent registration targets in another image. In one embodiment, stitching component 412 may identify registration targets 508, 510, 512, 514, 516, and 518 from image 520. Stitching component 412 will then search for the same registration targets in image 524. When stitching component 412 identifies registration targets 508, 510, 512, 514, 516, and 518 within image 524, stitching component 412 combines images 520 and 524 such that each registration target within image 520 is superimposed on the respective registration target within image 524.
As shown in
As shown in
Referring now to
In accordance with an aspect of the present invention, a space and part of adjacent spaces are captured in order to allow the stitching. However, a significant amount of unnecessary work may be performed if a part of all adjacent spaces are included in each individual scan. For example,
Generally, when 3D imaging any set of adjacent spaces using the present invention, only one of the 3D images of the spaces should capture a 3D image of a portion of the adjacent space for both spaces to be imaged accurately. This will be further described with reference to
As shown in the figure, stitched image 800 includes image 802 and image 804. Stitched image 800 is the digital, 3D representation of space 500. Image 802 corresponds to room 502 and image 804 corresponds to room 504.
In one embodiment, and with reference to
In another embodiment, and with reference to
In the non-limiting example embodiment discussed above with reference to
Therefore, stitched image 800 will look the same whether the images are stitched as described in
Returning to
Referring to
Returning to
With reference to
In summary, conventional 3D imaging systems present multiple problems when attempting to create a 3D image of a large space. Because conventional systems require users to scan a large space in a single session, significant preparation and scanning time is involved. In addition, because conventional systems typically provide assumptions regarding wall thicknesses there are often significant dimensional errors compounded over the scans of multiple rooms that result in inaccurate dimensions.
The present invention addresses those problems by providing a user the ability to break up a 3D scan of a large space with multiple rooms into many small scanning sessions while increasing the overall accuracy of the scan. To do so, in some embodiments, registration targets are placed in the rooms to be scanned, whereas in other embodiments natural features already in the space may be used as registration targets. When scanning one room, the scanner also scans a portion of the adjacent room that contains registration targets. Doing so properly accounts for the thickness of the wall in between the two rooms. The scanner then scans the adjacent room which also includes the same registration targets. When the images of the rooms are stitched together, the stitching component matches the registration targets between the scanned rooms, creating a single, accurate image that contains both rooms.
It should also be noted that the invention may permit the work of scanning a large space in parallel to be broken up among multiple independent teams.
The foregoing description of various embodiments have been presented for purposes of illustration and description. It is not intended to be exhaustive or to limit the invention to the precise forms disclosed, and obviously many modifications and variations are possible in light of the above teaching. The example embodiments, as described above, were chosen and described in order to best explain the principles of the invention and its practical application to thereby enable others skilled in the art to best utilize the invention in various embodiments and with various modifications as are suited to the particular use contemplated. It is intended that the scope of the invention be defined by the claims appended hereto.
The United States Government has ownership rights in this invention. Licensing inquiries may be directed to Office of Research and Technical Applications, Space and Naval Warfare Systems Center, Pacific, Code 36000, San Diego, Calif., 92152; telephone (619) 553-5118; email: ssc_pac_t2@navy.mil. Reference Navy Case No. 105,302.