Claims
- 1. A video editing system or tool for E-commerce, said system utilizing augmented reality (AR) technology for combining real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world, said system comprising:
a programmable computer for performing data processing of video and calibration data; a source of video data coupled to said computer; a set of markers for calibration of said camera and for pose estimation of said markers, for providing calibration results;
a source of a 3-dimensional (3-D) image data model for a product; said computer utilizing said 3-D image data and said calibration results for rendering a 3D model; and said computer utilizing said 3D model and said video data for generating a 3-D model with superposition of said 3D model and said video data so as to provide an AR video.
- 2. A video editing system in accordance with claim 1, wherein said (3-D) image data model for a product comprises a VRML model.
- 3. A video editing system in accordance with claim 1, wherein said (3-D) image data model for a product comprises an OpenGL model.
- 4. A video editing system in accordance with claim 1, wherein said a source of video data is a video camera.
- 5. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides marker-based calibration to calibrate the camera and estimate the pose of the markers in the AR video editing system.
- 6. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides image feature extraction and marker recognition.
- 7. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides virtual reality (VR) model rendering/augmentation.
- 8. A video editing system in accordance with claim 1, wherein said computer performs video compression on said AR video.
- 9. A video editing system in accordance with claim 1, wherein said computer performs video compression on said AR video for converting said AR video to at least one of RealMedia and MPEG Movie format.
- 10. A video editing system in accordance with claim 1, wherein said computer adds inputted hyperlink information to said AR video after said converting said AR video, so as to produce a hyperlinked video message.
- 11. A video editing system in accordance with claim 10, wherein said computer data provides hyper-linking of said AR video to product specification WebPages.
- 12. A method for video editing comprising the steps of:
obtaining video image data from a source; extracting feature information data from said video image data; extracting marking recognition data from said video image data; utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source; deriving 3-dimensional (3-D) model data for an object; utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
- 13. A method for video editing as recited in claim 12, comprising the steps of:
setting hyperlink information; compressing said AR video so as to produce a compressed AR video; adding said hyperlink information to said compressed AR video so as to produce an ArEcVideo message with hyperlinks.
- 14. A method for video editing as recited in claim 13, wherein said step of setting hyperlink information comprises setting hyperlink information for hyperlinks providing product information associated with said object.
- 15. A method for video editing as recited in claim 12, comprising the step of:
sending said ArEcVideo message with hyperlinks on the Web.
- 16. A system for video editing comprising:
means for obtaining video image data from a source; means for extracting feature information data from said video image data; means for extracting marking recognition data from said video image data; means for utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source; means for deriving 3-dimensional (3-D) model data for an object; and means for utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
- 17. A system for video editing as recited in claim 16, comprising:
means for setting hyperlink information; means for compressing said AR video so as to produce a compressed AR video; and means for adding said hyperlink information to said compressed AR video so as to produce an ArEcVideo message with hyperlinks.
- 18. A system for video editing as recited in claim 17, wherein said means for setting hyperlink information comprises means for setting hyperlink information for hyperlinks providing product information associated with said object.
- 19. A system for video editing as recited in claim 18, comprising:
means for sending said ArEcVideo message with hyperlinks on the Web.
- 20. A system for video editing as recited in claim 16, wherein said means for obtaining video image data from a source comprises a video camera.
- 21. A system for video editing as recited in claim 16, wherein said means for obtaining video image data from a source comprises a source of a stored video image.
- 22. A video editing system or tool for E-commerce, said system utilizing augmented reality (AR) technology for combining real and virtual worlds together to provide an interface for a user to sense and interact with virtual objects in the real world, said system comprising:
a programmable computer for performing data processing of video and calibration data in real time; a source of video data coupled to said computer; a set of markers for calibration of said camera and for pose estimation of said markers, for providing calibration results;
a source of a 3-dimensional (3-D) image data model for a product; said computer utilizing said 3-D image data and said calibration results for rendering a 3D model; and said computer utilizing said 3D model and said video data for generating a 3-D model with superposition of said 3D model and said video data so as to provide an AR video in real time relative to said video data.
- 23. A video editing system in accordance with claim 1, wherein said (3-D) image data model for a product comprises a VRML model.
- 24. A video editing system in accordance with claim 1, wherein said (3-D) image data model for a product comprises an OpenGL model.
- 25. A video editing system in accordance with claim 1, wherein said a source of video data is a video camera.
- 26. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides marker-based calibration to calibrate the camera and estimate the pose of the markers in the AR video editing system.
- 27. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides image feature extraction and marker recognition.
- 28. A video editing system in accordance with claim 1, wherein said said computer utilizing said 3D model and said video data provides virtual reality (VR) model rendering/augmentation with real time editing capability.
- 29. A video editing system in accordance with claim 1, wherein said computer performs video compression on said AR video.
- 30. A video editing system in accordance with claim 1, wherein said computer performs video compression on said AR video for converting said AR video to at least one of RealMedia and MPEG Movie format.
- 31. A video editing system in accordance with claim 1, wherein said computer adds inputted hyperlink information to said AR video after said converting said AR video, so as to produce a hyperlinked video message.
- 32. A video editing system in accordance with claim 10, wherein said computer data provides hyper-linking of said AR video to product specification WebPages.
- 33. A method for video editing comprising the steps of:
obtaining video image data from a source; extracting feature information data from said video image data; extracting marking recognition data from said video image data; utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source; deriving 3-dimensional (3-D) model data for an object; and utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
- 34. A method for video editing in accordance with claim 33 wherein said step of obtaining video image data includes a step of obtaining accompanying sound data.
- 35. A system for video editing comprising:
means for obtaining video image data, including accompanying sound data from a source; means for extracting feature information data from said video image data; means for extracting marking recognition data from said video image data; means for utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source; means for deriving 3-dimensional (3-D) model data for an object; and means for utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition to produce an artificial reality (AR) image.
- 36. A video editing system in accordance with claim 1, wherein said source of video data comprises a source for associated sound data.
- 37. A video editing system in accordance with claim 36, wherein said source of associated sound data comprises a microphone.
- 38. A video editing system in accordance with claim 16, wherein said source provides sound data and wherein said means for obtaining video image data comprises means for obtaining sound data from said source.
- 39. A video editing system in accordance with claim 22, wherein said video data includes associated sound data.
- 40. A video editing system in accordance with claim 33, wherein said step of obtaining video image data comprises a step of obtaining associated sound data from said source.
- 41. A method for video editing as recited in claim 12, said method being carried out in real-time using an ordinary desktop or laptop PC type of computer.
- 42. A method for video editing as recited in claim 12, to be carried out in real-time that enables a user to rehearse and get visual feed-back in real time.
- 43. A system for video editing as recited in claim 12, for producing said AR video in real time, said video being ready to be broadcast through a network in real time.
- 44. A method for video editing comprising the steps of:
obtaining video image data and associated synchronized sound data from a source; extracting feature information data from said video image data; extracting marking recognition data from said video image data; utilizing said information data and said recognition data to derive calibration data and pose estimation data for said source; deriving 3-dimensional (3-D) model data for an object; and utilizing said calibration data, said pose estimation data, said video image data, and said 3-dimensional (3-D) model data for an object to perform volume rendering (VR) and superposition so as to produce an artificial reality (AR) image in real time.
- 45. A method for video editing as recited in claim 44 including a step of providing said associated synchronized sound data to accompany said AR image in real time.
Parent Case Info
[0001] Reference is hereby made to Provisional Patent Application Serial No. 60/220,959 entitled DEVELOPMENT OF A REAL-TIME AUGMENTED REALITY APPLICATION: E-COMMERCE SALES SUPPORT VIDEO EDITING SYSTEM and filed Jul. 26, 2000 in the names of Navab Nassir and Xiang Zhang, and whereof the disclosure is hereby incorporated herein by reference.
Provisional Applications (1)
|
Number |
Date |
Country |
|
60220959 |
Jul 2000 |
US |