Computer ball device for mixed reality, virtual reality, or augmented reality

Abstract

Implementations of various computer methods to couple a computerized ball device which acts as a mobile computing device to record the users environment and project light towards waveguide eyeglasses or contacts which then allows a user to view imbedded light structure holograms in the waveguide while viewing the actual world. The computer ball device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also attach to a wrist band for mobility. The device also has the ability to couple the projected light structures so that a plurality of users may view the same light structure content to build an environment of trust. The device decouples the traditional design of head mounted virtual and mixed reality that place together the camera with the head mounted device.

Description

BACKGROUND OF THE INVENTION

Field of the Invention

Implementations of various methods to couple a computerized ball device which acts as a mobile computing device to project towards waveguide eyeglasses or contacts which will then allow a user to view their world in a mixed reality, augmented reality, and virtual reality world and to allow for group collaboration on a shared coupled device. The device additionally has the ability to be docked in a drone cradle which creates a database map of the user's environment while not being utilized by the user for an immediate task. The device may also be attached to a wrist band for mobility. The device decouples the traditional design of head mounted virtual and mixed reality wherein the traditional design places the camera or central processing unit (“CPU”) addition to the standard eyeglass which then violates human social contracts or concern the user or nearby bystanders are being recorded. The mobile computer ball device is decoupled from the waveguide lens so that a third person view of the user can be obtained in addition to a first person view. The computerized ball device allows standard shape eyeglasses to be coupled with the device in both a private user to ball setting or a device (ball) to private group setting. The device is superior in design to existing implementations of mixed and virtual reality technology with bulky head mounted apparatus which add weight that disturbs social contracts and bio-mechanical movement and weight distribution and does not allow for both first person and third person view points in the waveguide display. Family use of the technology allows for natural sharing of a coupled group technology sharing of experience. Commercial and Industrial work team use of the technology allows for natural sharing of a coupled group sharing of technology experience. The technology is a superior implementation of the way humans collaborate and work in groups. The technology is a superior implementation to extend natural human interaction without drawing attention to the technology instead of the shared human experience. Current technology deployment for computerized devices has focused on individual experience at the expense of group interaction. The implementation of the computerized ball device with head mounted eyeglass experience allows for a superior group experience. The computerized ball device may be placed in a mutual group setting or alternatively docked on a drone that has the ability to map a database of the user's environment. The computerized ball device has both an internal server and CPU as well as network connection capability to interface with a remote application server.

Description of the Related Art

The following descriptions and examples are not admitted to be prior art by virtue of their inclusion within this section.

Current implementations of mixed reality, augmented reality and virtual reality computing devices generally have bulky head mounted variations which are tailored to the individual experience and that experience generally isolates human beings from interacting face to face with other human beings. Such examples of these technologies are those implemented by Microsoft and their HaloLens product (A Trademark of Microsoft, Inc.), Oculus Rift VR (A Trademark of Facebook, Inc. by assignment), Sony's PlayStation VR (A Trademark of Sony, Inc.), HTC Vive (A Trademark of HTC, Inc.), Google Glass (A Trademark of Google, Inc.), Samsung's Gear VR (A Trademark of Samsung, Inc.), Razer's OSVR (A Trademark of Razer, Inc.) or Magic Leap's proposed systems (A Trademark of Magic Leap, Inc.). While these technologies are very impressive and useful, they fall short of allowing humans to interact in groups, face to face while using the technology without violating traditional human social contracts. Clearly these technologies stand the promise of greatly improved human productivity, but it has also come at a great expense of isolating humans from natural shared face to face interaction. Humans have rejected the model of a camera on the eyeglasses because others are concerned they are being recorded or watched. Some proponents of the camera on the eye glass model argue that humans will gain such benefit that the cost of objection for being recorded will be overwhelmed by the tremendous benefits of the technology. Further objections have become apparent because others in a group are not able to share the same information which creates a barrier of unfair information advantage. The implementation of the method allows users to “group” or “pair” multiple sets of eyeglasses with a single ball mobile computing device. The “group” or “paired” user experience allows all users in a group comfort in the social setting because everyone in the group is able to share the same information thus no social contract has been violated such as the objection to others recording a user without permission. While customization of user experience is useful for an individual experience, the implementations of technology have decreased the skills of humans to interact with eye to eye contact which has limited the ability to maintain or improve non-technology dependent human communication skills. Prior art generally has limited the ability to user both first person and third person viewpoints simultaneously.

Implementations of methods have been made in systems that provide augmented or virtual reality experiences, but do so in a manner that violates traditional human social contracts:

• • 1) U.S. Pat. No. 8,930,490 issued Jan. 6, 2015 to Apple Inc. covers a method and system for collecting information, enriching the collected information and linking the enriched information that is provided. The system includes an application server as well as wearable smart glasses to process data. System item 1740 pertains to a video/audio capture device on the wearable glasses. The system and method proposed continues to violate the social contract between humans that does not generally allow for recording of each other. Further we propose an alternative that only allows recording by one device where all private group users have access to the same information to avoid the “are you recording me syndrome” as well as reducing information advantage bias in group settings. A common group device will allow a superior collective outcome for group settings where technology is utilized. Again, most of these forms are more awkward and do not flow well with biomechanical movements of the user.
  • 2) U.S. Pat. No. 8,570,244 issued Oct. 29, 2013 to Sony Corporation, covers systems and methods for a head mounted image display apparatus. The image forming device is an optical system converting light emitted from the image forming device into parallel light. The implementation of this system and method does not pair the device for a private group, it does not transmit light images to the retina, it is bulky and it does not have the power to have a stronger CPU lens to project high definition images to multiple users. Further the device is incapable of remote database mapping of the user's environment. Again, most of these forms are more awkward and do not flow well with biomechanical movements of the user.
  • 3) US Patent No. 20140098009 issued Dec. 10, 2013 to Prest, Tang, Evans, et al. covers methods and apparatus for a personal goggle system for presenting a personal display of media. The implementation of this method uses not only a bulky head mounted apparatus, but also is designed for personal or private viewing with minimal consideration for the group which then violates social contracts of acceptability. Again, most of these forms are more awkward and do not flow well with biomechanical movements of the user.
  • 4) US Patent Application No. 2015/0016777 A1 to Abovitz et al, covers a planar waveguide apparatus with diffraction elements and system employing the same. The implementation of this method is substantially different in the configuration of the head mounted apparatus and planar waveguide, but also the configuration of the cameras and projection system. This system is not capable of mutually implementing first person and third person omniscient perspectives independently and simultaneously as the user's option. This system does not feature a locking mechanism for multiple users to share the same view which creates a barrier of asymmetric information in communication and recording of the common user environment for a plurality of users. Because the system does not allow a plurality of users to share the common recorded environment in a mutual design of trust, the system continues to violate social contracts of trust where humans object to being recorded. Because the systems and methods do not include both first person and third person omniscient perspectives where the full presence of the user's physical representation is not a part of the environment and the content does not provide artificial intelligence feedback from the user to interact with the content displayed in the waveguide, the system is not capable of an integrated augmented reality feedback experience and iterative reality experience. Users are not able to be a musician in the music band and receive visual and audio interaction with the actual musical band which the proposed invention does accomplish. Users are not able to be an actor or actress in the movie or TV show and receive audio and visual interaction with the movie stars and television stars which the proposed invention does accomplish. The proposed invention not only changes the way we experience current services such as cooking lessons, athletic training lessons, movies, music and other experiences, but it allows the user both the first person as well as third person omniscient perspectives and feedback from other objects or humans in the augmented environment.

SUMMARY

Current systems of technology to integrate computing into everyday life have largely been accepted when human users can trust the other users of the technology. The isolated nature of CPU, desktop, laptop or mobile computing is accepted because it remains obvious if one user is recording another user and typically this is forbidden in standard social settings because it violates a human social contract of trust between each other. Innovations such as Google Glass or Microsoft HaloLens or other augmented or virtual reality devices have struggled with adoption because they violate social contracts between humans and breach trust between humans. Information is power and if humans know they have different levels of power, they will typically not interact freely. This problem has caused a rift to form between humans and humans with technology. Further, augmented and virtual reality requires mapping a user's environment so that the virtual objects can interact with real objects that have been mapped into a database. Implementations of methods thus far have introduced non-sharing technologies which then pit one user against another user in turn causing low levels of adoption and violate human social contracts of trust. Lastly, implementations of methods and systems thus far have dealt with the first person perspective rather than the proposed invention which allows the first person and third person omniscient perspective, which, alongside methods and systems of artificial intelligence iterative feedback, the ability for a user to not only listen to music, but be part of the band, it allows not only the ability to watch a movie, but to be in the movie alongside existing actors and actresses, it allows not only the ability to watch a lesson in cooking or music or athletics, but to be alongside the teacher or instructing professional in an augmented or mixed reality environment.

The invention of systems and methods to accelerate the adoption of mixed reality, augmented reality and virtual reality is directed towards a mobile computing ball device that pairs with standard shaped eye glasses or contacts. The mobile ball device has the ability to project light and record/map environments while pairing to other users in a private group. The shared device has the function of building social contract trust so that users can equally build the groups information advantage rather than destroying group trust because the technology is potentially being used against a group member creating biased or skewed information advantage. The shared device also has the functional ability to display a first person or third person omniscient perspective with artificial intelligence iterative feedback, for a user to not only listen to music, but be part of the band, it allows not only the ability to watch a movie, but to be in the movie alongside existing actors and actresses, it allows not only the ability to watch a lesson in cooking or music or athletics, but to be alongside the teacher or instructing professional in an augmented environment, it allows not only the ability to invent something, but to be alongside the inventor or mentor in an augmented or mixed reality environment.

A plurality of users is communicatively paired with the device for group interaction settings. The plurality of users can command the device independently for the benefit of the private group. Accordingly, a plurality of users is then connected to the local or remote application server through the ball device. The ball CPU and application host or network server then connects users to a plurality of application functions. The ball CPU device is not only capable of pairing users to transmit data and electromagnetic light to users, but it also maps the user's environment for interaction with the application server. Users may use the device privately as one would use a mobile smart phone or they may pair with other users for group purposes to ease social contract stress. Shared or private applications may include but are not limited to calendar, photos, camera, videos, maps, weather, credit cards, crypto currency, notes, clocks, music, application hosting servers, settings, physical fitness, news, video conferencing, hologram conferencing, home security, home lighting, home watering systems, home energy or temperature settings, home cooking, phone, texting services, mail, internet, social networking, blogs, investments, books, television, movies, device location, flashlights, music tuners, airlines, transportation, identification, translation, gaming, real estate, shopping, food, commodities, technology, memberships, applications, web applications, audio media, visual media, touch media, general communication, internet, etc. . . . .

In one embodiment of the invention, the application server uses artificial intelligence algorithms to more efficiently provide the user with services or applications that are needed after the device has scanned the common area for the group or private user who has been paired with the device. The application server will display through the ball device most frequently used applications as well as recommending more efficient application for data patterns of the user or group of users.

In another embodiment of the invention, the application server uses artificial intelligence to analyze the user's biomechanical movement for such exercises as athletics, music, performing arts, cooking, teaching, conferencing etc. The visualization allows both the first person and third person omniscient perspective because of the positioning of the camera and projection relative to the waveguide lens. The ball CPU device will then be able to provide the user of the CPU ball device with an augmented reality companion to teach them. The augmented reality companion may be a professional at the service such as but not limited to tennis with John McEnroe or football with Nick Sabin or cooking with Julia Child or piano with Beethoven or acting alongside Harrison Ford in Star Wars or singing alongside Carrie Underwood on stage or in a private performance or many other examples. The ball CPU device will be able to analyze the user's movements and provide customized feedback and interaction with other projected human holograms and objects based on artificial intelligence inherent in the augmented reality system.

In another embodiment of the invention, the ball CPU device is docked on a drone that will then transport the device within a fixed set radius of the user to scan the associated area of the user into a database. The drone docked CPU ball has the ability to scan the user's area and navigate hallways, stairways, rooms, and outside places within a fixed radius of the user as well as the user's movements. The application server that the ball CPU device accesses locally or remotely will then be able to draw upon the database to speed processing times and reduce memory leak.

In another embodiment of the invention, multiple users who each have the CPU ball or cube device may lock the other devices to a common group share over a network if a group of users is working together. These bounded group lock features are in place to build technology trust amongst users while not violating human social contracts. This implementation allows for all users to experience the common recording in their viewing through the planar waveguide lens to disallow asymmetric information which violates human social contracts of trust.

In another embodiment of the invention, reflective light and electromagnetic waves are projected from the CPU ball device onto the eyeglasses then from the eyeglasses through the aqueous humor lens and vitreous humor which then project onto the photo receptors of the retina. The projected images to provide the augmented reality experience reside within the structures at reactive variable depths of the eyeglasses or contact lenses. The impulses then synapse with the optic nerve to transmit images to the brain. Adjustments to the pupil and lense allow for the adjustment of light transmission to the retina. These features augment the users visual experience from not only the natural world but also the CPU ball generated objects to make a mixed reality or augmented reality experience.

People use eye glasses or contacts because the cornea and the length of the eye are often mismatched. The name for the mismatch is correlation error in optometry. When one is near sighted the cornea does not project all the way back to the retina and when one is far sighted the image is projected too far past the retina. Glasses to correct near sightedness are thinner in the middle and thicker on the edges which allows light to diffuse and diverge and project images further back toward the retina. To correct far sightedness, the glasses are thicker in the middle and thinner on the edges which allows for light to converge more quickly and the images are brought in further to project onto the retina accurately which allows for focus. More or less glasses “trick” the eye by moving the light toward different focal points.

Coherent laser light and electromagnetic waves are projected from the mobile CPU ball. Refracted images from light transmission into the structures in the glasses or contacts make the holographic images inside the contacts or eyeglasses. Refraction allows for the laser image that is projected to the head mounted eye glasses or contacts to be properly transmitted to the optic nerves for interpretation.

BRIEF DESCRIPTION OF THE DRAWINGS

Implementations of various technologies will hereafter be described with reference to the accompanying drawings. It should be understood, however, that the accompanying drawings illustrate only the various implementations described herein and are not meant to limit the scope of various technologies described herein.

FIG. 1 illustrates a schematic diagram of the mobile CPU networked ball projection device mapping the current location environment with the drone docking station. The mobile CPU networked ball device may also project images of virtual companions to facilitate dialogue, analysis or teaching to the user from both a first person and third person omniscient perspective.

FIG. 2 illustrates a schematic diagram of implementations of methods considering pairing multiple users so that social contracts of trust are not violated and a schematic of the wrist band to which the mobile CPU networked ball may be attached.

FIGS. 3A and 3B illustrate a schematic diagram of implementations of methods considering the separation of the ball device from the breakable head-mounted glasses which increases the technological capability while increasing durability and reducing stress from adding technology near the head which decreases biomechanical movement and balance as well as adding unwanted magnetic and radio waves near the brain.

FIGS. 4A and 4B illustrate in further detail the holographic images inside the eyeglass or contact lens structures projected from the mobile networked CPU ball. Refraction allows for the augmented reality hologram to be seen by the user against the real physical world from both a first person and third person omniscient perspective.

FIGS. 5A and 5B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able watch the band or musical performing artist but also may participate in the band as a singer, drummer, guitar player or other instrument player with interaction such that the user is a band member.

FIGS. 6A and 6B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able to watch the movie or performing artist but also may participate in the movie as an actor or actress, with interaction such that the user is a band member.

FIGS. 7A and 7B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able to watch the chef or cook but also may participate in the cooking experience, with interaction such that the user is a chef.

FIGS. 8A and 8B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able to watch the author or reader read but also may participate in the story telling experience, with interaction such that the user is a co-story teller or author.

FIGS. 9A and 9B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able to watch the inventor, architect or educator but also may participate in the creative experience, with interaction such that the user is a co-inventor or architect or educator.

FIGS. 10A and 10B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environments where the users not only are able to watch the athlete or coach but also may participate in the sporting experience, with interaction such that the user is a participant.

FIG. 11 illustrate a diagram of the mobile computer ball device in accordance with some embodiments.

FIG. 12 illustrates an exemplary user interface for selecting a plurality of applications in accordance with some embodiments.

FIGS. 13A and 13B illustrate a schematic diagram of the implementation of methods from the system where the exemplary user is able to visualize 3d augmented reality food menus and food options at a plurality of establishments using interactive artificial intelligence iterative environments and geofence and geolocation technology where the users may order food and prepay for food delivered at any participating restaurant or food retailer while being transported in a vehicle or from a static location.

FIGS. 14A and 14B illustrate a schematic diagram of the implementation of methods from the system where the exemplary user is able to visualize themselves in a 3d augmented reality clothing or textiles or consumer good both in a first person and third person omniscient augmented interactive artificial intelligence iterative environments for the purpose of customized manufacturing, purchases and delivery.

FIGS. 15A and 15B illustrate a schematic diagram of the implementation of methods from the system of the user's projected image to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence iterative environment where the users not only are able to see a demonstration of a professional athlete, but compare their movement variances for analysis.

DETAILED DESCRIPTION

The discussion below is directed to certain specific implementations. It is to be understood that the discussion below is only for the purpose of enabling a person with ordinary skill in the art to make and use any subject matter defined now or later by the patent “claims” found in any issued patent herein.

The following paragraphs provide a brief summary of various techniques described herein such as illustrated in FIG. 1. In one implementation as illustrated in FIG. 1 the ball CPU device 140 is mounted on a drone charging base 170. The ball CPU device 140 may gather preliminary information to complete and transmit a map tile database 160 utilizing the wireless network 150 and wireless GPS location network 130 of the user's environment from a fixed radius from the user 120. The map tiles from the database server 160 are then transferred to the ball CPU device 140 on a wireless network 150 from the database server 160. The CPU ball device 140 only utilizes map tiles in the immediate user 120 radius to optimize memory leak. The users 120 environment is periodically scanned for change analysis to the map tiles by the ball CPU device 140 and 170. Images may also be projected by laser light to the user 120. The images could be but are not limited to an athlete 175 or a musician 180 or a chef 190 or another service user that would then act as a virtual companion to the user 120 in their display device.

The embodiment illustrated in FIG. 2 illustrates how multiple users are paired so that human social contracts of trust are not violated and projected images are shared rather than consumed by a single user 230 to create asymmetric information with user 220. The user 230 may call the ball CPU device 270 to a centrally accessible common area with the user 230 or a group of users 230 and 220 for use with head mounted waveguide glasses 240 or contacts 210 which act as planar waveguides for the laser and infrared light 280 which is transmitted from the ball CPU device 270 to the head mounted glasses 240 or contacts 210. The ball CPU device may then transmit laser light 280 and infrared light 280 to the head mounted waveguide apparatus 240 or 210 which facilitates the visualization of embedded photon structures in the waveguide. Another benefit of the separation of the ball CPU 270 from the head mounted glasses 240 or contacts 210 is that Network and radiofrequency waves are further away from the head mounted waveguide therefore there is a reduction of radiofrequency and heat exposure of the electronics with the brain tissue. Additionally, the user 230 may attach the CPU ball 270 to a wrist mounted configuration 290 for mobility. Further, if users 230 and 220 agree to pair with the CPU ball 270, then the system only allows users to see the same information which adds trust to the overall system and use of the technology to ease societal social contract trust burdens which are violated when another user has reason to believe that they are being recorded.

The embodiment illustrated in FIG. 3A illustrates the network based ball CPU device 330 projecting laser light and infrared light 370 to the users 310 head mounted glasses 320 or contacts 320.

The embodiment illustrated in FIG. 3B illustrates the mobile network based ball CPU projection device 340 projecting laser light and infrared light 370 to the head mounted glass or contact lens 350. FIG. 3B shows a side view of the lens 350 taken from the front view if FIG. 3A glasses or contacts 320. Laser light and infrared light is refracted internally in 350 to project holographic images inside the lens 350 such that the user's eye 360 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 4A illustrates the same embodiment as FIG. 3B, but is repeated so it can be compared and expanded for the purposes of FIG. 4B which expands the explanation and the physical mechanics of light refraction to the user's eye 440.

The embodiment illustrated in FIG. 4B illustrates the infrared and laser light projecting from the wireless network based CPU ball 450 in greater detail as it moves through the waveguide lens 490 to project the hologram 460. Again, laser light and infrared light are projected from the wireless network based CPU ball to the lens 490 where light is refracted by structures 480 within the lens 490 that then project the holographic image 460 to the user's eye 465. Both structures 470 and 480 allow for refraction to project the hologram to the user's eye 465 within the lens structure 490. Many of these structures are present within the lens 490 so that the user may change the angles as which they look at both the real world and holograms 460 against the real world.

The embodiment illustrated in FIG. 4B further illustrates the use of the infrared light and laser light transmission in sequence with the users eyeball 465. The laser light and infrared light may scan the users eyeball 465 to recognize the user for purposes of identity security.

The embodiment illustrated in FIG. 4B could be any object 460 hologram such as but not limited to a word processor application, spreadsheet application, presentation application, keyboard, voice activated assistant, voice activated recorder, productivity application, movie application, music application, health application, companion chef instructor, companion to talk with who is remotely connected through network chat or messaging or video text, companion personal coach, companion athletic trainer, companion music or performing arts instructor, companion reading application, companion writing application for authors, companion personal trainer, or any personal instructor of any type that performs analysis through the camera in the ball CPU device 450 that transmits user 310 movements for analysis to the wireless network 250 and database server 260. The database server 260 and wireless network 250 can then transmit analysis from the database server or processors in the database server 260 or CPU ball device 450 to then project a holographic image 460 to the user 310 for interaction, companionship, and self-improvement or analysis.

The embodiment illustrated in FIG. 5A illustrates the mobile network based ball CPU projection device 510 projecting laser light and infrared light 520 to the head mounted glass or contact lens 530. Laser light and infrared light and electromagnetic waves are refracted internally in the lens 530 to project holographic images inside the lens 530 such that the user's eye 540 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 5B illustrates a schematic diagram of the implementation of methods from the system 510 and 570 of the user's projected image 560 to allow the user 550 to visualize both a first person 550 and third person omniscient 592 augmented interactive artificial intelligence interactive environments where the users 591 and 590 not only are able watch the band or musical performing artist but also may participate in the band as a singer 591, drummer 580, guitar player or other instrument player with interaction such that the user 591 is a band member. The artificial intelligence of the system 510 and methods will change music from an observed experience to an immersive and participatory experience with a plurality of users 591 and 590. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content. The camera 1113 also allows for the user 550 to record the music with the user 550 in the band for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 6A illustrates the mobile network based ball CPU projection device 610 projecting laser light and infrared light 620 to the head mounted glass or contact lens 630. Laser light and infrared light and electromagnetic waves are refracted internally in the lens 630 to project holographic images inside the lens 630 such that the user's eye 640 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 6B illustrates a schematic diagram of the implementation of methods from the system 610 and 670 of the user's projected image 680 to allow the user 650 to visualize both a first person 650 and third person omniscient 680 augmented interactive artificial intelligence interactive environments where the users 650 and 680 not only are able watch the movie 660 or performing artist but also may participate in the movie as an actor 690 or actress 680, with interaction such that the user 650 is an actor or actress in the movie or theatrical production. The artificial intelligence of the system 610 and methods will change movies and theatrical arts from an observed experience to an immersive and participatory experience with a plurality of users 680 and 690. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content. The camera 1113 also allows for the user 680 to record the movie with the user 680 in the movie for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 7A illustrates the mobile network based ball CPU projection device 710 projecting laser light and infrared light 720 to the head mounted glass or contact lens 730. Laser light and infrared light and electromagnetic waves 720 are refracted internally in the lens 730 to project holographic images inside the lens 730 such that the user's eye 740 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 7B illustrates a schematic diagram of the implementation of methods from the system 710 and 770 of the user's projected image 760 to allow the user 750 to visualize both a first person and third person omniscient augmented interactive artificial intelligence interactive environments where the users 790 not only are able to watch the chef 780 or cook 780 but also may participate in the cooking experience 760, with interaction such that the user is a chef 780. The artificial intelligence of the system 710 and 770 and methods change cooking instruction 780 from an observed experience to an immersive and participatory experience with a plurality of users 750 and 790. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content and other users. The camera 1113 also allows for the user 790 to record the cooking experience with the user 790 in the cooking experience for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 8A illustrates the mobile network based ball CPU projection device 810 projecting laser light and infrared light 820 to the head mounted glass or contact lens 830. Laser light and infrared light and electromagnetic waves 820 are refracted internally in the lens 830 to project holographic images inside the lens 830 such that the user's eye 840 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 8B illustrates a schematic diagram of the implementation of methods from the system 810 and 870 of the user's projected image 860 to allow the user 850 to visualize both a first person and third person omniscient augmented interactive artificial intelligence interactive environments where the users 890 not only are able to watch the author 880 or reader 880 read but also may participate in the story telling experience 860, with interaction such that the user 850 is a co-story teller or author 890. The artificial intelligence of the system and methods will change reading from an observed experience to an immersive and participatory experience with a plurality of users. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content. The camera 1113 also allows for the user 890 to record the reading experience with the user 890 in the reading experience for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 9A illustrates the mobile network based ball CPU projection device 910 projecting laser light and infrared light 920 to the head mounted glass or contact lens 930. Laser light and infrared light and electromagnetic waves 920 are refracted internally in the lens 930 to project holographic images inside the lens 930 such that the user's eye 940 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 9B illustrates a schematic diagram of the implementation of methods from the system 910 and 970 of the user's projected image 960 to allow the user to visualize both a first person and third person omniscient augmented interactive artificial intelligence interactive environments where the users 990 not only are able to watch the inventor 980, architect 980 or educator 980 but also may participate in the creative experience 960, with interaction such that the user 950 is a co-inventor or co-architect or co-educator 990. The artificial intelligence of the system and methods will change the creative process from an observed experience to an immersive and participatory experience with a plurality of users 990. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content. The camera 1113 also allows for the user 990 to record the co-invention or co-architect or co-educator with the user 990 in the co-invention or co-architect or co-educator for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 10A illustrates the mobile network based ball CPU projection device 1010 projecting laser light and infrared light 1020 to the head mounted glass or contact lens 1030. Laser light and infrared light and electromagnetic waves 1020 are refracted internally in the lens 1030 to project holographic images inside the lens 1030 such that the user's eye 1040 can interpret the images against the real world from both a first person and third person omniscient perspective.

The embodiment illustrated in FIG. 10B illustrates a schematic diagram of the implementation of methods from the system 1010 and 1070 of the user's projected image 1060 to allow the user 1050 to visualize both a first person and third person omniscient augmented interactive artificial intelligence interactive environments where the users 1090 not only are able to watch the athlete 1091 or coach 1080 but also may participate in the sporting experience, with interaction such that the user 1090 is a participant. The artificial intelligence of the system and methods will change the video from an observed experience to an immersive and participatory experience with a plurality of users 1090. The artificial intelligence content allows for a variety of endings or paths based on the user's interaction with the existing content. The camera 1113 also allows for the user 1090 to record the sporting experience with the user 1090 in the sporting experience for posting to social media or other local or cloud based networks subject to copyright laws.

The embodiment illustrated in FIG. 11 illustrates the mobile network based ball CPU projection device 1125. The device 1125 may include a memory 1102, a memory controller 1103, one or more processing units (CPUs) 1104, a peripherals interface 1105, RF circuitry 1106, audio circuitry 1108, one or more speakers 1107 and 1115, a microphone 1109, an input/output (I/O) subsystem 1110, input control devices 1111, an external port 1112, optical sensors 1116, camera 1113, one or more laser projection systems 1114, power supply 1117, battery 1118, wifi module 1119, GPS receiver 1120, accelerometer 1121, ambient light sensor 1122, location sensor 1123, barometer 1124, and USB port 1126. The device 1125 may include more or fewer components or may have a different configuration or arrangement of components

The CPUs 1104 run or execute various instructions compiled by software and applications which are stored in the memory 1102 that perform various functions on the device 1125. The RF circuitry 1106 receives and sends RF signals. The RF circuitry 1106 converts electrical signals to/from electromagnetic signals and communicates with communications networks 150 and 130 and other communication devices via the electromagnetic signals. The RF circuitry may be comprised of but not limited to an antenna system, a tuner, a digital signal processor, an analogue signal processor, various CODECs, a SIM card, memory, amplifiers, an oscillator and a transceiver. The wireless communication components may use a plurality of standard industry protocols such as Global System for Mobile Communication (“GSM”), Voice over internet protocol (“VOIP”), long-term evolution (“LTE”), code division multiple access (“CDMA”), Wireless Fidelity (“WiFi”), Bluetooth, Post office Protocol (“POP”), instant messaging, Enhanced Data GSM Environment (“EDGE”), short message service (“SMS”), or other communication protocol invented or not yet invented as of the filing or publish date of this document.

The input/output subsystem 1110 couples with input/output peripherals 1105 and other control devices 1111 and other laser projection systems 1114 to control the device 1125. The laser projection system 1114 and camera 1113 take infrared tracking information feedback from the user 120 into the peripheral interface 1105 and CPU 1104 to combine the data with instructions in the CPU 1104 and memory 1102 that provide an iterative instruction for the graphical user interface which is displayed in the waveguide lens 240 or 210 after comparison with information in the memory from the database server 260. The input control devices 1111 may be controlled by user 120 movements that are recorded by the laser projection system 1114 and camera 1113. The input control devices 1111 may include instructions from the user 120 movements based on interactions with the graphical user interface module that is a hologram 460 in the waveguide lens 240 or 210. Holograms 460 may take the form of representations of such things as graphical user interface modules which represent virtual keyboards, voice recognition, translation services, physical buttons, dials, sliders, joysticks, video game controllers, physical sporting equipment 1091, user 1050, comparisons of the user 1050 to a professional athlete 1080 or inventor 980 or author 880 or chef 780 or actress 680 or actor 690 or a musician 590, fashion apparel designer 980, weapons, cooking utensils 780, musical instruments 580, microphones, tools, books 880, movies 660, music 580, ordering food 1360 or drink 1380 with geofence location services, or ordering clothing 1460 or 1490, ordering retail goods in a virtual store 1460 or 1490, comparing the user 1591 and 1590 to a professional athlete 1560 using artificial intelligence on the database server 160 through interaction with the device 140 through the wireless network 150 or 130, virtual shopping 1225, virtual restaurant drive thru 1224 or other equipment for completing tasks.

The audio circuitry 1108, one or more speakers 1107 and 1115 and the microphone 1119 provide an audio interface between the user and the device 1125. The audio circuitry 1108 receives audio data from the peripherals interface 1105, converting the data to an electrical signal, and transmits the electrical signal to the speakers 1107 and 1115. The speakers 1107 and 1115 convert the electrical signals to human audible sound waves which are mechanotransducted into electrical impulses along auditory nerve fibers and further processed into the brain as neural signals. The audio circuitry 1108 also receives electrical signals converted by the microphone 1109 from sound waves. The audio circuitry 1108 converts the electrical signal to audio data and transmits the audio data to the peripherals interface 1105 for processing. Audio data may be retrieved and/or transmitted to memory 1102 and/or the RF circuitry 1106 by the peripherals interface 1105. In some embodiments the RF circuitry may produce ultra-high frequency waves that transmit to wireless headphones which then convert the electrical signals to human audible sound waves which are mechanotransducted into electrical impulses along auditory nerve fibers and further processed into the brain as neural signals.

In some embodiments, the graphical user interface hologram objects 460, 592, 660, 760, 860, 960, 1060, 1360, 1492, 1592 and other objects and representations of humans or objects interact with the user 120 through the laser projection system 1114 and camera 1113 take infrared tracking information feedback from the user 120 into the peripheral interface 1105 and CPU 1104 to combine the data with instructions in the CPU 1104 and memory 1102 that provide an iterative instruction for the graphical user interface which is displayed in the waveguide lens 240 or 210 after comparison with information in the memory from the database server 260. Both a first person and third person omniscient perspective mode are available due to the remote separation of the camera 1113 and laser projection system from the waveguide lens 490. The user 1550 may compare their movement 1590 from a third person omniscient perspective to the movements of a professional athlete 1560. The artificial intelligence algorithms on the network 250 and database server 260 provide real time analytical feedback to the user 230 on the biomechanical motion differences between the user 1550 and professional athlete 1590.

The device 1125 also includes a power supply 1117 and battery 1118 for powering the various components. The USB port 1125 may be used for providing power to the battery 1118 for storage of power.

Optical sensors 1116 are used in conjunction with the camera 1113 and laser projection system 1114 to capture images and movements by the user 120 and its environment 110 to capture images or video. If other users 220 are near the user 230, both users may couple to the device 270 utilizing the laser projection system 1114, RF circuitry 1106 and optical sensors 1116 to allow both users 220 and 230 or a plurality of users to view the same digital projection which then reduces the technological problem of asymmetric information or the “are you recording me” syndrome and assimilates the technology into more common social conventions and unwritten trust contracts.

The location sensor 1123 couples with the peripherals interface 1105 or input/output subsystem 1110 to disable the device if the device 1125 is placed in a pocket, purse or other dark area to prevent unnecessary power loss when the device 1125 is not being used.

The device 1125 may also utilize data from an accelerometer 1121 to assist in the detection of user motion in addition to the infrared laser light projection system to more efficiently process the location of the user 120 in relation to the device 120 and other objects 660 projected by the laser light projection system 1114 to the waveguide lens 670.

The software instructions stored in the memory 1102 may include an operating system (LINUX, OS X, WINDOWS, UNIX, or a proprietary operating system) of instructions of various graphical user interfaces 592, 660, 760, 860, 960, 1060 or other variations which include instructions for object hologram embodiments of a calendar 1201, photos 1212, camera 1212, videos 1209, maps 1211, weather 1202, credit cards 1215, banking 1215, crypto currency 1215, notes, clocks 1213, music 1206, application hosting servers 1220, settings 1220, physical fitness 1203, news 1216, video conferencing 1209, home security 1208, home lighting 1208, home watering systems 1208, home energy 1208 or temperature settings 1208, home cooking 1207, phone 1214, texting services, mail 1218, internet 1217, social networking 1219, blogs 1219, investments 1210, books, television 1209, movies 1209, device location, flashlights, music tuners 1206, airlines 1205, transportation 1205, identification 1219, translation, gaming 1221, real estate 1208, shopping, food 1207, commodities 1215, technology 1217, memberships, applications 1220, web applications 1217, audio media 1206, visual media 1209, mapping or GPS 1211, touch media 1217, general communication 1214, internet 1217, mail 1218, contacts 1219, cloud services 1220, games 1221, translation services 1223, virtual drive through with geofence location services for nearby restaurants to allow advance ordering of food and payment 1224, virtual shopping with custom measurements through infrared scans 1225, etc. . . . and facilitates communication between various hardware and software components. Artificial Intelligence algorithms on the network 150 and database server 160 provide iterative analytical feedback to the user 120. Software applications are not limited to the aforementioned embodiments. The operating system includes various software components and/or drivers for controlling and managing general system tasks such as but not limited to memory management, storage device control, power management, etc. . . . )

Examples of other applications in FIG. 12 that may be stored in memory 1102 include voice and word processing application, JAVA applications, HTML5 or subsequent web version language applications, encryption, digital rights management, voice recognition, human movement recognition, or human electromagnetic impulse recognition. In conjunction with images projected onto the planar waveguide lens 1030, the mobile CPU device 1125 and laser projection system and infrared tracking system 1114 may be used to manage the calendar 1201 or contacts 1214, including: adding name(s) to the calendar or address book; deleting names from the calendar and address contact list or book; associating names or contacts with phone numbers or emails or social networks or other networks; verifying identity from a network database; sorting names; distributing communication identity for voice, video or hologram communication, third person omniscient analysis 1560 and 1590 with network 150 and 130 database server 160 feedback using artificial intelligence to interact with the user 120.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, laser projection and infrared detection laser systems 1114 the graphical user interface may be used to communicate with other users through the hologram connection communication system 1214. Hologram communication may be recorded for delayed delivery or conducted live. The remote recording capability of the recording CPU computing device may allow the user 120 to transmit text like communication as holograms or in script text. The artificial intelligence of the CPU 140 and database 160 may be used to communicate in multiple languages to any user 120 on the network 150. Hologram communication may be used to speak a language such as English and have the receiving user hear the hologram speak in Chinese. The translation module 1223 compiles network neurons to provide phrase mapping across various literary styles of writing in various languages. Phrase mapping is used along with neural networks for translation services 1223. Cooking assisted lessons from famous chefs 190 are on the cooking application 1207 with the ability to provide feedback in cooking technique and recipe variation from artificial intelligence on the network 150 and database server 160.

In conjunction with laser projection and infrared detection laser systems 1114, optical sensors 1116, camera 1113, microphone 1109, the graphical user interface may be used to capture still images or video (including a video stream) or hologram representation and store them into memory 1102. The user 120 may modify characteristics of a still image or video or hologram or delete them. The user 120 may arrange, modify, manipulate, present, store of delete still images or videos or holograms. The user 120 may play back videos, hologram representations stored in memory 1102 or accessed through the network 150 and database server 160.

In conjunction with laser projection and infrared detection laser systems 1114, optical sensors 1116, camera 1113, microphone 1109, the graphical user interface may be used to browse the internet module 1217 with traditional still representations, video representation or holographic representation.

In conjunction with laser projection and infrared detection laser systems 1114, optical sensors 1116, camera 1113, microphone 1109, calendar module 1201, contact module 1219, email module 1218, the graphical user interface may be used to search for a plurality of widgets or modules. In some embodiments a widget or module may include an HTML5 (recent or future version of a Hypertext Markup Language), CSS (cascading style sheets) or JavaScript or any future set of instructions the CPU can process for the holographic representation of the module.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114 the graphical user interface may utilize the transportation module 1205 which provides mathematical algorithms to minimize cost and transportation time across a variety of transportation systems. One embodiment of the transportation module 1205 utilizes the hub and spoke model which is more efficient than the point to point model. The point to point model consists of 45 routes for a network of N nodes where N=10 destination points. The hub and spoke model in the transportation module 1205 utilizes N−1 routes to optimize on miles driven subject to the constraint of maximizing persons in each vehicle. The hub and spoke model in the transportation module 1205 utilizes only 9 routes to service all 45 possible point combinations in a system of N=10 destination nodes subject to the constraint of maximizing vehicle capacity.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may utilize the Shopping module 1225 which provides consumer good design creators the ability to display merchandise with three dimensional holograms. The three dimensional holograms have the ability to show the user 120 in both the first person and third person omniscient perspective where the graphical user interface shows the clothing on the user 120 by utilizing the laser projection and infrared detection laser systems 1114 to detect the current size and shape of the user to appropriately match and size consumer goods in the shopping module with the user 120.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may utilize the real estate module 1208 to buy or sell houses or rent properties on an exchange-based system. The user 120 may buy or sell capacity in a house on a temporary or permanent basis through the real estate module 1208. The graphical user interface utilizes the laser projection and infrared projection system 1114 to display three dimensional hologram renderings and property tours for rent or purchase.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may utilize the stock trading and commodity, currency and bond module 1210 to buy or sell securities on an exchange based system. The user 120 may tour the factory facilities of an investment with a hologram experience provided by the company whom is seeking investment or is publically or privately traded. The user 120 may participate in three dimensional hologram analyst calls or presentation with the management in real time. The infrared and laser detection system 1114 may record the eye movements and body language of company management to assess risky behavior or lying from the artificial intelligence database server 160 and network 150 to alert the user 120 of potential risk analysis.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may the weather module 1202 to see hologram renderings of rain, cloud formations, sunrise or sunsets, tornado warnings, hurricane warnings, flood watches, and other weather data relevant to the user 120. The weather module 1202 may synchronize with the user's 120 calendar 1201 to alert the user for activities that will correspond to the users 120 calendar 1201 to alert the user 120 of proper clothing to wear or to reschedule appointments or outside activities that are at odds with the then current forecast in the weather module 1202.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may be used for gaming and social media module 1221 to link everyday activity and transactions with helping people in developing areas of the world. Additional description of the module to link everyday transactions with helping people in developing areas of the world can be found in U.S. patent application Ser. No. 15/266,326, “Implementations of various methods to create economic incentives to directly link users of a social network or social network reality game to actual projects and people within a charity or developing world area,” filed Sep. 15, 2016, the content of which is hereby incorporated by reference in its entirety.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may be used for listening to music with the music module 1206 with a live band in the room. The holograms of band members and instruments may be interactive with the laser projection and infrared detection laser system 1114 to include the user 120 in the band as a singer or musician. Artificial intelligence feedback from the database server 160 and network 150 may provide the user with interactive feedback and dialogue with band members. The camera 1113 may also record renderings of the user 591 performing with the band for posting on social media or local or cloud based network platforms.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may be used to order food with the cooking and food module 1207 and 1225. The GPS receiver locates prepared and raw ingredient alternative shopping locations within a geofence near the user 1350 where the user 1350 sees three dimensional holograms rendering of the prepared or raw product. The artificial intelligence algorithms based on analysis from the user's 1350 blood markers and saliva markers provide mathematically optimized food intake based on the science of the user's 1350 specific body chemistry. Based on the user's 1350 selection of the three dimensional rendering of the food product 1390, the food product 1390 may be delivered to the user's 1350 place of work or residence or another alternative meeting point including but not limited to, the place at which the food was produced or prepared. The transaction for the food product 1390 is connected to the user's 1350 financial account information where the user 1350 stored the information in the memory 1102 or database server 160 to provide instant payment to the vendor or service provider.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may be used to order custom fit clothing 1460 or consumer goods 1490 based upon the measurements provided by the laser projection and infrared detection laser systems 1114. The three dimensional rendering of the clothing or consumer goods has the option to view with a model rendered by the merchant or from a third person omniscient perspective placing the clothing or consumer good on the user 1491 and 1490. Based on the user's 1450 selection of the three dimensional rendering of the clothing 1490 or consumer good 1460, the product may be delivered to the user's 1450 place of work or residence or another alternative meeting point including but not limited to the place at which the product was produced or prepared. The transaction for the product 1490 is connected to the user's 1450 financial account information where the user 1450 stored the information in the memory 1102 or database server 160 to provide instant payment to the vendor or service provider.

In conjunction with RF circuitry 1106, audio circuitry 1108, speakers 1107, microphone 1109, GPS receiver 1120, laser projection and infrared detection laser systems 1114, the graphical user interface may be used to perform analysis on the biomechanical movements of the user 1550 or 1590 or 1591 compared to the movements of a professional athlete 1560 or trained professional 1560 based upon the measurements of the user's 1590 movements provided by the laser projection and infrared detection laser systems 1114 and in contrast to the movements of the trained professional 1560. The change analysis between the two three dimensional holographic renderings are geared towards competitive training and instruction in any given field of athletics, music, work or other trained skill. The three dimensional rendering of the trained professional has the option to view stand alone or from a third person omniscient perspective placing the trained professional hologram on the user 1591 and 1590. Based on the user's 1550 movement of the three dimensional rendering of the trained professional 1560, an instructive video may be rendered for the user 1550 or for the user 1550 to post to social media or another cloud based network subject to copyright laws.

Claims

1. A method, comprising: receiving audio data acquired using one or more audio devices of a projection device coupled to a drone device, wherein the audio data corresponds to a physical environment proximate to a plurality of users, and wherein the drone device is configured to move within the physical environment while the one or more audio devices acquire the audio data;generating mapping data of the physical environment based on the received audio data; andgenerating an interactive environment for the plurality of users based on the mapping data, wherein the interactive environment comprises an augmented reality (AR) environment, a mixed reality (MR) environment, or a virtual reality (VR) environment.

2. The method of claim 1, wherein the one or more audio devices comprise one or more microphones.

3. The method of claim 1, wherein the interactive environment is associated with one or more applications.

4. The method of claim 1, wherein the projection device comprises a ball-shaped housing configured to include the one or more audio devices.

5. The method of claim 1, wherein generating the mapping data comprises transferring the mapping data to a map database.

6. The method of claim 1, wherein generating the interactive environment for the plurality of users comprises: accessing the mapping data from the map database; andgenerating the interactive environment for the plurality of users based on the accessed mapping data.

7. The method of claim 1, further comprising: generating image data based on the interactive environment, wherein the image data corresponds to one or more images associated with the interactive environment; andtransmitting the image data to the projection device, wherein the projection device is configured to transmit the image data to a plurality of viewing devices configured to project the interactive environment to the plurality of users based on the image data.

8. The method of claim 7, wherein the projection device is configured to transmit the image data to the plurality of viewing devices from a location that is substantially central to the plurality of users.

9. The method of claim 1, further comprising transmitting one or more commands to the drone device to move within the physical environment while the one or more audio devices acquire the audio data.

10. The method of claim 1, wherein the interactive environment is configured to allow one or more virtual interactions between a first user and a second user of the plurality of users.

11. The method of claim 10, wherein the one or more virtual interactions comprise: one or more visual communications between the first user and the second user in the AR environment, the MR environment, or the VR environment;one or more audio communications between the first user and the second user in the AR environment, the MR environment, or the VR environment; orcombinations thereof.

12. A projection device coupled to a drone device, wherein the projection device comprises: one or more audio devices;one or more processors; andat least one memory, comprising program instructions executable by the one or more processors to: receive audio data acquired using the one or more audio devices, wherein the audio data corresponds to a physical environment proximate to a plurality of users, and wherein the drone device is configured to move within the physical environment while the one or more audio devices acquire the audio data;generate mapping data of the physical environment based on the received audio data; andgenerate an interactive environment for the plurality of users based on the mapping data, wherein the interactive environment comprises an augmented reality (AR) environment, a mixed reality (MR) environment, or a virtual reality (VR) environment.

13. The projection device of claim 12, wherein the one or more audio devices comprise one or more microphones.

14. The projection device of claim 12, wherein the interactive environment is associated with one or more applications.

15. The projection device of claim 12, further comprising a ball-shaped housing configured to include the one or more audio devices, the one or more processors, and the at least one memory.

16. A non-transitory computer-readable medium having stored thereon a plurality of computer-executable instructions which, when executed by a computer, cause the computer to: receive audio data acquired using one or more audio devices of a projection device coupled to a drone device, wherein the audio data corresponds to a physical environment proximate to a plurality of users, and wherein the drone device is configured to move within the physical environment while the one or more audio devices acquire the audio data;generate mapping data of the physical environment based on the received audio data; andgenerate an interactive environment for the plurality of users based on the mapping data, wherein the interactive environment comprises an augmented reality (AR) environment, a mixed reality (MR) environment, or a virtual reality (VR) environment.

17. The non-transitory computer-readable medium of claim 16, wherein the plurality of computer-executable instructions which, when executed by a computer, cause the computer to generate the mapping data further comprise computer-executable instructions which, when executed by a computer, cause the computer to transfer the mapping data to a map database.

18. The non-transitory computer-readable medium of claim 16, wherein the plurality of computer-executable instructions which, when executed by a computer, cause the computer to generate the interactive environment for the plurality of users further comprise computer-executable instructions which, when executed by a computer, cause the computer to: access the mapping data from the map database; andgenerate the interactive environment for the plurality of users based on the accessed mapping data.

19. The non-transitory computer-readable medium of claim 16, wherein the plurality of computer-executable instructions which, when executed by a computer, further cause the computer to: generate image data based on the interactive environment, wherein the image data corresponds to one or more images associated with the interactive environment; andtransmit the image data to the projection device, wherein the projection device is configured to transmit the image data to a plurality of viewing devices configured to project the interactive environment to the plurality of users based on the image data.

20. The non-transitory computer-readable medium of claim 16, wherein the plurality of computer-executable instructions which, when executed by a computer, further cause the computer to transmit one or more commands to the drone device to move within the physical environment while the one or more audio devices acquire the audio data.