The advent of metaverse as a potential successor to the Internet will bring a number of changes. One foreseeable change is the way in which people interact with non-physical environments. Today, interactions with the Internet are limited to text and multimedia consumption (known as web2—read and write). This media is usually static in nature, such as webpages with multimedia (e.g., images, audio, and/or video). More dynamic interactions are either limited (e.g., forums, chat rooms, social media groups, and the like) or handled in a strictly-controlled environment (e.g., voice, video, and/or text chat and multiplayer games). Metaverse (also known as web3—read, write, own) will allow for more interactive environments (e.g., virtual rooms) that incorporate aspects of extended reality (“XR”), such as virtual reality (“VR”), augmented reality (“AR”), and mixed reality (“MR”).
As XR environments become more prevalent, universal gestures to perform common actions and communication gestures to interact with others will become more commonplace. In a public XR environment, if a user wants to have a private conversation (e.g., a conversation with the user's spouse or confidential work-related conversation), the user risks others eavesdropping on their private conversation or otherwise risks interruptions that might be malicious.
Concepts and technologies are disclosed that are directed to the creation of dynamic language for XR. According to one aspect disclosed herein, a user device can set up a private metaverse. The user device can invite, based upon an input provided by a user, at least one member to join a private group that includes the user. The user device can create a dynamic language for use by the private group while the private group is within the private metaverse.
In some embodiments, the private metaverse includes one or more XR environments. The XR environment(s) can be virtual reality environments, augmented reality environments, or mixed reality environments. Moreover, the private metaverse can operate within a public metaverse.
In some embodiments, the user device can set up the private metaverse at least in part by hosting the private metaverse on the user device. In other embodiments, the user device can set up the private metaverse by communicating with a private metaverse server computer to host the private metaverse.
In some embodiments, the dynamic language includes one or more verbal sounds, one or more utterances, one or more gestures, one or more movements, or a combination thereof. In some embodiments, the dynamic language includes a language component known only to the private group (e.g., a language known only to the members of the private group).
In some embodiments, the user device can create the dynamic language solely based upon a further input from the user. In other embodiments, the user device can create the dynamic language based upon a further input from the user and additional input from the at least one member. The additional input can be based upon a privilege established for the at least one member.
It should be appreciated that the above-described subject matter may be implemented as a computer-controlled apparatus, a computer process, a computing system, or as an article of manufacture such as a computer-readable storage medium. These and various other features will be apparent from a reading of the following Detailed Description and a review of the associated drawings.
This Summary is provided to introduce a selection of concepts in a simplified form that are further described below in the Detailed Description. This Summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended that this Summary be used to limit the scope of the claimed subject matter. Furthermore, the claimed subject matter is not limited to implementations that solve any or all disadvantages noted in any part of this disclosure.
While the subject matter described herein may be presented, at times, in the general context of program modules that execute in conjunction with the execution of an operating system and application programs on a computer system, those skilled in the art will recognize that other implementations may be performed in combination with other types of program modules. Generally, program modules include routines, programs, components, data structures, computer-executable instructions, and/or other types of structures that perform particular tasks or implement particular abstract data types. Moreover, those skilled in the art will appreciate that the subject matter described herein may be practiced with other computer system, including hand-held devices, mobile devices, wireless devices, multiprocessor systems, distributed computing systems, microprocessor-based or programmable consumer electronics, minicomputers, mainframe computers, routers, switches, other computing devices described herein, and the like.
Referring now to
The public metaverse server computer(s) 102 can execute, via one or more processors (best shown in
The private metaverse server computer(s) 104 can execute, via one or more processors (best shown in
The public metaverse server computer 102, the private metaverse server computer 104, and the user devices 112 can communicate via one or more networks 122 (referred to herein collectively as “networks 122” or individually as “network 122”). An example of the network 122 will be described herein with reference to
An XR service can be a virtual reality (“VR”) service, an augmented reality (“AR”) service, a mixed reality service, or any combination thereof. VR, AR, and mixed reality services will now be described. These descriptions should not be interpreted as limiting in any way.
VR is used herein to describe a concept that provides a computer-generated environment (also referred to as a “virtual environment”) that the users 110 can explore via the user devices 112. A virtual environment can be the public metaverse 114, the private metaverse 120, or a portion thereof. A virtual environment can include a gathering of many individual objects that represent small parts of the overall environment. A virtual environment may be a single room, a house, a city, a world, or any other virtualization of a real-world environment. The virtual environment may be a completely imaginary environment that does not have a real-world analog. The virtual environment may be a combination of real-world and imaginary environments. A virtual object can represent any real-world object, such as furniture, individual avatars (i.e., representations of real-world users), animals (e.g., virtual pets and wildlife), vehicles, electronics, and the like. Each virtual object may belong to a virtual environment. A virtual object may be something that was created as part of the virtual environment. Alternatively, a virtual object may be something that was added at a later point by either the environment owner or another user.
A VR environment can be generated by any software framework designed for the creation and development of graphics. Some example software frameworks include, but are not limited to, UNREAL ENGINE (available from EPIC GAMES), UNITY (available from UNITY TECHNOLOGIES), CRYENGINE (available from CRYTEK), HAVOK VISION ENGINE (available from HAVOK), and open source software frameworks. In some embodiments, the software frameworks utilize graphics assets, such as textures, that include or are derived from photographs of the real-world environment that is to be virtualized. Those skilled in the art will appreciate the wide range of graphical fidelity, visual styles, and other attributes a particular VR environment may have, and as such, further details in this regard are not provided herein.
AR is used herein to describe a concept in which at least a portion of a physical, real-world environment is augmented to include computer-generated data. AR can be used in the public metaverse 114, the private metaverse 120, or a portion thereof. The computer-generated data can include virtual objects that are presented over and/or spatially integrated with real-world objects of the physical, real-world environment. The virtual objects can include text, colors, patterns, gradients, graphics, other images, videos, animations, combinations thereof, and the like. Computer-generated data that augments in some manner a view of a physical, real-world environment and/or elements thereof is referred to herein generally as an “augmentation.”
The AR service can provide a live view of a physical, real-world environment. In these embodiments, the AR service may utilize a camera component (best shown in
Mixed reality is used herein to describe a concept in which elements of VR and elements of AR are used together. A mixed reality environment can be the public metaverse 114, the private metaverse 120, or a portion thereof. The term “XR” is specifically used herein to refer to VR-only, AR-only, or mixed reality.
The illustrated user devices 112 can be or can include one or more mobile telephones, smartphones, tablet computers, slate computers, smart watches, fitness devices, smart glasses (e.g., the GOOGLE GLASS family of products), a dedicated AR device, a dedicated VR device, a dedicated mixed reality device, a wearable device, mobile media playback devices, laptop computers, notebook computers, ultrabook computers, netbook computers, computers of other form factors, computing devices of other form factors, other computing systems, other computing devices, and/or the like. It should be understood that the functionality of the user devices 112 can be provided by a single device, by two or more similar devices, and/or by two or more dissimilar devices. For purposes of describing the concepts and technologies disclosed herein, the user device 112 is described herein as a smartphone. It should be understood that this embodiment is illustrative, and should not be construed as being limiting in any way.
In the illustrated example, a first user device 112A′ operating in the private metaverse 120 includes a dynamic language device application 124 (also referred to as “dynamic language device app 124”), an XR app 126, and an XR component 128. The other user devices 112A-112N/112A′-112N′ can be configured the same as or similar to the first user device 112A′. It should be understood, however, that the user devices 112 can include other components. Illustrative example architectures of the user devices 112 are described in greater detail herein with reference to
The dynamic language device app 124 can be executed by one or more processors (best shown in
The dynamic language device app 124 can be a client-side application that communicates, via the network(s) 122, with a dynamic language server application 130 executing on the private metaverse server computer 104 to enable the dynamic language created by the private group to be stored within a private metaverse language library 132 that is associated, particularly, with the private group of users 110A′-110C′ within the private metaverse 120. The private metaverse server computer 104 can store multiple languages tied to the private group (e.g., across multiple private metaverses 120) or the private metaverse 120. The users 110A′-110C′ within the private group can access the private metaverse language library 132 from any device, including the user devices 112 and other devices (not shown). Moreover, a copy of the private metaverse language library 132 may be stored locally on the user device 112 if storage capacity permits. In some embodiments, the dynamic language server application 130 can implement machine learning and artificial intelligence technologies to build upon the dynamic language initially created by the private group.
The dynamic language can include sounds, utterances, gestures/movements (e.g., expressions made using the hands, face, other body parts, or a combination thereof), and the like. The dynamic language can include components known only to the members of the private group. The dynamic language therefore can be a code language shared among the members of the private group. In some embodiments, the dynamic language is created by one member (e.g., the originator of the group). In other embodiments, the dynamic language is created by multiple members, which may or may not include the originator of the group. Whether or not a particular member is allowed to contribute to the dynamic language can be based upon privileges established for members of the private group. For example, a private group that includes only friends may have equal privileges for all members, whereas a private group associated with a business may allow contributions only from managers or other authority figures. The authority figure may allow contributions from other members upon his/her expressed permission. The hierarchy of members within the private group and associated privileges can be provided as part of the dynamic language or as a separate data file. Additional details about the creation of the dynamic language will be described below with reference to
The XR app 126 can be executed by one or more processors (best shown in
The XR app 126 can utilize the XR component 128 to allow the user 110 to enter the private metaverse XR environment(s) 108 within the private metaverse 120. The XR app 126 can also utilize the XR component 128 to enter the public metaverse XR environments 108 within the public metaverse 114. The illustrated embodiment of the XR component 128 represents the XR component 128 as an internal component of the user device 112. It should be understood that the XR component 128 alternatively may be an external component that is in communication with the user device 112 via a wired or wireless connection. The XR component 128, in some embodiments, is or includes a camera (e.g., a still camera and/or video camera), a sensor (e.g., an accelerometer, a global positioning system sensor, a solid state compass, or the like), a display (e.g., an integrated display, a head-mounted display, an eyeglasses display, a head-up display, an external monitor, a projection system, or a holographic display), an input device, or the like. The XR component 128, in other embodiments, is or includes a display (e.g., an integrated display, a head-mounted display, an eyeglasses display, a head-up display, an external monitor, a projection system, or a holographic display), an input device, a combination thereof, or the like. In some embodiments, the XR component 128 is META QUEST (available from META), PLAYSTATION VR or PLAYSATION VR 2 (available from SONY), HTC VIVE (available from HTC and VALVE), MICROSOFT HOLOLENS (available from MICROSOFT), or the like. The XR app 126 can provide an interface, using the XR component 128, through which the user 110 can interact with the private metaverse XR environments 118 provided, at least in part, by the private metaverse server computer 104. The XR app 126 also can provide an interface, using the XR component 128, through which the user 110 can interact with the public metaverse XR environments 108 provided, at least in part, by the public metaverse server computer 102.
Turning now to
It also should be understood that the method disclosed herein can be ended at any time and need not be performed in their respective entireties. Some or all operations of the method, and/or substantially equivalent operations, can be performed by execution of computer-readable instructions included on a computer storage media, as defined herein. The term “computer-readable instructions,” and variants thereof, as used herein, is used expansively to include routines, applications, application modules, program modules, programs, components, data structures, algorithms, and the like. Computer-readable instructions can be implemented on various system configurations including the public metaverse server computer 102, the private metaverse server computer 104, the user devices 110, single-processor or multiprocessor systems, minicomputers, mainframe computers, personal computers, hand-held computing devices, microprocessor-based, programmable consumer electronics, combinations thereof, and the like.
Thus, it should be appreciated that the logical operations described herein are implemented (1) as a sequence of computer implemented acts or program modules running on a computing system and/or (2) as interconnected machine logic circuits or circuit modules within the computing system. The implementation is a matter of choice dependent on the performance and other requirements of the computing system. Accordingly, the logical operations described herein are referred to variously as states, operations, structural devices, acts, or modules. These states, operations, structural devices, acts, and modules may be implemented in software, in firmware, in special purpose digital logic, and any combination thereof. As used herein, the phrase “cause a processor to perform operations” and variants thereof refers to causing a processor of a computing system or device, such as the public metaverse server computer 102, the private metaverse server computer 104, or the user devices 110 to perform one or more operations and/or causing the processor to direct other components of the computing system or device to perform one or more of the operations.
For purposes of illustrating and describing some of the concepts of the present disclosure, the methods disclosed herein are described as being performed, at least in part, by the public metaverse server computer 102, the private metaverse server computer 104, the user devices 110, or some combination thereof, via execution of one or more software modules and/or software applications. It should be understood that additional and/or alternative devices and/or network nodes can provide the functionality described herein via execution of one or more modules, applications, and/or other software. Thus, the illustrated embodiments are illustrative, and should not be viewed as being limiting in any way.
The method 200 will be described from the perspective of the user device 112A′ under control of the user 110A′. The operations of the method 200 are equally applicable to other user devices 112 and other users 110 described herein.
The method 200 begins and proceeds to operation 202. At operation 202, the XR app 126, executed by one or more processors of the user device 112A′ sets up the private metaverse 120 via communications with the private metaverse server computer 104. The private metaverse 120 can include one or more of the private metaverse XR environments 118. As such, the private metaverse 120 can include one or more VR, AR, or mixed reality environments. Although the operation 202 is described as the private metaverse XR environment(s) 118 being hosted on the private metaverse server computer 104, it is contemplated that the user device 112A′ alternatively may host the private metaverse XR environment(s) 118 locally.
From operation 202, the method 200 proceeds to operation 204. At operation 204, the user device 112A′, based upon input from the user 110A′, invites one or more of the others users 110 to the private metaverse 120. In some embodiments, the XR app 126 can include an invite function to invite the other users 110 to the private metaverse 120. The invite function can be part of a friends list associated with the user 110A′. The user 110A′ may add other users 110 who are not part of the friends list via an email address, alias, username, or other unique user identifier. In the illustrated example, the user 110A′ provides input to the user device 112A′ to invite the user 110B′ and 110C′. As such, a private group of the users 110A′, 110B′, 110C′ can be established upon the users 110B′, 110C′ acceptance of the invites. From operation 204, the method 200 proceeds to operation 206.
At operation 206, the user device 112A′, via execution of the dynamic language device application 124, creates a dynamic language for use by the users 110A′, 110B′, 110C′ included in the private group while the private group is within the private metaverse 120. The dynamic language can include verbal sounds, utterances, gestures/movements (e.g., expressions made using the hands, face, other body parts, or a combination thereof), and the like. The dynamic language can include components known only to the members of the private group. The dynamic language therefore can be a code language shared among the members of the private group. In some embodiments, the dynamic language is created by one member (e.g., the originator of the group such as the user 110A′ in the method 200) and shared with the private group (including the meaning of each language component). In other embodiments, the dynamic language is created by multiple members, which may or may not include the originator of the group. Whether or not a particular member is allowed to contribute to the dynamic language can be based upon privileges established for members of the private group. For example, a private group that includes only friends may have equal privileges for all members, whereas a private group associated with a business may allow contributions only from managers or other authority figures. The authority figure may allow contributions from other members upon his/her expressed permission. The hierarchy of members within the private group and associated privileges can be provided as part of the dynamic language or as a separate data file.
In some embodiments, creation of the dynamic language is based upon a language template, which can provide a guide for the user 110A′, and possibly the other users 110B′, 110C′ via dynamic language device apps 124 executing on their respective user devices 112B′, 112C′, to create the dynamic language. The language template can be pre-populated with placeholders for basic communications such as greetings, goodbyes, compliments, and/or the like. The language template can be generic or customized for one or more of the users 110A′, 110B′, 110C′ or the private group. The dynamic language can be based, at least in part, upon the dynamic language stored in the private metaverse language library 132 associated with any or certain of the users 110A′, 110B′, 110C′. In some embodiments, the private group has been previously established within another private metaverse 120, and as such, may already have an associated dynamic language, which can be downloaded from the private metaverse language library 132 or access locally on one or more of the user devices 112A′, 112B′, 112C′. In some embodiments, the dynamic language can follow the private group such that the private group can use the dynamic language when meeting in other private metaverses 120.
Also at operation 206, the dynamic language device app 124 and/or the dynamic language server application 130 can utilize machine learning and/or artificial intelligence to further develop the dynamic language. This may occur during the private group's session within the private metaverse 120 and/or after the session. An example machine learning system that can be used to implement this functionality is illustrated and described herein with reference to
At operation 208, the private metaverse 120 session concludes. The user device 112A′ and the private metaverse server computer 104 can coordinate to tear down the private metaverse XR environment(s) 118. The other user devices 112B′, 112C′ can, via respective XR apps 126, log out and leave the private metaverse 120. In some embodiments, the dynamic language at the end of the private metaverse 120 session can be uploaded to the private metaverse server computer 104 and stored in the private metaverse language library 132. The dynamic language can additionally or alternatively be stored on one or more of the user devices 112A′, 112B′, 112C′.
From operation 208, the method 200 proceeds to operation 210. The method 200 can end at operation 210.
Turning now to
The computer system 300 includes a processing unit 302, a memory 304, one or more user interface devices 306, one or more input/output (“I/O”) devices 308, and one or more network devices 310, each of which is operatively connected to a system bus 312. The bus 312 enables bi-directional communication between the processing unit 302, the memory 304, the user interface devices 306, the I/O devices 308, and the network devices 310.
The processing unit 302 may be a standard central processor that performs arithmetic and logical operations, a more specific purpose programmable logic controller (“PLC”), a programmable gate array, a system-on-a-chip, or other type of processor known to those skilled in the art and suitable for controlling the operation of the server computer. Processing units are generally known, and therefore are not described in further detail herein.
The memory 304 communicates with the processing unit 302 via the system bus 312. In some embodiments, the memory 304 is operatively connected to a memory controller (not shown) that enables communication with the processing unit 302 via the system bus 312. The memory 304 includes an operating system 314 and one or more program modules 316. The operating system 314 can include, but is not limited to, members of the WINDOWS family of operating systems from MICROSOFT CORPORATION, the LINUX family of operating systems, the MAC OSX and/or iOS families of operating systems from APPLE CORPORATION, other operating systems, and the like.
The program modules 316 may include various software and/or program modules to perform the various operations described herein. The program modules 316 for the computer system 300 embodied as the public metaverse server computer 102 can include the public metaverse server application 106. The program modules 316 for the computer system 300 embodied as the private metaverse server computer 104 can include the private metaverse server applications 116. The program modules 316 for the computer system 300 embodied as the user device 112 can include the dynamic language device app 124 and the XR app 126. The program modules 316 and/or other programs can be embodied in computer-readable media containing instructions that, when executed by the processing unit 302, perform one or more operations, such as the operations described herein above with reference to the method 200 illustrated in
By way of example, and not limitation, computer-readable media may include any available computer storage media or communication media that can be accessed by the computer system 300. Communication media includes computer-readable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics changed or set in a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared and other wireless media. Combinations of the any of the above should also be included within the scope of computer-readable media.
Computer storage media includes volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data. Computer storage media includes, but is not limited to, RAM, ROM, Erasable Programmable ROM (“EPROM”), Electrically Erasable Programmable ROM (“EEPROM”), flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the computer system 300. In the claims, the phrase “computer storage medium,” “computer-readable storage medium,” and variations thereof does not include waves or signals per se and/or communication media, and therefore should be construed as being directed to “non-transitory” media only.
The user interface devices 306 may include one or more devices with which a user accesses the computer system 300. The user interface devices 306 may include, but are not limited to, computers, servers, personal digital assistants, cellular phones, or any suitable computing devices. The I/O devices 308 enable a user to interface with the program modules 316. In one embodiment, the I/O devices 308 are operatively connected to an I/O controller (not shown) that enables communication with the processing unit 302 via the system bus 312. The I/O devices 308 may include one or more input devices, such as, but not limited to, a keyboard, a mouse, or an electronic stylus. Further, the I/O devices 308 may include one or more output devices, such as, but not limited to, a display screen or a printer.
The network devices 310 enable the computer system 300 to communicate with other networks or remote systems via a network 318, such as the network(s) 122/400 (best shown in
Turning now to
A mobile communications device 408, such as, for example, the user device 112, a cellular telephone, a user equipment, a mobile terminal, a PDA, a laptop computer, a handheld computer, and combinations thereof, can be operatively connected to the cellular network 402. The cellular network 402 can be configured as a 2G Global System for Mobile communications (“GSM”) network and can provide data communications via General Packet Radio Service (“GPRS”) and/or Enhanced Data rates for GSM Evolution (“EDGE”). Additionally, or alternatively, the cellular network 402 can be configured as a 3G Universal Mobile Telecommunications System (“UMTS”) network and can provide data communications via the High-Speed Packet Access (“HSPA”) protocol family, for example, High-Speed Downlink Packet Access (“HSDPA”), Enhanced UpLink (“EUL”) (also referred to as High-Speed Uplink Packet Access (“HSUPA”)), and HSPA+. The cellular network 402 also is compatible with 4G mobile communications standards such as Long-Term Evolution (“LTE”), or the like, as well as evolved and future mobile standards.
The packet data network 404 includes various devices, for example, servers (e.g., the public metaverse server computer 102 and the private metaverse server computer 104), computers, databases, and other devices in communication with another, as is generally known. The packet data network 404 devices are accessible via one or more network links. The servers often store various files that are provided to a requesting device such as, for example, a computer, a terminal, a smartphone, or the like. Typically, the requesting device includes software (a “browser”) for executing a web page in a format readable by the browser or other software. Other files and/or data may be accessible via “links” in the retrieved files, as is generally known. In some embodiments, the packet data network 404 includes or is in communication with the Internet. The circuit switched network 406 includes various hardware and software for providing circuit switched communications. The circuit switched network 406 may include, or may be, what is often referred to as a plain old telephone system (“POTS”). The functionality of a circuit switched network 406 or other circuit-switched network are generally known and will not be described herein in detail.
The illustrated cellular network 402 is shown in communication with the packet data network 404 and a circuit switched network 406, though it should be appreciated that this is not necessarily the case. One or more Internet-capable devices 410, for example, the user device 112, a PC, a laptop, a portable device, or another suitable device, can communicate with one or more cellular networks 402, and devices connected thereto, through the packet data network 404. It also should be appreciated that the Internet-capable device 410 can communicate with the packet data network 404 through the circuit switched network 406, the cellular network 402, and/or via other networks (not illustrated).
As illustrated, a communications device 412, for example, a telephone, facsimile machine, modem, computer, or the like, can be in communication with the circuit switched network 406, and therethrough to the packet data network 404 and/or the cellular network 402. It should be appreciated that the communications device 412 can be an Internet-capable device, and can be substantially similar to the Internet-capable device 410. In the specification, the network 400 is used to refer broadly to any combination of the networks 402, 404, 406. It should be appreciated that substantially all of the functionality described with reference to the network 400 can be performed by the cellular network 402, the packet data network 404, and/or the circuit switched network 406, alone or in combination with other networks, network elements, and the like.
Turning now to
As illustrated in
The UI application can interface with the operating system 508 to facilitate user interaction with functionality and/or data stored at the mobile device 500 and/or stored elsewhere. In some embodiments, the operating system 508 can include a member of the IOS family of operating systems from APPLE INC., a member of the ANDROID OS family of operating systems from GOOGLE INC., and/or other operating systems. These operating systems are merely illustrative of some contemplated operating systems that may be used in accordance with various embodiments of the concepts and technologies described herein and therefore should not be construed as being limiting in any way.
The UI application can be executed by the processor 504 to aid a user in entering content, viewing account information, answering/initiating calls, entering/deleting data, entering and setting user IDs and passwords for device access, configuring settings, manipulating address book content and/or settings, multimode interaction, interacting with other applications 510, and otherwise facilitating user interaction with the operating system 508, the applications 510, and/or other types or instances of data 512 that can be stored at the mobile device 500.
According to various embodiments, the applications 510 can include, for example, presence applications, visual voice mail applications, messaging applications, text-to-speech and speech-to-text applications, add-ons, plug-ins, email applications, music applications, video applications, camera applications, location-based service applications, power conservation applications, game applications, productivity applications, entertainment applications, enterprise applications, combinations thereof, and the like. The applications 510, the data 512, and/or portions thereof can be stored in the memory 506 and/or in a firmware 514, and can be executed by the processor 504. The firmware 514 also can store code for execution during device power up and power down operations. It can be appreciated that the firmware 514 can be stored in a volatile or non-volatile data storage device including, but not limited to, the memory 506 and/or a portion thereof.
The mobile device 500 also can include an input/output (“I/O”) interface 516. The I/O interface 516 can be configured to support the input/output of data such as location information, user information, organization information, presence status information, user IDs, passwords, and application initiation (start-up) requests. In some embodiments, the I/O interface 516 can include a hardwire connection such as USB port, a mini-USB port, a micro-USB port, an audio jack, a PS2 port, an IEEE 1394 (“FIREWIRE”) port, a serial port, a parallel port, an Ethernet (RJ45) port, an RJ11 port, a proprietary port, combinations thereof, or the like. In some embodiments, the mobile device 500 can be configured to synchronize with another device to transfer content to and/or from the mobile device 500. In some embodiments, the mobile device 500 can be configured to receive updates to one or more of the applications 510 via the I/O interface 516, though this is not necessarily the case. In some embodiments, the I/O interface 516 accepts I/O devices such as keyboards, keypads, mice, interface tethers, printers, plotters, external storage, touch/multi-touch screens, touch pads, trackballs, joysticks, microphones, remote control devices, displays, projectors, medical equipment (e.g., stethoscopes, heart monitors, and other health metric monitors), modems, routers, external power sources, docking stations, the XR component 138, combinations thereof, and the like. It should be appreciated that the I/O interface 516 may be used for communications between the mobile device 500 and a network device or local device.
The mobile device 500 also can include a communications component 515. The communications component 518 can be configured to interface with the processor 504 to facilitate wired and/or wireless communications with one or more networks described above herein. In some embodiments, other networks include networks that utilize non-cellular wireless technologies such as WI-FI or WIMAX. In some embodiments, the communications component 518 includes a multimode communications subsystem for facilitating communications via the cellular network and one or more other networks.
The communications component 518, in some embodiments, includes one or more transceivers. The one or more transceivers, if included, can be configured to communicate over the same and/or different wireless technology standards with respect to one another. For example, in some embodiments one or more of the transceivers of the communications component 518 may be configured to communicate using GSM, CDMA, CDMAONE, CDMA2000, LTE, and various other 2G, 2.5G, 3G, 4G, 5G, and greater generation technology standards. Moreover, the communications component 518 may facilitate communications over various channel access methods (which may or may not be used by the aforementioned standards) including, but not limited to, TDMA, FDMA, W-CDMA, OFDM, SDMA, and the like.
In addition, the communications component 518 may facilitate data communications using GPRS, EDGE, the HSPA protocol family, including HSDPA, EUL, or otherwise termed HSUPA, HSPA+, and various other current and future wireless data access standards. In the illustrated embodiment, the communications component 518 can include a first transceiver (“TxRx”) 520A that can operate in a first communications mode (e.g., GSM). The communications component 518 also can include an Nth transceiver (“TxRx”) 520N that can operate in a second communications mode relative to the first transceiver 520A (e.g., UMTS). While two transceivers 520A-520N (hereinafter collectively and/or generically referred to as “transceivers 520”) are shown in
The communications component 518 also can include an alternative transceiver (“Alt TxRx”) 522 for supporting other types and/or standards of communications. According to various contemplated embodiments, the alternative transceiver 522 can communicate using various communications technologies such as, for example, WI-FI, WIMAX, BLUETOOTH, infrared, infrared data association (“IRDA”), near-field communications (“NFC”), other radio frequency (“RF”) technologies, combinations thereof, and the like.
In some embodiments, the communications component 518 also can facilitate reception from terrestrial radio networks, digital satellite radio networks, internet-based radio service networks, combinations thereof, and the like. The communications component 518 can process data from a network such as the Internet, an intranet, a broadband network, a WI-FI hotspot, an Internet service provider (“ISP”), a digital subscriber line (“DSL”) provider, a broadband provider, combinations thereof, or the like.
The mobile device 500 also can include one or more sensors 524. The sensors 524 can include temperature sensors, light sensors, air quality sensors, movement sensors, orientation sensors, noise sensors, proximity sensors, or the like. As such, it should be understood that the sensors 524 can include, but are not limited to, accelerometers, magnetometers, gyroscopes, infrared sensors, noise sensors, microphones, combinations thereof, or the like. Additionally, audio capabilities for the mobile device 500 may be provided by an audio I/O component 526. The audio I/O component 526 of the mobile device 500 can include one or more speakers for the output of audio signals, one or more microphones for the collection and/or input of audio signals, and/or other audio input and/or output devices.
The illustrated mobile device 500 also can include a subscriber identity module (“SIM”) system 528. The SIM system 528 can include a universal SIM (“USIM”), a universal integrated circuit card (“UICC”) and/or other identity devices. The SIM system 528 can include and/or can be connected to or inserted into an interface such as a slot interface 530. In some embodiments, the slot interface 530 can be configured to accept insertion of other identity cards or modules for accessing various types of networks. Additionally, or alternatively, the slot interface 530 can be configured to accept multiple subscriber identity cards. Because other devices and/or modules for identifying users and/or the mobile device 500 are contemplated, it should be understood that these embodiments are illustrative, and should not be construed as being limiting in any way.
The mobile device 500 also can include an image capture and processing system 532 (“image system”). The image system 532 can be configured to capture or otherwise obtain photos, videos, and/or other visual information. As such, the image system 532 can include cameras, lenses, charge-coupled devices (“CCDs”), combinations thereof, or the like. The mobile device 500 may also include a video system 534. The video system 534 can be configured to capture, process, record, modify, and/or store video content. Photos and videos obtained using the image system 532 and the video system 534, respectively, may be added as message content to a multimedia message service (“MMS”) message, email message, and sent to another mobile device. The video and/or photo content also can be shared with other devices via various types of data transfers via wired and/or wireless communication devices as described herein.
The mobile device 500 also can include one or more location components 536. The location components 536 can be configured to send and/or receive signals to determine a geographic location of the mobile device 500. According to various embodiments, the location components 536 can send and/or receive signals from GPS devices, A-GPS devices, WI-FI/WIMAX and/or cellular network triangulation data, combinations thereof, and the like. The location component 536 also can be configured to communicate with the communications component 518 to retrieve triangulation data for determining a location of the mobile device 500. In some embodiments, the location component 536 can interface with cellular network nodes, telephone lines, satellites, location transmitters and/or beacons, wireless network transmitters and receivers, combinations thereof, and the like. In some embodiments, the location component 536 can include and/or can communicate with one or more of the sensors 524 such as a compass, an accelerometer, and/or a gyroscope to determine the orientation of the mobile device 500. Using the location component 536, the mobile device 500 can generate and/or receive data to identify its geographic location, or to transmit data used by other devices to determine the location of the mobile device 500. The location component 536 may include multiple components for determining the location and/or orientation of the mobile device 500.
The illustrated mobile device 500 also can include a power source 538. The power source 538 can include one or more batteries, power supplies, power cells, and/or other power subsystems including alternating current (“AC”) and/or direct current (“DC”) power devices. The power source 538 also can interface with an external power system or charging equipment via a power I/O component 540. Because the mobile device 500 can include additional and/or alternative components, the above embodiment should be understood as being illustrative of one possible operating environment for various embodiments of the concepts and technologies described herein. The described embodiment of the mobile device 500 is illustrative, and should not be construed as being limiting in any way.
As used herein, communication media includes computer-executable instructions, data structures, program modules, or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any delivery media. The term “modulated data signal” means a signal that has one or more of its characteristics changed or set in a manner as to encode information in the signal. By way of example, and not limitation, communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, RF, infrared, UV, and other wireless media. Combinations of any of the above should also be included within the scope of computer-readable media.
By way of example, and not limitation, computer storage media may include volatile and non-volatile, removable and non-removable media implemented in any method or technology for storage of information such as computer-executable instructions, data structures, program modules, or other data. For example, computer media includes, but is not limited to, RAM, ROM, EPROM, EEPROM, flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), HD-DVD, BLU-RAY, or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information and which can be accessed by the mobile device 500 or other devices or computers described herein, such as the computer system 300 described above with reference to
Encoding the software modules presented herein also may transform the physical structure of the computer-readable media presented herein. The specific transformation of physical structure may depend on various factors, in different implementations of this description. Examples of such factors may include, but are not limited to, the technology used to implement the computer-readable media, whether the computer-readable media is characterized as primary or secondary storage, and the like. For example, if the computer-readable media is implemented as semiconductor-based memory, the software disclosed herein may be encoded on the computer-readable media by transforming the physical state of the semiconductor memory. For example, the software may transform the state of transistors, capacitors, or other discrete circuit elements constituting the semiconductor memory. The software also may transform the physical state of such components in order to store data thereupon.
As another example, the computer-readable media disclosed herein may be implemented using magnetic or optical technology. In such implementations, the software presented herein may transform the physical state of magnetic or optical media, when the software is encoded therein. These transformations may include altering the magnetic characteristics of particular locations within given magnetic media. These transformations also may include altering the physical features or characteristics of particular locations within given optical media, to change the optical characteristics of those locations. Other transformations of physical media are possible without departing from the scope and spirit of the present description, with the foregoing examples provided only to facilitate this discussion.
In light of the above, it should be appreciated that many types of physical transformations may take place in the mobile device 500 in order to store and execute the software components presented herein. It is also contemplated that the mobile device 500 may not include all of the components shown in
Turning now to
The hardware resource layer 602 provides hardware resources, which, in the illustrated embodiment, include one or more compute resources 610, one or more memory resources 612, and one or more other resources 614. The compute resource(s) 610 can include one or more hardware components that perform computations to process data, and/or to execute computer-executable instructions of one or more application programs, operating systems, and/or other software. The compute resources 610 can include one or more central processing units (“CPUs”) configured with one or more processing cores. The compute resources 610 can include one or more graphics processing unit (“GPU”) configured to accelerate operations performed by one or more CPUs, and/or to perform computations to process data, and/or to execute computer-executable instructions of one or more application programs, operating systems, and/or other software that may or may not include instructions particular to graphics computations. In some embodiments, the compute resources 610 can include one or more discrete GPUs. In some other embodiments, the compute resources 610 can include CPU and GPU components that are configured in accordance with a co-processing CPU/GPU computing model, wherein the sequential part of an application executes on the CPU and the computationally-intensive part is accelerated by the GPU. The compute resources 610 can include one or more system-on-chip (“SoC”) components along with one or more other components, including, for example, one or more of the memory resources 612, and/or one or more of the other resources 614. In some embodiments, the compute resources 610 can be or can include one or more SNAPDRAGON SoCs, available from QUALCOMM; one or more TEGRA SoCs, available from NVIDIA; one or more HUMMINGBIRD SoCs, available from SAMSUNG; one or more Open Multimedia Application Platform (“OMAP”) SoCs, available from TEXAS INSTRUMENTS; one or more customized versions of any of the above SoCs; and/or one or more proprietary SoCs. The compute resources 610 can be or can include one or more hardware components architected in accordance with an advanced reduced instruction set computing (“RISC”) machine (“ARM”) architecture, available for license from ARM HOLDINGS. Alternatively, the compute resources 610 can be or can include one or more hardware components architected in accordance with an x86 architecture, such an architecture available from INTEL CORPORATION of Mountain View, California, and others. Those skilled in the art will appreciate the implementation of the compute resources 610 can utilize various computation architectures, and as such, the compute resources 610 should not be construed as being limited to any particular computation architecture or combination of computation architectures, including those explicitly disclosed herein.
The memory resource(s) 612 can include one or more hardware components that perform storage operations, including temporary or permanent storage operations. In some embodiments, the memory resource(s) 612 include volatile and/or non-volatile memory implemented in any method or technology for storage of information such as computer-readable instructions, data structures, program modules, or other data disclosed herein.
Computer storage media includes, but is not limited to, random access memory (“RAM”), read-only memory (“ROM”), Erasable Programmable ROM (“EPROM”), Electrically Erasable Programmable ROM (“EEPROM”), flash memory or other solid state memory technology, CD-ROM, digital versatile disks (“DVD”), or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store data and which can be accessed by the compute resources 610.
The other resource(s) 614 can include any other hardware resources that can be utilized by the compute resources(s) 610 and/or the memory resource(s) 612 to perform operations described herein. The other resource(s) 614 can include one or more input and/or output processors (e.g., network interface controller or wireless radio), one or more modems, one or more codec chipset, one or more pipeline processors, one or more fast Fourier transform (“FFT”) processors, one or more digital signal processors (“DSPs”), one or more speech synthesizers, and/or the like.
The hardware resources operating within the hardware resource layer 602 can be virtualized by one or more virtual machine monitors (“VMMs”) 616A-616N (also known as “hypervisors”; hereinafter “VMMs 616”) operating within the control layer 604 to manage one or more virtual resources that reside in the virtual resource layer 606. The VMMs 616 can be or can include software, firmware, and/or hardware that alone or in combination with other software, firmware, and/or hardware, manages one or more virtual resources operating within the virtual resource layer 606.
The virtual resources operating within the virtual resource layer 606 can include abstractions of at least a portion of the compute resources 610, the memory resources 612, the other resources 614, or any combination thereof. These abstractions are referred to herein as virtual machines (“VMs”). In the illustrated embodiment, the virtual resource layer 606 includes VMs 618A-618N (hereinafter “VMs 618”). Each of the VMs 618 can execute one or more applications 620A-620N in the application layer 608. The applications 620A-620N can include the public metaverse server application 106 or the private metaverse server applications 116 in various embodiments.
Turning now to
The illustrated machine learning system 700 includes one or more machine learning models 702. The machine learning models 702 can include supervised and/or semi-supervised learning models. The machine learning model(s) 702 can be created by the machine learning system 700 based upon one or more machine learning algorithms 704. The machine learning algorithm(s) 704 can be any existing, well-known algorithm, any proprietary algorithms, or any future machine learning algorithm. Some example machine learning algorithms 704 include, but are not limited to, gradient descent, linear regression, logistic regression, linear discriminant analysis, classification tree, regression tree, Naive Bayes, K-nearest neighbor, learning vector quantization, support vector machines, and the like. Classification and regression algorithms might find particular applicability to the concepts and technologies disclosed herein. Those skilled in the art will appreciate the applicability of various machine learning algorithms 704 based upon the problem(s) to be solved by machine learning via the machine learning system 700.
The machine learning system 700 can control the creation of the machine learning models 702 via one or more training parameters. In some embodiments, the training parameters are selected modelers at the direction of an enterprise, for example. Alternatively, in some embodiments, the training parameters are automatically selected based upon data provided in one or more training data sets 706. The training parameters can include, for example, a learning rate, a model size, a number of training passes, data shuffling, regularization, and/or other training parameters known to those skilled in the art.
The learning rate is a training parameter defined by a constant value. The learning rate affects the speed at which the machine learning algorithm 704 converges to the optimal weights. The machine learning algorithm 704 can update the weights for every data example included in the training data set 706. The size of an update is controlled by the learning rate. A learning rate that is too high might prevent the machine learning algorithm 704 from converging to the optimal weights. A learning rate that is too low might result in the machine learning algorithm 704 requiring multiple training passes to converge to the optimal weights.
The model size is regulated by the number of input features (“features”) 706 in the training data set 706. A greater the number of features 708 yields a greater number of possible patterns that can be determined from the training data set 706. The model size should be selected to balance the resources (e.g., compute, memory, storage, etc.) needed for training and the predictive power of the resultant machine learning model 702.
The number of training passes indicates the number of training passes that the machine learning algorithm 704 makes over the training data set 706 during the training process. The number of training passes can be adjusted based, for example, on the size of the training data set 706, with larger training data sets being exposed to fewer training passes in consideration of time and/or resource utilization. The effectiveness of the resultant machine learning model 702 can be increased by multiple training passes.
Data shuffling is a training parameter designed to prevent the machine learning algorithm 704 from reaching false optimal weights due to the order in which data contained in the training data set 706 is processed. For example, data provided in rows and columns might be analyzed first row, second row, third row, etc., and thus an optimal weight might be obtained well before a full range of data has been considered. By data shuffling, the data contained in the training data set 706 can be analyzed more thoroughly and mitigate bias in the resultant machine learning model 702.
Regularization is a training parameter that helps to prevent the machine learning model 702 from memorizing training data from the training data set 706. In other words, the machine learning model 702 fits the training data set 706, but the predictive performance of the machine learning model 702 is not acceptable. Regularization helps the machine learning system 700 avoid this overfitting/memorization problem by adjusting extreme weight values of the features 708. For example, a feature that has a small weight value relative to the weight values of the other features in the training data set 706 can be adjusted to zero.
The machine learning system 700 can determine model accuracy after training by using one or more evaluation data sets 710 containing the same features 708′ as the features 708 in the training data set 706. This also prevents the machine learning model 702 from simply memorizing the data contained in the training data set 706. The number of evaluation passes made by the machine learning system 700 can be regulated by a target model accuracy that, when reached, ends the evaluation process and the machine learning model 702 is considered ready for deployment.
After deployment, the machine learning model 702 can perform a prediction operation (“prediction”) 714 with an input data set 712 having the same features 708″ as the features 708 in the training data set 706 and the features 708′ of the evaluation data set 710. The results of the prediction 714 are included in an output data set 716 consisting of predicted data. The machine learning model 702 can perform other operations, such as regression, classification, and others. As such, the example illustrated in
Based on the foregoing, it should be appreciated that concepts and technologies directed to the creation of dynamic language for private metaverse have been disclosed herein. Although the subject matter presented herein has been described in language specific to computer structural features, methodological and transformative acts, specific computing machinery, and computer-readable media, it is to be understood that the concepts and technologies disclosed herein are not necessarily limited to the specific features, acts, or media described herein. Rather, the specific features, acts and mediums are disclosed as example forms of implementing the concepts and technologies disclosed herein.
The subject matter described above is provided by way of illustration only and should not be construed as limiting. Various modifications and changes may be made to the subject matter described herein without following the example embodiments and applications illustrated and described, and without departing from the true spirit and scope of the embodiments of the concepts and technologies disclosed herein.