Patent Application
20160301788
The exemplary and non-limiting embodiments of this invention relate generally to wireless communication systems, methods, devices and computer programs and, more specifically, relate to initiation of applications/services.
This section is intended to provide a background or context to the invention that is recited in the claims. The description herein may include concepts that could be pursued, but are not necessarily ones that have been previously conceived or pursued. Therefore, unless otherwise indicated herein, what is described in this section is not prior art to the description and claims in this application and is not admitted to be prior art by inclusion in this section.
Currently, there is no framework on mobile or other systems that allow users to create their own personalized services through combination of other services and still enabling access to those through new modalities such as the voice dialer in the car. Web based mashup applications may be created by combining one or more web apps into a single web application by piping the input and output of each application together via a script.
Many modern cars come with a name dialer in-built or can be had as an add-on. The name dialer works on the principle that users train the speech recognizer in the car to their voice and then upload their contacts in the contact book. A pairing has to be performed between the car and the phone. Then, when the phone is in the vicinity of the car (and the car is on), the user can dial or accept calls using the car speakers and microphone. The name dialer sends signal to the mobile device about the intended caller present in the phone book. The phone will then dial that particular intended caller and, if the call is accepted, dual audio communication is performed using the car microphone and car speakers through the phone.
The below summary section is intended to be merely exemplary and non-limiting.
The foregoing and other problems are overcome, and other advantages are realized, by the use of the exemplary embodiments of this invention.
In a first aspect thereof an exemplary embodiment of this invention provides a method to provide an additional interface for launching applications. The method includes receiving information indicative of a record stored in an electronic device application. The method also includes determining whether the record is associated with a software application command. In response to determining that the record is associated with a software application command, the software application command is activated.
In a further aspect thereof an exemplary embodiment of this invention provides an apparatus to provide an additional interface for launching applications. The apparatus includes at least one processor; and at least one memory including computer program code. The at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to perform actions. The actions include to receive information indicative of a record stored in an electronic device application; to determine whether the record is associated with a software application command; and in response to determining that the record is associated with a software application command, to activate the software application command.
In an additional aspect thereof an exemplary embodiment of this invention provides a computer readable medium to provide an additional interface for launching applications. The computer readable medium is tangibly encoded with a computer program executable by a processor to perform actions. The actions include receiving information indicative of a record stored in an electronic device application; determining whether the record is associated with a software application command; and in response to determining that the record is associated with a software application command, activating the software application command.
In a further aspect thereof an exemplary embodiment of this invention provides an apparatus to provide an additional interface for launching applications. The apparatus includes means for receiving information indicative of a record stored in an electronic device application; means for determining whether the record is associated with a software application command; and means for activating the software application command in response to determining that the record is associated with a software application command.
In an additional aspect thereof an exemplary embodiment of this invention provides a method to generate phonebook records for activating software application commands. The method includes receiving a selection of a user-selected software application command and a name for the software application. A phonebook record is generated using the name. The method also includes associating the phonebook record with the user-selected software application command. Storing the phonebook record in a phonebook is also included in the method.
The foregoing and other aspects of exemplary embodiments of this invention are made more evident in the following Detailed Description, when read in conjunction with the attached Drawing Figures, wherein:
Various exemplary embodiments in accordance with this invention allow users to create their own services from a list of available services, for example, through use of a visual tool or user interface (UI). The user can provide their own name for the service using words familiar to them and uploads these to the device framework. The device framework assigns a unique identifier (ID) to this service and adds this to the user phonebook. The phonebook tags this as an application name which is different from personal contacts. The phonebook can then upload this to the car interface and user can invoke the service by saying the application name.
Before describing in further detail various exemplary embodiments of this invention, reference is made to
The user equipment (UE) 110 includes a controller, such as a computer or a data processor (DP) 114, a computer-readable memory medium embodied as a memory (MEM) 116 that stores a program of computer instructions (PROG) 118, and a suitable wireless interface, such as radio frequency (RF) transceiver 112, for bidirectional wireless communications.
The PROGs 118 is assumed to include program instructions that, when executed by the associated DP, enable the device to operate in accordance with exemplary embodiments of this invention, as will be discussed below in greater detail.
That is, various exemplary embodiments of this invention may be implemented at least in part by computer software executable by the DP 114 of the UE 110, or by hardware, or by a combination of software and hardware (and firmware).
The UE 110 may also include dedicated processors, for example, speech recognition device 115.
In general, the various embodiments of the UE 110 can include, but are not limited to, cellular telephones, tablets having wireless communication capabilities, personal digital assistants (PDAs) having wireless communication capabilities, portable computers having wireless communication capabilities, image capture devices such as digital cameras having wireless communication capabilities, gaming devices having wireless communication capabilities, music storage and playback appliances having wireless communication capabilities, Internet appliances permitting wireless Internet access and browsing, as well as portable units or terminals that incorporate combinations of such functions.
The computer readable MEM 116 may be of any type suitable to the local technical environment and may be implemented using any suitable data storage technology, such as semiconductor based memory devices, flash memory, magnetic memory devices and systems, optical memory devices and systems, fixed memory and removable memory. The DP 114 may be of any type suitable to the local technical environment, and may include one or more of general purpose computers, special purpose computers, microprocessors, digital signal processors (DSPs) and processors based on a multicore processor architecture, as non-limiting examples. The wireless interface (e.g., RF transceiver 112) may be of any type suitable to the local technical environment and may be implemented using any suitable communication technology such as individual transmitters, receivers, transceivers or a combination of such components.
Within the sectional view of
Signals to and from the camera 228 pass through an image/video processor 244 which encodes and decodes the various image frames. A separate audio processor 246 may also be present controlling signals to and from the speakers 234 and the microphone 224. The graphical display interface 220 is refreshed from a frame memory 248 as controlled by a user interface chip 250 which may process signals to and from the display interface 220 and/or additionally process user inputs from the keypad 222 and elsewhere.
Certain embodiments of the UE 110 may also include one or more secondary radios such as a wireless local area network radio WLAN 237 and a Bluetooth® radio 239, which may incorporate an antenna on-chip or be coupled to an off-chip antenna. Throughout the apparatus are various memories such as random access memory RAM 243, read only memory ROM 245, and in some embodiments removable memory such as the illustrated memory card 247. The various programs 118 are stored in one or more of these memories. All of these components within the UE 110 are normally powered by a portable power supply such as a battery 249.
Processors 238, 240, 242, 244, 246, 250, if embodied as separate entities in a UE 110, may operate in a slave relationship to the main processor 114, which may then be in a master relationship to them. Embodiments of this invention are most relevant to the internal speech recognition device 115 and external speech recognition devices (for example, a speech recognition device embodied in a car-dialer), though it is noted that other embodiments need not be disposed there but may be disposed across various chips and memories as shown or disposed within another processor that combines some of the functions described above for
Note that the various chips (e.g., 238, 240, 242, etc.) that were described above may be combined into a fewer number than described and, in a most compact case, may all be embodied physically within a single chip.
Various exemplary embodiments in accordance with this invention allow users to invoke user-defined application/commands using a phonebook interface, for example, with a paired speech recognition device. In a non-limiting example, the user may activate the speech recognition device and speaks a command. This command is used to identify a phonebook tag which is associated with an application (such tags are different from personal contacts). The speech recognition device provides this information to the mobile device (e.g., via a Bluetooth interface) which can then perform the command (e.g., activate the application).
In additional embodiments, some or all actions may be performed by the mobile device, for example, where the mobile device includes speech recognition software/components or where the speech recognition device simply transmits the audio signal to the mobile device.
Some examples of operations of exemplary embodiments are given below:
A driver may wish to record their kids in the back when they start singing a song. The driver can open the dialer in the car and say “voice recorder”. A voice recorder on the phone will start to record audio. The drive can then open the dialer and say a second command (e.g., “stop recorder”) and the recorder will stop.
When the driver reaches a destination, they can then open the dialer and say “take me home” after which it will start a map application on the device and navigate to their home.
If the driver receives a text message they can open the car dialer and say “read SMS”. The mobile device may then auto-read the text message. The driver can then open car dialer and say “reply voice”. The device can then open a speech recognizer, converts audio to text and sends that text to a messaging application that would send it as a text reply.
In various non-limiting examples in accordance with this invention, the phone book is stored in a name dialer in the phone and possibly either all of the contacts in the phone book or a part of the contacts in the phone book are stored in the name dialer application (for example, in a built-in car dialer or other electronic device). However, this does not require any changes to software in the name dialer (of a car, for example) making it possible to run multiple applications using existing phonebook. In some embodiments, the phonebook can make use of a small extension in order to submit an application ID (and parameters provided by the user) to the device platform instead of dialing. Similarly, any other programs can use this extension and contact the device platform providing the ID of the user created program name.
The user can also provide specific parameters to the service/application. These may be additional ‘hot words’ that are associated with the same ID as that of the service/application. The phonebook may be provided ‘hot words’ as well with the ID. The phonebook may opt to not display the ‘hot words’ (unless navigated into by the user) but can export those to the dialer system (in the car, for example). The user can use these words after the service name has been spoken and have the command understood. These words may be spoken at anytime that the program is running and before the session has been terminated, e.g., by using another keyword, an expiring timeline or other criterion.
In a non-limiting example, the name dialer is used to recognize what a user has said and send that to the phone book, for example, by providing the ID of a phonebook entry. Alternatively, the name dialer may provide an unaltered audio channel to the mobile device which in turn may process the audio data in order to determine what was said.
A UI tool may be provided on a personal computer and can be synchronized with the device to get updates of all applications installed on the device. The UI tool may also be updated from an OEM site for updates on applications and parameters. The user can also provide parameters for applications such as ‘hot words’ for the speech recognition application. Another example would be a reader application where the user can also say the name of a file in a default directory that would be read by the reader application.
Once the user has created their personalized service (which includes a “command name” for the name dialer, a set of applications or instructions to be performed/invoked when that command is executed (for example, via the phone book), a set of optional parameters or hot words for that command and the unique ID for that “command name”/personalized service) this personalized service may be uploaded to their mobile device. The device platform then updates the service to the phonebook (and other registered applications). In one embodiment, the user can specify which applications to update this information to through the UI.
The user may also provide a timeline in which to invoke the various applications. In a non-limiting embodiment, the timeline may include a sequence in which to invoke the command, for example, invoking a second command using parameters generated by the invocation of a first command. In another non-limiting embodiment, the timeline can also specify when one application ends and another can begin or be executed in parallel. Using the timeline does not limit the application invocations.
The non-limiting UI includes various windows for providing a list of applications and application parameters. The application parameter list may be based on a selected application in the list of applications. As shown, ‘Application A’ is selected and possible parameters for A are shown. Operation of multiple applications (or multiple invocations of the same application) may be assigned triggers. Additionally, the UI may provide a timing window in order to show which applications are assigned to the service and the order in which they are invoked and/or interact.
The user may assign a name to the service and upload the service to a device. Alternatively, the new service may be saved into a memory on the device with the UI (e.g., where a mobile phone is used to define the service).
Even though a system generated ID is shown in the UI, this does not have to be displayed on the UI. It can be directly generated by the device platform when the service is uploaded to device.
As shown, user interaction device 420 and service creation tool 430 are shown separate from the UE 210; however, either or both of these may be embodied within the UE 110. For example, UE 110 may provide a platform to run the service creation tool 430 and/or provide user interaction via an installed microphone and speech recognition software.
Various exemplary embodiments in accordance with this invention provide numerous applications. Many applications may be controlled through an interface such as car dialer. The user can define unique ways to invoke and use the applications without requiring modification to current aspects of the in-car interaction. Multiple application mashups allows personalized and user-preferred naming for personal applications. There is no need to provide service calls for all available applications as the user may create service calls for applications they want and define how they want to invoke the application.
Since the user defines how they want to invoke the applications, the system is easier for each user to remember and more intuitive when using. Similarly, the user can define how to pass on parameters (not just command invocation) that makes sense to the user.
Using the UI the user can define additional parameters to pass to the applications in a context aware process. For example, the interface may be configured to provide location based information whenever a mapping application is invoked.
Based on the foregoing it should be apparent that the exemplary embodiments, of this invention provide a method, apparatus and computer program(s) to provide an additional interface for launching applications.
The various blocks shown in
An exemplary embodiment in accordance with this invention is a method to provide an additional interface for launching applications. The method includes receiving information (e.g., at a processor) indicative of a record stored in an electronic device application. The method also includes determining (e.g., by a processor) whether the record is associated with a software application command. In response to determining that the record is associated with a software application command, the software application command is activated (e.g., at a processor).
In a further exemplary embodiment of the method above, the information includes additional parameters. Activating the software application command includes activating the software application command using the additional parameters.
In an additional exemplary embodiment of any one of the methods above, the information is received from a speech recognition component.
In a further exemplary embodiment of any one of the methods above, the software application command is launching a map application, starting a voice recorder or stopping a voice recorder.
In an additional exemplary embodiment of any one of the methods above, the electronic device application is a phonebook and the method also includes receiving a selection of a user-selected software application command and a name for the software application; generating a phonebook record using the name; associating the phonebook record with the user-selected software application command; and storing the phonebook record in the phonebook.
In a further exemplary embodiment of any one of the methods above, the method also includes receiving a selection of at least one application parameter; and associating the at least one application parameter with the phonebook record.
In an additional exemplary embodiment of any one of the methods above, the method also includes assigning an identifier to the phonebook record.
In a further exemplary embodiment of any one of the methods above, the method also includes exporting at least a portion of the phonebook record to a speech recognition component.
In an additional exemplary embodiment of any one of the methods above, the method also includes receiving at least one additional software application command and a timing sequence in which to activate a plurality of software application commands which include the user-selected software application command and the at least one additional software application command.
A further exemplary embodiment in accordance with this invention is an apparatus to provide an additional interface for launching applications. The apparatus includes at least one processor; and at least one memory including computer program code. The at least one memory and the computer program code are configured to, with the at least one processor, cause the apparatus to perform actions. The actions include to receive information indicative of a record stored in an electronic device application; to determine whether the record is associated with a software application command; and in response to determining that the record is associated with a software application command, to activate the software application command.
In an additional exemplary embodiment of the apparatus above, the information includes additional parameters. Activating the software application command includes activating the software application command using the additional parameters.
In a further exemplary embodiment of any one of the apparatus above, the information is received from a speech recognition component.
In an additional exemplary embodiment of any one of the apparatus above, the software application command is launching a map application, starting a voice recorder or stopping a voice recorder.
In a further exemplary embodiment of any one of the apparatus above, the electronic device application is a phonebook and the actions also include to receive a selection of a user-selected software application command and a name for the software application; to generate a phonebook record using the name; to associate the phonebook record with the user-selected software application command; and to store the phonebook record in the phonebook.
In an additional exemplary embodiment of any one of the apparatus above, the actions also include to receive a selection of at least one application parameter; and associating the at least one application parameter with the phonebook record.
In a further exemplary embodiment of any one of the apparatus above, the actions also include to assign an identifier to the phonebook record.
In an additional exemplary embodiment of any one of the apparatus above, the actions also include to export at least a portion of the phonebook record to a speech recognition component.
In a further exemplary embodiment of any one of the apparatus above, the actions also include to receive at least one additional software application command and a timing sequence in which to activate a plurality of software application commands which include the user-selected software application command and the at least one additional software application command.
An additional exemplary embodiment in accordance with this invention is a computer readable medium to provide an additional interface for launching applications. The computer readable medium is tangibly encoded with a computer program executable by a processor to perform actions. The actions include receiving information indicative of a record stored in an electronic device application; determining whether the record is associated with a software application command; and in response to determining that the record is associated with a software application command, activating the software application command.
In a further exemplary embodiment of the computer readable medium above, the information includes additional parameters. Activating the software application command includes activating the software application command using the additional parameters.
In an additional exemplary embodiment of any one of the computer readable media above, the information is received from a speech recognition component.
In a further exemplary embodiment of any one of the computer readable media above, the software application command is launching a map application, starting a voice recorder or stopping a voice recorder.
In an additional exemplary embodiment of any one of the computer readable media above, the electronic device application is a phonebook and the actions also include receiving a selection of a user-selected software application command and a name for the software application; generating a phonebook record using the name; associating the phonebook record with the user-selected software application command; and storing the phonebook record in the phonebook.
In a further exemplary embodiment of any one of the computer readable media above, the actions also include receiving a selection of at least one application parameter; and associating the at least one application parameter with the phonebook record.
In an additional exemplary embodiment of any one of the computer readable media above, the actions also include assigning an identifier to the phonebook record.
In a further exemplary embodiment of any one of the computer readable media above, the actions also include exporting at least a portion of the phonebook record to a speech recognition component.
In an additional exemplary embodiment of any one of the computer readable media above, the actions also include receiving at least one additional software application command and a timing sequence in which to activate a plurality of software application commands which include the user-selected software application command and the at least one additional software application command.
In a further exemplary embodiment of any one of the computer readable media above, the computer readable medium is a non-transitory computer readable medium (for example, a CD-ROM, RAM, flash memory, etc.).
An additional exemplary embodiment in accordance with this invention is an apparatus to provide an additional interface for launching applications. The apparatus includes means for receiving (e.g., a processor) information indicative of a record stored in an electronic device application; means for determining (e.g., a processor) whether the record is associated with a software application command; and means for activating (e.g., a processor) the software application command in response to determining that the record is associated with a software application command.
In a further exemplary embodiment of the apparatus above, the information includes additional parameters. The activating means includes means for activating the software application command using the additional parameters.
In an additional exemplary embodiment of any one of the apparatus above, the information is received from a speech recognition component.
In a further exemplary embodiment of any one of the apparatus above, the software application command is launching a map application, starting a voice recorder or stopping a voice recorder.
In an additional exemplary embodiment of any one of the apparatus above, the electronic device application is a phonebook and the apparatus also includes means for receiving a selection of a user-selected software application command and a name for the software application; means for generating a phonebook record using the name; means for associating the phonebook record with the user-selected software application command; and means for storing the phonebook record in the phonebook.
In a further exemplary embodiment of any one of the apparatus above, the apparatus also includes means for receiving a selection of at least one application parameter; and means for associating the at least one application parameter with the phonebook record.
In an additional exemplary embodiment of any one of the apparatus above, the apparatus also includes means for assigning an identifier to the phonebook record.
In a further exemplary embodiment of any one of the apparatus above, the apparatus also includes means for exporting at least a portion of the phonebook record to a speech recognition component.
In an additional exemplary embodiment of any one of the apparatus above, the apparatus also includes means for receiving at least one additional software application command and a timing sequence in which to activate a plurality of software application commands which include the user-selected software application command and the at least one additional software application command.
A further exemplary embodiment in accordance with this invention is a method to provide an additional interface for launching applications. The method includes receiving a selection of a user-selected software application command and a name for the software application. A phonebook record is generated using the name. The method also includes associating the phonebook record with the user-selected software application command. Storing the phonebook record in a phonebook is also included in the method.
In general, the various exemplary embodiments may be implemented in hardware or special purpose circuits, software, logic or any combination thereof. For example, some aspects may be implemented in hardware, while other aspects may be implemented in firmware or software which may be executed by a controller, microprocessor or other computing device, although the invention is not limited thereto. While various aspects of the exemplary embodiments of this invention may be illustrated and described as block diagrams, flow charts, or using some other pictorial representation, it is well understood that these blocks, apparatus, systems, techniques or methods described herein may be implemented in, as nonlimiting examples, hardware, software, firmware, special purpose circuits or logic, general purpose hardware or controller or other computing devices, or some combination thereof.
It should thus be appreciated that at least some aspects of the exemplary embodiments of the inventions may be practiced in various components such as integrated circuit chips and modules, and that the exemplary embodiments of this invention may be realized in an apparatus that is embodied as an integrated circuit. The integrated circuit, or circuits, may comprise circuitry (as well as possibly firmware) for embodying at least one or more of a data processor or data processors, a digital signal processor or processors, baseband circuitry and radio frequency circuitry that are configurable so as to operate in accordance with the exemplary embodiments of this invention.
Various modifications and adaptations to the foregoing exemplary embodiments of this invention may become apparent to those skilled in the relevant arts in view of the foregoing description, when read in conjunction with the accompanying drawings. However, any and all modifications will still fall within the scope of the non-limiting and exemplary embodiments of this invention.
It should be noted that the terms “connected,” “coupled,” or any variant thereof, mean any connection or coupling, either direct or indirect, between two or more elements, and may encompass the presence of one or more intermediate elements between two elements that are “connected” or “coupled” together. The coupling or connection between the elements can be physical, logical, or a combination thereof. As employed herein two elements may be considered to be “connected” or “coupled” together by the use of one or more wires, cables and/or printed electrical connections, as well as by the use of electromagnetic energy, such as electromagnetic energy having wavelengths in the radio frequency region, the microwave region and the optical (both visible and invisible) region, as several non-limiting and non-exhaustive examples.
Furthermore, some of the features of the various non-limiting and exemplary embodiments of this invention may be used to advantage without the corresponding use of other features. As such, the foregoing description should be considered as merely illustrative of the principles, teachings and exemplary embodiments of this invention, and not in limitation thereof.
| Number | Date | Country | |
|---|---|---|---|
| Parent | 13268063 | Oct 2011 | US |
| Child | 15187902 | US |
