Many people enjoy consuming media content while travelling or during other activities. The media content can include audio content, video content, or other types of media content. Examples of audio content includes songs, albums, podcasts, audiobooks, etc. Examples of video content includes movies, music videos, television episodes, etc. Using a mobile phone or other media-playback device, such as a vehicle-integrated media playback device, a person can access large catalogs of media content. For example, a user can access an almost limitless catalog of media content through various free and subscription-based streaming services. Additionally, a user can store a large catalog of media content on his or her mobile device.
This nearly limitless access to media content introduces new challenges for users. For example, it may be difficult to find or select a desired variety of media content suitable for traveling.
In general terms, this disclosure is directed to customizing media programs to match a selected duration. In one possible configuration and by non-limiting example, a media-playback device generates a customized media program that is specifically configured to provide playback of media content for the duration of a traveled route. Various aspects are described in this disclosure, which include, but are not limited to, the following aspects.
In one aspect, media playback device for customizing a media program for a specified duration comprises: a processor; a memory device encoding instructions that, when executed by the processor, cause the media playback device to: determine a duration of the media program; determine one or more preferences of a user; build a customized playlist of media content items based on the determined duration and the one or more preferences of the user; and a content output device configured to play the media content items.
In another aspect, a method of presenting a customized media program to a user comprises: determining a duration of the customized media program; building a playlist including one or more items of media content that fit the determined duration; and playing the playlist.
In yet another aspect, a system for building a customized playlist for a specific route comprises: a media-delivery system configured to communicate with a mobile device through a network, the media-delivery system comprising: a customized program server application for selecting media for a customized playlist for a specific travel route based on user preferences comprising a machine learning engine and a user preferences data store; and a media server application for accessing and streaming media content of the customized playlist.
In another aspect, computer-executable instructions are executed by one or more computing devices, causing the computing device to: receive a selection of a destination; determine a route to the destination; determine a duration of the route; determine the driving conditions of the route; determine one or more preferences of the user; build a playlist including one or more types of audio content the conform to the preferences of the user, the driving conditions of the route, and the duration of the route, wherein the playlist includes one or more news content items and one or more entertainment content items; play the playlist through a media playback device; adjust the playlist in response to changes in the duration of the route or receiving a command from the user to skip content; and conclude the playlist with an uplifting media content item selected for the user.
Various embodiments will be described in detail with reference to the drawings, wherein like reference numerals represent like parts and assemblies throughout the several views. Reference to various embodiments does not limit the scope of the claims attached hereto. Additionally, any examples set forth in this specification are not intended to be limiting and merely set forth some of the many possible embodiments for the appended claims.
Users of media-playback devices often consume media content during various activities, including travelling. As used herein, the term “travel” and variants thereof refers to any activity in which a user is in transit between two locations. For example, a user is in transit when being conveyed by a vehicle, including motorized and non-motorized, public transit, and private vehicles. A user is also in transit when moving between locations by other means such as walking and running.
Enjoying media content while travelling presents many challenges. First, it can be difficult to safely interact with a media-playback device while traveling in a manner that does not interfere with travel related activities (driving, navigating, etc.) Second, desired media content may not be available or accessible in a format that can be accessed while travelling. Third, accessing media content while travelling may be difficult, expensive, or impossible depending on network availability/capacity along the route of travel. Fourth, accessing and playing back media content can require significant amounts of energy, potentially draining a battery in the media-playback device. Fifth, it can be challenging to connect a media-playback device to a vehicle-embedded audio system for playback while travelling in a vehicle. Embodiments disclosed herein address some or all of these challenges. It should be understood, however, that aspects described herein are not limited to use during travel.
For example, in some embodiments, the media-playback device includes a limited-attention interface that requires less attention from the user and/or is less distracting than a standard interface. This limited-attention interface can be useful during travelling because a user may have limited attention available for interacting with a media-playback device due to the need to concentrate on travel related activities, including, for example, driving and navigating. But the limited-attention interface can also be configured for use playing back media content during other activities that require the user's concentration, such as exercising, playing games, operating heavy equipment, reading, studying, etc.
Consuming media content may include one or more of listening to audio content, watching video content, or consuming other types of media content. For ease of explanation, the embodiments described in this application are presented using specific examples. For example, audio content (and in particular music) is described as an example of one form of media consumption. As another example, travelling (and in particular driving) is described as one example of an activity during which media content is consumed. However, it should be understood that the same concepts are similarly applicable to other forms of media consumption and to other activities, and at least some embodiments include other forms of media consumption and/or are configured for use during other activities.
The media-playback device 102 plays back media content items to produce media output 110. In some embodiments, the media content items are provided by the media-delivery system 104 and transmitted to the media-playback device 102 using the network 106. A media content item is an item of media content, including audio, video, or other types of media content, which may be stored in any format suitable for storing media content. Non-limiting examples of media content items include news content items, weather content items, traffic content items, music, audiobooks, music videos, movies, television episodes, podcasts, other types of audio or video content, and portions or combinations thereof.
The media-playback device 102 plays media content for the user during travel or other activities. The media content that is played back may be selected based on user input or may be selected without user input. The media content may be selected for playback without user input by either the media-playback device 102 or the media-delivery system 104. For example, media content can be selected for playback without user input based on stored user profile information, location, travel conditions, current events, and other criteria.
User profile information includes but is not limited to user preferences and historical information about the user's consumption of media content. User profile information can also include libraries and/or playlists of media content items associated with the user. User profile information can also include information about the user's relationships with other users (e.g., associations between users that are stored by the media-delivery system 104 or on a separate social media site). Although the media-playback device 102 is shown as a separate device in
The duration-based customized media program engine 108 generates customized media programs for users based on a specified duration of time. In at least some embodiments, the duration-based customized media program engine 108 builds media playlists configured to accompany a user traveling in a vehicle along a particular route. The selected media in the playlist is customized to conform to the user's preferences and conditions along the route.
In some embodiments, the duration-based customized media program engine 108 receives input from a user to skip media content within a playlist during playback. In some embodiments, the duration-based customized media program engine 108 updates the playlist in response to a changed duration by adding or removing new or entertainment content. The duration may be changed in response to receiving input from the user to change the duration of the media program. In some embodiments, the duration is adjusted based on input received from the travel server application 186 which shows that a route will take more or less time than initially estimated. Additionally, the duration may be adjusted due to an interruption in playback of the playlist such as a phone call or pausing playback. In some embodiments, the duration-based customized media program engine 108 updates the playlist in response to a changed duration by adding or removing news or entertainment content. Embodiments of the duration-based customized media program engine 108 are illustrated and described further throughout.
As noted above, the media-playback device 102 plays media content items. In some embodiments, the media-playback device 102 plays media content items that are provided (e.g., streamed, transmitted, etc.) by a system external to the media-playback device such as the media-delivery system 104, another system, or a peer device. Alternatively, in some embodiments, the media-playback device 102 plays media content items stored locally on the media-playback device 102. Further, in at least some embodiments, the media-playback device 102 plays media content items that are stored locally as well as media content items provided by other systems.
In some embodiments, the media-playback device 102 is a computing device, handheld entertainment device, smartphone, tablet, watch, wearable device, or any other type of device capable of playing media content. In yet other embodiments, the media-playback device 102 is an in-dash vehicle computer, laptop computer, desktop computer, television, gaming console, set-top box, network appliance, blue-ray or DVD player, media player, stereo, or radio.
In at least some embodiments, the media-playback device 102 includes a location-determining device 150, a touch screen 152, a processing device 154, a memory device 156, a content output device 158, a movement-detecting device 160, a network access device 162, a sound-sensing device 164, and an optical-sensing device 166. Other embodiments may include additional, different, or fewer components. For example, some embodiments do not include one or more of the touch screen 152, the movement-detecting device 160, the sound-sensing device 164 and the optical-sensing device 166.
The location-determining device 150 is a device that determines the location of the media-playback device 102. In some embodiments, the location-determining device 150 uses one or more of the following technologies: Global Positioning System (GPS) technology which may receive GPS signals 174 from satellites S, cellular triangulation technology, network-based location identification technology, Wi-Fi positioning systems technology, and combinations thereof.
The touch screen 152 operates to receive an input 176 from a selector (e.g., a finger, stylus, etc.) controlled by the user U. In some embodiments, the touch screen 152 operates as both a display device and a user input device. In some embodiments, the touch screen 152 detects inputs based on one or both of touches and near-touches. In some embodiments, single taps and/or swipes are recognized as inputs. In some embodiments, the touch screen 152 displays a user interface 168 for interacting with the media-playback device 102. As noted above, some embodiments do not include a touch screen 152. Some embodiments include a display device and one or more separate user interface devices. Further, some embodiments do not include a display device. In some embodiments, the user interface 168 operates to receive input from the user U to determine one or more preferences of the user U. The user U may provide input to the user interface 168 by one or more of the sound-sensing device 164 and the touch screen 152.
In some embodiments, the processing device 154 comprises one or more central processing units (CPU). In other embodiments, the processing device 154 additionally or alternatively includes one or more digital signal processors, field-programmable gate arrays, or other electronic circuits.
The memory device 156 operates to store data and instructions. In some embodiments, the memory device 156 stores instructions for a media-playback engine 170 that includes the duration-based customized media program engine 108. In some embodiments, the media-playback engine 170 selects and plays back media content and generates interfaces for selecting and playing back media content items. As described above, the duration-based customized media program engine 108 also selects media content for the user. The memory device 156 may further store instructions for a navigation application 171 and a parking application 172 in some embodiments. The navigation application 171 operates to determine routes to selected destinations. The parking application 172 operates to report the status of available parking spaces near of a location of interest to the user.
In at least some embodiments, interfaces are generated that are configured to be less distracting to a user and require less attention from the user than other interfaces generated by the media-playback engine 170. For example, interfaces may include fewer features than the other interfaces generated by the media-playback engine 170. These interfaces may make it easier for the user to interact with the media-playback device 102 during travel or other activities that require the user's attention.
Some embodiments of the memory device also include a media content cache 173. The media content cache 173 stores media-content items, such as media content items that have been previously received from the media-delivery system 104. The media content items stored in the media content cache 173 may be stored in an encrypted or unencrypted format. The media content cache 173 can also store decryption keys for some or all of the media content items that are stored in an encrypted format. The media content cache 173 can also store metadata about media-content items such as title, artist name, album name, length, genre, mood, era, etc. The media content cache 173 can also store playback information about the media content items, such as the number of times the user has requested to playback the media content item or the current location of playback (e.g., when the media content item is an audiobook, podcast, or the like for which a user may wish to resume playback). In some embodiments, the playlist can be stored in the media content cache 173 for later playback.
The memory device 156 typically includes at least some form of computer-readable media. Computer readable media includes any available media that can be accessed by the media-playback device 102. By way of example, computer-readable media include computer readable storage media and computer readable communication media.
Computer readable storage media includes volatile and nonvolatile, removable and non-removable media implemented in any device configured to store information such as computer readable instructions, data structures, program modules, or other data. Computer readable storage media includes, but is not limited to, random access memory, read only memory, electrically erasable programmable read only memory, flash memory and other memory technology, compact disc read only memory, blue ray discs, digital versatile discs or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium that can be used to store the desired information and that can be accessed by the media-playback device 102. In some embodiments, computer readable storage media is non-transitory computer readable storage media.
Computer readable communication media typically embodies computer readable instructions, data structures, program modules or other data in a modulated data signal such as a carrier wave or other transport mechanism and includes any information delivery media. The term “modulated data signal” refers to a signal that has one or more of its characteristics set or changed in such a manner as to encode information in the signal. By way of example, computer readable communication media includes wired media such as a wired network or direct-wired connection, and wireless media such as acoustic, radio frequency, infrared, and other wireless media. Combinations of any of the above are also included within the scope of computer readable media.
The content output device 158 operates to output media content. In some embodiments, the content output device 158 generates media output 110 for the user U. Examples of the content output device 158 include a speaker assembly 268 comprising one or more speakers, an audio output jack, a Bluetooth transmitter, a display panel, and a video output jack. Other embodiments are possible as well. For example, the content output device 158 may transmit a signal through the audio output jack or Bluetooth transmitter that can be used to reproduce an audio signal by a connected or paired device such as headphones, speaker system, or vehicle media-playback system 264. Embodiments involving transmission of media output 110 through a vehicle media-playback system 264 are further described throughout.
The movement-detecting device 160 senses movement of the media-playback device 102. In some embodiments, the movement-detecting device 160 also determines an orientation of the media-playback device 102. In at least some embodiments, the movement-detecting device 160 includes one or more accelerometers or other motion-detecting technologies or orientation-detecting technologies. As an example, the movement-detecting device 160 may determine an orientation of the media-playback device 102 with respect to a primary direction of gravitational acceleration. The movement-detecting device 160 may detect changes in the determined orientation and interpret those changes as indicating movement of the media-playback device 102. The movement-detecting device 160 may also detect other types of acceleration of the media-playback device and interpret the acceleration as indicating movement of the media-playback device 102 too.
The network access device 162 operates to communicate with other computing devices over one or more networks, such as the network 106. Examples of the network access device 162 include one or more wired network interfaces and wireless network interfaces. Examples of wireless network interfaces include infrared, BLUETOOTH® wireless technology, 802.11a/b/g/n/ac, and cellular or other radio frequency interfaces.
The network 106 is an electronic communication network that facilitates communication between the media-playback device 102 and the media-delivery system 104. An electronic communication network includes a set of computing devices and links between the computing devices. The computing devices in the network use the links to enable communication among the computing devices in the network. The network 106 can include routers, switches, mobile access points, bridges, hubs, intrusion detection devices, storage devices, standalone server devices, blade server devices, sensors, desktop computers, firewall devices, laptop computers, handheld computers, mobile telephones, vehicular computing devices, and other types of computing devices.
In various embodiments, the network 106 includes various types of links. For example, the network 106 can include wired and/or wireless links, including Bluetooth, ultra-wideband (UWB), 802.11, ZigBee, cellular, and other types of wireless links. Furthermore, in various embodiments, the network 106 is implemented at various scales. For example, the network 106 can be implemented as one or more vehicle are networks, local area networks (LANs), metropolitan area networks, subnets, wide area networks (such as the Internet), or can be implemented at another scale. Further, in some embodiments, the network 106 includes multiple networks, which may be of the same type or of multiple different types.
The sound-sensing device 164 senses sounds proximate the media-playback device 102 (e.g., sounds within a vehicle in which the media-playback device 102 is located). In some embodiments, the sound-sensing device 164 comprises one or more microphones. For example, the sound-sensing device 164 may capture a recording of sounds from proximate the media-playback device 102. These recordings may be analyzed by the media-playback device 102 using speech-recognition technology to identify words spoken by the user. The words may be recognized as commands from the user that alter the behavior of the media-playback device 102 and the playback of media content by the media-playback device 102. The words and/or recordings may also be analyzed by the media-playback device 102 using natural language processing and/or intent-recognition technology to determine appropriate actions to take based on the spoken words.
Additionally or alternatively, the sound-sensing device 164 may determine various sound properties about the sounds proximate the user such as volume, dominant frequency or frequencies, etc. These sound properties may be used to make inferences about the environment proximate to the media-playback device 102 such as whether the sensed sounds are likely to correspond to a private vehicle, public transportation, etc. In some embodiments, recordings captured by the sound-sensing device 164 are transmitted to media-delivery system 104 (or another external server) for analysis using speech-recognition and/or intent-recognition technologies.
The optical-sensing device 166 senses optical signals proximate the media-playback device 102. In some embodiments, the optical-sensing device 166 comprises one or more light sensors or cameras. For example, the optical-sensing device 166 may capture images or videos. The captured images can be processed (by the media-playback device 102 or an external server such as the media-delivery system 104 to which the images are transmitted) to detect gestures, which may then be interpreted as commands to change the playback of media content. Similarly, a light sensor can be used to determine various properties of the environment proximate the user computing device, such as the brightness and primary frequency (or color or warmth) of the light in the environment proximate the media-playback device 102. These properties of the sensed light may then be used to infer whether the media-playback device 102 is in an indoor environment, an outdoor environment, a private vehicle, public transit, etc.
The media-delivery system 104 comprises one or more computing devices and provides media content items to the media-playback device 102 and, in some embodiments, other media-playback devices as well. The media-delivery system 104 includes a media server 180. Although
The media server 180 transmits stream media 218 to media-playback devices such as the media-playback device 102. In some embodiments, the media server 180 includes a media server application 184, a travel server application 186, a customized program server application 187, a processing device 188, a memory device 190, and a network access device 192. The processing device 188, memory device 190, and network access device 192 may be similar to the processing device 154, memory device 156, and network access device 162 respectively, which have each been previously described.
In some embodiments, the media server application 184 accesses and streams music or other audio, video, or other forms of media content. The media server application 184 includes a media stream service 194, a media data store 196, and a media application interface 198. The media stream service 194 operates to buffer media content such as media content items 206, 208, and 210, for streaming to one or more streams 200, 202, and 204.
The media application interface 198 can receive requests or other communication from media-playback devices or other systems, to retrieve media content items from the media server 180. For example, in
In some embodiments, the media data store 196 stores media content items 212, media content metadata 214, and playlists 216. The media data store 196 may comprise one or more databases and file systems. As noted above, the media content items 212 may be audio, video, or any other type of media content, which may be stored in any format for storing media content.
The media content metadata 214 operates to provide various information associated with the media content items 212. In some embodiments, the media content metadata 214 includes one or more of title, artist name, album name, length, genre, mood, era, etc. In some embodiments, the media content metadata 214 includes characteristics about media content relevant to its appropriateness for certain travel conditions. In some embodiments, the media content metadata 214 records information about one or more users' preferences related to a media content item.
The playlists 216 operate to identify one or more of the media content items 212 and assemble the media content items together into a playlist. In some embodiments, the playlists 216 identify a group of the media content items 212 in a particular order. In other embodiments, the playlists 216 merely identify a group of the media content items 212 without specifying a particular order. Some, but not necessarily all, of the media content items 212 included in a particular one of the playlists 216 are associated with a common characteristic such as a common genre, mood, era, or appropriateness for particular travel conditions. The playlists 216 may include user-created playlists, which may be available to a particular user, a group of users, or to the public.
The travel server application 186 provides travel-specific functionality for providing media content items and interfaces for accessing media content items to media-playback devices. In some embodiments, the travel server application 186 includes a travel application interface 222 and a travel data store 224.
The travel application interface 222 can receive requests or other communication from media-playback devices or other systems, to retrieve travel information and media content items for playback during travel. For example, in
Additionally, the travel server application 186 can process data and user input information received from the media-playback device 102. In some embodiments, travel server application 186 operates to transmit information about the suitability of one or more media content items for playback during travel. In some embodiments, the travel server application 186 may provide a list of media content items that are suited to particular geographic locations, travel conditions, modes of travel, user preferences, etc.
For example, the travel server application 186 may store metadata and other information that associates media content items with geographic locations, forms of travel, route conditions, etc. in the travel data store 224. The travel server application 186 may also store information that associates media content items with an individual or group of users' preferences for consuming that media content during travel in the travel data store 224. The travel data store 224 may comprise one or more files or databases. The travel data store 224 can also comprise files, tables, or fields in the media data store 196.
In some embodiments, the travel data store 224 stores travel media metadata. The travel media metadata may include various types of information associated with media content items, such as the media content items 212. In some embodiments, the travel data store 224 provides information that may be useful for selecting media content items for playback during travel. For example, in some embodiments, the travel data store 224 stores travel scores for media content items that correspond to the suitability of particular media content items for playback during travel. As another example, in some embodiments, the travel data store 224 stores timestamps (e.g., start and end points) that identify portions of media content items that are particularly well-suited for playback during travel (or other activities).
The customized program server application 187 coordinates with the media server application 184 and travel server application 186 to build customized media programs to present to a user through the media-playback device 102. The customized program server application 187 selects media for a customized playlist for a specific travel route based on user preferences and communicates that playlist to the duration-based customized media program engine 108 through communication 238. In some embodiments, the customized program server application 187 includes a user preferences engine 226. The user preferences engine 226 operates to learn and store preferences of a user to determine media content items to include in a playlist or program. In some embodiments, the user preferences engine 226 includes a machine learning engine 228 and a user preferences data store 230. In some embodiments, the machine learning engine 228 operates to receive communication 238 regarding user selections that indicate preferences of the user. These preferences may be stored in the user preferences data store 230 along with preferences that may have been entered by the user or received from additional sources.
Additional sources may include databases of preferences of other users. Such preferences are recorded with the user's permission to improve the recommendations of media content that are provided. In some embodiments, demographic information is requested from other users to build a demographic preferences database. The demographic preferences database can be accessed by the user preferences engine 226 to determine one or more preferences of the user based on comparison to other users having similar age, gender, geography, income, taste in media content, type of car, and/or education level.
Each of the media-playback device 102 and the media-delivery system 104 can include additional physical computer or hardware resources. In at least some embodiments, the media-playback device 102 communicates with the media-delivery system 104 via the network 106.
Although in
In at least some embodiments, the media-delivery system 104 can be used to stream, progressively download, or otherwise communicate music, other audio, video, or other forms of media content items to the media-playback device 102 for playback during travel on the media-playback device 102. In accordance with an embodiment, a user U can direct the input 176 to the user interface 168 to issue requests, for example, to playback media content for playback during travel on the media-playback device 102.
The user preferences engine 302 operates to access and apply previously determined user preferences to the selection of content for a customized media program. The user preferences may be accessed from a database such as the user preferences data store 230 described in
The duration engine 304 operates to determine a duration for the customized program. In some embodiments, the duration engine 304 receives a selected duration from the user through the user interface 112. This duration will remain fixed unless modified by the user. In some embodiments, the duration can change due to interruptions to playback of the playlist such as receiving a phone call or pausing the playlist.
In other embodiments, the duration engine 304 communicates with the navigation application 171, which is described further in
The news engine 306 operates to access and select news content for the customized media program. The memory device 156 encodes instructions to determine one or more news content items, weather content items, and traffic content items to include in the customized playlist of media content items. The news content is accessed through the media-delivery system 104 which receives the news content from one or more external content sources 232. The external content sources 232 provide updated news content that may be accessed in real-time during playback or in advance of building the playlist. In preferred embodiments, news content is streamed at the time of playing the media program to provide the most up to date information. The external content sources 232 are further described in
The news engine 306 operates in conjunction with the user preferences engine 302 and the duration engine 304 to select appropriate types and amounts of news content items to include in a customized program. News content items include one or more of traffic reports, weather reports, world news stories, national news stories, regional news stories, local news stories, sports news stories, business news stories, politics news stories, entertainment news stories, and parking reports.
The entertainment engine 308 operates to access and select entertainment content for the customized media program. The memory device 156 encodes instructions to determine one or more audio book content items, music content items, and podcast content items to include in the customized media program. The entertainment content is accessed by communicating with the media server application 184. Media content items 212, media content metadata 214, and playlists 216 are accessed from the media data store 196 and communicated back to the duration-based customized media program engine 108. In some embodiments, entertainment content is accessed from device memory, for example, at the media content cache 173. In other embodiments, the entertainment content is streamed from the media stream service 194. The media content items 212 may include audio files and video files for music, music videos, podcasts, audiobooks, comedy programs, television shows, movies, and other types of entertainment. The entertainment engine 308 operates in conjunction with the user preferences engine 302 and the duration engine 304 to select appropriate types and amounts of entertainment content to include in a customized program.
In some embodiments, the radio personality engine 310 operates to provide spoken content to accompany the customized playlist of media content items in the form of a “radio personality.” Spoken narration is provided between media content to greet the user and introduce each segment of content. The spoken word content may be prerecorded or may be generated with speech synthesis.
The routing engine 402 operates to determine routes from one location to a destination. Typically, the route is from a user's location to a user input destination. The routing engine 402 communicates with the location determining engine 404 to determine the location of the media-playback device 102. The routing engine 402 may determine more than one appropriate route to a destination. A user may select from multiple route options. Alternatively, the routing engine 402 may automatically select the fastest route. The routing engine 402 also determines a duration of the route.
The location determining engine 404 operates to determine the current location of the media-playback device. The location determining engine 404 communicates with the location-determining device 150 of
The traffic monitoring engine 406 operates to monitor traffic conditions along the route. In the event that traffic conditions change affecting the duration of the route, the navigation application 171 will communicate an update to the duration-based customized media program engine 108. Additionally, the traffic monitoring engine 406 determines the travel conditions for the route. In some embodiments the travel conditions of a route are used to determine appropriate entertainment and news content to include in a customized program. If the traffic monitoring engine 406 detects a change in traffic, this may be communicated to the duration-based customized media program engine 108 to prompt a change in the media content included in the program presented to the traveling user.
The local news source 502 includes local news stories and may include news stories relevant to the local area of the user, such as a metropolitan area or town. The world news source 504 includes news stories from across the world. The weather news source 506 provides weather updates for the user's general geographic area. These updates may be specific to a zip code, a city, or a region. The traffic news source 508 provides traffic news updates that are relevant to the user. The updates may be relevant to the user's metropolitan area or the user's planned route.
At operation 802, the duration of the customized media program is determined. The duration determines the amount of media content that can be included in the program.
At operation 804, a customized media program is built including one or more items of media content to fit the specified duration. Multiple factors may be considered, which are further discussed with reference to
At operation 806, the customized program is played for the user. In some embodiments, the program is played directly from the content output device 158 of the media-playback device 102. In other embodiments, the program is played through a vehicle media-playback system 264 or other external audio output devices, such as Bluetooth speakers.
At operation 902, the mode of travel of the user is determined. In some embodiments the user is driving a vehicle. In other embodiments, the user is traveling as a passenger in a private vehicle, in a taxi, in a train, in a bus, in a boat, or in a plane. In some embodiments, the user is traveling by means of bicycling, running, walking, skiing, or other modes of recreational travel. Finally, the user may not be traveling at all and simply wishes to listen to a customized media program of a particular duration. As is illustrated in
At operation 904, it is determined whether the user is traveling along a defined route. Generally, this is determined by prompting the user to input a destination. As was mentioned above, the user may not be traveling at all, in which case there is no defined route. Additionally, even though the user may be traveling by a particular method, the route may not define the duration of the program. In such instances the user typically provides some input to indicate that a route is not being utilized and the method proceeds to operation 912. However, if the user is traveling to a particular destination along a particular route, the method proceeds to operation 906.
At operation 906, the user inputs the destination to which he or she is traveling. The destination may be the name of a location, an address, or an intersection. The user inputs the destination into the media-playback device 102 through the user interface 112 or by speaking the destination which is received by the sound-sensing device 164.
At operation 908, a route to the destination is determined. The navigation application 171 receives the user input destination and determines one or more routes to the destination.
At operation 910, the duration of the route is determined. The navigation application 171 calculates the estimated duration of the route based on the distance and traffic conditions along the route.
For instances where the user has not input a destination, the method proceeds from operation 904 to operation 912. At operation 912, a duration is received from the user. The user may input a desired duration of the customized media program into the media-playback device 102 through the user interface 112 or by speaking the duration which is received by the sound-sensing device 164. For example, the user may be planning to run on a treadmill for 30 minutes and wishes to listen to a customized media program that lasts for the duration of the run. In this instance the user may use the touch screen 152 to input a duration of 30 minutes.
At operation 1202, the driving conditions of the route are determined. This determination is made in conjunction with the navigation application 171 which accesses map information and traffic information from external sources. The driving conditions may be influenced by the type of road, traffic, weather, and other factors which are further discussed with respect to
At operation 1204, the appropriate type of media for each portion of the route are determined. The appropriate media is selected based on various factors, including those described in
At operation 1206, user preferences are determined. User preferences influence media selection in a number of ways, which are further described with respect to
At operation 1208 entertainment and news content are selected based on the route and the user's preferences. In some embodiments, entertainment content is retrieved from the media data store 196. Media may be downloaded to the media-playback device 102 or streamed using the media stream service 194. In some embodiments, news content is accessed from the external content source 232. The external content source 232 provides various types of news relevant to the time that the playlist is being generated. The types of news content are described further in
At operation 1210, the media program is generated, placing the entertainment and news media items together in a particular order. In some embodiments a radio personality may be integrated into the program to provide narration and commentary between entertainment and news media items. In some embodiments the media program may be generated in advance of the user traveling. In such instances, the program may be cached to the media-playback device 102 so that the user does not have to rely on a data connection to stream the media content. Additional media content can be cached in case the program needs to be extended in duration. The news content is accessed and downloaded at the time the program is downloaded. In other embodiments, the media program may be generated as the user is beginning his or her travels. The user may have entered a destination and has started to travel along the route. The program is generated and begins to play as the user is traveling and the media content may be streamed or may be accessed from the memory device 156 of the media-playback device 102. News content is then accessed at the time the playlist is generated or even as the news content is being played for the user.
At operation 1302, the mode of travel of the user is determined. The mode of travel may be selected from driving, biking, running, and the like. In some embodiments, the mode of travel is determined as described with respect to operation 902 of
At operation 1304, the type of road or path is determined. This determination may be made for multiple segments within the same route. Each route may have multiple types of roads or paths. Each segment of the route is analyzed. For example, a route may begin with suburban streets, then transition to a gravel road in the country, and then end with an interstate. While running, a user may be on a paved running path, a trail through the woods, a county road, and the like. For example, for driving a vehicle, the types of roads may include suburban streets, county roads, city streets, highways, and interstates. Driving on a city street in an area with a lot of pedestrians may require more attention from a driver than a straight stretch of interstate highway with light traffic. In some embodiments, the route may take the user on a bike trail or sidewalk if the user is running, biking, or the like. Running on a controlled path will typically require less attention than running on or near streets with heavy vehicular traffic.
At operation 1306, the traffic conditions along the route are determined. The duration-based customized media program engine 108 may communicate with the traffic monitoring engine 406 of the navigation application 171 to determine current traffic conditions along the route. Greater amounts of traffic require more attention from the traveling user than routes with less traffic.
At operation 1308, the weather conditions along the route are determined. The user requires less attention to travel in good weather than in bad weather. For example, traveling in a thunderstorm requires more attention than traveling on a sunny day, affecting the type of media content that is chosen for the customized media program. The weather conditions may be determined by accessing a weather news source from the external content source 232. In some embodiments, weather conditions along a route may be inferred from traffic information obtained from the navigation application 171.
At operation 1310, the level of attention required for the route is determined. The factors in operations 1302, 1304, 1306, and 1308 are combined to determine how much attention is required of the user while traveling along each segment of a route. The level of attention may differ at each segment of the route. For instance, a segment of driving on a county road with little traffic during favorable weather conditions will require very little attention from the driver, allowing him or her to focus on more content-heavy media items. However, a segment of driving on a crowded freeway while it is sleeting will require most of the driver's attention, leaving little remaining to focus to media content.
At operation 1402, the preferred type of media content to play at that time of day for that type of route for that user is determined. As was just discussed, there are various attributes of routes that can be considered when choosing media content for a customized program. In addition, each user may have preferences regarding types of media content to be playing at particular times or with certain route conditions. For example, a user may prefer to listen to rock music during a morning commute, but prefers jazz music during an evening commute. In another example, a user may prefer to listen to audiobooks during long trips, but prefers news stories for short trips. In yet another example, a user may prefer to listen to podcasts during portions of routes with less traffic and classical music for portions of routes with heavy traffic. In yet another example, a user may prefer to listen to more news content in the morning and more music content in the afternoon. Such preferences can be determined directly with user input or may be inferred by machine learning or extrapolating the user's other preferences to apply to other aspects of the program. In some embodiments, preferences of other users may be accessed to infer the user's preferences, particularly when the user and the other users have one or more attributes in common.
At operation 1404, the user's news content preferences are determined. The preferences of the user may be inferred from other preferences, learned by machine learning, or determined by receiving input from the user. Preferences may include an amount of news content to include in a customized playlist, whether the user prefers to only hear headlines or wants to hear full stories, the types of news content to include, and which geographic area is of interest to the user. Input could be received from the user in advance of building a playlist or may be received from the user during playback of a customized playlist. For instance, if the user opts to skip sports news three days in a row, the user preferences engine 226 will determine that sports news should no longer be included in the user's customized media program. Alternatively, the user preferences engine 226 could prompt the user for feedback after skipping sports news the first time to determine if the user would always like to skip sports news. In some embodiments, the user preferences engine 226 may prompt the user to select alternative news content to replace the skipped content, such as arts and culture news. In yet another embodiment, the user may simply enter a preference to skip sports news content by selecting one or more preferences in a setup page of the customized program server application 187.
At operation 1406, the user's entertainment content preferences are determined. These preferences may include whether the user prefers music over podcasts or audiobooks. Other preferences may include preferred genres of music, preferred musical artists, preferred songs, preferred genres of audiobooks, preferred authors of audiobooks, preferred types of news content, the user's listening preferences based on time of day, preferred types of videos, preferred sports teams, preferred amounts of news and entertainment content, preferred geographic area, and preferred types of content. The entertainment preferences of the user may be determined by user input, machine learning, or by accessing the user preferences data store 230. The user's previous media content listening behavior and preferred media content playlists can influence the user's preferences for entertainment content. The previous listening behavior can be while traveling, not while traveling, or both.
At operation 1408, the user's current location in audiobooks and/or podcasts is determined. When a user is in progress of listening to a long item of media content, the duration-based customized media program engine 108 can determine the point in the media at which the user stopped listening and resume the media at that same point. Metadata is utilized to mark the stopping point of the user in the audiobook and/or podcast. If the user is not currently listening to an audiobook or podcast, this content may be skipped or an audiobook or podcast may be suggested to the user based on past listening behavior and preferences.
At operation 1410, the amount of news content and the amount of entertainment content to include in the program is determined. The user may prefer to hear mostly entertainment content, mostly news content, or a blend of the two. In some instances, these preferences may be determined based on the duration of the customized media playlist or the time of day. In some embodiments, more media content is selected than is needed to fill a particular duration in order to have backup content in case any media content is skipped or the duration of the program increases. Such preferences may be stored in the user preferences data store 230.
At operation 1412, the user's favorite uplifting media content is determined. The uplifting media content may be a favorite song, an upbeat song, a comedy show segment, a motivational speech, and the like. The user's preferences may be determined by previous listening behavior, machine learning, or user input.
One technique for identifying uplifting media content, or media content having any other desired characteristic, is to build and train computer models that can then be used to identify media content having the desired characteristics. Techniques for building models and training are described in U.S. Patent Application No. 62/347,642, filed Jun. 9, 2016 and titled Identifying Media Content, the disclosure of which is incorporated by reference herein in its entirety. These same techniques can be used by the system 100 disclosed herein for identifying media content items having desired characteristics.
In some embodiments, the customized media program duration may be adjusted in response to user input or changes in the route a user is traveling on.
At operation 1902, the navigation application 171 communicates a notification to the duration-based customized media program engine 108 that the duration of the route has changed. The duration may increase or decrease depending on driving conditions, detours, or stops made along the route.
At operation 1904, the duration-based customized media program engine 108 determines whether the customized media program needs more or less media content. Media content may be added or removed at any point in the program.
At operation 1906, the duration-based customized media program engine 108 determines which type of content should be added or removed based on the driving conditions and user preferences. In some embodiments, media content is preferably removed from the middle of the program so that the program can begin with important information and end with uplifting media content.
At operation 1908, the selected content is added or removed to adjust the customized media program duration to match the route duration.
At operation 2002, the media content in the customized media program is played.
At operation 2004, if a skip command is received from the user, the playback process continues to operation 2006 to skip and replace media content within the playlist. This operation 2006 is further described in
At operation 2008, if notification of a detour is received from the navigation application 171, the playback continues to operation 2010. The detour operation 2010 is further described in
At operation 2012, if playback is interrupted for any reason, the playback process continues to the interruption operation 2014. This operation 2014 is further described in
At operation 2102, input is received from the user to skip one or more media content items. The user may skip one media content item at a time or may skip a whole segment of media content. For example, the user could be listening to a news story and wishes to skip ahead. The user could indicate whether to skip just that one news story or skip the whole news section of media content that is upcoming in the customized media playlist. In some embodiments this input is received through the touch screen 152 or the sound-sensing device 164 of the media-playback device 102.
At operation 2104, the media content item is removed from the customized media program.
At operation 2106, the user is optionally prompted to provide feedback on the user's preference for skipping or replacing the media content. The user may be requested to select a type of replacement content or be asked if that particular type of content should always be skipped in future programs. In other embodiments, the duration-based customized media program engine 108 may automatically replace the skipped media content with new replacement content. The replacement content is determined by accessing the user's preferences.
At operation 2108, appropriate replacement media content is determined to replace the removed media content item. The appropriate replacement media content item is selected based on route conditions and user preferences, as described in
At operation 2110, the media content is replaced in the customized media program. The replacement media content may be streamed from the media stream service 194 or accessed from the media-playback device 102 memory device 156.
At operation 2602, a detour notification is received from the navigation application 171. The detour could be caused by traffic, road construction, or even the user taking a wrong turn.
At operation 2604, the duration engine 304 of the duration-based customized media program engine 108 determines if the detour has affected the duration of the route. Typically, a detour will result in the duration of the route increasing.
At operation 2606, the duration-based customized media program engine 108 determines if additional media content is needed. If the duration has increased, more media content will need to be added to the program to last for the new duration of the route.
At operation 2608, the news engine 306 and entertainment engine 308 of the duration-based customized media program engine 108 select additional media content to include in the customized media program. These selections are based upon the same criteria discussed in
At operation 2610 the additional media content is played along with the rest of the customized media program.
At operation 2902, a notification of an interruption is received by the duration-based customized media program engine 108. The interruption may be an operation performed on the media-playback device 102 that interrupts playback, such as receiving a phone call. Alternatively, the interruption could be instigated by the user. The user could pause playback of the media program for any number of reasons.
At operation 2904, playback of the customized media program is paused.
At operation 2906, the customized media program engine 108 determines how much media content needs to be removed in response to the interruption. This may be a continuously updating process, or may occur after playback of the program has resumed.
At operation 2908, the customized media program engine 108 determines which media content items to remove from the playlist in response to the interruption. Preferably, the media content items are chosen from the middle of the playlist so that key portions of the media program at the beginning and end of the playlist are not disrupted.
Adjustments to the media program such as those described in
As noted previously, although many of the examples provided above are described with respect to traveling in a vehicle, other embodiments relate to other forms of travel or even other types of activities.
The various embodiments described above are provided by way of illustration only and should not be construed to limit the claims attached hereto. Those skilled in the art will readily recognize various modifications and changes that may be made without following the example embodiments and applications illustrated and described herein, and without departing from the true spirit and scope of the following claims.
This application claims priority to U.S. Application No. 62/441,266, filed on Dec. 31, 2016, and titled DURATION-BASED CUSTOMIZED MEDIA PROGRAM, the disclosure of which is hereby incorporated by reference in its entirety.
Number | Name | Date | Kind |
---|---|---|---|
9164996 | Jellison, Jr. | Oct 2015 | B2 |
9229938 | Jaini | Jan 2016 | B1 |
9288254 | Sharkey | Mar 2016 | B2 |
9390757 | Shahraray | Jul 2016 | B2 |
20130005465 | Murphy | Jan 2013 | A1 |
20130253833 | Tuukkanen | Sep 2013 | A1 |
20140181656 | Kumar | Jun 2014 | A1 |
20140281971 | Isbell, III | Sep 2014 | A1 |
20140307878 | Osborne | Oct 2014 | A1 |
20150032366 | Man | Jan 2015 | A1 |
20150032769 | Rose | Jan 2015 | A1 |
20150178280 | DiMaria | Jun 2015 | A1 |
20150213018 | Sanio | Jul 2015 | A1 |
20160150020 | Farmer | May 2016 | A1 |
20170041680 | Lewis | Feb 2017 | A1 |
20170094363 | Miller | Mar 2017 | A1 |
20170134498 | Mitchell | May 2017 | A1 |
20170242656 | Plagge | Aug 2017 | A1 |
20170366861 | Chung | Dec 2017 | A1 |
20180089453 | Scholz | Mar 2018 | A1 |
Number | Date | Country |
---|---|---|
2402872 | Jan 2012 | EP |
2857988 | Apr 2015 | EP |
WO-2008033472 | Mar 2008 | WO |
Number | Date | Country | |
---|---|---|---|
20180188054 A1 | Jul 2018 | US |
Number | Date | Country | |
---|---|---|---|
62441266 | Dec 2016 | US |