Methods and apparatus for visualizing a music library

Abstract
Visualizing and exploring a music library using metadata, such as genre, sub-genre, artist, and year, is provided. Geometric shapes, such as disks or rectangles, may be divided into sectors representing genre and each sector may be further divided into sub-sectors representing artists associated with each genre. The sector's relative size generally reflects the importance of the corresponding genre within the library. Likewise, the sub-sector's relative size generally reflects the importance of the corresponding artist within the genre which may be determined by the number of media items of the artist. Marks representing each media item may be arranged and displayed within the geometric shape to reflect the mark's corresponding genre, artist, and year. In addition, each mark may reflect an attribute, such as playcount, of the media item and each sector may reflect the mean value of an attribute of all media items within the sector.
Description
BACKGROUND

This application relates to methods and apparatus for providing a graphical representation of a music library.


Effectively organizing a music library not only allows a user to get a sense of music contained in the library, but also helps them select and play the music. However, the popularity of digital audio encoding together with music distribution channels through the Internet have allowed users to collect hundreds or even thousands of media items. This change in scale of accessible music from the traditional album to thousands of songs makes choosing what music to listen to at a particular moment a challenge.


Digital media players, such as iTunes 10 of FIG. 1 introduced by Apple Computer, Inc., Cupertino, Calif., USA, allow users to play and organize digital music and video files using textual lists. Each item of the list may be categorized by track title 12, track length 14, artist 16, album 18, year released 20, genre 22, and composer 24. Track lists can be ordered alphanumerically by categories such as title 12, artist 16, album 18, or genre 22 for example. Search bar 26 may be used to perform a keyword-based search by one or more category, such as artist 16, album 18, or track title 12. Tracks may also be filtered using a genre filter 28, artist filter 30, or album filter 32, or all three filters may be used at the same time. For example, the user can filter all tracks by (1) Jazz using genre filter 28, (2) Billie Holiday using artist filter 30, and (3) Lady in Satin using album filter 32. Results from the filters are displayed in a results window 34 and may be ordered alphanumerically by one or more category, such as artist 16, album 18, or track title 12.


Playlists are also known to help organize and manage music libraries. A playlist is a subset of a library that defines an ordered sequence of media items to be played and are usually created by adding media items to the playlist one-by-one. A smart playlist follows a set of logical filtering criteria, such as all jazz from 1970 that were played in the last six months. Playlists may be generated in iTunes 10 using two different methods: (1) adding media items manually in a one-by-one manner; and (2) defining filtering criteria, such as artist 16, album 18, or track title 12, to create smart playlist 36. The smart playlist may automatically update when new media items are added to the library.


Playlists are also known to be automatically generable. PATS: Realization and User Evaluation of an Automatic Playlist Generator of Pauws et. al. refers to a Personalized Automatic Track Selection (PATS) that creates a playlist using a dynamic clustering method. Songs are grouped based on a similarity measure that selectively weighs categorization values of songs, such as track title, year released, album, style, tempo, instruments used, place of recording, record company, or rhythmic foundation. The similarity measure is selective in the sense that one categorization value may be more important than another. When the user selects a song, the cluster in which the song is contained is presented as a playlist. An inductive learning algorithm is used to eliminate tracks from future playlists based upon user input.


In addition, analyzing media items based on signal processing techniques are known to allow the user to organize and visualize a music library. However, these methods analyze each media item using signal processing techniques without requiring categorization based on genre, artist, and year.


Furthermore, visualizing search results is known to help users browse for digitized music. Variations2: Toward Visual Interfaces for Digital Music Libraries of Notess et. al. refers to visualizing music bibliographic data to assist music students and faculty members browse and search for digitized music. By way of example, a student may search for works by creator and instrumentation used. The results of the search are displayed with a grid-based visualization that uses icon shape to represent media type, such as audio, score, or video, color to represent the performer, and position within the grid to indicate both work genre (x-axis) and composer/work (y-axis). Hovering over an object gives details on the performer, for example.


However, each one of these references suffers from one or more of the following disadvantages: (1) the user does not have an overall feel for how many media items are in the music library; (2) the user cannot intuitively see what portion of the library represents a rock genre versus an easy listening genre, for example; (3) the user cannot easily see desired attributes about each media item in relation to the library as a whole, such as which media items they listen to most often; (4) the user cannot easily visualize, manage, or organize playlists; and (5) the user cannot easily rediscover media items in their music library or know which portion of their music library needs expansion.


The present inventors have recognized a need for improved apparatus and methods for providing a graphical representation of a music library.





BRIEF DESCRIPTION OF THE DRAWINGS

Features, aspects, and advantages of the present invention are set forth in the following description, appended claims, and accompanying drawings wherein:



FIG. 1 shows a user interface for iTunes of the prior art;



FIG. 2 shows a disk visualization of a music library according to a first embodiment;



FIG. 3 shows the disk visualization of FIG. 2 with a mean value of a playcount of all media items within a sector illustrated;



FIG. 4 shows the disk visualization of FIG. 2 having a graphical representation of playlists overlaid thereon;



FIG. 5 shows a rectangular visualization of a music library according to a second embodiment;



FIG. 6 shows the rectangular visualization of FIG. 5 with a mean value of a playcount of all media items within a sector illustrated;



FIG. 7 shows the rectangular visualization of FIG. 5 having a graphical representation of playlists overlaid thereon;



FIG. 8A shows a Tree-Map visualization of a music library according to a third embodiment;



FIG. 8B shows a Tree-Map visualization for the rock genre of FIG. 8A;



FIG. 8C shows a Tree-Map visualization for the rock and roll sub-genre of FIG. 8B.





DETAILED DESCRIPTION OF PREFERRED EMBODIMENTS

Throughout the specification, reference to “one embodiment,” “an embodiment,” or “some embodiments” means that a particular described feature, structure, or characteristic is included in at least one embodiment. Thus appearances of the phrases “in one embodiment,” “in an embodiment,” or “in some embodiments” in various places throughout this specification do not necessarily refer to the same embodiment.


Furthermore, the described features, structures, and characteristics may be combined in any suitable manner in one or more embodiments. Skilled persons will appreciate that the invention can be practiced without one or more of the specific details, or with other methods, components, materials, etc. In some instances, well-known structures, materials, and operations are omitted or not described in detail to avoid obscuring aspects of the embodiments.



FIG. 2 shows a disk visualization 40 of a music library according to a first embodiment. Disk visualization 40 includes a plurality of sectors 50 representing genre of the music library, one or more sub-sectors 60 representing artists associated with the genre, radii 70 representing a time axis, and a plurality of marks 100 corresponding to each media item of the music library. Disk visualization 40 may not only provide an overview of the total number of media items in the music library but may also provide good percentage and proportional overviews. In addition, disk visualization 40 may allow one or more playlists 110 to be visualized, managed and organized. Furthermore, disk visualization 40 may facilitate rediscovering media items in a music library instead of simply enlarging it. Therefore, when the time comes to expand the music library, disk visualization 40 may be helpful in deciding what to acquire or listen to next.


Referring now to FIG. 2, disk visualization 40 is divided into different sectors 50 that represent each genre of the library. For example, the music library illustrated in the embodiment of FIG. 2 is categorized into nine genres: (1) Rock genre 112; (2) Soundtrack genre 114; (3) Easy listening genre 116; (4) Electronica/dance genre 118; (5) Jazz genre 120; (6) Latin genre 122; (7) Pop genre 124; (8) Alternative and punk genre 126; and (9) R&B genre 128. The music library could also be classified into other genres, such as Classical music, Gospel, Blues, Rhythm and blues, Funk, Metal, Country music, Electronic music, Melodic music, Ska, Reggae, Dub, Hip hop, and Contemporary African music.


The size of each sector 50 may be proportional to the number of media items of the associated genre with respect to the whole library. Therefore, the size of each sector 50 may be directly proportional to the importance of the corresponding genre within the library. At the same time, sectors 50 may be split in sub-sectors 60 representing the artists of the associated genre. Again, the size of sub-sectors 60 may be proportional to the number of media items of the artist. The radii 70 of disk visualization 40, from the center 80 to the perimeter 90, could illustrate a time axis. In addition, the center 80 could represent the year of the oldest possible media item of the library and the perimeter 90 could represent the most recent media items in the library. While year may be described primarily in relation to a year an album was released, it is to be appreciated that year can include the year a media item was released, for example.


In addition, although media items may be described primarily in relation to songs or music tracks, it is to be appreciated that media items can include, but are not limited to, songs, tracks, music CDs, movies, music videos, documents, books, poems, and images (e.g., photographs), for example. Media items may be depicted as marks 100 and can be arranged within disk visualization 40 according to the media item's categorization. For example, the media items of the library may be categorized according to genre, artist, and year of release. Further categorizations may include title of the media item, album, style or era, tempo, musicians featured in the media item, instruments used in the media item, total number of musicians, soloing musicians, composer of the media item, producer of the media item, where the media item was recorded, whether the media item is a live performance, record company, rhythmic foundation, and melodic/harmonic development. In one embodiment, media items belonging to the same album are positioned contiguously thereby having the effect of producing arcs of points 130 representing albums. In addition, albums may be depicted in alphanumeric order and media items of the same album may be ordered in the original order of the album.


Quantitative attributes 132 may be chosen by the user. For example, quantitative attributes 132 may include playcount 134, rating 136, last played date 138, and added date 140. In addition, other quantitative attributes 132 may include ratings and reviews assigned by critics, artists, or others, or artists having new media items forthcoming. The quantitative attributes 132 may be depicted by marks 100 and colors may be used to express the exact value for one media item in its associated mark 100. For example, each mark 100 could have different color or grayscale tonalities indicative of quantitative attribute 132. By way of example, if the quantitative attribute 132 is playcount 134, a spectrum from light blue to black may be used. Marks 100 colored light blue could represent the most played media items, marks 100 colored black could represent the least played media items, and marks 100 colored according to another part of the spectrum could fall in between the most played and least played media items. In addition, each mark 100 could have a unique identification code 142, such as A, B, and C. By way of example, if the quantitative attribute 132 is playcount 134, A could represent the most played media item, C could represent the least played media item, and B could represent a media item falling in between the least played and most played.


Referring now to FIG. 3, a mean value of all the media items for one genre may be used to color a corresponding sector 50. For example, each sector 50 could have different color or grayscale tonalities indicative of the mean value of the playcount 134 of all media items within that sector 50. Again, a spectrum from light blue to black may be used, but other colors would be suitable. Sectors 50 colored light blue could represent sectors 50 having the most played media items, sectors 50 colored black could represent sectors 50 having the least played media items, and sectors 50 colored according to another part of the spectrum could represent sectors 50 having media items with a playcount falling between the most played and least played. In addition, each sector 50 could also be shaded with unique patterns 144 as shown in FIG. 3. By way of example, sectors 50 represented by a first unique pattern 146 could represent sectors 50 having the most played media items. In a similar manner, sectors 50 represented by a second unique pattern 148 could represent sectors 50 having media items with a playcount falling between the most played and least played. Finally, sectors 50 represented by a third unique pattern 150 could represent sectors 50 having the least played media items.


Referring now to FIG. 4, playlists 110 are shown using the disk visualization 40. Playlists 110 may be created by adding media items in a one-by-one manner, or they could be smart playlists following a set of logical filtering criteria. Media items of playlists 110 without any grouping logic may be depicted using geometric forms different from marks 100, which are used in general for the rest of the media items. For example, jogging playlist 152 could be displayed using diamond shapes 154. While, diamond shapes 154 are colored black, other shapes, sizes, colors or shading could be used. Likewise, 25 last played playlist 156 could be represented using black crosses 158. Again, other shapes, sizes, colors or shading could also be used. Other playlists 110, including 60's and 70's music playlist 160, Bruce Springsteen playlist 162, and R.E.M. after 1990 playlist 164, may be shown as shaded regions since they follow a regular geometric form. In one embodiment, red shaded regions are used, but other colors, shading patterns, or indicia could also be used. Rolling Stones & Beatles playlist 166 and 80's pop music playlist 168 are not highlighted in the embodiment shown in FIG. 4 because the user has not activated the corresponding checkboxes 170.


Disk visualization 40 may also indicate currently playing media item 172. For example, currently playing media item 172 could be displayed using a circular shape. While, the circular shape illustrating currently playing media item 172 is colored black, other shapes, sizes, colors or shading could be used. Furthermore, path 174 grouping media items to be played next could be displayed. In this manner, the user could get an idea of what regions of the library are going to be used in the current music sequence, such as playlist 110.


The user may interact with disk visualization 40 in a number of ways, including navigating media items, zooming over one or more sectors 50, managing playlists 110, and searching for media items. For example, additional information about any media item in the library may be visualized by positioning a cursor 176 over the mark 100 representing the media item. As illustrated in FIG. 2, cursor 176 is positioned over the media item I don't want a lover by Texas. Metadata, such as media item attributes, could be indicated in media item title field 178, artist name field 180, album name field 182, and year released field 184. In addition, an album cover field 186 may provide a visual indication of cover art associated with the album indicated in album name field 182.


If cursor 176 is positioned over one of sectors 50, the artist of corresponding sub-sector 60 may be highlighted. For example, as shown in FIG. 2, cursor 176 is over sector 50 representing the pop genre 124 and sub-sector 60 representing the group Texas. The name of the artist may be displayed in a sub-sector name field 188 as illustrated in FIG. 2. Likewise, the year of release may be highlighted with dashed-circle 190 and the actual year displayed in year field 192. In this manner, the user could see other media items released in the same year.


The user may also zoom over any sector 50 of the disk visualization 40 to get a more detailed view of the library. When the zoom feature is activated, a second disk visualization (not shown) could be generated with similar visualization and interaction principles but applied to the genre of selected sector 50. The second disk visualization may be displayed proximate disk visualization 40 or disk visualization 40 may simply be updated with new information. By way of example, if the user zooms over sector 50 representing pop genre 124, sectors 50 of disk visualization 40 representing genres may become sectors (not shown) representing artists. Likewise, sub-sectors 60 of disk visualization 40 representing artists may become sub-sectors (not shown) representing albums. All the other dimensions and general principles may remain the same.


The user may perform another level of zoom by selecting another sector of the second disk visualization. This could generate a third disk visualization (not shown) with similar visualization and interaction principles but applied to the artist of the selected sector. The third disk visualization may be displayed proximate the second disk visualization or the second disk visualization may simply be updated with new information. By way of example, if the user zooms over the sector representing the group Texas, sectors of the second disk visualization representing artists may become sectors (not shown) representing albums. In the third disk visualization, there may be no sub-sector, but the user could obtain a graphical representation of the media items for a given artist.


Referring again to FIG. 4, disk visualization 40 may not only be used to graphically display playlists 110, but may also be used to edit or create new playlists 110 using the graphical display. For example, playlists 110 may be considered as sets and new playlists 110 may be formed using set operations. By way of example, the user could select multiple playlists 110, such as the 60's and 70's music playlist 160 and the Bruce Springsteen playlist 162, and apply set operations, such as union, intersection, difference, or complements. The resulting playlists 110 could graphically displayed.


In addition, when creating or editing playlists 110 by directly selecting media items or by constructing a set of logic rules for smart playlists, the disk visualization 40 may be helpful by showing playlist 110 being created step-by-step. This may not only allow the user to immediately see the new playlist 110 take form, but it may also allow the user to see changes to the new playlist 110 in a real-time manner. Furthermore, the user can also approximate the size and topology of the new playlist 110 which provides a better idea of the zones of the library that are overused or underused, or the zones implied in each playlist 110.


Furthermore, the user may also search for media items using search bar 194. In response to the search, results may be dynamically filtered and highlighted on disk visualization 40.



FIGS. 5, 6, and 7 show a rectangular visualization 200 of a music library according to a second embodiment (in FIGS. 5, 6, and 7 reference numerals with the prime symbol, e.g., 50′, indicate elements similar to those of the same name in the first embodiment, i.e., sectors 50). Rectangular visualization 200 includes a plurality of sectors 50′ representing genre of the music library, one or more sub-sectors 60′ representing artists associated with the genre, lines 202 representing a time axis, and a plurality of marks 100′ corresponding to each media item of the music library.


Although a sector may be described as a plane figure bounded by two radii and the included arc of a circle, it is to be appreciated that sector may be described as a division into sectors, portions, or contiguous subparts, for example. Referring now to FIG. 5, rectangular visualization 200 is divided into different sectors 50′ that represent each genre of the library. For example, the music library illustrated in the embodiment of FIG. 5 is categorized into nine genres: (1) Rock genre 112′; (2) Soundtrack genre 114′; (3) Easy listening genre 116′; (4) Electronica/dance genre 118′; (5) Jazz genre 120′; (6) Latin genre 122′; (7) Pop genre 124′; (8) Alternative and punk genre 126′; and (9) R&B genre 128′.


The size of each sector 50′ may be proportional to the number of media items of the associated genre with respect to the whole library. Therefore, the size of each sector 50′ may be directly proportional to the importance of the corresponding genre within the library. At the same time, sectors 50′ may be split in sub-sectors 60′ representing the artists of the associated genre. Again, the size of sub-sectors 60′ may be proportional to the number of media items of the artist. Lines 202 of rectangular visualization 200 illustrate parallel lines of equal length defining sectors 50′. Bottom side 204 and top side 206 illustrate a time axis. For example, bottom side 204 could represent the year 1956 while top side 206 could represent the year 2004. In this manner, bottom side 204 may represent the year of the oldest possible media item of the library and top side 206 may represent the most recent media items in the library.


Media items may be depicted as marks 100′ and are arranged within rectangular visualization 200 according to the media item's categorization. For example, the media items of the library may be categorized according to genre, artist, and year of release. Further categorizations may include title of the media item, album, style or era, tempo, musicians featured in the media item, instruments used in the media item, total number of musicians, soloing musicians, composer of the media item, producer of the media item, where the media item was recorded, whether the media item is a live performance, record company, rhythmic foundation, and melodic/harmonic development. In one embodiment, media items belonging to the same album are positioned contiguously thereby having the effect of producing a line of points 210 representing albums. In addition, albums may be depicted in alphanumeric order and media items of the same album may be ordered in the original order of the album.


Quantitative attributes 132′ may be chosen by the user. For example, quantitative attributes 132′ may include playcount 134′, rating 136′, last played date 138′, and added date 140′. In addition, other quantitative attributes 132′ may include ratings and reviews assigned by critics, artists, or others, or artists having new works forthcoming. The quantitative attributes 132′ may be depicted by marks 100′ and colors may be used to express the exact value for one media item in its associated mark 100′. For example, each mark 100′ could have different color or grayscale tonalities indicative of quantitative attribute 132′. By way of example, if the quantitative attribute 132′ is playcount 134′, a spectrum from light blue to black may be used. Marks 100′ colored light blue could represent the most played media items, marks 100′ colored black could represent the least played media items, and marks 100′ colored according to another part of the spectrum could fall in between the most played and least played media items. In addition, each mark 100′ could have a unique identification code 142′, such as A, B, and C. By way of example, if the quantitative attribute 132′ is playcount 134′, A could represent the most played media item, C could represent the least played media item, and B could represent a media item falling in between the least played and most played.


Referring now to FIG. 6, a mean value of all the media items for one genre may be used to color a corresponding sector 50′. For example, each sector 50′ could have different color or grayscale tonalities indicative of the mean value of the playcount 134′ of all media items within that sector 50′. Again, a spectrum from light blue to black may be used, but other colors would be suitable. Sectors 50′ colored light blue could represent sectors 50′ having the most played media items, sectors 50′ colored black could represent sectors 50′ having the least played media items, and sectors 50′ colored according to another part of the spectrum could represent sectors 50′ having media items with a playcount falling between the most played and least played. In addition, each sector 50′ could also be shaded with unique patterns 144′ as shown in FIG. 6. By way of example, sectors 50′ represented by a first unique pattern 146′ could represent sectors 50′ having the most played media items. Sectors 50′ represented by a second unique pattern 148′ could represent sectors 50′ having media items with a playcount falling between the most played and least played. Finally, sectors 50′ represented by a third unique pattern 150′ could represent sectors 50′ having the least played media items.


Referring now to FIG. 7, playlists 110′ are shown using the rectangular visualization 200. Playlists 110′ may be created by adding media items in a one-by-one manner, or they could be smart playlists following a set of logical filtering criteria. Media items of playlists 110′ without any grouping logic may be depicted using geometric forms different from marks 100′, which can be used in general for the rest of the media items. For example, jogging playlist 152′ could be displayed using diamond shapes 154′. While, diamond shapes 154′ are colored black, other shapes, sizes, colors or shading could be used. Likewise, 25 last played playlist 156′ could be represented using black crosses 158′. Again, other shapes, sizes, colors or shading could also be used. Other playlists 110′, including 60's and 70's music playlist 160′, Bruce Springsteen playlist 162′, and R.E.M. after 1990 playlist 164′, may be shown as shaded regions since they follow a regular geometric form. In a preferred embodiment, red shaded regions are used, but other colors, shading patterns, or indicia could also be used. Rolling Stones & Beatles playlist 166′ and 80's pop music playlist 168′ are not highlighted because the user has not activated their corresponding checkboxes 170′.


Rectangular visualization 200 may also indicate currently playing media item 172′. For example, currently playing media item 172′ could be displayed using a circular shape. While, the circular shape illustrating currently playing media item 172′ is colored black, other shapes, sizes, colors or shading could be used. In addition, path 174′ grouping media items to be played next could also be displayed. In this manner, the user might get an idea of what regions of the library are going to be used in the current music sequence, such as playlist 110′.


The user may interact with rectangular visualization 200 in a number of ways, including navigating media items, zooming over one or more sectors 50′, managing playlists 110′, and searching for media items. For example, additional information about any media item in the library may be visualized by positioning a cursor (not shown) over a mark 100′ in a manner similar to that described for disk visualization 40. In addition, if the cursor is positioned over a sector 50′, the artist of corresponding sub-sector 60′ may be highlighted in a manner similar to that described for disk visualization 40, except that the year of release may be highlighted with a dashed-line (not shown).


The user may also zoom over any sector 50′ in a manner similar to that described for disk visualization 40 to get a more detailed view of the library. For example, when the zoom feature is activated, a second rectangular visualization (not shown) may be generated with similar visualization and interaction principles but applied to the genre of selected sector 50′. The second rectangular visualization may be displayed proximate rectangular visualization 200 or rectangular visualization 200 may simply be updated with new information. By way of example, if the user zooms over sector 50′ representing pop genre 124′, sectors 50′ of rectangular visualization 200 representing genres may become sectors (not shown) representing artists. Likewise, sub-sectors 60′ of rectangular visualization 200 representing artists may become sub-sectors (not shown) representing albums. All the other dimensions and general principles could remain the same.


The user may perform another level of zoom by selecting another sector of the second rectangular visualization. This could generate a third rectangular visualization (not shown) with similar visualization and interaction principles but applied to the artist of the selected sector. The third rectangular visualization may be displayed proximate the second rectangular visualization or the second rectangular visualization may simply be updated with new information. By way of example, if the user zooms over the sector representing the group Bruce Springsteen, sectors of the second rectangular visualization representing artists may become sectors (not shown) representing albums. In the third rectangular visualization, there may be no sub-sector, but the user could obtain a graphical representation of the media items for a given artist.


Another way of applying a zoom function in the rectangle visualization 200 is to consider that the media items in the library are always shown, but the scale of a horizontal axis 210 or vertical axis 212 changes. For example, the user could explore the entire library by using a scroll bar (not shown) for panning over a specific zone. In this manner, when zooming in, the horizontal axis 210 still represents the genres, and the artists within each genre. Another level of zoom, as previously described, could be used in which the horizontal axis 210 also represents the albums for each artist. Accordingly, the horizontal axis 210 and its scroll bar may be adapted depending on the zoom level.


Referring again to FIG. 7, rectangular visualization 200 may be used to graphically display playlists 110′ and to edit or create new playlists 110′ using the graphical display in a manner similar to that described for disk visualization 40. In addition, the user may also search for media items using search bar 194′. In response to the search, results may be dynamically filtered and highlighted on rectangular visualization 200.



FIGS. 8A, 8B, and 8C show a Tree-Map visualization 300 of a music library according to a third embodiment (in FIGS. 8A, 8B, and 8C reference numerals with the prime symbol, e.g., 50″, indicate elements similar to those of the same name in the first embodiment, i.e., sectors 50). Tree-Map visualization 300 includes a plurality of sectors 50″ representing genre of the music library, one or more first sub-sectors 302 representing sub-genres associated with the genre, one or more second sub-sectors 304 representing artists associated with each sub-genre, and an indicia representing a mean value of an attribute of all media items within a second sub-sector. Tree-Map visualization 300 may give the user a good overview of the number of media items belonging to each genre, sub-genre, and artist as represented by the respective rectangle sizes. However, in one embodiment, Tree-Map visualization 300 does not display information about individual media items or playlists.


Referring now to FIG. 8A, Tree-Map visualization 300 is divided into different sectors 50″ that represent each genre of the library. For example, the music library illustrated in the embodiment of FIG. 8A is categorized into seven genres: (1) Jazz genre 306; (2) Pop genre 308; (3) Classical genre 310; (4) Techno genre 312; (5) Country genre 314; (6) Rock genre 316; and (7) Soundtrack genre 318.


The size of each sector 50″ may be proportional to the number of media items of the associated genre with respect to the whole library. At the same time, sectors 50″ may be split into one or more first sub-sectors 302 representing sub-genres associated with the sector 50″. For example, sub-genres of Rock genre 316 may include Rock and roll sub-genre 322, Alternative sub-genre 324, Psychedelic sub-genre 326, Folk sub-genre 328, Instrumental sub-genre 330, Hard rock sub-genre 332, and Punk sub-genre 334. Of course, other sub-genre may be available for other genre. Each first sub-sector may be sized to reflect a ratio between the number of media items associated with the first sub-sector 302 and all the media items in the sector 50″. In addition, each first sub-sector 302 may be divided into one or more second sub-sectors 304 representing artists associated with the first sub-sector 302. Each second sub-sector 304 may be sized to reflect a ratio between the number of media items associated with the second sub-sector 304 and all the media items in the first sub-sector 302. Further, each second sub-sector 304 may be divided into one or more third sub-sectors 320 representing albums associated with the second sub-sector 304. Each third sub-sector 320 may be sized to reflect a ratio between the number of media items associated with the third sub-sector 320 and all the media items in the second sub-sector 304.


In a manner similar to that for disk visualization 40 and rectangular visualization 200, quantitative attributes may be chosen by the user. For example, quantitative attributes may include playcount, rating, last played date, and added date. In addition, other quantitative attributes may include ratings and reviews assigned by critics, artists, or others, or artists having new works forthcoming. The mean value of all the media items in each second sub-sector 304 may be used to color a corresponding second sub-sector 304. For example, each second sub-sector 304 could have different color or grayscale tonalities indicative of the mean value of the playcount of all media items within that second sub-sector 304. A spectrum from light blue to black may be used, but other colors would be suitable. Second sub-sectors 304 colored light blue could represent second sub-sector 304 having the most played media items, second sub-sectors 304 colored black could represent second sub-sectors 304 having the least played media items, and second sub-sectors 304 colored according to another part of the spectrum could represent second sub-sectors 304 having media items with a playcount falling between the most played and least played. In addition, each second sub-sector 304 could also be shaded with unique patterns as discussed with reference to FIGS. 3 and 6. Furthermore, the mean value of all the media items in each third sub-sector 320 may be used to color a corresponding third sub-sector 320.


The user may also zoom over any sector 50″ in a manner similar to that described for disk visualization 40 and rectangular visualization 200 to get a more detailed view of the library. For example, when the zoom feature is activated, a Second Tree-Map visualization 336 may generated with similar visualization and interaction principles but applied to the genre of selected sector 50″. The second Tree-Map visualization 336 may be displayed proximate Tree-Map visualization 300 or Tree-Map visualization 300 may simply be updated with new information. By way of example, if the user zooms over sector 50″ representing Rock genre 316, sectors 50″ of Tree-Map visualization 300 representing genres may become sectors (not shown) representing sub-genres including Rock and roll sub-genre 322, Alternative sub-genre 324, Psychedelic sub-genre 326, Folk sub-genre 328, Instrumental sub-genre 330, Hard rock sub-genre 332, and Punk sub-genre 334. Likewise, first sub-sectors 302 of Tree-Map visualization 300 representing sub-genre may become additional sub-sectors (not shown) representing artists. All the other dimensions and general principles could remain the same.


The user may perform another level of zoom by selecting any second sector of the second Tree-Map visualization 336 corresponding to a sub-genre. This could generate a third Tree-Map visualization 338 with similar visualization and interaction principles but applied to the sub-genre of the selected second sector. The third Tree-Map visualization 338 may be displayed proximate the second Tree-Map visualization 336 or the second Tree-Map visualization 336 may simply be updated with new information. By way of example, if the user zooms over the second sector representing the Rock and roll sub-genre 322, sectors of the second Tree-Map visualization representing sub-genre may become sectors (not shown) representing artists.


It will be obvious to those having skill in the art that many changes may be made to the details of the above-described embodiments without departing from the underlying principles of the invention. The scope of the present invention should, therefore, be determined only by the following claims.

Claims
  • 1. A method for generating a graphical representation of a music library comprising: accessing metadata that describes a set of media items, the metadata including at least genre, artist, and year for each media item;generating a screen display wherein the screen display comprises a geometric shape, the geometric shape divided into a plurality of sectors representing genre of the music library, each sector sized to reflect a ratio between the number of media items associated with the sector and a total number of media items in the music library, and each sector divided into one or more sub-sectors representing artists associated with the sector, each sub-sector sized to reflect a ratio between the number of media items associated with the sub-sector and a total number of media items in the sector;in the screen display, displaying a mark for each one of the set of media items; andarranging the marks within the geometric shape so thateach mark is positioned spaced apart from a selected point within the geometric shape according to the year of the corresponding media item, andeach mark is positioned in the sector corresponding to the genre of the corresponding media item, and each mark is positioned in the sub-sector corresponding to the artist of the corresponding media item.
  • 2. The method of claim 1 wherein: the geometric shape is a disk,each sector of the disk is bound by a corresponding pair of line segments extending along radii,each sub-sector of the disk is bound by a corresponding pair of line segments extending along radii, andthe selected point is located at the center of the disk.
  • 3. The method of claim 1 wherein: the geometric shape is a rectangle,each sector of the rectangle is bound by a corresponding pair of parallel lines of equal length,each sub-sector of the rectangle is bound by a corresponding pair of parallel lines of equal length, and the selected point is located at an intersection of two adjacent sides of the rectangle.
  • 4. The method of claim 1 wherein said displaying the marks includes selecting an appearance of each of the marks so as to visually indicate an attribute of the corresponding media item.
  • 5. The method of claim 4 wherein the attribute is a playcount.
  • 6. The method of claim 4 wherein the attribute is a rating.
  • 7. The method of claim 4 wherein the attribute is a last played date.
  • 8. The method of claim 4 wherein the attribute is an add date.
  • 9. The method of claim 1 further comprising positioning the marks so that marks corresponding to media items that are associated with a given album are positioned contiguously.
  • 10. The method of claim 1 further comprising positioning the marks within a range representing the year of the corresponding media item.
  • 11. The method of claim 4 further comprising displaying, within a sector, an indicium representing a mean value of the attribute of all media items within the sector.
  • 12. The method of claim 1 further comprising selecting a plurality of the media items so as to define a playlist and overlaying at least one mark with an identifier of the defined playlist that includes the media item.
  • 13. The method of claim 12 further comprising highlighting a portion of the geometric shape that includes marks corresponding to media items in a defined playlist.
  • 14. The method of claim 1 further comprising overlaying at least one mark with an identifier of a currently playing media item.
  • 15. The method of claim 14 further comprising displaying a connection between media items in a playlist so that a path from the currently playing media item to subsequent media items in the playlist is illustrated.
  • 16. The method of claim 1 further comprising: receiving a user input selecting a media item;displaying at least a portion of the metadata for the selected media item;highlighting the sub-sector in which the media item is positioned; anddisplaying an indicia of the year of the media item.
  • 17. The method of claim 16 wherein the indicia is a circle.
  • 18. The method of claim 16 wherein the indicia is a line.
  • 19. The method of claim 1 further comprising: receiving a user input selecting one of the sectors corresponding to a genre;responsive to the user input, generating a second screen display wherein the second screen display comprises a second geometric shape, the second geometric shape divided into a plurality of second sectors representing artists of the selected sector, each second sector sized to reflect a ratio between the number of media items associated with the second sector and a total number of media items in the selected sector, and each second sector divided into one or more second sub-sectors representing albums associated with the artist of the second sector, each second sub-sector sized to reflect a ratio between the number of media items associated with the second sub-sector and a total number of media items in the second sector;in the second screen display, displaying second marks for each one of the set of media items within the selected genre sector; andarranging the second marks within the second geometric shape so thateach second mark is positioned spaced apart from a second selected point within the second geometric shape according to the year of the corresponding media item, andeach second mark is positioned in the second sector corresponding to the artist of the corresponding media item, and each second mark is positioned in the second sub-sector corresponding to the album of the corresponding media item.
  • 20. The method of claim 19 further comprising: receiving a second user input selecting one of the second sectors corresponding to an artist;responsive to the second user input, generating a third screen display wherein the third screen display comprises a third geometric shape, the third geometric shape divided into a plurality of third sectors representing albums of the selected second sector, each third sector sized to reflect a ratio between the number of media items associated with the third sector and a total number of media items in the selected second sector;in the third screen display, displaying third marks for each one of the set of media items within the selected artist sector; andarranging the third marks within the third geometric shape so thateach third mark is positioned sequentially from a third point within the third geometric shape according to the year of the corresponding media item, andeach third mark is positioned in the third sector corresponding to the album of the corresponding media item.
  • 21. The method of claim 3 wherein only a portion of the rectangle is displayed and further comprising receiving a user input requesting a different portion of the rectangle to be displayed, and responsive to the user input, displaying a different portion of the rectangle.
  • 22. The method of claim 1 further comprising: receiving a user input selecting a media item; andadding the media item to a playlist.
  • 23. The method of claim 1 further comprising: receiving a user input containing search criterion;responsive to the user input, searching the metadata; andhighlighting a portion of the geometric shape corresponding to a plurality of media items matching the search criterion.
  • 24. The method of claim 1 further comprising: receiving a user input containing search criterion;responsive to the user input, searching the metadata; andoverlaying the mark of one or more media items matching the search criterion with an indicia of the search to which the media item matches.
  • 25. A computer program stored on machine readable medium for generating a graphical representation of a music library comprising: first code for accessing metadata that describes a set of media items, the metadata including at least genre, artist, and year for each media item;second code for generating a screen display wherein the screen display comprises a geometric shape, the geometric shape divided into a plurality of sectors representing genre of the music library, each sector sized to reflect a ratio between the number of media items associated with the sector and a total number of media items in the music library, and each sector divided into one or more sub-sectors representing artists associated with the sector, each sub-sector sized to reflect a ratio between the number of media items associated with the sub-sector and a total number of media items in the sector;third code for displaying, in the screen display, a mark for each one of the set of media items; andfourth code for arranging the marks within the geometric shape so thateach mark is positioned spaced apart from a selected point within the geometric shape according to the year of the corresponding media item, andeach mark is positioned in the sector corresponding to the genre of the corresponding media item, and each mark is positioned in the sub-sector corresponding to the artist of the corresponding media item.
  • 26. The computer program according to claim 25 wherein: the geometric shape is a disk,each sector of the disk is bound by a corresponding pair of line segments extending along radii,each sub-sector of the disk is bound by a corresponding pair of line segments extending along radii, andthe selected point from which the third code arranges the marks is located at the center of the disk.
  • 27. The computer program according to claim 25 wherein: the geometric shape is a rectangle,each sector of the rectangle is bound by corresponding pair of parallel lines of equal length,each sub-sector of the rectangle is bound by corresponding pair of parallel lines of equal length, and the point from which the third code arranges the marks is an intersection of any two sides of the rectangle.
  • 28. The computer program according to claim 25 wherein said displaying the marks includes selecting an appearance of each of the marks so as to visually indicate an attribute of the corresponding media item.
  • 29. The computer program according to claim 28 further comprising a fifth code for displaying, within a sector, an indicium representing a mean value of the attribute of all media items within the sector.
  • 30. The computer program according to claim 25 further comprising a fifth code for selecting a plurality of the media items so as to define a playlist and overlaying at least one mark with an identifier of the defined playlist that includes the media item.
  • 31. The computer program according to claim 30 further comprising a fifth code for highlighting a portion of the geometric shape that includes marks corresponding to media items in a defined playlist.
  • 32. The computer program according to claim 25 further comprising: a fifth code for receiving a user input selecting a media item;a sixth code for displaying at least a portion of the metadata for the selected media item;a seventh code for highlighting the sub-sector in which the media item is positioned; andan eight code for displaying an indicia of the year of the media item.
  • 33. The computer program according to claim 25 further comprising: a fifth code for receiving a user input selecting one of the sectors corresponding to a genre;a sixth code for generating in response to the user input a second screen display wherein the second screen display comprises a second geometric shape, the second geometric shape divided into a plurality of second sectors representing artists of the selected sector, each second sector sized to reflect a ratio between the number of media items associated with the second sector and a total number of media items in the selected sector, and each second sector divided into one or more second sub-sectors representing albums associated with the artist of the second sector, each second sub-sector sized to reflect a ratio between the number of media items associated with the second sub-sector and a total number of media items in the second sector;a seventh code for displaying, in the second screen display, second marks for each one of the set of media items within the selected genre sector; andan eight code for arranging the second marks within the second geometric shape so thateach second mark is positioned spaced apart from a second selected point within the second geometric shape according to the year of the corresponding media item, andeach second mark is positioned in the second sector corresponding to the artist of the corresponding media item, and each second mark is positioned in the second sub-sector corresponding to the album of the corresponding media item.
  • 34. The computer program according to claim 33 further comprising: a ninth code for receiving a second user input selecting one of the second sectors corresponding to an artist;a tenth code for generating in response to the second user input a third screen display wherein the third screen display comprises a third geometric shape, the third geometric shape divided into a plurality of third sectors representing albums of the selected second sector, each third sector sized to reflect a ratio between the number of media items associated with the third sector and a total number of media items in the selected second sector;an eleventh code for displaying, in the third screen display, third marks for each one of the set of media items within the selected artist sector; anda twelfth code for arranging third marks within the third geometric shape so thateach third mark is positioned spaced apart from a third selected point within the third geometric shape according to the year of the corresponding media item, andeach third mark is positioned in the third sector corresponding to the album of the corresponding media item.
  • 35. The computer program according to claim 27 wherein only a portion of the rectangle is displayed and further comprising a fifth code for receiving a user input requesting a different portion of the rectangle to be displayed, and responsive to the user input, displaying a different portion of the rectangle.
  • 36. A method for generating a graphical representation of digital music library comprising: accessing metadata that describes a set of media items, the metadata including at least genre, sub-genre, and artist for each media item;displaying a rectangle, the rectangle divided into a plurality of sectors representing genre of the music library, each sector sized to reflect a ratio between the number of media items associated with the sector and a total number of media items in the music library, and each sector divided into one or more first sub-sectors representing sub-genres associated with the sector, each first sub-sector sized to reflect a ratio between the number of media items associated with the first sub-sector and a total number of media items in the sector; anddisplaying within each first sub-sector an indicium representing a mean value of an attribute of all media items within the first sub-sector.
  • 37. The method of claim 36 wherein each first sub-sector is divided into one or more second sub-sectors representing artists associated with the first sub-sector, each second sub-sector sized to reflect a ratio between the number of media items associated with the second sub-sector and a total number of media items in the first sub-sector; and displaying within each second sub-sector an indicium representing a mean value of an attribute of all media items within the second sub-sector.
  • 38. The method of claim 37 wherein each second sub-sector is divided into one or more third sub-sectors representing albums associated with the second sub-sector, each third sub-sector sized to reflect a ratio between the number of media items associated with the third sub-sector and a total number of media items in the second sub-sector; and displaying within each third sub-sector an indicium representing a mean value of an attribute of all media items within the third sub-sector.
  • 39. The method of claim 36 wherein the attribute is a playcount.
  • 40. The method of claim 36 wherein the attribute is a rating.
  • 41. The method of claim 36 wherein the attribute is a last played date.
  • 42. The method of claim 36 wherein the attribute is an add date.
  • 43. The method of claim 36 further comprising: receiving a user input selecting one of the sectors corresponding to a genre;responsive to the user input, displaying a second rectangle, the second rectangle divided into a plurality of second sectors representing sub-genre of the music library, each second sector sized to reflect a ratio between the number of media items associated with the second sector and a total number of media items in the second rectangle, and each second sector divided into one or more additional sectors representing artists associated with the second sector, each additional sector sized to reflect a ratio between the number of media items associated with the additional sector and a total number of media items in the second sector; anddisplaying within each additional sector an indicium representing a mean value of an attribute of all media items within the additional sector.
  • 44. The method of claim 43 further comprising: receiving a second user input selecting one of the second sectors corresponding to a sub-genre;responsive to the second user input, displaying a third rectangle, the third rectangle divided into a plurality of third sectors representing artists of the selected second sector, each third sector sized to reflect a ratio between the number of media items associated with the third sector and a total number of media items in the third rectangle; anddisplaying within each third sector an indicium representing a mean value of an attribute of all media items within the third sector.
  • 45. A computer program stored on machine readable medium for generating a graphical representation of a digital music library comprising: first code for accessing metadata that describes a set of media items, the metadata including at least genre, sub-genre, and artist for each media item;second code for displaying a rectangle, the rectangle divided into a plurality of sectors representing genre of the music library, each sector sized to reflect a ratio between the number of media items associated with the sector and a total number of media items in the music library, and each sector divided into one or more first sub-sectors representing sub-genres associated with the sector, each first sub-sector sized to reflect a ratio between the number of media items associated with the first sub-sector and a total number of media items in the sector, each first sub-sector divided into one or more second sub-sectors representing artists associated with the first sub-sector, and each second sub-sector sized to reflect a ratio between the number of media items associated with the second sub-sector and a total number of media items in the first sub-sector; andthird code for displaying within each second sub-sector an indicium representing a mean value of an attribute of all media items within the second sub-sector.
RELATED APPLICATIONS

This application claims priority from U.S. Provisional Application No. 60/723,865 filed Oct. 4, 2005, which is hereby incorporated by reference in its entirety.

US Referenced Citations (75)
Number Name Date Kind
5583763 Atcheson Dec 1996 A
5918014 Robinson Jun 1999 A
6000044 Chrysos Dec 1999 A
6047311 Ueno Apr 2000 A
6134532 Lazarus Oct 2000 A
6346951 Mastronardi Feb 2002 B1
6381575 Martin Apr 2002 B1
6434621 Pezzillo Aug 2002 B1
6438579 Hosken Aug 2002 B1
6487539 Aggarwal Nov 2002 B1
6526411 Ward Feb 2003 B1
6532469 Feldman Mar 2003 B1
6615208 Behrens Sep 2003 B1
6687696 Hofmann Feb 2004 B2
6785688 Abajian Aug 2004 B2
6842761 Diamond Jan 2005 B2
6850252 Hoffberg Feb 2005 B1
6914891 Ha Jul 2005 B2
6931454 Deshpande Aug 2005 B2
6938209 Ogawa et al. Aug 2005 B2
6947922 Glance Sep 2005 B1
6987221 Platt Jan 2006 B2
6990497 O'Rourke Jan 2006 B2
6993532 Platt Jan 2006 B1
7020637 Bratton Mar 2006 B2
7021836 Bratton Apr 2006 B2
7072846 Robinson Jul 2006 B1
7082407 Bezos Jul 2006 B1
7096234 Plastina Aug 2006 B2
7111240 Crow et al. Sep 2006 B2
7120619 Drucker Oct 2006 B2
7180473 Horie Feb 2007 B2
7256341 Plastina Aug 2007 B2
7457862 Hepworth Nov 2008 B2
7493572 Card Feb 2009 B2
20020082901 Dunning et al. Jun 2002 A1
20030120630 Tunkelang Jun 2003 A1
20030229537 Dunning Dec 2003 A1
20040003392 Trajkovic Jan 2004 A1
20040073924 Pendakur Apr 2004 A1
20040139064 Chevallier Jul 2004 A1
20040263337 Terauchi et al. Dec 2004 A1
20050060350 Baum Mar 2005 A1
20050102610 Jie May 2005 A1
20050193014 Prince Sep 2005 A1
20050198075 Plastina et al. Sep 2005 A1
20050203807 Bezos et al. Sep 2005 A1
20050210101 Janik Sep 2005 A1
20050216855 Kopra Sep 2005 A1
20050235811 Dukane Oct 2005 A1
20050276570 Reed Dec 2005 A1
20060015904 Marcus Jan 2006 A1
20060018208 Nathan Jan 2006 A1
20060018209 Drakoulis Jan 2006 A1
20060020062 Robinson Jan 2006 A1
20060026263 Raghavan Feb 2006 A1
20060053077 Mourad Mar 2006 A1
20060062094 Nathan Mar 2006 A1
20060074750 Clark Apr 2006 A1
20060095516 Wijeratne May 2006 A1
20060100978 Heller May 2006 A1
20060112098 Renshaw May 2006 A1
20060165571 Seon Jul 2006 A1
20060173910 McLaughlin Aug 2006 A1
20060173916 Verbeck Aug 2006 A1
20060195438 Galuten Aug 2006 A1
20060195462 Rogers Aug 2006 A1
20060195789 Rogers et al. Aug 2006 A1
20060206811 Dowdy Sep 2006 A1
20060253874 Stark Nov 2006 A1
20060288044 Kashiwagi Dec 2006 A1
20070043829 Dua Feb 2007 A1
20070203790 Torrens Aug 2007 A1
20070250761 Bradley Oct 2007 A1
20070294096 Randall Dec 2007 A1
Foreign Referenced Citations (11)
Number Date Country
1 231 788 Aug 2002 EP
1420388 May 2004 EP
11-052965 Feb 1999 JP
2002-108351 Apr 2002 JP
2003-255958 Sep 2003 JP
2002-025579 Apr 2002 KR
WO2004070538 Aug 2004 WO
WO2006052837 May 2006 WO
WO2007134193 May 2007 WO
WO2007075622 Jul 2007 WO
WO2007092053 Aug 2007 WO
Related Publications (1)
Number Date Country
20070233726 A1 Oct 2007 US
Provisional Applications (1)
Number Date Country
60723865 Oct 2005 US