The present invention relates generally to music information display apparatus and methods for displaying predetermined music information on display devices, as well as programs therefor. More particularly, the present invention relates to an improved music information display apparatus and method for displaying music information on a thin, lightweight and power-saving sheet-shaped electronic paper, as well as an improved program therefor.
Heretofore, electronic music apparatus, such as electronic musical instruments, have been known which are constructed to display music information, such as a musical score and/or lyrics, on a predetermined display device in accordance with acquired performance information, musical score display information or lyrics display information. One example of such electronic music apparatus is disclosed in Japanese Patent Application Laid-open Publication No. 2002-258838. In the conventional electronic music apparatus, like the one disclosed in the above-identified publication, there is employed a display device, such as a liquid crystal display (LCD) device or CRT display device, and music information corresponding to successive ranges or sections of a music piece is sequentially displayed on the display device, for example, in accordance with reproduction of the music piece, i.e. with the display of the music information automatically switched or updated in accordance with progression of the reproduction.
However, in the conventional electronic music apparatus, like the one disclosed in the above-identified publication, which employ a display device, such as a liquid crystal display (LCD) device or CRT display device, to display music information, there has been the significant inconvenience of extremely great electric power consumption, because the display device itself must be illuminated to display the music information on its screen and electric power must be constantly supplied to the display device to keep the music information displayed on the screen. Further, the illumination of the display device itself tends to make the eyes of a user tired, so that the display of the music information on the illuminated display device has been unsuitable for the user to view for a long time as compared to music information, such as a musical score and/or lyrics, printed on an ordinary sheet (or sheets) of paper or the like.
In view of the foregoing, it is an object of the present invention to provide an improved music information display apparatus and method which use an electronic paper as a display device for displaying music information to thereby not only minimize necessary electric power consumption but also permit an easy-to-view and easy-on-the-eye display of music information, as well as an improved program therefor.
In order to accomplish the above-mentioned object, the present invention provides an improved music information display apparatus, which comprises: an electronic paper; and a control section that controls a display by the electronic paper to visually display music information, corresponding to a music piece being reproduced, in synchronism with reproduction of the music piece.
The present invention also provides an improved music information display apparatus, which comprises: an electronic paper; an acquisition section that acquires music information related to reproduction and display of a music piece; a determination section that determines a predetermined lead time in accordance with a display response characteristic of the electronic paper; a detection section that, in accordance with reproduction of a music piece based on the acquired music information, detects timing for switching the display based on the acquired music information, in correspondence with the music piece being reproduced, earlier by the predetermined lead time than actual display-switching timing; and a display control section that, in accordance with the detection by the detection section, instructs the electronic paper to start a display switching operation based on the music information.
According to the present invention, music information to be visually displayed in synchronism with (progression of) reproduction of a music piece is displayed on the electronic paper, so that an easy-on-the eyes and easy-to-view visual display of the music information can be achieved with the necessary electric power consumption effectively reduced. Further, for displaying the music information on the electronic paper, a predetermined lead time is determined in accordance with a display response characteristic of the electronic paper, and the timing for switching the display based on the music information, in correspondence with the music piece being reproduced, is detected earlier than actual display-switching timing by the predetermined lead time, and thus, a display driving instruction is given to the electronic paper such that the electronic paper can start a display switching operation in response to the detection of the display-switching timing. Namely, an electronic-paper driving operation, intended to switch one display to another on the electronic paper, is started ahead of actual display-switching timing, in consideration of a display response delay time that would be involved when the electronic paper switches the display, in such a manner that switching to a display of music information corresponding to a currently-reproduced section of the music piece has been completed by predetermined display-switching timing. In this way, a display corresponding to currently-reproduced music information can be appropriately presented on the electronic paper with no delay behind the music piece reproduction.
The present invention may be constructed and implemented not only as the apparatus invention as discussed above but also as a method invention. Also, the present invention may be arranged and implemented as a software program for execution by a processor such as a computer or DSP, as well as a storage medium storing such a software program. Further, the processor used in the present invention may comprise a dedicated processor with dedicated logic built in hardware, not to mention a computer or other general-purpose type processor capable of running a desired software program.
The following will describe embodiments of the present invention, but it should be appreciated that the present invention is not limited to the described embodiments and various modifications of the invention are possible without departing from the basic principles. The scope of the present invention is therefore to be determined solely by the appended claims.
For better understanding of the objects and other features of the present invention, its preferred embodiments will be described hereinbelow in greater detail with reference to the accompanying drawings, in which:
The ROM 2 has prestored therein various programs to be executed by the CPU 1 and various data. The RAM 3 is used as a working memory for temporarily storing various data generated as the CPU 1 executes a predetermined program, as a memory for storing the currently-executed program and data related thereto, and for various other purposes. Predetermined address regions of the RAM 3 are allocated and used as registers, flags, tables, memories, etc. Performance operator/setting operator unit 4A includes, for example, a performance operator for a manual performance by a user, such as a keyboard having a plurality of keys for designating pitches of tones, operators for selecting a musical score and/or lyrics to be displayed on an electronic paper 6A, operators for setting various parameters to be used for reproduction of a music piece, etc. The detection circuit 4 detects depression and release of the keys on the performance operator to thereby produce detection outputs, and operational states of the setting operators to output switch information, corresponding to the detected operational states, to the CPU 1 via the data and address bus 1D. The performance operator may be of any other structural or operating type than the keyboard musical instrument type, such as a stringed instrument type, wind instrument type or percussion instrument type.
LCD display device 5A, which is in the form of a liquid crystal display panel or the like, can display a list of music pieces whose musical scores and/or lyrics are displayable under control of the drive circuit 5, information set via the setting operators (that are also indicated by 4A for convenience of description), controlling states of the CPU 1, etc. The LCD display device is constructed similarly to the conventional display device extensively used in the known electronic musical instruments; heretofore, it has been conventional to display musical scores, lyrics, etc. too on the LCD display device. The LCD display device 5A is advantageous over an electronic paper in that it can achieve a quick response speed in switching between information to be displayed. However, the LCD display device is disadvantageous in that it consumes much greater electric power than the electronic paper, because the display device itself must be illuminated to display music information on its screen and electric power must be constantly supplied to keep the music information displayed on the screen. Also, the display of the music information on the illuminated LCD display device is unsuitable for the user to view for a long time as compared to music information printed on a sheet (or sheets) of ordinary paper or the like. Besides, the LCD display device is disadvantageous over the electronic paper, for example, in that it requires high costs if the screen has a great size. For these reasons, the electronic music apparatus of the invention includes, in addition to the LCD display device 5A, a removably-attachable electronic paper 6A, so that a musical score and/or lyrics can be displayed on the removably-attached electronic paper 6A under control of the electronic paper drive circuit 6.
Now, a description will be given about the electronic paper 6A attachable to the body of the electronic music apparatus, with reference to
As shown in
The electronic paper 6A constructed in this manner has the following advantages. First, the electronic paper 6A is easy on the eyes and easy to view because it is of a high-contrast reflection type where images are displayed with light emitted from an external light source without its screen having to be illuminated in its entirety. Further, the electronic paper 6A is thin, lightweight and bendable as necessary, so that it is readily portable. Besides, because the construction of the electronic paper 6A is simple, it can be manufactured at low cost even if its screen has a great size. Furthermore, because the electronic paper 6A can be kept in the music-information displaying state (i.e., can keep the music information displayed on the screen) without having to be constantly powered from an external power source, it can effectively save the power consumption. Where music information, such as a musical score and/or lyrics, is displayed on the electronic paper 6A having such advantages, the music information can be, at a glance, much like a musical score and/or lyrics printed on a sheet (sheets of) paper, and thus the electronic paper 6A can be used without the user having no sense of discomfort. Thus, the electronic music apparatus of
Whereas the electronic paper 6A of the microcapsule/electrophoretic type has been described above, the electronic paper 6A employed in the electronic music apparatus of the invention may be of any one of various other known types, such as a twisting ball type, horizontal electrophoretic type and electrolytic deposition/dissolution type. In such a case, the electronic paper 6A is driven by the electronic paper drive circuit 6 in accordance with an appropriate drive scheme corresponding to the type of the electronic paper 6A.
Referring back to
The external storage device 10 is provided for storing various data, such as performance information to be used for reproduction of a music piece and musical score display information and/or lyrics display information to be used for displaying a musical score and/or lyrics, various control programs (such as those of “initial setting processing”, “music piece reproduction processing” and “electronic paper drive processing” to be later described in detail) that are to be executed by the CPU 1, and various control-related data. Where a particular control program is not prestored in the ROM 2, the control program may be prestored in the external storage device (e.g., hard disk device) 10, so that, by reading the control program from the external storage device 10 into the RAM 3, the CPU 1 is allowed to operate in exactly the same way as in the case where the particular control program is stored in the program memory 2. This arrangement greatly facilitates version upgrade of the control program, addition of a new control program, etc. The external storage device 10 may comprise any of various removable-type media other than the hard disk (HD), such as a flexible disk (FD), compact disk (CD-ROM or CD-RAM), magneto-optical disk (MO) and digital versatile disk (DVD), and a semiconductor memory, such as a flash memory.
The MIDI interface (I/F) 11 is provided for inputting performance information of the MIDI format (i.e., MIDI data) from externally-connected other MIDI equipment 11A or the like to the electronic music apparatus, and for outputting performance information of the MIDI format (i.e., MIDI data) from the electronic music apparatus to the other MIDI equipment 11A or the like. The communication interface (I/F) 12 is connected to a wired or wireless communication network X, such as a LAN, via which it can be connected to a desired server computer 12A to receive various desired data from the server computer 12A. It should be appreciated that the communication interface 12 may be of either or both of wired and wireless types.
Furthermore, the electronic music apparatus of the present invention is not limited to the type where the performance operator/setting operator unit 4A, LCD display device 5A, electronic paper 6A, tone generator circuit 7, etc. are incorporated together within the body of the electronic music apparatus; for example, the electronic music apparatus may be constructed in such a manner that the above-mentioned components are provided separately and interconnected via communication facilities such as a MIDI interface, various networks and/or the like. Moreover, the electronic music apparatus of the present invention may be applied to any desired type of apparatus or equipment other than an electronic musical instrument or personal computer, such as a portable phone or other portable communication terminal, karaoke apparatus or game apparatus.
Because the electronic paper 6A has a superior portability and power-saving capability as set forth above, it can be optimally employed in mobile-type electronic music apparatus etc. having a built-in power supply. Further, because the electronic paper 6A is a reflection-type display device and can be readily constructed to have a great-size screen at low cost, it can readily provide a visual display that is easy on the eyes and easy to view. The electronic paper 6A having such advantages, however, can only achieve an extremely-slow display response speed (i.e., display response time) from a start to completion of each display to be newly made, as compared to the LCD display device 5A or the like; thus, the electronic paper 6A takes a time (e.g., in a range of tens of milliseconds to a hundred and tens of milliseconds) longer than the LCD display device 5A, in switching between displays. Therefore, in the case where such an electronic paper 6A is used as a display device for displaying music information while automatically updating the displayed music information, for example, in accordance with reproduction of a music piece, there arises a need to adjust drive-starting timing of the electronic paper 6A, in consideration of the slow display response speed (i.e., display response time), so that a display-switching driving operation is started prior to so-called “display-switching timing” at which switching to a display of music information corresponding to a given position of a music piece should have been completed prior to reproduction of the given position of the music piece. Namely, it is necessary to determine a predetermined lead time in accordance with a display response characteristic of the electronic paper. Such adjustment of the drive-starting timing of the electronic paper 6A (or determination of the lead time) is explained with reference to
In the instant embodiment, there are prepared in advance a plurality of pages of musical score display data and/or a plurality of pages of lyrics display data (i.e., a plurality of pages of music information display data) which are indicative of musical scores and/or lyrics to be displayed on the electronic paper 6A. The pages of the musical score display data and/or lyrics display data are sequentially displayed, page by page, on the electronic paper 6A, in accordance with progression of a reproduced music piece and in accordance with the musical score display data and/or lyrics display data. For example, in a case where a total of 16 measures are displayable per page, a plurality of “display-switching timing” shown in the upper row of
The electronic paper 6A has a slow display response speed (i.e., display response time) and thus takes a long time to switch one display to another, and thus, in the case where the musical score display is switched on the page-by-page basis in accordance with progression of the music piece as noted above, completion of the display switching would be delayed behind the predetermined “display-switching timing” unless drive-starting timing is determined in consideration of the slow display response speed (display response time) of the electronic paper 6A. Consequently, the musical score and/or lyrics can not be displayed exactly in accordance with reproduction of the music piece, which is very inconvenient. Assuming that 150 ms is required for the electronic paper 6A to switch one display to another as illustrated in
Note that the switching of the display of a musical score, lyrics and/or the like is other than the page-by-page switching; for example, the instant embodiment can effect the display switching while wiping or deleting the previous display per predetermined range, e.g. per letter (in the case of a display of lyrics). Namely, where all of the display elements (i.e., microcapsules C in the described embodiment) are simultaneously driven, the instant embodiment can effect the display switching per page. Where only some of the display elements (microcapsules C), located in a predetermined range, are simultaneously driven, the instant embodiment can effect the display switching while wiping the previous display per predetermined range, e.g. per letter. Alternatively, the display switching may be made about a pointer that indicates a currently-reproduced position of a music piece in accordance with (progression of) the reproduction of the music piece.
Note that, in the instant embodiment, the above-mentioned drive-starting timing (or the lead time) is left unchanged even when a reproduction tempo of a music piece has been changed; that is, the drive-starting timing set in advance is not changed in response to a change in the reproduction tempo. Further, in the instant embodiment, the musical score display data may be generated by analyzing automatic performance data, or logical musical score data and/or musical score image data corresponding to automatic performance data may be prestored in memory. The lyrics display data may also be generated from automatic performance data, or lyrics-displaying image data may be prestored in memory.
Because the LCD display device heretofore used, as a display device for displaying a musical score and/or the like, in the conventional electronic music apparatus has a very quick display response speed (i.e., display response time) as compared to the electronic paper, the musical score and/or the like can be displayed appropriately, with no substantial delay perceivable by the user, even when the display-switching drive operation is started at predetermined “display-switching timing” without the display response speed (i.e., display response time) being taken into account. However, in the case where the electronic paper is used as in the above-described embodiment, and if the display-switching drive operation is started at predetermined “display-switching timing” with no particular consideration of the display response speed (i.e., display response time) as in the conventional technique, then completion of the display switching would be delayed behind reproduction of a corresponding music piece section, so that the display switching will be made with a delay perceivable by the user. Thus, in the instant embodiment, where music information is displayed on the electronic paper 6A while being automatically updated, it is detected when a time point earlier than predetermined “display-switching timing” by a predetermined time (i.e., predetermined lead time) has been reached, and the display-switching drive operation is started with that time point used as “drive-starting timing”. In this way, the instant embodiment can display a musical score, lyrics, pointer and/or the like with no delay or deviation from a currently-reproduced position of a music piece. Automatic updating processing for switching one display of music information to another in accordance with reproduction of a music piece will be later described in detail with reference to
At step S11 of the “music piece reproduction process”, the leading or first page of the music information display data are read out (or generated), and the other process, “electronic paper drive process”, is instructed to display the first page. Upon receipt of the display instruction from the “music piece reproduction process”, the “electronic paper drive process” supplies the first page of the music information display data to the electronic paper drive circuit 6 and instructs a start of electric voltage application, at step S21. After passage of the predetermined time set through the above-described “initial setting processing” of
If, on the other hand, the elapsed time has not reached the time point earlier than the “display-switching timing” (NO determination at step S13), the reproduction of the music piece data (automatic performance data) is continued at step S15. At next step S16, a determination is made as to whether the reproduction has come to the end of the music piece, i.e. whether the reproduction of the music piece has been completed. If the reproduction of the music piece has been completed (YES determination at step S16), the music piece reproduction process is brought to an end. If the reproduction of the music piece has not been completed (NO determination at step S16), the music piece reproduction process reverts to step S13 in order to repeat the operations of steps S13-S16.
In the instant embodiment, as having been set forth above, the display-switching driving operation is started slightly (e.g., a time in the range of tens of milliseconds to a hundred and tens of milliseconds) ahead of progression of a music piece during a display of a musical score and/or lyrics of the music piece, in consideration of the slow display response speed of the electronic paper 6A. For such a purpose, a plurality of pages of music information display data are prestored in memory, and, in order to display the music information page by page, it is detected, in accordance with progression of a music piece, when a time point earlier than predetermined “display-switching timing” by a predetermined time (i.e., time necessary for display switching) has been reached, upon which the page-switching drive operation is started. In the case where the electronic paper 6A is employed as a display device for displaying music information as set forth above, it is possible to effectively reduce the power consumption and provide an easy-to-view and easy-on-the eye visual display. To deal with a display delay due to the slow display response speed of the electronic paper 6A, the instant embodiment is arranged to adjust the drive-starting timing in consideration of the slow display response speed, so that it permits a display of the music information with no delay behind the reproduction of the music piece. Namely, although the electronic paper 6A has the disadvantage of the slow display switching speed, the instant embodiment allows any necessary display switching to be completed by predetermined “display-switching timing”, by causing the page-switching drive operation to start at a time point earlier than the display-switching timing by the predetermined time (i.e., predetermined lead time).
Further, in the instant embodiment, no electric power is supplied to the electronic paper drive circuit 6 for a time period from the completion of each display switching to the next “display-switching timing”. Namely, upon completion of each page switching, driving of the electronic paper 6A is discontinued until a time point earlier than the next display-switching timing by the predetermined time is reached. This arrangement can even further reduce the necessary power consumption by the electronic paper 6A.
Furthermore, the electronic paper 6A may be fixedly provided on the electronic music apparatus rather than being removably provided on the electronic music apparatus via a dedicated interface or general-purpose interface, such as a USB. Alternatively, the electronic paper 6A may be physically separated from the body of the electronic music apparatus, in which case a display switching instruction may be given wirelessly from the body of the electronic music apparatus. In the case where the electronic paper 6A is fixedly provided on the body of the electronic music apparatus, the electronic paper 6A is preferably fixed on a music rest, while, in the case where the electronic paper 6A is removably provided on the electronic music apparatus, the electronic paper 6A is preferably formed into a shape (e.g., size and thickness similar to those of a paper-made musical score) such that it can be placed appropriately on the music rest. Furthermore, in the case where the electronic paper 6A is removably provided on the electronic music apparatus, the electronic paper drive circuit 6 may be either fixed to the body of the electronic music apparatus or removably provided on the electronic music apparatus along with the electronic paper 6A. Furthermore, any one or more of a plurality of types of electronic papers 6A may be removably connected to the body of the electronic music apparatus. In such a case, the “predetermined time” is preferably varied in accordance with the type of the electronic paper 6A connected, since the display response speed depends on the type of the electronic paper 6A. The “predetermined time” may be set by the user or automatically set in response to detection of the type of the electronic paper 6A.
In the case where the electronic paper 6A is fixedly provided on the body of the electronic music apparatus, the “predetermined time” corresponding to the electronic paper 6A may be stored in memory in advance without the “predetermined time” being set through the “initial setting processing”. Further, a desired time longer than the display response time may be set, as the predetermined time, by the user.
Furthermore, in the case where the electronic paper 6A and other display device (e.g., LCD display device 5A) are employed as in the above-described embodiment, either a same kind of information (e.g., musical score or lyrics) or different kinds of information may be displayed on the electronic paper 6A and other display device (5A). For example, one page of the same information may be displayed on the electronic paper 6A, and only a portion of the page (e.g., a portion at and around a currently-reproduced position of a music piece) may be displayed on the other display device.
Whereas the pointer display or wiping-based lyrics display on a musical score may be constantly updated per predetermined time required for display switching, the present invention is not so limited; for example, the pointer display or wiping-based lyrics display may be updated per predetermined time longer than the above-mentioned predetermined time (i.e., per second predetermined time that is, for example, equal to the length of a quarter note (e.g., 500 ms when the tempo is “120” or 250 ms when the tempo is “240”) and hence longer than the above-mentioned “predetermined time” (i.e., predetermined lead time)).
Number | Date | Country | Kind |
---|---|---|---|
2004-233372 | Aug 2004 | JP | national |