The present invention relates to mobile devices, and more particularly, to methods for using a mobile device as a musical instrument.
The use of portable electronic devices and mobile communication devices has increased dramatically in recent years. Mobile devices are capable of establishing communication with other communication devices over landline networks, cellular networks, and, recently, wide local area networks (WLANs). Mobile devices are capable of providing access to Internet services which are bringing people closer together in a world of information. Mobile devices operating over a telecommunications infrastructure are capable of providing various forms of multimedia and entertainment. People are able to collaborate on projects, discuss ideas, interact with one another on-line, all while communicating via text, audio, and video.
A mobile device such as a portable music player can be used to download songs, edit music files, compose music, and share music files. However, the music files or sound files are generally pre-recorded. For example, a downloaded song is generally recorded and produced in a studio or mixed at a production facility. The music is generally provided as a completed recording and allows only for limited types of editing. Moreover, the music is composed by musicians who have access to music equipment including musical instruments. Users are generally unable to create musical instrument sounds without access to a musical instrument.
Embodiments of the invention are directed to a mobile device suitable for use as a wind instrument. The mobile device can include a microphone for capturing an air turbulence in response to a blowing action on the microphone, a keypad for selecting at least one virtual valve to associate with the air turbulence, a synthesis engine for synthesizing a musical note in response to the blowing based on the at least one virtual valve and the air turbulence, and an audio speaker for playing the musical note. One or more keys of the keypad can be depressed during the blowing action on the microphone for synthesizing a musical note of a wind instrument. The synthesis engine may be one of a Musical Instrument Device Interface (MIDI) synthesis engine that is Frequency Modulated (FM) generated or Waveform generated. In another arrangement, musical notes can be synthesized via acoustic modeling such as sampled waveforms, or mathematical modeling of sounds. Sampled waveforms can be extracted from portions of a WAV, OOG, or MP3 format digital media but are not herein limited to these.
The mobile device can include a detector for determining an acoustic pressure of the air turbulence, and a processor for mapping the acoustic pressure to a musical note. One or more keys of the keypad can be depressed for changing the musical note in accordance with the acoustic pressure. The processor can change the musical note as a function of the acoustic pressure, wherein the function is based on at least one threshold such that the at least one musical note changes if the acoustic pressure exceeds the at least one threshold. The detector can determine a duration of the air turbulence and the processor can hold the musical note for the duration. The mobile device can further include a display for presenting a musical notation of the musical note.
In one aspect, the musical notation can identify a numerical fingering of the at least one virtual valve corresponding to a key on the keypad. The keypad can include at least one back light element for illuminating a key that corresponds to a virtual valve. In one arrangement, the keypad provides a key to virtual valve mapping for three simultaneous instruments, wherein a first wind instrument employs at least one of keys *, 7, 4, or 1, a second wind instrument employs at least one of keys 0, 8, 5, 2, and a third wind instrument employs at least one of keys #, 9, 6, and 3.
Embodiments of the invention are also directed to a mobile device suitable for use as a training wind instrument. The mobile device can include a display for presenting a musical notation and numerical fingering of a musical note, a back light keypad for illuminating at least one key of the keypad to associate with the musical notation, a microphone for capturing an air turbulence in response to a blowing action on the microphone, a synthesis engine for producing a musical note in response to a pressing of an illuminated key and a blowing into the microphone, an audio speaker for playing the synthetic musical note, and a processor for mapping an acoustic pressure of the air turbulence to a musical note. An image of a wind instrument can be presented on the display, and the synthesis engine can generate a modeled sound of the displayed wind instrument. A processor can determine if the blowing action exceeds a threshold for producing a note of the musical notation, and can present a visual comparison of the musical note and the note for providing training feedback on breath control. In one arrangement, the microphone can determine a consistency of the blowing action based on an acoustic pressure of the air turbulence, and the display can present an indication of the consistency for informing a user of a breath control.
The mobile device can include a data store for storing musical notations to present on the display as training material, and a recording unit for saving musical note compositions produced in response to a playing of the mobile device as a wind instrument. The mobile device can include a mouthpiece attachment for associating an acoustic pressure of the blowing action to an illuminated key and determining a musical note for the mobile device to produce.
The features of the system, which are believed to be novel, are set forth with particularity in the appended claims. The embodiments herein, can be understood by reference to the following description, taken in conjunction with the accompanying drawings, in the several figures of which like reference numerals identify like elements, and in which:
While the specification concludes with claims defining the features of the embodiments of the invention that are regarded as novel, it is believed that the method, system, and other embodiments will be better understood from a consideration of the following description in conjunction with the drawing figures, in which like reference numerals are carried forward.
As required, detailed embodiments of the present method and system are disclosed herein. However, it is to be understood that the disclosed embodiments are merely exemplary, which can be embodied in various forms. Therefore, specific structural and functional details disclosed herein are not to be interpreted as limiting, but merely as a basis for the claims and as a representative basis for teaching one skilled in the art to variously employ the embodiments of the present invention in virtually any appropriately detailed structure. Further, the terms and phrases used herein are not intended to be limiting but rather to provide an understandable description of the embodiment herein.
The terms “a” or “an,” as used herein, are defined as one or more than one. The term “plurality,” as used herein, is defined as two or more than two. The term “another,” as used herein, is defined as at least a second or more. The terms “including” and/or “having,” as used herein, are defined as comprising (i.e., open language). The term “coupled,” as used herein, is defined as connected, although not necessarily directly, and not necessarily mechanically. The term “processing” or “processor” can be defined as any number of suitable processors, controllers, units, or the like that are capable of carrying out a pre-programmed or programmed set of instructions. The terms “program,” “software application,” and the like as used herein, are defined as a sequence of instructions designed for execution on a computer system. A program, computer program, or software application may include a subroutine, a function, a procedure, an object method, an object implementation, an executable application, an applet, a midlet, a servlet, a source code, an object code, a shared library/dynamic load library and/or other sequence of instructions designed for execution on a computer system.
The term “synthetic sound” can be defined as sound generated by software or hardware. The term “emulate” can be defined as imitating a function of. The term “acoustic modeling” can be defined as the generating of an acoustic signal through modeling. The term “modeling” can be defined as producing a behavior based on a model. The term “synthesis” can be defined as generating or producing via mathematical algorithms or sampling algorithms. The term “synthesizing” can be defined as creating either from a mathematical model, an acoustic model, a sampled waveform, a frequency modulated waveform, or a musical instrument device interface (MIDI) instrument. The term “waveform modeling” can be defined as sampling a waveform and using a portion of the waveform to synthesize a sound. The term “mathematical modeling” can be defined as using mathematical methods to generate a replica of at least a portion of a waveform or a synthetic waveform. The term “mapping” can be defined as translating one form into another form. The term “valve” can be defined as an object that permits change in pitch by a rapid varying of an air column in a tube. The term “virtual valve” can be defined as an emulated valve. The term “pitch” can be defined as a signal having periodicity. The term “blowing” can mean to produce air turbulence for varying air. The term “air turbulence” can be defined as an eddying motion of air molecules. The term “pressure” can be defined as a force per unit area. The term “musical note” can be defined as a tone of definite pitch. The term “acoustic” can be defined as a signal that carries sound. The term “wind instrument” can be defined as an object that generates or emulates sound in response to a blowing of air through at least one tube. The term “tube” can be defined as a column providing a passage of air for generating turbulence and producing at least one sound.
Referring to
In one aspect, the mobile device can operate as a cell phone over a mobile communications network. For example, the mobile device 160 can provide wireless connectivity over a radio frequency (RF) communication link or a Wireless Local Area Network (WLAN) link. Communication within the mobile device 160 can be established using a wireless, copper wire, and/or fiber optic connection using any suitable protocol. In one arrangement, the mobile device 160 can communicate with a base receiver using a standard communication protocol such as TDMA, CDMA, GSM, or iDEN. The base receiver, in turn, can connect the mobile device 160 to the Internet over a packet switched link. In one arrangement, the mobile device 160 can download musical notations and present the musical notations on a display of the mobile device. A user can also download music, sound files, or data to practice wind instrument training with the mobile device. The mobile device 160 can also download wind instruments from the network for allowing a user to emulate different wind instrument sounds. An image of a wind instrument can also be downloaded to the mobile device and displayed on the display 110 when the user selects the wind instrument.
The mobile device 160 can also connect to the Internet over a WLAN. Wireless Local Access Networks (WLANs) provide wireless access to the mobile communication environment 100 within a local geographical area. WLANs can also complement loading on a cellular system, so as to increase capacity. WLANs are typically composed of a cluster of Access Points (APs) also known as base stations. In typical WLAN implementations, the physical layer uses a variety of technologies such as 802.11b or 802.11g WLAN technologies. The physical layer may use infrared, frequency hopping spread spectrum in the 2.4 GHz Band, or direct sequence spread spectrum in the 2.4 GHz Band. The mobile device 160 can send and receive data to a server or other remote servers on the mobile communication environment.
In one arrangement, musicians utilizing a plurality of mobile devices 160 can collaborate together over a cellular network or a WLAN network, such as an ad-hoc network, to perform music together, but are not limited to the WLAN or cellular arrangement. For example, users in an ad-hoc network can use their mobile devices 160 as an ensemble to rehearse together as a band. As one example, the mobile devices 160 can synchronize a playing of a musical notation that scrolls across a display of the mobile devices. That is, each of the users employing the mobile device 160 as a wind instrument can see the same musical notation as it scrolls by on a display The mobile device 160 can sequence musical notations for synchronous display, thereby allowing for collaborative music training, practice, and development.
Referring to
Briefly, the mobile device 160 can function as a valve-operated wind instrument, such as a trumpet. The microphone 102 can emulate a wind instrument aperture for receiving air, and the keys on the keypad 104 can serve as virtual valves for emulating valves on a wind instrument. For example, a user can press one or more keys on the keypad 104 for operating a virtual wind instrument valve. The mobile device can synthesize a wind instrument sound based on the blowing at the microphone 102 and the combination of virtual valves pressed on the keypad 104.
Referring to
At step 301 the method can start. The method can start in a state wherein a user orients the phone as a wind instrument. In particular, an orientation of the mobile device 160 allows the keys on the keypad 104 to be used similarly as valves on a wind instrument. For example, referring to
At step 310, an acoustic signal can be captured in response to a blowing action of the user on the microphone of the mobile device. For example, referring to
Briefly, referring to
Briefly, referring to
In one arrangement, a pressing of a single key can determine both a wind instrument and the musical note. In another arrangement, a pressing of multiple keys can generate simultaneous musical notes from separate wind instruments. For example, a user can play three wind instruments simultaneously by selecting virtual valves (i.e. keys on the keypad 104) from three different columns. A first column of keys may correspond to a tuba, a second of keys may correspond to a trumpet, and a third column of keys may correspond to a flugel horn. The user can simultaneously play the three wind instruments by selected fingering of the virtual valves on the keypad 104.
Referring back to method 300 of
Briefly, referring to
The mobile device 160 can include a detector 122 for determining an acoustic pressure of the air turbulence, a processor 124 for mapping the acoustic pressure to a musical note, and a synthesis engine 126 for producing a musical note in response to the blowing action based on the at least one valve and the air turbulence. The detector 122 can assess a turbulence of the blowing action and assign a measure based on the turbulence. For example, the detector 122 can measure a velocity of the air flow and associate the air flow with a level. Each level can correspond to a production of a musical note, wherein the musical note is based on the valve selected. For instance, if a user presses key “0” for selecting valve 1 (See
The processor 124 can change the musical note produced as a function of the acoustic pressure, wherein the function is based on at least one threshold such that the at least one musical note changes if the acoustic pressure exceeds the at least one threshold. For example, each key to valve mapping may have more than one level assigned to the valve. For example, valve 1 may have 3 levels corresponding to the three notes: A, A#, B. Valve 2, may have 4 levels corresponding to the four notes: C, C#, and D. Valve 3, may have 3 levels corresponding to the three notes: E, F, and G. The detector 122 can detect an air velocity and assign a level corresponding to the air pressure. The processor 124 can compare the level to one or more thresholds stored in a memory to determine whether the blowing actions corresponds to a note. For example, a level exceeding a threshold can be associated with a musical note corresponding to the last exceeded threshold. For example, each valve may have three thresholds with each threshold associated with a note. A blowing action that results in a level that exceeds a threshold can be associated with the corresponding musical note. The last exceeded threshold can correspond to the musical note. Notably, the key to valve mappings are software configurable and a user can adjust the musical notations accordingly. In general, the key to valve mappings reference a standard valve to note mapping on a wind instrument.
The processor 124 can also assess a consistency of the blowing action based on an acoustic pressure of the air turbulence captured at the microphone. The processor 124 can display a measure of the consistency on the display 110 for informing a user of their breath control. For example, an experienced wind instrument player can produce a blowing action with constant velocity to sustain a note. The constant velocity keeps the turbulence from varying thereby preserving the note. That is, the note does not change. The processor 124 can present breath control information to the display 110 (See
For example, referring to
Referring back to
Referring to
As the fingering chart 810 shows, a note (802) produced by a wind instrument, such as a trumpet, is a combination of which valves (812) are held down and how hard the player blows into the mouthpiece. In such an instrument, 3 and sometimes 4 valves (e.g. keys of the keypad 104) are lined up in a row approximately perpendicular to the performer when the horn is brought into playing position. When a user holds up the mobile device 160 to the user's mouth in a similar position, such as in
The mobile device 160 can also be employed to replicate other wind instruments such as the clarinet, the oboe, the flute, and the like. In principle, these wind instruments are played by covering air holes while blowing into the instrument. The mobile device 160 can also associate the virtual valves with covering air holes. For example, the virtual valves, though not emulating valves, can emulate the covering of holes to generate wind instrument sounds. Also, the keypad 104 (See
The musical notation 800 allows a user to read music and the fingering chart 810 allows a user to see the corresponding fingering of the musical notes. The musical notation 800 can be presented on the display 110 (See
For example, referring to
Furthermore, the display 110 can present the musical note generated by the user for comparison with the actual note. For example, devout musicians may carry the mobile device 160 around for practice instead of an actual wind instrument. Understandably, the mobile device 160 is significantly smaller than an wind instrument such as a tuba or a trumpet. A user can employ the mobile device 160 as a substitute instrument or practice instrument for training. In practice, a user will select a musical notation 800 (See
Where applicable, the present embodiments of the invention can be realized in hardware, software or a combination of hardware and software. Any kind of computer system or other apparatus adapted for carrying out the methods described herein are suitable. A typical combination of hardware and software can be a mobile communications device with a computer program that, when being loaded and executed, can control the mobile communications device such that it carries out the methods described herein. Portions of the present method and system may also be embedded in a computer program product, which comprises all the features enabling the implementation of the methods described herein and which when loaded in a computer system, is able to carry out these methods.
While the preferred embodiments of the invention have been illustrated and described, it will be clear that the embodiments of the invention is not so limited. Numerous modifications, changes, variations, substitutions and equivalents will occur to those skilled in the art without departing from the spirit and scope of the present embodiments of the invention as defined by the appended claims.
Number | Name | Date | Kind |
---|---|---|---|
5170003 | Kawashima | Dec 1992 | A |
5922985 | Taniwaki | Jul 1999 | A |
6740802 | Browne, Jr. | May 2004 | B1 |
7271329 | Franzblau | Sep 2007 | B2 |
20050056139 | Sakurada | Mar 2005 | A1 |
20050076774 | Sakurada | Apr 2005 | A1 |
20050272475 | Hahn | Dec 2005 | A1 |
20060027080 | Schultz | Feb 2006 | A1 |
20070137467 | Sim et al. | Jun 2007 | A1 |
Number | Date | Country | |
---|---|---|---|
20080047415 A1 | Feb 2008 | US |