Patent Application
20230012622
The present disclosure relates to a technology for controlling sound.
Various technologies for changing a feature amount of a sound reproduced in accordance with a user instruction, for example, have been proposed in the prior art. For example, Japanese Laid-Open Patent Application No. 2017-161699 discloses an electronic musical instrument in which the pitch of a sound that is reproduced in response to a key depression by the user is changed (pitch bend) in response to a user operation of a pitch bend wheel.
However, in the conventional configuration, the pitch bend instruction by a user operation of the pitch bend wheel must be made separately from the instruction to generate sound by depressing a key. Therefore, there is the problem that the operations that are required to reproduce the desired sound are highly burdensome to the user. Given this circumstance, an object of one aspect of the present disclosure is to reduce the burden of the user instructions required for sound reproduction.
A reproduction control method according to one aspect of the present disclosure is executed by a computer and comprises detecting a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface, initiating sound reproduction at a first time point at which the first state is detected, continuing the sound reproduction from the first time point to a third time point which subsequent to a second time point at which the second state is detected, and controlling a change in the feature amount of a sound during a first time period, i.e., from the first time point to the second time point.
A reproduction control method according to one aspect of the present disclosure is executed by a computer and comprises reproducing a sound in a state in which an object is in contact with an operation surface, and changing a feature amount of the sound at a speed that corresponds to a movement speed with which the object is moving in a process of the object separating from the operation surface.
A reproduction control system according to one aspect of the present disclosure comprises an electronic controller including at least one processor. The electronic controller is configured to execute a plurality of modules including a state detection module and a reproduction control module. The state detection module is configured to detect a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface. The reproduction control module is configured to initiate sound reproduction at a first time point at which the first state is detected, continue the sound reproduction from the first time point to a third time point, which is subsequent to a second time point at which the second state is detected, and control a change in a feature amount of a sound during a first time period from the first time point to the second time point.
A non-transitory computer readable medium storing a program according to one aspect of the present disclosure causes a computer to execute a process, and the process comprises detecting a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface, initiating sound reproduction at a first time point at which the first state is detected, continuing the sound reproduction from the first time point to a third time point, which is subsequent to a second time point at which the second state is detected, and controlling a change in the feature amount of the sound during a first time period, i.e., from the first time point to the second time point.
Selected embodiments will now be explained in detail below, with reference to the drawings as appropriate. It will be apparent to those skilled from this disclosure that the following descriptions of the embodiments are provided for illustration only and not for the purpose of limiting the invention as defined by the appended claims and their equivalents.
The control system 1 includes an electronic controller (control device 10), a storage device 11, and a sound output device 13. The control system 1 is realized, for example, by an information terminal, such as a smartphone, a tablet terminal, or a personal computer. The control system 1 can be realized as a single device or as a plurality of separate devices.
The electronic controller 10 is one or a plurality of processors that control each element of the control system 1. For example, the electronic controller 10 can be configured to comprise one or more types of processors, such as a CPU (Central Processing Unit), an SPU (Sound Processing Unit), a DSP (Digital Signal Processor), an FPGA (Field Programmable Gate Army), an ASIC (Application Specific integrated Circuit), etc. The electronic controller 10 generates an audio signal X representing the waveform of the target sound in accordance with the user operation. The term “electronic controller” as used herein refers to hardware that executes software programs.
The sound output device 13 reproduces the target sound represented by the audio signal X generated by the electronic controller 10. The sound output device 13 is a speaker or headphones, for example. The D/A converter that converts the audio signal X from digital to analog and the amplifier that amplifies audio signal X have been omitted from the figure for the sake of convenience. Further, the example shown in
The storage device 11 includes one or more memory units (computer memories) for storing a program to be executed by the electronic controller 10 and various data used by the electronic controller 10. The storage device 11 is a known storage medium, such as a magnetic storage medium or a semiconductor storage medium, or a combination of a plurality of various types of storage media. The storage device 11 can be separated from the control system 1 (for example, cloud storage), and the electronic controller 10 can read from or write to the storage device 11 via a communication network, such as a mobile communication network or the Internet. In other words, the storage device 11 can be omitted from the control system 1.
The reproduction control system 100 has a plurality of detection units 2 that correspond to different pitches (hereinafter referred to as “standard pitches”) Ps. Each of the plurality of detection units 2 is an operator with which the user issues an instruction to reproduce a target sound of standard pitch Ps corresponding to the detection unit 2. When the user operates the detection unit 2 out of the plurality of detection units 2 that corresponds to the desired standard pitch Ps, the target sound of the standard pitch Ps is reproduced. Each of the detection units 2 constitutes a key of a keyboard instrument, for example. In other words, the keyboard constitutes an array of the plurality of detection units 2, and the reproduction control system 100 is realized as a keyboard instrument.
The first detector 21 is an optical sensor that detects the state of the user's hand H. The first detector 21 is installed in the vicinity of the midpoint (center) of the bottom surface of the enclosure portion 20a. Specifically, a distance-measuring sensor that measures the distance between the object and a light-receiving surface is used as the first detector 21. For example, the first detector 21 generates a time-series detection signal Q1 that represents the position of the hand (specifically, the distance from the light-receiving surface to hand H) in a direction perpendicular to the operation surface F by receiving the light reflected from the hand H that has passed through the light transmission portion 20b. The detection signal Q1 is transmitted to the control system 1 via wired or wireless communication. The light detected by the first detector 21 is not limited to visible light. For example, invisible light, such as infrared light, can be detected by the first detector 21.
The second detector 22 is a sensor for detecting the contact of the hand H with the operation surface F. For example, a sound collection device that collects ambient sounds is used as the second detector 22. The second detector 22 collects the striking sounds generated when the user's hand H strikes the operation surface F. The second detector 22 generates a detection signal Q2 that represents ambient sounds which include striking sounds. The detection signal Q2 is transmitted to the control system 1 via wired or wireless communication. The second detector 22 can be installed outside of the housing 20.
The state detection module 30 detects the state of the user's hand H in accordance with the detection result (detection signal Q1 and detection signal Q2) of each of the plurality of detection units 2. More specifically, the state detection module 30 detects a first state or a second state as the state of the hand H. As shown in
The state detection module 30 also detects that hand H is in the second state by analyzing the detection signal Q2 generated by the second detector 22. More specifically, the state detection module 30 calculates a volume V of the sound represented by the detection signal Q2. The calculation of volume V is repeated at a prescribed cycle. That is, time-series data are generated that represent volume V. Any known technology can be used to calculate volume V.
The user can issue an instruction to reproduce the target sound of the desired standard pitch Ps by bringing his or her hand H close to the operation surface F of one detection unit 2 which corresponds to the desired standard pitch Ps, among the plurality of detection units 2. The user hand H sequentially enters the first state and the second state in a series of processes of approaching the operation surface F of one of the detection units 2. More specifically, the hand H is in the first state at a specific time point t1 (hereinafter referred to as “first time point”) during the process of the hand H approaching the operation surface F, and the hand H is in the second state at a time point t2 which is subsequent to first time point t1 (hereinafter referred to as “second time point”).
The first time point t1 and second time point t2 are separated by an interval on the time axis.
The reproduction control module 31 of
As illustrated in
The reproduction control module 31 temporally changes the pitch P of the target sound during the first time period T1 from the first time point t1 to the second time point t2. The reproduction control module 31 controls temporal changes in pitch P (that is, the trajectory of the change in pitch P with respect to the time axis) during the first time period T1. More specifically, the reproduction control module 31 linearly or curvilinearly changes the pitch P of the target sound during the first time period T1 from a first pitch P1 to the standard pitch Ps. The first pitch P1 is lower than standard pitch Ps by a prescribed value. Therefore, the first pitch P1 differs for each of the detection units 2. More specifically, the reproduction control module 31 changes the pitch P of the target sound during the entire first time period T1, so that pitch P of the target sound becomes the first pitch P1 at the first time point t1 and reaches the standard pitch Ps at second tune point t2. The change in pitch P during the first time period T1 corresponds to the pitch bend of the target sound. The pitch P is one example of a “feature amount” of the target sound. The standard pitch Ps is one example of a “target value.”
In order to realize the change in pitch P described above, the reproduction control module 31 changes the pitch P of the target sound at a rate (speed) corresponding to the movement speed with which the user hand H is moving (hereinafter referred to as “movement speed”) during the first time period T1. The movement speed is the amount of change in the distance D per unit time calculated by the state detection module 30. The state detection module 30 analyzes the detection signal (image signal) Q1 and calculates the movement speed. More specifically, the reproduction control module 31 changes the pitch P during the first time period of time T1 so that the rate of change in pitch P increases with the movement speed. By the configuration described above, the user can adjust the rate of change in pitch P during the first time period T1 in accordance with the movement speed of the hand H. In the first embodiment, the first pitch P1 and the standard pitch Ps are predetermined. The reproduction control module 31 controls the trajectory of the pitch P (rate of change) from the first pitch P1 to the standard pitch Ps during the first time period T1 in accordance with the movement speed of the user's hand H. A configuration can be employed in which the relationship between the rate of change in pitch P and the movement speed during the first time period T1 can be changed in accordance with an instruction from the user.
The reproduction control module 31 maintains the pitch P of the target sound at standard pitch Ps during the second time period T2 from the second time point t2 to the third time point t3. More specifically, the pitch P of the target sound is fixed to the standard pitch Ps throughout the second time period T2.
When the control process Sa is initiated, the state detection module 30 analyzes the detection signal Q1 and the detection signal Q2 supplied from the detection unit 2 to detect the state of the user's hand H (Sa1). The reproduction control module 31 determines whether the state detection module 30 has detected that the hand H is in the first state (Sa2). If the first state is detected (Sa2: YES), the reproduction control module 31 causes the sound output device 13 to initiate reproduction of the target sound of the first pitch P1 corresponding to the standard pitch Ps of the relevant detection unit 2 (Sa3). If the first state is not detected (Sa2: NO), the reproduction control module 31 ends the control process Sa.
When the reproduction of the target sound is initiated, the reproduction control module 31 changes the pitch P of the target sound in the direction of the standard pitch Ps (Sa4). More specifically, the electronic controller 10 brings the pitch P of the target sound closer to the standard pitch Ps by an amount of change that corresponds to the movement speed of the user's hand H. The reproduction control module 31 determines whether the state detection module 30 has detected that the hand H is in the second state (Sa5). If the second state is not detected (Sa5: NO), the reproduction control module 31 advances to the process of Step Sa4. In other words, during the first time period T1 until the second time point t2 when the second state is detected, the pitch P of the target sound temporally changes in the direction of the standard pitch Ps. By the process described above, the pitch P of the target sound reaches the standard pitch Ps at the second time point t2 when the second state is detected.
If the second state is detected (Sa5: YES), the reproduction control module 31 maintains the pitch P of the target sound at the standard pitch Ps (Sa6), The reproduction control module 31 determines whether the third time point t3 has arrived (Sa7). The pitch P of the target sound is maintained at the standard pitch Ps until the third time point t3 arrives (Sa7: No). In other words, the pitch P of the target sound is maintained at the standard pitch Ps during the second time period T2. When the third time point t3 arrives (Sa7: YES), the reproduction control module 31 stops reproduction of the target sound (Sa8).
As described above, in the first embodiment, target sound reproduction continues from the first time point t1, when the hand H is in the first state, until the third time point t3, which is subsequent to the second time point t2, when the hand is in the second state, and the pitch P of the target sound changes during the first time period T1, from the first time point t1 to the second time point t2. Therefore, it is possible for the user to change the pitch P of the target sound during the first time period T1 by a simple operation of bringing his or her hand H close to the operation surface F. In other words, it is possible to reduce the instructional burden of the user compared with a configuration that requires the user to issue separate instructions for reproducing the target sound and for changing the pitch P.
Further, in the first embodiment, since the pitch P of the target sound reaches the standard pitch Ps at the second time point t2 when the second state is entered, i.e., when the user's hand H comes in contact with the operation surface F, there is the advantage that the user can easily instruct the time that the pitch P reaches the standard pitch Ps. Further, because the pitch P of the target sound is maintained at the standard pitch Ps during the second time period T2, i.e., from the second time point t2 to the third time point t3, there is the advantage that the user can easily instruct the reproduction of the target sound at the standard pitch Ps.
The second embodiment will be described below. In each of the following embodiments, elements that have functions that are similar to corresponding elements in the first embodiment have been assigned the same reference numerals that were used in the description in the first embodiment and their detailed descriptions have been appropriately omitted.
The reproduction control system 100 of the second embodiment detects a state (hereinafter referred to as “third state”) in which the hand H, which has come in contact with the operation surface F, begins to separate from the operation surface F. More specifically, the state detection module 30 detects, as the third state, the state in which the distance D between the operation surface F and the hand H starts to increase from zero.
In the first embodiment, the reproduction of the target sound is stopped at the third time point t3, which is the point in time after which a prescribed length of time has elapsed since the second time point t2. In the second embodiment, the reproduction of the target sound is stopped at the third time point t3, which is the point in time when the state detection module 30 detects the third state. In other words, reproduction of the target sound of the standard pitch Ps is continued during the period that user's hand H is in contact with operation surface F and is stopped when the user's hand H separates from the operation surface F.
The same effects as those of the first embodiment are realized in the second embodiment. Further, in the second embodiment, there is the advantage that the user can easily issue an instruction to stop the reproduction of the target sound by separating his or her hand H from operation surface F.
In addition to maintaining the pitch P of the target sound, the reproduction of which is initiated at the first time point t1, at the standard pitch Ps during the second time period T2, in the same manner as in the first embodiment, the reproduction control module 31 of the third embodiment temporally changes the pitch P of the target sound during the third time period T3. More specifically, the reproduction control module 31 linearly or curvilinearly changes the pitch P of the target sound during the third time period T3 from the standard pitch Ps to a second pitch P2. The second pitch P2 is lower than the standard pitch Ps by a prescribed value. Therefore, the second pitch P2 differs for each of the detection units 2. More specifically, the reproduction control module 31 temporally changes the pitch P of the target sound throughout the third time period T3, so that the pitch P of the target sound, which is at the standard pitch Ps at third time point t3, reaches the second pitch P2 at the fourth time point t4. Whether the first pitch P1 and the second pitch P2 are the same or different, as well as which pitch is higher (lower), can be arbitrarily set.
In order to realize the change in pitch P during the third time period T3 described above, the reproduction control module 31 changes the pitch P of the target sound at a rate (speed) that corresponds to the movement speed of the hand H during the third time period 13. More specifically, the reproduction control module 31 changes the pitch P during the third time period T3 such that the rate of change in pitch P increases with the movement speed. By the configuration described above, the user can adjust the rate of change in pitch P during the third time period T3 in accordance with the movement speed of the hand H. The relationship between the rate of change in pitch P and the movement speed during the third time period T3 can be changed in accordance with an instruction from the user.
Specific modified embodiments to be added to each of the aforementioned embodiment examples are illustrated below. Two or more embodiments arbitrarily selected from the following examples can be appropriately combined insofar as they are not mutually contradictory.
(1) In the embodiments described above, cases in which the first detector 21 is a distance measurement sensor is used as an example, but the type of first detector 21 is not limited to the example described above. For example, an image sensor that captures an image of the user's hand H can be used as the first detector 21. In this case, the state detection module 30 analyzes the image of the hand. H captured by the first detector 21 to calculate the distance D, and detects the first state in accordance with the distance D. Further, an infrared sensor that emits and receives infrared light can be used as the first detector 21. In this case, the state detection module 30 calculates the distance D from the intensity of the received infrared light reflected from the surface of the hand H. Further, the position in which the first detector 21 is installed is arbitrary. For example, the first detector 21 can capture an image of the hand H from the side.
(2) In the aforementioned embodiments, the detection signal Q2 that represents sounds that include striking sounds is analyzed to detect the second state, but the configuration and method of detecting the contact of the hand H with the operation surface F is not limited to the example described above. For example, the detection signal Q1 generated by the first detector 21 can be analyzed to detect contact of the hand H with the operation surface F (that is, the second state). For example, the state detection module 30 determines that the user's hand H is in the second state when distance D identified from the detection signal Q1 reaches zero. The second detector 22 is omitted in a configuration in which detection signal Q1 is used for the detection of the second state. Further, a contact sensor (for example, an electrostatic capacitive sensor) that detects contact of the hand H with the operation surface F (light transmission portion 20b), a vibration sensor that detects the vibration of the operation surface F (light transmission portion 20b), or a pressure sensor that detects pressure from the hand H that acts on the operation surface F can be used as the second detector 22.
(3) In the aforementioned embodiments, a configuration in which the user's hand H comes in contact with the operation surface F is used, but the object coming in contact with the operation surface F is not limited to a hand H. For example, the user can strike operation surface F with a striking member such as a stick for a percussion instrument. As can be understood from the examples described above, objects coming in contact with the operation surface F include both a part of the user's body (typically, hand H) and a striking member operated by the user. In a configuration in which a striking member strikes the operation surface F, the first detector 21 or the second detector 22 can be mounted on the striking member.
(4) The configuration of the housing 20 of the detection unit 2 is arbitrary. Further, the structure in which the first detector 21 and the second detector 22 are housed in the housing 20 is not mandatory. In other words, as long as the detection unit 2 includes the operation surface F with which an object such as the user's hand H comes in contact, the specific structure and presence/absence of the housing 20 are not particularly limited.
(5) In the aforementioned embodiments, the pitch P of the target sound is changed throughout the first time period T1, but the pitch P of the target sound can be changed during a part of the first time period T1, and the pitch P can be maintained during the remaining period. In other words, the pitch P of the target sound can reach the standard pitch Ps before the arrival of second time point t2. As can be understood from the foregoing explanation, the “change in pitch P during the first time period T1” means a change in pitch P during some or all of the first time period T1. Similarly, a “change in pitch P during the third time period T3” means a change in pitch P during some or all of third time period T3.
(6) In the aforementioned embodiments, the pitch P of the target sound is changed at a rate corresponding to the movement speed of the user's hand H, but the way in which the pitch P is linked to the movement speed of the user's hand H is not limited to the examples described above. For example, the pitch P of the target sound can be changed in accordance with the distance D of the hand H with respect to the operation surface F. The reproduction control module 31 can, for example, temporally changes the pitch P of the target sound so that the pitch P increases as the distance D decreases, with the pitch P reaching the standard pitch Ps when the distance D becomes zero. During the first time period T1, the pitch P can be decreased as the distance D increases.
Further, the reproduction control module 31 can change the pitch P of the target sound in accordance with the direction in which the user's hand H moves (hereinafter referred to as “direction of movement). The state detection module 30 analyzes the detection signal (image signal) Q1 to identify the direction of movement of the hand H with respect to the operation surface F. The reproduction control module 31 controls the relationship between changes in pitch P with respect to the time axis (that is, the trajectory of pitch P with respect to the passage of time) in accordance with the direction of movement of hand H. More specifically, when the angle of the direction of movement with respect to the operation surface F is within a first range, the reproduction control module 31 changes the pitch P to follow a first trajectory over time. On the other hand, when the angle of the direction of movement with respect to the operation surface F is within a second range, the reproduction control module 31 changes the pitch P to follow a second trajectory, which is different from the first trajectory, over time. For example, when the angle between the direction of movement and the operation surface F exceeds a prescribed threshold value, the reproduction control module 31 changes the pitch P abruptly with respect to time (first trajectory). On the other hand, when the angle between the direction of movement and the operation surface F is less than the threshold value, the reproduction control module 31 changes pitch P gradually with respect to time (second trajectory).
As can be understood from the example described above, the reproduction control module 31 changes the pitch P of the target sound in accordance with a parameter related to the position of user hand H. The above-mentioned movement speed, distance D, and direction of movement are specific examples of parameters related to the position of the hand H. The position of the user's hand H itself can also be used as a parameter. For example, in addition to the position of the hand H a direction perpendicular to the operation surface F (for example, the distance D), the position of hand H in a plane parallel to operation surface F is included in the parameters related to the position of the hand H. The parameters related to the position of the hand H are identified by analysis of the detection signal (image signal) Q1, for example, as illustrated in the aforementioned embodiments.
(7) In the aforementioned embodiments, a configuration in which the first pitch P1 is lower than the standard pitch Ps is described, but a configuration in which the first pitch P1 is higher than the standard pitch Ps can also be used. In other words, the pitch P of the target sound can decrease with time from the first pitch P1 to the standard pitch Ps during the first time period T1. Further, the first pitch P1 can be set in accordance with an instruction from the user.
In the third embodiment, a configuration in which the second pitch P2 is lower than the standard pitch Ps is described, but a configuration in which the second pitch P2 is higher than the standard pitch Ps can also be used. In other words, the pitch P of the target sound can increase with time from the second pitch P2 to the standard pitch Ps during the third time period T3. Further, the second pitch P2 can be set in accordance with an instruction from the user.
(8) In the aforementioned embodiments, the pitch P of the target sound is controlled in accordance with the state of the hand H, but the feature amount of the target sound to be controlled by the reproduction control module 31 is not limited to the pitch P. For example, the volume of the target sound can be controlled in accordance with the state of the hand H. Further, the tone of the target sound can be controlled in accordance with the state of the hand H. For example, the reproduction control module 31 generates an audio signal X representing the target sound of an intermediate tone between a first tone and a second tone by mixing first waveform data representing the sound of the first tone and second waveform data representing the sound of the second tone. The reproduction control module 31 changes the mixing ratio of the first waveform data and the second waveform data in accordance with the state of the user's hand H, in the same manner as with the pitch P in the aforementioned embodiments. By the configuration described above, it is possible bring the tone of the target sound from one of the first tone and the second tone to the other during the first time period T1 or the third time period T3, for example.
(9) in the aforementioned embodiments, a configuration in which the user's hand H actually comes in contact with the operation surface F is used as an example, but a configuration can be adopted in which the user touches a virtual operation surface F using haptic technology (haptics) that employs tactile feedback, for example. In this case, the user operates a simulated hand that exists in virtual space to contact the operation surface F installed in the virtual space. By using a vibrating body that vibrates when the operation surface F in virtual space is touched, the user perceives that he or she is actually in contact with the operation surface F. As can be understood from the foregoing explanation, the operation surface F can be a virtual surface in virtual space. Similarly, the object (e.g., hand H) that comes in contact with operation surface F can be a virtual object in virtual space.
(10) As described above, the functions of the reproduction control system 100 (particularly the function of the control system 1) used by way of example above are realized by cooperation between one or a plurality of processors that constitute the electronic controller 10 and a program stored in the storage device 11. The program according to the present disclosure can be provided in a form stored in a computer-readable storage medium and installed in a computer. For example, the storage medium can be a non-transitory storage medium, a good example of which is an optical storage medium (optical disc) such as a CD-ROM, but can include storage media of any known form, such as a semiconductor storage medium or a magnetic storage medium. Non-transitory storage media include any storage medium that excludes transitory propagating signals and does not exclude volatile storage media. Further, in a configuration in which a distribution device distributes the program via a communication network, a storage device that stores the program in the distribution device corresponds to the non-transitory storage medium.
For example, the following configurations can be understood from the foregoing embodiment examples.
A reproduction control method according to one aspect (Aspect 1) of the present disclosure is executed by a computer and comprises detecting a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface, initiating sound reproduction at a first time point when the first state is detected, continuing the sound reproduction from the first time point to a third time point, which is subsequent to a second time point when the second state is detected, and controlling a change in a feature amount of the sound within a first time period, i.e., from the first time point to the second time point.
By the aspect described above, sound reproduction is maintained from the first time point, when the object is in the first state, until the third time point, which is subsequent to the second time point, when the object is in the second state, and the feature amount of the sound is varied during the first time period from the first time point to the second time point. Therefore, it is possible to reduce the user burden compared with a configuration that requires the user to issue separate instructions for reproducing the target sound and for changing the feature amount. The feature amount of the sound can be, for example, the pitch, volume, or timbre.
In a specific example (Aspect 2) of Aspect 1, the control includes changing a feature amount of the sound during the first time period such that the feature amount of the sound reaches a target value at the second time point. By the aspect described above, since the feature amount of the sound reaches the target value at the second time point when the second state is entered when the object comes in contact with the operation surface, there is the advantage that the user can easily control the time that the feature amount reaches the target value.
In a specific example (Aspect 3) of Aspect 2, the reproduction control method further comprises maintaining the feature amount of the sound at the target value during a second time period, i.e., from the second time point to the third time point, By this aspect, because the feature amount of the sound is maintained at the target value during the second time period, i.e., from the second time point to the third time point, there is the advantage that the user can easily instruct the reproduction of the sound whose feature amount is the target value.
In a specific example (Aspect 4) of any one of Aspects 1 to 3, the control includes changing the feature amount of the sound in accordance with a parameter related to the position of the object during the first time period. By this aspect, the trajectory of the change in the feature amount can be adjusted during the first time period in accordance with the position of the object. Examples of parameters related to the position of the object include the speed with which the object Moves (Aspect 5), the distance of the object with respect to the operation surface (Aspect 6), and the direction of movement of the object (Aspect 7).
In a specific example (Aspect 8) of any one of Aspects 1 to 7, the feature amount of the sound is the pitch of the sound. By the configuration described above, the change in pitch (pitch bend) can be controlled at the beginning (during the first time period) of the start of sound reproduction.
A reproduction control method according to one aspect (Aspect 9) of this disclosure is executed by a computer and comprises reproducing sound in a state in which an object is in contact with an operation surface, and changing a feature amount of the sound at a rate that corresponds to the speed with which the object is moving in the process of the object separating from the operation surface.
A reproduction control system according to one aspect (Aspect 10) of this disclosure comprises a state detection unit for detecting a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface, and a reproduction control unit for initiating sound reproduction at a first time point when the first state is detected, continuing sound reproduction from the first time point to a third time point, which is subsequent to a second time point when the second state is detected, and controlling a change in a feature amount of the sound within a first time period, i.e., from the first time point to the second time point.
A program according to one aspect (Aspect 11) of this disclosure causes a computer to execute a process for detecting a first state in which an object is separated from an operation surface by a prescribed distance and a second state in which the object is in contact with the operation surface, initiating sound reproduction at a first time point when the first state is detected, continuing sound reproduction from the first time point to a third time point, which is subsequent to a second time point when the second state is detected, and controlling a change in a feature amount of the sound within a first time period, i.e., from the first time point to the second time point.
The present disclosure can be applied to a reproduction control method, a reproduction control system, or a program. The reproduction control method is executed by the electronic controller 10 as a computer.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2020-050817 | Mar 2020 | JP | national |
This application is a continuation application of International Application No. PCT/JP2020/045816, filed Dec. 9, 2020, which claims priority to Japanese Patent Application No. 2020-050817 filed in Japan on Mar. 23, 2020. The entire disclosures of International Application No. PCT/JP2020/045816 and Japanese Patent Application No. 2020-050817 are hereby incorporated herein by reference.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2020/045816 | Dec 2020 | US |
| Child | 17950697 | US |
