AUDIO SIGNAL PROCESSING METHOD AND AUDIO SIGNAL PROCESSING DEVICE

Abstract

The audio signal processing method in accordance with one embodiment receives an audio signal, obtains a first image, estimates room information based on the obtained first image, sets an acoustic parameter according to the estimated room information, applies sound processing to the audio signal according to the set acoustic parameter, and outputs the audio signal subjected to the sound processing.

Description

Claims

1. An audio signal processing method comprising: receiving an audio signal;obtaining a first image;estimating room information based on the obtained first image;setting an acoustic parameter according to the estimated room information;applying sound processing to the audio signal according to the set acoustic parameter; andoutputting the audio signal subjected to the sound processing.

2. The audio signal processing method according to claim 1, further comprising changing the acoustic parameter based on the audio signal subjected to the sound processing.

3. The audio signal processing method according to claim 1, further comprising: obtaining a second image at a timing different from a timing when the first image is obtained;estimating the room information from the obtained second image; andchanging the acoustic parameter based on the room information estimated from the second image.

4. The audio signal processing method according to claim 2, wherein the changing changes the acoustic parameter during a predetermined period.

5. The audio signal processing method according to claim 1, wherein: the room information includes space information indicating an open space or a closed space, andthe setting sets the acoustic parameter based on the space information.

6. The audio signal processing method according to claim 1, wherein: the room information includes at least one of a size of a room, a shape of a room, a material quality, a numerical quantity of people, a numerical quantity of chairs, or a shape of a desk, andthe setting sets the acoustic parameter according to at least one of the size of the room, the shape of the room, the material quality, the numerical quantity of people, the numerical quantity of chairs, or the shape of the desk.

7. The audio signal processing method according to claim 1, wherein the sound processing includes at least one of noise reduction, gain adjustment, reverberation removal, or reverberation addition.

8. The audio signal processing method according to claim 1, wherein: the room information includes desk information indicating a position of a desk, andthe acoustic parameter is set according to the desk information.

9. The audio signal processing method according to claim 1, wherein the applying applies the sound processing using a learned model that has learned a relationship between a first audio signal and a second audio signal by machine learning, the second audio signal being obtained by removing noise from the first audio signal.

10. The audio signal processing method according to claim 1, wherein the estimating estimates the room information using a learned model that has learned a relationship between an input image and the room information by machine learning.

11. An audio signal processing device comprising: a memory storing instructions; anda processor configured to implement the instructions to execute a plurality of tasks, including: a receiving task that receives an audio signal;an obtaining task that obtains a first image;an estimating task that estimates room information based on the obtained first image;a setting task that sets an acoustic parameter according to the estimated room information;a signal processing task that processes the audio signal according to the set acoustic parameter; andan outputting task that outputs the audio signal subjected to the sound processing.

12. The audio signal processing device according to claim 11, wherein the signal processing task changes the acoustic parameter based on the audio signal subjected to the sound processing.

13. The audio signal processing device according to claim 11, wherein: the obtaining task obtains a second image at a timing different from a timing when the first image is obtained,the estimating task estimates the room information from the obtained second image, andthe setting task changes the acoustic parameter based on the room information that is estimated from the second image.

14. The audio signal processing device according to claim 12, wherein the signal processing task changes the acoustic parameter during a predetermined period.

15. The audio signal processing device according to claim 11, wherein: the room information includes space information indicating an open space or a closed space, andthe setting task sets the acoustic parameter based on the space information.

16. The audio signal processing device according to claim 11, wherein: the room information includes at least one of a size of a room, a shape of a room, a material quality, a numerical quantity of people, a numerical quantity of chairs, or a shape of a desk, andthe setting task sets the acoustic parameter according to at least one of the size of the room, the shape of the room, the material quality, the numerical quantity of people, the numerical quantity of chairs, or the shape of the desk.

17. The audio signal processing device according to claim 11, wherein the processing performed by the sound processing task includes at least one of noise reduction, gain adjustment, reverberation removal, or reverberation addition.

18. The audio signal processing device according to claim 11, wherein: the room information includes desk information indicating a position of a desk, andthe setter sets the acoustic parameter according to the desk information.

19. The audio signal processing device according to claim 11, wherein the signal processing task processes the audio signal according to the set acoustic parameter using a learned model that has learned a relationship between a first audio signal and a second audio signal by machine learning, the second audio signal being obtained by removing noise from the first audio signal.

20. The audio signal processing device according to claim 11, wherein the estimating task estimates the room information using a learned model that has learned a relationship between an input image and the room information by machine learning.