Patent Grant
10991392
Examples of the disclosure relate to an apparatus, electronic device, system, method and computer program for capturing audio signals. In particular examples of the disclosure relate to an apparatus, electronic device, system, method and computer program for capturing audio signals by microphones distributed in different locations.
Apparatus for capturing audio signals are known. Some apparatus enable a user to capture enhanced audio signals such as spatial audio signals. The spatial audio signals may be signals which have directional properties. The spatial audio signals may be signals which enable the directional properties of sounds to be recreated. Other types of enhanced audio signals may comprise a beamformed audio signal, a noise cancelled audio signal, a stereo audio signal.
It is useful to provide improved devices to enable users to capture enhanced audio signals. For instance, if the spatial audio recording capabilities of a mobile electronic device can be improved this may make it easier for a user to obtain high quality spatial audio recordings.
According to various, but not necessarily all, examples of the disclosure there is provided an apparatus comprising: processing circuitry; and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to: enable a wireless connection to be established with an electronic device; capture an audio signal and enable the captured audio signal to be sent to the electronic device using the wireless connection to enable the captured audio signal to be used to create an enhanced audio signal; and wherein the apparatus is arranged to be removeably attachable to the electronic device.
The processing circuitry and the memory circuitry may be configured to enable a position of the apparatus relative to the electronic device to be determined and to enable the determined position of the apparatus relative to the electronic device to be used to create the enhanced audio signal.
Determining the position of the apparatus relative to the electronic device may comprise determining the location of the apparatus relative to the electronic device.
Determining the position of the apparatus relative to the electronic device may comprise determining an orientation of the apparatus.
Determining the position of the apparatus relative to the electronic device may comprise determining the position of the apparatus relative to a field of view of a camera of the electronic device.
The enhanced audio signal may comprise at least one of; a spatial audio signal, a beamformed audio signal, a noise cancelled audio signal, a stereo audio signal.
The processing circuitry and the memory circuitry may be configured to enable at least some processing of the captured audio signal before it is transmitted to the electronic device.
The processing circuitry and the memory circuitry may be configured to enable the apparatus to receive control signals from the electronic device. The received control signals may enable control of the audio signals that are to be captured. The received control signals may enable control of processing of the captured audio signals before they are transmitted to the electronic device.
The enhanced audio signal may be created from at least one audio signal captured by the apparatus and at least one audio signal captured by the electronic device.
According to various, but not necessarily all, examples of the disclosure the apparatus may be provided in a removable cover for the electronic device.
The removable cover may comprise one or more microphones.
The removable cover may comprise a power source.
The removable cover may comprise one or more transceivers configured to enable wireless communications.
According to various, but not necessarily all, examples of the disclosure there may be provided an electronic device configured to be removably attached to an apparatus as described above.
The electronic device may comprise at least one camera.
The electronic device may comprise one or more microphones.
According to various, but not necessarily all, examples of the disclosure there may be provided a system comprising an apparatus as described above and an electronic device as described above.
According to various, but not necessarily all, examples of the disclosure there may be provided a method comprising: enabling a wireless connection to be established between an apparatus and an electronic device; capturing an audio signal and enabling the captured audio signal to be sent to the electronic device using the wireless connection to enable the captured audio signal to be used to create an enhanced audio signal; and wherein the apparatus is arranged to be removably attachable to the electronic device.
The method may comprise enabling a position of the apparatus relative to the electronic device to be determined and enabling the determined position of the apparatus relative to the electronic device to be used to create the enhanced audio signal.
Determining the position of the apparatus relative to the electronic device may comprise determining the location of the apparatus relative to the electronic device.
Determining the position of the apparatus relative to the electronic device may comprise determining an orientation of the apparatus.
Determining the position of the apparatus relative to the electronic device may comprise determining the position of the apparatus relative to a field of view of a camera of the electronic device.
The enhanced audio signal may comprise at least one of; a spatial audio signal, a beamformed audio signal, a noise cancelled audio signal, a stereo audio signal.
The method may comprise performing at least some processing of the captured audio signal before it is transmitted to the electronic device.
The method may comprise receiving control signals from the electronic device. The received control signals may enable control of the audio signals that are to be captured. The received control signals may enable control of processing of the captured audio signals before they are transmitted to the electronic device.
The enhanced audio signal may be created from at least one audio signal captured by the apparatus and at least one audio signal captured by the electronic device.
According to various, but not necessarily all, examples of the disclosure there may be provided a computer program comprising computer program instructions that, when executed by processing circuitry, enable: enabling a wireless connection to be established between an apparatus and an electronic device; capturing an audio signal and enabling the captured audio signal to be sent to the electronic device using the wireless connection to enable the captured audio signal to be used to create an enhanced audio signal; and wherein the apparatus is arranged to be removeably attachable to the electronic device.
According to various, but not necessarily all, examples of the disclosure there may be provided a computer program comprising program instructions for causing a computer to perform any of the methods described above.
According to various, but not necessarily all, examples of the disclosure there may be provided a physical entity embodying the computer program as described above.
According to various, but not necessarily all, examples of the disclosure there may be provided an electromagnetic carrier signal carrying the computer program as described above.
According to various, but not necessarily all, examples of the disclosure there may be provided an electronic device comprising: processing circuitry; and memory circuitry including computer program code, the memory circuitry and the computer program code configured to, with the processing circuitry, enable the apparatus to: enable a wireless connection to be established with a cover wherein the cover comprises one or more microphones; enable a captured audio signal to be received from the cover using the wireless connection wherein the audio signal is captured by the one or more microphones of the cover; enable the captured audio signal to be used to create an enhanced audio signal; and wherein the cover is arranged to be removeably attachable to the electronic device.
According to various, but not necessarily all, example of the disclosure there may be provided examples as claimed in the appended claims.
For a better understanding of various examples that are useful for understanding the detailed description, reference will now be made by way of example only to the accompanying drawings in which:
The Figures illustrate an apparatus 1 comprising: processing circuitry 5; and memory circuitry 7 including computer program code 11, the memory circuitry 7 and the computer program code 11 configured to, with the processing circuitry 5, enable the apparatus 1 to: enable 71 a wireless connection to be established with an electronic device 31; capture 73 an audio signal and enable the captured audio signal to be sent to the electronic device 31 using the wireless connection to enable the captured audio signal to be used to create an enhanced audio signal; and wherein the apparatus 1 is arranged to be removeably attachable to the electronic device 31.
The apparatus 1 may be for enabling audio signals to be captured. In some examples the apparatus 1 may be for enabling enhanced audio signals such as spatial audio signals to be captured. In some examples the apparatus 1 may be provided in a cover 21 for an electronic device 31. The cover 21 may be configured to be removably attached to the electronic device 31 so that a user may place the electronic device 31 in a first position and the removable cover 21 in a second position to enable spatial audio signals to be captured.
The example apparatus 1 comprises controlling circuitry 3. The controlling circuitry 3 may provide means for controlling other components of the cover 21. The controlling circuitry 3 may also provide means for performing the methods or at least part of the methods of examples of the disclosure.
The processing circuitry 5 may be configured to read from and write to memory circuitry 7. The processing circuitry 5 may comprise one or more processors. The processing circuitry 5 may also comprise an output interface via which data and/or commands are output by the processing circuitry 5 and an input interface via which data and/or commands are input to the processing circuitry 5.
The memory circuitry 7 may be configured to store a computer program 9 comprising computer program instructions (computer program code 11) that controls the operation of the apparatus 1 when loaded into processing circuitry 5. The computer program instructions, of the computer program 9, provide the logic and routines that enable the apparatus 1 to perform the example methods illustrated in
In some examples the computer program 9 may comprise an audio capturing application. The audio capturing application may be configured to capture audio signals obtained by one or more microphones and may enable the captured audio signals to be stored in the memory circuitry 7. In some examples the audio capturing application may enable some processing of the audio signal before it is transmitted to an electronic device.
In some examples the computer program 9 may comprise a positioning application. The positioning application may be configured to enable the position of the apparatus 1 to be determined. The positioning application may enable the position of the apparatus 1 relative to the electronic device 31 to be determined. The positioning application may enable the location of the apparatus 1 relative to the electronic device 31 to be determined. In some examples the positioning application may enable the orientation of the apparatus 1 relative to the electronic device 31 to be determined. In some examples the positioning application may enable the position of the apparatus 1 relative to a field of view of a camera of the electronic device 31 to be determined.
The apparatus 1 therefore comprises: processing circuitry 5; and memory circuitry 7 including computer program code 11, the memory circuitry 7 and computer program code 11 configured to, with the processing circuitry 5, cause the apparatus 1 at least to perform: enabling 71 a wireless connection to be established with an electronic device 31; capturing 73 an audio signal and enabling the captured audio signal to be sent to the electronic device 31 using the wireless connection to enable the captured audio signal to be used to create an enhanced audio signal; and wherein the apparatus 1 is arranged to be removeably attachable to the electronic device 31.
The computer program 9 may arrive at the apparatus 1 via any suitable delivery mechanism. The delivery mechanism may be, for example, a non-transitory computer-readable storage medium, a computer program product, a memory device, a record medium such as a compact disc read-only memory (CD-ROM) or digital versatile disc (DVD), or an article of manufacture that tangibly embodies the computer program. The delivery mechanism may be a signal configured to reliably transfer the computer program 9. The apparatus may propagate or transmit the computer program 9 as a computer data signal. In some examples the computer program code 11 may be transmitted to the apparatus 1 using a wireless protocol such as Bluetooth, Bluetooth Low Energy, Bluetooth Smart, 6LoWPan (IPv6 over low power personal area networks) ZigBee, ANT+, near field communication (NFC), Radio frequency identification, wireless local area network (wireless LAN) or any other suitable protocol.
Although the memory circuitry 7 is illustrated as a single component in the Figures it is to be appreciated that it may be implemented as one or more separate components some or all of which may be integrated/removable and/or may provide permanent/semi-permanent/dynamic/cached storage.
Although the processing circuitry 5 is illustrated as a single component in the figures it is to be appreciated that it may be implemented as one or more separate components some or all of which may be integrated/removable.
References to “computer-readable storage medium”, “computer program product”, “tangibly embodied computer program” etc. or a “controller”, “computer”, “processor” etc. should be understood to encompass not only computers having different architectures such as single/multi-processor architectures, Reduced Instruction Set Computing (RISC) and sequential (Von Neumann)/parallel architectures but also specialized circuits such as field-programmable gate arrays (FPGA), application-specific integrated circuits (ASIC), signal processing devices and other processing circuitry. References to computer program, instructions, code etc. should be understood to encompass software for a programmable processor or firmware such as, for example, the programmable content of a hardware device whether instructions for a processor, or configuration settings for a fixed-function device, gate array or programmable logic device etc.
As used in this application, the term “circuitry” refers to all of the following:
(a) hardware-only circuit implementations (such as implementations in only analog and/or digital circuitry) and
(b) to combinations of circuits and software (and/or firmware), such as (as applicable): (i) to a combination of processor(s) or (ii) to portions of processor(s)/software (including digital signal processor(s)), software, and memory(ies) that work together to cause an apparatus, such as a mobile phone or server, to perform various functions) and
(c) to circuits, such as a microprocessor(s) or a portion of a microprocessor(s), that require software or firmware for operation, even if the software or firmware is not physically present.
This definition of “circuitry” applies to all uses of this term in this application, including in any claims. As a further example, as used in this application, the term “circuitry” would also cover an implementation of merely a processor (or multiple processors) or portion of a processor and its (or their) accompanying software and/or firmware. The term “circuitry” would also cover, for example and if applicable to the particular claim element, a baseband integrated circuit or applications processor integrated circuit for a mobile phone or a similar integrated circuit in a server, a cellular network device, or other network device.
The apparatus 1 may be as described above in relation to
The one or more microphones 23 may comprise any means which may enable an audio signal to be converted into an electrical signal. The one or more microphones 23 may comprise any suitable type of microphones 23. In some examples the microphones 23 may comprise digital microphones. In some examples the microphones 23 may comprise analogue microphones. In some examples the one or more microphones 23 may comprise an electret condenser microphone (ECM), a micro electro mechanical system (MEMS) microphone or any other suitable type of microphone.
The one or more microphones 23 may be coupled to the apparatus 1 to enable the apparatus 1 to process the audio signals detected by the plurality of microphones 23.
In some examples the cover 21 may comprise a plurality of microphones. The plurality of microphones may be located in different positions within the cover 21 so as to enable a spatial audio signal to be obtained by the apparatus 1 in the cover 21.
The power source 25 may comprise any means which may be configured to provide power to the components of the cover 21 such as the processing circuitry 5 and the microphones 23. In some examples the power source 25 may comprise a battery. In other examples the power source 25 could comprise a photovoltaic power source or any other suitable means.
The one or more transceivers 27 may comprise one or more transmitters and/or receivers. The one or more transceivers 27 may comprise any means which enables the apparatus 1 to establish a communication connection with an electronic device 31 and exchange information with the electronic device 31. The communication connection may comprise a wireless connection.
Any suitable methods or processes may be used to establish a communication connection between the apparatus 1 and an electronic device 31. The communication connection could be established using a known connection between the apparatus 1 and an electronic device 31. The connection process could be initiated by either the apparatus 1 or the electronic device 31. In some examples the communication connection could be established by an automatic pairing between the apparatus 1 and an electronic device 31. For example, if the apparatus 1 and the electronic device are NFC enabled the communication connection could be established automatically.
In some examples the one or more transceivers 27 may enable the apparatus 1 to communicate in local area networks such as wireless local area networks (WLAN), Bluetooth networks or any other suitable networks. In some examples the one or more transceivers 27 may enable short range communications between the apparatus 1 and an electronic device 31 such as near field communications (NFC) or any other suitable communication link.
The one or more transceivers 27 may be coupled to the apparatus 1 within the cover 21. The one or more transceivers 27 may be configured to receive signals from the apparatus 1 to enable the signals to be transmitted. The signals to be transmitted may comprise the captured audio signals. The audio signals may be transmitted to the electronic device 31.
The attachment portion 29 may comprise any means which enables the cover 21 to be attached to the electronic device 31. The attachment portion 29 may enable the cover 21 to be removably attached to the electronic device 31. The cover 21 may be removably attached to the electronic device 31 so that a user can easily connect and separate the cover 21 and electronic device 31 as needed. The attachment portion 29 may enable a user to connect and separate the cover 21 and electronic device 31 without the need for any additional tools.
In some examples the cover 21 may comprise a casing which is sized and shaped so as to fit tightly around the electronic device 31. In such examples the attachment portion may comprise the edges of the casing which may be arranged to grip the sides of the electronic device 31. A user may be able to attach the cover 21 to the electronic device 31 by pushing the electronic device 31 into the casing. The user may be able to release the cover 21 from the electronic device 31 by bending a part of the casing so that the edges of the casing release the grip on the sides of the electronic device 31. It is to be appreciated that other means for connecting and releasing the cover 21 and the electronic device 31 may be used in other examples of the disclosure.
As mentioned above, in some examples, the cover 21 may comprise components that are not illustrated in
In the examples of
In the example of
The controlling circuitry 31 may comprise processing circuitry 5 and memory circuitry 7 which may be configured to store a computer program 9 comprising computer program code 11. The processing circuitry 5 and memory circuitry 7 may be as described above.
The controlling circuitry 33 may be configured to control the electronic device 31. The controlling circuitry 33 may be arranged to control the components illustrated in
The one or more microphones 35 may be similar to the one or more microphones 23 provided in the cover 21. In some examples the electronic device 31 may comprise a plurality of microphones 35 which may be distributed over the electronic device 31 so as to enable a spatial audio signal to be captured.
The one or more transceivers 37 may comprise one or more transmitters and/or receivers. The one or more transceivers 37 may comprise any means which enables the electronic device 31 to establish a communication connection with the cover 21 and exchange information with the cover 21. The communication connection may comprise a wireless connection.
In some examples the one or more transceivers 37 may enable the electronic device 31 to exchange information with the cover 21 when the cover 21 is separated from the electronic device 31. In some examples the one or more transceivers 37 may enable the electronic device 31 to exchange information with the cover 21 when the cover 21 is connected to the electronic device 31. In other examples when the cover 21 is connected to the electronic device the controlling circuitry 33 of the electronic device 31 may be arranged to control components of the cover 21 so that the wireless connection is not needed.
The one or more transceivers 37 of the electronic device 31 may also enable the electronic device 31 to establish a communication connection with other devices. For instance, the one or more transceivers 37 may enable the electronic device 31 to communicate within a cellular network or any other suitable communication network.
The power source 39 may comprise any means for providing power to the components of the electronic device 31. The power source 39 may be configured so that when the cover 21 is connected to the electronic device 31 the power source also provides power to the components of the cover 21. The power source 39 may be configured to enable the power source 39 of the electronic device 31 to be used to charge the power source 25 of the cover 21. The power source 39 of the electronic device 31 may have a larger capacity than the power source 25 of the cover 21.
The example electronic device 31 also comprises a camera 41. In some examples the electronic device 31 may comprise a plurality of cameras 41. The camera 41 may comprise any means which enables the electronic device 31 to capture images. The camera 41 may comprise an image sensor which may be configured to convert light incident on the image sensor into an electrical signal to enable an image to be produced. The image sensors may comprise, for example, digital image sensors such as charge-coupled-devices (CCD) or complementary metal-oxide-semiconductors (CMOS). The images which are obtained may provide a representation of a scene and/or objects which are positioned in front of the camera 41.
The camera 41 may be arranged to obtain still images and/or video images. The camera 41 may be arranged to capture images at the same time as the microphones 35 capture the spatial audio signal.
The cameras 41 may be coupled to the apparatus 1 so that electrical signals comprising captured image information may be provided to the controlling circuitry 33.
The housing 43 may provide an external housing for the electronic device 31. The housing 43 may be configured so that the components of the electronic device 31 are entirely contained within the housing 43. The housing 43 may provide protection for the components of the electronic device 31. For example, the housing 43 may protect the components of the electronic device 31 from atmospheric conditions such as moisture or temperature variations. The housing 43 may also be configured to protect the components of the electronic device 31 from impact forces.
The housing 43 may be arranged so that, when the cover 21 is attached to the electronic device 31, the attachment portion 29 of the cover 21 is connected to a part of the housing 43. In some examples the housing 43 may comprise receiving means which may enable the cover 21 to be securely attached to the electronic device 31.
The electronic device 31 may be configured so that the electronic device 31 is operable both with the cover 21 attached and without the cover 21 attached. In the example system of
When the cover 21 is connected to the electronic device 31 an electrical connection may be established between the electronic device 31 and the cover 21. This may enable the controlling circuitry 33 of the electronic device 31 to also control functions of the cover 21. For instance this may enable a user to select whether to use the microphones 23 of the cover 21 or the microphones 35 of the electronic device 31 for capturing audio signals. In some examples this may enable both the microphones 23 of the cover 21 and the microphones 35 of the electronic device 31 to be used. For instance, the microphones 35 of the electronic device 31 could be used to capture a main audio signal while the microphones 23 of the cover 21 could be used to capture audio signals which can then be used to remove unwanted sounds such as noise or background sounds.
In the example of
When the cover 21 is removed from the electronic device 31 a wireless connection may be established between the cover 21 and the electronic device 31. The wireless connection may enable information to be exchanged between the cover 21 and the electronic device 31. The wireless connection may enable audio signals captured by the cover 21 to be transmitted to the electronic device 31. In some examples the apparatus 1 may be arranged to perform some processing of the captured audio signals before they are transmitted to the electronic device 31.
The wireless connection may also enable the electronic device 31 to send control signals to the cover 21. In some examples the control signals may enable control of the audio signals that are to be captured by the cover 21 and/or the processing of the signals that is to be performed. This may ensure that audio signals captured by the cover 21 may be combined with audio signals captured by the electronic device 31 to obtain an enhanced audio signal.
The enhanced audio signal may comprise any suitable type of audio signal where the audio signal captured by the apparatus 1 is used to modify or enhance an audio signal captured by the electronic device 31. In some examples the enhanced audio signal may comprise a spatial audio signal. In such examples the position of the apparatus 1 relative to the electronic device 31 may be used to create the spatial audio signal. In other examples of the disclosure other types of enhanced audio signals may be created. For instance, in some examples the audio signal captured by the apparatus 1 may be used for noise cancelling. This may improve the quality of the audio signals perceived by the user. In some examples the audio signal captured by the apparatus 1 may be used for beamforming or to create other directional signals. In some examples the captured audio signals may be used to create a stereo audio signal or any other suitable type of enhanced audio signal.
In some examples the audio signal captured by the apparatus 1 may be used to enhance an audio signal captured by the electronic device 31 by increasing the signal to noise ratio of the audio signal. For instance, the apparatus 1 may be removed from the electronic device 31 and positioned closer to the sound source than the electronic device 31. This may enable an improved audio signal to be obtained by the apparatus 1 compared to the electronic device 31.
In the example system 30 of
In the example of
In order to enable a spatial audio signal to be captured the position of the cover 21 relative to the electronic device 31 is determined. The position of the cover 21 may comprise the location of the cover 21 relative to the electronic device 31. The relative location may be determined by determining the distance between the cover 21 and the electronic device 31 and the bearing of the cover 21 relative to the electronic device 31. The relative orientation may be the angular position of the electronic device 31 relative to the cover 21. The orientation may be determined by determining the rotation of the cover 21 relative to the electronic device 31.
Any suitable methods and/or combinations of methods may be used to determine the position of the cover 21 relative to the electronic device 31. In some examples GPS (global positioning system) may be used to determine the locations of the cover 21 and the electronic device 31. In such examples both the cover 21 and the electronic device 31 may be arranged to communicate within a GPS network. Other systems may be used in other examples of the disclosure. For instance HAIP (high accuracy indoor positioning) or any other suitable system could be used.
Any suitable means may be used to detect the orientation of the cover 21 and the electronic device 31. For instance in some examples, both the cover 21 and the electronic device 31 may comprise an accelerometer which enables the angular orientation of the electronic device 31 and the cover 21 to be determined. In some examples, both the cover 21 and the electronic device 31 may comprise a compass 45 which enables the directions the electronic device 31 and the cover 21 are facing in to be determined. The orientation of the cover 21 relative to the electronic device 31 may be estimated by comparing the compass 45 and/or accelerometer signals obtained by the electronic device 31 and the cover 21.
The example of
The location of the cover 21 and the electronic device 31 can be determined by comparing the distances D1 and D2. In the example of
If the difference between D1 and D2 is within a threshold this may indicate that the cover 21 is located in front of the electronic device 31. In some examples if the difference between D1 and D2 is within a threshold this may indicate that cover 21 is located within the field of view 49 of the camera 41.
In the above described example only two pairs of microphones 35, 23 are used to determine the relative location. This arrangement does not take into account that the cover 21 could be located above, below or behind the electronic device 31. It is to be appreciated that such location information could be obtained using further pairs of microphones 23, 35. In some examples, if sufficient pairs of microphones 23, 25 are available then the distances between the pairs of microphones 23, 35 could also be used to determine the orientation of the cover 21 relative to the electronic device 31 as well as the relative location. In such examples three microphones 23, 35 may be needed in both the cover 21 and the electronic device 31.
Once the position of the cover 21 relative to the electronic device 31 has been determined an audio signal is captured. At least some of the audio signal is captured by the cover 21. The audio signal captured by the cover 21 may then be transmitted to the electronic device 31 via the wireless connection. The electronic device 31 may the use the captured audio signal to create an enhanced audio signal. In the example of
In some examples once the position of the cover 21 relative to the electronic device 31 has been determined the electronic device 31 may send a control signal to the cover 21 to control the algorithms that are used by the apparatus 1 in the cover 21 to capture the audio signal. In some examples the electronic device 31 may control the audio signals that are obtained by both the microphones of the electronic device and the microphones of the cover to obtain a desired enhanced audio signal. For instance, in the example of
In the example of
In the example of
In such examples, once the relative position of the cover 21 has been determined the electronic device 31 may control the cover 21 to obtain a beamformed audio signal. In such examples beamformed audio signal obtained by the cover 21 may be added to the audio signals captured by the electronic device 31 to create an enhanced audio signal.
In some examples the system 30 may be arranged so that the types of algorithms to be applied to the captured audio signals are automatically selected from the relative position of the cover 21 and the electronic device 31. For instance, if the cover 21 is arranged in the configuration of
In the examples of the disclosure the apparatus 1 of the cover 21 may be arranged to perform at least some of the algorithms for creating the enhanced audio signal. For instance, in the example of
In examples of the disclosure, if is determined that the cover 21 is outside the field of view 49 of the camera 41 the cover 21 may be used to improve the spatial attributes of the enhanced audio signal. This may be achieved using a spaced microphone technique. In such examples no delay compensation is needed between the audio signals captured by the microphones 23 in the cover 21 and the microphones 35 in the electronic device 31 because the delays are used to create the spatial attributes of the enhanced audio signal.
If it is determined that the cover 21 is outside the field of view 49 of the camera 41 the cover 21 may be used to improve the quality of the audio signal captured from an object within the field of view 49 of the camera 41. In the above examples the object is the person 47 playing the guitar. It is to be appreciated that other objects may be used in other examples of the disclosure. In such examples the audio signals captured by the cover 21 may be used to beamform sound from the object and/or attenuate sound from other objects.
In such cases the audio signals captured by the cover 21 would be added to the audio signals captured by the electronic device 31. In these cases it may be beneficial to compensate for the time difference that it takes for sound from the object to arrive at the cover 21 and the electronic device 31. In the examples of
In the examples described above the apparatus 1 and the electronic device 31 are used to capture audio signals that could be stored in memory circuitry for playback at a later time and/or for sending to another device. In some examples the apparatus 1 and electronic device 31 could be used to obtain audio signals that are played in real time or as soon as they are received.
For instance, examples of the disclosure could be used to monitor a sound source in a different location to the electronic device. The cover 21 could be positioned close to the sound source or in a location where the sound from the sound source can be captured. The electronic device 31 can then be positioned in a different location. The different location could be close to the user and may be a location in which the sound from the sound source cannot be heard or cannot be heard clearly. This would enable any sounds made by the sound source to be captured by the cover 21 and transmitted to the electronic device 31 where it could be played back immediately. This would enable the user to monitor the sound source without having to be in the positioned close to the sound source.
As an example a user may be in a meeting but may have to leave the meeting room for a period of time. The user may still wish to monitor what is happening in the meeting and so may leave the cover 21 in the meeting room but keep the electronic device 31 with them. The cover 21 may then transmit the audio from the meeting room to the electronic device 31 to enable the user to continue to listen to the meeting via the electronic device 31.
Examples of the disclosure enable a user of an electronic device 31 to obtain enhanced audio signals. As further microphones 23 may be provided in a detachable cover 21 the user always has additional microphone 23 capabilities. As the cover 21 is detachable the user can position the cover 21 and the electronic device 31 into their chosen positions. This may enable the same cover 21 and electronic device 31 to be used to obtain different types of enhanced audio signals in different configurations.
As the electronic device 31 may comprise a camera 41 the camera 41 and the microphones 23 are not in fixed relative positions. This may enable a user to position the cover 21 so as to enable high quality audio signals to be obtained and position the electronic device 31 so as to enable high quality images to be obtained.
The term “comprise” is used in this document with an inclusive not an exclusive meaning. That is any reference to X comprising Y indicates that X may comprise only one Y or may comprise more than one Y. If it is intended to use “comprise” with an exclusive meaning then it will be made clear in the context by referring to “comprising only one . . . ” or by using “consisting”.
In this brief description, reference has been made to various examples. The description of features or functions in relation to an example indicates that those features or functions are present in that example. The use of the term “example” or “for example” or “may” in the text denotes, whether explicitly stated or not, that such features or functions are present in at least the described example, whether described as an example or not, and that they can be, but are not necessarily, present in some of or all other examples. Thus “example”, “for example” or “may” refers to a particular instance in a class of examples. A property of the instance can be a property of only that instance or a property of the class or a property of a sub-class of the class that includes some but not all of the instances in the class. It is therefore implicitly disclosed that a feature described with reference to one example but not with reference to another example, can where possible be used in that other example but does not necessarily have to be used in that other example.
Although embodiments of the present invention have been described in the preceding paragraphs with reference to various examples, it should be appreciated that modifications to the examples given can be made without departing from the scope of the invention as claimed.
Features described in the preceding description may be used in combinations other than the combinations explicitly described.
Although functions have been described with reference to certain features, those functions may be performable by other features whether described or not.
Although features have been described with reference to certain embodiments, those features may also be present in other embodiments whether described or not.
Whilst endeavoring in the foregoing specification to draw attention to those features of the invention believed to be of particular importance it should be understood that the Applicant claims protection in respect of any patentable feature or combination of features hereinbefore referred to and/or shown in the drawings whether or not particular emphasis has been placed thereon.
| Number | Date | Country | Kind |
|---|---|---|---|
| 1607455 | Apr 2016 | GB | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 7957765 | Causey | Jun 2011 | B1 |
| 8325270 | Woodman | Dec 2012 | B2 |
| 8825124 | Davies et al. | Sep 2014 | B1 |
| 8861739 | Ojanpera | Oct 2014 | B2 |
| 9271061 | Amores | Feb 2016 | B1 |
| 9398241 | Ito | Jul 2016 | B2 |
| 9966985 | DiLaura | May 2018 | B2 |
| 10222833 | Kim | Mar 2019 | B2 |
| 20010027121 | Boesen | Oct 2001 | A1 |
| 20070133826 | Burk | Jun 2007 | A1 |
| 20070248238 | Abreu | Oct 2007 | A1 |
| 20080304688 | Kumar | Dec 2008 | A1 |
| 20090017881 | Madrigal | Jan 2009 | A1 |
| 20090181731 | Seshadri | Jul 2009 | A1 |
| 20100054519 | Mulvey | Mar 2010 | A1 |
| 20110287726 | Huang | Nov 2011 | A1 |
| 20120330653 | Lissek et al. | Dec 2012 | A1 |
| 20130156219 | Proebstel | Jun 2013 | A1 |
| 20130315402 | Visser | Nov 2013 | A1 |
| 20140023197 | Xiang | Jan 2014 | A1 |
| 20140080553 | Torset | Mar 2014 | A1 |
| 20140361876 | Abdelsamie et al. | Dec 2014 | A1 |
| 20150078575 | Selig | Mar 2015 | A1 |
| 20150110275 | Tammi | Apr 2015 | A1 |
| 20150138064 | Li | May 2015 | A1 |
| 20150163393 | Kim | Jun 2015 | A1 |
| 20150189058 | Hwang | Jul 2015 | A1 |
| 20150296294 | Paquier et al. | Oct 2015 | A1 |
| 20160006920 | Gomes Da Motta | Jan 2016 | A1 |
| 20160007131 | Tammi et al. | Jan 2016 | A1 |
| 20160012794 | Takata | Jan 2016 | A1 |
| 20160165341 | Benattar | Jun 2016 | A1 |
| 20160330545 | McElveen | Nov 2016 | A1 |
| 20170023975 | Nalbandian | Jan 2017 | A1 |
| 20170026740 | Kirsch | Jan 2017 | A1 |
| 20170150255 | Wang | May 2017 | A1 |
| Number | Date | Country |
|---|---|---|
| 104705957 | Jun 2015 | CN |
| 1524189 | Apr 2005 | EP |
| 2006004632 | Jan 2006 | WO |
| 2011067292 | Jun 2011 | WO |
| 2015026859 | Feb 2015 | WO |
| Entry |
|---|
| “iPhone 6 / 6s Smart Battery Case—Charcoal Grey”, Apple, Retrieved on Apr. 19, 2017, Webpage available at : https://www.apple.com/uk/shop/product/MGQL2ZM/A/iphone-6-6s-smart-battery-case-charcoal-grey?fnode=42. |
| Pertila et al., “Passive Self-Localization of Microphones Using Ambient Sounds”, Proceedings of the 20th European Signal Processing Conference, Aug. 27-31, 2012, pp. 1314-1318. |
| “AMP—Your Phone Has Never Sounded Better”, Ampaudio, Retrieved on Feb. 25, 2016, Webpage available at : https://www.ampaudio.com/. |
| “Speaker Case”, ZAGG, Retrieved on Apr. 19, 2017, Webpage available at : http://www.zagg.com/us/en_us/cases/iphone-6-case/speaker-case. |
| Search Report received for corresponding United Kingdom Patent Application No. 1607455.1, dated Oct. 11, 2016, 4 pages. |
| Extended European Search Report received for corresponding European Patent Application No. 17163198.9, dated Aug. 10, 2017, 8 pages. |
| Office action received for corresponding European Patent Application No. 17163198.9, dated Jul. 3, 2018, 8 pages. |
| Office Action for European Application No. 17163198.9 dated Jul. 3, 2018. |
| Summons to Attend Oral Proceedings for European Application No. 17163198.9 dated Apr. 3, 2019, 11 pages. |
| Number | Date | Country | |
|---|---|---|---|
| 20170316803 A1 | Nov 2017 | US |
