Patent Grant
11081127
This application is the U.S. national phase of International Application No. PCT/KR2018/016469 filed Dec. 21, 2018 which designated the U.S. and claims priority to KR Patent Application No. 10-2018-0006718 filed Jan. 18, 2018, the entire contents of each of which are hereby incorporated by reference.
This disclosure relates to an electronic device and a control method therefor, and more particularly relates to an electronic device which outputs a test sound and a control method therefor.
Various types of electronic products have been developed and distributed along the development of electronic technologies and functions executed using electronic devices have become diverse.
In particular, various methods for obtaining information on a specific space using electronic devices have been actively researched. For example, various electronic devices which obtain information on a stage space for a play or a space for orchestra performance and provide more optimized sounds to an audience and methods therefor have been developed.
However, the cost of a measurement device which obtains information on the space was high and the measurement device was only suitable for a large space such as a stage rather than a small space such as a house.
Accordingly, there was a need for development of an electronic device which obtains information on a space even in a house and provides contents, services, and the like optimized according to characteristics of the space, a measurement device, and a method therefor.
The disclosure is made in view of the needs described above and an object of the disclosure is to provide an electronic device which obtains information on a space in which the electronic device is positioned and a control method therefor.
According to an embodiment of the disclosure for achieving the object described above, there is provided an electronic device including a communicator, a speaker, and a processor configured to, based on a predetermined signal being received from an external terminal device via the communicator, output a test sound via the speaker, based on sound data obtained by recording the test sound being received from the terminal device via the communicator, obtain reverberation time information for each frequency of the test sound and size information of a space in which the electronic device is positioned, based on the sound data, obtain a sound absorption coefficient of an object arranged in the space based on the reverberation time information for each frequency and the size information of the space, and identify information of the object based on the sound absorption coefficient, in which a size of the space is obtained based on an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value and an energy intensity for each frequency for a predetermined period of time from an output point of the test sound.
The test sound may be a sound having a plurality of different frequencies in a range of audio frequency.
The device may further include an output unit, and the processor may be configured to control the output unit to output an audio content, and based on a sound absorption coefficient corresponding to at least one frequency among sound absorption coefficients of an object positioned in the space being equal to or higher than a predetermined value, compensate an audio signal corresponding to the frequency in the audio content and output the audio signal.
The processor may be configured to obtain size information of the space based on a ratio of the energy intensity for each frequency for a predetermined period of time from the output point of the test sound, to the energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value.
The device may further include a storage storing information of a sound absorption coefficient for each object and space size information for each ratio, and the processor may be configured to obtain a sound absorption coefficient of an object arranged in the space and size information of the space based on the information stored in the storage.
The device may further include a storage storing size information of the space according to the reverberation time for each frequency and the ratio, and the processor may be configured to obtain the size information of the space based on the information stored in the storage.
The reverberation time may be a period of time taken for a decrease in sound pressure level of the test sound recorded at an output point of the test sound by 60 dB.
The device may be positioned in a first space including a first object, and the processor may be configured to, based on at least one of size information of a second space in which another electronic device is positioned and information of a second object included in the second space being received from the other electronic device, identify the electronic device as a communal electronic device or a personal electronic device based on the received information and information of a size of the first space and the first object.
The processor may be configured to, based on the electronic device being identified as the communal electronic device, limit an access to at least one of a setting menu of the electronic device, a content payment menu, and a content view history menu.
The speaker may include first and second speakers arranged to be spaced apart from each other, and the processor may be configured to output a first test sound via the first speaker, and output a second test sound via the second speaker after a predetermined period of time, and based on first and second sound data pieces corresponding to the first and second test sounds, respectively, being received from the terminal device, obtain reverberation time information for each frequency of the first and second test sounds and size information of a space in which the electronic device is positioned, based on the first and second sound data.
According to another embodiment of the disclosure, there is provided a method for controlling an electronic device, the method including, based on a predetermined signal being received from an external terminal device, outputting a test sound, based on sound data obtained by recording the test sound being received from the terminal device, obtaining reverberation time information for each frequency of the test sound and size information of a space in which the electronic device is positioned, based on the sound data, obtaining a sound absorption coefficient of an object arranged in the space based on the reverberation time information for each frequency and the size information of the space, and identifying information of the object based on the obtained sound absorption coefficient, in which a size of the space is obtained based on an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value and an energy intensity for each frequency for a predetermined period of time from an output point of the test sound.
The test sound may be a sound having a plurality of different frequencies in a range of audio frequency.
The method may further include outputting an audio content, and the outputting may include, based on a sound absorption coefficient corresponding to at least one frequency among sound absorption coefficients of an object positioned in the space being equal to or higher than a predetermined value, compensating an audio signal corresponding to the frequency in the audio content and outputting the audio signal.
The obtaining size information of a space may include obtaining size information of the space based on a ratio of the energy intensity for each frequency for a predetermined period of time from the output point of the test sound, to the energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value.
The electronic device may store information of a sound absorption coefficient for each object and space size information for each ratio, the obtaining size information of a space may include obtaining size information of the space based on the space size information for each ratio, and the obtaining a sound absorption coefficient may include obtaining a sound absorption coefficient of an object arranged in the space based on the information of a sound absorption coefficient for each object.
The electronic device may store size information of the space according to the reverberation time for each frequency and the ratio, and the obtaining size information of a space may include obtaining the size information of the space based on the information.
The reverberation time may be a period of time taken for a decrease in sound pressure level of the test sound recorded at an output point of the test sound by 60 dB.
The electronic device may be positioned in a first space including a first object, and the method may further include receiving at least one of size information of a second space in which another electronic device is positioned and information of a second object included in the second space from the other electronic device, and identifying the electronic device as a communal electronic device or a personal electronic device based on the received information and information of a size of the first space and the first object.
The method may further include, based on the electronic device being identified as the communal electronic device, limiting an access to at least one of a setting menu of the electronic device, a content payment menu, and a content view history menu.
According to still another embodiment of the disclosure, there is provided a non-transitory computer-readable recording medium storing computer instructions to enable an electronic device to execute operations, when computer instructions are executed by a processor of the electronic device, in which the operations include, based on a predetermined signal being received from an external terminal device, outputting a test sound, based on sound data obtained by recording the test sound being received from the terminal device, obtaining reverberation time information for each frequency of the test sound and size information of a space in which the electronic device is positioned, based on the sound data, obtaining a sound absorption coefficient of an object arranged in the space based on the reverberation time information for each frequency and the size information of the space, and identifying information of the object based on the obtained sound absorption coefficient, and a size of the space is obtained based on an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value and an energy intensity for each frequency for a predetermined period of time from an output point of the test sound.
According to the embodiments of the disclosure, the electronic device is advantageous in terms of obtaining information on a space in which the electronic device is positioned, by outputting a test sound.
The disclosure will be described in detail after briefly explaining the terms used in the specification.
The terms used in embodiments of the disclosure have been selected as widely used general terms as possible in consideration of functions in the disclosure, but these may vary in accordance with the intention of those skilled in the art, the precedent, the emergence of new technologies and the like. In addition, in a certain case, there is also a term arbitrarily selected by the applicant, in which case the meaning will be described in detail in the description of the disclosure. Therefore, the terms used in the disclosure should be defined based on the meanings of the terms themselves and the contents throughout the disclosure, rather than the simple names of the terms.
The embodiments of the disclosure may be variously changed and include various embodiments, and specific embodiments will be shown in the drawings and described in detail in the description. However, it should be understood that this is not to limit the scope of the specific embodiments and all modifications, equivalents, and/or alternatives included in the disclosed spirit and technical scope are included. In describing the disclosure, a detailed description of the related art is omitted when it is determined that the detailed description may unnecessarily obscure a gist of the disclosure.
The terms “first,” “second,” or the like may be used for describing various elements but the elements may not be limited by the terms. The terms are used only to distinguish one element from another.
Unless otherwise defined specifically, a singular expression may encompass a plural expression. It is to be understood that the terms such as “comprise” or “consist of” are used herein to designate a presence of characteristic, number, step, operation, element, part, or a combination thereof, and not to preclude a presence or a possibility of adding one or more of other characteristics, numbers, steps, operations, elements, parts or a combination thereof.
A term such as “module” or a “unit” in the disclosure may perform at least one function or operation, and may be implemented as hardware, software, or a combination of hardware and software. Further, except for when each of a plurality of “modules”, “units”, and the like needs to be realized in an individual hardware, the components may be integrated in at least one module and be implemented in at least one processor (not shown).
Hereinafter, with reference to the accompanying drawings, embodiments of the disclosure will be described in detail so that those skilled in the art can easily make and use the embodiments in the technical field to which the disclosure belongs. But, the disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, in the drawings, the parts not relating to the description are omitted for clearly describing the disclosure, and the same reference numerals are used for the same parts throughout the specification.
Referring to
The electronic device 100 according to an embodiment of the disclosure may be implemented as devices in various forms such as a user terminal device, a display device, a set-top box, a tablet personal computer (PC), a smartphone, an e-book reader, a desktop PC, a laptop PC, a workstation, a server, a personal digital assistant (PDA), a portable multimedia player (PMP), an MP3 player, and the like. But, this is merely an embodiment, and the electronic device 100 may be implemented as various types of devices capable of outputting a sound.
According to an embodiment, the electronic device 100 may execute communication with the terminal device 200. In particular, the electronic device 100 may receive signals, data, and the like transmitted by the terminal device 200 according to various types of communication systems such as IR, RF, and the like. For example, the terminal device 200 may be implemented as a remote controlling device for controlling the electronic device 100 and the electronic device 100 may receive a control signal transmitted by the terminal device 200. The electronic device 100 may transmit and receive data to and from the terminal device 200.
The electronic device 100 may output a test sound, when a predetermined signal is received from the external terminal device 200. The test sound may mean a predetermined sound source for identifying characteristics of a space in which the electronic device 100 is positioned. For example, the test sound may be a sound having an audio frequency at 16 hZ to 20 kHz. However, there is no limitation thereto, and the electronic device 100 may output a plurality of test sounds different from each other. For example, the electronic device 100 may sequentially output a first test sound in a low frequency band (e.g., 20 Hz to 160 Hz), a second test sound in a medium frequency band (e.g., 160 Hz to 1,280 Hz), and a third test sound in the high frequency band (1,280 Hz to 20 kHz).
According to an embodiment, the predetermined signal transmitted by the external terminal device 200 to the electronic device 100 may be a signal requesting for output of the test sound. However, this is merely an embodiment, and the electronic device 100 may output the test sound in various situations, for example, every time of a predetermined operation of the electronic device 100 or at an initial setting stage.
The terminal device 200 according to an embodiment of the disclosure may obtain sound data by recording the test sound output by the electronic device 100. Particularly, the terminal device 200 may transmit the sound data to the electronic device 100. The electronic device 100 may identify characteristics of a space in which the electronic device 100 is positioned by analyzing the received sound data. The characteristics of the space may mean objects arranged in the space, size information of the space, and the like. For example, the electronic device 100 may identify whether or not the furniture, carpet, and the like are arranged in the space in which the electronic device 100 is positioned, the size of the space, and the like.
Hereinabove, the operations of the electronic device 100 and the terminal device 200 included in the electronic system 1000 have been briefly described. Hereinafter, the operations of the electronic device 100 will be described in detail.
Referring to
The communicator 110 is a component for executing communication with the external terminal device 200. In particular, the communicator 110 may receive signals, data, and the like transmitted from the external terminal device 200. The signals may mean various types of control signals for controlling the electronic device 100. For example, the electronic device 100 may receive a predetermined signal for requesting output of the test sound from the external terminal device 200 via the communicator 110. The control signals may be signals in various forms such as an infrared ray (IR) or a radio frequency (RF).
The communicator 110 according to an embodiment may receive the sound data obtained by recording the test sound from the external terminal device 200. The sound data may be data generated by recording the sound data output by the electronic device 100 through a microphone or the like included in the terminal device 200.
The speaker 120 is a component for outputting various sounds. Particularly, the speaker 120 may output the test sound. The speaker 120 according to an embodiment of the disclosure may include first and second speakers arranged to be spaced apart from each other.
The processor 130 controls general operations of the electronic device 100. The processor 130 may include one or more of a digital signal processor (DSP), a central processing unit (CPU), a controller, an application processor (AP), or a communication processor (CP), and an ARM processor or may be defined as the corresponding term. In addition, the processor 130 may be implemented as System on Chip (SoC) or large scale integration (LSI) including the processing algorithm or may be implemented in form of a Field Programmable gate array (FPGA).
In particular, when the sound data obtained by recording the test sound is received from the terminal device 200, the processor 130 may obtain reverberation time information for each frequency of the test sound and size information of the space in which the electronic device 100 is positioned, based on the sound data.
The test sound may be a sound having a plurality of frequencies. For example, the test sound may have a plurality of different frequencies in a range of the audio frequency (e.g., 16 Hz to 20 kHz). The test sound may be implemented as one sound source. However, this is merely an embodiment, and the test sound may be implemented as a plurality of sound sources such as a first test sound having a plurality of frequencies in a first range and a second test sound having a plurality of frequencies in a second range.
The reverberation time information for each frequency of the test sound according to an embodiment may mean information on the reverberation time for each of the plurality of frequencies of the test sound. The test sound output via the speaker of the electronic device 100 may be recorded by the terminal device 200. Some of the output test sounds may be directly transmitted to the terminal device 200 and the others thereof may be reflected by an object such as a wall and then transmitted thereto. Accordingly, the sound reflected may be recorded by the terminal device 200 with a time difference from the directly transmitted sound. Hereinafter, the directly transmitted sound and the sound reflected are collectively referred to as a direct sound and reflected sound (reflection-tone), respectively.
It is possible to assume a sense of space of the sound according to the time difference between the direct sound and the reflected sound and such a time difference is called reverb. In general, the reverberation means that the time difference between the direct sound and the reflected sound is short, and this is called an echo or a delay, if the time difference relatively increases further.
The reverberation time means a period of time during which a sound pressure of the test sound recorded at an output point of the test sound is reduced by 1/1,000,000 or a period of time taken for a decrease in sound pressure level by 60 dB. The reverberation time according to an embodiment of the disclosure may be a period of time during which a sound pressure of the recorded test sound is reduced by 1/1,000,000 of a sound pressure of the direct sound, or a period of time taken for a decrease in sound pressure level of the direct sound by 60 dB. However, this is merely an embodiment, and the reverberation time may be measured based on various references such as a period of time taken for a decrease in sound pressure level by 20 dB or 30 dB. Hereinafter, for convenience of description, a period of time taken for a decrease in sound pressure level by 60 dB (RT60) is assumed as the reverberation time.
The processor 130 according to an embodiment of the disclosure may obtain the reverberation time information for each frequency of the test sound and the size information of the space in which the electronic device 100 is positioned by analyzing the received sound data. The size information of the space may mean a volume.
For example, the processor 130 may obtain the size information of the space based on an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value and an energy intensity for each frequency for a predetermined period of time from an output point of the test sound. The volume of the test sound may mean the sound pressure or the sound pressure level.
The processor 130 according to an embodiment of the disclosure may obtain a total energy intensity for each frequency as the energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value. For example, it may be assumed that the predetermined threshold value is 0 and the predetermined period of time is 50 milliseconds (msec). The predetermined threshold value which is 0 may mean that a direct sound and a reflected sound generated from the output test sound are all dissipated. In such a case, the processor 130 may obtain a total energy intensity of the direct sound and the reflected sound generated from the test sound and an energy intensity for 50 msec from the output point of the test sound. The processor 130 may obtain the size information of the space based on the following Mathematical Formula 1.
Herein, E50 represents an energy intensity of the test sound in the sound data recorded for 50 msec from the output point and E∞ represents a total energy intensity of the test sound recorded in the sound data.
As the size of the space increases, the reflected sound and the reverberation may increase. Accordingly, the value of E∞ may increase and the size information D of the space may be reduced. The processor 130 may obtain information regarding a volume of the space in which the electronic device 100 is positioned, based on the size information D of the space.
However, this is merely an embodiment, and the processor 130 may also obtain the size information of the space based on a ratio of the energy intensity for each frequency for the predetermined period of time from the output point of the test sound, to an energy intensity for each frequency after the predetermined period of time. For example, the predetermined period of time may be assumed as 50 msec. In such a case, the processor 130 may obtain the size information of the space based on a ratio of sound energy recorded in the sound data for 50 msec from the output point of the test sound to sound energy recorded after 50 msec. The processor 130 may obtain the size information of the space based on the following Mathematical Formula 2.
Herein, E50 represents an energy intensity of the test sound recorded in the sound data for 50 msec from the output point and E∞ represents a total energy intensity of the test sound recorded in the sound data.
The size information of the space may be obtained as a value of D according to the Mathematical Formula 1 and a value of C50 according to the Mathematical Formula 2. The value of D and the value of C50 satisfies the following relationship according to the following Mathematical Formula 3.
The processor 130 according to an embodiment of the disclosure may obtain the reverberation time information for each frequency of the test sound and the size information of the space by analyzing the sound data. The processor 130 may obtain a sound absorption coefficient of an object arranged in the space based on the reverberation time information for each frequency and the size information of the space obtained.
For example, the reflected sound of the output test sound excluding the direct sound means a sound that is partially absorbed by an object such as a wall, a carpet, or the like arranged in the space and partially not absorbed but reflected by the object and has reached the terminal device 200. The sound absorption coefficient means a ratio of a reflection energy to an incidence energy when the reflected sound is reflected by the object.
The sound absorption coefficient may vary depending on the object and frequency. For example, the reflected sounds having the same frequency may have different sound absorption coefficients according to the objects by which the sounds are reflected. In another example, the reflected sounds reflected by the same object may have different sound absorption coefficients according to the frequencies of the reflected sounds. A sound with a high frequency has a comparatively higher sound absorption coefficient than a sound with a low frequency. This will be described in detail with reference to
The processor 130 according to an embodiment of the disclosure may obtain a sound absorption coefficient of an object based on the following Mathematical Formula 4.
Herein, T represents the reverberation time, V represents the volume of the space, and A represents an average sound absorption coefficient of the space. The processor 130 according to an embodiment of the disclosure may identify T based on the reverberation time information for each frequency and identify V based on the size information D of the space to identify a sound absorption coefficient A of an object arranged in the space.
The processor 130 according to an embodiment of the disclosure may identify the information of the object based on the sound absorption coefficient. The electronic device 100 may store information regarding the sound absorption coefficient of the object for each frequency in advance. The processor 130 may identify an object having a sound absorption coefficient similar to the obtained sound absorption coefficient based on the stored information.
The processor 130 according to an embodiment of the disclosure may output a first test sound and a second test sound respectively via first and second speakers arranged to be spaced apart from each other. For example, the first test sound may be output via the first speaker and the second test sound may be output via the second speaker after a predetermined period of time. The first test sound and the second test sound may be test sounds having a plurality of frequencies in the same frequency range. However, there is no limitation thereto, and the first test sound and the second test sound may be output at the same time.
When first and second sound data respectively corresponding to the first and second test sounds are received from the terminal device 200, the processor 130 may obtain the reverberation time information for each frequency of the first and second test sounds and the size information of the space in which the electronic device 100 is positioned based on the first and second sound data. For example, if the first speaker and the second speaker are right and left speakers, respectively, the processor 130 may also obtain the reverberation time information and the size information of the space for each of the left and right speakers.
Referring to
The communicator 110 according to an embodiment of the disclosure may communicate with the terminal device 200 through various communication systems using Radio Frequency (RF) and Infrared (IR) such as Local Area Network (LAN), cable, wireless LAN, cellular, Device to Device (D2D), Bluetooth, Bluetooth Low Energy (BLE), 3G, LTE, Wi-Fi, ad-hoc Wi-Fi Direct and LTE Direct, Zigbee, and Near Field Communication (NFC). For this, the communicator 110 may include an RF communication module such as a Zigbee communication module, a Bluetooth communication module 111, a BLE communication module, and a Wi-Fi communication module 112, and an IR communication module 113.
The processor 130 may include a CPU, a ROM (or a non-volatile memory) storing a control program for controlling the electronic device 100, and a RAM (or volatile memory) storing data input from the outside of the electronic device 100 or used as a storage area corresponding to various operations executed by the electronic device 100.
The CPU may execute the booting by using the 0/S stored in the memory 150 by accessing the memory 150. The CPU may execute various operations by using various programs, contents, data, and the like stored in the storage 150.
The output unit 140 may be implemented as at least one of a speaker unit and a display which are able to output audio and video contents. For example, the output unit 140 may be implemented as at least one speaker unit and may output an audio content. The output unit 140 may include a plurality of speakers for multi-channel reproduction. For example, the output unit 140 may include a plurality of speakers for each channel outputting mixed sounds. In some cases, a speaker for at least one channel may be implemented as a speaker array including a plurality of speaker units for reproducing sounds in frequency ranges different from each other.
In particular, if a sound absorption coefficient corresponding to at least one frequency among sound absorption coefficients of the object positioned in the space is equal to or higher than a predetermined value, the processor 130 may compensate the audio signal in the audio content and output the audio signal via the output unit 140. For example, if the sound absorption coefficient at 2,000 Hz is equal to or higher than 0.5, the processor 130 may amplify an audio signal corresponding to 2,000 Hz in the audio content and output the audio signal via the output unit 140. In another example, if the sound absorption coefficient at 200 Hz is equal to or lower than 0.5, the processor 130 may output an audio signal corresponding to 200 Hz in the audio content as it is. The value of 0.5 is merely an embodiment, and the predetermined value may be variously set according to setting of a user, setting in the content, or the purpose of the manufacturer.
According to an embodiment, the output unit 140 may be implemented as a display for outputting a video content. The display may be implemented as various types of displays such as a liquid crystal display (LCD), organic light emitting display (OLED), Liquid crystal on silicon (LCoS), or digital light processing (DLP). However, there is no limitation thereto and the display may be implemented as various types of display capable of displaying a screen. The output unit 140 may display a UI for guiding a position of the terminal device 200. For example, the electronic device 100 may display a UI for guiding a suitable position of the terminal device 200 to record the test sound output by the electronic device 100.
The storage 150 may store various data, programs, or applications for operating/controlling the electronic device 100. Particularly, the storage 150 may store the test sound according to an embodiment of the disclosure.
The storage 150 may be implemented as an internal memory such as a ROM, a RAM, and the like included in the processor 130 or may be implemented as a memory separated from the processor 130. In such a case, the storage 150 may be implemented in a form of a memory embedded in the electronic device 100 or may be implemented in a form of a memory detachable from the electronic device 100 according to data storage purpose. For example, data for operating the electronic device 100 may be stored in a memory embedded in the electronic device 100, and data for an extended function of the electronic device 100 may be stored in a memory detachable from the electronic device 100. The memory embedded in the electronic device 100 may be implemented in a form of a non-volatile memory, a volatile memory, a hard disk drive (HDD), or a solid state drive (SSD), and the memory detachable from the electronic device 100 may be implemented in a form of a memory card (e.g., a micro SD card, a USB memory, or the like), or an external memory connectable to a USB port (e.g., USB memory).
The storage 150 according to an embodiment of the disclosure may store the information of the sound absorption coefficient for each frequency of each of the plurality of objects, and the size information of the space according to a ratio of the energy intensity for each frequency for a predetermined period of time from the output point of the test sound, to an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value. For example, information regarding the size of the space corresponding to the ratio obtained based on any one of the Mathematical Formulae 1 to 3 may be stored in the storage 150.
In another example, the storage 150 may store the size information of the space according to the reverberation time for each frequency and the ratio. The ratio herein may be the value of D or C50 obtained based on the Mathematical Formula 1 or 2, and the information stored in the storage 150 may be information indicating a relationship between the reverberation time for each frequency and the ratio, and the size of the space. This will be described in detail with reference to
Referring to
The terminal device 200 may be implemented as various types of devices capable of outputting a signal for controlling the electronic device 100. For example, the terminal device 200 may be implemented as a remote control device outputting a control signal with respect to the electronic device 100.
The communicator 210 is a component for outputting a control signal and transmitting and receiving data to and from the electronic device 100. The communicator 210 according to an embodiment of the disclosure may execute communication with the electronic device 100 through various communication systems using Radio Frequency (RF) and Infrared (IR) such as Local Area Network (LAN), cable, wireless LAN, cellular, Device to Device (D2D), Bluetooth, Bluetooth Low Energy (BLE), 3G, LTE, Wi-Fi, ad-hoc Wi-Fi Direct and LTE Direct, Zigbee, and Near Field Communication (NFC). For this, the communicator 210 may include an RF communication module such as a Zigbee communication module, a Bluetooth communication module, a BLE communication module, and a Wi-Fi communication module, and an IR communication module.
Particularly, the communicator 210 may transmit a predetermined signal to the electronic device 100. The predetermined signal may be a signal controlling the electronic device 100 so that the electronic device 100 outputs the test sound.
The microphone 220 may record a signal or a sound. In particular, the microphone 220 may record the test sound output by the electronic device 100 and transmit the test sound to the processor 230. As will be described later, the processor 230 may generate sound data obtained by recording the test sound.
The processor 230 controls general operations of the electronic device 100. The processor 230 may include one or more of a signal digital signal processor (DSP), a central processing unit (CPU), a controller, an application processor (AP), or a communication processor (CP), and an ARM processor or may be defined as the corresponding term. In addition, the processor 230 may be implemented as System on Chip (SoC) or large scale integration (LSI) including the processing algorithm or may be implemented in form of a Field Programmable gate array (FPGA).
In particular, the processor 230 may transmit the predetermined signal to the electronic device 100 via the communicator 210 according to an input of a user. When the test sound output by the electronic device 100 is recorded by the microphone 220, the sound data may be generated.
The processor 230 according to an embodiment of the disclosure may transmit the sound data to the electronic device 100 via the communicator 210. In another example, the processor 230 may perform the same operation as those of the processor 130 of the electronic device 100. For example, the processor 230 of the terminal device 200 may obtain the reverberation time information for each frequency and the size information of the space by analyzing the sound data.
The processor 230 may obtain a sound absorption coefficient of an object arranged in the space based on the reverberation time information for each frequency and the size information of the space obtained. Accordingly, the sound absorption coefficient of the object arranged in the space in which the electronic device 100 is positioned may be obtained by the processor 130 of the electronic device 100 or the processor 230 of the terminal device 200.
Referring to
When the predetermined signal is received, the electronic device 100 may output the test sound (S530).
Then, the electronic device 200 may record the test sound and obtain sound data (S540). The terminal device 200 may transmit the sound data to the electronic device 100 (S550).
Next, the electronic device 100 may obtain reverberation time information for each frequency of the test sound and size information of a space in which the electronic device is positioned, based on the received sound data (S560).
Hereinafter, a method for obtaining the reverberation time information for each frequency and the size information of the space will be described with a graph.
Referring to
The sound pressure level at the second frequency 620 reaches a maximum level at approximately 0.2 sec and then gradually decreases. Referring to
The electronic device 100 may obtain the size information of the space in which the electronic device 100 is positioned based on the sound data. For example, the electronic device 100 may obtain the size information of the space based on a ratio of sound energy of the sound data for first 50 msec to sound energy after 50 msec. In such a case, the electronic device 100 may obtain the ratio based on the Mathematical Formula 2.
In another example, the electronic device 100 may obtain the size information of the space based on a ratio of sound energy of the sound data for first 50 msec to total sound energy of the sound data. In such a case, the electronic device 100 may obtain the ratio based on the Mathematic Formula 1.
In the Mathematic Formula 1, E50 may be obtained based on the following Mathematic Formula 5.
E50=∫00.05p2dt [Mathematical Formula 5]
E∞ may be obtained based on the following Mathematic Formula 6.
E∞=∫0∞p2dt [Mathematical Formula 6]
Herein, P2 represents energy of sound (sound energy).
The electronic device 100 according to an embodiment of the disclosure may obtain information regarding a size of a space in which the electronic device 100 is positioned by using the above Mathematic Formulae based on the sound data. For example, D50 represents energy of a direct sound of the output test sound, that is, a sound reached the terminal device 200 without reflection. E∞ represents energy of the direct sound and the reflected sound according to the output test sound. As the size of the space in which the electronic device 100 is arranged increases, the energy of the reflected sound and the reverberation sound may proportionally increase, compared to the direct sound. E∞ have a relatively larger value in a wider space, rather than a small space. The electronic device 100 may obtain information regarding the size of the space in which the electronic device 100 is arranged, based on the ratio of E50 and E∞.
Referring to
The electronic device 100 according to an embodiment of the disclosure may obtain the sound absorption coefficient of the object based on the reverberation time for each frequency and the size information of the space obtained through the graph of
Herein, T represents the reverberation time, V represents the volume of the space, and A represents the average sound absorption coefficient of the space.
The electronic device 100 may identify an object corresponding to the average sound absorption coefficient A of the space based on the information stored in advance. For example, if a sound absorption coefficient of 0.01 at a frequency of 125 Hz is identified and a sound absorption coefficient of 0.3 at a frequency of 2,000 Hz is identified, the electronic device 100 may identify that a carpet is arranged in the space.
The sound absorption coefficient of the object for each frequency shown in
Referring to
The information stored in the electronic device 100 may be information indicating a relationship between the reverberation time for each frequency and the ratio, and the size of the space. For example, the electronic device 100 may identify the size of the space corresponding to the values of RT60 and C50 based on the information. For example, if RT60 is 10 and C50 is 0.25, the electronic device 100 may determine that the volume of the space is in a range of 40 to 100 m3 according to the graph shown in
The graph shown in
As shown in
For example, it may be assumed that a first electronic device 100-1 is positioned in a first space including a first object and a second electronic device 100-2 is positioned in a second space including a second object. When at least one of size information of the second space in which the other electronic device is positioned and information of the second object included in the second space is received from the other electronic device (e.g., second electronic device 100-2), the electronic device 100 may identify the first electronic device 100-1 as a communal electronic device or a personal electronic device based on the received information and the information of the size of the first space and the first object.
For example, the first electronic device 100-1 may be positioned in a living room where sofa and the like are arranged, and the second electronic device 100-2 may be positioned in a private space such as a bedroom. The first electronic device 100-1 may identify that the sofa is located in the space where the first electronic device 100-1 is positioned and the size information of the space, based on the reverberation time for each frequency and the size information of the space.
According to an embodiment, when at least one of information of a size of a bedroom where the second electronic device 100-2 is positioned and information indicating whether or not a bed is arranged is transmitted to the first electronic device 100-1 from the second electronic device 100-2, the first electronic device 100-1 may identify the first electronic device 100-1 as a communal electronic device or a personal electronic device based on the received information, the information of the size of the living room, and the information indicating whether or not the sofa is arranged in the living room. The size of the living room is comparatively larger than that of the bedroom when comparing the size of the living room with the size of the bedroom, the first electronic device 100-1 may determine that the first electronic device 100-1 is positioned in the living room. In addition, the first electronic device 100-1 may identify itself as a communal electronic device.
In another example, the reverse case may also be satisfied. When at least one of information of a size of a living room where the first electronic device 100-1 is positioned and information indicating whether or not sofa is arranged is transmitted to the second electronic device 100-2 from the first electronic device 100-1, the second electronic device 100-2 may identify the second electronic device 100-2 as a personal electronic device based on the received information, the information of the size of the bedroom, and the information indicating whether or not the bed is arranged in the bedroom.
According to an embodiment of the disclosure, if the electronic device 100 is identified as a communal electronic device, an access to at least one of a setting menu of the electronic device 100, a content payment menu, and a content view history menu by a user may be limited. For example, the communal electronic device means an electronic device used by a plurality of users, and accordingly, an access to the device setting menu and the content payment menu may be limited. Since the electronic device 100 positioned in the living room may be accessed by kids among family members, it is necessary to limit an access to the content payment menu so that the content payment or the like is not easily performed.
In another example, the reverse case may also be satisfied. For example, if the electronic device 100 is identified as a personal electronic device, an access to at least one of a setting menu of the electronic device 100, a content payment menu, and a content view history menu by a user may be limited. An input of a personal PIN number may be requested, and the access to the setting menu, the content payment menu, and the content view history menu may be permitted only when the PIN number is input.
According to the method for controlling the electronic device shown in
Then, when sound data obtained by recording the test sound is received from the terminal device, reverberation time information for each frequency of the test sound and size information of a space in which the electronic device is positioned are obtained based on the sound data (S1020). Herein, the size of the space is obtained based on an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value and an energy intensity for each frequency for a predetermined period of time from an output point of the test sound.
Then, a sound absorption coefficient of an object arranged in the space is obtained based on the reverberation time information for each frequency and the size information of the space (S1030).
Next, information of the object is identified based on the obtained sound absorption coefficient (S1040).
The test sound herein may have a plurality of different frequencies in a range of the audio frequency.
The control method according to an embodiment of the disclosure may include outputting an audio content, and when a sound absorption coefficient corresponding to at least one frequency among sound absorption coefficients of the object positioned in the space is equal to or higher than a predetermined value, an audio signal corresponding to the frequency may be compensated in the audio content and output.
In addition, in Step S1020 of obtaining the size information of the space, the size information of the space may be obtained based on a ratio of the energy intensity for each frequency for a predetermined period of time from the output point of the test sound, to an energy intensity for each frequency until a volume of the test sound reaches a predetermined threshold value.
The electronic device may store the information of the sound absorption coefficient for each object and space size information for each ratio, and the size information of the space may be obtained based on the space size information for each ratio in Step S1020 of obtaining the size information of the space, and a sound absorption coefficient of an object arranged in the space may be obtained based on the information of the sound absorption coefficient for each object in Step S1030 of obtaining the sound absorption coefficient.
In another example, the electronic device may store the size information of the space according to the reverberation time for each frequency and the ratio, and the size information of the space may be obtained based on the information in Step S1020 of obtaining the size information of the space.
In addition, the reverberation time may be a period of time taken for a decrease in sound pressure level of the test sound recorded at an output point of the test sound by 60 dB.
In addition, the electronic device may be positioned in a first space including a first object, and the control method according to an embodiment of the disclosure may include receiving at least one of size information of a second space in which the other electronic device is positioned and information of a second object included in the second space from the other electronic device, and identifying the electronic device as a communal electronic device or a personal electronic device based on the received information and information of a size of the first space and the first object.
The control method may include, based on the electronic device being identified as a communal electronic device, limiting an access to at least one of a setting menu of the electronic device, a content determination menu, a content view history menu.
The embodiments described above may be implemented in a recording medium readable by a computer or a similar device using software, hardware, or a combination thereof. In some cases, the embodiments described in this specification may be implemented as a processor itself. According to the implementation in terms of software, the embodiments such as procedures and functions described in this specification may be implemented as software modules. Each of the software modules may execute one or more functions and operations described in this specification.
Computer instructions for executing processing operations according to the embodiments of the disclosure descried above may be stored in a non-transitory computer-readable medium. When the computer instructions stored in such a non-transitory computer-readable medium are executed by the processor, the computer instructions may enable a specific machine to execute the processing operations according to the embodiments described above.
The non-transitory computer-readable medium is not a medium storing data for a short period of time such as a register, a cache, or a memory, but means a medium that semi-permanently stores data and is readable by a machine. Specific examples of the non-transitory computer-readable medium may include a CD, a DVD, a hard disk, a Blu-ray disc, a USB, a memory card, and a ROM.
Hereinabove, the preferred embodiments of the disclosure have been shown and described, but the disclosure is not limited to specific embodiments described above, various modifications may be made by those skilled in the art without departing from the gist of the disclosure claimed in the claims, and such modifications may not be individually understood from the technical sprit or the prospect of the disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 10-2018-0006718 | Jan 2018 | KR | national |
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/KR2018/016469 | 12/21/2018 | WO | 00 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2019/143036 | 7/25/2019 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 9763008 | Johnson et al. | Sep 2017 | B2 |
| 20020067835 | Vatter | Jun 2002 | A1 |
| 20090129604 | Enamito et al. | May 2009 | A1 |
| 20100104114 | Chapman | Apr 2010 | A1 |
| 20100296658 | Ohashi | Nov 2010 | A1 |
| 20130321566 | Simonnet | Dec 2013 | A1 |
| 20150067787 | Stanasolovich et al. | Mar 2015 | A1 |
| 20150078596 | Sprogis | Mar 2015 | A1 |
| 20160061597 | De Bruijn | Mar 2016 | A1 |
| 20170223478 | Jot et al. | Aug 2017 | A1 |
| 20190394602 | Moore | Dec 2019 | A1 |
| Number | Date | Country |
|---|---|---|
| 2 895 542 | May 2008 | FR |
| 2011-158794 | Aug 2011 | JP |
| 5403896 | Jan 2014 | JP |
| 10-2015-0107699 | Sep 2015 | KR |
| 10-1721406 | Mar 2017 | KR |
| 10-1787224 | Oct 2017 | KR |
| 2014091027 | Jun 2014 | WO |
| Entry |
|---|
| International Search Report for PCT/KR2018/016469 dated Apr. 4, 2019, 5 pages with English Translation. |
| Written Opinion of the ISA for PCT/KR2018/016469 dated Apr. 4, 2019, 9 pages with English Translation. |
| Number | Date | Country | |
|---|---|---|---|
| 20200381007 A1 | Dec 2020 | US |
