Systems and methods of signal analysis and data transfer using spectrogram construction and inversion

Abstract

A method of generating an analytical signal for signal analysis. The method includes obtaining a digital signal, sectioning the digital signal into a series of overlapping windows in time domain, generating a plurality of energy pulses by evaluating a function that describes energy information within each window or set of windows, and generating a time-dependent analytical signal by generating an oscillating signal by multiplying each of the plurality of energy pulses by an oscillating function; and integrating the oscillating function across a band pass frequency filter.

Description

TECHNICAL FIELD

The present invention relates generally to the field of signal processing; and more particularly, to systems and methods of generating a time-dependent analytical signal from an input signal using spectrogram inversion.

BACKGROUND

Some current approaches conduct signal analysis by applying a Fourier transform on a signal that is solely a function of time and obtaining a “spectrum” of the resulting information that is solely a function of frequency. The method is perfectly reversable via the forward and inverse Fourier transforms. Furthermore, some current approaches to signal analysis proceed by windowing the signal into sections, apply the Fourier transform to each temporal section, and then reconstruct the information as a time-frequency representation or “spectrogram”. However, these approaches result in spectrograms that are either discontinuous, irreversible, or both. Although providing some insight into the nature of the signal, the result of this process is a vague representation of the information contained within the signal that may provide a means of communication but cannot generally be used to sufficiently reconstruct the original signal. Thus, providing signal analysis with some built-in limitations.

In an example, data transfer techniques using signal generation, transmission, and processing may apply frequency filtering to isolate and interpret information contained within a signal. This is generally applicable to wireless transmission through cell towers, WIFI, and other radio-based communications. Digital signal transmission of bits using wireless technology generally relies upon the above signal analysis techniques. These techniques generally result in a theoretical upper limit to bitrates for digital transmission

In the example of speech recognition, systems generally attempt to identify patterns of phonetic sounds or words as represented by a digitally sampled sound signal. Generally, such approaches can be trained to identify the characteristics of a narrow group of individuals who have provided samples of speech with known meaning, but such approaches may be deficient in attempting to accommodate a wide group of individuals with varying dialects or accents. Moreover, the accuracy of operating on signal data is highly susceptible to background noise. Additionally, some current approaches to synthesize speech take pre-recorded phonetic sounds and words in their digital sound signal form and then concatenate them together to form larger words and sentences. However, when played back as audio, digital sound signals modified in this way may not sound natural, or even audibly human, due to missing characteristics of speech.

SUMMARY

In one aspect, a method of generating an analytical signal for signal analysis is provided, the method executable on one or more computer processors, the method comprising: obtaining a digital signal; sectioning the digital signal into a series of overlapping windows in time domain; generating a plurality of energy pulses by evaluating a function that describes energy information within each window or set of windows; and generating a time-dependent analytical signal by: generating an oscillating signal by multiplying each of the plurality of energy pulses by an oscillating function; and integrating the oscillating function across a band pass frequency filter.

In a particular case of the method, the analytical signal is defined by a set of parameters including time units, frequency units, origin and range of energy pulse information to be included.

In another case of the method, the band pass frequency filter has a frequency range corresponding to the energy pulse information to be included.

In yet another case of the method, the time-dependent analytical signal is invertible to approximate the digital signal.

In yet another case of the method, the digital signal is generated by discretely sampling an input signal, the input signal being either an analog signal or the analytical signal, wherein the amplitude of each sample is the average energy information of the input signal over a predefined observation time interval.

In yet another case of the method, the function has as its peak a median position and monotonically tends to zero at a finite time and frequency interval from the median position.

In yet another case of the method, the function is one of: a parametric probability density function, a single or set of square functions, and a single or set of triangular functions.

In yet another case of the method, the oscillating function comprises a sine wave having a form of sin(2πωt+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

In yet another case of the method, sectioning the digital signal allows for identifying, quantifying, and mitigating background/ambient noise from the digital signal prior to evaluating the function.

In yet another case of the method, portions of the oscillating function filtered out by the band pass filter are classified as containing noise and represented by the respective energy pulse information being zero.

In yet another case of the method, the method further comprises: obtaining the analytical signal; sampling the analytical signal to convert the analytical signal into a generated digital signal; sectioning the generated digital signal into a series of overlapping windows; determining a discrete forward Fourier transform of the generated digital signal in each window; and arranging the Fourier transform of each window into a discrete time-frequency energy spectrogram.

In yet another case of the method, the method further comprises applying a phase correction to each discrete component of the discrete time-frequency spectrogram to perform at least one function selected from: adjust a relative time of each window to an absolute time origin of the digital signal, rotate a complex valued discrete component to be real-valued in magnitude, and correct a polarity of discrete components that exhibit a negative real value.

In yet another case of the method, the method further comprises converting the discrete time-frequency spectrogram into an analytical spectrogram by identifying a location and an amplitude of each local maximum in the time-frequency domain of the discrete time-frequency spectrogram, where each maximum is representative of a single one of the energy pulses.

In yet another case of the method, converting the discrete time-frequency spectrogram into the analytical spectrogram further comprises performing least-squares optimization to estimate parameters of a parametric function for each energy pulse to obtain a best fit with each local maximum from the discrete time-frequency spectrogram, wherein a function representing the sum of all parametric functions represents the analytical spectrogram.

In another aspect, a system for generating an analytical signal for signal analysis is provided, the system comprising one or more processors and one or more computer storage media, the one or more computer storage media causing the one or more processors to execute a set of programmable modules configured to: obtain a digital signal; section the digital signal into a series of overlapping windows in time domain; generating a plurality of energy pulses by evaluating a function that describes energy information within each window or set of windows; and generate a time-dependent analytical signal by: generating an oscillating signal by multiplying each of the plurality of energy pulses by an oscillating function; and integrating the oscillating function across a band pass frequency filter.

In a particular case of the system, the analytical signal is defined by a set of parameters including time units, frequency units, origin and range of energy pulse information to be included.

In a particular case of the system, the band pass frequency filter has a frequency range corresponding to the energy pulse information to be included.

In a particular case of the system, the time-dependent analytical signal is invertible to approximate the digital signal.

In a particular case of the system, the digital signal is generated by discretely sampling an input signal, the input signal being either an analog signal or the analytical signal, wherein the amplitude of each sample is the average energy information of the input signal over a predefined observation time interval.

In a particular case of the system, the function has as its peak a median position and monotonically tends to zero at a finite time and frequency interval from the median position.

In a particular case of the system, the function is one of: a parametric probability density function, a single or set of square functions, and a single or set of triangular functions.

In a particular case of the system, the oscillating function comprises a sine wave having a form of sin(2πωt+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

In a particular case of the system, portions of the oscillating function filtered out by the band pass filter are classified as containing noise and represented by the respective energy pulse information being zero.

In a particular case of the system, sectioning of the digital signal identifies, quantifies, and mitigates background/ambient noise from the digital signal prior to evaluation of a function that describes the noiseless analytical signal.

In a particular case of the system, the programmable modules are further configured to: obtain the analytical signal; sample the analytical signal to convert the analytical signal into a generated digital signal; section the generated digital signal into a series of overlapping windows; determine a discrete forward Fourier transform of the generated digital signal in each window; and arrange the Fourier transform of each window into a discrete time-frequency energy spectrogram.

In a particular case of the system, the programmable modules are further configured to apply a phase correction to each discrete component of the discrete time-frequency spectrogram to perform at least one function selected from: adjust a relative time of each window to an absolute time origin of the digital signal, rotate a complex valued discrete component to be real-valued in magnitude, and correct a polarity of discrete components that exhibit a negative real value.

In a particular case of the system, the programmable modules are further configured to convert the discrete time-frequency spectrogram into an analytical spectrogram by identifying a location and an amplitude of each local maximum in the time-frequency domain of the discrete time-frequency spectrogram, where each maximum is representative of a single one of the energy pulses.

In a particular case of the system, the programmable modules are further configured to convert the discrete time-frequency spectrogram into the analytical spectrogram further comprises performing least-squares optimization to estimate parameters of a parametric function for each energy pulse to obtain a best fit with each local maximum from the discrete time-frequency spectrogram, wherein a function representing the sum of all parametric functions represents the analytical spectrogram.

In an aspect, there is provided a method of generating a time-dependent analytical signal from an input signal, the input signal comprising an analog or analytical signal, the method executable on one or more computer processors, the method comprising: receiving the input signal; determining a digital spectrogram for the input signal; determining energy pulses in a time-frequency domain for the analytical spectrogram, each energy pulse determined by evaluating a parametric function spanning a defined interval of the analytical spectrogram; determining a time-dependent analytical signal by aggregating the energy pulses, aggregating the energy pules comprises integration of a multiplication of the energy pulses by an oscillating function in a time-frequency domain across a band pass frequency filter, the frequencies inclusive in the band pass filter comprising the determined energy pulses; and outputting the time-dependent analytical signal.

In a particular case of the method, the probability density function for each pulse comprises a defined median position, and scale.

In another case of the method, the oscillating function comprises a sine wave having a form of sin(2πωt+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

In yet another case of the method, each energy pulse represents a unit of information, and collectively convey a concept.

In yet another case of the method, the method further comprising: receiving the analytical signal; sampling the analytical signal to convert the analytical signal into a digital signal; sectioning the digital signal into a series of overlapping windows; determining a discrete forward Fourier transform of the digital signal data in each window; and arranging the Fourier transform of each sequential window into a discrete time-frequency energy spectrogram.

In yet another case of the method, the method further comprising zero padding a first window and a last window in the series of overlapping windows.

In yet another case of the method, the method further comprising zero padding the front of each window.

In yet another case of the method, the method further comprising applying a phase correction to each discrete component of the digital spectrogram to, at least one of, adjust a relative time of each window to an absolute time origin of the digital signal, rotate a complex valued discrete component to be real-valued in magnitude, and correct a polarity of discrete components that exhibit a negative real value.

In yet another case of the method, the method further comprising converting a digital spectrogram of the digital signal into an analytical spectrogram by identifying a location and an amplitude of each local maximum in the time-frequency domain of a digital spectrogram of the digital signal, where each maximum is representative of a single one of the energy pulses.

In yet another case of the method, converting the digital spectrogram of the digital signal into the analytical spectrogram further comprising performing least-squares optimization to estimate parameters of a parametric function for each energy pulse to obtain a best fit with each local maximum from the digital spectrogram, wherein a function representing the sum of all parametric functions represents the analytical spectrogram.

In another aspect, there is provided a system of generating a time-dependent analytical signal from an input signal, the input signal comprising an analog or analytical signal, the system comprising one or more processors and one or more computer storage media, the one or more computer storage media causing the one or more processors to execute: an input module to receive the input signal; an analytical spectrum module to: determine an analytical spectrogram for the input signal; determine energy pulses in a time-frequency domain for the analytical spectrogram, each energy pulse determined by evaluating a parametric function spanning a defined interval of the analytical spectrogram; and determine a time-dependent analytical signal by aggregating the energy pulses, aggregating the energy pules comprises integration of a multiplication of the energy pulses by an oscillating function in a time-frequency domain across a band pass frequency filter, the frequencies inclusive in the band pass filter comprising the determined energy pulses; and an output module to output the time-dependent analytical signal.

In a particular case of the system, the probability density function for each pulse comprises a defined median position, and scale.

In another case of the system, the oscillating function comprises a sine wave having a form of sin(2πωt+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

In yet another case of the system, each energy pulse represents a unit of information.

In yet another case of the system, the one or more processors further executing a digital signal module to: receive the analytical signal; sample the analytical signal to convert the analytical signal into a digital signal; section the digital signal into a series of overlapping windows; determine a discrete forward Fourier transform of the digital signal data in each window; and arrange the Fourier transform of each sequential window into a discrete time-frequency energy spectrogram.

In yet another case of the system, the digital signal module further zero pads a first window and a last window in the series of overlapping windows.

In yet another case of the system, the digital signal module further zero pads the front of each window.

In yet another case of the system, the digital signal module further applies a phase correction to each discrete component of the digital spectrogram to, at least one of, adjust a relative time of each window to an absolute time origin of the digital signal, rotate a complex valued discrete component to be real-valued in magnitude, and correct a polarity of discrete components that exhibit a negative real value.

In yet another case of the system, the one or more processors further executing a digital spectrogram module to convert a digital spectrogram of the digital signal into an analytical spectrogram by identifying a location and an amplitude of each local maximum in the time-frequency domain of a digital spectrogram of the digital signal, where each maximum is representative of a single one of the energy pulses.

In yet another case of the system, converting the digital spectrogram of the digital signal into the analytical spectrogram further comprising performing least-squares optimization to estimate parameters of a parametric function for each energy pulse to obtain a best fit with each local maximum from the digital spectrogram, wherein a function representing the sum of all parametric functions represents the analytical spectrogram.

In another aspect, there is provided a method of synthesizing, packaging, and transmitting information using signals, the method executable on one of more computer processors, the method comprising: attributing an energy pulse in the time-frequency space of an analytical spectrogram to represent a unit of information, where an energy pulse is represented by an analytical probability density function spanning a finite interval of time and frequency, and where the probability density function has characteristic amplitude, location (median position), scale (standard deviation), and shape (parameters of the parametric probability density function); arranging within a specific time interval and frequency interval, or band, of an analytical spectrogram a set of energy pulses to represent multiple units of information, which collectively convey a concept; performing a definite integration from the lower to the upper frequency bounds of the band containing the multiple energy pulses of information within the analytical spectrogram, producing an analytical signal over the specific time interval containing the multiple pulses of information; outputting the analytical signal.

In another aspect, there is provided a method of digital signal analysis, the method executable on one or more computer processors, the method comprising: receiving an analytical signal and sampling it into a digital signal; in some cases, normalizing and filtering the digital signal; sectioning the normalized and filtered digital signal into a series of overlapping windows wherein the first window and the last window may be zero padded; in some cases, zero padding the front of each window except those points which represent new information; determining a discrete forward Fourier transform of the digital signal data in each window; arranging the Fourier transform of each sequential window into a discrete “digital” time-frequency energy spectrogram and determining, in some cases, a finite difference representation of each discrete Fourier transform value, for each frequency value, with respect to the relative time difference between adjacent windows, outputting a discrete digital spectrogram; in some cases, applying a phase correction to each discrete component of the digital spectrogram to: adjust from the relative time of each window to the absolute time origin of the digital signal; rotating the complex valued discrete component into only being real valued in magnitude; and correcting the polarity of any discrete components the exhibit a negative real value so that the discrete components are positive real valued in magnitude.

In another aspect, there is provided a method of converting a digital spectrogram into an analytical spectrogram, the method executable on one or more computer processors, the method comprising: identifying the location and amplitude of all local maxima in a time-frequency domain of a digital spectrogram, where each maximum can be represented by a single energy pulse; in some cases, using an initial estimate for a shape of the energy pulse and standard deviation in both frequency and time, such that the combination of location, amplitude, shape, and standard deviation prescribe the initial estimate for fitting the digital energy; in some cases, performing least-squares optimization to estimate parameters of each parametric function for each energy pulse in order to obtain a best fit with each local maximum from the digital spectrogram, where the parameters capture the location, amplitude, scale and shape of the energy pulse in time and frequency; determining a function representing a sum of all parametric functions, which represent distinct energy pulses, as a analytical spectrogram.

In another aspect, there is provided a method of using digital binary digit or “bit” data for information synthesis, packaging, transmission, and decoding, the method executable on one of more computer processors, the method comprising: attributing a unit of information to be a digital bit of data; synthesizing information by arranging groups of bits into prearranged packets of data, for example, 8 bits to produce a byte (or any other suitable collecting of bits, such as 16, 32, 64, or the like), where the packet occupies an interval of time and frequency of the analytical spectrogram, and each bit has a codec-specified median position, standard deviation, and shape; locating energy pulses associated with each digital bit at a given position, scale, and shape and turned on with unit amplitude to represent a bit value of “1” and zero amplitude to represent a value of “0”; performing a definite integration from a lower to an upper frequency interval of the packet of data within the analytical spectrogram, producing an analytical signal or packet signal over the specific time interval containing the packet of information; transmitting the analytical signal; receiving the analytical signal and sampling it into a digital packet signal; analyzing the digital signal to construct a digital spectrogram which contains the energy information within the digital signal; using the same codec employed to construct the original “packet” signal, decode the information by examining all median locations in the time-frequency interval spanned by the packet of data and determine whether each median location exhibits local maxima in the digital spectrogram and hence represents a “1” or whether it does not exhibit a local maximum and represents a “0”.

A method of speech synthesis, the method executable on one of more computer processors, the method comprising: attributing a unit of information to be an energy pulse emanating from a single component of a human voice apparatus; synthesizing information by arranging multiple energy pulses into a set of pulses, where the set of pulses occupies an interval of time and frequency of the analytical spectrogram, and each pulse in the set has a specified median position, amplitude, standard deviation, and shape, and collectively the set represents a phoneme of human speech; modulating the specified median position, amplitude, standard deviation, and shape of all, or some of the, energy pulses that collectively represent the phoneme to concatenate multiple phonemes together into phoneme combinations, such as words, and further to introduce intonation, inflection, phrasing, and expression into the progression of phonemes as words, as well as in transitions between phonemes and words into a sentence; performing a definite integration from the lower to the upper frequency interval of the set of energy pulses within the analytical spectrogram, producing an analytical signal over the specific time interval containing the phoneme, word, or sentence of information; transmitting the analytical signal or digitally sampling the analytical signal for storage.

In another aspect, there is provided a method of removing background noise from a signal, the method executable on one of more computer processors, the method comprising: receiving an analog signal and digitally sampling the analog signal, or receiving a digital signal, where the digital signal is pre-recorded, or the digital signal represents output from a receiver, such as a microphone, that was used to receive and digitally sample a signal; constructing a digital spectrogram of the digital signal; in some cases, establishing a noise threshold value, which could be static, variable, or even dynamically assisted by an artificial agent, to differentiate ambient noise from potentially important information, such as human speech; identifying background or ambient signal noise under controlled conditions, quantifying the average energy persistence within the spectrogram relating to background noise, which may include energy expressions at specific frequencies; removing digital information relating to background from each time and frequency interval within the digital spectrogram, and in some cases using subtraction, and in yet others using multiplication, to scale the total energy information within time-frequency intervals to remove the persistence of background energy; constructing an analytical spectrogram to be consistent with the digital spectrogram after removing the background noise; performing a definite integration from a lower to an upper frequency interval of the set of energy pulses within the analytical spectrogram, producing an analytical signal over the specific time interval containing the phoneme, segment, word, or sentence of information; transmitting the analytical signal or digitally sampling the analytical signal for storage.

In another aspect, there is provided a method of speech recognition, the method executable on one of more computer processors, the method comprising: receiving an analog human voice signal or alternatively a signal synthesized and digitally sampling the analog signal, or receiving a digitized human voice signal, where the digital signal is pre-recorded, or the digital signal represents output from a microphone that was used to receive and digitally sample an analog human voice signal; constructing a digital spectrogram of the digital signal; in some cases, removing background noise from the digital spectrogram; constructing an analytical spectrogram from the digital spectrogram information; identifying patterns within the analytical spectrogram in which the human voice information resides; matching identified patterns within the analytical spectrogram with known spoken phonemes under controlled conditions to create a training data set; utilizing a machine learning algorithm with the training data set to classify information in digital and analytical spectrograms as spoken phonemes or words.

In another aspect, there is provided a method of generating an obfuscating layer over a signal for encoding purposes, the method executable on one of more computer processors, the method comprising: receiving and digitally sampling an analog signal, or receiving a digital signal from a computer system, where the digital signal is pre-recorded, or the digital signal represents output from a receiver, such as a microphone, that was used to receive and digitally sample a signal; constructing a digital spectrogram of the digital signal; constructing a predefined codec using an analytical spectrogram containing digital bits positioned to overlay important information in the digital spectrogram of the received signal; producing an analytical signal over the specific time interval containing the packet of information within the analytical spectrogram; digitally sampling the analytical signal to produce a digital packet signal; overlaying the analytical signal and adding it to the received signal, and normalizing the signal, to encode the received digital signal by creating an obfuscating layer with the analytical spectrogram comprising the digital packet signal; transmitting the signal or storing the digital signal; receiving and digitally sampling the analog signal; reproducing the analytical obfuscating signal layer using a predefined codec and subtracting the resulting signal from the received or stored signal to recover, or decode, the original information.

These and other aspects are contemplated and described herein.

It will be appreciated that the foregoing summary sets out representative aspects of systems and methods and assists skilled readers in understanding the following detailed description.

DESCRIPTION OF THE DRAWINGS

A greater understanding of the embodiments will be had with reference to the Figures, in which:

FIG. 1 illustrates a flow diagram of programmable modules and methods performed by each respective module.

FIG. 2 is a schematic diagram showing the system of FIG. 1, in accordance with an embodiment.

FIG. 3 is a schematic diagram showing the system of FIG. 2 in an exemplary operating environment.

FIG. 4 is a flow chart of a method for receiving and sampling either an analog or analytical input signal for the purpose of generating a digital output signal, in accordance with an embodiment.

FIG. 5 illustrates an example of an idealized continuous (analog) signal and discrete sampling (digital) of such analog signal.

FIG. 6 is a flow chart of a method for inverting an analytical spectrogram into an analytical signal, in accordance with an embodiment;

FIG. 7A illustrates an example of a single energy pulse in the time-frequency domain;

FIG. 7B illustrates an example of a signal for the energy pulse of FIG. 7A;

FIG. 8 is a flow chart of a method for windowing digital signal information for spectral analysis, in accordance with an embodiment.

FIG. 9 illustrates an example of overlap windowing on the example signal of FIG. 4;

FIG. 10 illustrates an example of sampling, and distributing into windows, of a signal, in accordance with the method of FIG. 8;

FIG. 11 is a flow chart of a method for constructing a digital spectrogram, in accordance with an embodiment;

FIG. 12 illustrates an example arrangement of a Fourier transform of a signal from each window in a waterfall plot, in accordance with the method of FIG. 11;

FIG. 13 illustrates an example visualization of a finite difference determination of a waterfall plot for generating a digital spectrogram, in accordance with the method of FIG. 11;

FIG. 14 is a flow chart of a method for quantifying phase shifting for phase continuity, in accordance with an embodiment;

FIG. 15 is a flow chart of a method for removing background noise from an input digital spectrogram, in accordance with an embodiment;

FIG. 16 is a flow chart of a method for converting a digital spectrogram into an analytical spectrogram, in accordance with an embodiment;

FIG. 17 is a schematic diagram representing an example of the system of FIG. 2 for binary bit packaging.

FIG. 18 illustrates an example of a placement of energy pulses within an analytical spectrogram to synthesize and encode a data packet of information.

FIG. 19 illustrates an example of a resulting analytical signal containing a data packet to transmit information.

FIG. 20 illustrates an example of a decoded data packet within a digital spectrogram.

FIG. 21 is a schematic diagram representing an example of the system of FIG. 2 for speech synthesis.

FIG. 22 illustrates an example of an input digital signal of the spoken word “are”.

FIG. 23 illustrates an example of a digital spectrogram representing the spoken word “are”.

FIG. 24 illustrates an example of a location of peaks of all of energy pulses within a digital spectrogram that comprise the spoken word “are” for the purpose of generating a trial analytical spectrogram.

FIG. 25 illustrates an example of a trial analytical signal of the spoken word “are” generated with an initial guess of standard deviation values for the energy pulses identified in FIG. 24.

FIG. 26 illustrates an example of an input digital signal of the spoken word “are” combined with automobile background noise.

FIG. 27 illustrates an example of a digital spectrogram of the spoken word “are” combined with automobile background noise.

FIG. 28 illustrates an example of a digital spectrogram of the spoken word “are” after application of a noise filter.

FIG. 29 illustrates an example of an analytical signal of the spoken word “are” after application of the noise filter.

DETAILED DESCRIPTION

Embodiments will now be described with reference to the figures. For simplicity and clarity of illustration, where considered appropriate, reference numerals may be repeated among the figures to indicate corresponding or analogous elements. In addition, numerous specific details are set forth to provide a thorough understanding of the embodiments described herein. However, it will be understood by those of ordinary skill in the art that the embodiments described herein may be practiced without these specific details. In other instances, well-known methods, procedures, and components have not been described in detail so as not to obscure the embodiments described herein. Also, the description is not to be considered as limiting the scope of the embodiments described herein.

Any module, unit, component, server, computer, terminal, or device exemplified herein that executes instructions may include or otherwise have access to computer readable media such as storage media, computer storage media, or data storage devices (removable and/or non-removable) such as, for example, magnetic disks, optical disks, or tape. Computer storage media may include volatile and non-volatile, removable, and non-removable media implemented in any method or technology for storage of information, such as computer readable instructions, data structures, program modules, or other data. Examples of computer storage media include RAM, ROM, EEPROM, flash memory or other memory technology, CD-ROM, digital versatile disks (DVD) or other optical storage, magnetic cassettes, magnetic tape, magnetic disk storage or other magnetic storage devices, or any other medium which can be used to store the desired information, and which can be accessed by an application, module, or both. Any such computer storage media may be part of the device or accessible or connectable thereto. Any application or module herein described may be implemented using computer readable/executable instructions that may be stored or otherwise held by such computer readable media.

The following disclosure relates generally to the field of signal processing; and more particularly, to systems and methods of signal analysis by synthesizing or decoding information within a spectrogram and inverting the spectrogram into a signal. Further, the following disclosure is directed to systems and methods of synthesis, modification, transmission and decoding of high-density bit data within a signal. Further, the following disclosure is directed to systems and methods of recognition and synthesis of human speech communication. Generally, embodiments of the present disclosure take advantage of the premise that transient waves of information within a signal can be intercepted, measured, and then disaggregated into energy pulses occurring within a specific time and frequency interval of a spectrogram to quantify how these energy pulses come into existence, persist, and ultimately dissipate. The information contained within, and therefore expressed by, these same energy pulses can then be modified and converted back into a signal for subsequent transmission.

Generally, various approaches use the idea that an analog or analytically defined signal is the starting point for digital sampling, analysis, and interpretation of any enclosed information. In contrast, the present disclosure provides methods and systems that are configured to provide an entry point for information that is provided as an analog signal, an analytical signal or a digital signal, and to interpret the entered information for conversion to the other domains. Thus, embodiments of the present disclosure are inspired by a full life-cycle interpretation of information, exemplified as programmable modules 200 in FIG. 1, and thus, identifies the analog signal as an intermediary state of transmission from a source to a receiver. Such life-cycle interpretation of information can begin with a set of time-ordered frequency-specific analog energy pulses synthesized within a domain dimensioned by orthogonal time and frequency axes, where this energy information is used to express an idea. Note that the time-frequency domain can be like other definitions of a spectrogram to the degree that both are dimensioned by a horizontal time and vertical frequency axis; the information they contain may vary.

A simplified example to provide background context is a note played on a guitar:

• • The guitar string is physically constrained to produce information over a small frequency range. This physical process is like selecting an incremental frequency interval in the time-frequency domain.
  • The musician provides energy to the guitar string by plucking it at a point in time. This causes the string to begin vibrating at its prescribed frequency and later stop vibrating as the energy dissipates. The energy input into a specific frequency translates into the volume of the note played, with more energy producing a higher volume. This is analogous to populating an interval of the time-frequency domain with an energy pulse consisting of non-zero coefficients spanning the time interval and frequency at which the string vibrates.
  • The vibrating guitar string encounters resistance from the surrounding environment, which causes concussive energy pulses to form in the air and travel away from the source as an analog signal. There is a conservation of energy between the vibration of the guitar string after plucking and the energy in the signal.
  • The analog signal is created as a combination or aggregation of information originally synthesized as analog energy pulses in the time-frequency domain. The complexity of the signal is a function of the time sequence and overlap in which energy pulses at specific frequencies (notes) and energy (volume) are synthesized and then dissipate in the time-frequency domain, resulting in a signal that could be easy or difficult to interpret.
  • An observer or receiver can intercept and sample the analog signal converting it into a digital signal, perform digital signal analysis to generate a digital spectrogram, and identify the transmitted energy patterns using the digital spectrogram. In this example, the energy pattern would be the note played on a guitar at a particular interval in time, and at a specific volume and frequency.

In the above example, the analog signal transmission can be interpreted as an intermediary step between the synthesis and analysis of the information. The guitar is the source of the time-ordered and frequency-ordered information in the time-frequency domain, the ambient air is the medium that relays identifiable information to an audience as concussive energy pulses in the form of a signal, and the audience receives and analyzes the information conveyed by the signal. The above example provides a framework, algorithm, and application to quantify the processes whereby energy information is conserved as it is converted between the time-frequency domain and the signal as a continuously differentiable and reversible operation.

Without loss of generality, the present embodiments inventively provide a full life-cycle interpretation of information through a method and system that can both conduct signal analysis on a digital or analog signal to decode information within the signal, or alternatively accept an analytical signal or parameters describing an analytical signal for synthesis into a digital or analog signal for subsequent transmission.

In the above example of the guitar string, a member of the audience could use the present embodiments to conduct signal analysis by receiving a recording of the analog signal of the guitar music played and inputting the analog signal to programmable modules 200. In this case, the analog signal is sampled into a digital signal. Signal analysis is then conducted via windowing the digital signal, constructing a time-frequency digital spectrogram of the window information, and phase-shifting the digital spectrogram relative to the time origin of the received analog signal. The resulting digital spectrogram can be stored. The time-frequency location of energy pulses within the digital spectrogram then depicts the progression of notes played by the musician.

Staying with the above example, the musician may wish to edit the recording of themself playing and subsequently then mix it with additional sound information to construct a new recording. The musician could begin by taking the digital spectrogram of the recording, remove any unwanted background or audience noise and convert it to an analytical spectrogram, which is a time and frequency continuous representation of the discrete digital spectrogram. The present embodiments can be instructed to remove or adjust existing energy pulses within the analytical spectrogram, or even synthesize new energy pulses representing musical notes (information) into the same analytical spectrogram. The analytical spectrogram can be inverted into an analytical signal. This analytical signal could be sampled and transmitted to an audience or sampled into a digital recording. Note the distinction between the analog signal and the analytical signal. The analog signal was received from the musician playing their guitar while the analytical signal was constructed by synthesizing information into a time-frequency continuous analytical spectrogram and inverting that information into an analytical signal.

Advantageously, the present embodiments allow for the use and modification of a received signal's spectrogram and provides for the ability to invert that spectrogram back into a digital signal; for example, such that it can be communicated to another receiver for analysis.

While the present embodiments are discussed in the context of sound information, the subject matter described herein is applicable to any application that synthesizes packets of information in the time-frequency domain, and then performs spectrogram inversion to generate a signal for subsequent transmission of these packets through wired or wireless technology to be received and analyzed by a device. For the foregoing reasons, a skilled reader will appreciate that the present embodiments are suitable for data transfer applications in general.

Advantageously, the embodiments described herein overcome significant technical challenges in the art of spectrogram inversion. Other approaches generally include incomplete phase information, causing the production of discontinuities within a digital signal reproduced from a digital spectrogram. Embodiments of the present disclosure permit seamless transition of information between the spectrogram domain and the signal. Specifically, definite integration of the analytical spectrogram over a frequency interval collapses the time-frequency dimensionality of energy pulses within the spectrogram into the time-only dimensionality of a signal. The resulting analytical signal produces a parametric representation wholly with respect to time and can be measured at any sampling rate. The spectrogram inversion approach presented herein provides a foundation, for example, for generating a carefully designed analytical signal to replicate human speech characteristics or to perform high-density information packing for data transfer.

Advantageously, the embodiments described herein overcome significant technical challenges in the art of spectrogram construction. In some embodiments, a digital signal is selected for numerical analysis. In some cases, the front end and back end of the digital signal are zero-padded to ensure the first and last windows contain no energy information. In some cases, observation windows can be shifted and overlapped along a temporal length of the digital signal to, for example, observe the appearance, persistence, and subsequent dissipation of signal information between consecutive windows; and, to construct a digital spectrogram representation of the signal in both time and frequency. In some cases, a backwards finite difference of information energy can be formed or judiciously estimated with respect to time to produce a digital spectrogram representation describing energy changes at all frequencies, which allows this analysis to quantify the appearance, persistence, and subsequent dissipation of information energy throughout the entirety of any digital signal. In some cases, the digital spectrogram is then phase shifted from the relative time of each sampling window to the absolute time origin of the input digital signal. Additionally, the digital spectrogram is further phase shifted so that all digital spectrogram entries are only real valued and positive in magnitude, thereby representing energy pulses as units of information.

Advantageously, the embodiments described herein provide an approach for numerical analysis to inform the parameterization of functions that construct an equivalent analytical spectrogram to that of any input digital spectrogram. Once described, these parameters can be modified to dynamically change and effect any desired influence on the nature of energy information within the analytical spectrogram, wherein this same energy information is then inverted into an analytical signal. In the case of replicating a phonetic sound within human speech, these changes could include intonation, emotion, dialect, and phrasing or could include the transition of one phonetic sound into another during expression of a multi-syllabic word. In the case of sound analysis, the outcome of the approach is to provide a strategy to implement natural speech recognition and synthesis by identifying patterns within the digital spectrogram, replicating those patterns with parametric functions within an analytical spectrogram as part of speech recognition, of further inverting the synthesized information into an analytical signal as part of speech synthesis. The numerical approaches can provide feedback control that allows replication of human speech characteristics by iteratively comparing a synthesized trial speech signal with a target recorded signal. In the case of data packaging and transmission, the outcome of this approach can be used to efficiently store bit information within a signal and recapture this bit information upon reception and analysis. In another application, the techniques described herein could generate an obfuscating layer of encoded energy to mask an underlying signal, which could only be recovered with a priori knowledge of the codec.

Embodiments of the present disclosure advantageously interpret a signal as an intermediary transmission step. Thus, a spectrogram within the time-frequency domain can be interpreted as the origin of information synthesis leading to a signal as a means of information transmission. This is generally in contrast to other approaches used to describe Fourier analysis such as: the “forward Fourier transform” which is used to transform a digital signal that is solely a dependant on time into a related function that is solely dependent on frequency; and the “inverse Fourier transform” which is used to transform energy information that is solely dependent on frequency back into a digital signal that is solely dependent on time. These terms imply that the digital signal, as derived by receiving and sampling a signal, is the starting point for analysis. Given that the time-frequency domain is the origin of information, and that the information is transmitted as time-ordered and meaningful patterns through signals, the information patterns in the time-frequency domain can be generally considered smooth and have continuously differentiable functions with respect to time and frequency.

Referring now to FIG. 2 and FIG. 3, shown are a system 100, in accordance with an embodiment, and a computing environment, respectively. In this embodiment, the system 100 is run on a client-side device 26 and, in some cases, can access content or computing resources located on a server 32 over a network 24, such as the internet. In further embodiments, the system 100 can be run on any other computing device; for example, a desktop computer, a laptop computer, a smartphone, a tablet computer, the server 32, a smartwatch or other wearable computing device, distributed or cloud computing device(s), or the like.

In some embodiments, the components of the system 100 are stored by and executed on a single computer system. In other embodiments, the components of the system 100 are distributed among two or more computer systems that may be locally or remotely distributed.

FIG. 2 shows various physical and logical components of an embodiment of the system 100. As shown, the system 100 has several physical and logical components, including a central processing unit (“CPU”) 102 (comprising one or more processors), random access memory (“RAM”) 104, an input interface 106, an output interface 108, a network interface 110, non-volatile storage 112, and a local bus 114 enabling CPU 102 to communicate with the other components. CPU 102 executes an operating system, and various modules, as described below in greater detail. RAM 104 provides relatively responsive volatile storage to CPU 102. The input interface 106 can interact with and receive data and signals from various devices, such as an audio input signal from an audio or bit input device 160 (e.g., microphone). The input interface 106 can also enable an administrator or user to provide input via an input device, for example a keyboard and mouse. In other cases, the audio sensor data can be already located on the database 116 or received via the network interface 110. The output interface 108 can outputs data to output devices, for example, to an audio or bit output device 170 (e.g., speaker). The network interface 110 permits communication with other systems, such as other computing devices and servers remotely located from the system 100, such as for a typical cloud-based access model. Non-volatile storage 112 stores the operating system and programs, including computer-executable instructions for implementing the operating system and modules, as well as any data used by these services. Additional stored data, as described below, can be stored in a database or codec 116. During operation of the system 100, the operating system, the modules, and the related data may be retrieved from the non-volatile storage 112 and placed in RAM 104 to facilitate execution.

In an embodiment, the CPU 102 is configurable to execute a number of conceptual modules, including an input module 120, an output module 130, and a number of programmable modules 200. The programmable modules 200 are illustrated in FIG. 1 and can include an analog signal module 210, a digital signal module 220, a digital spectrogram module 230, an analytical spectrogram module 240, and an analytical signal module 250. In further embodiments, all or a portion of the functions of these modules can be combined on certain modules or executed on other modules, or executed on, or in combination with, other computing devices.

In some cases, the output module 130 can output or transmit an output signal wirelessly using radio waves for cellular, Wi-Fi, Bluetooth, or analogous peer-to-peer data transfer protocol; as acoustic waves through air, or for underwater communication, or through solid media; as light waves through a vacuum, gas or liquid phase, or through solid fibre optic media; as electrons or other particles though gas, liquid or solid phase material.

FIG. 1 illustrates an illustrative flow diagram of an interaction of the programmable modules 200 and illustrates the respective methods performed by each of the programmable modules. It is understood that while the methods are illustrated as separated and performed by a respective programmable module, they can be combined and/or performed on other programmable modules as suitable.

The input module 120 receives and reads an input signal from the input interface 106, the network interface 110, or the database 116. In some cases, to read the input signal, the input module 120 can identify a single channel for input and read integer (or real) data representing signal magnitude as a function time t where the discrete data is denoted as h(t_n) at discrete sampling time t_n [time]. Operating on a single channel is for illustrative purposes and operating on additional channels in parallel is contemplated.

The input module 120 provides multiple entry points of external information, is communicatively linked to the analog signal module 210, digital signal module 220, and analytical spectrogram module 240, and includes suitable logic to direct the received information appropriately. The input module 120 provide a first entry point of external information, an analog signal, to analog signal module 210; a second entry point of external information, a time-dependent digital signal, to digital signal module 220; and a third entry point of external information, energy pulse parameters, to analytical spectrogram module 240. Alternatively, analytical spectrogram module 240 may receive input energy pulse information following internal processing within the programmable modules 200.

As illustrated in FIG. 4, Method 300, performed by the digital signal module 220, receives and samples either an analog or analytical input signal for the purpose of generating a digital output signal.

At block 302 the digital signal module 220 receives either a time-dependant analog signal from module 210 or the time-dependent analytical signal from module 250, depending on whether the inputted signal received from the input module 120 is an analog signal or an analytical signal.

The digital signal module 220 discretely samples the analog or analytical signal into a time series where: the length of the time series is the observation interval; and the amplitude of each measurement is the average information energy within the signal over a given sampling interval. FIG. 5 illustrates an example of an idealized time-continuous (analog or analytical) signal s(t) as well as a discretely sampled (digital) version of the same signal h(t_n) in the observation interval n=0,1, . . . , N−1. Note that the first data point of the signal is at the origin t₀, while the last data point is t_N−1.

In some cases, the digital signal module 220 can determine, using method 300, properties and operations for the signal to be analyzed. In an example, at block 304, a sampling interval can be determined surrounding time t_n [time] and denoted as

$T\left[\frac{\mathrm{time}}{\mathrm{sample}}\right]$ where:

$\begin{array}{cc}T=\frac{t_{n+\frac{1}{2}}-t_{n-\frac{1}{2}}}{\left(n+\frac{1}{2}\right)-\left(n-\frac{1}{2}\right)}& \mathrm{Equation}\left(1\right)\end{array}$

Starting at time t₀ and ending at time t_N−1, sampling times for analysis can be such that the data are indexed as h(t_n) where n=0, . . . , N−1 [samples]. Therefore, the digital signal includes N data points and starts at t=0 [time].

To discretely sample the time-continuous analog or analytical signal s(t), at block 302, the input interface 106 receives from the audio or bit input device 160 (such as an audio sensor) an input analog signal. At block 304, the digital signal module 220 performs numerical integration on the analog signal at equally spaced sampling intervals T to average this energy over the sampling interval and generate a digital signal h(t_n). Equation (2) shows a mathematical representation of this digital sampling process:

$\begin{array}{cc}h\left(t_n\right)=\frac{1}{T}{\int }_{n-\frac{1}{2}}^{n+\frac{1}{2}}s\left(t\right)dt& \mathrm{Equation}\left(2\right)\end{array}$ Therefore, there is a conservation of information energy between the analog or analytical and digital signals over the time observation interval.

The process of sampling the time-continuous analog or analytical signal s(t) using Equation (2) transforms the embedded information into a discrete digital signal h(t_n) comprised of a set of time-ordered samples n=0,1, . . . , N−1 [samples]. Note that the sampling process can be explicitly denoted with units of “sample”. For instance, a standard digital audio file can have 44,100 samples of data h(t_n) in one second of a recording. Therefore, the time-sampling-process ratio would be denoted as

$T=\frac{1}{44,100}\left[\frac{\mathrm{seconds}}{\mathrm{sample}}\right].$ The time observation interval of the signal would now be: (N−1)·T [seconds].

At block 306, the digital signal module 220 outputs the time dependant digital signal. The digital signal may be utilized by digital spectrogram module 240, as described below, or could be converted to an analog signal by analog signal module 210 using any of the several known digital-to-analog signal conversion techniques.

As illustrated in FIG. 6, method 400, performed by the analytical spectrogram module 240, inverts an analytical spectrogram into an analytical signal. At block 402, the analytical spectrogram module 240 receives a base input analytical spectrogram which includes parameters specifying the time and frequency units, origin, and range to be populated with energy pulse information. These parameters are either generated by the programmable modules 200 when the analytical spectrogram was generated by the digital spectrogram module or can by input from an external source (including, for example, by a user) by the input interface 106. The base input spectrogram does not contain any energy pulse information itself and is initialized everywhere with zero [joules] of energy.

At block 404, the input module 120 receives analytical energy pulse information and directs the input data to analytical spectrogram module 240. For example, the two-dimensional Gaussian function may be used to define an energy pulse (t, ω) as a function of time t [time] and frequency ω [Hz] as:

$\begin{array}{cc}𝒮\left(t,\omega \right)=\frac{1}{2\pi {\sigma }_t{\sigma }_{\omega }}\exp \left\{-{a\left(\frac{t-m_t}{{\sigma }_t}\right)}^2-{b\left(\frac{\omega -m_{\omega }}{{\sigma }_{\omega }}\right)}^2\right\}& \mathrm{Equation}\left(3\right)\end{array}$ The use of a Gaussian function ensures that the magnitude of the energy pulse tends to zero with increasing distance from the median position (m_t, m_ω) subject to scale denoted by standard deviation (σ_t, σ_ω). The amplitude may be adjusted so that the area beneath the Gaussian function equals the desired total energy of the input pulse. In effect, (t, ω) localizes the energy pulse information and controls the resulting signal construction.

The energy pulse (t, ω) can be in the form of a parametric probability density function or a set of parametric probability density functions. A skilled reader will appreciate that the energy pulse (t, ω) may alternatively be in the form of a single or set of parametric square functions, triangular functions, or any other type of function which has as its peak the median position (m_t, m_ω) and monotonically tends to zero at a finite time and frequency interval from median position. The parameterization of any function used to replicate an energy pulse serves to characterize its location, scale, shape and amplitude. The area under the function is equal to the total energy within the pulse.

FIG. 7A illustrates an example of (t, ω) for an energy pulse representing a single Gaussian function. This energy pulse could represent a unit of information (i.e., a “bit”) to be transmitted in a radio signal or any expression of sound or light at a given frequency. The use of input module 120 to direct the energy pulse information directly into the analytical spectrogram module 240 provides a third entry point of external information entry into the programmable modules 200. Alternatively, analytical spectrogram module 240 may receive input energy pulse information following internal processing within the programmable modules 200 of the previously mentioned input analog, analytical, or digital signals.

An analytical expression can be used to describe the energy pulse information (t, ω) as:

$\begin{array}{cc}𝒮\left(t,\omega \right)=\frac{d^2\epsilon }{d\omega dt}& \mathrm{Equation}\left(4\right)\end{array}$ where

$\frac{d^2\epsilon }{d\omega \mathrm{dt}}\left[\mathrm{joules}/\left(\mathrm{time}·\mathrm{frequency}\right)\right]$ represents energy distributed as a smooth and continuously differentiable function across the time-frequency domain. Abstracting the energy expression (t, ω) to be a derivative with respect to both time and frequency allows for energy pulse information to smoothly come into existence, persist, and dissipate, while ensuring a continuously differentiable mathematical form. Notably, the derivative

$\frac{d^2\epsilon }{d\omega \mathrm{dt}}$ can be expressed as having units of joules as the time [sec] and frequency [1/sec] units of the derivative cancel out. This identifies the digital and analytical spectrogram as a careful expression of energy in the frequency-time domain, whereas the digital and analytical signals only represent energy with respect to time. In most cases, the above implies a mathematical definition of a signal s(t)≡∫(t, ω)dω, which may require a suitable definition of an incrementally small observation interval Δt in time and Δω in frequency. Additionally, power (t) [joules/time] can be defined as the rate of change of energy ε(t, ω) [joules] with respect to time, which implies a relationship with the signal s(t) as:

$\begin{array}{cc}𝒫\left(t\right)=\frac{d\epsilon }{dt}\equiv \int 𝒮\left(t,\omega \right)d\omega \Rightarrow s\left(t\right)\equiv 𝒫\left(t\right)& \mathrm{Equation}\left(5\right)\end{array}$

At block 406, the analytical spectrogram module 240 synthesizes the energy pulse information into the base spectrogram. For example, any number of parametric functions representing energy information, such as Equation 5, are evaluated within the base input analytical spectrogram to distribute energy

$\frac{d^2\epsilon }{d\omega \mathrm{dt}}$ in time and frequency. Alternatively, information within the previously mentioned input analog, analytical, or digital signals may be equivalently represented as energy pulses defined by a set of parametric functions, such as probability density functions, within the analytical spectrogram.

At block 408, to aggregate the unit of information in the time-frequency domain, the analytical spectrogram module 240 applies a signal integrator and signal multiplier, to generate a definite integration of an energy pulse (t, ω) in the analytical spectrogram, multiplied by an oscillating function (such as a sine wave) in the time-frequency domain, producing a time-dependent analytical signal s(t) as:

$\begin{array}{cc}s\left(t\right)={\int }_{{\omega }_{\min }}^{{\omega }_{\max }}\sin \left(2\pi \omega t+\lambda \right)\left(t,\omega \right)d\omega & \mathrm{Equation}\left(6\right)\end{array}$ where ω_min and ω_max specify a band pass filter via the bounds on the definite integration and sin(2πωt+λ) provides the correct frequency of vibration for each position within the time-frequency domain. Note that λ specifies a phase shift relative to the absolute time origin t=0 [sec]. The definite integration [ω_min, ω_max] reduces the dimensionality of the energy pulse vibration of sin(2πωt+λ)(t, ω) into a solely time-dependent form as a signal for transmission. Notably, this frequency-based integration operation conserves energy between the analytical spectrogram and the analytical signal. Therefore, any information energy introduced or removed from the spectrogram, and hence the time-frequency domain, naturally adjusts the resulting signal. In some ways, Equation (6) shares a resemblance to the inverse Fourier transform.

The signal construction that results from a single energy pulse described by (t, ω) in Equation (3) for a specific median position (m_t, m_ω) and scale (σ_t, σ_ω) can be analytically derived. A series of integration operations between [ω_min, ω_max] for Equation (6) produces the following signal:

$\begin{array}{cc}s\left(t\right)=\frac{2\pi {\sigma }_t{\sigma }_{\omega }}{8{\sigma }_t\sqrt{\pi b}}\exp \left\{-{b\left(\frac{2\pi {\sigma }_{\omega }\left(t-m_t\right)}{2b}\right)}^2-2\mathrm{\pi 𝒾}{m}_{\omega }\left(t-m_t\right)-\mathrm{𝒾\lambda }\right\}\{ℱ\left(t,{\omega }_{\max }\right)\exp \left\{{b\left(\frac{{\omega }_{\max }-m_{\omega }}{{\sigma }_{\omega }}\right)}^2\right\}\left[\text{⁠}\mathrm{erf}\left(\text{⁠}\frac{\left(2b{\omega }_{\max }+2{\mathrm{\pi 𝒾\sigma }}_{\omega }^2\left(t-m_t\right)-2b{m}_{\omega }\right)}{\left(2{\sigma }_{\omega }\sqrt{b}\right)}\text{⁠}\right)\text{⁠}-\exp \left\{4\mathrm{\pi 𝒾}{m}_{\omega }\left(t-m_t\right)+\mathrm{𝒾\lambda }\right\}\mathrm{erf}\left(\frac{2b{\omega }_{\max }-2{\mathrm{\pi 𝒾\sigma }}_{\omega }^2\left(t-m_t\right)-2b{m}_{\omega }}{\left(2{\sigma }_{\omega }\sqrt{b}\right)}\right)\right]-ℱ\left(\text{⁠}t,{\omega }_{\min }\right)\exp \left\{{b\left(\frac{{\omega }_{\min }-m_{\omega }}{{\sigma }_{\omega }}\right)}^2\right\}[\text{⁠}\mathrm{erf}\left(\text{⁠}\frac{2b{\omega }_{\min }+2{\mathrm{\pi 𝒾\sigma }}_{\omega }^2\left(t-m_t\right)-2b{m}_{\omega }}{\left(2{\sigma }_{\omega }\sqrt{b}\right)}\text{⁠}\right)\text{⁠}-\exp \left\{4\mathrm{\pi 𝒾}{m}_{\omega }\left(t-m_t\right)+\mathrm{𝒾\lambda }\right\}\mathrm{erf}\left(\frac{2b{\omega }_{\min }-2{\mathrm{\pi 𝒾\sigma }}_{\omega }^2\left(t-m_t\right)-2b{m}_{\omega }}{\left(2{\sigma }_{\omega }\sqrt{b}\right)}\right)]\}& \mathrm{Equation}\left(7\right)\end{array}$ An example of Equation (7) is illustrated in FIG. 7B, which represents the signal corresponding to a single energy pulse. Note that i is the imaginary number.

At block 410, the analytical spectrogram module 240 outputs the time-dependant analytical signal.

As illustrated in FIG. 8, method 500, performed by the digital spectrogram module 230, windows the digital signal information for spectral analysis. The digital spectrogram module 230 first receives and normalizes and then filters the input signal as a pre-processing step prior to windowing. The discrete forward Fourier transform is applied on the digital signal at specific intervals of time, generating Fourier pairs

$h\left(t_n\right)\leftrightarrow H\left({\omega }_k\right)$ that can span me entire signal length. Generally, the resolution of this numerical analysis technique is dependent upon the sampling rate, with higher sampling rates providing more resolution when determining where and when energy information exists within a signal. For the purposes of illustration, h(t_n) will be used in the observation interval n=0,1, . . . , N−1, where N represents the number of data points within the discrete interval of time.

At block 502, the digital spectrogram module 230 receives the input time-dependant digital signal, which is then normalized such that: −1≤h(t_n)≤1. At block 504, the forward Fourier transform of h(t_n) is determined as:

$\begin{array}{cc}H\left(\frac{j}{NT}\right)=\frac{1}{N}{\sum }_{n=0}^{N-1}h\left(nT\right)e^{-2\mathrm{\pi 𝒾}\mathrm{nj}/N}\mathrm{for}j=0,1,\dots ,N-1& \mathrm{Equation}\left(8\right)\end{array}$ Note that frequency

${\omega }_j=\frac{j}{NT},$ such that

$H\left(\frac{j}{NT}\right)\equiv H\left({\omega }_j\right).$ Additionally, i is the imaginary number.

At block 506, the upper and lower frequency bounds for analysis are determined as [ω_min, ω_max]. These values should constrain the input digital signal information of interest within H(ω_j). At block 508, the input digital signal is filtered as a band-pass signal as:

$$\begin{gathered} \begin{array}{cc}\mathrm{if}{\omega }_{\min }\le {\omega }_j\le {\omega }_{\max }\mathrm{then}\text{ \\ H^(ωj)=H⁡(ωj)⁢else⁢ \\ H^(ωj)=0⁢end⁢if}& \mathrm{Equation}\left(9\right)\end{array} \end{gathered}$$

At block 510, the inverse Fourier transform of Ĥ(ω_j) is determined as:

$\begin{array}{cc}\hat{h}\left(\mathrm{nT}\right)={\sum }_{j=0}^{N-1}\hat{H}\left(\frac{j}{NT}\right)e^{2\mathrm{\pi 𝒾}\mathrm{nj}/N}\mathrm{for}n=0,1,\dots ,N-1& \mathrm{Equation}\left(10\right)\end{array}$ where the resulting filtered signal is now ĥ(t_n) and can be used for subsequent analysis, where nT≡t_n such that ĥ(nT)≡ĥ(t_n). FIG. 9 depicts an idealized filtered sound signal ĥ(t_n), for example, for illustrating notation. Note that the Equation (8) and Equation (10) are shown for illustrative purposes and used to specify the forward and inverse discrete Fourier transform, and not to specify a required algorithmic implementation. For example, a fast Fourier transform could be used instead.

The discrete Fourier transform in Equation (8) collects N discrete samples of the signal over a finite observation interval, or “window”, of length t_N−1−t₀ [time]. Therefore, the complex coefficients within H(ω_k) represent the entire temporal span of the data and are denoted by prior art as being time independent. However, they are inclusive of the entire set of discrete data located within the observation interval or window. Likewise, h(t_n) are denoted as being frequency independent. In some approaches, transforming a signal over its entire observation interval t₀ . . . t_N−1 into the frequency domain provides a static image of the time-ordered nature of information within the window. However, it does not yield transient information such as when energy information described by a pulse comes into existence, how long it persists, and when it finally dissipates and disappears.

At block 512, the temporal sequence of events in the time-frequency domain is established such that the signal can be sectioned into samples of identical (or similar) length using a series of overlapping windows. FIG. 9 illustrates an example of Method 500 distributing a digital signal ĥ(t_n) into: =0,1, . . . , L−1 for a total of L [windows]; with each window including m=0,1, . . . , M−1 for a total of

$M\left[\frac{\mathrm{samples}}{\mathrm{window}}\right];$ and, where Δm [samples] is the shift along the digital signal between adjacent overlapping windows. The current window spans an interval of time τ [time] and is used to observe, sample, and analyze the signal that has occurred immediately prior to the current time t_n. Moreover, as the signal continues to evolve into the future, beyond the current time t_n, it can then progressively be observed, sampled, and analyzed using additional windows at shifted intervals of Δm.

In some cases, at block 514, one full window of zeros can be placed prior to the digitally sampled signal. In yet another case, a signal is continuously updated from a measurement device, such as a microphone, which is then sampled and analyzed in real time. In the example of FIG. 10, for a pre-recorded signal, this window of zeros is denoted as window index =0. FIG. 10 exhibits an example idealized signal s(t) digitally sampled into h(t_n). At blocks 516 to 520, the signal is distributed into windows =0,1, . . . , L−1. At block 516, sections of the digital signal are mapped to the next window. At block 518, sections of the digital signal are mapped to subsequent windows. At block 520, the last window is zero padded. FIG. 10 presents the example signal of length N that is zero-padded by a window of length M on the front, producing a new signal of total length N=N−1+M. Zero-padding can be used to help quantify the creation, persistence, and dissipation of energy pulses within the time-frequency domain. The complete evolution of energy pulses can be captured in the time-frequency domain with initial conditions of zero energy. Thus, zero-padding introduces a datum of zero information energy for a period M·T at the start of the input audio signal sample.

Method 500 can be used to input digital signal information, an example of which is depicted in FIG. 10, through zero padding and windowing. To do so, absolute time and relative time should be distinguished. The absolute signal time t_n refers to the elapsed time from the origin of the digital signal, spanning the interval from the start t₀ to the end t_N−1 of the signal. Similarly, the zero-padded signal is shifted in time t_nrelative to t_n, and spans the interval from t₀ to t_N−1. Distributing the shifted and zero padded signal into observation windows introduces a relative time for each window and refers to the elapsed time from the origin of window and spans the interval to . Signal sample t_n is obtained at the current time, with prior samples occurring in the past, and samples ahead of t_n occurring in the future.

At block 512, the zero-padded signal is mapped into the zeroth window =0 by mapping a section of the input discrete signal ĥ(t_n) into h(t_m,0) for m=0, . . . , M−1 data points per window. The mapping process for window =0 is as follows:h(t_m,0)=h(t_n) for m=0,1, . . . , M−1 where n=m   Equation (11)

Given the zero-padding operation on the signal, the zeroth window is entirely comprised of zeros in Equation (11), this first window does not overlap in time with any data from the input signal because it ends before the first data point in ĥ(t₀). The zero padding within the zeroth window provides substantial and practical advantages. Other approaches generally position window =0 just as the signal begins to be observed and then measures at ĥ(t₀). In contrast, the digital spectrogram module 230 positions window =0 so that it covers the span of signal data ĥ(t_n) before any time-ordered information (energy pulse) has been synthesized in the time-frequency space; and consequently, can be transmitted, observed, and/or measured in the signal.

At block 514, the signal is mapped into the next window =1. Let the next window =1 be shifted by Δm sampling points along ĥ(t_n) relative to =0. An example of this mapping is illustrated in the example of FIG. 10 Given that the sampling interval T is the same for h() as it is for ĥ(t_n), this shift can be denoted as Δm subject to

$1\le \Delta \ll \mathrm{mM}\left[\frac{\mathrm{samples}}{\mathrm{window}}\right].$ The mapping for window =1 is as follows:h(t_m,1)=h(t_n) for m=0,1, . . . , M−1 where n=m   Equation (12)

Note that h(t₀≤t_n≤t_M−1)≡0 (zero padded) and the non-zero contribution of data to window =1 arises from h(t_M≤t_n≤t_M+Δm).

At blocks 516 and 518, subsequent window is mapped by designating intermediate windows where 2≤≤L−1, h() as window :h()=h(t_n) for m=0,1, . . . , M−1 where n=Δm·+m   Equation (13)

At block 520, the signal is mapped into the last window =L−1. The mapping for window L−1 is as follows:h(t_m,L−1)=h(h_n) for m=0,1, . . . , M−1 where n=Δm·(L−1)+m    Equation (14)

Hence, the last window is zero padded because it starts after the last data point ĥ(t_N−1) such that: h(t_m,L−)≡0. Zero padding the last window is particularly advantageous. Other approaches generally have the end of window L−1 just as the signal ends and is no longer observed and measured at h(t_N). In this embodiment, the last window is positioned so that it extends past the last point for which signal information h(t_N) was observed and measured. In so far as the signal information transmits energy from the pulse that was synthesized in the time-frequency space, that energy has now entirely dissipated.

Thus, the digital signal in absolute time ĥ(t_n) can be mapped into the shifted time h(t_n) and window time h() as:

Equation (15a)
mapping ĥ(tn) → h(  ):
h(  ) = ĥ(tn) for n = 0, ... , N − 1 where n = n + M
Equation (15b)
mapping h(   ) → h(   ):
for   = 0,1, ... , L − 1
if   = 0
h(   ) = 0 for m = 0,1, ... , M − 1 (zero padding)
else if 1 ≤   ≤ L − 2
h(   ) = h(  ) for m = 0,1, ... , M − 1
where n, = Δm ·   + m
else if   = L − 1
h(   ) = 0 for m = 0,1, ..., M − 1 (zero padding)
end if
end for

Note that T has the same meaning and magnitude in each of the relative and absolute time mapping.

At block 522, the digital spectrogram module 230 outputs the windows containing the digital signal data.

The shift between adjacent overlapping windows Δm [samples] along the digitally sampled signal can be further interpreted. In this case, a discrete shift along the temporal length of the signal is an attribute of its respective window, and the relative advancement of the window

$v\left[\frac{\mathrm{samples}}{\mathrm{window}}\right],$ can be denoted as:

$\begin{array}{cc}v=\frac{\Delta m}{\mathrm{\Delta \ell }}& \mathrm{Equation}\left(16\right)\end{array}$

The relative advancement of the window v constrains the number of windows =0,1, . . . , L−1 [windows] used to observe and analyze the sampled signal as:

$\begin{array}{cc}L=\frac{\stackrel{\_}{N}-M}{v}& \mathrm{Equation}\left(17\right)\end{array}$

The maximum number of windows occurs when Δm, and hence v increments by a single sample, resulting in L=N−M. The total number of windows decreases as M→N and as v→N−M.

The window velocity

$V\left[\frac{\mathrm{time}}{\mathrm{window}}\right]$ associated with each adjacent window position is defined as a function of window advancement

$v\left[\frac{\mathrm{samples}}{\mathrm{window}}\right]$ and the sampling interval

$T\left[\frac{\mathrm{time}}{\mathrm{sample}}\right]$ as:V=vT   Equation (18)

Defining window advancement v and window velocity V provides distinct utilitarian advantages. With reference to the example of FIG. 9, an incremental step of window index Δ [window] is taken along the digital signal; for instance, the increment step between window −1 and is Δ=−(−1)=1. This incremental shift between adjacent windows can be transformed into an increment in time Δt [time] as:Δt=Δ·v·T   Equation (19a)Δt=Δ·V   Equation (19b)Δt=Δm·T   Equation (19c)The window velocity V is a relativistic concept that represents the speed that the window travels in time relative to a previously observed and sampled section of a signal. Moreover, the window velocity controls the amount of new information in each adjacent window relative to its previous position, with the amount of new information given by Δm [samples].

As illustrated in FIG. 11, method 600, performed by the digital spectrogram module 230, uses the windowed digital signal to construct a digital spectrogram. Method 600 uses a numerical analysis technique and uses conservation of energy information between the windowed digital signal and the resulting digital spectrogram. This approach relies upon a discrete interpretation of the derivative

$\frac{d^2\epsilon }{\mathrm{dtd}\omega }\left[\mathrm{joules}/\left(\mathrm{time}·\mathrm{frequency}\right)\right]$ from Equation (4). Notably, the units of

$\frac{d^2\epsilon }{\mathrm{dtd}\omega }$ could alternatively be stated in terms of [joules], but the former representation is more intuitive when considering the distribution of information within the time-frequency domain of the spectrogram.

At block 602, the digital spectrogram module 230, receives input from block 522 and determines the discrete Fourier transform of each window, for example, to determine the sound energy within a window for each frequency. For window =0, . . . , L−1, the signal within each sequential window h() is transformed into the time-frequency domain as an expression of average energy over an increment of frequency Δω and window period which spans MT time,

$\frac{1}{\mathrm{MT}}\frac{\Delta E}{\mathrm{\Delta \omega }}\left(\ell ,{\omega }_k\right)$ as:

$\begin{array}{cc}\frac{1}{\mathrm{MT}}\frac{\Delta E}{\mathrm{\Delta \omega }}\left(\ell ,\frac{k}{MT}\right)=\frac{1}{M}{\sum }_{m=0}^{M-1}\stackrel{\_}{\stackrel{\_}{h}}\left(\mathrm{mT},\ell \right)e^{-2\mathrm{\pi 𝒾}\mathrm{mk}/M}\mathrm{for}k=0,1,\dots ,M-1& \mathrm{Equation}\left(20\right)\end{array}$ where:

${\omega }_k=\frac{k}{MT},$ t _m, =(mT, ), k is tne frequency index for the complex coefficients of the average energy within window and frequency ω_k as

$\frac{1}{\mathrm{MT}}\frac{\Delta E}{\mathrm{\Delta \omega }}\left(\ell ,{\omega }_k\right).$ Note that the

$\frac{1}{MT}$ in the expression of

$\frac{1}{\mathrm{MT}}\frac{\Delta E}{\Delta \omega }\left(\ell ,{\omega }_k\right)$ is retained to express

$\frac{\Delta E}{\Delta \omega }\left(\ell ,{\omega }_k\right)$ per unit “volume” of the sampling interval here measured in

$M\left[\frac{\mathrm{samples}}{\mathrm{window}}\right]$ spanning an interval of MT [time], where the

$\frac{1}{T}$ originates from Equation (2) and the

$\frac{1}{M}$ originates from Equation (20). Multiplication of

$\frac{1}{\mathrm{MT}}\frac{\Delta E}{\Delta \omega }\left(\ell ,{\omega }_k\right)$ by volume of the sampling interval MT [time] yields an average estimate of the derivative of energy with respect to frequency

$\frac{\Delta E}{\Delta \omega }\left(\ell ,{\omega }_k\right)$ that was observed and measured across window .

At each window, at block 604, the digital spectrogram module 230 creates a sequence of

$\frac{\Delta E}{\Delta \omega }$ values at frequency ω_k and window position . The resulting window-frequency image can be presented as a waterfall plot as shown on FIG. 12. Note that in FIG. 12, there is a condensed notation of

$\frac{\Delta E}{\mathrm{\Delta \omega }}\left(\ell ,{\omega }_k\right)\mathrm{to}\frac{\Delta E_{\ell ,k}}{\mathrm{\Delta \omega }}$ for window index at frequency index k in the time-frequency domain. Given the symmetry in the Fourier transform operation of the discrete data h() about the Nyquist frequency, values of

$\frac{\Delta E_{\ell ,k}}{\Delta \omega }$ are only shown in the range k=0,1, . . . ,

$\frac{M-1}{2}.$ Generally, such approaches do not provide guidance on the degree of overlap Δm between adjacent windows, as shown on FIG. 9. Moreover, historically, any amount of overlap between windows yields a waterfall plot that, when reversed back into the time domain, produces sharp phase discontinuities in the recreated signal. This is because information within each window is determined independently of any adjacent windows. The present embodiments address this substantial technical problem.

The temporal length of each window is τ=MT, where the number of measurements in a window M and sampling interval T are chosen to provide the desired resolution along the frequency axis ω_min≤ω≤_max, where

${\omega }_{\max }=\frac{1}{2T}\left[{\mathrm{time}}^{-1}\right]$ and ω_min=0 [time⁻¹]. The increment length of each bin along the frequency axis can be inferred to be

$\Delta \omega =\frac{{\omega }_{\max }-{\omega }_{\min }}{N_b}.$ The number of bins N_b along the frequency axis is equal to half the number of measurements in the window as

$N_b=\frac{1}{2}M\left[\frac{\mathrm{samples}}{\mathrm{window}}\right].$ Therefore, the following identity results:

$\begin{array}{cc}\Delta \omega =\frac{{\omega }_{\max }-{\omega }_{\min }}{N_b}\Rightarrow \Delta \omega =\left(\frac{1}{2T}\right)/\left(\frac{1}{2}M\right)\Rightarrow \Delta \omega =\frac{1}{TM}\left[tim{e}^{-1}\right]\Rightarrow \mathrm{\Delta \omega }·\tau =1& \mathrm{Equation}\left(21\right)\end{array}$

The above identity states that improvements in frequency resolution of the time-frequency domain require either: a commensurate decrease in the sampling interval Δt as given by Equation (1), and hence sampling interval T for a fixed M; or, by increasing the number of measurements within each window M for a given sampling interval T. As an example, for the standard sound file with 1 second long windows, each window has the following properties:

$T=\frac{1}{44,100}\left[\frac{\mathrm{seconds}}{\mathrm{sample}}\right],\tau =1\left[\mathrm{second}\right],$ and hence

$M=44,100\left[\frac{\mathrm{samples}}{\mathrm{window}}\right],$ and yields a maximum frequency of ω_max=22,050 Hz as reduced by the Nyquist frequency.

The discrete Fourier transform, as expressed by Equation (20), is used to extract the average energy at measurable frequencies ω_k from the finite length signal within window spanning the time interval τ. Additionally, the discrete Fourier transform is also used to sample the preceding window −1 of data. The utility of the discrete Fourier transform is that it can disaggregate the a priori unknown frequency distribution of the energy information that occurs within each window of h() into

$\frac{\Delta E_{\ell ,k}}{\Delta \omega }.$ However, further differentiation with respect to time is required to construct

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}$ as an approximation of

$\frac{d^2\varepsilon }{\mathrm{d\omega dt}}.$ denoted by Equation 19c. FIG. 13 depicts the manner in which the time derivative of

$\frac{\Delta E}{\Delta \omega \Delta t}$ is constructed. The derivative

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}$ at window and frequency k gains new information energy

$\frac{\Delta E_{\ell ,k}}{\Delta \omega }$ that appears at frequency index k within the leading edge of window spanned by h(≤≤). Similarly,

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}$ accounts for the loss of information energy within the trailing edge of window −1 spanned by h(₋₁≤₋₁≤). Energy within the time interval spanned by h(≤≤) within window , or alternatively h(≤≤) within window −1, is common to both

$\frac{\Delta E_{\ell ,k}}{\Delta \omega }\mathrm{and}\frac{\Delta E_{\ell -1,k}}{\Delta \omega }$ and hence cancels when generating

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}.$ This is expressed as:

$\begin{array}{cc}\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}=\left(\frac{\Delta E_{\ell ,k}}{\Delta \omega }-\frac{\Delta E_{\ell -1,k}}{\Delta \omega }\right)/\Delta \mathrm{mT}& \mathrm{Equation}\left(22\right)\end{array}$

FIG. 13 presents an example visualization of Equation (22). The front zero padding ensures an initial condition of zero such that the Fourier transform of window index =0 is zero:

$\frac{\Delta E_{0,k}}{\mathrm{\Delta \omega }}=0.$ Therefore, the first derivative position is implicitly defined as equal to the discrete Fourier transform of the first window, as:

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}\equiv \frac{1}{\Delta \mathrm{mT}}\frac{\Delta E_{1,k}}{\mathrm{\Delta \omega }}-0.$

In some cases,

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}$ from Equation (22) can be approximated by zero-padding all energy within the overlap time interval spanned by h(≤≤) within window and only retaining that information at the leading edge of window in the interval spanned by h(≤≤). Therefore, only the most recent Δm values of signal data within window are used to construct

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}.$ This process can be visualized on FIG. 10 where energy within the overlapping segment of window with window −1 is assumed to perfectly cancel during the difference operation of Equation (22), and energy within the trailing edge with window −1 is ignored. Because both windows are of length M samples, the discrete Fourier transform results in the same resolution of the frequency band ω_k of information as Equation (22). Advantageously, because this approximation

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ only focuses on the most recent Δm values of signal data, it provides a more succinct estimation of the creation, occurrence, or dissipation of information within the time-frequency domain and is the preferred operation for estimating

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}.$ Equation (23) denotes this approximation as:

$\begin{array}{cc}\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}\approx \frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}& \mathrm{Equation}\left(23\right)\end{array}$ Note that

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ is complex-valued, which is a manifestation of the phase offset resulting from the shifted origin of each window in time relative to the origin of the input signal t₀ in absolute time.

The finite difference determination from Equation (22) in the time-frequency domain relies on the change of energy within frequency specific bins as the sampling window advances. Equation (24) implies a scalar relationship when constructing the time derivative based on the shift between adjacent windows as Δt=·V=Δm·T:

$\begin{array}{cc}\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}=\frac{\Delta {\hat{E}}_{\ell ,k}}{\mathrm{\Delta \omega \Delta }m·T}=\frac{\Delta {\hat{E}}_{\ell ,k}}{\mathrm{\Delta \omega \Delta \ell }·V}& \mathrm{Equation}\left(24\right)\end{array}$ This relationship follows from Equations 19a, 19b and 19c and indicates that

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ is equally with respect to the amount of new information Δm as it is with respect to time Δt. The maximum theoretical fidelity of the finite difference Δt occurs at the minimum window velocity when v=1, which requires that the window velocity be equal to the sampling interval V=T. This is because the finite difference between each window increments by the smallest possible amount, providing as much information as possible for a given sampling rate T. However, practical application requires larger than the minimum window velocity for representative approximations of

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}.$ As the position velocity becomes large and approaches the window size

$V\to M,$ the amount of new information in each window is increased and the finite difference may have difficulty capturing subtle changes in the information energy. Generally, there is an increase in computational cost associated with an increase in the temporal-fidelity of the spectral analysis.

The result of estimating the discrete derivative for each sequential window of information describing the change in vibrational energy with respect to time

$\frac{\Delta E_{\ell ,k}}{\Delta \omega \Delta t}$ is herein referred to as a digital spectrogram.

The concepts of absolute time and relative time can be advantageously used to resolve digital spectrogram inversion problems, specifically relating to phase continuity issues. The difference between absolute and relative time can manifest itself as a phase offset and can be expressed through the complex valued coefficients of

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t},$ where values of

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ are derived from the discrete Fourier transform of each sampling window . Continuity in phase offset within the signal can be preserved by the consistent shifting of consecutive windows by Δm with zero padding on the front of the signal, as shown in the example of FIG. 10. Thereafter, continuity in phase offset is preserved in the time-frequency domain of the discrete spectrogram

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ via both the real and imaginary components of these complex coefficients.

As illustrated in FIG. 14, Method 700, performed by the digital spectrogram module 230, quantifies the process of phase shifting

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t},$ as outputted in method 600, to ensure phase continuity. Phase shifting represents a convolution integration and is implemented by multiplying the percentage shift

$\frac{{\lambda }_{\ell ,k}}{2\pi }$ required to assure a consistent origin point for all energy by

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ from method 600 in the digital spectrogram.

Ensuring phase shift continuity in the digital spectrogram

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ can be interpreted with the concept of relative versus absolute time. Frequency information within window of the digital signal h(mT,) is transformed into the digital spectrogram

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ using the discrete forward Fourier transform given by Equation (20). If one were to apply the discrete forward Fourier transform to the entire signal ĥ(nT), the starting position of the digital signal is given a phase shift of zero radians for all frequencies ω_k. Instead, the starting position of the signal ĥ(nT) is identified as the absolute time origin, t₀=0 [sec]. However, the process of windowing the entire signal causes the origin of each window to be shifted relative to the absolute time origin. During application of the discrete forward Fourier transform within each window, the starting position h(0, ) is given a phase shift of zero radians, for all frequencies ω_k and windows . Consequently, the energy information of each window requires a phase shift to be consistent with the absolute time origin. At block 702, the window information from block 522 is received and then the spectrogram module 230 determines the relative time shift [time] of window as:=−MT+ΔmT−t₀   Equation (25)where, t₀ is the origin in absolute time. At block 704, for frequency

${\omega }_k=\frac{k}{\mathrm{MT}},$ the digital spectrogram module 230 obtains the relative to absolute time phase shift ψ_,k [radians] for each frequency in each window as:=2π·(1−modulus(·ω_k))   Equation (26)

At block 706, the digital spectrogram module 230 obtains the second phase adjustment by computing the angle [radians] of the magnitude of

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ as:

$\begin{array}{cc}{\theta }_{\ell ,k}={\tan }^{-1}\frac{𝒥\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)}{❘ℛ\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)❘}& \mathrm{Equation}\left(27\right)\end{array}$ where

$𝒥\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)\mathrm{and}ℛ\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)$ denote the imaginary and real components of the complex valued

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}.$

At block 708, the digital signal module obtains the third phase adjustment using the odd property of the sine function to correct the polarity, such that the real-value spectrogram data

$ℛ\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)$ are positive only [radians], as:

$$\begin{gathered} \begin{array}{cc}\mathrm{if}ℛ\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)<0\mathrm{then}\text{ \\ ςℓ,k=π⁢ \\ ℛ(Δ⁢Eˆℓ,kΔ⁢ω⁢Δ⁢t)=❘"[LeftBracketingBar]"ℛ(Δ⁢Eˆℓ,kΔ⁢ω⁢Δ⁢t)❘"[RightBracketingBar]"⁢else⁢ςℓ,k=0⁢end⁢if}& \mathrm{Equation}\left(28\right)\end{array} \end{gathered}$$

At block 710, the digital spectrogram module 230 obtains the total phase adjustment [radians] as:=++  Equation (29)

The digital spectrogram module 230 then receives the time derivative of the digital spectrogram

$\frac{{\mathrm{\Delta E}}_{\ell ,k}}{\Delta \omega \Delta t}$ from block 606. Each discrete derivative value within the digital spectrogram is then phase shifted as:

$\begin{array}{cc}{F}_{\ell ,k}=ℛ\left(\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\right)·\mathrm{modulus}\left(\frac{{\lambda }_{\ell ,k}}{2\pi }\right)& \mathrm{Equation}\left(30\right)\end{array}$ where, is the real-valued energy expression resulting from phase shifting the spectral analysis of each window for each frequency k to be in phase with the absolute starting position of the signal. is our interpretation of a digital spectrogram that may be inverted back into a signal. The convolution operation in Equation (30) results in time-shifting of energy information within the spectrogram such that it is consistent with the original signal. Transformation of the digital complex-valued spectrogram into a real-valued spectrogram ensures uniqueness of the information represented by the energy pulse patterns in time and frequency.

At block 712, the digital spectrogram module 230 outputs the real valued and positive digital spectrogram .

In some cases,

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}$ from Equation (22) can be evaluated in slightly different progression of the same operations described above. Specifically, the origin phase shifting from Equation (26) could be applied directly to individual windows after the Fourier transform but prior to evaluating the derivative in Equation (22). This would ensure that the windows used to estimate the time derivative in block 606 would have a consistent origin point. Thereafter, proceed with blocks 706 to 712 of Method 700 by performing the phase shifts from Equations (27) and (28) to produce a digital spectrogram. This results in an alternative evaluation of .

As illustrated in FIG. 15, method 800, performed by the digital spectrogram module 230, removes background noise from an input digital spectrogram. Aggregating the energy information within overlapping windows allows for identifying, quantifying, and mitigating background/ambient noise from the digital signal prior to evaluating a function describing the noiseless analytical signal. Background noise is additive to the desired information expressed by in Equation (30). Background noise provides an energy input that is a function of frequency ω_k and may establish a noise threshold value Ψ_k to differentiate ambient noise from potentially important or relevant information, such as human speech. In some instances, the threshold value Ψ_k could be static, variable, or even dynamically assisted by an artificial agent to optimally identify the threshold for background noise. At block 802, the digital spectrogram module 230 receives input from block 712 and then establishes a background noise threshold value Ψ_k for the purpose of classifying values of the digital spectrogram that contain important information to be analyzed. At block 804, all values of with energy below the threshold value Ψ_k are classified as containing noise only and consequently are “filtered’ by being zeroed out when mapped to . At block 806, all values of with energy above the threshold are classified as containing both noise and important information and are mapped without modification to . The outcome of the application of the noise threshold value Ψ_k is to isolate those regions of the digital spectrogram that contain important information from those regions that do not, and consequently remove all energy that is considered unimportant.

The next step of in the process of removing background noise is to focus on those regions of the filtered digital spectrogram that contain an additive energy contribution from both noise and important information. At block 808, the digital spectrogram module 230 utilizes a moving average γ_k over those elements of the digital spectrogram that were previously classified as containing noise only, where these elements are adjacent to sections of the filtered digital spectrogram that are now targeted for noise removal. The moving average γ_k is used to establish the noise contribution to the overall energy expressed by the important information within . At block 810, the digital spectrogram module 230 may remove noise from the relevant information by subtracting γ_k from the spectrogram as:=max(−γ_k,0)   Equation (31)and resulting in the noise filtered digital spectrogram . In some instances, the moving average background noise energy γ_k may be larger than the collective energy within a frequency bin, where γ_k>, which indicates an overestimation of the background noise energy. The resulting negative value for this case in Equation (31) is given a zero value to ensure the spectrogram remains positive and real-valued. Notably, the moving average γ_k is a broad estimate of the background noise energy that may be more accurate for situations with consistent or relatively time-invariant sources of background noise. Other approaches may better resolve relevant information when less predictable sources of background noise are present. In another instance, a second microphone independently captures ambient noise, which provides a real-time estimate of γ_k for each frequency k. For instance, the second microphone may be located at a point distant from the individual speaking albeit in the same automobile cabin. Hence, the voice information is barely discernible from the background noise and the information captured by the second microphone is a suitable real-time representation of the ambient noise.

At block 812, the digital spectrogram module 230 outputs the noise filtered digital spectrogram.

As illustrated in FIG. 16, method 900, performed by the digital spectrogram module 230, converts a digital spectrogram into an analytical spectrogram. At block 902, the digital spectrogram module 230 receives input from either block 712 or block 812 and converts the real-valued and phase-shifted, and in some cases noise-filtered, digital spectrogram into the analytical spectrogram

$\frac{d^2\epsilon }{d\omega \mathrm{dt}}$ by employing a peak finding approach within the two-dimensional time-frequency domain of the indices and k to identify local maxima. In one instance, parametric probability density function pulse objects _j(t, ω) where j=0 . . . could be positioned with predefined characteristics at coordinates of each local maxima. This trial spectrogram representation would be an initial analytical guess to reproduce (approximate) its digital counterpart. In some instances, at block 904, the digital spectrogram module 230 could employ parameter optimization to create a set of best-fit two-dimensional parametric probability density function energy pulse objects _j(t, ω) over the entire time and frequency domain. The derivative

$\frac{d^2{\varepsilon }_{𝒥}}{d\omega dt}$ can be expressed as:

$\begin{array}{cc}\frac{d^2{\varepsilon }_{𝒥}}{d\omega dt}\equiv \sum _{j=0}^{𝒥}{𝒮}_j\left(t,\omega \right)& \mathrm{Equation}\left(32\right)\end{array}$ and represents a superposition of all energy pulses.

At block 906, the digital spectrogram module 230 outputs the set of parametric functions representing the analytical energy pulses that replicate the real-valued and positive digital spectrogram. Output is then directed to block 404 of the analytical spectrogram module for further processing into an analytical signal. The analytical signal is then sent to be received by the analytical signal module 250.

The process of digitally sampling a signal (as described in Method 300) provides an average representation of energy intercepted during transmission, as illustrated in Equation (2). For illustration, an analog signal can be thought of as an infinitely dense digitally sampled signal where

$\frac{1}{T}\to \infty \left[\frac{\mathrm{samples}}{\mathrm{time}}\right].$ Therefore, the analog signal is consistent with the present interpretation of an analytically derived signal. The relationship between the absolute time increment Δt, the sampling interval T, and the window length M, as implied from Equation (21), can be determined as Δt=Δm·T. Given a theoretical infinite density of samples, the sampling interval approaches zero

$T\to 0\left[\frac{\mathrm{time}}{\mathrm{sample}}\right]$ resulting in an infinitesimal time resolution as

$\Delta t\to dt.$ The sampling density

$\frac{1}{T}$ also controls the frequency resolution for spectral analysis: high sampling density provides high-frequency resolution. The identity from Equation (21),

$\Delta \omega =\frac{\frac{1}{T}}{M},$ implies that the frequency resolution becomes infinitesimal as

$M\to \infty \left[\frac{\mathrm{samples}}{\mathrm{window}}\right]\mathrm{and}\frac{1}{T}\to \infty \left[\frac{\mathrm{samples}}{\mathrm{time}}\right]$ with M approaching large numbers much faster than

$\frac{1}{T},$ resulting in

$\Delta \omega \to d\omega .$ It follows that each measure of energy information approaches infinitesimally small values with the time and frequency resolution:

$\Delta E\to d\varepsilon ,\mathrm{\Delta \omega }\to d\omega ,\mathrm{and}\Delta t\to dt.$ Therefore,

$\frac{\Delta {\hat{E}}_{\ell ,k}}{\Delta \omega \Delta t}\to \frac{d^2\varepsilon }{dtd\omega }.$

Analytical spectrogram to signal generation (as described in method 400) can have widespread application to binary digit or “bit” packaging for data transmission through wired and wireless connections. Radio signals are used to wirelessly transmit data between a source and a receiver, often requiring encoding and decoding to ensure secure and efficient transmission. In some instances, such as FM radio, analog receivers are still used to transform radio waves into its intended physical expression of sound by controlling a speaker system. However, many contemporary wireless telecommunications applications use software, such as Bluetooth™ and Zigbee™ peer-to-peer connections, that digitally decode a received signal to complete the data transfer.

Advantageously, the present embodiments can be used to increase the information density of signal transmission relative to other approaches of imparting square waves directly into the signal, where these square waves represent a serial sequence of bits that are used to encode and transmit information. The theoretical channel capacity for these types of approaches in a noiseless medium is expressed by the Shannon-Hartley theorem in a noiseless channel as C_B=2B log₂ L, where: C_B is channel capacity in [bits/sec], B is the bandwidth of the channel [Hz], and L relates to the signal level as L=2ⁿ with n being the number of discrete states of the signal amplitude. Consider an example where the channel bandwidth of the antenna is B=3.2 [kHz], L=2¹ signal levels for binary information (i.e., on/off) are transmitted. The period of the square waveform used to denote information bits is

$T=\frac{1}{2B}.$ The serial square-wave signal is transmitted as an electric current to an antenna and then converted to a radio signal to be received by a remote device. The received signal exhibits a theoretical maximum bitrate of C_B=2B=6,400 [bits/sec]. Thus, such approaches generally only allow a signal to transmit 2 bits of data per second across each 1 Hz frequency band for each signal level.

FIG. 17 illustrates an example flow diagram for an application of the present embodiments for synthesizing information for transmission through a signal. A bit packer encoding module 1002 receives the external information to be transmitted via input module 120. This information comprises the set of probability density functions representing the set of on/off bits to be transmitted. The bit packer encoding module 1002 then directs the information into the analytical spectrogram module 240 to subsequently synthesize the information for transmission as an analytical signal. This approach begins by querying a binary bit packaging codec, and then synthesizing bits of information within an analytical spectrogram that conform to the codec and represent information. Each bit is denoted by a two-dimensional Gaussian function representing an energy pulse within the time-frequency-space of the analytical spectrogram, with the pulse being given parameters representing the median position (m_t, m_ω), scale (σ_t, σ_ω) and amplitude (on equals “1” and off equals “0”) as specified by the codec. The codec then specifies how to group the set of bits into a data packet within an interval of time Δt and frequency bandwidth Δω=ω_max−ω_min of the analytical spectrogram. Then, Method 400, as described herein, is used to invert the analytical spectrogram into the synthesized signal s(t) through definite integration from [ω_min, ω_max] in the manner of Equation (6), resulting in the “packet signal”. The signal is sent to output device 170 for transmission as a signal via wired or wireless communication. A bit packer decoding module 1004 can be used to receive an analog signal, such as an analog signal transmitted by the output device 170. Method 300, as described herein, can be employed to sample the resulting packet signal to create a digital signal representation of the enclosed bit information. Then, Method 500, Method 600, and Method 700 can be employed to construct a digital spectrogram. The bit packer decoding module 1004 can be used to decode the digital spectrogram and extracts the information located within the same interval of time Δt and frequency bandwidth Δω=ω_max−ω_min of the digital spectrogram.

In an example, four randomly generated 32-bit packets of information are transmitted as a signal, over a channel bandwidth Δω=3,200 [Hz], from ω_min=2,000 [Hz] to ω_max=5,200 [Hz], with L=2¹ signal levels.

• • Unit Packet: [1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1 1]
    • Packet 1: [0 0 0 0 1 1 0 1 0 1 0 1 0 1 1 0 1 1 0 0 0 0 1 1 0 0 0 0 1 0 1 1]
    • Packet 2: [0 1 0 1 0 0 0 0 0 1 0 0 0 0 1 0 1 0 1 0 1 0 1 0 1 1 0 0 1 0 1 0]
    • Packet 3: [0 0 1 0 0 1 1 0 1 1 1 0 1 1 0 0 0 1 1 1 1 0 1 1 1 1 0 0 1 0 1 0]
    • Packet 4: [1 1 1 0 0 0 0 0 0 0 1 0 0 0 1 1 1 0 0 1 1 1 1 1 1 1 0 1 0 1 1 1]These data packets are first defined and constructed as energy pulses within the analytical spectrogram as shown in FIG. 18 with specific median and standard deviation values in both time and frequency. All pulse-bits within each packet are oriented vertically in frequency across the frequency band and are spaced consistently in time spanning and interval of Δt≈0.08 [sec]. Each individual bit synthesized within the analytical spectrogram is visually analogous to that shown on FIG. 7. FIG. 19 presents a section of the packet signal spanning Δt≈0.02 [sec] of the entire packet signal. FIG. 20 presents the resulting digital spectrogram constructed using

$T=\frac{1}{44\text{,}100}\left[\frac{\mathrm{seconds}}{\mathrm{sample}}\right],$ M=44,100 [samples/window] and Δm=128 [samples]. The digital spectrogram shown on FIG. 20 can by analyzed using the codec to decode the bit information received.

This example demonstrates a bit rate of C_B≈1,600 [bits/sec] which is approximately 0.25 of the theoretical maxima of the conventional serial methodology. This example serves to qualitatively display how bit information can be packaged and extracted from a signal; however, alternative arrangements of bits may be employed, and higher levels of data transfer can be achieved.

The signal and spectrogram analysis techniques outlined herein have widespread application to human speech analysis, recognition, and synthesis. As exemplified in the flow chart of the example of FIG. 21, the present embodiments can be used for speech recognition; for example, using a speech recognition module 2002 and a speech synthesis module 2004. This example could include: receiving an analog signal from a human speaker with a microphone as the input device 160 which is then directed by input interface 106 into input module 120 for further processing within the programmable modules 200; sampling the analog signal into a digital signal (in accordance with the Method 300); windowing the digital signal for spectral analysis (in accordance with the Method 500); evaluating the Fourier transform of each window and estimating a discrete time derivative (in accordance with the Method 600); performing phase adjustment of the discrete derivative (in accordance with the Method 700) to construct a digital spectrogram representation of the digital signal; identifying where energy pulses that span time and frequency may exist; and then employing a speech recognition module 2002 to recognize energy pulse patterns of phonetic sounds within the analytical spectrogram by comparison to a phonetic database. In some cases, this can be used to replicate the received analog signal in order to capture the characteristics of the speech segment by: converting the digital spectrogram to a trial analytical spectrogram (in accordance with the Method 900); employing the speech synthesis module 2004 to modify the location, scale, shape and amplitude of energy pulses within the trial analytical spectrogram for the purpose of intonation, phrasing or other desired expression; inverting the trial analytical spectrogram into a trial analytical signal (in accordance with the Method 400) that closely approximates the received analog signal; and, sampling the trial analytical signal into a digital signal (in accordance with the Method 300) for further analysis as part of an iterative control loop for the purpose of minimizing the difference between the synthesized trial analytical and input analog signals. The resulting analytical spectrogram representation of the human speech segment allows for synthesis of a signal with similar vocal characteristics to the human speaker.

For ease of exposition, demonstration of the noise filter (in accordance with the Method 800) is provided in the following use case example. The example begins, in accordance with the Method 300, with a digital microphone (input device 160) recording of a human speech segment of the word/phoneme “are” as shown on FIG. 22. The signal has a sampling rate of

$T=\frac{1}{44\text{,}100}\left[\frac{\mathrm{seconds}}{\mathrm{sample}}\right]$ and its amplitude is normalized between values of ±1. Method 500, Method 600, and Method 700 are sequentially performed to construct the digital spectrogram shown on FIG. 23 where M=44,100 [samples/window] and Δm=256 [samples]. The Method 900 is then utilized to evaluate the time and frequency location as well as the amplitude of the peak positions within the digital spectrogram by applying a form of persistent homology. FIG. 24 presents the peaks detected in the speech segment analysis which will be used to transform the digital spectrogram into a trial analytical spectrogram by synthesizing analytical energy pulses as parametric probability density functions at these local maxima. Once the trial analytical spectrogram is set with some initial standard deviation values (σ_t, σ_ω), the analysis can produce a digital signal that approximates the original recording. FIG. 25 presents the trial digital signal that results from the initial guess of the trial analytical spectrogram for the conditions that all energy pulses are assigned σ_t=0.2 [sec] and σ_ω=10 [Hz]. The trial digital signal obtained using the initial guess parameters is qualitatively like the input voice recording of the word “are” and substantially sounds like the original speaker. This implies that the location, scale, shape, and amplitude of the energy pulses are reasonably approximated without further parameter estimation. In some cases, the approach can further perform least squares analysis to optimally parameterize the location, scale, and shape of the energy pulses within the trial analytical spectrogram such that the difference between the trial digital signal and the input digital signal are minimized.

Advantageously, accurately reproducing human speech patterns using parametric functions provides the opportunity to adjust the patterns to effect various changes to the original signal. This approach allows for an advanced investigation into the characteristics of human speech and provides context for artificially generated human-sounding speech patterns.

The signal and spectrogram analysis techniques outlined herein have widespread application to ambient or background noise filtering of various signals including, but not limited to, human speech. Speech recognition can be used to identify background noise within an input signal, quantify the energy contribution of the background noise as being distinct from energy contribution of the relevant information, remove the background noise while retaining the relevant information, and generate an analytical signal that comprises the human speech element without the ambient noise contribution. The present embodiments have particular importance to speech recognition and spectrogram pattern analysis in noisy environments, such as a vehicle in operation.

A controlled noisy environment can be generated to approximate the ambient sounds within a moving vehicle. The English phoneme “are” is spoken while the car sounds are playing in the background and is recorded by a microphone and digitally sampled as outlined in the Method 300. FIG. 26 presents the digital signal of the spoken word combined with the background noise. The digital signal is then processed using Method 500, Method 600, and Method 700 to produce a digital spectrogram. FIG. 27 presents the digital spectrogram with: the background noise occurring from the start of the recording to t≈0.4 [sec]. The background noise combined with the spoken word between 0.4≤t≤0.85 [sec]; and, returning to only background noise until the end of the recoding.

Method 800 is employed to remove the background noise and isolate the energy signature of the spoken word using a noise threshold function Ψ_k. First, the interval of from the start of the recording to t≈0.4 [sec] was determined to contain only background car noise, as the summative energy in the associated time frames was below the threshold energy Ψ_k. Second, the rolling average γ_k of the ambient energy was determined by evaluating the spectrogram energy signature for a given frequency index k obtained over the succession of window indices within those time frames identified as having background noise. Therefore, γ_k was evaluated as a function of frequency ω_k. Third, the noise threshold function γ_k was subtracted from the digital spectrogram in all positions with energy contributions from both spoken word and ambient noise using Equation (31) and generating , with the result being depicted on FIG. 28. Then, the Method 900 was used to convert the digital spectrogram into an analytical spectrogram. In some instances, the pattern of information given by could be used by a machine learning algorithm for the purposes of voice recognition without being confounded by energy patterns representing background or ambient noise. Finally, the Method 400 was used to generate the analytical signal shown on FIG. 29 as well as other outputs such as a text transcription of recognized voice information.

Although the invention has been described with reference to certain specific embodiments, various modifications thereof will be apparent to those skilled in the art without departing from the spirit and scope of the invention as outlined in the claims appended hereto.

Claims

1. A method of generating an analytical signal for signal analysis, the method executable on one or more computer processors, the method comprising: receiving a time-dependent digital signal;sectioning the time-dependent digital signal into a series of overlapping windows in time domain;generating a plurality of energy pulses by evaluating a function that quantifies energy information within each window or set of windows; andgenerating a time-dependent analytical signal by: generating an oscillating signal by multiplying each of the plurality of energy pulses by an oscillating function; andintegrating the oscillating function across a band pass frequency filter.

2. The method of claim 1, wherein the analytical signal is defined by a set of parameters including time units, frequency units, origin, and range of energy pulse information to be included.

3. The method of claim 2, wherein the band pass frequency filter has a frequency range corresponding to the energy pulse information to be included.

4. The method of claim 1, wherein the time-dependent analytical signal is invertible to approximate the time-dependent digital signal.

5. The method of claim 4, wherein the time-dependent digital signal is generated by discretely sampling an input signal, the input signal being either an analog signal or the analytical signal, wherein the amplitude of each sample is the average energy information of the input signal over a predefined observation time interval.

6. The method of claim 1, wherein the function has as its peak a median position and monotonically tends to zero at a finite time and frequency interval from the median position.

7. The method of claim 6, wherein the function is one of: a parametric probability density function, a single or set of square functions, and a single or set of triangular functions.

8. The method of claim 1, wherein the oscillating function comprises a sine wave having a form of sin(2πω+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

9. The method of claim 1, wherein sectioning the time-dependent digital signal allows for identifying, quantifying, and mitigating background/ambient noise from the digital signal prior to evaluating the function.

10. The method of claim 1, further comprising: obtaining the analytical signal;sampling the analytical signal to convert the analytical signal into a generated digital signal;sectioning the generated digital signal into a series of overlapping windows;determining a discrete forward Fourier transform of the generated digital signal in each window; andarranging the Fourier transform of each window into a discrete time-frequency energy spectrogram.

11. A system for generating an analytical signal for signal analysis, the system comprising one or more processors and one or more computer storage media, the one or more computer storage media causing the one or more processors to execute a set of programmable modules configured to: receive a time-dependent digital signal;section the time-dependent digital signal into a series of overlapping windows in time domain;generating a plurality of energy pulses by evaluating a function that quantifies energy information within each window or set of windows; andgenerate a time-dependent analytical signal by: generating an oscillating signal by multiplying each of the plurality of energy pulses by an oscillating function; andintegrating the oscillating function across a band pass frequency filter.

12. The system of claim 11, wherein the analytical signal is defined by a set of parameters including time units, frequency units, origin and range of energy pulse information to be included.

13. The system of claim 12, wherein the band pass frequency filter has a frequency range corresponding to the energy pulse information to be included.

14. The system of claim 12, wherein sectioning the time-dependent digital signal identifies, quantifies, and mitigates background/ambient noise from the digital signal prior to evaluation of the function.

15. The system of claim 11, wherein the time-dependent analytical signal is invertible to approximate the time-dependent digital signal.

16. The system of claim 15, wherein the time-dependent digital signal is generated by discretely sampling an input signal, the input signal being either an analog signal or the analytical signal, wherein the amplitude of each sample is the average energy information of the input signal over a predefined observation time interval.

17. The system of claim 11, wherein the function has as its peak a median position and monotonically tends to zero at a finite time and frequency interval from the median position.

18. The system of claim 17, wherein the function is one of: a parametric probability density function, a single or set of square functions, and a single or set of triangular functions.

19. The system of claim 11, wherein the oscillating function comprises a sine wave having a form of sin(2πωt+λ), where λ is a phase shift variable relative to an absolute time origin, ω is a frequency variable, and t is a time variable.

20. The system of claim 11, wherein the programmable modules are further configured to: obtain the analytical signal;sample the analytical signal to convert the analytical signal into a generated digital signal;section the generated digital signal into a series of overlapping windows;determine a discrete forward Fourier transform of the generated digital signal in each window; andarrange the Fourier transform of each window into a discrete time-frequency energy spectrogram.