This disclosure relates to sensing, representation, visualization and display of characteristics of signals detected in selected frequency bands.
A vast amount of information and/or energy is traveling all around us at any given time whether in the form of radio waves, visible light, invisible light, audible acoustic waves, inaudible acoustic waves, microwaves, and other similar waves, but the vast majority of this information and/or energy is unseen and/or unheard to the average human. The effect of average humans not being able to visually detect such waves is often trivial, but in certain environments (e.g., combat, industry, space), such unseen information and/or energy can be hazardous and, in some cases, deadly.
What is needed, therefore, is a means by which to better detect waves that are typically undetectable to the average human, preferably bringing much more of the light and sound spectrums within reach of the human senses.
It would be useful in some environments to provide a visual representation of frequencies present in a selected portion of the radiofrequency, microwave, infrared, visible or ultraviolet spectrum, in order to estimate locations and intensities of sources that may be producing such frequencies—particularly those that are not readily apparent to the basic five human senses. It would also be useful to provide an indication of an intensity or strength of these frequencies, or an indication of whether the associated intensity or strength of particular frequencies is above a threshold that is of concern, and to provide an alert signal when the intensity or shape characteristics of this frequency overlay is changing by at least a threshold amount.
A frequency visualization apparatus for detecting and displaying one or more specific sets of energy waves based on one or more of defined discrete sets of frequency ranges is disclsoed, the apparatus comprising: a power source; a microprocessor connected to the power source, the microprocessor further comprising data storage for storing pre-defined energy threshold values for one or more specified frequency ranges; a first receiver connected to the microprocessor, the first receiver for receiving a first set of energy waves wherein the first receiver comprises a detector array comprising a plurality of detector elements; a light emitting matrix connected to the microprocessor, the light emitting matrix comprising a plurality of discrete light emitting picture elements, each picture element paired to a specific detector element wherein each individual picture element will only become energized if the particular detector element paired with that particular picture element has received a set of energy waves that meets one of the predefined energy threshold values; a collimator in optical alignment with the light emitting matrix for receiving light produced from the light emitting picture elements, and collimating such light from the light emitting picture elements; a mirror in optical alignment with the collimator, the mirror for directing light transferred from the collimator to a light beam combination apparatus; an optical assembly for receiving light waves within the visual electromagnetic spectrum; and the light beam combination apparatus in optical alignment with the mirror and the optical assembly wherein the light beam combination apparatus is configured to combine the discrete picture elements from the mirror with the light received from the optical assembly, thereby forming a combined image for viewing by a user.
The frequency visualization apparatus may further comprise an optical condenser in optical alignment with the light beam combination apparatus, the optical condenser for altering the combined image for better viewing by a user.
The one or more specified frequency ranges may further comprise corresponding wavelength ranges selected from the group consisting of from about 0.1 nm to about 10 nm; from about 10 nm to about 400 nm; from about 400 nm to about 700 nm; from about 1 μm to about 1000 μm; from about 1 mm to about 10 cm; and from about 50 cm to about 10 m.
In a related embodiment, a frequency visualization apparatus for detecting and displaying one or more specific sets of energy waves based on one or more of defined discrete sets of frequency ranges is disclosed, the apparatus comprising: a power source; a microprocessor connected to the power source, the microprocessor further comprising data storage for storing pre-defined energy threshold values for one or more specified frequency ranges; a first receiver connected to the microprocessor, the first receiver for receiving a first set of energy waves wherein the first receiver comprises a frequency detector array comprising a plurality of frequency detector elements wherein the microprocessor assigns each applicable individual frequency detector element an active status if the particular frequency detector element receives a set of energy waves that meets one of the predefined energy threshold values and wherein the microprocessor assigns each applicable individual frequency detector element a non-active status if the particular frequency detector element does not receive a set of energy waves that meets one of the predefined energy threshold values; a second receiver connected to the microprocessor, the second receiver comprising an optical assembly for receiving light waves, the optical assembly comprising an optical detector array subdivided into discrete picture elements; a display apparatus connected to the microprocessor, the display apparatus for displaying a combined image comprising the frequency detector elements assigned an active status superimposed with the discrete picture elements. The one or more specified frequency ranges may further comprise corresponding wavelength ranges selected from the group consisting of from about 0.1 nm to about 10 nm; from about 10 nm to about 400 nm; from about 400 nm to about 700 nm; from about 1 μm to about 1000 μm; from about 1 mm to about 10 cm; and from about 50 cm to about 10 m.
In many embodiments, the light intensity of each individual picture element varies depending on the intensity of the sets of energy waves received by each respective frequency detector element paired with an individual picture element, such varying intensity based on a graduated scale of pre-defined threshold energy values wherein received energy intensity is proportional to light intensity for each picture element.
In many embodiments, the light color of each individual picture element varies depending on the intensity of the sets of energy waves received by each respective frequency detector element paired with an individual picture element, such varying intensity based on a graduated scale of pre-defined threshold energy values wherein received energy intensity values are grouped as sub-ranges wherein each sub-range is assigned a specific color.
In many embodiments the shape of each individual picture element varies depending on the intensity of the sets of energy waves received by each respective frequency detector element paired with an individual picture element, such varying intensity based on a graduated scale of pre-defined threshold energy values wherein received energy intensity values are grouped as sub-ranges wherein each sub-range is assigned a specific shape.
A method of overlaying one or more specific sets of energy waves based on one or more of defined discrete sets of frequency ranges onto a captured visual image is disclosed, the method comprising the steps of: providing a power source; storing a criteria schedule on a microprocessor connected to the power source, the criteria schedule including qualitative and/or quantitative data for various energy waves and correlating such qualitative and/or quantitative data to a specific apparatus function; receiving a first set of energy waves using a first receiver wherein the first receiver comprises a detector array comprising a plurality of detector elements; providing a light emitting matrix connected to the microprocessor, the light emitting matrix comprising a plurality of discrete light emitting picture elements, each picture element paired to a specific detector element; energizing a particular picture element based on the criteria schedule in response to the one or more sets of energy waves detected by the detector element specifically paired thereto; positioning a collimator to be in optical alignment with energized light from the energized picture elements; collimating light received from the one or more energized picture elements; positioning a mirror to be in optical alignment the collimated light from the energized picture elements; redirecting light transferred from the collimator to a light beam combination apparatus using the mirror; receiving light waves within the visual electromagnetic spectrum through an optical assembly; and directing the received light waves received through the optical assembly to a light beam combination apparatus in optical alignment with the mirror and the optical assembly; and combining the energized picture elements from the mirror with the light received from the optical assembly using the light beam combination apparatus, thereby forming a combined image for viewing by a user.
In another embodiment, a method of overlaying one or more specific sets of energy waves based on one or more of defined discrete sets of frequency ranges onto a captured visual image is disclosed, the method comprising the steps of: providing a power source; storing a criteria schedule on a microprocessor connected to the power source, the criteria schedule including qualitative and/or quantitative data for various energy waves and correlating such qualitative and/or quantitative data to a specific apparatus function; receiving a first set of energy waves using a first receiver as a first data set, wherein the first receiver comprises a frequency detector array comprising a plurality of frequency detector elements, wherein the frequency detector array is in communication with the microprocessor; storing the received first set of energy waves as a first data set; receiving a second set of energy waves using an optical assembly including an optical detector array, wherein the optical detector array comprises a plurality of optical detector elements and wherein the optical detector array is in communication with the microprocessor; storing the received second set of energy waves as a second data set; assigning each applicable individual frequency detector element an active status if the particular frequency detector element receives a set of energy waves that meets a predefined threshold value in the criteria schedule and assigning each applicable individual frequency detector element a non-active status if the particular frequency detector element does not receive a set of energy waves that meets a predefined threshold value in the criteria schedule; modifying the first data set based on assignment of active or non-active status of each particular frequency detector element, wherein frequency detector elements assigned a non-active status are further assigned a do not display command, thereby generating a modified first data set wherein only the frequency detector elements assigned an active status are to be displayed; sending the modified first data set and the second data set to a display apparatus to be visually displayed;
pairing data from the modified first data set associated with each discrete frequency detector element with data from the second data set associated with corresponding discrete optical detector elements, wherein the paired detector elements substantially overlap when visually displayed; and displaying an image corresponding to the modified first data set superimposed over the second data set. The qualitative and/or quantitative data included in the criteria schedule may comprise predefined frequency intervals. An additional step includes selecting a predefined frequency interval within which the first set of energy waves are temporarily defined.
Further features, aspects, and advantages of the present disclosure will become better understood by reference to the following detailed description, appended claims, and accompanying figures, wherein elements are not to scale so as to more clearly show the details, wherein like reference numbers indicate like elements throughout the several views, and wherein:
Various terms used herein are intended to have particular meanings. Some of these terms are defined below for the purpose of clarity. The definitions given below are meant to cover all forms of the words being defined (e.g., singular, plural, present tense, past tense). If the definition of any term below diverges from the commonly understood and/or dictionary definition of such term, the definitions below control.
The phrase “connected to” can be interpreted as “in communication with”, but the use of this phrase “connected to” does not necessitate the same meaning as the phrase “in communication with”.
The phrase “in communication with” means that two items are in communication with one another either directly (e.g., by wire”) or indirectly (e.g., by wireless communication).
A system for recognizing the presence of frequencies in a selected portion of the electromagnetic spectrum and for presenting electronic and/or visual signals that represent these frequencies is disclosed. A visual image is split into at least a first frequency dependent image component and a second frequency dependent image component, with the first component including only frequencies in a selected frequency-limited detection interval (FDI), for example, a portion of the radio frequency, microwave, mid-infrared, near-infrared, visible and/or ultraviolet spectrum; and the second component including an image as perceived by a human eye or similar image formation system.
In one embodiment, the first image component is formed by passing the image through a first array of M1 FDI detectors to produce an array of “flixels”, then through a second array of, for example, M2 LEDs, with each LED being coupled to, at most, one of the FDI detectors in the first array. As referred to herein, a “flixel” corresponds to a small segment of an image (analogous to a pixel), but the information associated with the flixel is limited to a selected frequency-limited detection interval (FDI). By contrast, a pixel on a computer monitor or television screen may include information associated with visible, near-infrared and near-ultraviolet wavelengths and is not necessarily limited to a specified wavelength or frequency interval. The system, or the user, may vary the choice of FDI over a discrete set of FDIs, partly overlapping or wholly distinct from each other (e.g., microwaves, radio waves, ultraviolet waves).
The second (LED) array for the first image component produces a set of visual image components, each representing a small portion of the original image. Each small portion of the image, as represented by the second array, is transparent (or, alternatively, opaque) unless that small portion of the image has at least one FDI frequency with an associated signal intensity or strength that is at least a selected threshold intensity value. If a frequency in the FDI (referred to for convenience herein as an “FDI frequency”) for a pixel in the first image component has an associated signal intensity or signal strength at least equal to a selected threshold intensity value, that image pixel will have a non-transparent (or non-opaque) image component representing the above-threshold FDI frequency present.
An output signal from the second array of LEDs for the first image component will thus be transparent (or opaque), except for individual LED flixels where at least one FDI frequency is present with an associated signal intensity or strength at least equal to the threshold intensity value. This output signal from the array of LEDs is re-aligned and combined, flixel-by-flixel, with corresponding pixels of the second image component and is presented as a combined image in a visually perceptible format, or an electronic format corresponding to this combined image.
In another embodiment, the second image component is divided into pixels of the original image, corresponding to flixels in the array of FDI detectors, and is processed as a standard visual image. The original image is again divided into a first image component and a second image component, and the first image component is divided into pixels of the original image corresponding to the flixels of the first image component, and each pixel signal is passed through an optical detector array (e.g., visible or near-infrared or near-ultraviolet) to produce a standard visual image, with flixel-by-corresponding-flixel alignment of the first and second image components. The first image component flixels and the aligned second image component pixels are combined in a microprocessor, and the combined images are displayed directly on a display screen in a visual format.
In yet another embodiment, a directional antenna having a narrow angular sector (e.g., 10°-30° and an adjustable (narrow) view video camera are mounted on first and second turntables that are rotationally coordinated so that the antenna “view” and the video camera view substantially the same narrowly defined portion of a selected scene, producing first and second image components, respectively. An antenna output signal is received by a frequency-limited detector (e.g., a flixel or group of related flixels) with a narrowly defined FDI (e.g., having a frequency resolution of Δf≈330 KHz). Spectral analysis is performed by a computer on an output signal from the frequency detector for each of a sequence of frequency resolution windows that cover the total frequency interval width of interest, such as, for example, 1 MHz or 5 MHz or 20 MHz width. Optionally, the computer includes a visual display for an associated signal intensity for each FDI. Spectrum-analyzed computer output signals are carried on a data transmission medium (e.g., an S-video channel) and received and processed by a composite converter module to produce a first component of a composite video signal. The video camera produces a second component of the composite video signal, and the first and second components are received and processed by a video signal mixer to produce a visually perceptible composite video signal, including a visually perceptible image component (video camera) of the scene and a frequency-limited overlay component as an image overlay.
In each embodiment, the visual intensity of the frequency-limited overlay component can be weighted according to the relative intensities of the FDI components, or according to any other suitable weighting allocation. The frequency-limited overlay components can be presented as time-sequenced image overlays, or can be presented in one or more groupings of FDIs.
Presence (or absence) of one or more frequencies in the selected FDI is sensed at each of the M1 regions in the visual image signal received by the FDI feed horn 22. The signal produced at each location L(m1) (m1=1, . . . , M1) by a corresponding frequency detector is processed by a programmed microprocessor 24, and the processed signals produce a second array 25 of output signals at M2 LEDs 25(a,b), numbered m2=1, . . . M2 (M2≈M1), with the signal produced at frequency detector number m1 corresponding to and being received at LED number m2=m1 to produce an LED output signal number m2=m1. The sequence of LED output signals is collimated and aligned by a collimator 26 and reflected by a mirror 27 to produce an array of FDI signals, with the same FDI.
The VI signal is also received by a video camera or other image formation mechanism 28 that produces a visually perceptible field of pixel values, with each pixel corresponding to a flixel in the FDI array, and the pixel signal(s) is combined with the FDI signal from the mirror 27 in a beamsplitter and combiner 29A. The combined beams (FDI plus original visual image) are optically processed by a condenser 29B and are presented at a viewing mechanism 30, which may be a display screen or other suitable electronic instrument.
In another embodiment, shown in
The detector-processed signal in
The visual image signal VI, or a parallax-correlated replica of the VI signal is also received by a video camera 51 with an adjustable (narrow) field of view. Preferably, the directional antenna 42 and the video camera 51 are mounted on one or more turntables, 52A and 52B (illustrated in
The display on the display mechanism 54 presents the visually perceptible VI signal, plus a visually distinguishable and partly transparent overlay, illustrated in
Alternatively, relative intensities of the different FDI frequency segments can be displayed graphically as a histogram on the visually perceptible image, as illustrated in
A second composite video output signal from the video mixer 53 is optionally received by a computer module 55 (e.g., Linux-based), which is programmed to detect motion of, or change in, one or more FDI segment overlays, by comparison of a frequency selector output signal intensity at two or more distinct times. The motion detector computer module 55 can be programmed to provide an audibly perceptible or visually perceptible alert or alarm signal whenever the change or difference in two or more of the fixed frequency segments, relative to each other, with passage of time is at least a selected threshold difference level.
As noted in the preceding disclosure, the visual intensity of each frequency-limited overlay component can be weighted according to the relative intensities of the FDI components, or according to any other suitable weighting allocation. For example, where relative intensity of one or more of the FDI components is changing, as sensed by a change detector module (e.g., 55 in
The displayed or visual intensity of each frequency-limited overlay component can also vary monotonically with the relative intensities of the FDI components so that, for example, a larger FDI relative intensity will produce a more intense visual display of the FDI component.
The frequency interval, 2405≦f (KHz)≦2405+Q330, illustrated in
The frequency visualization system may be adapted to a portable form factor such that the frequency visualization system may be mounted to a vehicle or carried as a lightweight portable device, such as the device illustrated in
Referring to
The portable frequency visualizer 60 further includes a storage component 72 such as a hard drive or solid state storage device and a connection terminal 74 such as, for example, a USB port for communicating with external devices such as a personal computer or other accessories as shown in
Referring now to
The foregoing description of preferred embodiments of the present disclosure has been presented for purposes of illustration and description. The described preferred embodiments are not intended to be exhaustive or to limit the scope of the disclosure to the precise form(s) disclosed. Obvious modifications or variations are possible in light of the above teachings. The embodiments are chosen and described in an effort to provide the best illustrations of the principles of the disclosure and its practical application, and to thereby enable one of ordinary skill in the art to utilize the concepts revealed in the disclosure in various embodiments and with various modifications as are suited to the particular use contemplated. All such modifications and variations are within the scope of the disclosure as determined by the appended claims when interpreted in accordance with the breadth to which they are fairly, legally, and equitably entitled.
Number | Name | Date | Kind |
---|---|---|---|
20120188623 | Inoue | Jul 2012 | A1 |
Number | Date | Country | |
---|---|---|---|
20140374569 A1 | Dec 2014 | US |