This application claims priority to Chinese Patent Application No. 202110670824.X, filed on Jun. 15, 2021, the contents of which are hereby incorporated by reference.
The application belongs to the field of photoelectric imaging, and in particular relates to an omnidirectional ghost imaging method based on the mechanism of bio-inspired retina-like.
A ghost imaging is a new imaging method, which uses a bucket detector to collect the light intensity fluctuation reflected or transmitted after the modulated light source illuminates the target, and then carries out correlation calculation with the modulated light source to reconstruct the target image. Compared with conventional imaging methods, the ghost imaging has the advantages of a simple structure, a strong anti-interference ability, an imaging resolution exceeding diffraction limit, and being able to image in different wave bands and high detection sensitivity. It can be used to solve the problems and challenges encountered by conventional imaging technologies, and has been extensively applied in a three-dimensional imaging, a microscopic imaging, a multispectral imaging, a remote sensing and other fields.
In practical application, an imaging technology has three important requirements: a high resolution, a large field of view and a real-time feature. At present, most of the research on ghost imaging focus on the improvement of an imaging quality and an imaging speed, so as to help to solve the problems and cope with challenges encountered by a conventional high-resolution imaging and real-time imaging. However, there are few research achievements on the ghost imaging with a large field of view, and as far as it is known, there is no research on a panoramic ghost imaging. However, there are many problems and challenges in the existing conventional panoramic imaging technology, such as the high cost of imaging in the non-visible light band, and the difficulty of imaging in some harsh imaging environments, such as an atmospheric turbulence and a scattering media, etc. With the help of the imaging advantages of the ghost imaging, such as a strong anti-interference ability and an ability of imaging in different wave bands, these problems can be solved. Therefore, it is urgent to propose a new panoramic imaging method by using the advantages of ghost imaging.
In order to solve the problems and cope with challenges existing in the conventional panoramic imaging technology, the technical problems to be solved by the method and the system of panoramic ghost imaging based on the mechanism of bio-inspired retina-like disclosed by the application are: realizing 360-degree panoramic ghost imaging based on ghost imaging mechanism combined with catadioptric panoramic imaging method, and realizing undistorted high-quality panoramic ghost imaging based on logarithmic polar mapping mechanism of bio-inspired retina-like.
The objective of the application is achieved by the following technical scheme:
an omnidirectional ghost imaging method based on the mechanism of bio-inspired retina-like proposed by the application utilizes the logarithmic polar mapping characteristic of the bio-inspired retina-like structure to generate an annular pattern sequence of the bio-inspired retina-like, and utilizes the pattern sequence to modulate a light source and the modulated light illuminates curved minor. After being reflected by the target around the curved minor, the light is projected onto the curved minor and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half minor and half lens, and the reflected light intensity with target information is received by the bucket detector. The reflected light intensity measurement value with target information is correlated with the annular pattern sequence of bio-inspired retina-like used for modulating the light source, and a 360-degree omnidirectional image is reconstructed, that is, realizing 360-degree omnidirectional ghost imaging. According to the mapping characteristics of logarithmic polar coordinates of bio-inspired retina-like, the reconstructed image is transformed into logarithmic polar coordinates, the image after logarithmic polar coordinates transformation is 360-degree tiled image and the tiled and undistorted high-quality panoramic ghost imaging is obtained.
The application discloses an omnidirectional ghost imaging method based on the mechanism of bio-inspired retina-like, which comprises the following steps:
S1: generating an annular pattern sequence of bio-inspired retina-like by utilizing the logarithmic polar coordinate mapping characteristics of bio-inspired retina-like structure.
S1.1: initializing the parameters used for generating the annular pattern of bio-inspired retina-like.
The annular pattern of bio-inspired retina-like includes the blind area of the central fovea and the imaging area, so area within the radius r0 of the outer ring of the blind area of the central fovea is defined as a blind area, and the area outside the radius r0 is defined as an imaging area. According to the difference of polar diameter and polar angle, the imaging area is divided into P rings, each ring has Q pixels, and E denotes the inter-ring growth coefficient.
S1.2: constructing an annular pattern model of bio-inspired retina-like, and generating an annular pattern sequence of bio-inspired retina-like.
According to the parameters set in S1.1, a model of the annular pattern of bio-inspired retina-like is obtained as follows:
in which p and q represent the p-th ring and the q-th pixel respectively, rp represents the radius of the p-th ring of pattern, and θq is the angle corresponding to the q-th pixel.
Each pixel grid is filled with a pattern for modulating the light source, so as to generate the annular pattern sequence of bio-inspired retina-like.
S2: utilizing the annular pattern sequence of bio-inspired retina-like to modulate a light source and the modulated light illuminates curved mirror. After being reflected by the target around the curved mirror, the light is projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by the bucket detector. The reflected light intensity measurement value with target information is correlated with the annular pattern sequence of bio-inspired retina-like used to modulate the light source, and the 360-degree omnidirectional image is reconstructed, that is, 360-degree omnidirectional ghost imaging.
S2.1: modulating the light source by utilizing the annular pattern sequence of bio-inspired retina-like, and making the modulated light illuminate the curved mirror so as to completely cover the entire imaging field of view. The light is reflected by the target around the curved mirror, then projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by a bucket detector.
S2.2: correlating the reflected light intensity measurement value with target information with the annular pattern sequence of bio-inspired retina-like for modulating the light source, and reconstructing the 360-degree omnidirectional image, namely, 360-degree omnidirectional ghost imaging.
The image resolution is set to M×N, and M×N pieces of annular pattern sequences bio-inspired retina-like is projected. The measured values detected by the detector are y={y1, y2 . . . yM×N}, and the reconstructed 360-degree omnidirectional image is o(x,y) as follows:
in which, ki represents the projected i-th pattern, and yi represents the measured light intensity obtained by projecting the i-th pattern.
The reflected light intensity measurement value with target information and the annular pattern sequence of the bio-inspired retina-like used for modulating the light source are correlated and calculated according to the reconstruction algorithm shown in formula (2), so that the 360-degree omnidirectional image is reconstructed, that is, 360-degree omnidirectional ghost imaging.
S3: according to the mapping characteristics of logarithmic polar coordinates of bio-inspired retina-like, transforming the reconstructed image into logarithmic polar coordinates and obtaining 360-degree tiled image after the reconstructed image is transformed into logarithmic polar coordinates, thus obtaining the tiled and undistorted high-quality panoramic ghost imaging. Step S3 comprises the following steps:
converting the 360-degree omnidirectional image reconstructed in S2 from Cartesian coordinates to polar coordinates;
where the coordinate of a certain point in Cartesian coordinates is defined as (x,y), denotated as (r,α) in polar coordinates, which is calculated out by Cartesian coordinates as follows:
where r and α are the polar diameter and polar angle of polar coordinate; and
transforming the reconstructed image into logarithmic polar coordinates and obtaining 360-degree tiled image after the reconstructed image is transformed into logarithmic polar coordinates, thus obtaining the tiled and undistorted high-quality panoramic ghost imaging.
The logarithmic polar coordinate described in S3.2 essentially takes logarithm of the polar diameter r, that is
where p and θ are the median radius and angle of logarithmic polar coordinates, and the base is the inter-ring growth coefficient ε.
The application also discloses an omnidirectional ghost imaging system based on the mechanism of bio-inspired retina-like, which is intended for realizing the omnidirectional ghost imaging system based on the mechanism of bio-inspired retina-like. The system comprises a projection system, a collimating lens, a spectroscope, a curved mirror, a bucket detector, a data acquisition card and an arithmetic system.
The projection system, the collimating lens, the spectroscope and the curved mirror are located on the same optical path in sequence, and the light source of the projection system is modulated by the annular pattern sequence of bio-inspired retina-like, collimated by the collimating lens, and then projected onto the curved mirror through the spectroscope; the light intensity reflected from the mirror is reflected by the spectroscope, received by the bucket detector, and stored in the data acquisition card to collect the total light intensity information of the whole omnidirectional target. The arithmetic system is used to reconstruct the 360-degree omnidirectional image and perform data operation and processing of logarithmic polar coordinate transformation on the 360-degree omnidirectional image.
The application also discloses a working method of an omnidirectional ghost imaging system based on the mechanism of bio-inspired retina-like, which comprises the following steps:
the required annular pattern sequence of bio-inspired retina-like according to S1 is input into the projection system, and the light source of the projection system is modulated. The modulated light source is collimated by the collimating lens, and then projected onto the curved mirror by the spectroscope. The light intensity reflected from the omnidirectional image projected on the surface of the mirror is reflected by the spectroscope, and received by the bucket detector, and the data acquisition card stores the data. After repeated measurements, correlation calculation is performed according to the reconstruction algorithm of S2, and a 360-degree omnidirectional image is reconstructed. According to S3, the 360-degree omnidirectional image is converted into logarithmic polar coordinates, and the image is tiled and unfolded, thus obtaining the undistorted 360-degree omnidirectional ghost imaging target.
Beneficial Effects:
1. The application discloses an omnidirectional ghost imaging method and system based on the mechanism of bio-inspired retina-like. Based on the mechanism of ghost imaging, combined with catadioptric panoramic imaging method, 360-degree ghost imaging can be realised. Only one curved mirror is needed to expand the imaging field of ghost imaging, without rotating and splicing, so structure is simple. It can realize ghost imaging with large field of view, high quality and high speed at the same time, thus meeting the imaging requirements of more fields and expanding the application field of ghost imaging.
2. The application discloses an omnidirectional ghost imaging method and system based on the mechanism of bio-inspired retina-like. Based on the logarithmic polar mapping mechanism of bio-inspired retina-like, the annular 360-degree reconstructed image is tiled flat without distortion, so as to realize high-quality panoramic ghost imaging without distortion, improve the quality of panoramic imaging and expand the application of panoramic imaging in various fields.
In order to better explain the objectives and advantages of the present application, the content of the application will be further explained below with reference to the drawings and embodiments.
As shown in
S1: generating an annular pattern sequence of bio-inspired retina-like by utilizing the logarithmic polar coordinate mapping characteristics of bio-inspired retina-like structure.
S1.1: initializing the parameters used for generating the annular pattern of bio-inspired retina-like.
The annular pattern of bio-inspired retina-like includes the blind area of the central fovea and the imaging area, so area within the radius r0 of the outer ring of the blind area of the central fovea is defined as a blind area, and the area outside the radius r0 is defined as an imaging area. According to the difference of polar diameter and polar angle, the imaging area is divided into P rings, each ring has Q pixels, and E denotes the inter-ring growth coefficient.
S1.2: constructing an annular pattern model of bio-inspired retina-like, and generating an annular pattern sequence of bio-inspired retina-like.
According to the parameters set in S1.1, a model of the annular pattern of bio-inspired retina-like is obtained as follows:
in which p and q represent the p-th ring and the q-th pixel respectively, rp represents the radius of the p-th ring of pattern, and θq is the angle corresponding to the q-th pixel.
Each pixel grid is filled with a pattern for modulating the light source, so as to generate the annular pattern sequence of bio-inspired retina-like.
S2: utilizing the annular pattern sequence of bio-inspired retina-like to modulate a light source and the modulated light illuminates curved mirror. After being reflected by the target around the curved mirror, the light is projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by the bucket detector. The reflected light intensity measurement value with target information is correlated with the annular pattern sequence of bio-inspired retina-like used to modulate the light source, and the 360-degree omnidirectional image is reconstructed, that is, 360-degree omnidirectional ghost imaging.
S2.1: modulating the light source by utilizing the annular pattern sequence of bio-inspired retina-like, and making the modulated light illuminate the curved mirror so as to completely cover the entire imaging field of view. The light is reflected by the target around the curved mirror, then projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by a bucket detector.
S2.2: correlating the reflected light intensity measurement value with target information with the annular pattern sequence of bio-inspired retina-like for modulating the light source, and reconstructing the 360-degree omnidirectional image, namely, 360-degree omnidirectional ghost imaging.
The image resolution is set to M×N, and M×N pieces of annular pattern sequences bio-inspired retina-like is projected. The measured values detected by the detector are y={y1, y2 . . . yM×N}, and the reconstructed 360-degree omnidirectional image is o(x,y) as follows:
in which, ki represents the projected i-th pattern, and yi represents the measured light intensity obtained by projecting the i-th pattern.
The reflected light intensity measurement value with target information and the annular pattern sequence of the bio-inspired retina-like used for modulating the light source are correlated and calculated according to the reconstruction algorithm shown in formula (2), so that the 360-degree omnidirectional image is reconstructed, that is, 360-degree omnidirectional ghost imaging.
S3: according to the mapping characteristics of logarithmic polar coordinates of bio-inspired retina-like, transforming the reconstructed image into logarithmic polar coordinates and obtaining 360-degree tiled image after the reconstructed image is transformed into logarithmic polar coordinates, thus obtaining the tiled and undistorted high-quality panoramic ghost imaging. Step S3 comprises the following steps:
converting the 360-degree omnidirectional image reconstructed in S2 from Cartesian coordinates to polar coordinates;
where the coordinate of a certain point in Cartesian coordinates is defined as (x,y), denotated as (r,α) in polar coordinates, which is calculated out by Cartesian coordinates as follows:
where r and α are the polar diameter and polar angle of polar coordinate; and
transforming the reconstructed image into logarithmic polar coordinates and obtaining 360-degree tiled image after the reconstructed image is transformed into logarithmic polar coordinates, thus obtaining the tiled and undistorted high-quality panoramic ghost imaging.
The logarithmic polar coordinate described in S3.2 essentially takes logarithm of the polar diameter r, that is
where ρ and θ are the median radius and angle of logarithmic polar coordinates, and the base is the inter-ring growth coefficient E.
As shown in
S1: generating an annular pattern sequence of bio-inspired retina-like by utilizing the logarithmic polar coordinate mapping characteristics of bio-inspired retina-like structure.
S1.1: initializing the parameters used for generating the annular pattern of bio-inspired retina-like.
According to the structure of the annular pattern of bio-inspired retina-like as shown in (b) of
S1.2: constructing an annular pattern model of bio-inspired retina-like, and generating an annular pattern sequence of bio-inspired retina-like.
According to the parameters set in S1.1, the annular pattern model of bio-inspired retina-like is obtained as follows:
in which p and q represent the p-th ring and the q-th pixel respectively, rp represents the radius of the p-th ring of pattern, θq is the angle corresponding to the q-th pixel, and ξp is the length corresponding to the radius of the p-th ring in logarithmic polar coordinate system.
Each pixel grid is filled with a pattern for modulating the light source as shown in (a) of
S2: utilizing the annular pattern sequence of bio-inspired retina-like to modulate a light source and the modulated light illuminates curved mirror. After being reflected by the target around the curved mirror, the light is projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by the bucket detector. The reflected light intensity measurement value with target information is correlated with the annular pattern sequence of bio-inspired retina-like used to modulate the light source, and the 360-degree omnidirectional image is reconstructed, that is, 360-degree omnidirectional ghost imaging.
S2.1: modulating the light source by utilizing the annular pattern sequence of bio-inspired retina-like, and making the modulated light illuminate the curved mirror so as to completely cover the entire imaging field of view. The light is reflected by the target around the curved mirror, then projected onto the curved mirror and diffusely reflected. According to the reversible characteristics of the optical path, the light after diffuse reflection is reflected to the original light source by the half mirror and half lens, and the reflected light intensity with target information is received by the bucket detector.
S2.2: correlating the reflected light intensity measurement value with target information with the annular pattern sequence of bio-inspired retina-like used for modulating the light source, and reconstructing a 360-degree omnidirectional image, that is, realizing 360-degree omnidirectional ghost imaging.
The image resolution is set to 256×256, and 256×256 pieces of annular pattern sequences bio-inspired retina-like is projected. The measured values detected by the detector are y={y1, y2 . . . y256×256}, and the reconstructed 360-degree omnidirectional image is o(x,y) as follows:
in which, ki represents the projected i-th pattern, and yi represents the measured light intensity obtained by projecting the i-th pattern.
The reflected light intensity measurement value with target information and the annular pattern sequence of the bio-inspired retina-like used for modulating the light source are correlated and calculated according to the reconstruction algorithm shown in formula (2), so that the 360-degree omnidirectional image as shown in
S3: according to the mapping characteristics of logarithmic polar coordinates of bio-inspired retina-like, in combination with the pattern shown in (c) of
converting the 360-degree omnidirectional image reconstructed in S2 from Cartesian coordinates to polar coordinates;
where the coordinate of a certain point in Cartesian coordinates is defined as (x,y), denotated as (r,α) in polar coordinates, which is calculated out by Cartesian coordinates as follows:
where r and a are the polar diameter and polar angle of polar coordinate; and
transforming the reconstructed image into logarithmic polar coordinates and obtaining 360-degree tiled image after the reconstructed image is transformed into logarithmic polar coordinates, thus obtaining the tiled and undistorted high-quality panoramic ghost imaging as shown in
The logarithmic polar coordinate described in S3.2 essentially takes logarithm of the polar diameter r, that is
where ρ and θ are the median radius and angle of logarithmic polar coordinates.
As shown in
The projector 1, the collimating lens 2, the spectroscope 3 and the curved mirror 4 are located on the same optical path in sequence; the required annular pattern sequence of bio-inspired retina-like according to S1 is input into the projector 1, and the light source of the projector 1 is modulated. The modulated light source is collimated by the collimating lens 2, and then projected onto the curved mirror 4 by the spectroscope 3. The light intensity reflected from the omnidirectional image projected on the surface of the curved mirror 4 is reflected by the spectroscope 3, and received by the single pixel detector 5, and the data acquisition card stores the data. After repeated measurements for many times, according to the reconstruction algorithm of S2, the upper computer 7 is used to calculate the correlation between the collected light intensity data and the annular pattern sequence of the bio-inspired retina-like, and a 360-degree omnidirectional image is reconstructed. Then, according to S3, the 360-degree omnidirectional image is converted into logarithmic polar coordinates, and the image is tiled and unfolded, so that an undistorted 360-degree omnidirectional ghost imaging target can be obtained.
The above detailed description further elaborates the objective, technical scheme and beneficial effects of the application. It should be understood that the above description is only a specific embodiment of the application, and is not used to limit the scope of protection of the application. Any modification, equivalent substitution, improvement, etc. made within the spirit and principle of the application should be included in the scope of protection of the application.
Number | Date | Country | Kind |
---|---|---|---|
202110670824.X | Jun 2021 | CN | national |