POLARIZATION ORIENTATION METHOD BASED ON SKY REGION PRIOR AND MORPHOLOGICAL TEMPLATE MATCHING OF TRANSFORM DOMAIN

Information

  • Patent Application
  • 20250238954
  • Publication Number
    20250238954
  • Date Filed
    May 02, 2024
    a year ago
  • Date Published
    July 24, 2025
    2 days ago
Abstract
A polarization orientation method based on sky region prior and morphological template matching of transform domain, which reduces an interference of reflected light through the sky region prior and solves sun blur through the morphological template matching of transform domain (MTMTD); a region division standard is given through prior knowledge of a sky region, and the sky region is identified by clustering darkest pixel images in 15-channel polarization images; meanwhile, the MTMTD strategy provided carries out a transform domain treatment on an image of the angle of polarization by an imaging method, and solves the problem of sun blur under a single Rayleigh scattering model without relying on an additional sensor.
Description
CROSS-REFERENCE TO RELATED APPLICATIONS

This application claims priority to Chinese Patent Application Ser. No. CN2024100802839 filed on 18 Jan. 2024.


TECHNICAL FIELD

The present invention belongs to the technical field of navigation, and particularly relates to a polarization orientation method based on sky region prior and morphological template matching of transform domain.


BACKGROUND

Researches show that an angle of polarization (AOP) predicted by a single Rayleigh scattering model has robustness and contains a lot of navigation information, so that accurate course angle measurement can be completed. However, current orientation methods are often extremely sensitive to local polarization, which will increase a calculation error, especially when reflected light of objects such as trees and buildings destroys an AOP model. Although a gradient of a degree of polarization and other methods have been provided in the prior art, it should be noted that an occluded object with a flat characteristic cannot be identified by this method. Another key problem is that the direct use of the angle of polarization (AOP) for navigation may cause sun blur, because a range of the angle of polarization is only a half of a range of a course angle. Therefore, this method needs additional information to detect the sun blur, which undoubtedly increases a navigation cost.


SUMMARY

Object of invention: in order to solve the problems that an orientation method in the prior art has poor accuracy due to an interference of reflected light and a navigation cost needs to be increased to solve sun blur, the present invention provides a polarization orientation method based on sky region prior and morphological template matching of transform domain.


Technical solution: a polarization orientation method based on sky region prior and morphological template matching of transform domain comprises a computer readable medium operable on a computer with memory for the polarization orientation method based on sky region prior and morphological template matching of transform domain, and comprising program instructions for executing the following steps of:

    • (1) calculating a polarization dark channel image, a degree of polarization, a gradient of the degree of polarization and a gradient of an angle of polarization by using 0°, 45°, 90° and 135° images shot by a polarization camera, calculating a light intensity binary image and an occlusion binary image according to the polarization dark channel image, calculating a binary image of the degree of polarization according to the degree of polarization, and calculating a gradient binary image according to the gradient of the degree of polarization and the gradient of the angle of polarization;
    • (2) setting a number of clusters according to the light intensity binary image and the occlusion binary image;
    • (3) carrying out polarization dark channel clustering according to the set number of clusters to obtain a polarization dark channel clustergram, and acquiring a sky region image through the polarization dark channel clustergram;
    • (4) calculating an image of the angle of polarization, and carrying out feature extraction on the image of the angle of polarization to obtain a feature binary image of the angle of polarization;
    • (5) constructing a two-dimensional plane by taking (0°, 360°] and [−90°, 90°] as horizontal and vertical directions respectively, and projecting the feature binary image of the angle of polarization onto the two-dimensional plane by a space domain transform method to obtain a sun position binary feature map;
    • (6) obtaining a sun position and a reverse sun position by matching according to the sun position binary feature map, and determining a real sun position according to a constraint condition that the sun is above a horizontal plane;
    • (7) ignoring a difference between a Rayleigh scattering model and a real atmospheric model, calculating a sun position deviation, and considering a detection result to be true and reliable when the deviation is less than a threshold Tm; and considering the detection result to be unreliable when the deviation is greater than the threshold;
    • (8) calculating a course angle by combining the angle of polarization with the sky region image; and
    • (9) providing a transform domain model for an angle of polarization, introduces template matching to solve a sun blur of a binary feature map that resulted in an accurate sky region based on the polarization orientation method, therefore, improving a robustness of orientation.


Further, in the step (1), the polarization dark channel is expressed as:








I
D

(
X
)

=


min

Y


Ω

(
X
)



(


min

c

C





I
c

(
Y
)


)







    • wherein, C=[r,g,b,r0,g0,b0,r45,g45,b45,r90,g90,b90,r135,g135,b135]

    • wherein, r, g and b respectively represent red, green and blue channel polarization images, and r* represents a red channel polarization image at an angle *.





Further, in the step (1), the binary images of light intensity IH, degree of polarization IDOP, occlusion IS and gradient ΔI are respectively expressed as:








I
H

=

1


(


I
D

==

I
max


)



,







I
DOP

=

1


(


1

%

<

P
D

<

90

%


)









I
S

=

1


(


I
D

==
0

)









Δ

I

=

1


(


(


Δ


P
D


+

Δ


P
A



)

>
T

)








    • wherein, ID represents each element in a polarization dark channel image matrix, Imax represents a maximum light intensity acceptable by a sensor, PD represents the degree of polarization, ΔPD represents the gradient of the degree of polarization, ΔPA represents the gradient of the angle of polarization, T is a gradient threshold, and 1 represents an indicator function.





Further, in the step (2), a setting method of the number of clusters comprises:

    • (a) setting an initial value of the number of clusters ko as 1;
    • (b) when occlusion exists, updating the number of clusters to be:








k
o

=


k
o

+
1


,



(







S
i



I
S





S
i


)

>
0

;







    • (c) setting an intensity threshold as wNM, and as for whether the light intensity exceeds wNM, further updating the number of clusters obtained in the step (b) to be:









{







k
o

=


k
o

+
2


,


(





H
i



I
H




H
i


)

>

wNM









k
o

=


k
o

+
1


,

0
<

(





H
i



I
H




H
i


)

<

wNM





.





Further, in the step (3), an acquisition method of the sky region image Ωsc through the polarization dark channel clustergram is:







Ω


SC


=


μ


sc




Δ

I




I
H



I
S








    • wherein, μSC represents a sky type, and μsc=1Ks==0, μh==0, μm==0)

    • wherein, IK represents the polarization dark channel clustergram, μS is an occlusion type, μh is an intensity type, and μm is a blur type,










μ
s



arg




max

μ
k


(





μ
k


μ




I

μ
k

K



I
S



)









μ
h



arg




max

μ
k


(





μ
k


μ




I

μ
k

K



I
H



)










μ
m



arg




max

μ
k


(


1

N
k








μ
k


μ




I

μ
k

K


Δ

I



)



,






    • wherein, μ represents a set of all types updated from the number of cluster number ko, μk represents a kth type, k∈{1, 2, . . . k0}, and Nk is a total number of individuals in the kth type.





Further, in the step (4), an acquisition method of the feature binary image of the angle of polarization AOPb0 is:











AOP

b

0


(

find
(

ρ
==


cosh
s



cos

(

θ
-

A
s


)



)

)

=
1

,







    • wherein, find(*) represents a set of coordinates satisfying *,









{




ρ
=


sinh
s



coth
p








θ
=

A
p











    • wherein, hs is a solar altitude, hp is an observation point altitude angle, and A, is an observation point azimuth angle.





Further, in the step (6), the sun position and the reverse sun position are obtained by matching according to the sun position binary feature map:







ξ
=



{





ξ
+

(


h
s
+

,

A
s
+


)







ξ
-



(


h
s
-

,

A
s
-


)












    • a constraint term is added:











ξ
t

=
ξ

,


s
.
t
.


sign

(
ξ
)


>
0







    • wherein, ξ represents the sun position, ξ+ is a sun position above the horizontal plane, ξ is a sun position below the horizontal plane, hs+, is a solar altitude above the horizontal plane, As+ is a solar azimuth above the horizontal plane, hs is a solar altitude below the horizontal plane, As is a solar azimuth below the horizontal plane, and ξt represents the real sun position; and

    • the real sun position is obtained according to the sun position, the reverse sun position and the constraint term, which is recorded as ξt (hs, As).





Further, in the step (7), the sun position deviation is calculated as:






δ


sd

(

δ

b

0


)



sd

(


Y
~


X
~


)







    • wherein, δ represents the sun position deviation, δb0 represents a deviation of the feature binary image of the angle of polarization AOPb0, {tilde over (X)} represents cos (Ap−As), {tilde over (Y)} represents cothp, and As is the solar azimuth.





Further, in the step (8), the course angle {tilde over (ψ)}nb is:








ψ




nb


=



tan
2

-
1


(




-


s
~

y
b




cos



ϕ


nb



+



s
~

z
b



sin



ϕ


nb




,




s
~

x
b



cos



θ


nb



+



s
~

y
b



sin




ϕ


nb



sin



θ


nb



+



s
~

z
b



cos



ϕ


nb




sin



θ


nb





)

+

A
s








    • wherein, θnb is a pitch angle, and ϕnb is a roll angle, which are measured by an additional sensor,











[





s
~

x
b





s
~

y
b





s
~

z
b




]

T

=

[




cos



Ã
s
b



cos




h
~

s
b







sin



Ã
s
b



cos




h
~

s
b







sin




h
~

s
b





]







    • wherein,











h
~

s
b

=

π
-


cos

-
1


(

z






x
2

/

y
2


+
1


/
x


)









Ã
s
b

=

-


tan

-
1


(

x
/
y

)








    • (1) wherein, x, y and z are defined as:










[




x
2



xy


xz




xy



y
2



yz




xz


yz



z
2




]


=
^



1
NM


?


(


e
ij


?


)









?

indicates text missing or illegible when filed






    • wherein, NM is a total number of pixels, and eij is a measured angle of polarization, wherein {i,j|ΩSC(i,j)=1}.





Beneficial effects: compared with the prior art, the polarization orientation method based on sky region prior and morphological template matching of transform domain provided by the present invention can realize course angle measurement under an interference of reflected light of objects such as trees and buildings, which has a small error, and can complete high-robustness sun blur judgment without relying on an additional sensor, which avoids an additional cost, thus effectively improving the accuracy and robustness of a course angle measurement method based on an atmospheric polarization mode.


Compared an existing orientation method based on scattered light of atmosphere, this method visualizes navigation information and improves the robustness of orientation; and this method provides a transform domain model for an angle of polarization, introduces template matching to solve the sun blur of the binary feature map, and gives the accurate sky region based on the polarization dark channel and the region prior before orientation, thus realizing the course angle measurement when a part of scattered light of sky is destroyed by reflected light.





BRIEF DESCRIPTION OF THE DRAWINGS


FIG. 1 is a frame flow chart of a polarization orientation method based on sky region prior and morphological template matching of transform domain;



FIG. 2 is a schematic diagram of a result of sun blur judgment by the polarization orientation method based on sky region prior and morphological template matching of transform domain; and



FIG. 3 is a schematic diagram of a result of orientation error measurement by the polarization orientation method based on sky region prior and morphological template matching of transform domain.





DETAILED DESCRIPTION

The present invention is further explained and described hereinafter with reference to the drawings and specific embodiments.


A polarization orientation method based on sky region prior and morphological template matching of transform domain, as shown in FIG. 1, comprises a computer readable medium operable on a computer with memory for the polarization orientation method, and comprising program instructions for executing the following steps.


(1) A polarization dark channel image, a degree of polarization, a gradient of the degree of polarization and a gradient of an angle of polarization are calculated by using 0°, 45°, 90° and 135° images shot by a polarization camera, a light intensity binary image and an occlusion binary image are calculated according to the polarization dark channel image, a binary image of the degree of polarization is calculated according to the degree of polarization, and a gradient binary image is calculated according to the gradient of the degree of polarization and the gradient of the angle of polarization. Specifically:


the binary images of light intensity IH, degree of polarization IDOP, occlusion IS and gradient ΔI are respectively expressed as:








I
H

=

1


(


I
D

==

I
max


)



,







I
DOP

=

1


(


1

%

<

P
D

<

90

%


)









I
S

=

1


(


I
D

==
0

)









Δ

I

=

1


(


(


Δ


P
D


+

Δ


P
A



)

>
T

)








    • wherein, ID represents each element in a polarization dark channel image matrix, Imax represents a maximum light intensity acceptable by a sensor, PD represents the degree of polarization, ΔPD represents the gradient of the degree of polarization, ΔPA represents the gradient of the angle of polarization, T is a gradient threshold, and 1 represents an indicator function.





The polarization dark channel image is expressed as:








I
D

(
X
)

=


min

Y


Ω

(
X
)



(


min

c

C





I
c

(
Y
)


)







    • wherein, C=[r,g,b,r0,g0,b0,r45,g45,b45,r90,g90,b90,r135,g135,b135]

    • wherein, r, g and b respectively represent red, green and blue channel polarization images, and r* represents a red channel polarization image at an angle *.





(2) A number of clusters is set according to the light intensity binary image and the occlusion binary image.


A setting method of the number of clusters comprises:

    • (a) setting an initial value of the number of clusters ko as 1;
    • (b) when occlusion exists, updating the number of clusters to be:








k
o

=


k
o

+
1


,



(







S
i



I
S





S
i


)

>
0

;







    • (c) setting an intensity threshold as wNM, and as for whether the light intensity exceeds wNM, further updating the number of clusters obtained in the step (b) to be:









{







k
o

=


k
o

+
2


,





(








H
i



I
H



,

H
i


)

>
wNM








k
o

=


k
o

+
1


,




0
<

(








H
i



I
H



,

H
i


)

<
wNM





.





(3) Polarization dark channel clustering is carried out according to the set number of clusters to obtain a polarization dark channel clustergram, and a sky region image is acquired through the polarization dark channel clustergram by an acquisition method as follows:







Ω
SC

=


μ
sc



Δ

I



I
H



I
S








    • wherein, μsc represents a sky type, and μsc=IK s=0, μh=0, μm=0)

    • wherein, IK represents the polarization dark channel clustergram, μs is an occlusion type, μh is an intensity type, and μm is a blur type,










μ
s



arg




max

μ
k


(








μ
k


μ




I

μ
k

K



I
S


)









μ
h



arg




max

μ
k


(








μ
k


μ




I

μ
k

K



I
H


)









μ
m



arg




max

μ
k


(


1

N
k










μ
k


μ




I

μ
k

K


Δ

I

)








    • wherein, μ represents a set of all types updated from the number of cluster number ko,

    • μk represents a kth type, k∈{1, 2, . . . k0}, and Nk is a total number of individuals in the kth type.





(4) An image of the angle of polarization is calculated, and feature extraction is carried out on the image of the angle of polarization to obtain a feature binary image of the angle of polarization, which is expressed as:








A

O


P

b

0





(

find



(

ρ
=

=


cosh
s



cos



(

θ
-

A
s


)




)


)


=
1

,






    • wherein, find(*) represents a set of coordinates satisfying *,









{



ρ



=


sinh
s




coth
p







θ



=

A
p











    • wherein, hs is a solar altitude, hp is an observation point altitude angle, and Ap is an observation point azimuth angle.





(5) A two-dimensional plane is constructed by taking (0°, 360°] and [−90°, 90°] as horizontal and vertical directions respectively, and the feature binary image of the angle of polarization is projected onto the two-dimensional plane by a space domain transform method to obtain a sun position binary feature map.


(6) A sun position and a reverse sun position are obtained by matching according to the sun position binary feature map:







ξ
=



{





ξ
+




(


h
s
+

,

A
s
+


)








ξ
-




(


h
s
-

,

A
s
-


)












    • because the sun is located above the horizontal plane, a constraint condition is set,











ξ
t

=


ξ


,




s
.
t
.

sign




(

ξ



(
x
)


)


>
0







    • wherein, ξ represents the sun position, ξ+ is a sun position above the horizontal plane, ξ is a sun position below the horizontal plane, hs+ is a solar altitude above the horizontal plane, As+ is a solar azimuth above the horizontal plane, hs is a solar altitude below the horizontal plane, As is a solar azimuth below the horizontal plane, and ξt represents the real sun position; and

    • a real sun position is obtained according to the sun position, the reverse sun position and the constraint term, which is recorded as ξt(hs,AS).





(7) A difference between a Rayleigh scattering model and a real atmospheric model is ignored, a sun position deviation is calculated, and a detection result is considered to be true and reliable when the deviation is less than a threshold Tm; and the detection result is considered to be unreliable when the deviation is greater than the threshold, and subsequently, the deviation may be detected and calculated again.


The sun position deviation is calculated as:






δ


sd



(

δ

b

0


)




sd



(


Y
~


X
~


)








    • wherein, δ represents the sun position deviation, δb0 represents a deviation of the feature binary image of the angle of polarization AOPb0, {tilde over (X)} represents cos (Ap−As), {tilde over (Y)} represents cothp, and As is the solar azimuth. δb0 is in direct proportion to











Y
~


X
~


,




and


the calculated sun position deviation is represented by a standard deviation of








Y
~


X
~


,




which


may be simplified as






δ


sd




(


Y
~


X
~


)

.






(8) A course angle is calculated by combining the angle of polarization with the sky region image, and the course angle {tilde over (ψ)}nb is:








ψ
~

nb

=



tan
2

-
1





(




-


s
˜

y
b



cos



ϕ
nb


+



s
˜

z
b


sin



ϕ
nb



,




s
~

x
b


cos



θ
nb


+




s
˜

y
b


sin



ϕ
nb


sin



θ
nb


+



s
˜

z
b


cos



ϕ
nb


sin



θ
nb




)


+

A
s








    • wherein, θnb is a pitch angle, and ϕnb is a roll angle, and the pitch angle and the roll angle are measured by an additional sensor, such as an inertial navigation system.











[





s
~

x
b





s
~

y
b





s
~

z
b




]

T

=

[




cos




A
~

s
b


cos




h
~

s
b







sin




A
~

s
b


cos




h
~

s
b







sin




h
˜

s
b





]







    • wherein,











h
~

s
b

=

π
-


cos

-
1


(

z





x
2

/

y
2


+
1


/
x

)










A
~

s
b

=

-


tan

-
1


(

x
/
y

)








    • (1) wherein, x, y and z are defined as:










[




x
2



xy


xz




xy



y
2



yz




xz


yz



z
2




]


=
Δ



1
NM





ij



(


e
ij



e
ij
T


)









    • wherein, NM is a total number of pixels, and eij is a measured angle of polarization, wherein {i,j|ΩSC(i,j)=1}; and





(9) Provides a transform domain model for an angle of polarization, introduces template matching to solve a sun blur of a binary feature map that resulted in an accurate sky region based on the polarization orientation method, therefore, improving a robustness of orientation.


The effect of this method is verified hereinafter by a vehicle-mounted test. FIG. 2 is a schematic diagram of a result of sun blur judgment by this method. FIG. 3 shows comparison of vehicle-mounted orientation errors of different polarization orientation methods. The orientation methods used in the comparison comprise: traditional direct orientation by polarized light, orientation by the gradient of the degree of polarization (Fan) and orientation by weather-weighted sparse coding (WWSC). It can be seen from FIG. 3 that the method in this embodiment has the highest accuracy under an interference of reflected light, and shows good robustness under different conditions.


According to the method, a region division standard is given through sky region prior, and the sky region is identified by clustering the darkest pixel images in 15-channel polarization images. Meanwhile, the MTMTD strategy provided carries out a transform domain treatment on the image of the angle of polarization by an imaging method, and solves the problem of sun blur under the single Rayleigh scattering model without relying on the additional sensor. According to the method, the orientation can be completed in the case that the sky is occluded and interfered under a ground/near-ground condition, and the accuracy and robustness of course measurement based on atmospheric polarized light are effectively improved.

Claims
  • 1. A polarization orientation method based on sky region prior and morphological template matching of transform domain, comprising a computer readable medium operable on a computer with memory for the polarization orientation method, and comprising program instructions for executing the following steps of: (1) calculating a polarization dark channel image, a degree of polarization, a gradient of the degree of polarization and a gradient of an angle of polarization by using 0°, 45°, 90° and 135° images shot by a polarization camera, calculating a light intensity binary image and an occlusion binary image according to the polarization dark channel image, calculating a binary image of the degree of polarization according to the degree of polarization, and calculating a gradient binary image according to the gradient of the degree of polarization and the gradient of the angle of polarization;(2) setting a number of clusters according to the light intensity binary image and the occlusion binary image;(3) carrying out polarization dark channel clustering according to the set number of clusters to obtain a polarization dark channel clustergram, and acquiring a sky region image through the polarization dark channel clustergram;(4) calculating an image of the angle of polarization, and carrying out feature extraction on the image of the angle of polarization to obtain a feature binary image of the angle of polarization;(5) constructing a two-dimensional plane by taking (0°, 360°] and [−90°, 90°] as horizontal and vertical directions respectively, and projecting the feature binary image of the angle of polarization onto the two-dimensional plane by a space domain transform method to obtain a sun position binary feature map;(6) obtaining a sun position and a reverse sun position by matching according to the sun position binary feature map, and determining a real sun position according to a constraint condition that the sun is above a horizontal plane;(7) ignoring a difference between a Rayleigh scattering model and a real atmospheric model, calculating a sun position deviation, and considering a detection result to be true and reliable when the deviation is less than a threshold Tm; and considering the detection result to be unreliable when the deviation is greater than the threshold;(8) calculating a course angle by combining the angle of polarization with the sky region image; and(9) providing a transform domain model for an angle of polarization, introduces template matching to solve a sun blur of a binary feature map that resulted in an accurate sky region based on the polarization orientation method, therefore, improving a robustness of orientation.
  • 2. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (1), the polarization dark channel is expressed as:
  • 3. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (1), the binary images of light intensity IH, degree of polarization IDOP, occlusion IS and gradient ΔI are respectively expressed as:
  • 4. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (2), a setting method of the number of clusters comprises: (a) setting an initial value of the number of clusters ko as 1;(b) when occlusion exists, updating the number of clusters to be:
  • 5. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 3, wherein, in the step (3), an acquisition method of the sky region image Ωsc through the polarization dark channel clustergram is:
  • 6. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (4), an acquisition method of the feature binary image of the angle of polarization AOPb0 is:
  • 7. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (6), the sun position and the reverse sun position are obtained by matching according to the sun position binary feature map:
  • 8. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 7, wherein, in the step (7), the sun position deviation is calculated as:
  • 9. The polarization orientation method based on sky region prior and morphological template matching of transform domain according to claim 1, wherein, in the step (8), the course angle {tilde over (ψ)}nb is:
Priority Claims (1)
Number Date Country Kind
2024100802839 Jan 2024 CN national