The present invention relates to a computer-implemented method for determining biometric data of an eye and to a corresponding method for manufacturing spectacle lenses taking into account the biometric data determined. Furthermore, the invention relates to corresponding computer program products and devices.
In the calculation of spectacle lenses, in particular progressive spectacle lenses, the biometrics of the eye of the spectacle wearer can be taken into account, as described in document U.S. Pat. No. 9,910,294 B2, for example. These biometric spectacle lenses offer great advantages, since the quality of the imaging is no longer evaluated at the vertex sphere, a virtual point of a simple model, but where the imaging actually takes place: on the retina of the eye. Thus, interactions between the individual aberrations, which arise during refraction and propagation through the media of the eye, are also taken into account.
The disadvantage of this method, however, is that extensive measurements with complex equipment and devices are necessary. This leads to great effort and high costs. As a result, the advantages of high-quality biometric spectacle lenses are only available to a relatively small proportion of those with visual defects.
It is an object of the present invention to make extensive use of the advantages of biometric spectacle lenses without having the disadvantages of the complex measurement.
This object is achieved by a computer-implemented method for determining biometric data of an eye, a corresponding device, and a corresponding computer program product, as well as a method and a corresponding device for manufacturing a spectacle lens with the features specified in the respective independent claims.
The present invention is based on the surprising finding that it is possible to determine or predict individual biometric parameters of at least one of the eyes of a user with sufficient accuracy and precision using standard values of the user's eye determined as part of a routine refraction determination. It is therefore possible to calculate and manufacture individual biometric spectacle lenses with high imaging quality and wearing comfort, without a complex and cost-intensive measurement of the additional biometric data being necessary for this.
A first aspect of the invention relates to a computer-implemented method for determining individual biometric parameters of at least one of the eyes of a user. The method comprises:
The method can also comprise providing the statistical model describing the relation between standard data and additional data.
Furthermore, the method can comprise providing the training data set and deriving the statistical model using statistical analysis of the training data set. Deriving the statistical model can comprise, for example, training an original (non-trained) model using the training data set. For example, the model can comprise several model parameters altered or adapted during training with the training data set.
The term “providing” within the meaning of the present application includes “specifying”, “transmitting”, “obtaining”, “reading out”, “retrieving from a memory, a database and/or a table”, “receiving”, etc.
The term “determining” within the meaning of the present application also includes “specifying”, “calculating”, “identifying”, “predicting”, etc.
Standard data (basic data) is data of at least one of the eyes of a user and possibly other data that is recorded in connection with an order for spectacles (for example by an optician or an ophthalmologist). For example, the standard data can include data that is normally always recorded in connection with an order for spectacles, such as prescription data. The standard data can also include data that is usually optionally recorded or measured in connection with an order for spectacles, such as the higher-order aberrations of at least one of the eyes of a user, etc. This data can then be used to determine further supplementary data (additional data).
For example, the standard data can include data that has been recorded with a first measuring device or a first measurement method. Additional data can be calculated on the basis of this data, which cannot be determined or measured with the first measuring device or with the first measurement method. Alternatively or in addition, the additional data can include data that can be determined or measured with the first measuring device or the first measurement method, but not with sufficient quality (for example not with sufficient accuracy, precision and/or repeatability).
For example, in the determination of at least part of the standard data there can be available a measuring device that allows determining part of the biometric parameters of at least one of the eyes of a user to be taken into account when calculating an individual biometric spectacle lens. The data recorded with this measuring device can then be used to determine additional individual biometric parameters that cannot be determined with this measuring device. The first measuring device can be an aberrometer, for example, which makes it possible to determine the aberrations of the eye, but not the aberrations of the cornea (which are measured with a topographer, for example,) and/or the anterior chamber depth (which is measured with a Scheimpflug camera, for example). The method can be used to determine further biometric data, such as aberration of the cornea and/or the anterior chamber depth, based on the aberration data of the eye recorded with the aberrometer. If a topographer and/or a Scheimpflug camera is available, the corresponding measurement data can be used to determine the aberrations of the eye.
As described above, the method can also be used when data not only cannot be determined or measured (because the appropriate measuring devices are not available, for example), but also when the corresponding data can only be determined or measured in poor or insufficient quality. For example, the standard data can include data that has been measured with a first (for example simple) measuring device or measurement method that delivers data with a low or insufficient quality. The data recorded with the first measuring device or with the first measurement method can be used to determine additional data having a higher quality. For example, the additional data can correspond to data that has been recorded or can be measured with a second, more precise measuring device/measuring device type or with a second measurement method.
The standard data includes at least the prescription data. The prescription data includes a distance prescription (i.e., the refraction data when looking at a distant distance, e.g., at infinity) and/or a near prescription (i.e., the refraction data when looking at a near distance, e.g., at a reading distance). The distance prescription of at least one of the eyes of a user is composed of the parameters sphere (Sph), cylinder (Cyl), and axis, or of variables derived therefrom, such as the components M (spherical equivalent), J0 (ortho-astigmatism), and J45 (oblique astigmatism) of the power vector of the distance prescription. The near prescription is also composed of the variables sphere (Sph), cylinder (Cyl), and axis of at least one of the eyes of a user, or of variables derived therefrom, such as the components M, J0 and J45 of the power vector of the near prescription. The prescription data can also include the addition, for example in the case of progressive lenses and multifocal lenses.
The distance prescription, the addition and/or the near prescription can be determined using subjective refraction, for example. It is also possible to determine the distance prescription, the addition and/or the near prescription using objective refraction or using a combination of objective and subjective refraction.
The subjective refraction determination is a method of refraction determination in which the visual impression subjectively felt by the user is taken into account. Usually, different refractive lenses are placed in front of the user, with the user of the spectacle lens notifying the refractionist of an improvement or a deterioration in the visual impression when the optical properties of the refractive lens in front change.
In the case of an objective refraction, however, no feedback from the user is taken into account. The objective refraction is carried out solely using an apparatus arrangement and can also record the refractive properties and the geometry of the eyeball. The objective refraction can be performed using various devices such as refractometers, aberrometers, wavefront scanners, etc.
Optionally, the standard data can include at least one of the following parameters:
Pupillary distance and pupil diameter can be determined using conventional measurement methods.
Furthermore, the standard data can optionally include at least part of the following data, the data having been recorded using a first measurement method or measuring device:
Furthermore, the standard data can also optionally include the following additional parameters: age, gender, ethnicity, place of order, body height, intraocular pressure, blood values, anamnesis data or medical record (e.g. possibly diabetes), images of the retina, values of eye pressure, data of the anterior segment of the eye (chamber angle) and/or data of the old spectacle lens.
Additional data is biometric data of at least one of the eyes of a user, which are determined (for example by an optician) in connection with an order for spectacles. The additional data can be data, for example, which is usually determined optionally (for example by the optician) in connection with an order for spectacles. As described above, the additional data and the standard data can at least partially include the same parameters (such as aberrations in at least one of the eyes of a user, etc.), with the parameters included in the additional data and the parameters included in the standard data being recordable using different measurement methods or measuring devices.
For example, the additional data can include data that is measured with an aberrometer, a topographer, a Scheimpflug camera, an OCT (i.e. an optical coherence tomograph or a method of optical coherence tomography), a biometer, and/or another measuring device or that have been or can be recorded using another method of objective refraction.
The additional data can include, for example, the following biometric data or parameters of at least one of the eyes of a user:
The additional data preferably includes at least part of the following data or parameters: the higher order aberrations of the eye (such as coma, trefoil, secondary astigmatism, spherical aberration, etc.), the lower and higher order aberrations of the cornea (sphere (Sph), cylinder (Cyl), axis (or M, J0, J45), coma, trefoil, secondary astigmatism, spherical aberration, etc.), the anterior chamber depth, the pupil sizes in the distance and near and/or under mesopic and photopic conditions.
The additional data in the reference data sets may be data that has been recorded or measured for earlier orders of biometric spectacle lenses in addition to the standard data, for example with an aberrometer, a topographer, a Scheimpflug camera, an OCT, a biometer and/or another measuring device.
The individual additional data specified based on a user's standard individual data and the additional data determined using the statistical model may, but need not, be the same type of additional data included in the reference data sets and used to derive the statistical model.
The statistical model can be any statistical model that is derived from an existing data set (training data set) using statistical methods. Exemplary statistical methods are regression (such as linear regression, nonlinear regression, nonlinear regression with an attention mechanism, nonlinear multi-task regression, nonparametric or semiparametric regression, etc.), classification methods, and other machine learning methods. Machine learning algorithms are described, for example, in Jeremy Watt, Reza Borhani, Aggelos Katsaggelos: Machine Learning Refined: Foundations, Algorithms, and Applications, Cambridge University Press, 2020.
The statistical model receives at least part of the individual standard data and/or variables derived therefrom as input variables and uses them to calculate at least part of the additional individual biometric parameters or additional data. The relation between standard data and additional data specified by the statistical model can be a linear or nonlinear relation. Furthermore, the relation can be multi-parametric.
Exemplary statistical models are linear or nonlinear regression models. For example, neural networks, which also include deep neural networks, can be used as nonlinear regression models. It is also possible to use other nonlinear regression models known from the field of machine learning. The regression models, such as the neural network, can be trained using the training data set provided.
The statistical model can also be a combination of several statistical models of different types, for example a combination of a linear regression model, a nonlinear regression model (such as a neural network), a classification model and/or another statistical model.
The statistical model derived from the training data set can be stored in a suitable storage device such as a database, calculator, computational or data cloud. At least part of the training data set used for the derivation can be stored together with the statistical model.
The statistical model derived from a training data set can also be checked and/or modified continuously or at regular intervals, for example on the basis of new reference data sets. Accordingly, the method may include modifying the statistical model.
If the statistical model contains a neural network or if it consists of one, the input layer of the neural network is filled with at least part of the standard data and/or auxiliary variables calculated therefrom. The output layer outputs values for at least one additional parameter or at least part of the additional data. The neural network can preferably also contain one or more hidden layers in addition to an input and an output layer.
During training of an original, untrained neural network, the weights are changed using appropriate learning algorithms. The trained neural network specifies the relation between standard data and additional data.
The structure of the neural network (such as the number and types of layers, number and types of neurons in the different layers, the way the layers and neurons are linked to one another, etc.) and the learning algorithms can be different.
The statistical model, which describes the relation between standard data and additional data, is derived using statistical methods on the basis of a training data set with a plurality of individual data sets (reference data sets). Each of the reference data sets can include, for example, standard data and the additional data of a specific user determined using suitable measurement methods. The different reference data sets in the training data set can preferably include the data (standard data and additional data) of a plurality of different users (reference users).
The additional data included in the reference data sets may include biometric parameters that are not included in the standard data assigned to the additional data. It is also possible for the additional data included in the reference data sets to include biometric parameters that are included in the standard data assigned to the additional data, but are of lower quality. For example, the values of the standard data and the additional data assigned to this standard data can have been recorded using different measurement methods and/or measuring devices.
To this end, existing orders for biometric spectacle lenses can be used to train a neural network or another statistical model with the data sets. In the case of a new standard order, the additional measurement data (additional data) can be calculated or forecast using the trained statistical model and based on the individual standard parameters included in the new order. Thus, biometric spectacle lenses can be calculated based on individual standard parameters and additional data calculated therefrom using the neural network or other statistical models.
The number of reference data sets can vary. For example, more than 10, 100, 1,000, 10,000, 100,000, or 1,000,000 reference data sets may be used. The reference data sets preferably cover a large, preferably the entire, range in which spectacle lenses can be ordered later on. For example, the reference data sets can cover the range of refraction values, for example −20 dpt to +20 dpt for sphere and −8 dpt to +8 dpt for cylinder.
Furthermore, the method for determining individual biometric parameters of at least one of the eyes of a user can comprise transmitting the individual standard data and the calculated individual additional data to an external entity, such as a manufacturer of ophthalmic lenses, a manufacturing unit, a manufacturing device, etc.
A second aspect of the invention relates to a method for manufacturing a spectacle lens, comprising:
For example, the spectacle lens can be calculated using the method described in U.S. Pat. No. 9,910,294 B2 or using another known method in which individual biometric parameters are taken into account when calculating the spectacle lens.
The method can also comprise manufacturing the calculated spectacle lens. The spectacle lens may be a single-vision spectacle lens, a multifocal spectacle lens or a progressive spectacle lens.
A third aspect of the invention relates to a computer-implemented method for determining a statistical model, the method comprising:
A fourth aspect of the invention relates to a computer program product which, when loaded into and executed on the memory of a computer, causes the computer to carry out a method according to one the above aspects.
With regard to the methods and computer program products described above, the aforementioned preferred embodiments and the aforementioned advantages apply analogously.
The method according to one of the above aspects can be carried out using a correspondingly designed device.
A fifth aspect of the invention relates to a device for determining individual biometric parameters of at least one of the eyes of a user, the device comprising a calculating device designed to carry out the above-described method for determining individual biometric parameters.
The calculating device can preferably comprise:
Furthermore, the device can comprise a model input interface for providing the statistical model. For example, the statistical model may be stored in a device, such as a database, a calculator, and/or a data or calculator cloud. Furthermore, the device can provide a training data set input interface for providing the training data set; and a model calculating device for deriving or calculating the statistical model using statistical analysis of the training data set. The statistical model can be derived or calculated by training an original (untrained) model using the training data set, for example.
A sixth aspect of the invention relates to a device for manufacturing a spectacle lens, comprising:
The manufacturing device can also comprise a manufacturing device for manufacturing the calculated spectacle lens.
The above-mentioned devices for providing, determining, specifying or calculating data (such as (individual) standard data, (individual) additional data, statistical models, model parameters, weighings, etc.) can be realized by suitably configured or programmed data processing devices (in particular specialized hardware modules, computers or computer systems, such as computer or data clouds) with appropriate computing units, electronic interfaces, storage and data transmission units. The devices may further comprise at least a preferably interactive graphical user interface (GUI) allowing a user to view and/or input and/or modify data.
The devices mentioned above can also have suitable interfaces that enable data (such as training data sets, reference data sets, (individual) standard data, (individual) additional data, etc.) to be transmitted, input and/or read out. The devices can also include at least one storage unit, for example in the form of a database, which stores the data used.
The manufacturing device can comprise at least one CNC-controlled machine for the direct processing of a blank according to the determined optimization specifications, for example. Alternatively, the spectacle lens can be manufactured using a casting process. The finished spectacle lens can have a first simple spherical or rotationally symmetric aspherical surface and a second individual surface calculated as a function of the individual standard data and the calculated individual additional data. The simple spherical or rotationally symmetric aspheric surface may be the front surface (i.e., the object-side surface) of the spectacle lens. However, it is of course possible to arrange the individual surface as the front surface of the spectacle lens. Both surfaces of the spectacle lens can also be calculated individually.
A further aspect of the invention relates to a spectacle lens manufactured according to the manufacturing method described above. Furthermore, the invention offers a use of a spectacle lens manufactured according to the manufacturing method described above in a predetermined average or ideal or individual position of wear of the spectacle lens in front of the eyes of a specific user for correcting a user's visual defect.
In the following, preferred embodiments of the present invention will be described by way of example with reference to accompanying figures. Individual elements of the described embodiments are not limited to the respective embodiment. Rather, elements of the embodiments can be combined with one another as desired and new embodiments can be created thereby. The figures show:
Step S1: Creation of a training data set from a plurality of data sets (reference data sets) 10, each reference data set including standard data 12 and additional data 14 assigned to this standard data.
An exemplary reference data set 10 is shown in
To form the training data set, existing orders for biometric spectacle lenses can be used, for which the additional data have been recorded using a measurement method. Exemplary measurement methods are measurements using an aberrometer, a topographer, a Scheimpflug camera, an OCT and/or a biometer.
Step S2: A relation between the standard data and the additional data is derived from the plurality of reference data sets with the aid of statistical methods. In other words, a statistical model is determined on the basis of the training data set, which describes the relation, such as the correlation(s), between standard data and additional data.
The determination of the statistical model can comprise, for example, training an originally untrained neural network with the training data set, which includes the plurality of reference data sets. The trained neural network can be tested using a test data set and/or can be validated using a validation data set. The test data set and the validation data set can each include a plurality of data sets (reference data sets) from previous orders, for example a plurality of the reference data sets shown in
Step S3: Providing an individual data set that only includes individual standard data. The individual standard data can be recorded by an optician as part of an individual order for spectacles for a user.
Step S4: Calculating individual additional data (additional data) based on the individual standard data included in the individual data set provided in step S3 and further based on the relation between standard data and additional data determined in step S2. For example, the individual standard data can be input to the trained neural network of step S2. The corresponding output data of the neural network can be used directly as the individual additional data. It is possible not to use the output data of the neural network directly, but to first subject this output data to further processing (such as checking for plausibility, smoothing, filtering, categorizing, converting, etc.).
Step S5: Calculating an individual spectacle lens based on the individual standard data included in the individual data set provided in step S3 and further based on the calculated individual additional data of step S4.
The calculation of an individual spectacle lens comprises the calculation of at least one surface of the spectacle lens based on the individual standard data and the calculated individual additional data. The surface thus calculated can be the back surface or the front surface of the spectacle lens. “Calculation of at least one surface of a spectacle lens” includes the calculation of at least a part of a surface or a piece of a surface. In other words, “calculation of at least one surface of a spectacle lens” means a calculation of at least part of the surface or calculating the entire surface.
The surface opposite the calculated surface can be a simple surface, such as a spherical, a rotationally symmetric, an aspheric, a toric, or an atoric surface. It is also possible to calculate both surfaces individually.
The individual spectacle lens can be calculated using a known method, for example using the method known from document U.S. Pat. No. 9,910,294 B2.
where W∈K×D denotes the weighing matrix.
where:
where:
h (h=1, . . . . H) denotes the hth attention head.
The output f(x) is calculated by:
where:
K×M, a separate weighing matrix WTrask h2, h=1 . . . , T is used for each individual task. With the help of the model, several output variables ft(x), t=1, . . . , T are calculated from a multidimensional input variable x with a dimension D (e.g. D=26). The dimensions of the output variables are given by the tasks, wherein the various tasks can have different dimensions. For example, the output variable f1 can have the dimension K1, the output variable f2 can have the dimension K2, etc. Overall, the dimension of all output variables is the sum of the dimensions of the individual output variables Σ1T Ki.
The subjective (Rx) spherical equivalent M, the subjective (Rx) ortho-astigmatism J0, and the subjective oblique astigmatism J45 are the components of the power vector of the distance prescription, which was determined using subjective refraction. The distance prescription is part of the standard data.
As can be seen from
Column 1 of the tables shown in
As can be seen from
The mean power of the prescription (sph+cyl/2) in Dpt (also called spherical equivalent) is plotted on the abscissa of
The difference [in Dpt] of the maximum astigmatism in the eye with a spectacle lens calculated using a method according to an example of the invention and the maximum astigmatism in the eye with a conventional spectacle lens is plotted on the ordinate of
The percentage difference between the change in refractive power for a spectacle lens calculated by a method according to an example of the invention and the change in refractive power for a conventional spectacle lens is plotted on the ordinate of
As can be seen from
The exemplary method used in the calculation of the spectacle lenses with the values shown in
The training data set includes about 20000 reference data sets. Each reference data set includes standard data and the additional data associated with the standard data. The standard data includes the prescription data (the distance prescription converted to M, J0, J45) of a user's right eye acquired by subjective refraction. The additional data includes the cornea topography in Zernike representation and the anterior chamber depth of the user's right eye. The training data set is used to train a linear regression model such as the model shown in
The trained model enables a prediction of each of the Zernike coefficients cn,m(x) of the cornea topography and the anterior chamber depth dCL(x) as a linear regression of the following features:
In the linear regression model, it holds for the predicted Zernike coefficients cn,m(x) of the cornea topography that:
For the predicted anterior chamber depth dCL(x) it holds that:
In equations (6) and (7):
For the corneal vertex depth z as a function of the feature vector x and the position of the pupil coordinates Xpup, Ypup it holds that:
where:
The terms of the sum according to equation (8) are determined by training the model.
In
The predicted eye length shown in
The predicted eye length shown in
The predicted eye length shown in
As can be seen from
Number | Date | Country | Kind |
---|---|---|---|
102020128958.8 | Nov 2020 | DE | national |
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/EP2021/080370 | 11/2/2021 | WO |