Patent Application
20230385601
The present disclosure relates to a data pruning tool including a group-learning self-organized map, SOM, machine learning, ML, model, and to related aspects where the SOM may be used iteratively to identify and drill down into one or more regions of interest in a large multi-dimensional data set.
In particular, but not exclusively, in some embodiments, the multi-dimensional data set comprises a set of test cases representing N dimensions of test conditions over which a test was performed on a particular configuration of a configurable physical entity. An example of a physical entity which can be tested over multiple dimensions of test conditions comprises a transceiver with a configurable digital pre-distortion, DPD, unit. A signal output by the transceiver can be tested over various ranges of radio settings using a transceiver test for the peak power spectrum of the output signal. The transceiver test determines if a particular DPD configuration of the transceiver results in the transceiver outputting a signal having a peak power spectrum which exceeds a peak power spectrum mask, and so failing the transceiver power output test, or if the signal output has a peak power spectrum which is below a peak power spectrum mask, in which case the transceiver passes the transceiver power output test.
In particular, but not exclusively, the data pruning tool reduces the range of radio settings over which different configurations of the transceiver need to be tested using a self-organizing map, SOM, machine learning, ML, model. The SOM ML model finds regions of interest comprising ranges of each of the N dimensional test conditions (i.e. of the N different radio settings) within which the transceiver did not pass the transceiver test. Tests can then be repeated using a new configuration of the transceiver just for those ranges of test conditions which results in fewer tests being performed. The test condition ranges over which different configurations need to be retested can be narrowed down further by repeatedly using the data pruning tool as the SOM ML model uses a competitive group learning SOM process. This enables test-cases to be repeated for different DPD configurations of the transceiver until a configuration set has been found which can be used to configure the transceiver to pass the transceiver test over various ranges of test criteria.
Some examples of the disclosed data pruning tool and SOM ML model can be used for finding configuration sets for other types of configurable physical entities, such as, for example, another type of device or substance. In some examples, the multi-dimensional data set comprises a plurality of parameter sets, each parameter set comprising a N-dimensional set of N test or selection conditions over which a particular configuration of the configurable physical entity is assessed or tested.
Testing or assessing a physical entity which can adopt a variety of different configurations, some of which may pass a test, some of which may not, can introduce great complexity into a test process. A given configuration or state of the physical entity may pass certain ranges of test or selection conditions, but not others. A new configuration of the physical entity may pass the test for some or all or just a sub-range of one of the ranges of test or selection conditions where a previous configuration failed the same test, but may then fail in regions where it passed the test previously. If the aim is to find configurations of the physical entity which result in the physical entity passing a test for all tested ranges of test or selection conditions, this can be very time-consuming. The amount of time and resources used, particularly if the number of test or selection conditions over which the test is to be conducted is high, or if any one of the test conditions can take a wide range of possible values or states over which the test needs to be repeated, can escalate to impractical levels.
As an example, transceiver devices in communications systems amplify an input signal to boost its output for retransmission into free space. Such devices can use digital pre-distortion, DPD, to adjust the power amplifier of the transceiver to linearize the amplification of the output signal over a range of frequencies. Some transceivers can be configured with radio settings which enable the transceiver to output a signal for transmission over a variety of different types and numbers of carrier networks (for example, a number of different long term evolution, LTE carrier networks as well as a number of GSM carrier networks). However, a single configuration of the DPD of the transceiver does not work over the full range of radio settings.
A SOM algorithm is an unsupervised competitive learning neural network type of algorithm which implements a particular linear projection from a high dimensional input data space into a lower dimensional arrangement of neurons. A SOM model can be used to classify data, for example, by discovering and generating a representation of particular areas of an input space in the form of clusters of neurons on the SOM mesh. The clusters result from the way that each individual neuron of the SOM model competes to have its weights adapted to conform with a selected input vector of the input data and influences its neighborhood.
In a conventional SOM ML model, each neuron competes individually to be mapped to an input vector based on its closeness to an input vector in a traditional SOM model. The winning neuron is the neuron whose weight vectors are closest to the corresponding weights of a selected input vector. The winning neurons' weights are then updated to match those of the input vector. A similar weight adaptation is then performed on the weights of a number of neighboring neurons using a neighborhood function. The process of selecting input vectors from the input space is repeated until the entire input space has been mapped to neurons on the SOM mesh. In this manner the SOM model is trained using the input space to present the input space as an ordered structure on the SOM mesh.
A conventional SOM model mapping is affected by the random order of the input vector selection. This makes conventional SOM models unsuitable for exploring very large data sets iteratively, as they cannot be relied upon to consistently map the large data sets into the same map structures each time the SOM is regenerated.
In addition, the higher the dimensionality of the input vector, the more challenging it is for a SOM ML model to form clusters in a low dimensional space and the larger the likelihood of errors.
The preferred aspects and embodiments of the disclosed technology are set out in the accompanying claims and following clauses.
The disclosed embodiments use a data pruning tool comprising a SOM ML model which can be iteratively used to implement a method of finding one or more regions of interest, ROI, within multi-dimensional data set of test-cases or parameter sets. Each test-case or parameter set comprises at least a test-identifier (or a parameter identifier) and a set of multiple different test or selection parameter values, and a test result or category indicator, or some other type of assessed characteristic of a configurable physical entity. Each test or selection parameter value represents a value or state of a test or selection condition which existed when a particular configuration of a configurable physical entity, such as a transceiver device was being tested.
By performing the method of finding one or more regions of interest, ROI, the ranges of each test (or selection) parameter value for a test (or selection) condition present when the test was conducted (or some other type of assessment of a characteristic of the configurable physical entity was conduction), and failed by a particular configuration of the physical entity are determined. A new configuration of the physical entity can then be retested (or reassessed) and the range of each of the N test (or selection) conditions for the re-test/re-assessment limited to just the ranges associated with each of the one or more regions of interest. In this manner, a set of configurations of the physical entity can be found which the physical entity can adopt to pass the test/assessment over the original ranges of N test or selection conditions.
One aspect of the disclosed technology relates to a method for determining one or more regions of interest in a multi-dimensional data set comprising a plurality of parameter sets, each parameter set comprising a parameter set identifier, a plurality of dimensions of selection conditions for assessing a configurable physical entity, and an indication of an assessed characteristic of the configurable physical entity, the method comprising: mapping, using a SOM model which uses competitive group learning, the multi-dimensional data set onto an edge-connected surface mesh of neurons; identifying at least one cluster of neurons on the surface mesh based on a category of the assessed characteristic; identifying a set of ranges of boundary values for the selection conditions for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that selection condition of the neurons in that cluster; and determining one or more regions of interest which associate the boundary values of the selection conditions of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster.
In some embodiments, the number of different ranges comprising boundary values for each of the selection conditions is less than the total number of selection conditions. This may be implemented, for example, to reduce the number of selection conditions used for the cluster analysis.
In some embodiments, using the SOM model comprises: generating a representation of the parameter sets of the multi-dimensional data set on an edge-connected SOM surface mesh comprising a plurality of neurons, each individual parameter set being allocated to a selected neuron, wherein using the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual parameter set when a collective correlation of the individual parameter set with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual parameter set with all other possible collections of adjacent neurons.
In some embodiments, the method further comprises transforming the edge-connected surface mesh to a two-dimensional planar surface mesh prior to generating the regions of interest. For example, a toroidal or hypertoroidal mesh can be transformed into an edged planar surface mesh to reduce the computational complexity associated with using a continuous surface mesh. The transformation can take place at any point where it is advantageous to reduce the computational complexity.
In some embodiments, the method further comprises resizing at least one cluster to have a size matching or exceeding a predefined ratio of one category of the assessed characteristic to another category of the assessed characteristic
In some embodiments, the method further comprises resizing at least one cluster to minimize the number of overlapping dimensions of selection conditions of that cluster with at least one other cluster on the SOM surface mesh.
In some embodiments, the method further comprises: reconfiguring the physical entity and repeating the assessment using the selection conditions of each parameter set associated with a region of interest; updating each parameter set associated with a region of interest in the multi-dimensional data set with at least the result of the repeated assessment; and iteratively repeating the first method aspect using an embodiment with the same SOM model to find if there are any new regions of interest in the updated data set.
In some embodiments, the method further comprises: one or more of the steps of reconfiguring the physical entity and updating each parameter set is controlled or performed manually.
In some embodiments, the method comprises a computer-implemented method.
In some embodiments, the parameter sets comprise a test-case, the plurality of dimensions of selection conditions comprise dimensions of test conditions, and the indication of the assessed characteristic comprises a test result of a test performed on the configurable physical entity under the test conditions.
In some embodiments, the configurable physical entity comprises a transceiver including a configurable DPD unit, the test conditions comprise radio settings for testing the transceiver, and the test comprises a transceiver test performed on the output signal of the transceiver.
In some embodiments, the assessed characteristic comprises a fail test result category if the peak output power of the output signal of the transceiver exceeds a regulatory standard body spectrum mask for peak output power for one or more carrier networks.
In some embodiments, the radio settings for testing the transceiver comprise the number or LTE carrier networks, the number of GSM carrier networks, the instantaneous bandwidth and the occupied bandwidth for the signal output by the transceiver.
In some embodiments, the configurable physical entity is one of: a configurable substance, such as, for example, a glass or concrete or other material or substance; a configurable device; or a device including a configurable component. Some other examples of configurable substances include food substances, medicinal substances, and liquid and gas substances, which can be configured with different relative proportions of the same constituent materials or chemical.
A second aspect of the disclosed technology comprises a method for determining one or more regions of interest in a multi-dimensional data set comprising a plurality of transceiver test cases, each transceiver test case comprising a test case identifier, plurality of radio settings for testing a configurable transceiver, and an indication of a test result of the transceiver test case for that plurality of radio settings, the method comprising: mapping, using a SOM model which uses competitive group learning, the multi-dimensional data set of test cases onto an edge-connected toroidal surface mesh of neurons; identifying at least one cluster of neurons on the surface mesh based on the test result category of transceiver test; determining a set of ranges comprising boundary values for each radio setting for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that radio setting of the neurons in that cluster; and determining one or more regions of interest which associate each of the sets of radio setting boundary values of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster which failed the transceiver test.
In some embodiments, the method comprises a computer-implemented method.
In some embodiments, the number of different ranges comprising boundary values for each of the test conditions is less than the total number of test conditions. This may be implemented, for example, to reduce the number of test conditions used for the cluster analysis.
In some embodiments, using the SOM model comprises: generating an representation of the test cases of the multi-dimensional data set on an edge-connected SOM surface mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons.
In some embodiments, the method further comprises transforming the edge-connected surface mesh to a two-dimensional planar edged surface mesh prior to the step of identifying at least one cluster.
In some embodiments, the indication of a test result of the transceiver test comprises a test fail if the peak output power of the output signal of the transceiver exceeds a regulatory standard body spectrum mask for peak output power for one or more carrier networks.
In some embodiments, the method further comprises resizing at least one cluster to have a size matching or exceeding a predefined ratio of test fails to test passes.
In some embodiments, the method further comprises resizing at least one cluster to minimize the number of overlapping dimensions of radio settings of that cluster with at least one other cluster.
In some embodiments, the method further comprises: reconfiguring the transceiver and repeating the test using the radio settings of each test case associated with a region of interest; updating each test case associated with a region of interest in the multi-dimensional data set with at least the result of the repeated test; and iteratively repeating the steps of any embodiment of the second aspect using the same SOM model to find if there are any new regions of interest in the updated data set.
In some embodiments, the reconfiguring and/or the updating may be performed manually.
A third aspect of the disclosed technology comprises a method for determining regions of interest in a multi-dimensional input space, wherein the multi-dimensional input space represents a plurality of test cases for use with each of one or more radio settings of a transceiver device, the method comprising the following steps: analyzing the plurality of test cases using a self-organizing maps model to provide a representation of the test cases on a toroidal mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons; converting the toroidal mesh representation into a two-dimensional representation, associating test results for each of the plurality of test cases with the respective neuron, identifying one or more clusters of neurons within the two-dimensional representation based on the test results, and associating one or more regions of interest in the multi-dimensional input space with the one or more identified clusters of neurons within the two-dimensional representation.
In some embodiments of the third aspect, the method is a computer-implemented method.
In some embodiments, the radio settings are used to test the transceiver over a range of one or more of different frequency ranges, modulation types, and bandwidths.
A fourth aspect of the disclosed technology comprises a method of testing a transceiver having configurable digital pre-distortion DPD, the test comprising: determining one or more regions of interest in a multi-dimensional data set of test cases using a group learning SOM model to determine at least one region of interest comprising a set of boundary values of a plurality of radio settings for testing the transceiver where a first configuration of the DPD results in the transceiver failing a transceiver peak power spectrum output test; reconfiguring the DPD with a different set of linearization parameters; retesting the transceiver with the reconfigured DPD using radio settings of each test-case in the at least one region of interest; updating the multi-dimensional data set of test cases with at least a new test result for each retested test case; and and repeating the method of the first step using the same SOM model configuration to determine if there are one or more regions where the new configuration of the DPD results in the transceiver failing the transceiver peak power spectrum output.
In some embodiments, the SOM model provides a representation of the test cases on a toroidal mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the SOM model determines a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons.
In some embodiments, the radio settings used to test the transceiver over a range of one or more of different frequency ranges, modulation types, and bandwidths.
In some embodiments, the method of the fourth aspect is a computer-implemented method.
In some embodiments, the configuration of the DPD using different linearization parameters is automated using a computerized test-set up for performing an embodiment of the fourth aspect.
A fifth aspect of the disclosed technology comprises apparatus comprising means configured to perform the steps of an embodiment of any one of the first to fourth method aspects.
In some embodiments of the fifth aspect, the apparatus comprising means configured to perform the steps of an embodiment of any one of the first to fourth method aspects comprises a memory, at least one processor, and computer code stored in the memory which, when executed by the at least one processor, causes or configures the apparatus to perform the steps of an embodiment of any one of the first to fourth method aspects.
In some embodiments, the computer code is configured as a plurality of modules.
A sixth aspect of the disclosed technology comprises apparatus comprising memory, at least one processor, and computer code stored in the memory which, when executed by the at least one processor, causes the apparatus to perform the steps of an embodiment of any one of the first to fourth method aspects.
A seventh aspect of the disclosed technology comprises a machine executable computer-program product, comprising computer code which, when executed on an embodiment of an apparatus according to the fifth or sixth aspect causes the apparatus to perform the steps of an embodiment of any one of the first to fourth method aspects.
The apparatus implementing any of the disclosed embodiments of a method aspect comprises in some embodiments a data pruning tool according to any of the disclosed embodiments.
An eighth aspect of the disclosed technology comprises an apparatus or processing circuitry configured to determine one or more regions of interest in a multi-dimensional data set comprising a plurality of parameter sets, each parameter set comprising a parameter set identifier, a plurality of dimensions of selection conditions for assessing a configurable physical entity, and an indication of an assessed characteristic of the configurable physical entity.
In some embodiments, the apparatus or processing circuitry is configured to or comprises: a mapping module for mapping, using a SOM model which uses competitive group learning, the multi-dimensional data set onto an edge-connected surface mesh of neurons; an identifying module for identifying at least one cluster of neurons on the surface mesh based on a category of the assessed characteristic; another identifying or determining module for identifying or determining a set of ranges of boundary values for the selection conditions for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that selection condition of the neurons in that cluster; and a module for determining one or more regions of interest which associate the boundary values of the selection conditions of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster.
An ninth aspect of the disclosed technology comprises an apparatus or processing circuitry configured to determine one or more regions of interest in a multi-dimensional data set comprising a plurality of transceiver test cases, each transceiver test case comprising a test case identifier, plurality of radio settings for testing a configurable transceiver, and an indication of a test result of the transceiver test case for that plurality of radio settings.
In some embodiments, the apparatus or processing circuitry is configured to or comprises: a mapping module configured to map, using a SOM model which uses competitive group learning, the multi-dimensional data set of test cases onto an edge-connected toroidal surface mesh of neurons; an identifying or determining module configured to identify or determine at least one cluster of neurons on the surface mesh based on the test result category of transceiver test; an identifying or determining module configured to identify or determine a set of ranges comprising boundary values for each radio setting for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that radio setting of the neurons in that cluster; and an identifying or determining module configured to identify or determine one or more regions of interest which associate each of the sets of radio setting boundary values of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster which failed the transceiver test.
A tenth aspect of the disclosed technology comprises an apparatus or processing circuitry configured to determine regions of interest in a multi-dimensional input space, wherein the multi-dimensional input space represents a plurality of test cases for use with each of one or more radio settings of a transceiver device. For example, apparatus or processing circuitry configured to perform any one of the first, second, third or fourth method aspects. In some embodiments, the apparatus or processing circuitry is configured to or comprises a data pruning tool.
In some embodiments, the apparatus or processing circuitry method is configured to or comprises one or modules configured to perform: analyzing the plurality of test cases using a self-organizing maps model to provide a representation of the test cases on a toroidal mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons; converting the toroidal mesh representation into a two-dimensional representation, associating test results for each of the plurality of test cases with the respective neuron, identifying one or more clusters of neurons within the two-dimensional representation based on the test results, and associating one or more regions of interest in the multi-dimensional input space with the one or more identified clusters of neurons within the two-dimensional representation.
An eleventh aspect of the invention comprises an apparatus or processing circuitry configured to test a transceiver having configurable digital pre-distortion DPD. In some embodiments, the apparatus or processing circuitry is configured to or comprises: a determining module configured to determine one or more regions of interest in a multi-dimensional data set of test cases using a group learning SOM model to determine at least one region of interest comprising a set of boundary values of a plurality of radio settings for testing the transceiver where a first configuration of the DPD results in the transceiver failing a transceiver peak power spectrum output test; a reconfiguring module configured to reconfigure the DPD with a different set of linearization parameters; a (re)testing module configured to (re)test the transceiver with the reconfigured DPD using radio settings of each test-case in the at least one region of interest; and an updating module configured to update the multi-dimensional data set of test cases with at least a new test result for each retested test case. In some embodiments of the apparatus and/or processing circuity, the same SOM model configuration in the determining module is used repeatedly to determine if there are one or more regions of interest where the new configuration of the DPD results in the transceiver failing the transceiver peak power spectrum output test.
Another aspect of the disclosed technology comprises a computer program, comprising instructions which, when executed in a processing circuitry, cause the processing circuitry to carry out any of the above method aspects. In some embodiments, the computer program comprises the computer code of any of the embodiments of the fifth, sixth, or seventh aspects including computer code.
Another aspect of the disclosed technology comprises a carrier containing the computer program aspect, wherein the carrier is one of an electronic signal, optical signal, radio signal, or computer-readable storage medium.
Another aspect of the disclosed technology comprises a data pruning tool comprising the computer program aspect and processing circuitry for executing the computer program aspect.
The aspects and embodiments of the disclosed technology seek to solve, obviate, mitigate, alleviate or eliminate the problems with known approaches for reducing the complexity of testing or otherwise assessing a configurable physical entity over a set of ranges, each range comprising maximum and minimum values of a plurality of test conditions.
Further objects, features and advantages will appear from the following detailed description of embodiments, which are by way of example only, and with reference being made to the accompanying drawings. The drawings are not necessarily to scale, emphasis instead being placed upon schematically illustrating the example embodiments.
It should be emphasized that the term “comprises/comprising” when used in this specification is taken to specify the presence of stated features, integers, steps, or components, but does not preclude the presence or addition of one or more other features, integers, steps, components, or groups thereof. As used herein, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
Embodiments of the present disclosure will be described and exemplified more fully hereinafter with reference to the accompanying drawings. The solutions disclosed herein can, however, be realized in many different forms and should not be construed as being limited to the embodiments set forth herein.
The features of the above disclosed aspects and embodiments may not be explicitly disclosed in a particular combination in the following description for the sake of brevity but, nonetheless, where a suitable combination would be apparent to anyone of ordinary skill in the art without undue effort the description should be construed to include such a combination of features.
In
Also shown in
Examples of test parameter values for an example embodiment of the transceiver test comprise a parameter value for each of the radio settings used to test the transceiver, for example, the type of network, the bandwidth, the modulation. Some examples of radio settings for the test configuration include an instantaneous bandwidth (IBW) value, an occupied bandwidth value (OBW), a number n of GSM carrier networks (nGSM), an a number n of LTE carrier networks (nLTE).
In some embodiments, a test case for the transceiver test conditions comprises a test identifier, and four parameter values, each value representing one of an IBW value, an OBW value, the n GSM carrier networks and n LTE networks, and a pass/fail indication for the test result category.
In some embodiments, a test result indication may be an indication of a test result category, such as a pass or fail of a particular test, or a test result value.
In the example test set-up shown schematically in
Each ROI 105 which is found using the DPT 104 comprises a set of ranges of test case parameter values for the test conditions within which the test cases are associated with test failures, i.e. each ROI indicates a range for each of the N radio settings of the transceiver within which the output signal 118 of the transceiver 110 failed the transceiver test.
A tester or user of the test set-up (which may be a human or a machine or robot) is then able to re-test a new DPD configuration for the transceiver only over the range set associated with that ROI. In other words, it is only necessary to repeat the test for those test-cases using a new DPD configuration over the radio setting ranges associated with each ROI the DPT 104 finds.
A re-test may be performed by selecting a test-case from a ROI and assigning a new set of linearization parameters to reconfigure the DPD of the transceiver 110. The same transceiver test is then repeated over the radio settings of the ROI (which correspond to where the previous DPD configuration resulted in the transceiver failing the test).
The new test case and its test result can then be added to the data-set 100 of test-cases and the process repeated by inputting the updated data-set 100 to find if there are any regions of interest where the transceiver with new DPD configuration also failed to pass the transceiver test.
The retest process can be reiterated using the DPT 104 until a set of DPD configurations has been found which can be used to configure the transceiver for various range of radio settings. This enables the output signal 118 of the transceiver to always pass the transceiver test over the full tested range of radio settings providing the transceiver is configured correctly.
In some embodiments of a test-set up such as
In some embodiments of a test-set up such as
In some embodiments, the configurable physical entity comprises a configurable or re-configurable device, such as,
In some embodiments, the configurable device is configured using a plurality of device settings to have (or in some embodiments, to cause to be manifested in the device or another device) a testable or measurable or otherwise assessable (for example, a detectable) physical condition, state, attribute, or other characteristic which is dependent on a configuration of the device settings. An example of a measurable characteristic which is affected by a test condition comprises a characteristic of a signal output by the device, such as a peak power spectrum of the signal output by the transceiver.
A test refers to a test or selection or measurement or other form of assessment of a measurable physical state and/or characteristic and/or attribute of the configurable physical entity conducted under at least one test condition. A test condition is a condition under which a test is conducted. In some embodiments, a test condition may comprise a selection or assessment constraint for the test. A test condition for testing a physical device can comprises an internal state or condition (e.g. a setting of the device) or an external condition or state, for example, an ambient or air temperature for that device to have when the test takes place. A test result may be provided as a metric, a probability or confidence score, a relative value or ratio, an absolute value, or as a category (e.g. a pass or fail of the test). A set of one or more test conditions accordingly define a test in a test case. In some embodiments, a test condition is an invariant or static condition for the duration of a test.
A test case comprises a data record a test of a configurable physical entity. A test case includes set of parameter values which represent a set of test conditions which defined the conditions under which the test was conducted. In some embodiments, the test case is associated with a test result metric and/or a test result category. Each test case is associated with a particular test set up which defines one or more test or measurement criteria which are assessed by the test and a set of one or more the rules for passing the test.
In the general embodiment of
Each ROI 106 comprises one or more ranges for the test or selection conditions a cluster of test cases which meets certain cluster selection conditions, for example, which contain a certain number of test cases with a particular test result. Each range for at least one, or each (as in all) of the n-dimensions of test or selection conditions, in other words the maximum and minimum values for each test or selection parameter of a cluster of test cases or parameter sets which were found by the DPT to include a particular result category, for example, in the case of the transceiver, which were found to have failed the transceiver test. The tests (or assessments) associated with the test-IDs (or parameter set IDs) within each ROI are then repeated. Each test/assessment ID can be used to look-up a set of test/assessment/selection conditions under which the test was previously conducted. This allows the test (by which term is meant any suitable form of assessment of a measurable characteristic) to be repeated for those test/assessment conditions with a new configuration of the physical entity.
As only test/assessments which are within a set of ranges of test/assessment conditions associated with each ROI are extracted, far fewer tests need to be repeated than would be required if the test was repeated over the various possible combinations and ranges of test conditions using the new configuration of the physical entity.
Once a test has been repeated with the new configuration, a test result is created, and in some embodiments, a new test result category is determined. The new test cases data for each re-test is then added to the data set 100 by updating the test data for that test case using the test-case ID.
In some embodiments, although the test/selection conditions of the retest have not changed for that test-case, the test result metric and/or a test result category may have changed, for example, from a fail to a pass.
The process can be repeated until a set of configurations are found to configure the physical entity so it passes the test over the entire range of test conditions of the original data set 100.
In some embodiments, new test-cases are added to the data-set to interpolate within the values of the test conditions of existing test-cases within the boundary values of each ROI.
One example of such a substance comprises a glass having a particular chemical composition. In some embodiments, a various of compositions of the physical entity comprise various chemical compositions of the glass. In some embodiments, the test assesses if the glass will shatter under over various test conditions, for example, if the glass will shatter above a particular temperature, if the glass will shatter if used in a particular way, if the glass will shatter if made in a particular way. By testing the glass to see if it is suitable for a particular type of use and/or if it can be made using a particular manufacturing method, it is possible to determine categories of test results for particular compositions of glass to shatter/not shatter. If a glass shatters, this indicates it is not suitable for that particular type of use and/or not being suitable for being made a particular way, another composition of glass is picked and the test repeated. In some embodiments, glass test comprises a plurality of different selection conditions including one which provides an indication of whether a composition of glass substances is suitable for a certain use or has a physical property. For example, a glass may have a characteristic indicating it is suitable for use as a safety glass, or as high-impact glass, or as self-cleaning glass, or for use as a high-temperature cooking container etc. The associated glass properties can be measured by performing appropriate tests.
Some embodiments of the DPT 104 of
Other embodiments of DPT 104 for such other embodiments of test-conditions may be used, for example, in an embodiment of a test set-up as shown in
Describing the test-set-up shown in
Examples of other data which a test record 202 may include comprise information about a current test and/or a history of the configuration of the physical entity which was tested under the test conditions of that test case. Each test case input 102 comprises a set of N test conditions for a test. If the test is repeated, for example, with a different configuration of the physical entity, the test-case is updated, and the previously tested configuration may be maintained in a test-history as other information associated with the test-case.
The cluster information which may be stored in association with a test-case ID includes at least a cluster identifier, ID, which identifies which cluster that test-case has been assigned to by the DPT 104. The cluster ID for each test-case is used by GP module 1000A and OP module 1100A of the DPT 104 which respectively generate an unoptimized range set comprising an unoptimized set of boundary values for each of the N dimensions of test conditions of the test cases which belong to that cluster identifier and an optimized range set comprising optimized range values found by OP module 1100A of DPT 104. Each test-case record 202 may also include other cluster information such as the maximum and minimum values of the weights for each dimension or test-condition of the cluster which are found by the GP module 1000A and OP module 1100A.
The cluster information comprising the cluster ID and the range of weights or test-conditions it is associated with is also used by the Get Info module which is configured to extract all of the test case identifiers in a cluster for a particular test result category and associate these with the ranges of the test conditions of that cluster to form a region of interest for retesting with a different configuration of the physical entity . In the case of the transceiver test, a region of interest compromises all test case identifiers for failed tests in a cluster.
In some example embodiments of the transceiver test-setup, test-case input 102 to the DPT 104 shown in
SOM module 700A receives the test id and the test conditions which in this example embodiment comprises four radio settings for the transceiver to output a signal suitable for being carried over a number of LTE carrier networks (represented by a value n for an LTE parameter), a number of GSM carrier networks (represented in the test case by a number n of GSM carrier networks, the instantaneous bandwidth (IBW) (represented by a frequency value), the occupied bandwidth (OBW) (represented by another frequency value). For example, a test-case record 202 could input a set of values for nLTE=2, nGSM=0, IBW=600 MHz, OBW=540 MHz, as the test case data input 102 to the SOM module 700A of DPT 104. The SOM module 700A will map these values weights of neurons on its surface mesh and retains with each mapped neuron the test ID so that this can be used by SCA module 900A to form clusters of neurons which are predominantly or wholly associated with a particular test result category, for example, to cluster neurons representing test fails. Details of the operations that SOM module 700A, SCA module 900A (and the other modules of the DPT 104) perform are described later on.
In some embodiments, each record 202 associated with a test-case ID in the data base also comprises additional items of information, for example, a carrier type, power, and location—for example, LTE 700 MHz center at x MHz, LTE 4 MHz center at y MHZ. A log may be included to show how may DPD restarts have been made (i.e. new configurations of the DPD found for that test case), and other information such as crest, EVM enable, carrier modulation, and total power not included in the test case input 102 to the DPD 104.
Each record 202 also includes data items for each cluster ID for each cluster identified by the DPT 104 together with the maximum and minimum values for each of the radio settings for the test cases mapped to that cluster. For example, each range set of radio conditions of a cluster to which the test case was mapped may be indicated as: IBWmin<IBW<IBWmax, OBWmin<OBW<OBWmax, nGSMmin<=nGSM<=nGSMmax, nLTEmin<=nLTE<nLTEmax , for example, 550 MHz <IBW<650 MHz, 554 MHz<OBW<704 MHz, 0<=nGSM<=2, 0<=nLTE<3. Different range set values may be provided for the same cluster ID to represent the unoptimized ranges of values and the optimized ranges of values.
The transceiver test 120 in
In some embodiments, test 120 is also configured to automatically reconfigure the transceiver by obtaining new sets of linearization parameters for automatically configuring the DPD 112 for retests from a data source such as another database 122 in
In some embodiments, the transceiver test result is represented pass or fail result category indicator as shown in
In some embodiments, instead or in addition, a test result value or other performance metric or value is used. One example of a different test result comprises a value indicating a relative strength of the peak power spectrum of the signal 118 compared to the value of the regulatory spectrum mask which may be also stored in a test case record 202 and/or provided to the DPT 104 so that test cases with results which share the same values can be classified into clusters using the SOM ML model. Another example comprises a test result which can be represented by a value +2 db indicating the test was failed and the peak power spectrum output of signal 118 was 2 db above the regulatory spectrum mask (a −2 db value test result in contrast would indicate the test was passed and that the peak power spectrum output was 2 db below the regulatory spectrum mask).
In
The SOM module 700A performs a process which maps input to the DPT to a SOM surface (step 700 in
The Get Info module 1200A performs process step 1200 in
In some embodiments, information about one or more regions of interest, ROIs, 106 found by the DPT 104 are automatically accessed by the test set-up 120 so that the test-cases included in an ROI can be updated with re-test information, but in other embodiments, this information can be manually extracted from the database 200.
An embodiment of the DPT shown in
Some embodiments of the computer-implemented method 300 for determining one or more regions of interest in a multi-dimensional data set can be used on a multi-dimensional data set which comprise a plurality of parameter sets, each parameter set comprising a parameter set identifier, N dimensions of selection conditions for a configurable physical entity, and an indication of a measured characteristic of the configurable physical entity. It will be appreciated that some of the steps shown for method 300 in
For example, one embodiment of method 300, which can be implemented using a suitable embodiment of DPT 104, for example, in the example set up of
In some embodiments of method 300, the number of different ranges comprising boundary values for each of the selection conditions is less than the total number of selection conditions, for example, if one of the selection conditions is not to be taken into account for the cluster analysis.
Another embodiment of the method 300 shown in
In some embodiments, the method comprises a computer-implemented method.
In some of the embodiments of the above embodiments of the method 300, the indication of a test result of the transceiver test comprises a test fail if the peak output power of the output signal of the transceiver exceeds a regulatory standard body spectrum mask for peak output power for one or more carrier networks. In some embodiments, the above method 300 further comprises resizing at least one cluster to have a size matching or exceeding a predefined ratio of test fails to test passes. The re-sizing may be performed by the SCA module 900A or the OP module 1100A shown in
In some embodiments, using the SOM model in method 300, comprises: generating a representation of the parameter sets or the test cases of the multi-dimensional data set on an edge-connected, for example, a toroidal or hypertoroidal, SOM surface mesh comprising a plurality of neurons, each individual parameter set or test case being allocated to a selected neuron, wherein the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual parameter set or test case when a collective correlation of the individual parameter set or test case with the collection of adjacent neurons has a value that is greater than any collective correlation of that individual parameter set or test case with all other possible collections of adjacent neurons.
In some embodiments of method 300, the method further comprises an optional transforming step (800) where the edge-connected surface mesh is transformed to a two-dimensional planar surface mesh prior to generating the regions of interest. This step may be omitted in some embodiments, or occur at another point that the point where it is indicated as being performed by the DPD 104 in
In some embodiments of method 300, the identify cluster process step 900 and/or the optimize range sets and clusters process step 1100 comprises resizing at least one cluster to have a size matching or exceeding a predefined ratio of one category of the assessed characteristic to another category of the assessed characteristic.
In some embodiments of method 300, the method comprises resizing at least one cluster to minimize the number of overlapping dimensions of radio settings of that cluster with at least one other cluster.
In some embodiments of method 300, the optimize range sets and clusters process step 1100 comprises: resizing at least one cluster to minimize the number of overlapping dimensions of selection conditions of that cluster with at least one other cluster on the SOM surface mesh.
For example, OP module 1100A may resize a cluster by finding the closest neighbouring cluster on the SOM mesh and joining the two clusters together.
Yet another embodiment of method 300 shown in
In some embodiments, the radio settings are used to test the transceiver over a range of one or more of different frequency ranges, modulation types, and bandwidths.
In some embodiments, the test- set-up performs the method of testing 1400 by performing a test-run comprising a series of tests, each test using test conditions of a test-case which are extracted from the database 200 using the test-ids. This allows the same set of N test conditions to be used in a re-test with a new configuration of the physical entity.
This greatly reduces the amount of re-testing that needs to be done, as only the range of test conditions associated with a ROI need to be retested with the new configuration. Each test performed on the reconfigured physical entity can then be added to the data-set of test cases by updating the test-case data record 202 and the DPT 104 can be re-used if necessary to identify one or more regions of interest where the new configuration does not result in a test pass. In this manner, the DPT (104) can be used in a method of testing (shown as step 1400 in
In some embodiments of method 300, process sets 700 to 1200 are iteratively repeated using the same configuration of the SOM model after updating the multi-dimensional data set to include at least one updated or new test case found in a region of interest as the test-case was had a test fail result. Each updated test case record retains its test case identifier and the values for the N dimensions of radio settings used to test each configuration of the transceiver, the new test-result information, and information to indicate the current configuration and any configuration history information.
In some embodiments of method 300, the parameter sets comprise a test-case, the dimensions of selection conditions comprise dimensions of test conditions, and the indication of the measured characteristic comprises a test result of a test performed on the configurable physical entity under the test conditions. For example, in some embodiments of method 300, such as that which may be used by the DPD of
Using the DPT 104 enables a test set-up or system for implementing a series of tests such as test 120 of
In some embodiments, the configurable physical entity shown in
In some embodiments, the configurable physical entity comprises a substance configurable to have various different ratios of chemical components or other constituent substances. The substance may comprises a glass, a material or a medicine such as a drug. In this manner, it is possible reduce the amount of retests performed on such substances to determine what chemical compositions of the substance will result in the substance passing a test over the range set of test conditions.
Advantageously, by suitably configuring the group size of SOM model 700 based on the number of test-cases provided as input 102 to the SOM ML model module 700A and the size of the surface mesh, the surface map of the SOM ML model becomes less random and more repeatable, allowing the same or similar clusters on the mesh surface as were generated in the previous iteration of the method 300 to be repeatedly found. This also results in the method of testing using fewer computational resources over a smaller amount of time, as it enables each region of interest where the new configuration of the physical entity has failed the test to be determined.
The initialisation defines the surface mesh size (step 608) where the surface mesh is edge connected to form a hypertoroid so that this is suitably larger than the number of test-cases to be mapped to neurons on the mesh-points. For example, a mesh of 40×40 neurons may be formed. The weights of the neurons on the mesh-points are then randomised (step 610) to a normalised scale. As each input vector comprises n=4 dimensions, each neuron is randomly assigned four weights on a normalised scale. The adjacency or radius of the groups of neurons from a central neuron which defines the size of the group to used by the SOM model 700 for collective correlation depending on the way neurons are interconnected on the surface mesh is then defined (step 610). For example, a fully interconnected surface mesh of neurons such as that shown in
In
In
An edge-connected surface mesh refers to a mesh in which each meshpoint has an equal number of adjacent neighboring mesh-points.
The best matching neuron, BMN, of the BMG is then determined (step 706) by finding the neuron of the BMG which has the maximum group correlation to the selected input vector and the test identifier. Depending on the group radius, there may or may not be a central neuron.
The test id and weights associated with the input vector are then assigned (step 708) to the BMN (the central neuron of the BMG, the winning group).
Next a neighborhood effect transformation is applied to apply a similar weight transformation to neurons in the neighborhood of the BMN (step 710). An example of a suitable neighborhood function is a neighborhood function determining how weights are decrementally adjusted as the neuron's distance from the BMN increases. For example, one suitable neighborhood function known in the art expresses the distance over which neighboring weights are updated using a Euclidean distance function:
Euclidian distance=√{square root over (Σk=0r type 2(x−a)2)}
where r type 2 is the radius of the update (to minimize the time of operation (as updates are minimal for greater distances), in which case each new weight of a neighboring function is determined by the old weight plus the magnitude (+/−) of the update to the BMN multiplied by the weight change to the BMN multiplied by a function, for example, by a Gaussian function of the Euclidian distance (e.g. e-beta*distance) where beta represents the sharpness of the Gaussian curve, which will affect how sharply the magnitude of the updates fall for neighboring neurons which are further away from the BMN.
Each input vector j is then removed from the training data set or suitably tagged or otherwise marked in the training data 102, so that it is not selected again as it has already been mapped to a neuron on the SOM mesh (step 712). After this, a check (step 714) is performed to determine if all the input vectors of the training data set 102 have been mapped and if not, the process returns to step 702 to select another input vector from the training data 102) until all the input vectors have been mapped and the SOM model training phase ends.
In
where r type 1 here means the group radius from the central neuron (=1 in the example embodiment illustrated in
An example embodiment to illustrate steps performed when initializing and mapping using the SOM module (steps 600 and 700 respectively in
Define a parametric sized 2D mesh whose edges are connected(toroid), for example, a 40×40 (total 1600 neurons) mesh.
Randomize the weights on normalized scale; here for example, 4 weight values (because of input dimensions) for each 1600 neurons.
Define the adjacency radius greater than or equal to 1 for the training groups on the SOM mesh, for example an adjacency radius of 1 means 9 neurons with a center neuron as the best matching or king neuron. If the adjacency radius is zero, then there is no group stage, and a generic SOM mapping would be implemented.
The numbers below and in each of the following pseudocode examples are for illustrative worked examples only as will be apparent to any one of ordinary skill in the art. For each input test id (1 of 800 samples in the representational input space)
For each weight of neuron (1 of 4, as there are N dimensions in this example)
Sum correlation of each neuron of the army to determine the training group correlation.
Find max correlation for all training groups on the edged-connected mesh to determine the winning training group
Find best neuron of wining group (in this case this will always be the central neuron) and update the weights of that best neuron to those of the input vector representing that input test id
Assign the test ID number to that wining neuron (and exclude this neuron from the next iteration using the other test-ids)
Apply neighborhood effect on parametric sized radius r type 2 (see the neighborhood function example described above)
In the example of
The effect of the transformation on the structure of the neurons located on the surface mesh can be seen in
This reduces the number of computations required for the DPT to generate the regions of interest in the output data set and so results in a technical benefit as power is saved as fewer computational resources are required and also as the process of obtaining the output is sped up.
Each rectangular box in
Those skilled in the art will appreciate that other tests may be used for testing the transceiver output and/or for testing other configurable physical entities, and that a test may comprises more than one test or selection condition .
In
In some embodiments of the SOM such as that shown schematically in
In some embodiments, the mesh size is dynamically adjusted to enable the data clusters to be sufficiently separated on the mesh surface. If the input test data is not well correlated, then there will be large numbers of smaller clusters on the mesh surface, and a larger mesh surface may be required. In some embodiments, the SCA algorithm implementing step 900 automatically adjusts the originally initialized mesh surface to increase the mesh surface (for example, to 3.5 or 4 times the number of input vectors which are to be mapped to the mesh) to ensure sufficient separation of the clusters.
In the example embodiment of the DPT 104 shown in
In
An example of a pseudo code based embodiment of the steps performed by the toroid to 2D module 800 follows.
An example of pseudocode for implementing the steps which are performed by module 800 to transform the toroid surface to a 2D surface according to the method of
Find empty space in x and y axis in the mesh (step 802). Else save the x axis ‘a’ value and y axis ‘b’ value.
Now shift the x axis data by a value and y axis data by b values.
If empty does not exist, then increase dimension by 20% and repeat the SOM apart again.
This results in a mesh which is ready to be treated as a 2D mesh.
Apply next set of algorithms which are good for 2D rather than toroid.
The example process illustrated in
Any neurons complying with the test selection condition(s) found in the neighborhood are associated with the selected neuron in (step 908) to form a cluster. Each new cluster is assigned a cluster ID which is then stored in database 200 in association with the relevant test case records 202 for the test case training data 102 represented by each neuron in the cluster as the cluster grows.
After all meshpoints on the surface SOM have been checked, the neurons on the surface mesh will have been classified into clusters mostly or wholly associated with neurons representing test cases where the transceiver test was passed in the embodiment of the DPT 104 shown in
A pseudocode example is now given for a mesh having 1600 meshpoints (for a 40×40 2D SOM surface mesh) where the training data set 192 comprise input vectors representing 800 transceiver test cases meaning some 800 surface mesh points will remain unoccupied. The example SCA module 900 for the transceiver test case first checks for occupied meshpoints and then checks to see if these are associated with test case IDs for the transceiver 110 which have passed the selection condition(s) for the output signal of the transceiver 310, 406.
The steps below reflect an illustrative example of possible pseudocode based steps for implementing optimizing boundary values, where parametric parameter values may be user defined.
Apply SCA 900 to find out a cluster. This is defined as follows:
Check each of 1600 neuron. Find the first failing neuron.
Within a third type of parametric radius of this failing case, find the next failing neuron and add it to the cluster.
Boundary cases (parametric boundary setting) are treated as failing case unless they don't have any more neighboring failing case. This means boundary cases help to connect the failing spattered cases together.
Store all the cluster info.
The term parametric radius as used herein may refer to a radius which can be initialized by process 600 for example, or by user input.
In some embodiments, after SCA 900A has completed the cluster identification process (step 900 in
One example embodiment of a process 900 which the GP module 900A implements comprises: selecting a cluster from the one of more initial clusters on the 2D SOM surface mesh (step 1002), determining the maximum and minimum values in each dimension i of the weights Wi of any neuron in the selected cluster (step 1004). The maximum and minimum weights for each test dimension of the cluster are then stored (step 1006) in database 200 as unoptimized range set values associated with the cluster ID. The process then checks (step 1008) for other clusters on the SOM map and if any after found steps 1002,10004,1006 are repeated until in step 1008 no unselected clusters remain and the algorithm performed by GP module 1000A terminates.
In this example, cluster #A section 1 is shown schematically as comprising four surface mesh points, three of which are occupied with neurons whose weights collectively fall with a range of IBW values from a minimum value MINIBW1 to a maximum value MAXIBW1 value, and within the range of OBW values from a minimum value MINOBW1 to a maximum value MAXOBW1 value, and within the range of a number of GSM carriers, nGSM, ranging from a minimum number of carriers MINnGSM1 to a maximum number MAXNGSM1, and within the range of a number of LTE carriers, nLTE, ranging from a minimum number of carriers MINnLTE1 to a maximum number MAXNLTE1. In this example, the black neurons represent test cases having a test result category comprising the test was failed, as the SOM is being used to find clusters of test cases which failed the test for certain test conditions.
In
The output of GP module 1000A is then processed by the OP module components 1100A of the example DPT 104 of
In one embodiment, the cluster size check (step 1106) checks if the number of neurons in a cluster exceeds a predetermined minimum number with the test result category for the cluster formation, and if not, the cluster size is increased, for example, as shown in
In
The example method shown in
In the example embodiment of the transceiver test embodiment of
In some embodiments, the level of sufficient cluster range overlap may be set by determining a minimum number of test dimensions N which must have a range overlap, for example, n>=2 and in some a specific proportion of the test dimensions is it set as an overlap condition for joining two clusters. For example, if there were 10 test dimensions, then if 50% or more (i.e. 5 or more dimensions) overlapped, the clusters would be joined, if 10% or less overlapped (i.e. if n=0 or 1) the clusters would not be joined, and if n=2, 3, or 4, joining the two clusters could be conditional on further checks on size and the test result category ratios both being passed.
In some embodiments, the cluster size increase check may be omitted and/or one or more other condition for overlapping sections to be joined applied instead.
The steps below reflect an example of possible pseudocode for implementing optimizing boundary values, where parametric parameter values can be user-defined in some embodiments.
Now for each cluster
Find if all four optimized boundary values overlap with another.
If all four joins, then join the clusters. But If only three-dimension (75%) predicates overlaps
If 1) and 2) conditions are met, then the clusters joined else the clusters are not joined.
If the range overlap is less than a minimum number, for example, 75%, of the N dimensions (in other words, for the exemplified embodiment where n=4, if less than 3 of the ranges overlap), then do not join the overlapping boundaries. (Here the 75% is also parametric and may be user defined in some embodiments.)
End of overlap analysis.
Check if any range of a test dimension is too small. i.e. number of failing tests <=2) and (failing number of tests +range of boundary values of the test dimension <5) (where 2 and 5 are example values only and are parametric in the sense a user can configure them).
If the range between boundary values of a test dimension is too small, then find the nearest neighbour cluster having a range of boundary values for that test dimension by increasing the range of the boundary values for all test dimensions by 10%, for example, and repeating “a) overlap analysis” steps again. The ranges may be iteratively increased in steps of 10%, for example, until the increases reaches a cut-off, for example, 50% and fails the overlap analysis. Here the size of the incremental steps can be configured by a user as can the size of the cut-off. If no nearest neighbouring cluster can still be found at the 50% cut-off. This can be saved or printed at this point to record this information. Further increase the dimensions until the nearest neighbour is found.
In some embodiments where the test 120 is a transceiver test, an ROI comprises a set of test-ids where the tested DPD configuration of the transceiver 110 failed the transceiver test, i.e., the transceiver output signal 118 with a peak power spectrum which exceed a standards regulatory spectrum mask for the radio settings of the transceiver being tested. If no ROIs are found by the Get Info module 1200A , then that configuration of the DPD 112 of the transceiver 110 passed the test under all of the radio settings which were tested and the testing can end (step 1400). If one or more ROIs are found, however, then another run of tests needs to be performed to find a configuration of the DPD which results in the transceiver passing the test.
In some embodiments, method of testing 1400 is performed by the test set-up 120 shown in
The example embodiment of a method of testing 1400 shown in
In some embodiments method of testing 1400 comprises performing the method (300) and further performing: reconfiguring (1402) the transceiver and repeating (step 1404) the test using the radio settings of each test case associated with a region of interest; updating (1406) each test case associated with a region of interest in the multi-dimensional data set with at least the result of the repeated test; and iteratively repeating steps 700 to 1300 of method 300 using the same SOM model in DPT 104 to find if there are any new regions of interest in the updated data set input into the DPT (step 1408).
The embodiment method of testing (1400) shown in
In some embodiments, the test cases for the retests are automatically updated and once the test-run is completed, the updated data set 100 is input into the DPT 104 to find if there are any new ROls (step 1408), and steps 700 to 1200 of the method (300) of determining one or more regions of interest is repeated, and the test ids for any new ROls are obtained (step 1300) If output from the DPT 104 does not include any new ROI, the test has been passed with the new configuration over the ranges represented by the previous ROI (and the step ends). If the DPT finds new ROIs, the process repeats, until no ROI are found.
In some embodiments, the method of testing (1400) tests a transceiver having a configurable digital pre-distortion DPD unit, the method comprising: performing a method for determining one or more regions of interest in a multi-dimensional data set of test cases using a group learning SOM model to determine at least one region of interest comprising a set of boundary values of a plurality of radio settings for testing the transceiver where a first configuration of the DPD results in the transceiver failing a transceiver peak power spectrum output test; reconfiguring the DPD with a different set of linearization parameters; retesting the transceiver with the reconfigured DPD; updating the multi-dimensional data set with test cases for each retest of the transceiver; and repeating the method using the same SOM model configuration to determine one or more regions where the new configuration of the DPD results in the transceiver failing the transceiver peak power spectrum output.
In some embodiments, the SOM model provides a representation of the test cases on a toroidal mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the SOM model determines a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons. The radio settings are used to test the transceiver are over a range of one or more of different frequency ranges, modulation types, and bandwidths, for example, to form a run of tests on a particular configuration of the transceiver. In some examples, the method is a computer-implemented method, for example, changing the configuration of the DPD using different linearization parameters is automated using a computerized test-set up in some embodiments of the method of testing.
In
The physical entity is then reconfigured, for example, to have configuration #2 and retested in a second test run as shown schematically in
As shown in the example embodiment of
For example, if the test is a configurable transceiver test where the first test was conducted over a range of IBW values from 425 MHz to 575 MHz, if test IDs from 56 to 404 are associated with ROI cluster #A which has a range of IBW values from 450 MHz to 475 MHz, and test case IDs from 808 to 910 are associated with ROI cluster #B which has a range of IBW values from 500 MHz to 550 MHz, then the test needs to only be repeated using the 2nd configuration of the transceiver for IBW values in the range 450 to 475 and 500 to 550 MHz. The result is that three configurations must be used by the transceiver if output signal 118 is to pass the transceiver test for the peak power spectrum output to not exceed a standards regulatory mask over the entire tested range of IBW (for example).
The embodiment of the apparatus illustrated in
The embodiment of the platform 1900 of
In some embodiments, the platform 1900 comprises one or more of the modules 600 to 1400 illustrated in
In the illustrated embodiment of
In some embodiments, the platform comprises means functionally configured to implement any of the disclosed method aspects and embodiments.
In some embodiments, the apparatus comprises memory, at least one processor, and computer code stored in the memory which, when executed by the at least one processor, causes the apparatus to perform the steps of any one of disclosed method aspects and embodiments.
In some embodiments, the SOM ML model arrangement finds regions of interest in a multi-dimensional input space of test case data by reducing the n-dimensional test conditions under which a test is performed to a two dimensional representation of the n-dimensional test conditions on a SOM surface map.
Generally, when an arrangement is referred to herein, it is to be understood as a physical product; e.g., an apparatus. The physical product may comprise one or more parts, such as controlling circuitry in the form of one or more controllers, one or more processors, or the like.
The described embodiments and their equivalents may be realized in software or hardware or a combination thereof. The embodiments may be performed by general purpose circuitry. Examples of general purpose circuitry include digital signal processors (DSP), central processing units (CPU), co-processor units, field programmable gate arrays (FPGA) and other programmable hardware.
Alternatively or additionally, the embodiments may be performed by specialized circuitry, such as application specific integrated circuits (ASIC). The general purpose circuitry and/or the specialized circuitry may, for example, be associated with or comprised in an apparatus such as a wireless communication device.
Embodiments may appear within an electronic apparatus (such as a wireless communication device) comprising arrangements, circuitry, and/or logic according to any of the embodiments described herein. Alternatively or additionally, an electronic apparatus (such as a wireless communication device) may be configured to perform methods according to any of the embodiments described herein.
According to some embodiments, a computer program product comprises a computer readable medium such as, for example a universal serial bus (USB) memory, a plug-in card, an embedded drive or a read only memory (ROM).
In some embodiments of the data pruning tool 104 and/or of the method (300) of determining regions of interest in a representative multi-dimensional input space, the DPT 104 implements method 300 using a computer readable medium which may be stored in memory 1906 and/or executed by one or more processors 1904 of platform 1900. The computer readable medium has stored thereon a computer program comprising program instructions for implementing the method. The computer program is loadable into a data processor such as processor 1904 shown in
In some embodiments, the computer program may, when loaded into and run by the data processing unit 1904, cause execution of method steps according to, for example,
In some embodiments, the machine executable computer-program product, comprises computer code which, when executed on an apparatus such as data platform 1900, causes the apparatus to perform the steps of any one of the disclosed method aspects of embodiments.
Generally, all terms used herein are to be interpreted according to their ordinary meaning in the relevant technical field, unless a different meaning is clearly given and/or is implied from the context in which it is used.
Reference has been made herein to various embodiments. However, a person skilled in the art would recognize numerous variations to the described embodiments that would still fall within the scope of the claims.
For example, the method embodiments described herein discloses example methods through steps being performed in a certain order. However, it is recognized that these sequences of events may take place in another order without departing from the scope of the claims. Furthermore, some method steps may be performed in parallel even though they have been described as being performed in sequence. Thus, the steps of any methods disclosed herein do not have to be performed in the exact order disclosed, unless a step is explicitly described as following or preceding another step and/or where it is implicit that a step follows or precedes another step.
In the same manner, it should be noted that in the description of embodiments, the partition of functional blocks into particular units is by no means intended as limiting. Contrarily, these partitions are merely examples. Functional blocks described herein as one unit may be split into two or more units. Furthermore, functional blocks described herein as being implemented as two or more units may be merged into fewer (e.g. a single) unit.
In some embodiments, the method steps of any of the disclosed methods are implemented in an apparatus comprising the arrangement depicted in
In some embodiments of the platform 1900 shown in the
Some embodiments of the platform 1900 comprise an apparatus or processing circuitry configured to determine one or more regions of interest in a multi-dimensional data set comprising a plurality of parameter sets, each parameter set comprising a parameter set identifier, a plurality of dimensions of selection conditions for assessing a configurable physical entity, and an indication of an assessed characteristic of the configurable physical entity.
In some embodiments, the apparatus or processing circuitry is configured to or comprises: a mapping module for mapping, using a SOM model which uses competitive group learning, the multi-dimensional data set onto an edge-connected surface mesh of neurons; an identifying module for identifying at least one cluster of neurons on the surface mesh based on a category of the assessed characteristic; another identifying or determining module for identifying or determining a set of ranges of boundary values for the selection conditions for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that selection condition of the neurons in that cluster; and a module for determining one or more regions of interest which associate the boundary values of the selection conditions of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster.
Some embodiments of the platform 1900 comprise an apparatus or processing circuitry configured to determine one or more regions of interest in a multi-dimensional data set comprising a plurality of transceiver test cases, each transceiver test case comprising a test case identifier, plurality of radio settings for testing a configurable transceiver, and an indication of a test result of the transceiver test case for that plurality of radio settings.
In some embodiments, the apparatus or processing circuitry is configured to or comprises: a mapping module configured to map, using a SOM model which uses competitive group learning, the multi-dimensional data set of test cases onto an edge-connected toroidal surface mesh of neurons; an identifying or determining module configured to identify or determine at least one cluster of neurons on the surface mesh based on the test result category of transceiver test; an identifying or determining module configured to identify or determine a set of ranges comprising boundary values for each radio setting for each cluster, each range of boundary values comprising a maximum and a minimum weight value of the weights representing that radio setting of the neurons in that cluster; and an identifying or determining module configured to identify or determine one or more regions of interest which associate each of the sets of radio setting boundary values of each cluster with one or more test case identifiers for the test cases represented by the neurons in that cluster which failed the transceiver test.
Some embodiments of the platform 1900 comprise an apparatus or processing circuitry configured to determine regions of interest in a multi-dimensional input space, wherein the multi-dimensional input space represents a plurality of test cases for use with each of one or more radio settings of a transceiver device.
In some embodiments, the apparatus or processing circuitry method is configured to or comprises one or modules configured to perform: analyzing the plurality of test cases using a self-organizing maps model to provide a representation of the test cases on a toroidal mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons; converting the toroidal mesh representation into a two-dimensional representation, associating test results for each of the plurality of test cases with the respective neuron, identifying one or more clusters of neurons within the two-dimensional representation based on the test results, and associating one or more regions of interest in the multi-dimensional input space with the one or more identified clusters of neurons within the two-dimensional representation.
Some embodiments of the platform 1900 comprise an apparatus or processing circuitry configured to test a transceiver having configurable digital pre-distortion DPD.
In some embodiments, the apparatus or processing circuitry is configured to or comprises apparatus or circuity configured to or comprising a set of modules configured to determine one or more regions of interest in a multi-dimensional data set of test cases using a group learning SOM model using an embodiment of any of the disclosed method embodiments, for example, a method according to any of the first to fourth embodiments. Is some embodiments, the apparatus or circuitry is further configured to determine at least one region of interest comprising a set of boundary values of a plurality of radio settings for testing the transceiver where a first configuration of the DPD results in the transceiver failing a transceiver peak power spectrum output test. In some embodiments, the apparatus or processing circuitry is configured to or further comprises a reconfiguring module configured to reconfigure the DPD with a different set of linearization parameters, a (re)testing module configured to (re)test the transceiver with the reconfigured DPD using radio settings of each test-case in the at least one region of interest; and an updating module configured to update the multi-dimensional data set of test cases with at least a new test result for each retested test case
In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises a mapping module using a SOM model to generate a representation of the test cases of the multi-dimensional data set on an edge-connected SOM surface mesh comprising a plurality of neurons, each individual test case being allocated to a selected neuron, wherein using the self-organizing maps model comprises determining a center neuron of a collection of adjacent neurons as the selected neuron for an individual test case when a collective correlation of the individual test case with the collection of adjacent neurons has a value that is greater than any collective correlation of the individual test case with all other possible collections of adjacent neurons.
In some embodiments of the apparatus and/or processing circuity, a SOM model configuration is used repeatedly in each iteration which determines if there are one or more regions of interest where a new configuration of the DPD results in the transceiver failing the transceiver peak power spectrum output test.
In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises a transforming module for transforming the edge-connected surface mesh to a two-dimensional planar surface mesh prior to generating the regions of interest. For example, a toroidal or hypertoroidal mesh can be transformed into an edged planar surface mesh to reduce the computational complexity associated with using a continuous surface mesh. The transformation can take place at any point where it is advantageous to reduce the computational complexity. In some embodiments, one or both of the identifying or determining modules comprise a modular component for resizing at least one cluster to have a size matching or exceeding a predefined ratio of one category of the assessed characteristic to another category of the assessed characteristic. In some embodiments of the apparatus or processing circuitry, the module for identifying or determining a set of ranges of boundary values further comprises a modular component for resizing at least one cluster to minimize the number of overlapping dimensions of selection conditions of that cluster with at least one other cluster on the SOM surface mesh.
In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises a test-set apparatus, for example, a test set up component or module, arranged to allow reconfiguring of the physical entity. In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises a test-set component or module arrange to allow the assessment to be repeated using the selection conditions of each parameter set associated with a region of interest; updating each parameter set associated with a region of interest in the multi-dimensional data set with at least the result of the repeated assessment; and iteratively repeating the steps of the above first method aspect using the same SOM model to find if there are any new regions of interest in the updated data set.
In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises the reconfiguring module being configured to enable one or more of the steps of reconfiguring the physical entity and updating each parameter set to be controlled or performed manually. In some embodiments of the apparatus or processing circuitry, the apparatus or processing circuitry is further configured to or comprises a set of modules which collectively implement the steps of an embodiment of any of the first to fourth method aspects as a computer-implemented method. In some embodiments, the parameter sets comprise a test-case, the plurality of dimensions of selection conditions comprise a plurality of dimensions of test conditions, and the indication of the assessed characteristic comprises a test result of a test performed on the configurable physical entity under the plurality of test conditions.
In some embodiments, the configurable physical entity comprises a transceiver including a configurable DPD unit, the plurality of test conditions comprise radio settings for testing the transceiver, and the test comprises a transceiver test performed on the output signal of the transceiver. In some embodiments, the assessed characteristic comprises a fail test result category if the peak output power of the output signal of the transceiver exceeds a regulatory standard body spectrum mask for peak output power for one or more carrier networks. In some embodiments, the radio settings for testing the transceiver comprise the number or LTE carrier networks, the number of GSM carrier networks, the instantaneous bandwidth and the occupied bandwidth for the signal output by the transceiver. In some embodiments, the configurable physical entity is one of: a configurable substance, such as a glass substance; a configurable device; or a device including a configurable component, such as, for example, a transceiver 110 with a configurable DPD 112 component or unit.
Some embodiments of the apparatus or processing circuitry, comprise modules configured to perform the steps of any one of the disclosed embodiments of the first, second, third or fourth method aspects.
Some embodiments of the apparatus or processing circuitry comprise a memory module, at least one processor module, and computer code stored in the memory module which, when executed by the at least one processor module or processing circuitry, causes the apparatus or processing circuitry to perform the steps of any one of the disclosed embodiments of the first, second, third or fourth method aspects.
In some embodiments, a machine executable computer-program product comprises computer code which, when executed on the apparatus or processing circuitry, causes the apparatus or processing circuitry to perform the steps in any one of the disclosed embodiments of the first, second, third or fourth method aspects.
In some embodiments a computer program, comprising instructions which, when executed in any of the processing circuitry or apparatus embodiments disclosed as being configured or operated using computer program or computer code, cause the apparatus or processing circuitry to carry out any of the disclosed methods of determining regions of interest in a data set or at least part or all any of the method of testing aspects. In some embodiments, the computer program comprises the computer code of any of the embodiments of the fifth, sixth, or seventh aspects described above as including computer code. Some of the examples of the disclosed data pruning tool 104 are implemented using such a computer program and apparatus 1900 or processing circuitry 1906 for executing the computer program. In some embodiments, the computer program code is structured so that the processing circuitry is configured to or the apparatus 1900 comprises at least the modules 700 to 1300 of the DPT 104. In some embodiments, the computer program code is structured so that the processing circuitry 1906 is further configured to or the apparatus 1900 further comprises the initialization module 600 and an user interface module or component to enable user input to the initialization module 600. In some embodiments, the computer program code is structured so that the processing circuitry 1906 is further configured to or the apparatus 1900 further comprises a module for implementing at least the automated steps of the method of testing module 1400. In some embodiments, all of the method of testing module 1400 comprises automated steps. Another aspect of the disclosed technology comprises a carrier containing the computer program aspect, wherein the carrier is one of an electronic signal, optical signal, radio signal, or computer-readable storage medium.
Any feature of any of the embodiments disclosed herein may be applied to any other embodiment, wherever suitable. Likewise, any advantage of any of the embodiments may apply to any other embodiments, and vice versa.
Hence, it should be understood that the details of the described embodiments are merely examples brought forward for illustrative purposes, and that all variations that fall within the scope of the claims are intended to be embraced therein.
As disclosed herein, several examples have been provide where a configurable physical entity such as a device or substance having a range of possible attribute ranges has been exemplified by reference to a configurable transceiver 110 comprising a configurable digital pre-distortion, DPD, unit 114. Another example of a configurable physical entity comprises another type of device, for example, an electrical device or component, such as, for example, a motor.
In one example, a configurable material or substance comprises a glass material or other substance composed of a range of chemicals, each chemical being able to form a different percentage weight (% wt) of the glass. In some embodiments of this example, a SOM ML model of the DPT 104 is used to reduce a multi-dimensional parameter input space comprising the ranges of ratios (which may be expressed as percentage weights) that various known glass component chemicals (attributes) of the glass substance are suitable for a certain type of use of the glass. By determining which composition of glass (i.e. what component chemicals/chemical compounds and their relative ratios) are associated with certain manufacturing techniques (for example, what types of glass could be formed using a float glass manufacturing method, a non-floating glass manufacturing method, or some other manufacturing method), the glass may be classified for a particular category of use.
Advantageously, some embodiments of the disclosed technology use less resources than would be the case if—all possible combinations of characteristics within the large data set were tested as only combinations of characteristics from a region of interest within the large data set may need to be tested. If a selected combination of characteristics from a region of interest results in the physical entity failing the test, then the data pruning tool, DPT, 104 can be iteratively used as disclosed to drill down into that region of interest to find smaller regions of interest within that region of interest from which a new combination of characteristics of the physical entity can be tested. This allows more rapid convergence on combinations of characteristics that result in the physical entity having a characteristic which passes the test.
| Filing Document | Filing Date | Country | Kind |
|---|---|---|---|
| PCT/EP2020/078661 | 10/12/2020 | WO |
