Patent Application
20140162628
This relates generally to electronic devices, and more particularly, to electronic devices having wireless communications circuitry.
Wireless electronic devices such as portable computers and cellular telephones are often provided with wireless communications circuitry. The wireless communications circuitry is tested in a test system to ensure adequate radio-frequency performance. A given wireless electronic device is typically tested using one or more test stations in the test system. To expedite the testing process, many test stations can be used to test the given wireless electronic device (i.e., to determine whether an electric device under test has been manufactured properly or whether an electric device under test satisfies design criteria).
Each test station that is used to test wireless electronic devices typically experiences measurement variation due to variations between individual test stations. The behavior of each test station is typically unique, as it is challenging to manufacture test stations that are exactly identical to one another. Variations among individual test stations make it difficult to provide consistent testing for each device under test.
It would therefore be desirable to be able to provide improved test systems for testing wireless electronic devices
A wireless electronic device may include wireless communications circuitry. The wireless communications circuitry may include baseband circuitry, baseband circuitry, and antenna structures. The wireless communications circuitry may transmit and receive radio-frequency signals at a number of different frequencies.
A test system having test equipment may be used to perform radio-frequency testing such as pass-fail testing on a wireless electronic device to determine whether the wireless electronic device has adequate radio-frequency performance. Radio-frequency test signals may be conveyed between the test system and a wireless electronic device under test (DUT) at different frequencies. The test system may include many radio-frequency test stations for testing radio-frequency performance of multiple DUTs. A reference test station in the test system may select a reference DUT from a group of wireless electronic devices under test. The reference DUT may be used to calibrate test stations in the test system.
The test system (e.g., the reference test station in the test system) may gather test data from multiple DUTs by testing the DUTs at desired frequencies. Test data gathered by the test system may include performance metric data associated with the radio-frequency performance of the DUTs. The test system may compute respective statistical parameters such as a respective standard deviation value for test data at each of the desired frequencies. The test system may identify a range of acceptable test data values for test data at each of the desired frequencies. The test system may compute a respective predetermined factor such as a respective weight value for test data at each of the desired frequencies based on the statistical parameters.
For example, weight values may be used to weight test data at each of the desired frequencies. The weight values may depend on the standard deviation value and/or the range of acceptable test data values at each of the desired frequencies. As an example, weight values may be directly proportional to the standard deviation value and/or inversely proportional to the range of acceptable test data values at each of the desired frequencies. The test system may compute a respective mean (average) value for test data at each of the desired frequencies
The test system may use predetermined factors to compute an error value such as a weighted mean square error value for each of the DUTs (e.g., the test system may compute a respective weighted mean square error value for each of the DUTs using weight values and mean values for each of the desired frequencies). The test system may select a reference DUT based on the error value computed for each DUT. For example, the test system may identify a DUT having a minimum weighted mean square error value as the reference DUT. The test system may use the reference DUT to calibrate test stations in the test system (e.g., to ensure that radio-frequency test results are consistent across multiple test stations).
Further features of the present invention, its nature and various advantages will be more apparent from the accompanying drawings and the following detailed description.
This relates generally to wireless communications, and more particularly, to systems and methods for testing wireless communications circuitry.
Electronic devices such as device 10 of
Long-range signals such as signals associated with satellite navigation bands may be received by the wireless communications circuitry of device 10. For example, device 10 may use wireless circuitry to receive signals in the 1575 MHz band associated with Global Positioning System (GPS) communications, in the 1602 MHz band associated with Global Navigation Satellite System (GLONASS) communications, etc. Short-range wireless communications may also be supported by the wireless circuitry of device 10. For example, device 10 may include wireless circuitry for handling local area network links such as WiFi® links at 2.4 GHz and 5 GHz, Bluetooth® links at 2.4 GHz, etc. In general, wireless communications circuitry in device 10 may support wireless communications in any suitable communications bands.
As shown in
Storage and processing circuitry 28 may be used to run software on device 10, such as internet browsing applications, voice-over-internet-protocol (VOIP) telephone call applications, email applications, media playback applications, operating system functions, functions related to communications band selection during radio-frequency transmission and reception operations, etc. To support interactions with external equipment (e.g., a radio-frequency base station, radio-frequency test equipment, etc.), storage and processing circuitry 28 may be used in implementing communications protocols.
Communications protocols that may be implemented using storage and processing circuitry 28 include internet protocols, wireless local area network protocols (e.g., IEEE 802.11 protocols—sometimes referred to as WiFi®), protocols for other short-range wireless communications links such as the Bluetooth® protocol, IEEE 802.16 (WiMax) protocols, cellular telephone protocols such as the “2G” Global System for Mobile Communications (GSM) protocol, the “2G” Code Division Multiple Access (CDMA) protocol, the “3G” Universal Mobile Telecommunications System (UMTS) protocol, the “3G” Evolution-Data Optimized (EV-DO) protocol, the “4G” Long Term Evolution (LTE) protocol, MIMO (multiple input multiple output) protocols, antenna diversity protocols, etc. Wireless communications operations such as communications band selection operations may be controlled using software stored and running on device 10 (i.e., stored and running on storage and processing circuitry 28 and/or input-output circuitry 30).
Input-output circuitry 30 may include input-output devices 32. Input-output devices 32 may be used to allow data to be supplied to device 10 and to allow data to be provided from device 10 to external devices. Input-output devices 32 may include user interface devices, data port devices, and other input-output components. For example, input-output devices may include touch screens, displays without touch sensor capabilities, buttons, joysticks, click wheels, scrolling wheels, touch pads, key pads, keyboards, microphones, cameras, buttons, speakers, status indicators, light sources, audio jacks and other audio port components, digital data port devices, light sensors, motion sensors (accelerometers), capacitance sensors, proximity sensors, etc.
Input-output circuitry 30 may include wireless communications circuitry 34 for communicating wirelessly with external equipment (e.g., a radio-frequency base station, radio-frequency test equipment, etc.). Wireless communications circuitry 34 may include radio-frequency (RF) transceiver circuitry formed from one or more integrated circuits, power amplifier circuitry, low-noise input amplifiers, passive RF components, one or more antennas, transmission lines, and other circuitry for handling RF wireless signals. Wireless signals can also be sent using light (e.g., using infrared communications).
Wireless communications circuitry 34 may include radio-frequency transceiver circuitry 38 for handling various radio-frequency communications bands. For example, circuitry 38 may handle the 2.4 GHz and 5 GHz communications bands for WiFi® (IEEE 802.11) communications, the 2.4 GHz communications band for Bluetooth® communications, cellular telephone bands such as at 850 MHz, 900 MHz, 1800 MHz, 1900 MHz, and 2100 MHz and/or the LTE bands and other bands (as examples). Circuitry 38 may handle voice data and non-voice data traffic. Transceiver circuitry 38 may include global positioning system (GPS) receiver equipment for receiving GPS signals at 1575 MHz or for handling other satellite positioning data.
Wireless communications circuitry 34 may include one or more antennas 40. Antennas 40 may be formed using any suitable antenna types. For example, antennas 40 may include antennas with resonating elements that are formed from loop antenna structures, patch antenna structures, inverted-F antenna structures, slot antenna structures, planar inverted-F antenna structures, helical antenna structures, hybrids of these designs, etc. Different types of antennas may be used for different bands and combinations of bands. For example, one type of antenna may be used in forming a WiFi® wireless link antenna and another type of antenna may be used in forming a cellular wireless link antenna. During communication operations, transceiver circuitry 38 may be used to transmit radio-frequency signals at desired frequencies via antennas 40 (e.g., antennas 40 may transmit wireless signals having a desired frequency).
As shown in
Baseband processor 36 may be used to provide data to storage and processing circuitry 28. Data that is conveyed to circuitry 28 from baseband processor 36 may include raw and processed data. Raw data may, for example, include downlink data received using wireless communications protocols. The processed data passed to circuitry 28 from baseband processor 36 may include data associated with wireless performance metrics for received (downlink) signals (sometimes referred to as performance parameters) such as received power, receiver sensitivity, frame error rate, bit error rate, channel quality measurements based on received signal strength indicator (RSSI) information, adjacent channel leakage ratio (ACLR) information, channel quality measurements based on received signal code power (RSCP) information, channel quality measurements based on reference symbol received power (RSRP) information, channel quality measurements based on signal-to-interference ratio (SINR) and signal-to-noise ratio (SNR) information, channel quality measurements based on signal quality data such as Ec/Io or Ec/No data, information on whether responses (acknowledgements) are being received from a cellular telephone tower corresponding to requests from the electronic device, information on whether a network access procedure has succeeded, information on how many re-transmissions are being requested over a cellular link between the electronic device and a cellular tower, information on whether a loss of signaling message has been received, information on whether paging signals have been successfully received, and other information that is reflective of the performance of wireless circuitry 34. For example, baseband processor 36 may monitor and process raw data to generate radio-frequency performance parameter data.
A radio-frequency test station may be provided for performing radio-frequency tests on wireless communications circuitry in electronic devices such as device 10 (e.g., to ensure adequate radio-frequency performance of wireless communications circuitry 34 in device 10). The radio-frequency performance of multiple wireless electronic devices 10 may be tested using a test system such as test system 42 of
Each electronic device that is being tested using radio-frequency test stations 44 may sometimes be referred to as device under test (DUT) 10′. DUT 10′ may be, for example, a fully assembled electronic device such as electronic device 10 or a partially assembled electronic device (e.g., DUT 10′ may include some or all of wireless circuitry 34 prior to completion of manufacturing). It may be desirable to test wireless communications circuitry 34 within partially assembled electronic devices so that wireless communications circuitry 34 can be more readily accessed during test operations (e.g., to test the performance of wireless communications circuitry 34 that have not yet been enclosed within a device housing).
Test stations 44 may each include a test host such as test host 48 (e.g., a personal computer, laptop computer, tablet computer, handheld computing device, etc.) and a test unit such as tester 46. Test host 48 and tester 46 may include storage circuitry. Storage circuitry in test host 48 and tester 46 may include one or more different types of storage such as hard drive storage, nonvolatile memory (e.g., flash memory or other electrically-programmable-read-only memory), volatile memory (e.g., static or dynamic random-access-memory), etc.
During test operations, radio-frequency test signals may be transmitted between DUT 10′ and tester 46 in a given test station 44. For example, radio-frequency uplink test signals may be transmitted from DUT 10′ and received by tester 46, whereas radio-frequency downlink test signals may be transmitted from tester 46 and received by DUT 10′. Test signals transmitted between DUT 10′ and test station 44 during testing may be transmitted at selected frequencies (sometimes referred to as test frequencies). For example, tester 46 may provide downlink test signals to DUT 10′ at a first frequency while DUT 10′ provides uplink test signals to tester 46 at the first frequency. As another example, tester 46 may provide downlink test signals to DUT 10′ at a second frequency that is different than the first frequency while DUT 10′ provides uplink test signals to tester 46 at the second frequency. This example is merely illustrative. If desired, DUT 10′ may provide uplink test signals without simultaneously receiving downlink test signals and tester 46 may provide downlink test signals without simultaneously receiving uplink test signals. Test signals transmitted between test stations 44 and DUTs 10′ may be used to characterize the radio-frequency performance of DUTs 10′.
Tester 46 may include, for example, a radio communications analyzer, spectrum analyzer, signal generator, power sensor, vector network analyzer, or any other suitable components for performing radio-frequency test operations on DUT 10′. Tester 46 may be used to characterize uplink and downlink behaviors of DUT 10′. For example, tester 46 may provide (transmit) radio-frequency downlink test signals at desired frequencies to DUT 10′. DUT 10′ may measure performance parameters for downlink signals received from tester 46 (e.g., receiver sensitivity, RSSI, RSRP, SNR, etc.). Performance parameters measured by DUT 10′ for downlink signals received from tester 46 may be used to characterize the downlink behaviors of DUT 10′ (e.g., the radio-frequency performance of DUT 10′ in response to receiving downlink signals may be characterized).
As another example, DUT 10′ may provide (transmit) radio-frequency uplink test signals at desired frequencies to tester 46. Tester 46 may measure performance parameters for the uplink test signals received from DUT 10′ (e.g., output power level, frequency response, gain, linearity, etc.). Performance parameters measured by tester 46 for uplink test signals received from DUT 10′ may be used to characterize the uplink behaviors of DUT 10′ (e.g., the radio-frequency performance of DUT 10′ when transmitting uplink signals may be characterized).
Tester 46 may be operated directly or via computer control (e.g., when tester 46 receives commands from test host 48). When operated directly, a user may control tester 46 by supplying commands directly to tester 46 using a user input interface of tester 46. For example, a user may press buttons in a control panel on tester 46 while viewing information that is displayed on a display in tester 46. In computer controlled configurations, test host 48 (e.g., software running autonomously or semi-autonomously on test host 48) may communicate with tester 46 by sending and receiving control signals and data over path 52. Test host 48 may send control signals instructing tester 46 to transmit radio-frequency downlink test signals to DUT 10′ and/or instructing tester 46 to measure radio-frequency parameters associated with radio-frequency uplink test signals received from DUT 10′. Tester 46 may convey data such as performance parameters associated with radio-frequency uplink signals received from DUT 10′ to test host 48. Test host 48 and tester 46 may collectively be considered as test equipment 50. Test equipment 50 may be a computer, test station, or other suitable system that performs the functions of test host 48 and tester 46 (e.g., the functionality of test host 48 and tester 46 may be implemented on one or more computers, test stations, etc.).
During test operations, DUT 10′ may, if desired, be coupled to test host 48 through a wired connection. DUT 10′ may, for example, be connected to test host 48 using a Universal Serial Bus (USB) cable, a Universal Asynchronous Receiver/Transmitter (UART) cable, or other types of cabling. Test host 48 may send control signals that instruct DUT 10′ to perform desired operations during testing. For example, test host 48 may instruct DUT 10′ to measure performance parameters of radio-frequency downlink test signals received from tester 46. Test host 48 may retrieve measured performance parameters from DUT 10′ (e.g., test host 48 may instruct DUT 10′ to send measured performance parameters to test host 48). As another example, test host 48 may instruct DUT 10′ to transmit radio-frequency uplink test signals to tester 46.
During test operations, DUT 10′ may, if desired, be coupled to tester 46 using a wired connection such as radio-frequency cabling structures, radio-frequency probing structures, or any other suitable coupling structures over which to convey radio-frequency signals between tester 46 and DUT 10′ (e.g., uplink and downlink test signals). If desired, DUT 10′ may be coupled to tester 46 through a wireless (over-the-air) connection. In such arrangements, tester 46 may include wireless structures such as test antennas for communicating with DUT 10′ (e.g., test antennas in tester 46 may be used to send wireless downlink test signals to antenna structures 40 in DUT 10′ and to receive wireless uplink test signals from antenna structures 40 in DUT 10′). Test station 44 may, if desired, include a test enclosure (e.g., a transverse electromagnetic cell, etc.) that is used to provide radio-frequency isolation from the outside environment during over-the-air testing.
Each test station 44 in test system 42 may be used to test the radio-frequency performance of a number of DUTs 10′ simultaneously (e.g., many DUTs 10′ may be tested in parallel). DUTs 10′ may be autonomously provided to test stations 44 (e.g., using automatic loaders, conveyor belt structures, etc.) or may be manually provided to test stations 44 for testing (e.g., by a test station operator). Test stations 44 in test system 42 may each perform the same test operations or different test operations on DUTs 10′ (e.g., test stations 44 may be used to measure any desired combination of uplink and downlink performance parameters associated with DUTs 10′ at any desired test frequencies).
DUTs 10′ that exhibit sufficient radio-frequency performance (e.g., as determined by a test station 44 during radio-frequency test operations) may be labeled as “passing” devices. DUTs 10′ that exhibit unsatisfactory radio-frequency performance may be labeled as “failing” devices. Passing devices may be further assembled, tested, and/or provided to users for normal device operation. Failing devices may be discarded, calibrated, re-tested, reworked, etc.
During testing of DUTs 10′ with test system 42, each test station 44 may experience measurement variation due to variations among individual test stations 44 (e.g., process, voltage, and temperature variations that may affect the operation of each test station 44). The behavior of each test station 44 is typically unique, because it is challenging to manufacture test stations that are exactly identical to one another. For example, the behavior of a first test station 44 may be different from the behavior of a second test station 44 while performing tests on DUTs 10′. Variations between any two test stations 44 make it difficult to provide consistent testing in a test system 42 having multiple test stations. It may therefore be desirable to be able to provide a test standard for ensuring that test results are consistent across multiple test stations 44.
A test standard may be selected from a group of electronic devices under test using a reference test station and may therefore sometimes be referred to as a reference DUT. As shown in
In order to select a test standard for ensuring consistent test results across test stations 44, master test station 54 may perform test operations on a group of DUTs 10′. During test operations, each DUT in the group of DUTs 10′ may be individually tested by master test station 54 (see, e.g., arrows 56). Master test station 54 may store performance parameter data (e.g., performance parameters measured by DUT 10′ and tester 46) associated with each DUT 10′ that is being tested. Master test station 54 may process the stored performance parameter data to select a test standard such as reference DUT 10″ from the group of DUTs 10′ tested by master test station 54. Reference DUT 10″ (sometimes referred to as a “golden” DUT or golden reference DUT) may subsequently be used to calibrate individual test stations 44 in test system 42 (e.g., to ensure that test results are consistent across multiple test stations 44).
At step 60, master test station 54 may gather radio-frequency measurements (e.g., a number of radio-frequency measurement values) from a group of DUTs 10′. Radio-frequency measurement values gathered by master test station 54 may sometimes be referred to as radio-frequency measurement data. Radio-frequency measurement values gathered by master test station 54 may be obtained at a number of different frequencies. Gathered radio-frequency measurement values may be stored in master test station 54 for subsequent analysis.
Master test station 54 may gather radio-frequency measurements from DUTs 10′ by performing wireless communications operations on each DUT 10′. For example, master test station 54 may transmit radio-frequency downlink test signals at different test frequencies to DUT 10′. DUT 10′ may obtain radio-frequency measurement values by performing radio-frequency measurements on received downlink test signals at each test frequency (e.g., each DUT 10′ may obtain a radio-frequency measurement value for each frequency tested). Master test station 54 may subsequently retrieve the radio-frequency measurement values obtained by DUT 10′ (e.g., DUT 10′ may send radio-frequency measurement values to master test station 54). In another suitable arrangement, DUT 10′ may transmit radio-frequency uplink test signals at different frequencies to tester 46. Tester 46 in master test station 54 may gather radio-frequency measurement values by performing radio-frequency measurements on received uplink test signals at each frequency (e.g., tester 46 may obtain a radio-frequency measurement value for each frequency tested).
Radio-frequency measurements gathered by master test station 54 may include performance parameters associated with each DUT 10′. For example, radio-frequency measurement values gathered by master test station 54 may include performance parameters measured by tester 46 for uplink radio-frequency test signals received from DUT 10′ and/or performance parameters measured by DUT 10′ for downlink radio-frequency test signals received from tester 46. Radio-frequency measurement values gathered by master test station 54 may include, for example, receiver sensitivity information, bit error rate information, RSSI information, output power information, or any other desired performance parameter associated with wireless communications operations in DUT 10′. In general, radio-frequency measurement values gathered by master test station 54 may include any desired radio-frequency measurements associated with the transmission or reception of radio-frequency signals by DUT 10′ at a number of different frequencies.
Measurements gathered by master test station 54 from a group of DUTs 10′ may exhibit differences (or “data spread”) due to variations between individual DUTs 10′ (e.g., design variations, manufacturing variations, etc.). The behavior of each DUT 10′ is typically unique, because it is challenging to manufacture devices that are exactly identical to one another. Radio-frequency measurement values gathered by master test station 54 at a given frequency may collectively exhibit a variation (e.g., a first radio-frequency measurement value gathered by master test station 54 in a selected frequency channel may be different from second and third radio-frequency measurement values gathered in the selected frequency channel, etc.).
Variation in radio-frequency measurement values gathered by master test station 54 at each frequency may be characterized by statistical parameters such as a range, average (mean), standard deviation, variance, median, etc. For example, a set of radio-frequency measurement values gathered by master test station 54 from a group of DUTs 10′ at a first frequency may have a first average and a first standard deviation, a set of radio-frequency measurement values gathered by master test station 54 from the group of DUTs 10′ at a second frequency may have a second average and a second standard deviation, etc.
Radio-frequency measurement values gathered by master test station 54 at a given frequency may be subject to a respective limit range specification for the radio-frequency performance of DUT 10′ (sometimes referred to as a limit range). A limit range may be defined as a range of radio-frequency measurement values over which an associated DUT 10′ has acceptable radio-frequency performance. For example, the limit range may provide a range of radio-frequency performance parameter values over which an associated DUT 10′ has acceptable radio-frequency performance (e.g., a range of bit error rates, a range of output powers, etc.). The limit range may have a lower limit and an upper limit (e.g., the limit range may be defined by the difference between the associated upper and lower limits). If master test station 54 obtains a radio-frequency measurement value from a given DUT 10′ that is within the limit range (e.g., if the measurement has a value that is greater than the lower limit and less than the upper limit of the limit range), the associated DUT 10′ may be considered to have satisfactory radio-frequency performance at that frequency. If master test station 54 obtains a radio-frequency measurement value from a given DUT 10′ that is outside of the limit range (e.g., the measurement has a value that is less than the lower limit or greater than the upper limit of the limit range), the associated DUT 10′ may be considered to have unsatisfactory radio-frequency performance at that frequency. For example, a limit range may specify a range of acceptable bit error rates for a group of DUTs 10′. In this scenario, DUTs associated with a bit error rate that is outside of the limit range may have unacceptable radio-frequency performance and DUTs associated with a bit error rate that is within the limit range may have acceptable radio-frequency performance.
A limit range may be specified by carrier-imposed requirements, design requirements, manufacturing requirements, regulatory requirements, or any other suitable requirements associated with the radio-frequency performance of DUT 10′ (e.g., requirements that constrain and/or define acceptable radio-frequency measurement values at a given frequency). Each frequency that is tested (e.g., each frequency at which master test station 54 gathers measurement data values from DUTs 10′) may, if desired, have a respective limit range. For example, a first test frequency may have a first limit range, a second test frequency may have a second limit range, etc. In this way, each frequency may have unique constraints for acceptable radio-frequency measurement values.
At step 62, master test station 54 may process radio-frequency measurement values gathered from DUTs 10′ to select a test standard such as reference DUT 10″. Reference DUT 10″ may be selected from the DUTs 10′ that are measured by master test station 54. Master test station 54 may, for example, compare radio-frequency measurement values gathered from each DUT 10′ at each test frequency to select reference DUT 10″. Master test station 54 may calculate statistical parameters of the radio-frequency measurement values associated with each test frequency to select reference DUT 10″. For example, master test station 54 may select reference DUT 10″ by calculating a value such as a weighted mean square error associated with each measured DUT 10′. If desired, master test station 54 may select a DUT 10′ having a least weighted mean square error to serve as reference DUT 10″. A weighted mean square error associated with each measured DUT 10′ may depend on statistical parameters associated with measurement values gathered by master test station 54. For example, the weighted mean square error associated with each measured DUT 10′ may depend on a standard deviation and an average of radio-frequency measurement values at each test frequency. Reference DUT 10″ may have well-known radio-frequency performance characteristics with which to calibrate test stations 44 in test system 42.
At step 64, reference DUT 10″ is passed to test stations 44 in test system 42. Each test station 44 may perform radio-frequency test measurements on reference DUT 10″. Radio-frequency test measurements performed on reference DUT 10″ by test stations 44 may be used to calibrate each test station 44. For example, each test station 44 may compare radio-frequency test measurements performed on reference DUT 10″ to well-known performance characteristics associated with reference DUT 10″ in order to generate test station offset data.
At step 66, calibrated test stations 44 may perform radio-frequency test operations on DUTs 10′. DUTs 10′ that are tested using test stations 44 after calibration by reference DUT 10″ may sometimes be referred to as production DUTs. Calibrated test stations 44 (e.g., test stations 44 that have been calibrated using reference DUT 10″ during step 64) in test system 42 may provide consistent radio-frequency testing for DUTs 10′.
An illustrative table 100 of exemplary radio-frequency measurement values gathered by master test station 54 from a group of DUTs 10′ at different test frequencies is shown in
In the example of
If desired, each measurement value Yij may be a performance parameter gathered by master test station 54 such as a performance parameter for uplink test signals received by tester 46 from DUT Xi or a performance parameter for downlink test signals received by DUT Xi from tester 46. As an example, each measurement value Yij may be a receiver sensitivity value measured by DUT Xi in response to downlink test signals received from tester 46 during testing. In this example, measurement value Y11 may be a receiver sensitivity value measured by DUT X1 in response to downlink test signals transmitted by tester 46 at frequency F1, measurement value Y12 may be a receiver sensitivity value measured by DUT X1 in response to downlink test signals transmitted by tester 46 at frequency F2, etc.
As another example, each measurement value Yij may be an output power value measured by tester 46 in response to uplink test signals received from DUT Xi during testing. In this example, measurement value Y11 may be an output power value measured by tester 46 in response to uplink test signals transmitted by DUT Xi at frequency F1, measurement value Y12 may be an output power value measured by tester 46 in response to uplink test signals transmitted by DUT X1 at frequency F2, etc. In general, each measurement value Yij may be any desired performance parameter gathered by master test station 54.
A flow chart of illustrative steps that may be performed by master test station 54 to select a golden test standard such as reference DUT 10″ for calibrating test stations 44 is shown in
In the example of
μj=SUM(Yij)/N (1)
In equation 1, SUM(Yij) is a sum of the N measurement values Yij associated with DUTS Xi at a selected frequency Fj. Master test station 54 may compute a respective average value μj for each test frequency Fj. For example, master test station 54 may compute a first average value μ1 of the N measurement values Yi1 in column 104 of
At step 72, master test station 54 may compute a standard deviation value of the radio-frequency measurement values gathered from DUTs Xi at each test frequency. In the example of
At step 74, master test station 54 may identify a limit range at each test frequency Fj. The limit range may, if desired, be provided by a test station operator, software implemented by test host 48, etc. Master test station 54 may identify a respective limit range corresponding to each test frequency Fj. For example, master test station 54 may identify a first limit range for the N measurement values Yi1 in column 104 of
At step 76, master test station 54 may compute a weight value associated with each test frequency Fj. Master test station 54 may calculate each weight value based on the computed standard deviation value and specified limit range for each test frequency Fj. The weight value associated with a selected test frequency may be a quantity that is proportional to the standard deviation value and the limit range associated with the selected test frequency. For example, the weight value may increase as the standard deviation value increases and/or the weight value may decrease as the limit range increases (e.g., the weight value may be directly proportional to the standard deviation value and inversely proportional to the limit range). As an example, a weight value Wj associated with measurement values Yij at a selected test frequency Fj (e.g., at frequency F1, F2, or F3) may be given by equation 2.
W
j=(1+σj/SUM(σj))*(K/ΔLj) (2)
In equation 2, σj is a standard deviation value associated with selected frequency Fj (e.g., a standard deviation value as computed by master test station 54 while performing step 72), SUM(σj) is a sum of all standard deviation values computed for each tested frequency Fj, K is a scaling constant (e.g., any suitable number such as 6, 1.5, etc.), and ΔLj is a limit range specified for selected frequency Fj (e.g., a limit range as specified during processing of step 74).
Each weight value Wj may be used to compute a weighted mean square error associated with each DUT Xi. A weighted mean square error may characterize how well the radio-frequency performance of a given device under test represents the radio-frequency performance of all devices tested by master test station 54 at a given frequency. By computing weight values Wj in this way, a weighted mean square error may include a heavier weighting for measurement values at frequencies corresponding to a large computed standard deviation value (e.g., a large variance in measurement values) than for measurement values at frequencies corresponding to a small standard deviation value. Measurement values in channels having increased measurement variation may, for example, be more significant in determining a weighted mean square error than measurement values in channels having reduced measurement variation. Similarly, a weighted mean square error may include a heavier weighting for measurement values at frequencies having a small limit range than for measurement values at frequencies having a large limit range (e.g., measurement values at frequencies with stricter limit range constraints may be weighted more heavily than measurement values at frequencies with looser limit range constraints). Measurement values in channels with stricter test requirements may, for example, be more significant in determining a weighted mean square error than measurement values in channels with looser test requirements.
At step 78, master test station 54 may compute a weighted mean square error value for each DUT Xi. Master test station 54 may compute each weighted mean square error value based on the calculated weight values, measurement values, and average values associated with each DUT Xi at each frequency Fj. For example, a weighted mean square error value ΔXi for each DUT Xi tested by master test station 54 (i.e., for each of the N DUTs Xi) may be calculated using equation 3.
ΔXi=SUM(Wj2*(Yij−μj)2) (3)
In equation 3, Wj is a weight value computed for test frequency Fj (e.g., a weight value Wj as calculated while processing step 76), Yij is a measurement value gathered from DUT Xi at frequency Fj, μj is an average value of the N measurement values at frequency Fj (e.g., an average value μj as computed while processing step 70), and SUM( ) is a sum over all test frequencies Fj. For example, a weighted mean square error value ΔX1 corresponding to first measured DUT X1 (
ΔX1=W12*(Y11−μ1)2+W22*(Y12−μ2)2+W12*(Y13−μ3)2 (4)
As another example, a weighted mean square error value ΔXN corresponding to an N-th measured DUT XN (see
ΔXN=WN2*(YN1−μ1)2+WN2*(YN2−μ2)2+WN2*(YN3−μ3)2 (5)
At step 80, master test station 54 may identify a minimum (least) weighted mean square error value from calculated mean square error values ΔXi. Master test station 54 may select the DUT Xi associated with the minimum weighted square error value to serve as reference DUT 10″.
For example, master test station 54 may gather measurement values for a first DUT X1, a second DUT X2, and a third DUT X3. First DUT X1 may have a weighted mean square error value of 0.10, second DUT X2 may have a weighted mean square error value of 0.22, and third DUT X3 may have a weighted mean square error value of 0.44. In this scenario, master test station 54 may select first DUT X1 to serve as reference DUT 10″, because first DUT X1 has the least weighted mean square value of all DUTs measured by master test station 54. First DUT X1 may thereby be used to calibrate test stations 44 in test system 42 to ensure consistent testing across test stations 44.
Measurement values 140 may have an average value μ1 and a standard deviation value σ1. Measurement values 142 may have an average value μ2 and a standard deviation value σ2. Measurement values 144 may have an average value μ3 and a standard deviation value σ3. Standard deviation values σ1, σ2, and σ3 may represent the variation (or “spread”) of measurement values at respective test frequencies. Standard deviation values σ1, σ2, and σ3 may represent the variation of measurement values relative to mean values μ1, μ2, and μ3, respectively. A limit range ΔL1 may be specified for a radio-frequency performance metric associated with measurement values 140, a limit range ΔL2 may be specified for the radio-frequency performance metric associated with measurement values 142, and a limit range ΔL3 may be specified for the radio-frequency performance metric associated with measurement values 144. Each mean value, standard deviation value, and limit range shown in
In the example of
The foregoing is merely illustrative of the principles of this invention and various modifications can be made by those skilled in the art without departing from the scope and spirit of the invention. The foregoing embodiments may be implemented individually or in any combination.
