The described embodiments generally relate to wireless communications devices and computer networks. More particularly, the described embodiments relate to apparatus and methods of product acceptance testing on a wireless device, and the collection and analysis of product acceptance data from the wireless device.
Wireless networking connects one or more wireless devices to other computer devices without a direct electrical connection, such as a copper wire or optical cable. Wireless devices communicate data, typically in the form of packets, across a wireless or partially wireless computer network and open a “data” or “communication” channel on the network such that the device can send and receive data packets. The wireless devices often have wireless device resources, such as programs and hardware components, which individually use open communication connections to transmit and receive data on the network. In order for the wireless devices to operate on the wireless networks, the devices need to be set-up or configured and then tested, i.e. product acceptance testing. Such set-up or configuration typically includes installing or adjusting various hardware, software and/or firmware and other associated parameters on the wireless device. Further, the set-up or configuration is typically analyzed by running the product acceptance tests on the wireless device to measure the performance and/or operability of the wireless device on the wireless network. Each type of wireless device may have its own device-specific set-up, and each wireless network and/or carrier may also have their network-specific and/or carrier-specific set-ups. Thus, the initial set-up and configuration of a wireless device for operation on a given wireless network is typically very complicated and time consuming
Another complicating factor in the initial set-up and testing of a wireless device is that typically external testing devices are required. For example, in a wireless device such as a cellular phone, various analyzers are serially connected to the phone and input and/or measure various test parameters. In order to maximize throughput, such testing is typically performed in a batch mode on a plurality of wireless devices, resulting in a confusing mass of external testing devices, cables and wireless devices. Further, typically such tests involve mobile tests, such as driving the cellular phone around a predetermined area to test its receive and transmit capabilities in varying environmental conditions. For example, with a cellular phone, these tests involve an exchange of messaging communications between a base station and the cellular phone. These mobile tests can be very inefficient, as the environmental conditions may not be consistent, as in the case of a change in the weather, and as driving around with the wireless device can be very time-consuming Further, such mobile testing and the moving around, connecting and disconnecting of the wireless device tend to increase the potential for damaging the wireless device.
Accordingly, it would be advantageous to provide an apparatus and method that allows for less complicated, safer and more consistent product acceptance testing.
An aspect is directed to a wireless communications device, comprising: a computer platform having a simulation module operable to simulate network communications of the wireless communications device on a wireless network, wherein the simulated network communications are associated with a network communications test scenario; and a communications processing engine disposed on the wireless communications device for processing the simulated network communications and generating corresponding product acceptance data for determining compliance of the wireless communications device with a communications processing standard.
Another aspect is directed to an apparatus for analyzing data from a wireless communications device, comprising: a module for receiving product acceptance data corresponding to a processing of a simulated communications message on the wireless communications device, wherein the product acceptance data is associated with a network communications test scenario, wherein the simulated communications message is associated with a communication on a wireless network; and a product acceptance test application executable by the module and including an analysis engine operable to analyze the product acceptance data and generate a product acceptance decision.
Another aspect is directed to a method of performing product acceptance testing, comprising: transmitting at least a portion of a product acceptance test application across a wireless network to a wireless communications device having a communications processing engine, the product acceptance test application including a simulation module for simulating network communications with the communications processing engine, the simulated network communications corresponding to a network communications test scenario; receiving product acceptance data from the wireless communication device, the product acceptance data comprising test result data corresponding to the processing of the simulated network communications by the communications processing engine; and determining a product acceptance decision based on the product acceptance data.
Another aspect is directed to a non-transitory computer readable storage medium containing instructions stored thereon, which, when executed by a wireless device, cause the wireless device to perform operations, the instructions comprising: program code to transmit at least a portion of a product acceptance test application across a wireless network to a wireless communications device having a communications processing engine, the product acceptance test application including a simulation module for simulating network communications with the communications processing engine, the simulated network communications corresponding to a network communications test scenario; program code to receive product acceptance data from the wireless communication device, the product acceptance data comprising test result data corresponding to the processing of the simulated network communications by the communications processing engine; and program code to determine a product acceptance decision based on the product acceptance data.
Another aspect is directed to an apparatus for performing product acceptance testing, comprising: means for transmitting at least a portion of a product acceptance test application across a wireless network to a wireless communications device having a communications processing engine, the product acceptance test application including a simulation module for simulating network communications with the communications processing engine, the simulated network communications corresponding to a network communications test scenario; means for receiving product acceptance data from the wireless communication device, the product acceptance data comprising test result data corresponding to the processing of the simulated network communications by the communications processing engine; and means for determining a product acceptance decision based on the product acceptance data.
Another aspect is directed to an apparatus for product acceptance testing on a wireless device, comprising: means for simulating communications representative of actual communications with a wireless network; and means for processing the simulated communications and thereby generating product acceptance data associated with a product acceptance decision.
The disclosed embodiments will hereinafter be described in conjunction with the appended drawings provided to illustrate and not to limit the disclosed embodiments, wherein like designations denote like elements, and in which:
Referring to
Product acceptance testing application 23 may be initiated at any time, and product acceptance data 29 may be stored on and obtained from the respective wireless device 12, 18, 20, 22 at any time via a wired or wireless connection to the respective wireless device. Product acceptance testing application 23 simulates at least one of a wireless network, a wireless network component, or another device on wireless network and the associated communications/messaging, such as by generating simulated wireless signaling messages. Further, product acceptance test application 23 logs the associated communications processing data, i.e. product acceptance data 29, relevant to determine compliance with predetermined communications processing standards 27. Such product acceptance data 29 is indicative of the wireless device set-up, performance and implementation of the device on the network. As mentioned above, the logged product acceptance data 29 may be stored within the respective wireless device 12, 18, 20, 22 and later uploaded via a wired or wireless connection to user manager 16 for analysis. By eliminating the need during testing for interaction with a wireless network, and by eliminating the need for complicated external cabling and expensive external devices, this solution advantageously reduces the amount of time and resources necessary to run any predetermined network communications test scenario 25 and provide proof of compliance with any predetermined communications processing standard 27. Thus, in one embodiment, product acceptance testing application 23 provides each wireless device 12, 18, 20, 22 with a resident or self-contained capability for simulating communications representative of actual communications with a wireless network and automatically performing product acceptance testing, while user manager 16 analyzes the test results and validates the configuration and operation of the device.
The wireless devices can include any type of computerized, wireless devices, such as cellular telephone 12, personal digital assistant 18, two-way text pager 20, and even a separate computer platform 22 that has a wireless communication portal, and which also may have a wired connection 24 to a network or the Internet. The wireless device can be a remote-slave, or other device that does not have an end-user thereof but simply communicates data across the wireless network 14, such as remote sensors, diagnostic tools, data relays, and the like. The apparatus and method of self-contained product acceptance testing on the wireless device can accordingly be performed on any form of wireless device or computer module including a wired or wireless communication portal, including without limitation, wireless modems, PCMCIA cards, access terminals, personal computers, telephones, or any combination or sub-combination thereof.
Referring to
Referring to
In one embodiment, such as a cellular telephone 12, processing subsystems 33 include at least a receive (“Rx”) component 35 for receiving communications sent to the processor of the wireless device, at least one call processing (“CP”) component 37 and/or system determination (“SD”) component 39 for handling the initiation, authentication, handoffs, data exchanges, messaging protocols, internal processing and decision-making, etc. associated with processing a message, and a transmit (“Tx”) component 41 for sending communications from the processor of the wireless device, such as to handset components, wireless network 14, wireless network components, and other devices connected to the wireless network. In this embodiment, CP component 37 may handle the majority of the call processing tasks, while SD component 39 may handle tasks relating to selecting an appropriate system, from a plurality of systems, with which to communicate, as well as higher-level decision-making tasks referenced by CP component 37.
In one embodiment, product acceptance test application 23 further includes a network simulation module 43 and a wireless device handset simulation module 45, and one or both of these modules may receive the communications transmitted from Tx component 41 and simulate an appropriate response. During the testing of simulated communication scenarios, product acceptance test application 23 and API 54 provide calls to communications processing engine 31 that prevent Tx component 41 from transmitting over-the-air, and instead direct the transmission to product acceptance test application 23. Network simulation module 43 includes, but is not limited to, a plurality of messages, message protocols and parameters, network characteristics, etc., such as may be associated with predetermined test scenarios 25 and predetermined device/network standards 27 (
Predetermined test scenarios 25, which may include a wide range of operational tests, simulated by product acceptance test application 23 may be defined by predetermined communications processing standards 27 (
Further, for example, these test scenarios may test the operational performance of various functions, parameters, characteristics, messaging protocols, etc., such as: terminations, originations and maintenance in strong signal, weak signal and mixed signal environments; radio frequency (“RF”) performance parameters, such as: receive (Rx) parameters including sensitivity, isolated magnetic dipole (“IMD”) and self-jamming, transmit (Tx) parameters such as waveform quality (“Rho”), power control and maximum power, and broadband (“BB”) and digital signal processing (“DSP”) parameters such as signal acquisition, soft handoff (“SHO”), searcher, and finger assignment; interoperability performance parameters such as: channel parameters including access channel (“ACH”), dedicated paging channel (“DPCH”), forward traffic channel (“FTCH”) and reverse traffic channel (“RTCH”), messaging parameters dealing with layer 1 and layer 2, and handoff parameters including SHO, interband hard handoff (“HHO”) and interfrequency HHO. Further, for example, these test scenarios may test wireless device feature parameters such as system acquisition, high speed packet data (“HSPD”), location determination, call types (POTS, 3-way, call waiting, voice mail, authentication, etc.), provisioning (over-the-air service provisioning (“OTASP”), over-the-air parameter administration (“OTAPA”), IP over-the-air (“IOTA”), etc.), and other parameters dealing with features such as short message service (“SMS”), multimedia service (“MMS”), browser, Java software and BREWED® software.
Referring back to
Network interface 26 may be any mechanism that allows user manager 16 to communicate across wireless network 14. For example, network interface 26 may include a local area network that connects user manager 16 through an Internet Service Provider to the Internet, which in turn may be connected to a respective wireless device through a carrier network and a base station.
In one embodiment, apparatus 10 can “push” at least one product acceptance test application 23 to be resident, at least temporarily, on the computer platform 50 of each wireless device 12, 18, 20, 22. For example, user manager 16 may “push” product acceptance test application 23 across wireless network 14 to the respective device. Alternately, product acceptance test application 23 can be placed on the platform 50 at the time of manufacture or initial programming, or the wireless device 12, 18, 20, 22 can “pull” the application from another computer device on the network, such as user manager 16, either with a request from the end-user, or automatically. Product acceptance data 29 can include, but is not limited to, messages, messaging protocols, and parameters, generated from communications processing engine 31 during the simulated operation of wireless device. Product acceptance data 29 can allow for specific troubleshooting of a device within the wireless network 14 based upon the gathered product acceptance data. As mentioned above, product acceptance application 23 or agent can be permanently stored in the local database 58 of the wireless device computer platform 50, or can only be temporarily held in memory 56 thereof for a one time (or n-time) execution to transmit product acceptance data 29.
Product acceptance test application 23 may cause the respective wireless device to selectively transmit product acceptance data 29 for that wireless device to another computer device, such as user manager 16, on the wireless network. In one embodiment, product acceptance test application 23 transmits product acceptance data 29 from that wireless device 12, 18, 20, 22 to user manager 16 across the wireless network 14 when requested. Alternately, product acceptance test data 29 is transmitted over an open communication connection from the wireless device 12, 18, 20, 22 to the wireless network 14, and thus “piggybacked” across an open connection, such as a voice or data call at the cellular telephone 12. In a cellular network configuration, product acceptance data 29 can be transmitted to user manager 16 through short message service. In another embodiment, a remote user manager 16 reads product acceptance data 29 from the respective device through the resident product acceptance application 23, and in some instances, writes commands to computer platform 50 and alters the operation of the wireless device 12, 18, 20, 22. Accordingly, the access to product acceptance testing application 23 allows user manager 16 to remotely control product acceptance testing and set-up, perform customer interactions, remotely monitor the wireless device, and remotely gather specific product acceptance information.
Referring back to
Additionally, apparatus 10 includes analysis engine 21 that analyzes product acceptance data 29 and generates product acceptance decision 47 as to whether or not the respective wireless device 12, 18, 20, 22 achieves predetermined communications processing standards 27 associated with predetermined network communications scenarios 25. For example, the analysis performed by analysis engine 21 may compare select portions of product acceptance data 29 with select portions of predetermined communications processing standards 27 to see whether or not the data falls within the standards. The selected predetermined communications processing standards 27 may be a minimum value, a maximum value, a range of values, a predetermined value, and combinations thereof Further, after performing an initial analysis on an initial set of product acceptance test data 29, analysis engine 21 may initiate further communications with one or more wireless devices 12, 18, 20, 22 to retrieve additional data related to product acceptance test data, or to initiate simulation of additional test scenarios 25 and generation of new product acceptance test data. Analysis engine 21 may repeat such a feedback loop until a predetermined solution is achieved, i.e. until a set number of tests are run and the results confirmed. Analysis engine 21 may include hardware, software, firmware, and combinations thereof for analyzing and processing product acceptance data 29. Additionally, analysis engine 21 may further include algorithms, decision-making routines, statistical programs, etc. for analyzing and interpreting product acceptance data 29. Analysis engine 21 may be located anywhere in communication with apparatus 10, such as on user manager 16 or on a respective wireless device 12, 18, 20, 22.
In another embodiment, referring to
In operation, referring to
Further, this embodiment of the method includes simulating communications between the wireless device and another device associated with a wireless communications network (Block 152). For example, the product acceptance test application may include one or more simulation modules, such as a network simulator module and a handset simulator module. Each of these simulator modules may simulate network-specific or external communications and handset-specific or internal device communications, respectively, that are received by a communications processing engine of the wireless device. Further, these simulated communications may be associated with a predetermined network communications test scenario, which may correspond to a predetermined communications processing standard.
This embodiment of the method also includes collecting product acceptance data associated with processing of the simulated communications by the wireless device (Block 154). For example, the product acceptance data is data generated by the communications processing engine of the wireless device during the processing of the simulated communications. The product acceptance test application may execute to cause the product acceptance data to be collected on a memory of the wireless device.
Additionally, the method includes forwarding the collected product acceptance data for analysis to determine a product acceptance decision (Block 156). For example, the collected product acceptance data may be obtained from the communications processing engine and stored in a memory of the wireless device for analysis on the computer platform of the device, or for forwarding across the wireless network for analysis by another computer device, such as a user manger. Further, in one embodiment, the collected product acceptance data is uploaded from the wireless device through a standard HTTP, an FTP or some other data transfer protocol.
Further, this embodiment of the method includes determining the product acceptance decision (Block 158). For example, the product acceptance data may be analyzed by an analysis engine associated with a user manager located across the wireless network from the wireless device. Alternatively, the analysis engine may reside on the wireless device. In one embodiment, the analysis engine may compare selected portions of the product acceptance data with selected portions the predetermined communications processing standards to decide whether or not the data achieves the standard. If the data does achieve the standard, then the product acceptance decision indicates a positive result, i.e. that the wireless device passes the corresponding test or standard. If the data does not achieve the standard, then the product acceptance decision indicates a negative result, i.e. that the wireless device fails the corresponding test or standard. Additionally, the product acceptance decision may be a summary decision based on more than one set of product test data, i.e. if there are a number of test scenarios that need to be run for a given standard. As such, the product acceptance decision may be based on an analysis of a plurality of test results, and a positive result may occur when each of the plurality of tests and/or standards are achieved.
Additionally, it should be noted that the method may include granting access to the product acceptance data to other business or commercial systems. To ensure the security and/or integrity of the collected product acceptance data, such access may be granted in a monitored fashion such as through a user manager. Further, other computer devices, including both storage and processing devices, can be located across the wireless network from the wireless device, and accordingly, the architecture associated with the user manager is readily scalable.
In summary, the apparatus can be implemented solely on the wireless device 12, 18, 20, 22. The wireless device can have at least one application or agent resident (either permanent or temporarily) on the computer platform 50 thereof which causes the gathering of product acceptance data 29 from communications processing engine 31, and which can effect selective transmission of the product acceptance data for that wireless device to another computer device (such as user manager 16) on the wireless network 14. If the wireless device 12, 18, 20, 22 is so embodied, product acceptance data 29 may be transmitted over an open communication connection from the wireless device 12, 18, 20, 22 to the wireless network 14, such as an open voice or data call. If the wireless device is a cellular telephone 12 and the wireless network is a cellular telecommunication network, such as shown in
In view of the method being executable on computer platform 50 of a wireless device 12, 18, 20, 22, the method includes a program resident in a computer readable medium, where the program directs a wireless device 12, 18, 20, 22 having a device platform 50 to perform the steps of the method. Such a program can be executed on any single computer platform, or can be executed in a distributed way among several computer platforms. Furthermore, the method can be implemented by a program that directs a computer device such as user manager 16 to perform a product acceptance determination through gathering and processing product acceptance data 29 from the wireless devices 12, 18, 20, 22.
The computer readable medium can be the memory 56 of the computer platform 50 of the cellular telephone 12, or other wireless device 18, 20, 22, or can be in a local database, such as local database 58 of the device platform 50. Further, the computer readable medium can be in a secondary storage media that is loadable onto a wireless device computer platform, such as a magnetic disk or tape, optical disk, hard disk, flash memory, or other storage media as is known in the art.
Further, the method may be implemented, for example, by operating portion(s) of the wireless network 14 and/or LAN 30, such as device platform 50 and user manager 16, to execute a sequence of machine-readable instructions. The instructions can reside in various types of signal-bearing or data storage primary, secondary, or tertiary media. The media may comprise, for example, RAM (not shown) accessible by, or residing within, the components of the wireless network 14 or LAN 30. Whether contained in RAM, a diskette, or other secondary storage media, the instructions may be stored on a variety of machine-readable data storage media, such as DASD (“direct access storage device”) storage (e.g., a conventional “hard drive” or a RAID (“redundant array of independent disks”) array), magnetic tape, electronic read-only memory (e.g., ROM, EPROM, or EEPROM), flash memory cards, an optical storage device (e.g. CD-ROM, WORM (write once, read many), DVD, digital optical tape), paper “punch” cards, or other suitable data storage media including digital and analog transmission media.
While the foregoing disclosure shows illustrative embodiments, it should be noted that various changes and modifications could be made herein without departing from the scope of the described embodiments as defined by the appended claims. Furthermore, although elements of the described embodiments may be described or claimed in the singular, the plural is contemplated unless limitation to the singular is explicitly stated.
The present Application for Patent is a divisional of patent application Ser. No. 11/080,288 entitled “APPARATUS AND METHODS FOR PRODUCT ACCEPTANCE TESTING ON A WIRELESS DEVICE” filed Mar. 14, 2005, pending, and assigned to the assignee hereof and hereby expressly incorporated by reference herein in its entirety.
Number | Date | Country | |
---|---|---|---|
Parent | 11080288 | Mar 2005 | US |
Child | 13231773 | US |