This application is generally related to U.S. Non-Provisional application Ser. No. ______ entitled “Seal Failure Detection System and Methods,” [Atty Docket No. 085430-1406031-008210US] and U.S. Provisional Application ______ entitled “Transfer Learning Methods and Models Facilitating Defect Detection,” [Atty Docket No. 085430-1406033-008310US] filed concurrently herewith, the entire contents of which are incorporated herein by reference for all purposes.
The present invention relates generally to the field of manufacturing, in particular identification of faulty units, such as sample cartridges for analysis of a fluid sample.
In recent years, there has been considerable development in the field of biological testing devices that facilitate manipulate a fluid sample within a sample cartridge to prepare the sample for biological testing by polymerase chain reaction (PCR). One notable development in this field is the GeneXpert sample cartridge by Cepheid. The configuration and operation of these types of cartridges can be further understood by referring to U.S. Pat. No. 6,374,684 entitled “Fluid Control and Processing System,” and U.S. Pat. No. 8,048,386 entitled “Fluid Processing and Control.” While these sample cartridges represent a considerable advancement in the start of the art, as with any precision instrument, there are certain challenges in regard to manufacturing of the sample cartridge, in particular the assembly of multiple components can occasionally result in defects that cause the sample cartridge to leak or unable to maintain internal pressure needed for successful operation.
Conventional systems for manufacturing sample cartridges utilize a series of manufacturing process and steps, some of which employ processes that can introduce defects into the sample cartridge, for example defects that cause the sample cartridge to be unable to maintain internal pressure, commonly known as seal failures. Certain steps, such as welding of a lid apparatus onto a cartridge body and film sealing of reagents in the cartridge occasionally introduce defects in sealing that can be difficult to detect. Existing approaches to detecting these include various seal testing approaches and visual inspections, however, these approaches often utilize destructive methods and/or occasionally fail to identify all defects. Existing testing procedures entail randomly selecting a number of units (e.g. 200 cartridges) produced from the assembly/manufacturing line and performing a specialized seal test (e.g. Seal Test Failure (STF) test). When more than a pre-set number units (e.g. 10 cartridges) fails the test, this results in abandoning the entire lot, which consists of a large volume of units (e.g. 1500 to 1600), as faulty. When these faulty units are not detected during this quality check process, this allow faulty units to reach to the customers.
Accordingly, there exists a need for improved methods of detecting faulty cartridges that avoids needless waste of entire lots and avoids faulty units reaching the customer. There is further need for faulty cartridge detection methods that are non-destructive, that do not require extensive testing post-manufacture and that are not prone to human errors.
In one aspect, the invention pertains to methods of detecting faulty sample cartridges. Such methods can include steps of: obtaining one or more data sets of one or more monitored operational parameters during a manufacturing process of a sample cartridge; comparing the one or more data sets to a baseline or standard data set of the manufacturing process associated with acceptable sample cartridges; and identifying a faulty sample cartridge based on a variance of the one or more data sets from the baseline or standard data set. In some embodiments, identifying a faulty sample cartridge is based on the monitored operational parameter being outside of a range of acceptable operational values of the parameter associated with approved sample cartridges. The range of acceptable values can vary with respect to time, depending on the manufacturing process. In some embodiments, identifying a faulty sample cartridge is based on the monitored operational parameter diverging from a standard characteristic profile of the operational parameters associated with approved sample cartridges.
In some embodiments, the manufacturing process includes welding of cartridge components by a welder that engages forcibly against the cartridge components, such as a lid and cartridge body, and applies ultrasonic energy to form a weld that seals the components together. The operational parameters can include any of: power, travel distance, force, amplitude, frequency, or any combination thereof. In some embodiments, the operational parameter includes power supplied to the welder during welding. In some embodiments, the operational parameter includes a travel distance of the welder sonotrode during welding. In some embodiments, the operational parameter includes a force applied by the sonotrode during welding. In some embodiments, the operational parameter includes an amplitude of the ultrasound applied during welding. In some embodiments, the operational parameter includes a frequency of the ultrasound applied by the ultrasonic sonotrode during welding. In some embodiments, the manufacturing process includes heat sealing of the cartridge lid by a heat sealing mechanism that presses a film across the lid and applies heat thereby heat sealing openings in the lid to seal reagents in the cartridge. In some embodiments, identifying faulty cartridges includes automatically identifying faulty cartridges based on the one or more data sets obtained from an automated control unit controlling operation of the manufacturing equipment, and the method can further include automatically discarding any faulty cartridge.
In another aspect, the invention pertains to a system configured for detecting faulty sample cartridges. Such systems include one or more sensors in communication with manufacturing equipment, where the sensors monitor operational parameters associated with operation of the manufacturing equipment performing a manufacturing process on the sample cartridge; and a processing unit communicatively coupled to the one or more sensors. The processing unit has recorded thereon instructions for performing automated detection of faulty sample cartridges that includes steps of: obtaining one or more data sets of the one or more monitored operational parameters from the one or more sensors during a manufacturing process of a sample cartridge; comparing the one or more data sets to a baseline data set of the manufacturing process associated with acceptable sample cartridges; and identifying a faulty sample cartridge based on a variance of the one or more data sets from the baseline data set. In some embodiments, the one or more sensors are integrated within a control unit that operates the manufacturing equipment. In some embodiments, the system is integrated within automation software that controls the manufacturing processes and associated manufacturing line and the system is configured to automatically discard any faulty cartridges during manufacturing. In some embodiments, the processing unit is configured such that identification of a faulty sample cartridge is based on the monitored operational parameters being outside of a range of acceptable operational values of the parameter associated with approved sample cartridges. The range of acceptable values can vary with respect to time. In some embodiments, the processing unit is configured such that identifying a faulty sample cartridge is based on the monitored operational parameter diverging from a characteristic profile of operational parameters associated with approved sample cartridges.
In some embodiments, the manufacturing process includes welding of cartridge components by a welder that engages forcibly against cartridge components, such as a lid and cartridge body, and applies ultrasonic energy to form a weld that seals the components together. In some embodiments, the operational parameters include any of: power, travel distance, force, amplitude, frequency, or any combination thereof. In some embodiments, the operational parameter includes power supplied to the welder during welding. In some embodiments, the operational parameter a travel distance of the welder sonotrode during welding. In some embodiments, the operational parameter includes a force applied by the sonotrode during welding. In some embodiments, the operational parameter includes an amplitude of the ultrasound applied during welding. In some embodiments, the operational parameter includes a frequency of the ultrasound applied by the ultrasonic sonotrode during welding. In some embodiments, the manufacturing process includes heat sealing of the cartridge lid by a heat-sealing mechanism that presses a film across the lid and applies heat thereby heat sealing the film atop the lid. In some embodiments, the processing unit is configured such that the defect detection is determined in real-time during manufacturing of the sample cartridge. In some embodiments, processing unit is configured to command the system to discard a faulty cartridge from the manufacturing line once identified.
The present invention relates generally to manufacturing defect detection, particularly identification of faulty sample cartridges during manufacturing. In some embodiments, the methods and systems provide automated identification of faulty cartridges that is performed in real-time during manufacturing. Flowcharts of such automated faulty cartridge identification methods are shown in
In one aspect, the invention pertains to an automated detection system for identifying faulty sample cartridge. An exemplary sample cartridge configured for testing for a target analyte is shown in
An exemplary use of such a sample cartridge with a reaction vessel for analyzing a biological fluid sample is described in commonly assigned U.S. Pat. No. 6,818,185, entitled “Cartridge for Conducting a Chemical Reaction,” filed May 30, 2000, the entire contents of which are incorporated herein by reference for all purposes. Examples of the sample cartridge and associated instrument module are shown and described in U.S. Pat. No. 6,374,684, entitled “Fluid Control and Processing System” filed Aug. 25, 2000, and U.S. Pat. No, 8,048,386, entitled “Fluid Processing and Control,” filed Feb. 25, 2002, the entire contents of which are incorporated herein by reference in their entirety for all purposes. Various aspects of the sample cartridge can be further understood by referring to U.S. Pat. No. 6,374,684, which described certain aspects of a sample cartridge in greater detail. Such sample cartridges can include a fluid control mechanism, such as a rotary fluid control valve, that is connected to the chambers of the sample cartridge. Rotation of the rotary fluid control valve permits fluidic communication between chambers and the valve so as to control flow of a biological fluid sample deposited in the cartridge into different chambers in which various reagents can be provided according to a particular protocol as needed to prepare the biological fluid sample for analysis. To operate the rotary valve, the cartridge processing module comprises a motor such as a stepper motor typically coupled to a drive train that engages with a feature of the valve to control movement of the valve in coordination with movement of the syringe, thereby resulting in movement of the fluid sample according to the desired sample preparation protocol. The fluid metering and distribution function of the rotary valve according to a particular sample preparation protocol is demonstrated in U.S. Pat. No. 6,374,684.
As described further below, the automated faulty cartridge detection system obtains one or more operational parameters 2011 from the welder, which are then input into a faulty cartridge detection unit 2040 which compares the parameters with corresponding operational parameters from acceptable cartridges (e.g. a number of cartridges having passed applicable performance tests). While these concepts are described with respect to the manufacturing process of welding, it is appreciated that these same concepts can be applied to various other manufacturing processes, including but not limited to film heat sealing of the reagents in the cartridge body at the film seal station. Similarly, this second data set of operational parameters 2031 from the film station can be input to the faulty detection unit to identify faulty cartridges due to defects in the film seal. This identification from both inputs can be output back into the manufacturing line to allow discarding of faulty cartridges before labelling and completion of the cartridges and shipping to the consumer.
In one aspect, the system and methods described herein utilize one or more monitored operational parameters associated with performing one or more manufacturing processes along the manufacturing production line to identify faulty cartridges in-real time during manufacturing. The monitored parameters can be obtained from existing control units that control operation of the manufacturing equipment, using sensors integral to the equipment, or can be obtained by additional sensors. In some embodiments, corresponding parameters from acceptable cartridges can be used to determine a baseline range or profile for a given parameter. In other embodiments, a more complex relationship between multiple parameters can be examined by use of specially developed algorithms. Given the complexity of data and the limited amount of data associated with defects (which are relatively infrequent), it can be advantageous to utilize a machine learning (ML) model to determine a relationship between one or more monitored parameters and faulty cartridges. By utilizing a ML model, subtle variations in monitored parameters that contribute to defects resulting in faulty cartridges can be examined. Advantageously, this automated defect detection allows for identification of faulty cartridges in real-time during manufacturing, so the cartridge can be removed during manufacturing. In some embodiments, the automated defect detection avoids the need to conduct destructive post-manufacturing testing on select cartridge from each lot, particularly destructive testing, thereby avoiding waste and reducing costs, while considerably improving defect detection.
In one aspect, one objective of this invention was to develop a supervised model based on power (P), travel (T), force (F), amplitude (A), and frequency (Y) data that are reported from the automated welder data (e.g. Hermann Welder data) during the welding process along the automated manufacturing line (e.g. Reagents On-Board Assembly Line (ROBAL)). In conventional systems, the automated welder data is reported in these five parameters in 1 milli-second resolution. This data shows how much power had been supplied to the welder and how much the lid of the cartridge had been moved as well as how much force had been applied by the ultrasonic welder (e.g. sonic rod or horn). When not enough distance (i.e., travel) is reported, this can indicate improper welding and discrete movement of force or amplitude can also indicate improper welding which can lead to failing Seal Test Failure (STF) associated with faulty cartridges. As noted previously, existing procedure requires abandoning entire lot when excessive number of units fail STF testing and more importantly allow faulty unit to reach our customers. Thus, by developing a supervised model allows for automated faulty cartridge detection that can detect faulty units in real-time to improve product quality and prevent waste associated with abandoning an entire lot.
In some embodiments, the automated faulty detection unit compares monitored operational parameters with corresponding operational parameters of acceptable cartridges. In some embodiments, the fault detection unit can use an algorithm that is determined by analyzing monitored parameters from a sufficient number of acceptable cartridges until the values of the parameter converge on an identifiable range or characteristic profile. In some embodiments, a ML model can be used to associate one or more parameters of a manufacturing process with a particular defect that contributes to faulty cartridges. In some embodiments, the defects are associated with welded seals (e.g. overweld, underweld, cracked chimney) and/or film seals (e.g. incomplete seal, melted chimney). The parameters or characteristics can include any attribute associated with the manufacturing process. Advantageously, this approach allows for defect detection in real-time during the manufacturing process such that the defective cartridges can be removed mid-process.
As shown in
As shown in
Based on available parameter data, one proposed model can be developed according to the following sequence: (1) Continue collecting data, n, until the variations in power (P), travel (T), force (F), amplitude (A), and frequency (Y) data converges. (2) Develop empirical distribution function of normal P, T, F, A, and Y, NP, NT, NF, NA, and NY respectively. (3) Compare the normal curves with real-time P,T,F,A, and Y, compute the difference for each cartridge serial number, i : DPi, DTi, DFi, DAi, DYi (4) Find the distribution of DPi, DTi, DFi, DAi, DYi and compute their p-values: PPi, PTi, PFi, PAi, PYi; (5) Create size 5 vector with these five p-values associated with each of the cartridge (6) Run supervised model based on these features with labelled data.
Based on available parameter data, another proposed model can be developed according to the following sequence: (1) generating a baseline vector from welding data associated with a welder used to attach the lid to the body; (2) collecting attachment data associated with the welder during attachment of the lid to the body; (3) converting the attachment data to a container vector; (4) determining a manufacturing status by comparing the container vector to the baseline vector; and (5) transmitting the manufacturing status to an output.
One or more methods can be performed via a non-transitory computer-readable medium having stored thereon instructions that, when executed by a processor, cause the processor to perform the method. The method can be used to detect manufacturing defects of a container, cartridge, or storage vessel in real time. Additionally, the output communicates a status, a result, information, instructions, or combinations thereof to a user or a device. The output can be auditory, visual, haptic, or combinations thereof. The output can be, for example, a screen, a speaker, an interface, or the like.
Existing auto feature generating models do not generally consider the shape of time series model but generate thousands of features that do not necessarily have physical meaning and can result in over-fitting the model. The proposed model takes the physical meaning of the data into account and creates custom features prior to developing the supervised model. Based on the custom-built features, the drift in welding parameters can also be monitored and accounted for in identifying faulty cartridges. It is noted that not all abnormal patterns associated with power (P), travel (T), force (F), amplitude (A), and frequency (Y) parameters resulted in faulty cartridges (e.g. seal test failures), and that additional relationships between parameters can be examined. It is appreciated that the above approach is but one example to developing a model of the applicable parameters and that various other approaches could be realized. In some embodiments, the various parameters can be input into a ML model so as to develop algorithms that illustrate a relationship between one or more parameters and faulty cartridges, as well as a relationship between multiple differing parameters and faulty cartridges in order to further improve faulty cartridge detection.
In the foregoing specification, the invention is described with reference to specific embodiments thereof, but those skilled in the art will recognize that the invention is not limited thereto. Various features, embodiments and aspects of the above-described invention can be used individually or jointly. Further, the invention can be utilized in any number of environments and applications beyond those described herein without departing from the broader spirit and scope of the specification. The specification and drawings are, accordingly, to be regarded as illustrative rather than restrictive. It will be recognized that the terms “comprising,” “including,” and “having,” as used herein, are specifically intended to be read as open-ended terms of art. Any references to publication, patents, or patent applications are incorporated herein by reference in their entirety for all purposes.
This application is a Non-Provisional of and claims the benefit of priority of U.S. Provisional Application No. 63/374,312 filed on Sep. 1, 2022, which is incorporated herein by reference.
Number | Date | Country | |
---|---|---|---|
63374312 | Sep 2022 | US |