Method for real time detection of defects in a food product

Information

  • Patent Grant
  • 8284248
  • Patent Number
    8,284,248
  • Date Filed
    Tuesday, August 25, 2009
    14 years ago
  • Date Issued
    Tuesday, October 9, 2012
    11 years ago
Abstract
The present invention is a method to detect defects in a process producing a food product by utilizing multivariate image analysis. In one aspect, an image is captured of the food product in the visible spectrum by on-line vision equipment, multivariate image analysis is performed on the image via an algorithm programmed onto a field programmable gate array to determine if a defect exists, a signal is sent to downstream sorting equipment, and the sorting equipment then rejects those food products that contain defects.
Description
BACKGROUND OF THE INVENTION

1. Technical Field


This invention relates to the use of multivariate image analysis to detect defects on a production line producing a food product.


2. Description of Related Art


The chemical acrylamide has long been used in its polymer form in industrial applications for water treatment, enhanced oil recovery, papermaking, flocculants, thickeners, ore processing and permanent-press fabrics. Acrylamide precipitates as a white crystalline solid, is odorless, and is highly soluble in water (2155 g/L at 30° C.). Synonyms for acrylamide include 2-propenamide, ethylene carboxamide, acrylic acid amide, vinyl amide, and propenoic acid amide. Acrylamide has a molecular mass of 71.08, a melting point of 84.5° C., and a boiling point of 125° C. at 25 mmHg.


In recent times, a wide variety of foods have tested positive for the presence of acrylamide monomer. Acrylamide has especially been found primarily in carbohydrate food products that have been heated or processed at high temperatures. Examples of foods that have tested positive for acrylamide include coffee, cereals, cookies, potato chips, crackers, french-fried potatoes, breads and rolls, and fried breaded meats. Acrylamide has not been determined to be detrimental to humans, but its presence in food products, especially at elevated levels, is undesirable.


One way to reduce the formation of acrylamide is to thermally process food products to a higher moisture content. However, food products that contain too much moisture have poor organoleptical properties and are undesirable to consumers. It is the objective of the present invention to detect defects, particularly food products having a moisture content above a certain threshold, in a process producing a food product with a higher moisture content.


SUMMARY OF THE INVENTION

One aspect of the present invention is directed towards a method for the real time detection of defects in a food product comprising the steps of capturing an image of a food product in the visible spectrum, performing multivariate image analysis on the image to reveal a data set, and determining whether a defect exists in the food product based on the data set. In one aspect, the invention further comprises removal of food products containing a defect prior to a packaging step. One aspect of the invention comprises adjusting a process variable to reduce the number of manufactured food products that are defective. One aspect of the present invention comprises analyzing and removing the food products for acrylamide defects.


One aspect of the present invention is directed towards a field programmable gate array having an algorithm that transforms a color image of a food product into a data set such as a t1-t2 score space via multivariate image analysis, determines if a defect exists based on the data set, and sends a signal to downstream sorting equipment to reject said defect within about 0.002 seconds.


In one aspect, the present invention is directed towards an apparatus for monitoring a process producing a food product for defects. In one aspect, the apparatus comprises an image capturing device, a computing device capable of storing an algorithm, wherein said algorithm transforms a color image of a food product into a suitable expression of an image matrix via multivariate image analysis, and determines if a defect exists based on a resulting data set.


Other aspects, embodiments and features of the invention will become apparent from the following detailed description of the invention when considered in conjunction with the accompanying drawings. The accompanying figures are schematic and are not intended to be drawn to scale. In the figures, each identical, or substantially similar component that is illustrated in various figures is represented by a single numeral or notation. For purposes of clarity, not every component is labeled in every figure. Nor is every component of each embodiment of the invention shown where illustration is not necessary to allow those of ordinary skill in the art to understand the invention.





BRIEF DESCRIPTION OF THE DRAWINGS

The novel features believed characteristic of the invention are set forth in the appended claims. The invention itself, however, as well as a preferred mode of use, further objectives and advantages thereof, will be best understood by reference to the following detailed description of illustrative embodiments when read in conjunction with the accompanying drawings, wherein:



FIG. 1 depicts a general flow chart of a method for detecting defects in a process producing a food product in accordance with one embodiment of the present invention;



FIG. 2 depicts prophetic moisture content distributions of potato chips;



FIG. 3
a depicts a plurality of fried potato chips, each chip having a desirable crispy region and a defective soft center region;



FIG. 3
b is a depiction of the corrected image of the defective soft center region superimposed upon the fried potato chips depicted in FIG. 3a;



FIG. 4 is a prophetic representation of the color images of two fried potato chips transformed into the t1-t2 score space; and



FIG. 5 depicts a schematic representation of one embodiment of the present invention.





DETAILED DESCRIPTION

The present invention, in one embodiment, comprises a method for real-time detection of defects in a process producing a food product. The present invention can be used to monitor a process producing a food product and detect food products that contain defects by utilizing multivariate image analysis to differentiate between characteristics of the food product, some of which are defective and some of which are not, that appear similar when viewed in the visible spectrum.


Referring now to FIG. 1, an image is captured 100 of the food product in the visible spectrum, which encompasses the wavelength range of 400 nm to 700 nm, by on-line vision equipment such as a digital camera, as the product proceeds down the process line. In one embodiment, the entire width of a conveyor belt is imaged thereby providing maximum inspection and analysis of the surface of the food product. In one embodiment the food is in a monolayered configuration. Bedded food products can be placed into monolayered configuration by transferring bedded food product from a first conveyor belt to a much faster moving second conveyor belt. Multivariate image analysis (hereinafter “MIA”) is then performed on the image via an algorithm 110. In one embodiment, the algorithm can be programmed into a field programmable gate array (FPGA), which is a semiconductor device, known in the art, that can be programmed in the field. In one embodiment, an application specific integrated circuit can be used to process the algorithm. The algorithm can be used to reveal a data set, which depicts the location of the product characteristics in the t1-t2 score space or other suitable expression of the image matrix via multivariate image analysis.


Next, it is determined if a defect exists 120 based on the resulting data set. In one embodiment, if a defect is found, a signal 130 can be sent to sorting equipment, such as a bank of independently selected air nozzles, located downstream from the vision equipment, to reject the food product containing the defect. The sorting equipment then rejects those food products that contain defects by deflecting the defective food products from the conveyor carrying the product with a stream of air from an air nozzle prior to a packaging step.


In one embodiment, the invention comprises using the real time measurement of defects to adjust a process variable in the food manufacturing line to lower the percentage of defects in the food products.


One embodiment of the present invention can be explained with reference to a potato chip production line and “soft center” defects that occur in fried potato chips having a moisture content of greater than about 2.5% by weight. A soft center defect occurs when a thermally processed food such as a fried potato chip is not cooked to a moisture content that ensures a crispy texture throughout the food product. Thus, the central region of the food product is relatively soft. Soft centers are problematic because they adversely affect the shelf life of the product by increasing the amount of moisture in the product container and lead to the product becoming stale more rapidly. Further, soft centers affect the texture of the potato chip, which results in decreased consumer satisfaction, and can cause multiple chips to stick together, which results in problems during further processing.


As foods are thermally processed to higher moisture contents to lower the level of acrylamide in the food, soft center defects become more prevalent. For example, potato chips are typically cooked by frying to a moisture content distribution prophetically depicted by curve 200 in FIG. 2. As shown in FIG. 2, when potato chips are fried to a target moisture content of about 1.4% by weight, very few of the fried potato chips have moisture contents above 2% by weight. However, thermally processing foods to higher moisture contents such as a target moisture content of about 1.8% by weight, to reduce the formation of acrylamide can result in an unintended consequence of producing larger numbers of soft centers, which need to be removed from the product stream prior to packaging. The curve 220 in FIG. 2 represents the prophetic moisture content distribution of a thermally processed potato chip fried to a target moisture content of about 1.8%. As shown by FIG. 2, raising the target moisture content of the potato chips results in a much greater percentage of the chips having a moisture content of more than about 2.0%. Also evident in FIG. 2 is that the prophetic moisture distribution 220 is wider as the target moisture is increased. The reason that the moisture distribution 220 increases is that the lower end of the distribution is further from the constraint of the “bound” moisture content of the finished potato chip. Consequently, an even greater than expected level of soft center defects occurs by raising the target moisture content.


Existing sorting equipment in the production of potato chips based on the visible spectrum sorts out defective chips based on the degree of darkness (e.g. black, brown, green), and size of the observed defect on the chip. However, detecting soft center defects with the existing equipment is difficult because soft centers reflect light differently than other defects because soft center defects emit a white or glossy/shiny wavelength signature. For example, color is sometimes described in an HSI (hue, saturation, intensity) color space. It is difficult to use the HSI colorspace to accurately detect soft centers because the glare or glossy component, which is mostly unrelated to the object's actual saturation and intensity properties, is necessarily measured by the HSI technology. Further complicating matters is the fact that oil-soaked chips, which are not considered defective, also emit a white or glossy wavelength signature and can be erroneously rejected along with the soft centers.


Oil soaked chips are fried food products where the oil is not attached to the starch. Various regions of the fried chip can be oil-soaked. In some embodiments, because chips are analyzed for defects within a relatively short period of time after exiting the fryer, oil can still be on the surface of the fried food if the oil is not yet been imbibed into the food product. Oil soaked chips are not considered defective. Consequently, a need exists for an apparatus and method to monitor a thermally processed food product production line for soft centers, and selectively reject the soft centers without rejecting oil-soaked chips.


While thermally processed fried food products are typically processed to moisture contents of less than 2.5% by weight of the food product, and more preferably less than about 2.0% by weight of the food product, baked goods such as crackers can be thermally processed to higher moisture contents and still be shelf-stable. Consequently, as used herein, a thermally processed food product is defined as a food product having a moisture content of less than about 5% by weight, and more preferably less than about 3.5% by weight. As used herein, the term chip and thermally processed food product are used interchangeably.


One embodiment of the present invention allows soft center defects and oil-soaked chips to be differentiated by performing multivariate image analysis on an image taken in the visible spectrum of the thermally processed food product to construct an algorithm that can be used to identify features, such as soft center defects and oil-soaked areas on the food product.


A color image captured in the visible spectrum is a multivariate image composed of three variables—red, green and blue channels. The color of each pixel in the image has varying intensities of the colors red, green and blue and is characterized by the numerical values (normally integers from 0 to 255) of its red, green and blue channels. A color image can be expressed as a 3-way matrix. Two dimensions represent the x-y spatial coordinates and the third dimension is the color channel. Without considering the spatial coordinates of pixels, the image matrix can be unfolded and expressed as a 2-way matrix.








I


N
row

×

N
col

×
3





unfold



I

N
×
3



=


[




c

1
,
r





c

1
,
g





c

1
,
b






M


M


M





c

i
,
r





c

i
,
g





c

i
,
b






M


M


M





c

N
,
r





c

N
,
g





c

N
,
b





]

=

[




c
1





M





c
i





M





c
N




]







I is a 3-way image matrix with image size Nrow×Ncol. I is the unfolded 2-way image matrix. N is the number of pixels in the image, N=Nrow×Ncol, ci,r, ci,g, ci,b (i=1, . . . , N) are the intensity values of the red, green and blue channels for pixel i. ci (i=1, . . . , N) is the i-th row vector of I, which represents the color values of pixel i. Different regression methods known in the art, such as Principle Component Analysis (PCA) or Partial Least Squares (PLS), may be used on the 2-way matrix I to obtain a t1-t2 score space.


For example, multi-way Principle Component Analysis can be performed on the multivariate color image to obtain a t1-t2 score space. Multi-way PCA is equivalent to performing PCA on the unfolded 2-way image matrix I.






I
=




a
=
1

A




t
a



p
a
T








where A is the number of principal components, the ta's are score vectors and the corresponding pa's are loading vectors.


Because the row dimension of the 2-way image matrix I is very large (equal to 307,200 for a 480×640 image space) and the column dimension is much smaller (equal to 3 for an RGB color image), a kernel algorithm can be used to compute the loading and score vectors. In this algorithm, the kernel matrix (ITI) is first formed (for a set of images, kernel matrix is calculated as










k




I
k
T



I
k



)

,





and then singular value decomposition (SVD) is performed on this very low dimension matrix (3×3 for color image) to obtain loading vectors pa (a=1, . . . , A).


After obtaining loading vectors, the corresponding score vectors to are then computed ta=I pa. Since the first two components normally explain most of the variance, instead of working in original 3-dimensional RGB space, working in the 2-dimensional orthogonal t1-t2 score space allows the images to be more easily interpreted.



FIG. 3
a depicts a plurality of fried potato chips, each chip having a desirable, non-defective crispy region 302 and a soft center region 304. The lightly hatched region depicted by numeral 304 necessarily represents a darker color in this drawing than would be indicative of a soft center on an actual color image, and is depicted to show a prophetic soft center region 304. FIG. 4 is a prophetic representation of the color images of two fried potato chips transformed into the t1-t2 score space. Computer software for transforming an image into a t1-t2 score space is known in the art.


To develop the algorithm used to accomplish the multivariate image analysis that correlates the color image of a fried potato chip to determine whether the chip is defective, a multiway PCA is performed on two of the images in FIG. 3a to convert the t1-t2 score space of each potato chip 410411 depicted in FIG. 4.


Modifications may be made to existing equipment to enable the user to look for white/glossy areas, such as changing the belt material from white to a darker color like blue to allow differentiation between the background/transport belt color and the defect thereby permitting more accurate detection of soft centers. Consequently, in one embodiment, the background color, for example the color of the conveyor belt, is removed from the image in FIG. 3a prior to converting the image of each potato chip into t1-t2 score space. Following removal of the background, the RGB image of the potato chip depicted in FIG. 3a can then be converted into a transformed image 410411 depicted in FIG. 4. Those having ordinary skill in the art will understand that different food products will produce different t1-t2 score spaces. For example the t1-t2 score space fora tortilla chip will be different than the t1-t2 score space for a potato chip. It should be pointed out that there are other ways to unfold and express the image matrix other than the t1-t2 score space and such expression is provided for purposes of illustration and not limitation.


Next, a mask is created by highlighting an identified defect in the RGB space and observing where the defect falls in the t1-t2 space. A mask 402 is created that highlights the area in the t1-t2 space that is characteristic of the defect, which corresponds to the soft center region identified by numeral 304 in FIG. 3a. In one embodiment, the mask 402 occurs in the same t1-t2 space even though score space of each potato chip 410411 may encompass different areas on the t1-t2 space.


The area comprising the mask 402 in the t1-t2 space is selected and a corrected image is projected back into the RGB space on the potato chip shown in FIG. 3b. Mask areas around the defect region 304 shown in FIG. 3a are, in one embodiment, selected by trial and error until the corrected image mapped back into the RGB space is substantially superimposed upon the defective area 314 of the chip shown in FIG. 3b. In one embodiment, the mask areas around the defect region 304 shown in FIG. 3a can be selected by an automation algorithm that can optimize the mask generation task.


The above process can be repeated to define masks that are correlated with other food product properties including, but not limited to, other defects. For example, potato slices with defects have also been found to be linked with higher levels of acrylamide when fried in hot oil (e.g., fried in oil having an oil temperature of greater than about 280° F.) than potato slices having no potato defects. A potato slice having no defects is a slice having an evenly golden color on its entire surface area after frying. Potato defects are well known to those skilled in the art and such defects include, but are not limited to zebra, dry rot, scab, hollow heart, greening, blackleg, sprouting, bruises, leaf roll and sugar defects. Additional detail on defects found in potatoes, including a listing of such defects, can be found in Information Bulletin 205 titled ‘Detection of Potato Tuber, Diseases and Defects’ published by the Cornell University Department of Plant Pathology on their website at http://vegetablemdonline.ppath.cornell.edu/factsheets/Potato_Detection.htm. This information bulletin is incorporated herein by reference.


Several fried potato slices having various defects were fried to a moisture content below 2% by weight in hot oil and analyzed for levels of acrylamide. The results are provided in the table below.

















Fried Potato Chip




Acrylamide Level



Defect
(ppb)









Zebra
4435



High Sugar
2062



Black Leg
1081



Sprout
1927



Green
1816



Bruise
 531



Rot
1564










Sugar defects are not typically removed from product streams prior to packaging. Interestingly, chips having the highest acrylamide levels because of sugar defects have not historically been flagged as consumer defects, because these defects have predominantly light to mid-brownish colors and therefore are not considered unacceptable. Rather, defects such as rot, blackleg, and sprouting which have predominantly black or very dark colors are the types of potato defects most likely to be removed prior to packaging.


As exemplified by the data above, removal of defective fried potato chips from the packaging process can help to substantially reduce the average level of acrylamide in a food product serving. Consequently, in one embodiment of the invention, a food product having an acrylamide defect known to be characteristic of high levels of acrylamide is removed prior to packaging the food products. As used herein, a food product has an acrylamide defect known to be characteristic of a high level of acrylamide if the acrylamide concentration due to the defect is more than twice the level of a non-defective potato slice thermally processed under the same conditions. Thus, a slice having a sugar defect is one that because of higher than normal sugar content will produce a finished potato slice having more than twice the level of acrylamide as a potato slice having a normal sugar content (e.g., chipping potatoes typically have less than 0.05% reducing sugar by weight of a fresh potato) that is thermally processed under the same conditions.


In one embodiment, a mask is created by highlighting a non-defective portion of a chip, such as an oil-soaked region and observing where the defect falls in the RGB space. Mask areas can again be selected by trial and error or by an automated algorithm until the oil-soaked area produces a corrected image that adequately covers the non-defective area of the chip. In this way, a differentiation can be made between the light colored area on the potato chip that is caused by a defective soft center as opposed to a light colored area on the potato chip that corresponds to non-defective oil-soaked chip. Software, such as Proportion, from Prosensus, Inc. can be used to develop the algorithm in the manner discussed above to accomplish the multivariate image analysis that can be used to create the corrected image.


This algorithm can then be programmed into a FPGA to determine, based on the captured image and corresponding dataset calculated from that image, the number, type, and degree of defect pixels within the chip, and establish which chips are defective. FPGA's are known in the art and can, for example, be purchased from Hunt Engineering of Brent Knoll Village, Somerset, England.


Advantageously, the present invention, unlike the prior art, permits one or more defective areas within the chip to be aggregated. In one embodiment, defects most associated with acrylamide can be weighted so that acrylamide defects require less defective area for removal than other defects, such as soft centers, which have relatively low levels of acrylamide. Whether a chip is classed as defective can be determined by one or more pre-determined variables. In one embodiment, a defect exists when the dataset or corrected image reveals that at least about 10% of the imaged food comprises a soft center.


In one embodiment, defective chips are targeted for removal. If a chip has been targeted for removal, the FPGA can calculate the target area, translate the target area to the specific rejection nozzles in the bank of air nozzles downstream, calculate the necessary timing, and communicate the firing sequence to the ejector controller. Sorting equipment such as a Manta high capacity sorter available from Key Technologies of Walla Walla, Wash. can be used.



FIG. 5 depicts a schematic representation of one embodiment of the present invention. In one embodiment, the bank of independently triggered air nozzles 508, situated about the entire width of the conveyor 502, are located a short distance (e.g., less than about 5 feet and more preferably less than about 3 feet) downstream from the image capturing equipment 504. Therefore, in such embodiment, if the food product 502 is moving along the conveyor at speeds upward of 500 ft/min, the multivariate image analysis and determination of whether a chip is defective must take place very quickly.


To accomplish this, the algorithm can be programmed into the processor 506 that is connected with the vision equipment 504 and sorting equipment 508. A color image of a potato chip 502 can be taken by the vision equipment 504 and sent to the processing unit 506. The processing unit 506 can comprise an FPGA.


The processor 506 applies the algorithm that was developed by methods discussed above to the image, which transforms the color image into a t1-t2 score space or other suitable expression of the image matrix via multivariate image analysis and determines if a defect exists based on the resulting data set. In one embodiment, the resulting dataset is used to superimpose a corrected image in the RGB space onto the food substrate.


In one embodiment, if a defect exists, a signal is sent to the downstream sorting equipment 508 to reject the defective chip. Using FPGA and/or high speed processor array technology 506 allows the process to occur in less than about 0.002 seconds and more preferably in less than about 0.001 seconds to allow actuation of high speed air solenoid valves connected to air nozzles 508 that are selected to remove identified defects from the product stream. Defective chips are routed to a defect stream 510 while the non-defective chip stream 512 is routed to seasoning and/or packaging.


In one embodiment, if a defect exists, a signal can then be used to adjust process variables to adjust the defect levels in a finished food product. For example, the time and temperature of exposure of a food product in the fryer can be optimized so as to reduce, lower and/or minimize the level of defects in the finished food product. For example, the paddle wheel speed can be decreased to permit a longer residence time in the fryer and/or the hot oil temperature can be increased to fry out the soft centers. Other process levels that can be adjusted include, but are not limited to, oil flow rate into the fryer, the oil level in the fryer, the submerger speed, the take out conveyor speed, the inlet oil temperature, and the product feed rate.


In one embodiment, an evaluation of the defect stream 510 and/or non-defect stream 512 occurs to provide additional fine tuning to the process. For example, in one embodiment, the defect stream 510 is measured to ascertain the level of non-defective chips in the defect stream 510. In one embodiment, the non-defect stream 512 is measured to ascertain the level of defective chips in the non-defective stream 512. This information is collected, along with statistics of the incoming defects by type and degree calculated from the processor 506 and used to adjust the algorithm. Such fine tuning can be achieved in one embodiment by observing the shape of the mask in the t1-t2 image and increasing (causing more of the pixels to fit within the definition of a specified defect class) or decreasing (causing less of the pixels to fit within the definition of a specified defect class) the radial distance from the centroid of the mask, 402 shown in FIG. 4.


In one embodiment, the number, type, and degree of defect pixels within each chip in the defective stream 510 and/or the non-defective stream 512 are counted for purposes of statistical analysis 514. In one embodiment, these statistics can be combined with the level of defective chips in the non-defect stream 512 to evaluate the performance 516 of the system. Using the information from the system performance 516, and the level of non-defective food products in the defect stream 510, calculations can be made to adjust the aggressiveness 518 of the tuning as it applies to each individual defect class. For example, as it applies to each individual defect class if a high number of defects are being passed through the system, the tuning action would be to steadily increase the sensitivity of each defect, by class, until an acceptable degree of defect rejection is achieved. On the other hand, if the number of defects in the non-defective stream 512 is within acceptable performance limits, and the number of “good” chips in the reject stream 510 is unacceptably high (meaning that yield is being given up), then the system could be tuned by decreasing the sensitivity or aggressiveness 518 to certain defect classes (the ones that are less egregious in terms of acrylamide) to reduce the number of “good” chips occurring in the reject stream 510.


This information can be used alone or in conjunction with a manual input by an operator to adjust the overall sensitivity 520 of the system. In such embodiment, an operator would have access to an operator input device such as a slide bar or up/down arrow keys, or a “bias” adjustment/numeric input based on any desired scale (e.g. 0-100, +1-10, etc) that would be used to bias the overall system sensitivity to defects. For, example, if the operator wants to increase the allowable defects in the “good” or non-defective stream 512 to increase or decrease by a given percentage, say from 5% to 4%, the operator would be able to make this adjustment manually. In one embodiment, the manual adjustment by an operator would be unavailable to adjust the sensitivity of certain classes of defects, specifically those resulting in increased acrylamide levels, to ensure that rejection of such defects could not be overridden manually by an operator.


Prophetic Example

Potato slices are cooked in a continuous fryer at, for example, a temperature of about 340° F. to about 370° F. for approximately 3 minutes. The cooking step generally reduces the moisture level of the chip to less than 2% by weight. For example, a typical fried potato chip exits the fryer with approximately 1.5% moisture by weight.


The cooked potato chips exit the fryer and proceed along a conveyor at approximately 8 feet per second. A digital camera, positioned above the conveyor, captures a color image of the chip as it proceeds down the conveyor. The image is sent to the processing unit containing the FPGA or processor array with the programmed algorithm. The FPGA or processor array applies the algorithm to transform the color image into a t1-t2 score space. The algorithm then determines if the potato chip is defective based where the chip's characteristics are located in the t1-t2 score space. A mask is created that highlights the area in the t1-t2 score space that is characteristic of the defect. This is done first by highlighting an identified defect in the RGB space and observing where the defect falls in the t1-t2 space. An area around the point in the t1-t2 score space is selected and projected back into the RGB space. Mask areas around the defect region would have been previously identified by trial and error until the area mapped back into the RGB space adequately covers the defective area of the chip. The FPGA signals the sorting equipment, that in one embodiment comprises one or more air nozzles, that a defective chip is approaching in 3 feet or 0.006 seconds. The sorting equipment then rejects the defective chip by contacting the defective chip with a blast of air as the chip is launched across an opening of about 12 inches in width between the transport conveyor to a receiving/slow down chute. The air blast deflects the defective chip from the conveyor and into a waste stream.


One advantage for having a short distance between the detection zone and the rejection nozzles is that chips moving at high velocities, meaning speeds of greater than about 500 feet per minute exhibit aerodynamics and can move relative to the targeting information that is transmitted to the air rejection nozzles. Any movement in relative position of the chip can result in either a missed shot or possibly rejecting an adjacent non-defective chip. An advantage of placing the vision units as close as possible to the rejection nozzles is that the theoretical probability of missed chips or false rejections is reduced. In one embodiment, image is captured during the “flight” of the chip between the transport conveyor and the slow down chute. In those cases, the distance is probably on the order of less than a foot between the image acquisition system and the ejection nozzles.


Though the present invention has been described with reference to a potato chip production line and soft center defects in potato chips, it is to be understood that the invention is applicable to other defects a familiar to the potato processing industry, and other thermally processed food products, such as baked or fried corn chips, tortilla chips, crackers, etc. The examples and explanations given are not meant to limit the present invention.


Having thus described several aspects of at least one embodiment of this invention, it is to be appreciated that various alterations, modifications, and improvements will readily occur to those skilled in the art. Such alterations, modifications, and improvements are intended to be part of this disclosure, and are intended to be within the spirit and scope of the invention. Accordingly, the foregoing description and drawings are by way of example only.

Claims
  • 1. A method for detecting defects in a process producing food products having a processing unit, said method comprising the steps of: capturing an image of said food products in a visible spectrum;performing multivariate image analysis on said image to reveal a data set;determining whether a defect exists based on said data set;wherein said defect occurs when said food products comprise a moisture content of more than about 2.0% by weight;wherein said defect exists when said data set reveals at least about 10% of an imaged area of said imaged food products comprises a soft center; rejecting said food products that comprise said defects; andwherein said multivariate image analysis occurs by an algorithm programmed into a field programmable gate array.
  • 2. The method of claim 1 further comprising the step of adjusting a process variable to provide a lowered number of said defects.
  • 3. The method of claim 1 wherein said data set comprises a t1-t2 score space.
  • 4. The method of claim 1 further comprising the step of counting the food products that comprise said defects.
  • 5. The method of claim 1 wherein said defect further comprises an acrylamide defect.
  • 6. The method of claim 5 wherein said acrylamide defect further comprises a sugar defect.
  • 7. A method for detecting defects in a process producing food products having a processing unit, said method comprising the steps of: capturing an image of said food products in a visible spectrum;performing multivariate image analysis on said image to reveal a data set;rejecting food products that contain defects, wherein said defects comprise food products with a pre-determined moisture content;measuring said food products rejected for non-defective food product;tuning said dataset based upon non-defective food products measured in said rejected food products; andwherein said multivariate image analysis occurs by an algorithm programmed into a field programmable gate array.
  • 8. The method of claim 7 further comprising the step of determining whether a defect exists based on said data set before said rejecting step.
  • 9. The method of claim 7 further comprising the step of sending a signal to downstream sorting equipment to reject the food products comprising said defect before said rejecting step.
  • 10. The method of claim 7 further comprising the step of measuring said food products not rejected at said rejecting step for defective food products.
  • 11. The method of claim 10 further comprising the step of tuning said dataset based upon defective food products measured in a non-rejected food product stream.
  • 12. An apparatus for monitoring a process producing food products for defects comprising: a processing unit;an image capturing device;a computing device configured to store an algorithm, wherein said algorithmtransforms a color image of said food products into a t1-t2 score space via multivariate image analysis;determines if a defect exists based on a resulting data set, wherein said defect exists when said data set reveals at least about 10% of an imaged area of said imaged food products comprises a soft center;rejects said food products that comprise said defects; andwherein said multivariate image analysis occurs by said algorithm being programmed into a field programmable gate array.
  • 13. The apparatus of claim 12 wherein said computing device comprises a plurality of computer processing arrays that segments said color image.
US Referenced Citations (279)
Number Name Date Kind
1053 Hatfield Dec 1838 A
1782960 Erysin Nov 1930 A
2448152 Patton Aug 1948 A
2490431 Greene Dec 1949 A
2498024 Baxter Feb 1950 A
2584893 Lloyd Feb 1952 A
2611705 Hendel Sep 1952 A
2704257 deSellano Mar 1955 A
2744017 Baldwin May 1956 A
2759832 Cording, Jr. Aug 1956 A
2762709 Janis Sep 1956 A
2780552 Willard Feb 1957 A
2893878 Simon Jul 1959 A
2905559 Anderson Sep 1959 A
2910367 Melnick Oct 1959 A
2987401 Johnston Jun 1961 A
3026885 Eytinge Mar 1962 A
3027258 Markakis Mar 1962 A
3038810 Akerboom Jun 1962 A
3044880 Bogyo Jul 1962 A
3085020 Backinger Apr 1963 A
3219458 Higby Nov 1965 A
3278311 Brown Oct 1966 A
3305366 Sutton Feb 1967 A
3359123 Katucki Dec 1967 A
3365301 Lipoma Jan 1968 A
3369908 Gonzalez Feb 1968 A
3370627 Willard Feb 1968 A
3404986 Wimmer Oct 1968 A
3436229 Simpson Apr 1969 A
3460162 Sijbring Aug 1969 A
3545979 Ghafoori Dec 1970 A
3578463 Smith May 1971 A
3608728 Trimble Sep 1971 A
3620925 Mochizuki Nov 1971 A
3627535 Davidson Dec 1971 A
3634095 Willard Jan 1972 A
3652402 Chibata Mar 1972 A
3687679 Sijbring Aug 1972 A
3690895 Amadon Sep 1972 A
3725087 Miller Apr 1973 A
3773624 Wagner Nov 1973 A
3782973 Pittet Jan 1974 A
3812775 Sijbring May 1974 A
3849582 Blagdon Nov 1974 A
3851572 Lazzarini Dec 1974 A
3870809 Green Mar 1975 A
3914436 Nakadai Oct 1975 A
3917866 Purves Nov 1975 A
3925568 Rao Dec 1975 A
3987210 Cremer Oct 1976 A
3997684 Willard Dec 1976 A
3998975 Liepa Dec 1976 A
4005225 Craig Jan 1977 A
4073952 Standing Feb 1978 A
4084008 Yueh Apr 1978 A
4122198 Wisdom Oct 1978 A
4124727 Rockland Nov 1978 A
4136208 Light Jan 1979 A
4140801 Hilton Feb 1979 A
4167137 van Remmen Sep 1979 A
4192773 Yoshikawa Mar 1980 A
4199612 Fragas Apr 1980 A
4210594 Logan Jul 1980 A
4251895 Caridis Feb 1981 A
4272554 Schroeder Jun 1981 A
4277510 Wicklund Jul 1981 A
4312892 Rubio Jan 1982 A
4317742 Yamaji Mar 1982 A
4366749 Caridis Jan 1983 A
4394398 Wilson Jul 1983 A
4418088 Cantenot Nov 1983 A
4461832 Tschang Jul 1984 A
4537786 Bernard Aug 1985 A
4555409 Hart Nov 1985 A
4582927 Fulcher Apr 1986 A
4594260 Vaquerio Jun 1986 A
4595597 Lenchin Jun 1986 A
4645679 Lee Feb 1987 A
4673581 Fulcher Jun 1987 A
4706556 Wallace Nov 1987 A
4721625 Lee Jan 1988 A
4749579 Haydock Jun 1988 A
4751093 Hong Jun 1988 A
4756916 Dreher Jul 1988 A
4806377 Ellis Feb 1989 A
4844930 Mottur Jul 1989 A
4844931 Webb Jul 1989 A
4863750 Pawlak Sep 1989 A
4884780 Ohashi Dec 1989 A
4889733 Willard Dec 1989 A
4900576 Bonnett Feb 1990 A
4917909 Prosise Apr 1990 A
4931296 Shanbhag Jun 1990 A
4933199 Neel Jun 1990 A
4937085 Cherry Jun 1990 A
4963373 Fan Oct 1990 A
4966782 Heidolph Oct 1990 A
4971813 Strobel Nov 1990 A
4978684 Cerami Dec 1990 A
4985269 Irvin Jan 1991 A
5002784 Pare Mar 1991 A
5009903 deFigueiredo Apr 1991 A
5035904 Huang Jul 1991 A
5045335 DeRooij Sep 1991 A
5071661 Stubbs Dec 1991 A
5087467 Schwank Feb 1992 A
5126153 Beck Jun 1992 A
5134263 Smith Jul 1992 A
5137740 Benson Aug 1992 A
5167975 Tsurumaki Dec 1992 A
5171600 Young Dec 1992 A
5176933 Fulcher Jan 1993 A
5196225 Lush Mar 1993 A
5232721 Polansky Aug 1993 A
5279840 Baisier Jan 1994 A
5292542 Beck Mar 1994 A
5298274 Khalsa Mar 1994 A
5356646 Simic-Glavaski Oct 1994 A
5362511 Villagran Nov 1994 A
5368879 White Nov 1994 A
5370898 Zussman Dec 1994 A
5389389 Beck Feb 1995 A
5391384 Mazza Feb 1995 A
5391385 Seybold Feb 1995 A
5393543 Laufer Feb 1995 A
5394790 Smith Mar 1995 A
5441758 Lewis Aug 1995 A
5447742 Malvido Sep 1995 A
5458903 Colson Oct 1995 A
5464642 Villagran Nov 1995 A
5464643 Lodge Nov 1995 A
5505978 Roy Apr 1996 A
5514387 Zimmerman May 1996 A
5534280 Welch Jul 1996 A
5554405 Fazzolare Sep 1996 A
5558886 Martinez-Bustos Sep 1996 A
5580598 Benson Dec 1996 A
5589213 Desai Dec 1996 A
5603972 McFarland Feb 1997 A
5603973 Benson Feb 1997 A
5620727 Gerrish Apr 1997 A
5676042 Sakuma Oct 1997 A
5690982 Fazzolare Nov 1997 A
5695804 Hnat Dec 1997 A
5707671 Beck Jan 1998 A
5747084 Cochran May 1998 A
5776531 Aasman Jul 1998 A
5792499 Atwell Aug 1998 A
5846589 Baker Dec 1998 A
5858429 Wallace Jan 1999 A
5858431 Wiedersatz Jan 1999 A
5887073 Fazzari Mar 1999 A
5919691 Schulein Jul 1999 A
5945146 Twinam Aug 1999 A
5947010 Barry Sep 1999 A
5972367 Inoue Oct 1999 A
5972397 Durance Oct 1999 A
6001409 Gimmler Dec 1999 A
6016096 Barnes Jan 2000 A
6025011 Wilkinson Feb 2000 A
6033707 Lanner Mar 2000 A
6039978 Bangs Mar 2000 A
6066353 Martines-Serna Villagran et al. May 2000 A
6068872 Hashiguchi May 2000 A
6068873 Delrue May 2000 A
RE36785 Colson Jul 2000 E
6139884 Shifferaw Oct 2000 A
6159530 Christiansen Dec 2000 A
6207204 Christiansen Mar 2001 B1
6210720 Leusner Apr 2001 B1
6227421 Richard May 2001 B1
6287672 Fields Sep 2001 B1
6290999 Gerrish Sep 2001 B1
6299914 Christiansen Oct 2001 B1
6335048 Swarvar Jan 2002 B1
6358544 Henry, Jr. Mar 2002 B1
6383533 Soeda May 2002 B1
6419965 Douaire Jul 2002 B1
6436458 Kuechle Aug 2002 B2
6521871 Shelton Feb 2003 B1
6528768 Simic-Glavaski Mar 2003 B1
6531174 Barrett et al. Mar 2003 B2
6558730 Gisaw May 2003 B1
6599547 Villagran Jul 2003 B1
6602533 Smith Aug 2003 B1
6607777 Walsh Aug 2003 B1
6638554 Rubio Oct 2003 B1
6638558 Brubacher Oct 2003 B2
6716462 Prosise Apr 2004 B2
6770469 Yamaguchi Aug 2004 B2
6778887 Britton Aug 2004 B2
6828527 Simic-Glavaski Dec 2004 B2
6872417 Freudenrich Mar 2005 B1
6896528 Kubota May 2005 B2
6929812 Van Der Doe Aug 2005 B2
6989167 Howie Jan 2006 B2
7037540 Elder May 2006 B2
7122719 Hakimi Oct 2006 B2
7169417 Lang et al. Jan 2007 B2
7189422 Howie Mar 2007 B2
7190813 Daley et al. Mar 2007 B2
7220440 Dria May 2007 B2
7267834 Elder Sep 2007 B2
7291380 Nyholm Nov 2007 B2
7393550 Barry Jul 2008 B2
7514113 Zyzak Apr 2009 B2
7524519 Zyzak Apr 2009 B2
7527815 Teras May 2009 B2
7534934 Rommens May 2009 B2
20020018838 Zimmerman Feb 2002 A1
20020025367 Koehler Feb 2002 A1
20020129713 Caridis Sep 2002 A1
20030049359 Kulkarni Mar 2003 A1
20030183092 Barber Oct 2003 A1
20030198725 Cardenas Oct 2003 A1
20030219518 Li Nov 2003 A1
20040047973 Bourhis Mar 2004 A1
20040086597 Awad May 2004 A1
20040101607 Zyzak May 2004 A1
20040105929 Tomoda Jun 2004 A1
20040109926 Tomoda Jun 2004 A1
20040115321 Tricoit Jun 2004 A1
20040126469 Tomoda Jul 2004 A1
20040131737 Tomoda Jul 2004 A1
20040180125 Plank Sep 2004 A1
20040180129 Plank Sep 2004 A1
20040197012 Bourg et al. Oct 2004 A1
20040224066 Lindsay Nov 2004 A1
20050064084 Elder Mar 2005 A1
20050068535 Bond Mar 2005 A1
20050074538 Elder Apr 2005 A1
20050079254 Corrigan Apr 2005 A1
20050118322 Elder Jun 2005 A1
20050152811 Taylor Jul 2005 A1
20050196504 Finley Sep 2005 A1
20050214411 Lindsay Sep 2005 A1
20060019007 Baas Jan 2006 A1
20060088633 Barber Apr 2006 A1
20060110503 Bates May 2006 A1
20060127534 Elder Jun 2006 A1
20060193964 Eckhoff Aug 2006 A1
20060210693 Oftring Sep 2006 A1
20060216376 Milici Sep 2006 A1
20060216388 Christensen Sep 2006 A1
20070042080 Plomp Feb 2007 A1
20070087101 Gusek Apr 2007 A1
20070141225 Elder Jun 2007 A1
20070141226 Elder Jun 2007 A1
20070141227 Boudreaux Jun 2007 A1
20070148318 Rubio Jun 2007 A1
20070166439 Soe Jul 2007 A1
20070178219 Boudreaux Aug 2007 A1
20070184175 Rubio Aug 2007 A1
20070196556 Van Der Meer Aug 2007 A1
20070281062 Bourg Dec 2007 A1
20070292589 Elder Dec 2007 A1
20080003340 Karwowski Jan 2008 A1
20080008780 Streekstra Jan 2008 A1
20080101657 Durkin May 2008 A1
20080138480 Bows Jun 2008 A1
20080144880 DeLuca Jun 2008 A1
20080166450 Corrigan Jul 2008 A1
20080166452 Corrigan Jul 2008 A1
20080253648 Mulder Oct 2008 A1
20080279994 Cantley et al. Nov 2008 A1
20080299273 Bhaskar Dec 2008 A1
20090047725 Elder Feb 2009 A1
20090074915 Hendriksen Mar 2009 A1
20090098265 Kock Apr 2009 A1
20090191310 Zyzak Jul 2009 A1
20100040729 Sahagian Feb 2010 A1
20100040750 Assaad Feb 2010 A1
20100051419 Desai Mar 2010 A1
20100055259 Bourg Mar 2010 A1
20100062123 Anderson Mar 2010 A1
20100112177 Bourg, Jr. May 2010 A1
20100143540 Bhaskar Jun 2010 A1
20100255167 Bourg Oct 2010 A1
Foreign Referenced Citations (50)
Number Date Country
4032002 Jun 2003 CL
2743230 Apr 1979 DE
113940 Jul 1984 EP
1419702 May 2004 EP
1419703 May 2004 EP
2019044 Feb 1990 ES
874453 Aug 1942 FR
156905 Jan 1921 GB
1132296 Oct 1968 GB
1519049 Jul 1978 GB
335214 Sep 1980 GB
68006927 Sep 1965 JP
70009815 Oct 1966 JP
57100179 Dec 1980 JP
62048351 Mar 1987 JP
4104753 Apr 1992 JP
6030782 Feb 1994 JP
06169713 Jun 1994 JP
05123126 May 1998 JP
10136883 May 1998 JP
11056280 Mar 1999 JP
11178536 Jul 1999 JP
2004180563 Jul 2004 JP
2004-313183 Nov 2004 JP
2004313183 Nov 2004 JP
2005278448 Oct 2005 JP
910006619 Aug 1991 KR
1822863 Jun 1993 RU
2048512 Nov 1995 RU
2078797 May 1997 RU
2140927 Nov 1999 RU
2216574 Nov 2003 RU
9601572 Jan 1996 WO
0004784 Feb 2000 WO
0191581 Dec 2001 WO
2004004484 Jan 2004 WO
2004026043 Apr 2004 WO
2004028276 Apr 2004 WO
2004028277 Apr 2004 WO
2004028278 Apr 2004 WO
2004032647 Apr 2004 WO
2004032648 Apr 2004 WO
2004039174 May 2004 WO
2004040999 May 2004 WO
2004047559 Jun 2004 WO
2004060078 Jul 2004 WO
2004080205 Sep 2004 WO
2006128843 Dec 2006 WO
2007106996 Sep 2007 WO
2008061982 May 2008 WO
Related Publications (1)
Number Date Country
20110050880 A1 Mar 2011 US