Patent Grant
10304179
This application claims priority to Malaysian Patent Application No. PI 2016001263, filed on Jul. 5, 2016, the disclosure of which is hereby incorporated by reference in its entirety.
The present invention relates to a maturity determination device and a maturity determination method.
The economic value of a harvesting target of fruits and vegetables depends on the content of a specific ingredient contained in the harvesting target. For example, an oil palm bunch (Fresh Fruit Bunch) includes a large number of (e.g., 1,000 to 3,000) fruits, each of which includes pericarp (also referred to as “pulp”), “mesocarp” and a seed (also referred to as “palm kernel”). In the case where the harvesting target is an oil palm bunch, the content of oil contained in the mesocarp or palm kernel in a fruit is considered important. The oil contained in the mesocarp is generally called “palm oil”, and the oil contained in the palm kernel is generally called “palm kernel oil”. The oil content of the oil palm fruit is known to be different in accordance with the maturity level of the oil palm bunch (specifically, fruits). Specifically, the oil content of a ripe fruit is known to be higher than the oil content of an unripe, underripe (slightly unripe) or overripe fruit. For example, the oil content of a fruit when being ripe is about three times the oil content thereof when being unripe.
For example, in Malaysia, the Malaysian Palm Oil Board (MPOB) has established guidelines on the maturity level of fruits. Currently, farmers working in oil palm plantations subjectively determine whether or not to harvest the fruits in accordance with the guidelines. As described above, the maturity level of the oil palm bunch significantly influences the amount of yield of oil. Therefore, a wrong subjective determination of a farmer (worker) on whether or not to harvest the fruits may have a significant influence on the amount of yield. In actuality, it is difficult for a farmer to correctly determine whether the fruits are ripe or not, which is a factor that decreases the amount of yield of oil.
In such a situation, measurement equipments have been developed for measuring various characteristics of an oil palm bunch, which is a subject (harvesting target), by use of near infrared light without destroying the bunch, namely, in a nondestructive manner. Such measurement equipments irradiate the subject with near infrared light of a predetermined wavelength and measure a characteristic to be measured based on the reflectance of the light from the subject.
WO2012/074372 discloses a system that determines the maturity level of oil palm fruits using a hyperspectral imaging technology. WO2012/074372 also discloses the characteristic that the reflectance of the light of the near infrared wavelength band varies in accordance with the maturity level of the fruit. In this system, an image of a harvested oil palm bunch is captured by a spectral camera to acquire a sample image, and the sample image is analyzed based on the characteristic that the reflectance varies in accordance with the maturity level of the fruits to determine the maturity level of the oil palm fruit.
Japanese Laid-Open Patent Publication No. 2000-356591 discloses a nondestructive sugar content meter that calculates the sugar content of fruits and vegetables by a sugar content estimation equation by use of an output from a photoelectric conversion element based on light that has passed a near infrared light wavelength filter. Japanese Laid-Open Patent Publication No. Hei 8-122250 discloses a nondestructive measurement device that determines the maturity level of fruits and vegetables based on the intensity ratio between two specific wavelength components of near infrared light.
As described above, the economic value of a harvesting target depends on the content of a specific ingredient contained in the harvesting target. Therefore, it is desired to harvest the harvesting target at the time when the content of the specific component in the harvesting target is high. For example, in the case where the harvesting target is an oil palm bunch, it is desired to harvest the oil palm bunch at the time when the content of the palm oil or palm kernel oil is high.
However, the system disclosed in WO2012/074372 is developed for indoor use, and outdoor use is not fully considered. Therefore, the system is of a large scale. In addition, the hyperspectral camera is costly, and thus the system is also costly. In a high-temperature, high-humidity environment, the hyperspectral camera is not considered durable. Therefore, it is very difficult to perform, for example, image capturing of an oil palm bunch in a tree in an oil palm plantation by use of the hyperspectral camera and determine the maturity level on the spot in order to determine an appropriate time to harvest the oil palm bunch. It is now assumed that the time to harvest is determined on the spot by use of the hyperspectral camera and an oil palm bunch having a high economic value is harvested. However, even in such a case, the load on the farmer is increased by the large-scale system, which lowers the efficiency of the entire harvesting work. As a result, the producer does not fully enjoy the advantage that the economic value of the harvesting target is improved.
The present invention made to solve the above-described problem provides a maturity determination device and a maturity determination method determining, with high precision, the time to harvest a harvesting target while reducing the load on a farmer without decreasing the efficiency of the harvesting work.
A maturity determination device in an embodiment according to the present invention is a maturity determination device determining a maturity level of a fruit or vegetable product, and includes an image capturing device including a plurality of pixels arrayed one-dimensionally or two-dimensionally, the image capturing device performing image capturing of at least a part of the fruit or vegetable product to acquire an image, the plurality of pixels including a plurality of first pixels each including a first light transmission filter selectively transmitting light of a first wavelength band, the intensity of the light of the first wavelength band reflected by the fruit or vegetable product varying in accordance with the maturity level; and a signal processing circuit configured to find an area size ratio of an intensity distribution of the light of the first wavelength band on the basis of a predetermined reference value based on pixel values obtained from the plurality of first pixels, and to generate maturity determination information in accordance with the area size ratio.
In an embodiment, the first wavelength band may be a wavelength band of near infrared light.
In an embodiment, the first wavelength band may be a wavelength band of near infrared light from 800 nm to 900 nm.
In an embodiment, the signal processing circuit may calculate the number of pixels having a pixel value larger than, or equal to, a first threshold value or a pixel value smaller than, or equal to, the first threshold value from the plurality of first pixels, may find a first ratio of the calculated number of the pixels with respect to the number of the plurality of first pixels, and may generate the maturity determination information based on a result of comparing the first ratio against a second threshold value.
In an embodiment, the plurality of pixels may further include a plurality of second pixels each including a second light transmission filter selectively transmitting light of a second wavelength band, the intensity of the light of the second wavelength band reflected by the fruit or vegetable product varying in accordance with the maturity level, the second wavelength band being different from the first wavelength band; and the signal processing circuit may generate the maturity determination information based on the pixel values obtained from the plurality of first pixels and pixel values obtained from the plurality of second pixels.
In an embodiment, the second wavelength band may be a wavelength band of red light.
In an embodiment, the signal processing circuit may add a pixel value obtained from each first pixel of the plurality of first pixels and a pixel value obtained from each second pixel of the plurality of second pixels on a pixel-by-pixel basis, said each second pixel being associated with said each first pixel, may calculate the number of pixels having a sum value larger than, or equal to, a third threshold value or a sum value smaller than, or equal to, the third threshold value from pixels as targets of addition, may find a second ratio of the calculated number of the pixels with respect to the number of the pixels as the targets of addition, and may generate the maturity determination information based on a result of comparing the second ratio against a fourth threshold value.
In an embodiment, the signal processing circuit may subtract a pixel value obtained from each second pixel of the plurality of second pixels from a pixel value obtained from each first pixel of the plurality of first pixels on a pixel-by-pixel basis, said each second pixel being associated with said each first pixel, may calculate the number of pixels having a difference value larger than, or equal to, a third threshold value or a difference value smaller than, or equal to, the third threshold value from pixels as targets of subtraction, may find a third ratio of the calculated number of the pixels with respect to the number of the pixels as the targets of subtraction, and may generate the maturity determination information based on a result of comparing the third ratio against a fourth threshold value.
In an embodiment, the signal processing circuit may calculate the number of pixels having a pixel value larger than, or equal to, a fifth threshold value or a pixel value smaller than, or equal to, the fifth threshold value from the plurality of second pixels, may find a fourth ratio of the calculated number of the pixels with respect to the number of the plurality of second pixels, and may generate the maturity determination information based on a result of comparing the first ratio against the second threshold value and a result of comparing the fourth ratio against a sixth threshold value.
In an embodiment, the plurality of pixels further may include a plurality of third pixels each including a third light transmission filter selectively transmitting blue light and a plurality of fourth pixels each including a fourth light transmission filter selectively transmitting green light; and the signal processing circuit may generate a color image based on pixel values obtained from the plurality of second, third and fourth pixels, and may generate, based on the maturity determination information, a maturity level image including information on the reference value and representing the maturity level.
In an embodiment, the maturity determination device may further include an output interface which outputs the maturity determination information to outside.
In an embodiment, the maturity determination device may further include a driving circuit which generates a driving signal for driving a notification device notifying the maturity level, the notification device being connectable with the maturity determination device, and the driving signal being generated in accordance with the maturity determination information.
In an embodiment, the maturity determination device may further include a notification device which notifies the maturity level; and a driving circuit which generates a driving signal for driving the notification device, the driving signal being generated in accordance with the maturity determination information.
In an embodiment, the notification device may include at least one of an optical device emitting light in accordance with the driving signal, a sound output device outputting a sound in accordance with the driving signal, a vibration device vibrating in accordance with the driving signal, and a display device displaying maturity level information in accordance with the driving signal.
In an embodiment, the maturity determination device may further include a display device; and a driving circuit which generates a driving signal for driving the display device, the driving signal being generated in accordance with the maturity determination information. The display device may display the maturity level image as overlapping the color image in accordance with the driving signal.
In an embodiment, the signal processing circuit may determine whether the fruit or vegetable product is harvestable or not based on the maturity determination information.
In an embodiment, the light reflected by the fruit or vegetable product at the time of harvest thereof may have a reflectance characteristic that an intensity thereof increases as the light has a longer wavelength in a wavelength band from the blue light to the near infrared light.
In an embodiment, the fruit or vegetable product may be a bunch with a large number of fruits.
A method in an embodiment according to the present invention is a method for determining a maturity level of a fruit or vegetable product, and includes the steps of receiving an image including at least a part of the fruit or vegetable product, the image including an intensity distribution of light of at least a first wavelength band, the intensity of the light of the first wavelength band reflected by the fruit or vegetable product varying in accordance with the maturity level; finding an area size ratio of the intensity distribution of the light of the first wavelength band on the basis of a predetermined reference value; and generating maturity determination information in accordance with the area size ratio.
In an embodiment, the first wavelength band may be a wavelength band of near infrared light.
In an embodiment, the first wavelength band may be a wavelength band of near infrared light from 800 nm to 900 nm.
In an embodiment, in the step of finding the area size ratio, the number of pixels having a pixel value larger than, or equal to, a first threshold value or a pixel value smaller than, or equal to, the first threshold value may be calculated from the plurality of first pixels including information, representing the intensity distribution of the light of the first wavelength band, and included in the image; and a first ratio of the calculated number of the pixels with respect to the number of the plurality of first pixels may be found. In the step of generating the maturity determination information, the maturity determination information may be generated in accordance with a result of comparing the first ratio against a second threshold value.
In an embodiment, in the step of receiving the image, the image received may further include an intensity distribution of light of a second wavelength band, the intensity of the light of the second wavelength band reflected by the fruit or vegetable product varying in accordance with the maturity level, the second wavelength band being different from the first wavelength band. In the step of generating the maturity determination information, the maturity determination information may be generated based on the intensity distributions of the light of the first wavelength band and the light of the second wavelength band.
In an embodiment, the second wavelength band may be a wavelength band of red light.
In an embodiment, in the step of finding the area size ratio, a pixel value of each first pixel of the plurality of first pixels including information, representing the intensity distribution of the light of the first wavelength band, and included in the image, and a pixel value of each second pixel of the plurality of second pixels including information, representing the intensity distribution of the light of the second wavelength band, and included in the image, may be added together on a pixel-by-pixel basis, said each second pixel being associated with said each first pixel; the number of pixels having a sum value larger than, or equal to, a third threshold value or a sum value smaller than, or equal to, the third threshold value may be calculated from pixels as targets of addition; and a second ratio of the calculated number of the pixels with respect to the number of the pixels as the targets of addition may be found. In the step of generating the maturity determination information, the maturity determination information may be generated in accordance with a result of comparing the second ratio against a fourth threshold value.
In an embodiment, in the step of finding the area size ratio, a pixel value of each second pixel of the plurality of second pixels including information, representing the intensity distribution of the light of the second wavelength band, and included in the image may be subtracted, on a pixel-by-pixel basis, from a pixel value of each first pixel of the plurality of first pixels including information, representing the intensity distribution of the light of the first wavelength band, and included in the image, said each second pixel being associated with said each first pixel; the number of pixels having a difference value larger than, or equal to, a third threshold value or a difference value smaller than, or equal to, the third threshold value may be calculated from pixels as targets of subtraction; and a third ratio of the calculated number of the pixels with respect to the number of the pixels as the targets of subtraction may be found. In the step of generating the maturity determination information, the maturity determination information may be generated in accordance with a result of comparing the third ratio against a fourth threshold value.
In an embodiment, in the step of finding the area size ratio, the number of pixels having a pixel value larger than, or equal to, a fifth threshold value or a pixel value smaller than, or equal to, the fifth threshold value may be calculated from the plurality of second pixels including information, representing the intensity distribution of the light of the second wavelength band, and included in the image; a fourth ratio of the calculated number of the pixels with respect to the number of the plurality of second pixels may be found; and the maturity determination information may be generated in accordance with a result of comparing the first ratio against the second threshold value and a result of comparing the fourth ratio against a sixth threshold value.
In an embodiment, in the step of receiving the image, the image received may further include intensity distributions of blue light and green light. The method may further include the step of generating a color image based on pixel values obtained from the plurality of pixels including information representing the intensity distributions of the red light, the blue light and the green light, and generating a maturity level image including information on the reference value and representing the maturity level, the maturity level image being generated based on the maturity determination information.
In an embodiment, the method may further include the step of outputting the maturity determination information to outside.
In an embodiment, the method may further include the step of generating a driving signal for driving a notification device notifying the maturity level, the driving signal being generated in accordance with the maturity determination information.
In an embodiment, the notification device may include at least one of an optical device emitting light in accordance with the driving signal, a sound output device outputting a sound in accordance with the driving signal, a vibration device vibrating in accordance with the driving signal, and a display device displaying maturity level information in accordance with the driving signal.
In an embodiment, the method may further include the step of displaying the maturity level image as overlapping the color image on a display device.
In an embodiment, the method may further include the step of performing image capturing of at least a part of the fruit or vegetable product to acquire the image.
In an embodiment, in the step of acquiring the image, the image may be acquired by performing image capturing of a central part and the vicinity thereof of the fruit or vegetable product.
In an embodiment, in the step of acquiring the image, the image may be acquired a plurality of times.
In an embodiment, the method may further include the step of determining whether the fruit or vegetable product is harvestable or not based on the maturity determination information.
In an embodiment, the light reflected by the fruit or vegetable product at the time of harvest thereof may have a reflectance characteristic that an intensity thereof increases as the light has a longer wavelength in a wavelength band from the blue light to the near infrared light.
In an embodiment, the fruit or vegetable product may be a bunch with a large number of fruits.
A computer program in an embodiment according to the present invention causes a computer, usable for a maturity determination device determining a maturity level of a fruit or vegetable product, to execute the steps of receiving an image including at least a part of the fruit or vegetable product, the image including an intensity distribution of light of at least a first wavelength band, the intensity of the light of the first wavelength band reflected by the fruit or vegetable product varying in accordance with the maturity level; finding an area size ratio of the intensity distribution of the light of the first wavelength band on the basis of a predetermined reference value; and generating maturity determination information in accordance with the area size ratio.
According to an embodiment of the present invention, a maturity determination device and a maturity determination method determining, with high precision, the time to harvest a harvesting target while reducing the load on a farmer without decreasing the efficiency of the harvesting work are provided.
As a result of accumulating studies, the present inventors found the following problems.
There are problems to be solved in order to determine, highly precisely, the time to harvest of a harvesting target. Oil palm is harvested in units of bunches each including a larger number of fruits. There is a distribution of maturity level of fruits included in one bunch, which is one factor that makes it difficult to determine the maturity level. In the case where one bunch, which is a unit of harvesting, includes a large number of fruits as in the case of oil palm, the maturity level cannot be determined by simply averaging pixel values of a plurality of pixels included in an image of the bunch. One bunch includes dead calyx and leaves in addition to the fruits, which is also a factor that makes it difficult to determine the maturity level. The image of the bunch may include information on the dead calyx and the leaves, which is not related to the fruits. Therefore, it is difficult to use only the information on the fruits to determine the maturity level.
Based on the above-described knowledge, the present inventors found a method by which the maturity level is determined highly precisely even in the case where a bunch includes a large number of fruits having different maturity levels and also includes dead calyx and leaves as in the case of oil palm, and thus have arrived at the present invention.
A maturity determination device in an embodiment according to the present invention determines the maturity level of a fruit or vegetable product, and is preferably usable as a device determining the maturity level of, for example, an oil palm bunch including a large number of fruits. The maturity determination device includes an image capturing device including a plurality of pixels arrayed one-dimensionally or two-dimensionally, the image capturing device performing image capturing of at least a part of the fruit or vegetable product to acquire an image, the plurality of pixels including a plurality of first pixels each including a first light transmission filter selectively transmitting light of a first wavelength band, the intensity of the light of the first wavelength band reflected by the bunch varying in accordance with the maturity level; and a signal processing circuit configured to find an area size ratio of an intensity distribution of the light of the first wavelength band on the basis of a predetermined reference value based on a pixel value obtained from the plurality of first pixels, and to generate maturity determination information in accordance with the area size ratio. The light of the first wavelength band is typically near infrared light. With this structure, the maturity level of a fruit or vegetable product is determined with high precision.
A method in an embodiment according to the present invention is a method determining the maturity level of a fruit or vegetable product, and is preferably usable as a method determining the maturity level of, for example, an oil palm bunch including a large number of fruits. The method includes the steps of receiving an image including at least a part of the fruit or vegetable product, the image including an intensity distribution of light of at least a first wavelength band, the intensity of the light of the first wavelength band reflected by the bunch varying in accordance with the maturity level; finding an area size ratio of the intensity distribution of the light of the first wavelength band on the basis of a predetermined reference value; and generating maturity determination information in accordance with the area size ratio. With this method, the maturity level of a fruit or vegetable product is determined with high precision.
In this specification, a maturity determination device and a maturity determination method determining the maturity level of an oil palm bunch, which is an example of fruit or vegetable product. In this specification, any type or any part of fruit or vegetable that is to be harvested is referred to as a “fruit or vegetable product”. As described below, the present invention encompasses determination of the maturity level of a fruit or vegetable product with which the reflectance of light varies in accordance with the maturity level in a specific wavelength band, for example, coffee fruits, apples and mangoes.
Hereinafter, a maturity determination device and a maturity determination method in embodiments according to the present invention will be described with reference to the attached drawings. In the following description, identical or similar elements will bear the identical reference signs to each other. The maturity determination device and the maturity determination method in an embodiment according to the present invention are not limited to those in any of the following embodiments. For example, one embodiment and another embodiment may be combined together.
With reference to
[Structure of System 1000 for which the Determination Method is Usable]
An example of structure of a system 1000 for which the determination method in this embodiment is usable will be described. The determination method in this embodiment may also be preferably usable for another device (or a system) different from the system 1000. A specific example of the another device (in this specification, will be referred to as a “maturity determination device”) will be described below in detail.
The image capturing device 200 includes a lens 210 and an image sensor 220. The image capturing device 200 may be realized as, for example, a camera module.
The lens (or lens group) 210 collects light from the bunch F onto an image capturing surface of the image sensor 220. The lens 210 may be a single lens or include a plurality of lenses. The lens 210 may include a lens for autofocus (AF) and/or a lens for optical zooming. The lens for AF and the lens for optical zooming are drivable by a dedicated driver (not shown). The image capturing device 200 may include a control circuit (not shown) controlling such a driver.
The image sensor 220 is, for example, a CCD (Charge Coupled Device) sensor or a CMOS (Complementary Metal Oxide Semiconductor) sensor. The image sensor 220 includes a plurality of pixels arrayed one-dimensionally or two-dimensionally (pixel array 220A shown in
The image sensor 220 includes the plurality of pixels 221 arrayed two-dimensionally (pixel array 220A). The pixels 221 each include the microlens 222, the light transmission filter 223 and a photoelectric conversion element 224.
The microlens 222 is located on the light transmission filter 223, and collects light from the bunch F to improve the pixel sensitivity. The light transmission filter 223 selectively transmits light of a specific wavelength band. For example, the light transmission filter 223 is either an IR filter or one of RGB color filters. As shown in
The photoelectric conversion element 224 is typically a photodiode (PD), and converts received light into an electric signal. The PD is, for example, embedded in a semiconductor substrate formed of silicon (not shown).
As shown in
Any of various pixel unit patterns other than the above-described pixel unit patterns may be selected. For example, the pixel unit does not need to include the B filter, or may include only the IR filter and the R filter. The number of each type of filters included in the pixel unit is arbitrary.
As described below in detail, the reflectance of light (intensity of reflected light) of a first wavelength band from, for example, the bunch F varies in accordance with the maturity level. The first wavelength band is, for example, a near infrared wavelength band. In the case where the maturity level of a fruit or vegetable product exhibiting such a characteristic is to be found, the unit pixel merely needs to include at least the IR filter. For example, the four filters in the pixel unit shown in
In this specification, the term “pixel value” is, for example, an 8-bit gray scale value, and mainly refers to RAW data. The image capturing device 200 at least outputs RAW data. Alternatively, the image capturing device 200 may have a function of generating a luminance/color difference signal based on the RAW data and outputting the luminance/color difference signal.
The calculation device P includes a signal processing circuit (not shown) that processes pixel values output from the image capturing device 200 to generate maturity determination information. The calculation device P is, for example, a personal computer (PC) such as a laptop computer or the like. Data transmission between the calculation device P and the image capturing device 200 may be performed by, for example, wireless communication. The wireless communication may be conformed to, for example, the Bluetooth (registered trademark) standards. Needless to say, the calculation device P and the image capturing device 200 may be connected with each other in a wired manner by, for example, a USB cable or the like. The calculation device P may further include a driving circuit (not shown) that generates a driving signal for driving the notification device 500 in accordance with the maturity determination information. All of, or a part of, these functions may be implemented on the image capturing device 200.
The calculation device P may have a function of performing a process generally performed for image processing, for example, gamma correction, color interpolation, spatial interpolation, and auto-white balance.
The notification device 500 notifies the farmer of the maturity level of the bunch F or whether the bunch F is harvestable or not. The notification device 500 is connected with the calculation device P in a wired or wireless manner. The notification device 500 includes at least one of an optical device emitting light in accordance with a driving signal, a sound output device outputting a sound in accordance with the driving signal, a vibration device vibrating in accordance with the driving signal, and a display device displaying maturity information in accordance with the driving signal. The optical device is, for example, an LED (Light Emitting Diode) lamp. The sound output device is, for example, a speaker. The vibration device is, for example, a vibrator. The display device is, for example, a liquid crystal display or an organic EL (Electroluminescence) display.
[Processing Procedure of the Determination Method]
(Step S100)
The image capturing device 200 performs image capturing of all of, or a part of, the large number of fruits in the bunch F (preferably, at least three fruits) to acquire an image I. As described below, the image capturing device 200 may perform image capturing of the entirety of the oil palm tree. The image capturing device 200 may acquire the image I by performing image capturing of a central part and the vicinity thereof of the bunch F. Moreover, the image capturing device 200 preferably acquires the image I through image capturing of a well-sunlit portion of the bunch F, e.g., a tip thereof. The reason is that, presumably, the fruits in a sunlit portion of the bunch F will be the first to start maturing. The image capturing device 200 may perform the image capturing a plurality of times to acquire the image I a plurality of times. The acquired pieces of image data may be added together to improve the SN ratio. The acquired image I includes an intensity distribution of at least near infrared light reflected by the bunch F. In this embodiment, the image I includes intensity distributions of the near infrared light, red light, green light and blue light reflected by the bunch F. In other words, the image I includes pixel values (image data) REDS, GLNS, NIRS and BLUS obtained from the four pixels 221A, 221B, 221C and 221D. In the embodiments of the present invention, the image I merely needs to include an intensity distribution of at least the near infrared light.
In step S100, the calculation device P receives the image I from the image capturing device 200. The operation of “receiving the image” encompasses acquiring the image I in real time when the image capturing device 200 acquires the image I. The operation of “receiving the image” is not limited to this. For example, the calculation device P may acquire the image I later by reading the image I stored on a storage medium such as an external hard disc HD or the like connected with the calculation device P. Such an operation may be encompassed in the operation of “receiving the image”.
The maturity may be classified into, for example, “ripe”, “underripe” and “unripe”. Needless to say, the maturity may be classified into a larger number of categories. For example, the category “overripe” may be provided. A category representing another maturity level (e.g., “slightly ripe” may be provided between “ripe” and “underripe”. At the time of harvest of the oil palm bunch F, the light reflected by the bunch F has a reflectance characteristic that the intensity increases as the light has a longer wavelength within the wavelength band from the blue light to the near infrared light. Especially in a wavelength band of the red light, which is visible light, the reflectance characteristic is exhibited that the intensity increases as the maturity level of the bunch F rises. Also in the near infrared light wavelength band having the maximum wavelength of the reflected light that may be received in accordance with the sensitivity characteristic of the image sensor 220, the reflectance characteristic is exhibited that the intensity increases as the maturity level of the bunch F rises. As can be seen, especially in the wavelength band from the red light to the near infrared light, the reflectance is represented by a curve unique to the maturity level. As described below in detail, an appropriate threshold value for the reflectance may be set in each wavelength band based on the curve and the reflectance and the threshold value may be compared against each other, so that the maturity level is determined.
In this embodiment according to the present invention, the image I including the intensity distribution of at least the near infrared light may be analyzed, so that the maturity level is determined. In this embodiment, the maturity level is determined based on the pixel value NIRS. Therefore, for example, the pixel unit including the pixels 221 in two rows by two columns shown
(Step S200)
The calculation device P calculates an area size ratio of the intensity distribution of the near infrared light in the received image I. The image I includes a plurality of first pixels (or image data) including information representing the intensity distribution of the near infrared light, a plurality of second pixels including information representing an intensity distribution of the red light, a plurality of third pixels including information representing an intensity distribution of the green light, and a plurality of fourth pixels including information representing an intensity distribution of the blue light. As described above, the image I merely needs to include at least the plurality of first pixels.
It is now assumed that all the pixel values in the image I including the entirety of the bunch F are simply averaged. The average value may vary by an influence of the background, the shadow between the fruits or the like, which may be included in the image I. With the determination method in this embodiment, the area size of the intensity distribution of the near infrared light is found on the basis of the predetermined reference value.
Portion (a) of
For example, it is now assumed that the entirety of the bunch F is processed with image capturing from far to acquire the image I shown in portion (a) of
After an image including one or a plurality of bunches F or the entirety of the oil palm tree is acquired by the image capturing device 200, the calculation device P may extract the rectangular part represented by the dashed line from such an image by trimming. In other words, the calculation device P may use a trimming function to acquire the image I shown in portion (b) of
For performing image capturing of the bunch F or the entirety of the oil palm tree, a part of bunch F including, for example, three fruits may be automatically specified (recognized) by image recognition. Trimming may be performed in substantially the same manner. An example of usable image recognition technology may be any of a wide range of known pattern recognition technologies. It may be analyzed which of patterns corresponding to a classification prepared in advance (fruit, branch, leaf, etc.) matches the subject, so as to determine which class the subject is. Pattern recognition is performed by use of, for example, a trainable pattern recognition system using mathematical, geometrical and harmonic-shape descriptors. Such a system is educated so as to select a possible class by use of a knowledge base learned by contacting a large number of samples of the classification prepared in advance. A training set includes thousands of basic types of images for each class. Successful pattern matching is caused when an untrained descriptor on the target matches a trained descriptor on the target. The above-described pattern recognition system is described in detail in, for example, Japanese Laid-Open Patent Publication No. 2015-046162.
The mapping image shown in portion (c) of
The calculation device P also generates the mapping image shown in portion (c) of
As the maturity level of the bunch F rises, the intensity of the reflected light of the near infrared light, namely, the value of the pixel value NIRS increases. As a result, the density of the pixels of the hierarchical layer III is raised. This indicates that the maturity level of the bunch F is easily determinable by appropriately setting the threshold value for the gray scale value.
Referring to
The pixel distribution corresponds to the area size ratio AR of the intensity distribution of the near infrared light on the basis of the predetermined reference value. Specifically, the area size ratio AR is the ratio of the number N1 of pixels fulfilling a condition for the reference value among the plurality of first pixels included in the image I with respect to the number M1 of the plurality of first pixels. For example, the lower limit of the reference value (lower-limit threshold value) and the upper limit of the reference value (upper-limit threshold value) used for the hierarchical layer I are respectively 60 and 70. The lower limit and the upper limit of the reference value used for the hierarchical layer II are respectively 70 and 80. The lower limit of the reference value used for the hierarchical layer III is 80. The upper limit is not set. An appropriate reference value may be set, so that the maturity level of the bunch F is determined based on the density of the pixels, namely, the area size ratio AR.
The cumulative frequency percentage (%) is found from expression (1).
Cumulative frequency percentage (%)=(100×cumulative frequency)/(n+1) expression (1)
In expression (1), the cumulative frequency corresponds to a value obtained by accumulating the frequency from the smallest value of the frequency, namely, the left side of the histogram. n is the number of samples, and is equal to the number M1 of the plurality of first pixels.
As shown in
Next, in step S220, the calculation device P finds the ratio N1/M1, namely, the ratio the calculated number N1 of the pixels with respect to the number M1 of the plurality of first pixels. It is now assumed that the image I is formed of only the plurality of first pixels. In this case, if the angle of view is narrow, the shadow between the fruits may possibly influence the maturity determination. Therefore, it is preferable that another threshold value is provided, so that the number of first pixels having a pixel value larger than, or equal to, the another threshold value (e.g., “10”) is set as M1 to find the ratio N1/M1.
Now,
(Step S300)
The calculation device P generates maturity determination information in accordance with the area size ratio AR. Specifically, the calculation device P generates the maturity determination information in accordance with a result of comparing the ratio N1/M1 against a threshold value R1.
For example, it may be further determined whether the maturity level is “underripe” or “unripe”. Referring to
Specifically, for the hierarchical layer II, the calculation device P calculates, among the plurality of first pixels, the number N1 of pixels having a pixel value larger than, or equal to, the lower limit of a threshold value L2 and smaller than the upper limit of the threshold value L2. As described above, for example, the lower limit of the threshold value L2 may be set to “70” and the upper limit of the threshold value L2 may be set to “80”. Like in step S220, for the hierarchical layer II, the calculation device P finds the ratio N1/M1, namely, the ratio the calculated number N1 of the pixels with respect to the number M1 of the plurality of first pixels.
In step S330, the calculation device P determines whether the ratio N1/M1 calculated for the hierarchical layer II is larger than the threshold value R2 or not. In the case where the ratio N1/M1 is larger than the threshold value R2, the calculation device P generates maturity determination information representing “underripe” in step S340. In the case where the ratio N1/M1 is smaller than, or equal to, the threshold value R2, the procedure goes to step S350.
In step 350, the calculation device P finds the ratio N1/M1 for the hierarchical layer I and compares the ratio against a threshold value R3. Specifically, for the hierarchical layer I, the calculation device P calculates, among the plurality of first pixels, the number N1 of pixels having a pixel value larger than, or equal to, the lower limit of a threshold value L3 and smaller than the upper limit of the threshold value L3. As described above, for example, the lower limit of the threshold value L3 may be set to “60” and the upper limit of the threshold value L3 may be set to “70”. Like in step S220, for the hierarchical layer I, the calculation device P finds the ratio N1/M1, namely, the ratio the calculated number N1 of the pixels with respect to the number M1 of the plurality of first pixels.
In step S350, the calculation device P determines whether the ratio N1/M1 calculated for the hierarchical layer I is larger than the threshold value R3 or not. In the case where the ratio N1/M1 is larger than the threshold value R3, the calculation device P generates maturity determination information representing “unripe” in step S360. In the case where the ratio N1/M1 is smaller than, or equal to, the threshold value R3, the calculation device P generates maturity information representing, for example, “other” in step S370. The maturity determination information may be represented by, for example, a 2-bit signal, where “11” may be assigned to “ripe”, “10” may be assigned to “underripe”, “01” may be assigned to “unripe”, and “00” may be assigned to “other”. In this manner, the maturity determination information representing “underripe” or “unripe” may be generated in addition to the maturity determination information representing “ripe”.
Now,
(Step S400)
In accordance with the maturity determination information, the calculation device P generates a driving signal for driving the notification device 500 notifying, for example, the farmer of the maturity level of the bunch F. For example, the notification device 500 may include an LED. In such a structure, in the case where the maturity determination information represents “ripe”, the calculation device P generates a driving signal for causing the LED to emit light (signal for turning on the LED). In the case where the maturity determination information represents “not ripe”, the calculation device P does not generate a driving signal for causing the LED to emit light. The notification device 500 may include a plurality of LEDs emitting light of different colors. In the case where the maturity determination information includes various maturity levels (e.g., “ripe”, “underripe” and “unripe”), the calculation device P, for example, may generate a driving signal for causing any one of the plurality of LEDs to emit light in accordance with the maturity level. In this manner, the farmer recognizes the maturity level of the bunch F in accordance with the color of the light emitted by the LED.
For example, the notification device 500 may include a speaker. In such a structure, in the case where the maturity determination information represents “ripe”, the calculation device P generates a driving signal for causing the speaker to output an audio signal (signal for turning on the speaker). In the case where the maturity determination information represents “not ripe”, the calculation device P does not generate a driving signal for causing the speaker to output an audio signal. In the case where the maturity determination information includes various maturity levels, the calculation device P, for example, may drive the speaker such that the loudness of the audio signal is changed in accordance with the maturity level.
For example, the notification device 500 may include a vibrator. In such a structure, in the case where the maturity determination information represents “ripe”, the calculation device P generates a driving signal for causing the vibrator to vibrate (signal for turning on the vibrator). In the case where the maturity determination information represents “not ripe”, the calculation device P does not generate a driving signal for causing the vibrator to vibrate. In the case where the maturity determination information includes various maturity levels, the calculation device P, for example, may drive the vibrator such that the strong/weak pattern of the vibration is changed in accordance with the maturity level.
For example, the notification device 500 may include a liquid crystal display. In such a structure, in the case where the maturity determination information represents “ripe”, the calculation device P generates a driving signal for causing the liquid crystal display to display letter information “ripe”. In the case where the maturity determination information represents “not ripe”, the calculation device P generates a driving signal for causing the liquid crystal display to display letter information “not ripe”. For example, the liquid crystal display may display a symbol such as “◯”, “×” or the like instead of the letter information, or may change the color of display in accordance with the maturity level.
The calculation device P may generate a color image of the bunch F based on the pixel values REDS, GLNS and BLUS obtained from the RGB pixels of the image sensor 220. The calculation device P may generate a maturity level image including information on the reference value and representing the maturity level, based on the maturity determination information. The maturity level image is, for example, the mapping image shown in portion (c) of
The calculation device P may also determine whether the bunch F is harvestable or not based on the maturity determination information. For example, it is now assumed that there are four maturity levels of “ripe”, “slightly ripe”, “underripe” and “unripe”. In the case where, for example, the maturity determination information represents “ripe” or “slightly ripe”, the calculation device P determines that the bunch F is harvestable. In the case where the maturity determination information represents “underripe” or “unripe”, the calculation device P determines that the bunch F is not harvestable. For example, the liquid crystal display may display letter information representing whether the bunch F is harvestable or not in accordance with the determination information. With such display, the information on whether the bunch F is harvestable or not is transmitted to the farmer directly, which supports the farmer more.
The calculation device P may output the maturity determination information to outside via, for example, an output IF (not shown) instead of performing the operation in step S400. In the case where, for example, the notification device 500 has a function of generating a signal for driving the notification device 500 itself, the notification device 500 may receive the maturity determination information from the calculation device P and generate a driving signal in accordance with the maturity determination information.
In this embodiment, the variance in the determination on the maturity level at the time of harvest of oil palm is made smaller, regardless whether the farmer is experienced or not, than by a conventional method by which the maturity level is determined by visual observation. In addition, the time to harvest the oil palm is determined with high precision without decreasing the efficiency of the harvesting work. Therefore, it is expected that the production amount of the oil component contained in the oil palm is increased.
According to a determination method in this embodiment, the calculation device P receives an image I including the intensity distributions of the light in the first wavelength band and the light of a second wavelength band in step S100, and generate maturity determination information based on the intensity distributions of light in the first and second wavelength bands in step S300. The intensity of light of the second wavelength band that is reflected by the bunch F varies in accordance with the maturity level. The second wavelength band is different from the first wavelength band (i.e., the wavelength band of the near infrared light). The second wavelength band is a wavelength band of, for example, red light, which is visible light.
The “addition of the pixel values” refers to adding pixel values of pixels associated with each other in the pixel unit. In this embodiment, the calculation device P adds the pixel value of the pixel 221C including the IR filter and the pixel value of the pixel 221A including the R filter that is associated with the pixel 221C. In other words, the calculation device P adds the pixel value NIRS and the pixel value REDS.
As shown in
As compared with in the normal probability plots based on the pixel value NIRS shown in
As shown in
In this embodiment, the pixel distribution is represented by the ratio N2/M2, and corresponds to the area size ratio AR of the sum of the intensity distributions of the near infrared light and the red light on the basis of the predetermined reference value. For example, the lower limit of the reference value (lower-limit threshold value) and the upper limit of the reference value (upper-limit threshold value) used for the hierarchical layer I are respectively 90 and 100. The lower limit and the upper limit of the reference value used for the hierarchical layer II are respectively 100 and 110. The lower limit of the reference value used for the hierarchical layer III is 110. The upper limit is not set.
Next, the calculation device P follows the processing procedure shown in, for example,
With the determination method in this embodiment, the information on the pixel value REDS is used in addition to the information on the pixel value NIRS, so that the precision of the maturity determination is further improved.
According to a determination method in this embodiment, unlike the determination method in embodiment 2, maturity determination information is generated based on a difference between the pixel NIRS and the pixel value REDS.
For example, the light reflected by the bunch F includes light reflected by the fruits and also light reflected by the dead calyx and leaves covering the fruits. The dead calyx and leaves contains little chlorophyll, which is a main component of chloroplast. Therefore, the reflectance characteristic of the light reflected by the dead calyx and leaves is generally uniform in a wavelength band from the red light to the near infrared light. By contrast, as shown in
The “subtraction of the pixel values” refers to subtracting the pixel value of a pixel from the pixel value of another pixel associated with the above-mentioned pixel in the pixel unit. In this embodiment, the calculation device P subtracts, from the pixel value of the pixel 221C including the IR filter, the pixel value of the pixel 221A including the R filter that is associated with the pixel 221C. In other words, the calculation device P subtracts the pixel value REDS from and the pixel value NIRS.
As shown in
As shown in
In this embodiment, the pixel distribution is represented by the ratio N3/M3, and corresponds to the area size ratio AR of the difference between the intensity distributions of the near infrared light and the red light on the basis of the predetermined reference value. For example, the lower limit of the reference value (lower-limit threshold value) and the upper limit of the reference value (upper-limit threshold value) used for the hierarchical layer I are respectively 40 and 50. The lower limit and the upper limit of the reference value used for the hierarchical layer II are respectively 50 and 60. The lower limit of the reference value used for the hierarchical layer III is 60. The upper limit is not set.
Next, the calculation device P follows the processing procedure shown in, for example,
With the determination method in this embodiment, the information obtained as a result of subtracting the pixel value REDS from the pixel value NIRS is used, so that the precision of the maturity determination is further improved while the complicated information included in the image I is suppressed.
In this embodiment, the calculation device P finds the number N4 of pixels having a pixel value larger than, or equal to, a threshold value L6 or a pixel value smaller than, or equal to, the threshold value L6 from the plurality of second pixels, and finds the ratio N4/M4, namely, the ratio the calculated number N4 of the pixels with respect to the number M4 of the plurality of second pixels. The calculation device P further generates maturity determination information based on a result of comparing the ratio N1/M1 against the threshold value R1 and a result of comparing the ratio N4/M4 against a threshold value R6.
First, the calculation device P generates a color mapping image of the hierarchical layer III by use of the plurality of first pixels included in the image I. Specifically, the calculation device P calculates the number N1 of the pixels by use of the color mapping image of the hierarchical layer III in step S210, and finds the ratio N1/M1 in step S220. Next, the calculation device P generates a color mapping image of the hierarchical layer III by use of the plurality of second pixels included in the image I. Specifically, in step S211, the calculation device P calculates the number N4 of pixels having a pixel value larger than, or equal to, a threshold value L6 from the plurality of second pixels included in the image I. For example, for the hierarchical layer III shown in
Next, in step S221, the calculation device P finds the ratio N4/M4, namely, the ratio the calculated number N4 of the pixels with respect to the number M4 of the plurality of second pixels. It is now assumed that the image I is formed of only the plurality of first pixels. In this case, if the angle of view is narrow, the shadow between the fruits may possibly influence the maturity determination. Therefore, it is preferable that another threshold value is provided for the plurality of second pixels, so that the number of second pixels having a pixel value larger than, or equal to, the another threshold value (e.g., “10”) is set as M4 to find the ratio N4/M4.
Next, in step S310, the calculation device P checks which of the ratio N1/M1 for the hierarchical layer III based on the plurality of first pixels and the threshold value R5 is larger or smaller. The calculation device P further checks which of the ratio N4/M4 for the hierarchical layer III based on the plurality of second pixels and the threshold value R6 is larger or smaller. In the case where the ratio N1/M1 is larger than threshold value R1 and the ratio N4/M4 is larger than threshold value R6, the calculation device P generates maturity determination information representing “ripe” like in step S320.
With the determination method in this embodiment, in the case where the bunch F cannot be selected as being distinguished from another object, a sensor condition for the pixel value NIRS and a sensor condition for the pixel value REDS are independently set, so that the selectivity of the target is improved.
With reference to
The controller C is a semiconductor integrated circuit (LSI), and may be, for example, a general-purpose processor. The controller C is electrically connected with each of the image capturing device 200, the signal processing circuit 300 and the driving circuit 400 to control the entirety of the maturity determination device 100.
The structure of the image capturing device 200 is as described above. As shown in
The signal processing circuit 300 is a semiconductor integrated circuit, and is, for example, an image signal processor (ISP). The signal processing circuit of the calculation device P described in embodiment 1 is an element corresponding to the signal processing circuit 300. The signal processing circuit 300 includes an area size ratio computation section 310, a maturity determination information generation section 320, a driving signal generation section 330, a storage medium 340 and a central processing section (CPU) 350. The storage medium 340 is, for example, a read-only memory (ROM), a random access memory (RAM), which is writable, or a hard disc. The area size ratio computation section 310, the maturity determination information generation section 320, and the driving signal generation section 330 may be realized by any combination of hardware and software using, for example, the CPU 350, the RAM (not shown), a computer program loaded on the RAM, the ROM (corresponding to the storage medium 340) storing the computer program, and an interface for connection with a network.
The signal processing circuit 300 includes hardware and/or software, and is configured to operate in accordance with the processing procedure of the determination method described in each of embodiments 1 through 4. For example, the calculation device P (specifically, the signal processing circuit) as the operating subject of the processing procedures of the determination methods shown in
Like the calculation device P, the signal processing circuit 300 may generate the color image I of the bunch F based on the pixel values REDS, GLNS and BLUS obtained from the RGB pixels of the image sensor 220. The signal processing circuit 300 may also generate a maturity level image, including information on the reference value and representing the maturity level, based on the maturity determination information. The signal processing circuit 300 may overlap the maturity level image on the color image to generate an overlapping image to be displayed on the notification device 500 (e.g., liquid crystal display). The signal processing circuit 300 may further determine whether the bunch F is harvestable or not based on the maturity determination information.
The driving circuit 400 may include hardware and/or software. The driving circuit 400 is, for example, a semiconductor integrated circuit. The driving circuit 400 generates a driving signal in accordance with the maturity determination information or the determination information on whether the bunch F is harvestable or not in step S400 in the processing procedure shown in
A part of the maturity determination device 100 may be realized by an LSI as one chip. Each of the functional blocks of the signal processing circuit 300 may be independently a chip. Alternatively, a part of, or the entirety of, the functional blocks of the signal processing circuit 300 may be integrated into a chip. The semiconductor integrated circuit may be, for example, an application specific integrated circuit (ASIC) or a field programmable gate array (FPGA). In the case where a technology of an integrated circuit usable as a substitute of the LSI emerges by the advancement of the semiconductor technology, an integrated circuit realized by such a technology is usable.
The maturity determination device 100A includes the controller C, the image capturing device 200, the signal processing circuit 300 and an output interface (IF) 600. The maturity determination device 100A includes the output IF 600 instead of the driving circuit 400. The maturity determination device 100A may output the maturity determination information to outside via the output IF 600. The output IF 600 is a USB interface or an interface configured to perform a wireless communication conformed to, for example, the Bluetooth standards. In this variation, in the case where, for example, the notification device 500 has a function of generating a signal for driving the notification device 500 itself, the notification device 500 may receive the maturity determination information from the signal processing circuit 300 and generate a driving signal in accordance with the maturity determination information. The maturity determination device 100A may be provided with a driving circuit as an external element. The driving circuit may receive the maturity determination information and may generate a driving signal in accordance with the maturity determination information.
The maturity determination device 100B includes the controller C, the image capturing device 200, the signal processing circuit 300, the driving circuit 400 and the notification device 500. In this variation, the notification device 500 is integrally included in the maturity determination device 100B. The maturity determination device 100B is decreased in size and thus is easier to use for the farmer.
The signal processing circuit 300 may have a plurality of operation modes respectively operable in accordance with the determination method in each of embodiments 1 through 4. For example, the signal processing circuit 300 may select an optimal operation mode, from the plurality of operation modes, for switching the sensor sensitivity of the image sensor 220 or for narrowing down the sensing results.
In embodiments 1 through 5 described above, the determination method is described regarding an oil palm bunch as an example of fruit or vegetable product, which is a harvesting target. The fruit or vegetable product targeted by the present invention is not limited to the oil palm bunch, and may be any fruit or vegetable product having a reflectance characteristic of the near infrared light that the reflectance varies in accordance with the maturity level. An example of such a fruit or vegetable product is, for example, green apple or mango.
The maturity determination information may be generated based on an NDVI (Normalized Difference Vegetation Index). The NDVI is generated based on the pixel value NIRS and the pixel value REDS, as found from expression (2).
(NIRS−REDS)/(NIRS+REDS) (2)
The unripe bunch F contains more chlorophyll than does the ripe bunch F. Chlorophyll absorbs red light well and reflects near infrared light well. Therefore, the maturity level of the bunch F may well be determined by using the NDVI.
The calculation device P calculates the NDVI using the pixel value NIRS of each first pixel of the plurality of first pixels and the pixel value REDS of each second pixel of the plurality of second pixels, on a pixel-by-pixel basis. Said each second pixel is associated with said each first pixel. Namely, the calculation device P calculates the NDVI using the pixel value NIRS and the pixel value REDS on a pixel unit-by-pixel unit basis. The calculation device P calculates, among the plurality of pixels that are targets of calculation, the number N100 of pixels having an NDVI value larger than, or equal to, a threshold value L100. The calculation device P finds the ratio N100/M100, namely, the ratio of the calculated number N100 of the pixels with respect to the number M100 of pixels that are the targets of calculation. Typically, the number M100 of pixels that are the targets of calculation matches the number of the plurality of first pixels.
The pixel distribution is represented by the ratio N100/M100, and corresponds to the area size ratio AR of the NDVI value on the basis of the predetermined reference value. For example, the lower limit of the reference value (lower-limit threshold value) and the upper limit of the reference value (upper-limit threshold value) used for the hierarchical layer I are respectively 90 and 100. The lower limit and the upper limit of the reference value used for the hierarchical layer II are respectively 100 and 110. The lower limit of the reference value used for the hierarchical layer III is 110. The upper limit is not set.
The maturity determination information is generated in accordance with a result of comparing the ratio N100/M100 against a threshold value R100. Specifically, the calculation device P determines which of the ratio N100/M100 for the hierarchical layer III and the threshold value R100 is larger or smaller. In the case where the ratio N100/M100 is larger than threshold value R100, the calculation device P generates maturity determination information representing “ripe”.
With the determination method, the NDVI information can be used to further improve the precision of the maturity determination.
A maturity determination device in an embodiment according to the present invention determining a maturity level of a fruit or vegetable product, comprising:
an image capturing device including a plurality of pixels arrayed one-dimensionally or two-dimensionally, the image capturing device performing image capturing of at least a part of the fruit or vegetable product to acquire an image, the plurality of pixels including a plurality of first pixels each including a near infrared light transmission filter selectively transmitting light of a near infrared wavelength band and a plurality of second pixels each including a red light transmission filter selectively transmitting light of red wavelength band; and
a signal processing circuit configured to find an area size ratio of an intensity distribution of NDVI on the basis of a predetermined reference value based on pixel values obtained from the plurality of first pixels and pixel values obtained from the plurality of second pixels, and to generate maturity determination information in accordance with the area size ratio.
A method in an embodiment according to the present invention is a method for determining a maturity level of a fruit or vegetable product, the method comprising the steps of:
receiving an image including at least a part of the fruit or vegetable product, the image including an intensity distribution of near infrared light and an intensity distribution of red light;
finding an area size ratio of the intensity distribution of NDVI on the basis of a predetermined reference value; and
generating maturity determination information in accordance with the area size ratio.
The determination method in an embodiment according to the present invention may be realized by a computer program. The computer program is configured to realize the various functions described above in embodiments 1 through 5. The computer program controls, for example, the calculation device P and the CPU or the like of the maturity determination device 100. Information handled by these devices is temporarily stored on the RAM when being processed, and then is stored on any of various ROMs or HDDs. The CPU reads the information when necessary, and corrects the information or write additional data on the information. The storage medium storing the computer program may be, for example, a semiconductor storage medium (e.g., ROM, nonvolatile memory card, etc.), an optical storage medium (e.g., DVD, MO, MD, CD, BD, etc.), a magnetic storage medium (e.g., magnetic tape, flexible disc, etc.) or the like. Each of the functions described above in embodiments 1 through 5 is realized by the CPU loading and executing the computer program. Alternatively, each of the functions described above in embodiments 1 through 5 may be realized by the CPU in cooperation with an operating system, another application program or the like in accordance with an instruction of the computer program.
The computer program may be stored on a portable storage medium, so that the contents thereof are distributed in the market. Alternatively, the computer program may be transferred to a server computer connected via a network such as the Internet or the like, so that the contents thereof are distributed in the market. In this case, the storage device included in the server computer is encompassed in the present invention. Each of the functions described above in embodiments 1 through 5 may be stored on a computer-readable medium, or transferred, as at least one command group or a code. The “computer-readable storage medium” encompasses a communication medium including a medium assisting the computer program be carried from one site to another site and also encompasses a computer storage medium. The storage medium may be any commercially available medium accessible by a general-purpose computer or a special-purpose computer.
In this specification, various illustrative elements, blocks, modules, circuits and steps are described generally regarding the functionality thereof in order to clearly show the synonymy between hardware and software. Whether such functionality is implemented as hardware or software depends on the designing restriction imposed on each of applications and the entire system. A person of ordinary skill in the art could implement the functions by any of various methods for specific applications, but determination on such implementation should not be construed as departing from the scope of this disclosure.
Various illustrative logical blocks and processing units described in relation with the disclosure of this specification may be implemented or executed by a general-purpose processor, a digital signal processor (DSP), an ASIC, an FPGA, any other programmable logical device, a discrete gate or transistor logic, or a discrete hardware component designed to execute the functions described in this specification, or a combination of any of these. The general-purpose processor may be a microprocessor, or may be a conventional processor, controller, microcontroller or state machine. The processor may be implemented by a combination of computing devices. For example, the processor may be realized by a combination of a DSP and a microprocessor, a combination of a plurality of microprocessors, a combination of a DSP core and at least one microprocessor connected with the DSP core, or a combination of any other such devices.
The determination methods or the steps of algorithm described in relation with the disclosure of this specification may be directly embodied by a software module executable by hardware (especially, a processor) or by a combination of hardware and the software module. The software module may be present in a RAM, a flash memory, a ROM, an EPROM, an EEPROM, a register, a hard disc, a removable disc, a CD-ROM, or any storage medium in any form known in this field. A typical storage medium may be coupled to the processor such that information may be read therefrom, or written thereto, by the processor. With another method, the storage medium may be integrated with the processor. The processor and the storage medium may be in the ASIC. The ASIC may be mounted on the maturity determination device. Alternatively, the processor and the storage medium may be housed in the maturity determination device as discrete elements.
Embodiments of the present invention have been described in detail with reference to the drawings. Specific structures are not limited to any of the embodiments, and designs and the like not departing from the gist of the present invention are encompassed in the scope of the claims.
A maturity determination method and a maturity determination device in an embodiment according to the present invention are preferably usable for a method and a device determining the maturity level of a fruit or vegetable product, especially the maturity level of a bunch including a large number of fruits.
While the present invention has been described with respect to preferred embodiments thereof, it will be apparent to those skilled in the art that the disclosed invention may be modified in numerous ways and may assume many embodiments other than those specifically described above. Accordingly, it is intended by the appended claims to cover all modifications of the invention that fall within the true spirit and scope of the invention.
| Number | Date | Country | Kind |
|---|---|---|---|
| PI 2016001263 | Jul 2016 | MY | national |
| Number | Name | Date | Kind |
|---|---|---|---|
| 9824298 | Krishnan Gorumkonda | Nov 2017 | B1 |
| 20090147260 | Costa | Jun 2009 | A1 |
| 20090268031 | Honma | Oct 2009 | A1 |
| 20140122044 | Yasukawa | May 2014 | A1 |
| Number | Date | Country |
|---|---|---|
| 08-122250 | May 1996 | JP |
| 2000-356591 | Dec 2000 | JP |
| 2015-046162 | Mar 2015 | JP |
| 2006014974 | Feb 2006 | WO |
| 2012074372 | Jun 2012 | WO |
| Entry |
|---|
| Bensaeed et al., “Oil palm fruit grading using a hyperspectral device and machine learning algorithm”, IOP Conf. Series: Earth and Environmental Science 20 (2014), pp. 1-22. |
| Number | Date | Country | |
|---|---|---|---|
| 20180012345 A1 | Jan 2018 | US |
