This patent application is based on and claims priority pursuant to 35 U.S.C. § 119(a) to Japanese Patent Application No. 2023-218569, filed on Dec. 25, 2023, in the Japan Patent Office, the entire disclosure of which is hereby incorporated by reference herein.
Embodiments of this disclosure relate to an electronic apparatus, an anomaly detection system, and an anomaly detection method, and more particularly, to an electronic apparatus, an anomaly detection system incorporating the electronic apparatus, and an anomaly detection method performed by the electronic apparatus.
Related-art electronic apparatuses present solutions to address an error that is detected. As one example, based on a dataset that correlates error information and operation information of the electronic apparatus to solution information to address an error, the electronic apparatus presents a solution suggested to address the error by using a learned model obtained by machine learning of conditions for solutions suggested to address the error.
However, for example, in a case that the detected error requests an instant control such as interruption of operation of the electronic apparatus as a solution, the solution may not address the error.
This specification describes below an improved electronic apparatus. In one embodiment, the electronic apparatus includes a sensor that outputs sensor values and processing circuitry that retrieves time series data obtained by collecting the sensor values from the sensor over time. The processing circuitry detects an abnormality based on the retrieved time series data and a predetermined rule determined in advance. The processing circuitry inputs the retrieved time series data to a learned model that defines the time series data as input data and information indicating a type of the abnormality as output data. The processing circuitry obtains the information indicating the type of the abnormality from the learned model. The processing circuitry controls operation of the electronic apparatus based on the information indicating the type of the abnormality.
This specification further describes an improved anomaly detection system. In one embodiment, the anomaly detection system includes an information processing device that generates a learned model and an electronic apparatus that includes a sensor that outputs sensor values and processing circuitry that retrieves time series data obtained by collecting the sensor values from the sensor over time. The processing circuitry detects an abnormality based on the retrieved time series data and a predetermined rule determined in advance. The processing circuitry sends the time series data to the information processing device in a case that the processing circuitry detects the abnormality. The processing circuitry inputs the time series data to the learned model that defines the time series data as input data and information indicating a type of the abnormality as output data. The processing circuitry obtains the information indicating the type of the abnormality from the learned model. The processing circuitry controls operation of the electronic apparatus based on the information indicating the type of the abnormality.
This specification further describes an improved anomaly detection method performed by an electronic apparatus. In one embodiment, the anomaly detection method includes retrieving time series data obtained by collecting sensor values output from a sensor over time and detecting an abnormality based on the retrieved time series data and a predetermined rule determined in advance. The anomaly detection method further includes inputting the retrieved time series data to a learned model that defines the time series data as input data and information indicating a type of the abnormality as output data. The anomaly detection method further includes obtaining the information indicating the type of the abnormality from the learned model. The anomaly detection method further includes controlling operation of the electronic apparatus based on the obtained information indicating the type of the abnormality.
A more complete appreciation of embodiments of the present disclosure and many of the attendant advantages and features thereof can be readily obtained and understood from the following detailed description with reference to the accompanying drawings, wherein:
The accompanying drawings are intended to depict embodiments of the present disclosure and should not be interpreted to limit the scope thereof. The accompanying drawings are not to be considered as drawn to scale unless explicitly noted. Also, identical or similar reference numerals designate identical or similar components throughout the several views.
In describing embodiments illustrated in the drawings, specific terminology is employed for the sake of clarity. However, the disclosure of this specification is not intended to be limited to the specific terminology so selected and it is to be understood that each specific element includes all technical equivalents that have a similar function, operate in a similar manner, and achieve a similar result.
Referring now to the drawings, embodiments of the present disclosure are described below. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise.
Referring to the drawings, the following describes embodiments of the present disclosure.
The image forming apparatus 100 according to the embodiment is one example of an electronic apparatus.
The image forming apparatus 100 according to the embodiment includes four process units 10, an exposure device 3, and primary transfer rollers 5. Each of the process units 10 includes a photoconductive drum 1, a charger 2, a developing device 4, and a photoconductive drum cleaning unit 7. The image forming apparatus 100 further includes a transfer belt 15, a cleaning unit opposed roller 16, a tension roller 20, a transfer belt driving roller 21, a transfer sheet tray 22, a feed roller 23, a registration roller pair 24, the secondary transfer roller 25, a cleaning blade 26, a secondary transfer roller cleaning unit 27, the secondary transfer belt 28, and a tension roller 29.
The image forming apparatus 100 further includes a cleaning blade 31, a transfer belt cleaning unit 32, a waste toner container 33, a fixing device 40, a discharge slot 41, and a bypass slot 42.
The photoconductive drum 1 is tubular and rotates clockwise in
The exposure device 3 serves as an electrostatic latent image forming device. The exposure device 3 exposes the surface of the photoconductive drum 1 according to image data, forming an electrostatic latent image thereon. The exposure device 3 includes a laser beam scanner using a laser diode, a light-emitting diode (LED), or the like that exposes the surface of the photoconductive drum 1.
As the high voltage power supply supplies a predetermined developing bias to the developing device 4, the developing device 4 visualizes the electrostatic latent image formed on the photoconductive drum 1 into a toner image. The developing device 4 contains toner.
The photoconductive drum cleaning unit 7 accommodates a photoconductive drum cleaning blade 6 that cleans the photoconductive drum 1.
The process unit 10 serves as a unit into which the photoconductive drum 1, the charger 2, the developing device 4, and the photoconductive drum cleaning unit 7 are combined.
The four process units 10 are arranged in parallel. When the image forming apparatus 100 receives a print job for forming a full color toner image on a transfer sheet P, the primary transfer rollers 5 primarily transfer black, cyan, magenta, and yellow toner images formed on the photoconductive drums 1, respectively, onto the transfer belt 15 successively such that the black, cyan, magenta, and yellow toner images are superimposed on the transfer belt 15 that contacts the photoconductive drums 1, thus forming the full color toner image on the transfer belt 15.
The transfer belt 15 is stretched taut across the transfer belt driving roller 21, the cleaning unit opposed roller 16, the primary transfer rollers 5, and the tension roller 20. The image forming apparatus 100 further includes a driving motor serving as a driver that drives and rotates the transfer belt driving roller 21 that drives and rotates the transfer belt 15. The transfer belt driving roller 21 also serves as a secondary transfer roller opposed roller that is disposed opposite the secondary transfer roller 25.
The transfer belt 15 according to the embodiment is one example of an intermediate transferor that rotates while contacting the photoconductive drums 1 serving as image bearers.
The process units 10 and the transfer belt driving roller 21 may be driven by separate drivers, respectively, or a shared driver. However, driving of at least the process unit 10 that forms a black toner image and the transfer belt driving roller 21 is generally turned on and off simultaneously. Hence, the shared driver is preferably employed to downsize the image forming apparatus 100 and reduce costs. The image forming apparatus 100 further includes springs that bias both lateral ends of the tension roller 20 in an axial direction thereof. Thus, the tension roller 20 serves as a transfer belt stretching mechanism that stretches the transfer belt 15.
The transfer belt cleaning unit 32 includes the cleaning blade 31 that contacts counter to the transfer belt 15 that rotates counterclockwise in
The residual toner scraped by the cleaning blade 31 is conveyed into the waste toner container 33 through a waste toner conveyance path.
Each of the primary transfer rollers 5 is a metal roller or a conductive sponge roller. The primary transfer rollers 5 are disposed opposite the photoconductive drums 1, respectively, via the transfer belt 15. As the single high voltage power supply supplies a predetermined primary transfer bias to the primary transfer rollers 5, the primary transfer rollers 5 primarily transfer the black, cyan, magenta, and yellow toner images formed on the photoconductive drums 1, respectively, onto the transfer belt 15. Each of the primary transfer rollers 5 is a metal roller made of aluminum or stainless used steel (SUS), an ion conductive roller made of a mixture of urethane and dispersed carbon, acrylonitrile-butadiene rubber (NBR), or epichlorohydrin rubber, an electronically conductive roller made of ethylene-propylene-diene monomer (EPDM), or the like.
The transfer belt 15 is an endless belt that has a resin film shape and is made of a material produced by dispersing a conductive material such as carbon black in polyvinylidene fluoride (PVDF), ethylenetetrafluoroethylene (ETFE), polyimide (PI), polycarbonate (PC), thermoplastic elastomer (TPE), or the like.
The image forming apparatus 100 further includes a secondary transfer unit constructed of a roller or a belt. In a case that the secondary transfer unit is constructed of the roller as illustrated in
The secondary transfer roller cleaning unit 27 includes the cleaning blade 26 that contacts counter to the secondary transfer roller 25 that rotates clockwise in
In a case that the secondary transfer unit is constructed of the belt as illustrated in
The transfer sheet tray 22 or the bypass slot 42 is placed with a plurality of transfer sheets P serving as recording media. The feed roller 23 feeds a transfer sheet P to the registration roller pair 24 that conveys the transfer sheet P to a secondary transfer nip formed between the secondary transfer roller 25 and the transfer belt 15 at a time when a leading end of the full color toner image formed of the black, cyan, magenta, and yellow toner images superimposed on a surface of the transfer belt 15 reaches the secondary transfer nip. As the high voltage power supply applies a predetermined secondary transfer bias to the secondary transfer roller 25, the secondary transfer roller 25 secondarily transfers the full color toner image formed on the transfer belt 15 onto the transfer sheet P. According to the embodiment, the transfer sheet P is conveyed through a vertical conveyance path. The transfer belt driving roller 21 separates the transfer sheet P from the transfer belt 15 with a curvature of the transfer belt driving roller 21. The fixing device 40 fixes the full color toner image on the transfer sheet P. Thereafter, the transfer sheet P bearing the fixed full color toner image is ejected onto an outside of the image forming apparatus 100 through the discharge slot 41.
The fixing device 40 according to the embodiment includes a fixing rotator 40a, an opposed rotator 40b, and a heater 40c serving as a heat source. The opposed rotator 40b is disposed opposite the fixing rotator 40a. The heater 40c heats the fixing rotator 40a. As illustrated in
As illustrated in
The image forming apparatus 100 employs one of two methods, that is, an attraction transfer method and a repulsion transfer method. The attraction transfer method generates a secondary transfer electric field by applying a positive bias as a secondary transfer bias to the secondary transfer roller 25 and grounding the transfer belt driving roller 21. The repulsion transfer method generates a secondary transfer electric field by applying a negative bias as a secondary transfer bias to the transfer belt driving roller 21 and grounding the secondary transfer roller 25.
A description is provided of a construction of an image forming system 1000 that incorporates the image forming apparatus 100 depicted in
The image forming system 1000 according to the embodiment includes the image forming apparatus 100, a machine learning server 102, a host computer 103 (e.g., a mainframe), and a data server 105. The image forming apparatus 100 incorporates components (e.g., devices) that are connected via a network such as a local area network (LAN). The network that connects the components is wired or wireless. The machine learning server 102 and the data server 105 may be connected to the image forming apparatus 100 via the Internet or the like to communicate with the image forming apparatus 100.
The image forming apparatus 100 is a copier, a printer, a multifunctional peripheral (MFP), a facsimile machine, or the like. The image forming apparatus 100 is installed with an artificial intelligence (AI) capability that estimates a life of the transfer belt 15.
The machine learning server 102 generates a learned model to achieve the AI capability installed in the image forming apparatus 100.
The host computer 103 sends print data to the image forming apparatus 100. The data server 105 collects learning data used to perform machine learning in the machine learning server 102 from an external device such as the image forming apparatus 100 and sends the learning data to the machine learning server 102. The learning data includes various data that indicate a condition of the image forming apparatus 100. The learning data is described below in detail.
In the image forming system 1000, the image forming apparatus 100 receives the learned model generated by the machine learning server 102 from the machine learning server 102 and achieves a particular AI capability by using the learned model. In the image forming system 1000, the machine learning server 102 receives the learning data used to learn the learned model to achieve the particular AI capability from the external device such as the data server 105, the image forming apparatus 100, and the host computer 103. The machine learning server 102 uses a part or an entirety of the learning data to perform learning processes, generating the learned model.
According to the embodiment, the image forming apparatus 100 uses the learned model generated by using the learning data including information indicating the condition of the image forming apparatus 100. Thus, in a case that the image forming apparatus 100 detects an abnormality, the image forming apparatus 100 determines a type of the abnormality. If the abnormality results from the image forming apparatus 100, the image forming apparatus 100 interrupts operation. If the abnormality results from a usage of a user of the image forming apparatus 100, the image forming apparatus 100 performs control according to the usage of the user. According to the embodiment, the abnormality encompasses a failure and an error.
According to the embodiment, the image forming apparatus 100 operates as described above, addressing the abnormality to be overcome instantly and suppressing redundant downtime.
The machine learning server 102 and the data server 105 according to the embodiment may be constructed by an identical computer. The image forming apparatus 100 may perform functions similar to functions performed by the machine learning server 102 and the data server 105. The machine learning server 102 and the data server 105 may be constructed by a single computer or a plurality of computers. For example, the machine learning server 102 and the data server 105 may be constructed with a technology of cloud computing.
A description is provided of a hardware configuration of the image forming apparatus 100 and the machine learning server 102.
As illustrated in
The controller 910 includes a central processing unit (CPU) 901 as a main section of a computer, a system memory (MEM-P) 902, a northbridge (NB) 903, a southbridge (SB) 904, an application specific integrated circuit (ASIC) 906, a local memory (MEM-C) 907 as a storage, a hard disk drive (HDD) controller 908, and a hard disk (HD) 909 as a storage. The controller 910 further includes an accelerated graphics port (AGP) bus 921 through which the NB 903 is connected to the ASIC 906.
The CPU 901 is a controller that controls an entirety of the image forming apparatus 100. The NB 903 connects the CPU 901, the MEM-P 902, the SB 904, and the AGP bus 921. The NB 903 includes a memory controller that controls reading, writing, and the like with respect to the MEM-P 902, a peripheral component interconnect (PCI) master, and an AGP target.
The MEM-P 902 includes a read only memory (ROM) 902a and a random access memory (RAM) 902b. The ROM 902a is a memory that stores programs and data that perform functions of the controller 910. The RAM 902b is a memory or the like used for expansion of the programs and the data and drawing for printing. The programs stored in the RAM 902b may be recorded in a recording medium readable by a computer, such as a compact disc read-only memory (CD-ROM), a compact disc-recordable (CD-R), and a digital versatile disc (DVD), in a file format installable or executable.
The SB 904 is a bridge that connects the NB 903 to a PCI device and a peripheral device. The ASIC 906 is an integrated circuit (IC) that is used for image processing and includes a hardware element for image processing. The ASIC 906 serves as a bridge that connects the AGP bus 921, a PCI bus 922, the HDD controller 908, and the MEM-C 907 to each other. The ASIC 906 includes a PCI target, an AGP master, an arbiter (ARB), a memory controller, a plurality of direct memory access controllers (DMAC), and a PCI unit. The ARB is a core of the ASIC 906. The memory controller controls the MEM-C 907. The DMAC performs rotation and the like of image data with hardware logic and the like. The engine controller 930 includes a scanner section 931 and a printer section 932. The PCI unit transfers data between the scanner section 931 and the printer section 932 through the PCI bus 922. The ASIC 906 is connected to an interface based on the universal serial bus (USB) or an interface based on the institute of electrical and electronics engineers (IEEE) 1394.
The MEM-C 907 is a local memory used as an image buffer for printing and an encoding buffer. The HD 909 is a storage that stores image data, font data used for printing, and forms. The HD 909 controls reading or writing of data with respect to the HD 909 under control of the CPU 901. The AGP bus 921 is a bus interface for a graphics accelerator card proposed to accelerate graphics processing. The AGP bus 921 accesses the MEM-P 902 directly at a high throughput, accelerating the graphics accelerator card.
The near-field communication circuit 920 is coupled with an antenna 920a. The near-field communication circuit 920 is a communication circuit using near-field communication (NFC), Bluetooth®, or the like.
The engine controller 930 includes the printer section 932. The engine controller 930 further includes the scanner section 931. The control panel 940 includes a display 940a and a keyboard 940b. The display 940a includes a touch panel that displays current settings, a selection screen, and the like and receives instructions from the user. The keyboard 940b includes number keys and a start key. The number keys receive a value of a setting condition relating to image formation such as a setting condition of a density of a toner image. The start key receives an instruction to start copying. The controller 910 controls the entirety of the image forming apparatus 100. For example, the controller 910 controls drawing, communication, input from the control panel 940, and the like. The printer section 932 or the scanner section 931 includes an image processor that performs error diffusion, gamma conversion, and the like. The control panel 940 is one example of a display device of the image forming apparatus 100.
The control panel 940 displays application switch keys used to switch between a plurality of functions such as a printer function, settings, color adjustment, and scheduling of printing and maintenance. The application switch keys are also used to switch selectively between a document server function, a copy function, a facsimile function, and the like successively. The network I/F 950 is an interface for data communications using a communication network. The near-field communication circuit 920 and the network I/F 950 are electrically connected to the ASIC 906 through the PCI bus 922.
The sensors 960 include various sensors that detect conditions of the image forming apparatus 100, respectively. In other words, the sensors 960 output sensor values used to detect an abnormality of the image forming apparatus 100 serving as the electronic apparatus.
For example, the sensors 960 include a sensor that detects a voltage of a primary transfer bias, a sensor that detects a density of toner on density adjustment patterns formed on the transfer belt 15, and a sensor that detects an interval between the density adjustment patterns. The sensors 960 further include a sensor that detects torque of the transfer belt driving roller 21 that drives and rotates the transfer belt 15. The torque of the transfer belt driving roller 21 is defined by a driving electric current of the driving motor that drives and rotates the transfer belt driving roller 21. The sensors 960 further include a sensor that detects a temperature and a humidity of a space in which the image forming apparatus 100 is located and a sensor that detects a temperature and a humidity of an interior of the image forming apparatus 100. The sensors 960 further include a sensor that detects an operating time (e.g., a rotation time) of the transfer belt driving roller 21 and a sensor that detects a fixing temperature of the fixing device 40.
The CPU 501 controls operation of an entirety of the machine learning server 102. The ROM 502 stores a program used to drive the CPU 501, such as an initial program loader (IPL). The RAM 503 is used as a work area of the CPU 501. The HD 504 stores various data such as programs. The HDD controller 505 controls reading or writing of various data with respect to the HD 504 under control of the CPU 501. The display 506 displays various information such as a cursor, a menu, a window, a character, and an image. The external device connection I/F 508 is an interface coupled with various external devices. For example, the external devices include a USB memory and a printer. The network I/F is an interface used to perform data communications using a communication network. The data bus 510 includes an address bus and a data bus that electrically connect elements such as the CPU 501 depicted in
The keyboard 511 is one example of an input device that includes a plurality of keys used to input characters, values, instructions, and the like. The pointing device 512 is one example of an input device used to select and execute the instructions, select a target for processing, and move the cursor. The DVD-RW drive 514 controls reading or writing of various data with respect to a DVD-RW 513 as one example of a recording medium that is removably inserted into the DVD-RW drive 514. Alternatively, instead of the DVD-RW 513, a digital versatile disc recordable (DVD-R) or the like may be used. The media I/F 516 controls reading or writing (e.g., storing) of data with respect to a recording medium 515 such as a flash memory.
Each of the host computer 103 and the data server 105 according to the embodiment has a hardware configuration similar to the hardware configuration of the machine learning server 102. Hence, a description of the hardware configuration of each of the host computer 103 and the data server 105 is omitted.
Referring to
For example, in the image forming apparatus 100 depicted in
In the image forming system 1000 according to the embodiment depicted in
A description is provided of the functional units of the image forming apparatus 100.
The image forming apparatus 100 according to the embodiment includes a data storage unit 401, a job control unit 403, a machine control unit 411, a data retrieval unit 404, an abnormality detector unit 405, an abnormality type determination unit 406, and a communication unit 407.
The data storage unit 401 stores data input to and output from the image forming apparatus 100, such as image data, learning data described below, and a learned model, with respect to the RAM 902b and the HD 909 in the hardware configuration depicted in
The data storage unit 401 further stores time series data retrieved by the data retrieval unit 404 and information relating to a service engineer to whom maintenance of the image forming apparatus 100 is requested.
When the job control unit 403 receives a job based on an instruction from the user, the job control unit 403 implements a basic function of the image forming apparatus 100, such as copying, facsimile, and printing, according to the job. As the job control unit 403 implements the basic function, the job control unit 403 sends and receives an instruction and data to and from other functional unit.
The machine control unit 411 performs control according to a determination result sent from the abnormality type determination unit 406. For example, the machine control unit 411 interrupts operation of the image forming apparatus 100. The machine control unit 411 sends a notice that requests maintenance of the image forming apparatus 100 to the service engineer who performs maintenance.
The machine control unit 411 performs control according to a usage of the image forming apparatus 100. For example, the machine control unit 411 switches between a plurality of transfer sheet trays 22 automatically. The machine control unit 411 converts color image data into monochrome image data. In a case that a voltage available in an environment where the image forming apparatus 100 is located is not greater than a voltage specified by a product specification, the machine control unit 411 delays a feed start time at which the feed roller 23 starts feeding a transfer sheet P, stores heat in the charger 2 sufficiently, and continues printing. In a case that the machine control unit 411 detects an abnormality of a sensor that measures a value not affecting control of the heater 40c directly, the machine control unit 411 decreases productivity of the image forming apparatus 100 to continue printing safely.
The data retrieval unit 404 retrieves time series data obtained by collecting sensor values output from various sensors of the sensors 960 over time. According to the embodiment, data obtained by collecting the sensor values output from various sensors of the sensors 960 over time define the time series data.
The abnormality detector unit 405 detects an abnormality of the image forming apparatus 100 based on the time series data retrieved by the data retrieval unit 404. For example, in a case that the time series data satisfies a predetermined rule that is determined in advance, the abnormality detector unit 405 detects the abnormality of the image forming apparatus 100. The abnormality detector unit 405 stores the predetermined rule in advance. For example, the predetermined rule has a definition that a sensor value output from a particular sensor of the sensors 960 is not smaller than a threshold.
The abnormality detector unit 405 detects an abnormality of the fixing device 40 of the image forming apparatus 100 based on the time series data retrieved by the data retrieval unit 404. For example, the abnormality detector unit 405 detects an abnormality (e.g., a failure) of the sensor 960 that detects the temperature of the fixing rotator 40a of the fixing device 40.
The abnormality type determination unit 406 stores the learned model learned by the machine learning server 102 described below. As the abnormality detector unit 405 detects the abnormality, the abnormality type determination unit 406 inputs the time series data retrieved in a predetermined time period encompassing a time when the abnormality is detected to the learned model and obtains information indicating a type of the abnormality from the learned model. The abnormality type determination unit 406 sends the information indicating the type of the abnormality to the machine control unit 411.
The communication unit 407 performs communication between the image forming apparatus 100 and other devices. For example, the communication unit 407 sends the time series data to the data server 105.
A description is provided of the functional units of the data server 105.
The data server 105 includes a data collecting-providing unit 410 and a data storage unit 412 as software.
The data collecting-providing unit 410 collects and provides learning data to be learned by the machine learning server 102. For example, the data collecting-providing unit 410 collects the time series data retrieved by the data retrieval unit 404 from the image forming apparatus 100 and stores the time series data into the data storage unit 412. The data collecting-providing unit 410 sends the time series data stored in the data storage unit 412 to the machine learning server 102.
A description is provided of the functional units of the machine learning server 102.
The machine learning server 102 includes a learning data generating unit 413, a machine learning unit 414, and a data storage unit 415.
The learning data generating unit 413 generates a dataset (e.g., learning data) that correlates the time series data received from the data server 105 to the information indicating the type of the abnormality of the image forming apparatus 100 when the time series data is retrieved.
According to the embodiment, the information indicating the type of the abnormality, that correlates to the time series data, may be obtained with the time series data from the image forming apparatus 100. Alternatively, an administrator of the image forming apparatus 100 may input the information indicating the type of the abnormality to the data server 105 and the machine learning server 102 and the information indicating the type of the abnormality may correlate to the time series data.
In order to obtain a target learning effect from the time series data, the learning data generating unit 413 deletes unnecessary data that may cause noise. In order to input the time series data to the learned model generated by the machine learning unit 414, the learning data generating unit 413 adjusts a format of the learning data, optimizing the learning data.
The machine learning unit 414 defines the learning data generated by the learning data generating unit 413 as an input and performs machine learning by using a learning method with the learning model described below effectively.
The data storage unit 415 temporarily stores the time series data received from the data server 105, the learning data generated by the learning data generating unit 413, and the learned model generated by the machine learning unit 414.
Referring to
As one example for describing features of the image forming system 1000 according to the embodiment, the learning data includes elements X1 to X10 that are involved in generation of the learning model that predicts the type of the abnormality as an output based on the time series data as an input by using the neural network.
The elements X1 to X10 of the learning data define factors that relate to the type of the abnormality of the image forming apparatus 100. For example, the factors include an environment, a usage time of the transfer belt driving roller 21, a fixing temperature of the fixing device 40, and an electric current of the driving motor. However, the factors are not limited to the above.
According to the embodiment, pieces of information included in the time series data obtained from the image forming apparatus 100 define the elements X1 to X10 of the learning data, respectively. The elements X1 to X10 of the learning data according to the embodiment are described below in detail.
The elements X1 to X10 of the learning data are not limited to the information included in the time series data and may include other information.
For example, in addition to the neural network, machine learning uses algorithm including nearest neighbor algorithm, Naïve Bayes algorithm, decision tree algorithm, support vector machine algorithm, and the like. Further, machine learning uses deep learning that generates for itself a feature value to be learned and a binding weighting coefficient by using the neural network. The above-described algorithms are selectively used and applied to the embodiment of the present disclosure.
The learning model includes an error detector unit and an update unit.
Referring to
The error detector unit of the learning model obtains an error between an output data Y and a training data T to calculate a loss L representing the error by using a loss function. The output data Y is calculated by using the neural network based on an input data X input to an input layer depicted in
The update unit updates the binding weighting coefficient and the like between nodes of the neural network based on the loss L obtained by the error detector unit such that the loss L decreases, for example, such that the loss L is closer to zero. For example, the update unit uses backpropagation algorithm to update the binding weighting coefficient and the like between the nodes of the neural network. The backpropagation algorithm adjusts the binding weighting coefficient and the like between the nodes of each of the neural networks so that the error decreases.
Referring to
The learning data generating unit 413 of the machine learning server 102 according to the embodiment provides numerous learning data 50 in a process S1. The learning data 50 combines the input data X and the training data T as a set. The input data X has a known actual value (e.g., training data).
Subsequently, the machine learning unit 414 inputs the input data X corresponding to the training data T to a learning model W in a process S2. The machine learning unit 414 calculates with the learning model W in a process S3. The machine learning unit 414 obtains the output data Y in a process S4. Subsequently, the machine learning unit 414 obtains the error between the output data Y and the training data T and calculates the loss L representing the error by using the loss function in a process S5. Subsequently, the machine learning unit 414 updates the binding weighting coefficient and the like between the nodes of the neural network based on the loss L so that the loss L decreases in a process S6.
According to the embodiment, the machine learning unit 414 adjusts the binding weighting coefficient between the nodes of the neural network as described above, obtaining the learning model W with an enhanced accuracy. According to the embodiment described below, the processes S1 to S6 define learning processes. The learning model adjusted through the learning processes defines the learned model.
The learning data 50 according to the embodiment defines data as a set of the input data X and the training data T (e.g., a failure of the sensor 960). The input data X is the time series data in a case that a speed at which the temperature of the fixing rotator 40a increases is lower than a predetermined threshold.
According to the embodiment, the machine learning unit 414 that uses the learning data 50 causes the learning model W to learn a relation between the time series data and the type of the abnormality of the image forming apparatus 100 by machine learning. In other words, the machine learning unit 414 according to the embodiment generates the learned model that defines the time series data of the image forming apparatus 100 as the input and the information indicating the type of the abnormality of the image forming apparatus 100 as the output.
Referring to
A description is provided of the processes for generating the learned model.
In step S601, the data retrieval unit 404 of the image forming apparatus 100 according to the embodiment retrieves time series data obtained by collecting sensor values output from the sensors 960 of the image forming apparatus 100 over time. In step S602, the data retrieval unit 404 sends the time series data to the data server 105.
In step S603, the data collecting-providing unit 410 of the data server 105 receives the time series data and the data storage unit 412 of the data server 105 stores the time series data.
In step S604, the data collecting-providing unit 410 of the data server 105 sends the time series data received from the image forming apparatus 100 to the machine learning server 102. If the data storage unit 412 of the data server 105 stores condition information about the condition of the image forming apparatus 100 in an amount not smaller than a predetermined amount, the data server 105 sends the condition information to the machine learning server 102.
In step S605, when the machine learning server 102 receives the time series data, the learning data generating unit 413 generates the learning data. For example, the learning data generated by the learning data generating unit 413 according to the embodiment includes the time series data obtained in a predetermined time period including a time when an abnormality (e.g., a failure) of one or more sensors of the sensors 960 is detected and the time series data obtained in a predetermined time period including a time when an abnormality (e.g., a failure) of other element of the image forming apparatus 100 is detected.
Subsequently, in step S606, the machine learning server 102 performs machine learning by using the learning data generated by the learning data generating unit 413, generating the learned model. In step S607, the machine learning server 102 sends the learned model that is generated to the image forming apparatus 100.
The above describes the processes for generating the learned model. The abnormality type determination unit 406 stores the learned model sent to the image forming apparatus 100.
A description is provided of the processes for detecting the abnormality.
In step S608, the data retrieval unit 404 of the image forming apparatus 100 obtains the time series data of the image forming apparatus 100.
Subsequently, in step S609, the abnormality detector unit 405 of the image forming apparatus 100 detects an abnormality of the image forming apparatus 100. In step S610, the machine control unit 411 of the image forming apparatus 100 performs control according to a detection result of detection of the abnormality.
Referring to
In step S701, the data retrieval unit 404 of the image forming apparatus 100 retrieves the time series data. Subsequently, in step S702, the abnormality detector unit 405 of the image forming apparatus 100 determines whether or not the condition of the image forming apparatus 100 is faulty based on the time series data retrieved in step S701 and the predetermined rule.
In a case that the abnormality detector unit 405 determines that the condition of the image forming apparatus 100 is normal in step S702, that is, in a case that the abnormality detector unit 405 does not detect an abnormality of the image forming apparatus 100 (NO in step S702), the image forming apparatus 100 finishes the processes.
In a case that the abnormality detector unit 405 detects an abnormality of the image forming apparatus 100 based on the predetermined rule (YES in step S702), the machine control unit 411 of the image forming apparatus 100 interrupts operation of the image forming apparatus 100 in step S703.
Subsequently, in step S704, the abnormality type determination unit 406 of the image forming apparatus 100 determines the type of the abnormality. For example, the image forming apparatus 100 inputs the time series data retrieved by the data retrieval unit 404 in step S701 to the learned model stored in the abnormality type determination unit 406, obtaining information indicating the type of the abnormality output by the learned model.
Subsequently, in step S705, the abnormality type determination unit 406 outputs the information indicating the type of the abnormality to the machine control unit 411.
In step S706, the machine control unit 411 determines whether or not the type of the abnormality detected in step S702 indicates an abnormality of the image forming apparatus 100 based on the information indicating the type of the abnormality.
The machine control unit 411 according to the embodiment stores an abnormality type table listing abnormalities of the image forming apparatus 100 in advance. The machine control unit 411 compares the information indicating the type of the abnormality output by the abnormality type determination unit 406 with the abnormality type table to determine whether or not the abnormality detected in step S702 is the abnormality of the image forming apparatus 100.
In a case that the machine control unit 411 determines that the type of the abnormality detected in step S702 is the abnormality of the image forming apparatus 100 (YES in step S706), the machine control unit 411 notifies the service engineer that maintenance of the image forming apparatus 100 is necessary in step S707 and finishes the processes. The image forming apparatus 100 continues interrupting operation.
In a case that the machine control unit 411 determines that the type of the abnormality detected in step S702 is not the abnormality of the image forming apparatus 100 (NO in step S706), that is, in a case that the abnormality of the image forming apparatus 100 results from a usage of the image forming apparatus 100, the machine control unit 411 switches to a control that fits the usage of the image forming apparatus 100 and resumes operation of the image forming apparatus 100 in step S708.
As described above, the image forming apparatus 100 according to the embodiment detects the abnormality thereof based on the predetermined rule. In a case that the image forming apparatus 100 detects the abnormality, the image forming apparatus 100 interrupts operation. Thereafter, the image forming apparatus 100 determines the type of the abnormality by using the learned model. In a case that the type of the abnormality does not request instant interruption of operation of the image forming apparatus 100, the image forming apparatus 100 resumes operation.
Accordingly, the image forming apparatus 100 according to the embodiment addresses the abnormality to be overcome instantly and suppresses redundant downtime.
As described above, the image forming system 1000 according to the embodiment has a configuration in which the machine learning server 102 generates the learned model and sends the learned model to the image forming apparatus 100 so that the image forming apparatus 100 determines the type of the abnormality. Alternatively, the image forming system 1000 may have other configuration.
For example, the image forming system 1000 according to the embodiment may have a configuration in which the machine learning server 102 stores the learned model and determines the type of the abnormality. Accordingly, in a case that the abnormality detector unit 405 of the image forming apparatus 100 detects an abnormality, for example, the communication unit 407 sends the time series data retrieved by the data retrieval unit 404 to the machine learning server 102. The machine learning server 102 inputs the time series data received from the image forming apparatus 100 to the learned model. The machine learning server 102 sends the information indicating the type of the abnormality output from the learned model to the image forming apparatus 100.
According to the embodiment described above, the machine learning server 102 generates the learned model. Alternatively, other element may generate the learned model. For example, the image forming apparatus 100 may generate the learned model. In other words, the image forming apparatus 100 may have functions of the machine learning server 102 and the data server 105.
Referring to
In addition to the functional units of the image forming apparatus 100 depicted in
Since the image forming apparatus 100A incorporates the learning data generating unit 413 and the machine learning unit 414, the image forming apparatus 100A generates the learned model.
In a case that an image forming system includes an image forming apparatus that includes the data collecting-providing unit 410, the learning data generating unit 413, and the machine learning unit 414, like the image forming apparatus 100A, the image forming system does not include the machine learning server 102 and the host computer 103.
Each of the image forming apparatuses 100 and 100A according to the embodiments serves as one example of an electronic apparatus. However, the electronic apparatus is not limited to the image forming apparatus 100 or 100A. The technology of the present disclosure is applied to any electronic apparatus that includes a sensor for detecting a condition of the electronic apparatus and obtains a sensor value output from the sensor over time.
The functional units according to the embodiments described above are established by one or more processing circuitry. The processing circuitry according to the embodiments of the present disclosure encompasses a processor programmed to execute the functional units with software like a processor implemented by an electronic circuit. The processing circuitry further encompasses a device designed to execute the functional units described above, such as an application specific integrated circuit (ASIC), a digital signal processor (DSP), a field programmable gate array (FPGA), and a general circuit module.
The elements according to the embodiments of the present disclosure indicate one example of a plurality of computing environments that implements the embodiments of the present disclosure.
According to an embodiment of the present disclosure, the machine learning server 102 and an image forming apparatus (e.g., the image forming apparatuses 100 and 100A) include a plurality of computing devices such as a server cluster. The plurality of computing devices communicates with each other through a communication link of an arbitrary type that includes a network and a shared memory. The plurality of computing devices implements the processes described above. Similarly, the machine learning server 102 and the image forming apparatus include a plurality of computing devices that communicates with each other.
The machine learning server 102 and the image forming apparatus share the processes described above with various combinations. For example, the machine learning server 102 and the image forming apparatus implement the process implemented by a predetermined unit. Similarly, each of the machine learning server 102 and the image forming apparatus implements a function of the predetermined unit. The elements of each of the machine learning server 102 and the image forming apparatus are installed in a single server collectively or installed in a plurality of servers separately.
The image forming apparatus is any apparatus that has a communication function. For example, the image forming apparatus is a projector (PJ), an output device such as a digital signage, a head-up display (HUD), industrial machinery, an imaging device, a sound collector, a medical device, a network-connected home appliance, a connected car, a laptop personal computer, a mobile phone, a smartphone, a tablet, a video game console, a personal digital assistant (PDA), a digital camera, a wearable computer, a desktop personal computer, or the like.
A description is provided of aspects of the embodiments of the present disclosure.
A description is provided of a first aspect of the embodiments of the present disclosure.
As illustrated in
The data retriever retrieves time series data obtained by collecting sensor values output from the sensor over time. The abnormality detector detects an abnormality based on the time series data retrieved by the data retriever and a predetermined rule that is determined in advance. In a case that the abnormality detector detects the abnormality, the abnormality type determiner inputs the time series data retrieved by the data retriever to a learned model and obtains information indicating a type of the abnormality from the learned model. The learned model defines the time series data as input data and the information indicating the type of the abnormality as output data. The machine controller controls operation of the electronic apparatus based on the information indicating the type of the abnormality obtained by the abnormality type determiner.
A description is provided of a second aspect of the embodiments of the present disclosure.
According to the first aspect, in a case that the abnormality detector detects the abnormality, the machine controller interrupts operation of the electronic apparatus.
A description is provided of a third aspect of the embodiments of the present disclosure.
According to the second aspect, in a case that the machine controller determines that the information indicating the type of the abnormality obtained by the abnormality type determiner indicates an abnormality of the electronic apparatus, the machine controller interrupts operation of the electronic apparatus. In a case that the machine controller determines that the information indicating the type of the abnormality obtained by the abnormality type determiner indicates an abnormality resulting from usage of the electronic apparatus, the machine controller resumes operation of the electronic apparatus.
A description is provided of a fourth aspect of the embodiments of the present disclosure.
As illustrated in
The data retriever retrieves time series data obtained by collecting sensor values output from the sensor over time. The abnormality detector detects an abnormality based on the time series data retrieved by the data retriever and a predetermined rule that is determined in advance. In a case that the abnormality detector detects the abnormality, the communicator sends the time series data to the information processing device. The machine controller controls operation of the electronic apparatus based on information indicating a type of the abnormality sent from the information processing device. The abnormality type determiner inputs the time series data received from the data retriever to a learned model and obtains the information indicating the type of the abnormality from the learned model. The learned model defines the time series data as input data and the information indicating the type of the abnormality as output data. The information processing device sends the information indicating the type of the abnormality to the electronic apparatus.
A description is provided of a fifth aspect of the embodiments of the present disclosure.
As illustrated in
The opposed rotator is disposed opposite the fixing rotator to form a nip (e.g., the fixing nip 40e) therebetween. The heater heats the fixing rotator. The nip formation pad is disposed inside the fixing rotator. The heater is disposed opposite the fixing rotator and is disposed opposite an inner circumferential face or an outer circumferential face of the fixing rotator. The heater heats the fixing rotator in an outboard span of the fixing rotator, that is disposed outboard from the nip in a rotation direction (e.g., the rotation direction D40a) of the fixing rotator. The fixing device fixes an unfixed image on a recording medium (e.g., the transfer sheet P) conveyed through the nip.
The sensor detects a temperature of the fixing rotator or the opposed rotator. The data retriever retrieves time series data obtained by collecting sensor values output from the sensor over time. The abnormality detector detects an abnormality of the sensor based on the time series data retrieved by the data retriever and a predetermined rule that is determined in advance. In a case that the abnormality detector detects the abnormality, the abnormality type determiner inputs the time series data retrieved by the data retriever to a learned model and obtains information indicating a type of the abnormality from the learned model. The learned model defines the time series data as input data and the information indicating the type of the abnormality as output data. The machine controller controls operation of the image forming apparatus based on the information indicating the type of the abnormality obtained by the abnormality type determiner.
A description is provided of a sixth aspect of the embodiments of the present disclosure.
As illustrated in
A description is provided of a seventh aspect of the embodiments of the present disclosure.
As illustrated in
A description is provided of an eighth aspect of the embodiments of the present disclosure.
As illustrated in
According to the first aspect to the eighth aspect described above, the data retriever, the abnormality detector, the abnormality type determiner, the communicator, and the machine controller are implemented by processing circuitry including the CPU 901. The information processing device is implemented by processing circuitry including the CPU 501 or 901.
Accordingly, the electronic apparatus, the anomaly detection system, and the anomaly detection method address the abnormality to be overcome instantly and suppress redundant downtime.
The above describes the embodiments applied with the technology of the present disclosure. However, application of the technology of the present disclosure is not limited to the embodiments described above. The embodiments of the present disclosure are modified or applied within the scope of the present disclosure and defined properly according to the embodiments that are modified or applied.
According to the embodiments described above, the image forming apparatus 100 is a printer. Alternatively, the image forming apparatus 100 may be a copier, a facsimile machine, a multifunction peripheral (MFP) having at least two of copying, printing, scanning, facsimile, and plotter functions, an inkjet recording apparatus, or the like.
The above-described embodiments are illustrative and do not limit the present invention. Thus, numerous additional modifications and variations are possible in light of the above teachings. For example, elements and/or features of different illustrative embodiments may be combined with each other and/or substituted for each other within the scope of the present invention. Any one of the above-described operations may be performed in various other ways, for example, in an order different from the one described above.
The functionality of the elements disclosed herein may be implemented using circuitry or processing circuitry which includes general purpose processors, special purpose processors, integrated circuits, application-specific integrated circuits (ASICs), field-programmable gate arrays (FPGAs), and/or combinations thereof which are configured or programmed, using one or more programs stored in one or more memories, to perform the disclosed functionality. Processors are considered processing circuitry or circuitry as they include transistors and other circuitry therein. In the disclosure, the circuitry, units, or means are hardware that carry out or are programmed to perform the recited functionality. The hardware may be any hardware disclosed herein which is programmed or configured to carry out the recited functionality.
There is a memory that stores a computer program which includes computer instructions. These computer instructions provide the logic and routines that enable the hardware (e.g., processing circuitry or circuitry) to perform the method disclosed herein. This computer program can be implemented in known formats as a computer-readable storage medium, a computer program product, a memory device, a record medium such as a CD-ROM or DVD, and/or the memory of an FPGA or ASIC.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2023-218569 | Dec 2023 | JP | national |