Patent Grant
9332890
The present invention relates a processor for an electronic endoscope which processes an image signal from an electronic endoscope and displays video, for example, on a monitor, and an electronic endoscope apparatus including the above described electronic endoscope and the processor.
Electronic endoscope apparatuses have been widely used for observation and diagnosis for a body cavity. The electronic endoscope apparatus includes an image pick-up device at its tip portion, and includes an electronic endoscope which outputs an image signal of an image shot by the image pick-up device, and a processor for the electronic endoscope which processes the image signal from the electronic endoscope, converts the image signal into a video signal having a predetermined format (e.g., a video signal in NTSC format) and displays the video, for example, on a monitor.
Generally, the processor for the electronic endo scope displays the image picked up by the electronic endoscope on the monitor as a moving image. Further, the processor for the electronic endo scope has the function of displaying the picked up image as a still image in order to make it possible to more specifically observe an observation target portion.
Displaying of the still image is triggered, for example, upon detection of pressing of an operation button provided on the electronic endoscope or the processor for the electronic endoscope. That is, a frame displayed on a monitor when the operation button is pressed or a next frame is continued to be displayed as a still image.
In the above described configuration, a user of the electronic endoscope is required to press the operation button at an appropriate timing while checking the moving image displayed on the monitor. However, since it is necessary to operate the electronic endoscope and press the operation button while checking the monitor, it is not easy to obtain a desired still image due to delay of the pressing timing of the operation button. For example, when the operation button is pressed while the observation target portion is moving, a problem arises that a blurry still image or a still image affected by color drift is obtained.
In order to prevent occurrence of a blurry image or a still image affected by color drift, a processor for an electronic endoscope having the function described in Japanese Patent Publication No. JP3497231B (hereafter, referred to as patent document 1) has been proposed. The processor for the electronic endoscope described in patent document 1 is configured to store image data of a plurality of latest frames in a memory, and when an operation for obtaining a still image (e.g., pressing of an operation button) is performed, the processor selects an image having a lower level of blur or color drift and displayed the selected image as a still image on the monitor.
Through use of the processor for the electronic endoscope described in patent document 1, a still image having a lower level of blur or color drift can be obtained. However, in the configuration of the patent document 1, the obtained still image having a lower level of blur or color drift does not always correspond to a desired still image, and therefore there is a case where re-obtaining of a still image is needed. In addition, in the configuration of patent document 1, no image data is stored in the memory during a time period from conducting of operation for obtaining a still image to displaying of the still image on the monitor. Therefore, when obtaining of a still image is required again, it is necessary to wait until image data is stored in the memory again, which causes a problem that a diagnosis time extends.
The present invention is made to solve the above described problem. That is, the objection of the invention is to provide a processor for an electronic endoscope and an electronic endoscope apparatus capable of reliably obtaining a desired still image in a short period of time.
To achieve the above described object, a processor for an electronic endoscope according to the invention includes first and second image storing means and a control means, and the control means executes control in one of: a first mode in which the image data is sequentially converted into the video signal and is outputted, and is sequentially stored in the first and second image data storing means; a second mode in which the image data stored in the first image storing means is outputted, and the generated image data is sequentially stored in the second image storing means; and a third mode in which the image data stored in the second image storing means is outputted, and the generated image data is sequentially stored in the first image storing means. In the second mode and the third mode, a first reproduction mode in which a plurality of image data stored in the first and second image storing means are successively outputted and a second reproduction mode in which one of the plurality of image data stored in the first and second image storing means is repeatedly outputted can be switched.
In the above described configuration, when an image shot by the electronic endo scope is observed as a moving image, control is performed in the first mode, and when a still image is obtained, the mode is switched to the second or third mode, and the immediately previous plurality of image data stored in the first and second image storing means is displayed successively. Then, appropriate image data is selected and displayed on the monitor. In the above described configuration, the image data shot by the electronic endoscope is stored both in the first image storing means and the second image storing means. Therefore, even when a user operates to display a moving image by returning to the first mode after a still image is displayed in the second mode and to try to immediately obtain another still image while checking the moving image, the user can obtain a still image in the third mode because the immediately previous image data including the image shot by the electronic endoscope in the second mode is stored in the second image storing means.
When the control means may switch from the first reproduction mode to the second reproduction mode, the image data outputted immediately before switching to the second reproduction mode is repeatedly converted into the video signal and is outputted.
In the first reproduction mode, the plurality of image data stored in each of the first and second image storing means may be sequentially converted into the video signal in reverse chronological order in regard to a stored time and may be outputted. In this case, when the mode is switched from the first mode to the second or third mode, a moving image reproduced in a reverse direction from a time point of the switching is displayed on the monitor.
In the first reproduction mode, the plurality of image data stored in each of the first and second image storing means may be sequentially converted into the video signal in chronological order in regard to a stored time and may be outputted. In this case, when the mode is switched from the first mode to the second or third mode, a moving image reproduced in a forward direction from a time point wound back for a certain time period (corresponding to the storage capacity of the first and second image storing means) from the time point of the switching is displayed on the monitor.
In the first reproduction mode, each of the plurality of image data stored in the first and second image storing means may be successively converted into the video signal a plurality of times and may be outputted. In such a configuration, when the first mode is switched to the second or third mode, one frame of image data stored in the first and second image storing means is continuously displayed over a plurality of frames. That is, in this configuration, in the state where a plurality of image data is successively converted into the video signal and is outputted in the second or third mode, a moving image is displayed on the monitor in a slow reproducing manner.
The processor for an electronic endoscope may further comprise a judgment means which receives an input of a control signal for switching from the first mode to the second or the third mode and makes a judgment on which of the second mode and the third mode the control means switches to when the control signal is inputted, and the control means may switch from the first mode to the second or the third mode based on a judgment result of the judgment means.
In this case, the judgment means may make a judgment such that the second mode and the third mode are alternately switched each time the control signal is inputted.
The judgment means may make a judgment to switch from the first mode to the third mode only when the control signal is inputted within a predetermined time from a time when switching from the second mode to the first mode is performed. In this case, the predetermined time may correspond to a number of pieces of image data which can be stored in the first image storing means.
Preferably, an electronic endoscope apparatus according to the invention comprises one of the above described processors for an electronic endoscope, and comprises: a first input means which receives an input for designating switching from the first mode to the second or third mode; a second input means which receives an input for switching from the first reproduction mode to the second reproduction mode in the second or third mode; and a third input means which receives an input for designating switching from the second and third modes to the first mode by inputting through the first to third input means.
With this configuration, it becomes possible to obtain a still image and to release a displaying state for a still image.
The first input means may be identical with the third input means.
The processor for an electronic endoscope may further comprise a fourth input means which receives an input for switching from the second reproduction mode to the first reproduction mode in the second or the third mode.
With this configuration, when a still image displayed on the monitor once but the still image is hard to view due to a large degree of blur and color shift, it is possible to move back to the mode where the image data stored in the first and second image storing means is successively displayed on the monitor, and to obtain a still image again.
Furthermore, in this case, the second input means may be identical with the fourth input means.
As described above, according to the invention, a processor for an electronic endo scope and an electronic endo scope apparatus capable of reliably obtaining a desired still image in a short period of time are realized.
In the following, embodiments of the present invention are explained in detail with reference to the accompanying drawings.
An electronic endoscope apparatus 1 according to a first embodiment of the invention is explained with reference to
An objective lens 121 and an image pick-up device 120 are accommodated in the vicinity of a tip portion (an insertion tube tip part) 111 in an insertion tube 110 of the electronic endoscope 100. The objective lens 121 converges a subject image near to the insertion tube tip part 111 onto a light receiving surface of the image pick-up device 120.
The image pick-up device 120 outputs an image signal corresponding to the image converged onto the light receiving surface. The image signal is transmitted to a CCD process circuit 221 of the processor 200 for the electronic endoscope via a signal cable 123 inserted into the inside of the insertion tube 110. The image pick-up device 120 is controlled by timing pulses inputted to the image pick-up device 120 from a CCD driving circuit (not shown) accommodated in a connector portion 150 of the electronic endo scope 100. Output timing of the timing pulses by the CCD driving circuit is controlled by a microprocessor (not shown) accommodated in the connector portion 150. In
In the processor 200 for the electronic endoscope, the CCD process circuit 221, an A-D converter circuit 222, a frame memory 223, a video process circuit 224, a timing generator 225, a CPU 210, a switch 240, and an illumination device 230 are accommodated. The CCD process circuit 221 executes processes, such as a noise cut process and an amplifying process, for the image signal inputted from the image pick-up device 120, and transmits the signal to the A-D converter circuit 222. The A-D converter circuit 222 converts the analog image signal received from the CCD process circuit 221 into digital image data, and outputs the image data to the frame memory 223. The frame memory 223 is constituted by a memory capable of storing a plurality of frames of image data (which is described later), and is configured to store the image data under control of the timing generator 225 and to output the stored image data to the video process circuit 224. The video process circuit 224 converts the image data outputted from the frame memory 223 into a video signal (e.g., an NTSC signal) in a predetermined format, and outputs the video signal to the monitor 300 connected to the processor 200 for the electronic endoscope. Through the above described processes, the image near the insertion tube tip part 111 of the electronic endoscope 100 is displayed on the monitor 300.
The CPU 210 of the processor 200 for the electronic endo scope is connected to each component of the processor 200 for the electronic endo scope, such as the switch 240 and the timing generator 255, and totally controls the processor 200 for the electronic endoscope and the electronic endoscope 100 in accordance with programs stored in a memory (not shown). The switch 240 is a user interface through which a user makes settings or inputs instructions to the processor 200 for the electronic endoscope. For example, the switch 240 is a freeze button 240a for obtaining a still image. The CPU 210 makes settings or changes the settings of the processor 200 for the electronic endoscope and the electronic endoscope 100 in accordance with an input from the switch 240. In this embodiment, when the electronic endo scope 100 is connected to the processor 200 for the electronic endoscope, a scope button 140 of the electronic endoscope 100 is connected to the CPU 210, and the CPU 210 is configured to be able to monitor the state of the scope button 140. That is, when the scope button 140 is pressed, a scope button input signal SB indicative of pressing of the scope button 140 is transmitted to the CPU 210, and the CPU 210 is able to judge whether the scope button 140 of the electronic endo scope 100 is pressed.
The processor 200 for the electronic endoscope includes the illumination device 230 which generates illumination light for illuminating the portion near the insertion tube tip part 111 of the electronic endoscope 100. In the following, explanation is given for the function of the processor 200 for the electronic endoscope as an illumination device.
As shown in
The lamp 231 accommodated in the processor 200 for the electronic endoscope produces illumination light through supply of power from a lamp power supply circuit (not shown). The produced illumination light is incident on the condenser lens 233 through the diaphragm 232. The light guide 130 is provided to protrude from the connector portion 150, and in the state where the electronic endo scope 100 is connected to the processor 200 for the electronic endo scope, the light guide 130 is inserted into the inside of the processor 200 for the electronic endoscope. In the state where the light guide 130 is inserted into the processor 200 for the electronic endo scope, a proximal end 132 of the light guide 130 is located at a position on which the illumination light collected by the condenser lens 233 is incident. As a result, the illumination light produced by the lamp 231 is incident on the proximal end 132 of the light guide 130, reaches the tip portion 131 through the light guide 130, and illuminates, through the light distribution lens, a living body tissue near the insertion tube tip part 111. The diaphragm 232 is controlled by the CPU 210. That is, by controlling the diaphragm 232, the CPU 210 adjusts the amount of illumination light incident on the proximal end 132 of the light guide 130 from the lamp 231, and alters the intensity of the illumination light.
As shown in
The writing address WA is data representative of an address on the first memory 223a and the second memory 223b storing the input image data VIN, and in this embodiment, the writing address WA is inputted in common to the first memory 223a and the second memory 223b. Each of the first memory 223a and the second memory 223b stores the input image data VIN at an address indicated by the writing address WA when being set as a writable state (i.e., in a read-inhibited state) by the timing generator 225. The input image data VIN stored in the first memory 223a and the second memory 223b can be read by designating the first memory read address RA1 and the second memory read address RA2. When the first memory 223a and the second memory 223b are not set as the read-inhibited state (the writable state) by the timing generator 225, the image data stored at the first memory read address RA1 and the second memory read address RA2 are respectively read from the first memory 223a and the second memory 223b, and the image data is outputted as a first memory output MO1 and a second memory output MO2.
The switch circuit 223c is a circuit for performing switching of the input signals, and is constituted, for example, with a multiplexer. To the switch circuit 223c, the first memory output MO1, the second memory output MO2 and a through image signal TS (i.e., the input image data VIN) are inputted, and under control of the timing generator 225, one of the first memory output MO1, the second memory output MO2 and the through image signal TS is selected and is outputted as an output image data VOUT. Then, the output image data VOUT outputted from the switch circuit 223c is transmitted to the video process circuit 224.
As described above, the frame memory 223 accommodated in the processor 200 for the electronic endoscope according to the embodiment includes the first memory 223a and the second memory 223b each of which stores the plurality of frames of image data, and the image data stored in these memories is read under control of the timing generator 225. The timing generator 225 is controlled by the CPU 210 (
Next, the image recording/reproducing operation executed by the electronic endoscope apparatus 1 according to the embodiment is explained with reference to
When the electronic endoscope 100, the processor 200 for the electronic endoscope and the monitor 300 are turned on, as described above, the image signal outputted from the image pick-up device 120 is transmitted to the CCD process circuit 221, and is digitized by the A-D conversion circuit 222, and then the input image data VIN is sequentially inputted to the frame memory 223. The CPU 210 of the processor 200 for the electronic endoscope executes the program stored in the memory (not shown) to start the image recording/reproducing operation.
As shown in
In the first mode, when the CPU 210 detects that the scope button 140 is pressed (T1), the CPU 210 controls the timing generator 225 to execute a first rewind reproduction process. When the first rewind reproduction process is executed, the timing generator 225 sets the first memory 223a in a writing-inhibited state (a readable state) under control of the CPU 210, and after switching the output of the switch circuit 223c to the first memory output MO1, the timing generator 225 sets the first memory read address RA1 to the immediately previous value of the wiring address WA. Then, each time the new input image data VIN is inputted to the frame memory 223, the first memory read address RA1 is decremented. In the case of
As described above, when the first rewind reproduction process is executed, the image data stored in the first memory 223a is read out in reverse chronological order from the latest frame, and as a result the video is outputted in a rewinding manner. The first frame memory 223a according to the embodiment is constituted by a ring-type memory capable of storing 240 frames of image data. Therefore, after the 240 frames are rewound, the video returns again to the latest frame (the frame number 242 in
In the second mode, when the CPU 210 detects that the scope button 140 is pressed (T2), the CPU 210 controls the timing generator 225 to stop the first rewind reproduction process. When the first rewind reproduction process is stopped, the timing generator 225 sets the first memory 223a as the read-inhibited state (the writable state), and switches the output of the switch circuit 223c to the through signal TS, under control of the CPU 210. As a result, the input image data VIN is sequentially stored in the first memory 223a again, and the same data as the input image data VIN is outputted as the output image data VOUT. That is, the mode returns to the first mode.
When the CPU 210 detects that the scope button 140 is pressed (T3), the CPU 210 controls the timing generator 225 to execute a second rewind reproduction process. When the second rewind reproduction process is executed, the timing generator 225 sets the second memory 223b as the writing-inhibited state (the readable state), and switches the output of the switch circuit 223c to the second memory output MO2 and sets the second memory read address RA2 to the immediately previous value of the writing address WA, under control of the CPU 210. Then, each time the new input image data VIN is inputted to the frame memory 223, the second memory read address RA2 is decremented. In the case of
As described above, when the second rewind reproduction process is executed, the image data stored in the second memory 223b is sequentially outputted in reverse chronological order from the latest frame, and the video is outputted in a rewinding manner. The second memory 223b according to the embodiment is constituted by a ring-type memory capable of storing 240 frames of image data. Therefore, after the 240 frames are rewound, the video returns again to the latest frame (the frame number 721 in
In the third mode, when the CPU 210 detects that the scope button 140 is pressed (T4), the CPU 210 controls the timing generator 225 to stop the second rewind reproduction process. When the second rewind reproduction process is stopped, the timing generator 225 sets the second memory 223b as the read-inhibited state (the writable state), and switches the output of the switch circuit 223c to the through signal TS, under control of the CPU 210. As a result, the input image data VIN is sequentially stored in the second memory 223b again, and the same data as the input image data VIN is outputted as the output image data VOUT. That is, the mode returns to the first mode. It should be noted that, when pressing of the scope button 140 is detected thereafter, the above described mode transition is caused, i.e., each time pressing of the scope button 140 is detected, the mode changes in order of the second mode, the first mode, the third mode, the first mode.
As described above, in the electronic endoscope apparatus 1 according to the embodiment, each time pressing of the scope button 140 is detected by the CPU 210, the mode changes in order of the first mode, the second mode, the first mode, the third mode and the first mode. In the second mode, the image data is read from the first memory 223a while storing the input image data VIN in the second memory 223b, and the first memory output MO1 is outputted as the output image data VOUT. In the third mode, the image data is read out from the second memory 223b while storing the input image data VIN in the first memory 223a, and the second memory output MO2 is outputted as the output image data VOUT. That is, even when one of the first memory 223a and the second memory 223b is set as the readable state (i.e., the writing-inhibited state), the other continues to sequentially store the input image data VIN. Therefore, even when the first rewind reproduction process or the second rewind reproduction process is running, the latest 240 frames of image data can be stored in one of the first memory 223a and the second memory 223b. Therefore, as described later, in this embodiment, a still image is obtained in the second mode or the third mode so as to make it possible to repeatedly re-shoot a still image without the need for waiting for storing of the image data in a memory.
In the second mode, when the CPU 210 detects that the freeze button 240a (
The time period of T7 to T8 in
As described above, in this embodiment, a still image is obtained in the second mode or the third mode. Therefore, it is possible to re-shoot a still image repeatedly without the need for waiting for storing of the image data into a memory. Therefore, when a desired still image cannot be obtained by one operation, a desired still image can be obtained in a relatively short period of time even when re-shooting of a still image is repeatedly performed.
(Variation of First Embodiment)
In the first embodiment, each time pressing of the scope button 140 is detected by the CPU 210, the mode is changed in order of the first mode, the second mode, the first mode, the third mode, the first mode. However, the present invention is not limited to such a configuration. For example, in the case where the mode is changed from the second mode to the first mode, the mode may be changed to the third mode when pressing of the scope button 140 is detected within a predetermined time period from the transition, and the mode may be changed to the second mode again when pressing of the scope button 140 is detected after the predetermined time has elapsed from the transition. Each of the first memory 223a and the second memory 223b according to the first embodiment is configured to be able to store 240 frames of image data. Therefore, when the frame rate of the image signal outputted from the image pick-up device 120 is 60 frames/sec, the image data corresponding to immediately previous 4 seconds is stored in the first memory 223a and the second memory 223b, respectively. In other words, the image data in the first memory 223a and the second memory 223b is completely replaced (refreshed) at every four seconds. Therefore, when the mode is changed from the second mode to the first mode, the mode may move again to the second mode after the time period (four seconds) required for refresh of the first memory 223a has elapsed after the transition.
Next, an electronic endoscope apparatus 2 according to a second embodiment of the invention is explained with reference to
The speed setting input signal SS is inputted by a user through the switch 240 of the processor 200 for the electronic endoscope, and is data indicative of a degree of slow reproduction, such as double-slow (×2) or triple-slow (×3). The speed setting input signal SS is transmitted to the CPU 210 via the switch 240, and the CPU 210 controls the timing generator 225 based on the speed setting input signal SS.
As in the case of the first embodiment, in the first mode, when the CPU 210 detects pressing of the scope button 140 (T1), the CPU 210 controls the timing generator 225 to execute the first rewind reproduction process. When the first rewind reproduction process is executed, the timing generator 225 sets the first memory 223a to the writing-inhibited state (the readable state), switches the output of the switch circuit 223c to the first memory output MO1, and sets the first memory read address RA1 as the immediately previous value of the writing address WA, under control of the CPU 210. Then, when the double-slow (×2) is set to the speed setting input signal SS (the time period to T9, the time period from T10), the timing generator 225 decrements the first read address RA1 each time the input image data VIN corresponding to two frames is inputted to the frame memory 223. When the triple-slow (×3) is set to the speed setting input signal SS (the time period of T9 to T10), the timing generator 225 decrements the first read address RA1 each time the input image data VIN corresponding to three frames is inputted to the frame memory 223. In the case of
As described above, in this embodiment, when the first rewind reproduction process is executed, the image data stored in the first memory 223a is sequentially read out predetermined times from the latest data, and the slow rewind reproduction is performed. Therefore, according to the embodiment, the user is able to perform an operation (an operation to the freeze button 240a) for obtaining a still image while viewing a slow rewinding image. Therefore, it is possible to obtain a desired still image in a short time period. As in the case of the first embodiment, the slow rewinding reproduction is also performed when the mode moves from the first mode to the third mode. However, this operation is the same as the case when the mode moves from the first mode to the second mode, and therefore explanation thereof is omitted.
Next, an electronic endoscope apparatus 3 according to a third embodiment of the invention is explained with reference to
When the CPU 210 detects pressing of the scope button 140 in the first mode (T1), the CPU 210 controls the timing generator 225 to execute a first forward reproduction process. When the forward reproduction process is executed, the timing generator 225 sets the first memory 223a to the writing-inhibited state (the readable state), switches the output of the switch circuit 223c to the first memory output MO1, and sets the first memory read address RA1 to the value obtained by adding “1” to the immediately previous value of the writing address WA. Then, the timing generator 225 decrements the first memory address RA1 each time the new input image data VIN is inputted to the frame memory 223. In the case of
As described above, when the first forward reproduction process according to the embodiment is executed, the image data stored in the first memory 223a is read out in chronological order from the oldest data, and therefore the video is reproduced and outputted in a forward direction. The first memory 223a according to the embodiment is constituted by a ring-type memory capable of storing 240 frames of image data. Therefore, after 240 frames of image data are reproduced, the video returns to the oldest frame again (frame number 3 in
As described above the image record/reproduction operation according to the third embodiment is different from the image record/reproduction operation of the first embodiment shown in
As described above, in the first, second and third embodiments of the invention, switching between the first to the third modes of the image record/reproduction operation is performed based on the operation of the scope button 140 of the electronic endoscope 100. However, the present invention is not limited to such a configuration. For example, switching between the first to the third modes may be performed based on the operation of the switch 240 of the processor 200 for the electronic endoscope. Similarly, the freeze button 240a and the speed setting button 240b are not limited to the switch 240 of the processor 200 for the electronic endoscope, and may be provided on the electronic endoscope 100.
| Number | Date | Country | Kind |
|---|---|---|---|
| 2010-226806 | Oct 2010 | JP | national |
| Filing Document | Filing Date | Country | Kind | 371c Date |
|---|---|---|---|---|
| PCT/JP2011/069134 | 8/25/2011 | WO | 00 | 1/30/2013 |
| Publishing Document | Publishing Date | Country | Kind |
|---|---|---|---|
| WO2012/046518 | 4/12/2012 | WO | A |
| Number | Name | Date | Kind |
|---|---|---|---|
| 4901143 | Uehara et al. | Feb 1990 | A |
| 5270810 | Nishimura | Dec 1993 | A |
| RE34504 | Uehara et al. | Jan 1994 | E |
| 5617136 | Iso et al. | Apr 1997 | A |
| 6489987 | Higuchi et al. | Dec 2002 | B1 |
| 20070223797 | Kaneko | Sep 2007 | A1 |
| 20080303898 | Nishimura | Dec 2008 | A1 |
| 20090040235 | Matsuda | Feb 2009 | A1 |
| 20090135249 | Hirakawa | May 2009 | A1 |
| 20110122068 | Venon | May 2011 | A1 |
| 20130123576 | Ozawa | May 2013 | A1 |
| Number | Date | Country |
|---|---|---|
| 101005795 | Jul 2007 | CN |
| 101040774 | Sep 2007 | CN |
| 101778591 | Jul 2010 | CN |
| 63-214231 | Sep 1988 | JP |
| 1-279689 | Nov 1989 | JP |
| 4-33651 | Feb 1992 | JP |
| 4-71546 | Mar 1992 | JP |
| 7-289507 | Nov 1995 | JP |
| 10-323326 | Dec 1998 | JP |
| 11-197104 | Jul 1999 | JP |
| 11-216107 | Aug 1999 | JP |
| 2002-65667 | Mar 2002 | JP |
| 3497231 | Feb 2004 | JP |
| 2007-301398 | Nov 2007 | JP |
| 2008-302146 | Dec 2008 | JP |
| WO 2007077554 | Jul 2007 | WO |
| WO 2010086751 | Aug 2010 | WO |
| Entry |
|---|
| Japan Office action in Japan Patent Application No. 2010-226806, dated Jun. 2, 2014 along with an english translation thereof. |
| U.S. Appl. No. 13/823,996 to Ryo Ozawa, filed Mar. 15, 2013. |
| China Office action, dated Nov. 17, 2014 along with an English translation thereof. |
| China Office action in China Patent Application No. 201180051851.3, dated Dec. 3, 2014 along with an English translation thereof. |
| Office Action issued in U.S. Appl. No. 13/823,996, dated Jun. 18, 2015. |
| Number | Date | Country | |
|---|---|---|---|
| 20130123576 A1 | May 2013 | US |
