Patent Grant
11315532
The present invention relates to a chord information extraction device, a chord information extraction method and a non-transitory computer readable medium storing a chord information extraction program for extracting chord information from image data of a music score.
Conventionally, it has been suggested that image data of a score is acquired using a scanner or the like, and various information related to a music piece is extracted from the image data. For example, an electronic musical instrument system constituted by an electronic musical instrument and an image capturing device is described in JP 4702139 B2. The image capturing device includes a scanner, a digital camera or the like, and reads music piece information from a music score printed on a sheet of paper (printed music score). The music piece information includes setting information such as registration associated with performance of a music piece in addition to general music score information. The read music piece information is converted into music score image information, and the music score image information is input to an electronic musical instrument. When acquiring the music score image information, the electronic musical instrument converts the music score image information into music piece data by a music score reading process using an image analysis technique to read the data.
Chord information representing a chord in a music piece (a chord that is a combination of a chord root and a chord type, for example) may be notated on a score. In the above-mentioned electronic musical instrument system, a QR code (registered trademark), for example, is provided on a printed music score as setting information, and it is possible to acquire the setting information by reading the QR code (registered trademark). However, the chord information notated on a general score cannot be extracted accurately.
An object of the present invention is to provide a chord information extraction device, a chord information extraction method and a non-transitory computer readable medium storing a chord information extraction program for extracting chord information efficiently from score image data.
A chord information extraction device according to one aspect of the present invention includes a character group extractor configured to extract a character group corresponding to chord information from score image data representing a music score, a determiner configured to determine whether the extracted character group follows a predetermined chord notation rule, and a corrector configured to, in a case where the determiner determines that the extracted character group does not follow the chord notation rule, correct the extracted character group such that the extracted character group follows the chord notation rule.
In an embodiment, the chord notation rule may define a chord root rule in regard to a chord root and a chord type rule in regard to a chord type, and the determiner may be configured to determine that the extracted character group follows the chord notation rule, in a case where the extracted character group includes a chord root character group representing a chord root and a chord type character group representing a chord type, when the chord root character group follows the chord root rule, and the chord type character group follows the chord type rule. In an embodiment, the corrector may be configured to correct a character, which does not follow the chord notation rule, in the extracted character group based on a predetermined correction table.
In an embodiment, the chord information extraction device may further include a font information acquirer configured to acquire font information representing a font of a character group corresponding to the chord information, wherein the character group extractor may be configured to extract a character group corresponding to the chord information based on the acquired font information. In an embodiment, the chord information extraction device may further include a font receiver that is configured to receive designation of a font by a user, wherein the font information acquirer may be configured to acquire the font information representing the designated font. In an embodiment, the chord information extraction device may further include a font determiner configured to extract at least one character from the score image data and determine a font of the extracted character, wherein the font information acquirer may be configured to acquire the font information representing the determined font. In an embodiment, the chord information extraction device may further include a position information acquirer configured to acquire position information representing a position of the extracted character group in the music score, and a time position specifier configured to specify a time position in a music piece represented by the music score based on the acquired position information.
A chord information extraction method according to another aspect of the present invention includes extracting a character group corresponding to chord information from score image data representing a music score, determining whether the extracted character group follows a predetermined chord notation rule, and correcting, in a case where it is determined that the extracted character group does not follow the chord notation rule, the extracted character group such that the extracted character group follows the chord notation rule.
In an embodiment, the chord notation rule may define a chord root rule in regard to a chord root and a chord type rule in regard to a chord type, and the determining may include determining that the extracted character group follows the chord notation rule, in a case where the extracted character group includes a chord root character group representing a chord root and a chord type character group representing a chord type, when the chord root character group follows the chord root rule, and the chord type character group follows the chord type rule. In an embodiment, the correcting may include correcting a character, which does not follow the chord notation rule, in the extracted character group based on a predetermined correction table.
In an embodiment, the chord information extraction method may further include acquiring font information representing a font of a character group corresponding to the chord information, wherein the extracting a character group may include extracting a character group corresponding to the chord information based on the acquired font information. In an embodiment, the chord information extraction method may further include receiving designation of a font by a user, wherein the acquiring the font information may include acquiring the font information representing the designated font. In an embodiment, the chord information extraction method may further include extracting at least one character from the score image data, and determining a font of the extracted character, wherein the acquiring the font information may include acquiring the font information representing the determined font. In an embodiment, the chord information extraction method may further include acquiring position information representing a position of the extracted character group in the music score; and specifying a time position in a music piece represented by the music score based on the acquired position information.
A non-transitory computer readable medium according to yet another aspect of the present invention stores a chord information extraction program, wherein the chord information extraction program causes a computer to extract a character group corresponding to chord information from score image data representing a music score, determine whether the extracted character group follows a predetermined chord notation rule, and correct, in a case where it is determined that the extracted character group does not follow the chord notation rule, the extracted character group such that the extracted character group follows the chord notation rule.
Other features, elements, characteristics, and advantages of the present invention will become more apparent from the following description of preferred embodiments of the present invention with reference to the attached drawings.
A chord information extraction device, a chord information extraction method and a non-transitory computer readable medium storing a chord information extraction program according to embodiments of the present invention will be described below in detail with reference to the drawings.
The chord information extraction device 100 of
The score inputter 1 reads a music score printed on a recording medium such as a sheet of paper, and inputs the score image data representing the music score to the CPU 11. For example, the score inputter 1 is a scanner and includes a light source and an optoelectronic transducer. The music score is irradiated with light from the light source, and the reflected light is received by the optoelectronic transducer. The optoelectronic transducer generates score image data based on the received light.
The operation unit 4 includes various operating elements to be operated by a user, and is used for on-off of a power supply and various settings. The display 6 includes a liquid crystal display, for example, and displays the extracted chord information. At least part of the operation unit 4 and the display 6 may be constituted by a touch panel display.
The RAM 9, the ROM 10 and the CPU 11 constitute a computer 200. The RAM 9 is a volatile memory, for example, which is used as a working area for the CPU 11, and temporarily stores various data. The ROM 10 is a non-volatile memory, for example, and stores computer programs such as a control program and the chord information extraction program. The CPU 11 executes the chord information extraction program stored in the ROM 10 on the RAM 9 to perform a chord information extraction process mentioned below.
The storage device 13 includes a storage medium such as a hard disc, an optical disc, a magnetic disc or a memory card. The storage device 13 stores a chord notation rule and a correction table. The chord notation rule defines a rule for chord notation. The correction table is used to correct a character group extracted from the score image data. Details of the chord notation rule and the correction table will be described below. One or a plurality of score image data pieces may be stored in the storage device 13, or the chord information extraction program may be stored in the storage device 13.
The communication I/F 14 can be connected to various external equipment such as an external storage device. Further, the communication I/F 14 may be connected to a communication network. In a case where the communication I/F 14 is connected to an external storage device, at least one of the chord information extraction program, the score image data, the chord notation rule and the correction table may be stored in the external storage device.
The chord information extraction program in the present embodiment may be supplied in the form of being stored in a storing media which is readable by a computer, and installed in the ROM 10 or the storage device 13. In addition, in a case where the communication I/F 14 is connected to a communication network, the chord information extraction program delivered from a server connected to the communication network may be installed in the ROM 10 or the storage device 13. Similarly, at least one of the score image data, the chord notation rule and the correction table may be acquired from the storage medium or may be acquired from the server connected to the communication network.
The image data acquirer 51 acquires the score image data input by the score inputter 1. The image data acquirer 51 may acquire the score image data from any of the storage device 13 of
The character group extractor 52 extracts one or a plurality of character groups (hereinafter referred to as chord character groups) corresponding to the chord information from the acquired score image data. The chord character group includes one or a plurality of characters representing chord names. Specifically, the character group extractor 52 extracts the image data of the chord character group from the score image data, and recognizes each of the characters (hereinafter referred to as chord characters) included in the chord character group based on the extracted image data. The chord characters includes numerals, alphabets, music symbols such as “#” (sharp) and “♭” (flat), and symbols used for chord notation such as “Δ” (major) and “φ”(half diminished).
The font receiver 53 receives the designation of a font (hereinafter referred to as a chord font) of the chord character group by the user. The chord font differs depending on a score. As such, the user designates a chord font by operating the operation unit 4, for example. The font determiner 54 extracts at least one character from the acquired score image data as a reference character, and determines the font of the extracted reference character as the chord font. In this case, the extracted chord character group may be used as a reference character. For example, in a case where the chord font is not received by the font receiver 53 (in a case where the user does not designate the chord font), the font determiner 54 determines the chord font.
The font information acquirer 55 acquires the font information representing the chord font. In the present example, the font information acquirer 55 acquires the font information representing the chord font received by the font receiver 53 or the chord font determined by the font determiner 54. Further, in the present example, the character group extractor 52 recognizes each chord character included in the extracted chord character group based on the acquired font information.
The determiner 56 determines whether the extracted chord character group follows the chord notation rule CR stored in the storage device 13 of
The position information acquirer 58 acquires the position information representing the position of the chord character group on the reference score. The position information represents the coordinates of each chord character group on the reference score, for example. The time position specifier 59 specifies the time position of each chord information in the reference music piece based on the acquired position information. The time position is represented by a measure number, a beat and a tick, for example.
The display controller 60 controls the display 6 such that the chord information represented by the corrected chord character group is displayed. For example, the display controller 60 displays the chord score of the reference music piece on the screen of the display 6 based on the corrected chord character group and the time position specified by the time position specifier 59.
One example of extraction of the chord information from the score image data will be described.
Image data of a chord character group is extracted from the score image data representing such a reference score by the character group extractor 52 of
Subsequently, each chord character is recognized by the character group extractor 52 based on the image data of the extracted chord character group. In the present example, each chord character is recognized based on the font information acquired in advance by the font information acquirer 55 of
For example, the display 6 of
In a case where the chord font is unknown, the user turns on the option button OP1. In a case where the chord font is a general font, the user turns on the option button OP2 and turns on the option button OP2a corresponding to the chord font among the plurality of option buttons OP2a respectively corresponding to a plurality of general fonts. In a case where the chord font is a handwriting like font, the user turns on the option button OP3 and turns on the option button OP3a corresponding to the chord font among the plurality of option buttons OP3a respectively corresponding to a plurality of handwriting like fonts.
When any of the option buttons OP2a or any of the option buttons OP3a is turned on, the chord font is designated. In a case where the analysis button AN is turned on in that state, the designation of the chord font is received by the font receiver 53 of
In a case where the chord font is apparent, the user designates the chord font. Thus, each chord character is accurately recognized. On the other hand, even in a case where the chord font is unknown, the chord font is automatically determined based on a reference character. Thus, degradation of recognition accuracy of each chord character is suppressed.
The chord character group in which each chord character has been recognized in this manner is referred to as a recognized chord character group. The chord correctness determination is carried out by the determiner 56 of
Normally, a chord name is represented by one or a plurality of characters representing chord roots (hereinafter referred to as a chord root character group) and one or a plurality of characters representing chord types (hereinafter referred to as a chord type character group). For example, in regard to the chord name “A♭maj7,” the chord root character group is “A♭” and the chord type character group is “maj7.” Normally, the chord root character group is notated before the chord type character group. However, a major triad chord or the like may be notated with only a chord root character group. For example, a C major triad may be notated with one character “C.” In this case, a chord type character group is not notated.
The chord root character group includes only one of the seven alphabets “A” to “G” representing the names of musical note or two characters including the one alphabet, and “#” or “♭” following the one alphabet.
The chord type character group includes various numerals, alphabets and symbols. A chord type character group including one character is “7” (seventh), “m” (a minor triad) or the like, a chord type character group including two characters is “M7” (a major seventh), “m7” (a minor seventh) or the like and a chord type character group including three or more characters is “dim” (diminished), “maj7” (a major seventh) or the like. Even in a case where chord type character groups represent the same chord type, different chord type character groups may be notated. For example, “maj7,” “Maj7,” “M7” and “Δ7” all represent a major seventh.
In the present example, the recognized chord character group is divided into a chord root character group and a chord type character group. Hereinafter, the chord root character group and the chord type character group included in the recognized chord character group are referred to as a recognized chord root character group and a recognized chord type character group, respectively.
For example, it is determined whether the second character of the recognized chord character group is “#” or “♭.” In a case where the second character is “#” or “♭,” the first character and the second character of the recognized chord character group are specified as the characters belonging to the recognized chord root character group, and the third character and a plurality of subsequent characters are specified as the characters belonging to the recognized chord type character group. In a case where the second character is neither “#” nor “♭,” the first character of the recognized chord character group is specified as the character belonging to the recognized chord root character group, and the second character or a plurality of subsequent characters are specified as the characters belonging to the recognized chord type character group.
In the example of
A character group not corresponding to the chord information may be erroneously extracted from the score image data. Such a character group is preferably removed from the character groups subject to the chord correctness determination. For example, a character group including only numerals such as measure numbers or a rehearsal mark may be erroneously extracted as a chord character group. Since being clearly different from a chord character group, a character group including only numerals is preferably removed in advance. Further, a rehearsal mark normally includes a rectangular or circular frame, and a numeral or alphabet arranged within the frame. Therefore, such a character group including a character arranged within a frame may be determined as a rehearsal mark and may be removed in advance. Alternatively, in a case where the ratio of the characters that cannot be used for the chord notation to the plurality of characters included in the extracted character group is higher than a predetermined value, the character group may be removed in advance.
In the present example, the chord notation rule CR defines a chord root rule in regard to a chord root and a chord type rule in regard to a chord type. In a case where the recognized chord root character group follows the chord root rule, and the recognized chord type character group follows the chord type rule, it is determined that the recognized chord character group follows the chord notation rule CR. However, in a case where the recognized chord character group includes only a chord root character group (in a case where a chord type character group is not included), when the recognized chord root character group follows the chord root rule, it may be determined that the recognized chord character group follows the chord notation rule CR.
The chord root rule defines that the first character of the chord root character group is any of the alphabets “A” to “G,” for example. In the example of
The chord type rule defines the list of correct chord type character groups, for example. In a case where the recognized chord type character group matches any of the chord type character groups included in the list, it is determined that the recognized chord type character group follows the chord type rule. In the example of
The chord type rule may define characters or combinations of characters that cannot be included in the correct chord type character groups. For example, “B,” “C” and the like cannot be included in the correct chord type character groups. Although “#,” “a,” “7” or the like alone can be included in the chord type character groups, combinations of characters such as “#7,” “#a,” or “a7” cannot be included in the chord type character groups. In a case where such a character or such a combination of characters that cannot be included in the correct chord type character groups is included in the recognized chord type character group, it is determined that the recognized chord type character group does not follow the chord type rule.
Further, in a case where a combination of characters that cannot be included in the correct chord type character groups is included in the recognized chord character group, when each of those characters alone can be included in the correct chord type character group, an incorrect character (a character that does not follow the chord notation rule) may be specified as described below. For example, in a case where it is assumed that “7” is incorrect in regard to the combination of characters “d7,” “dim” is a character group that starts with “d” and can be included in the chord type character group. However, “dim” is not a correction candidate for “d7” because the number of characters does not match that of “d7.” On the other hand, in a case where it is assumed that “d” is incorrect, “M7,” “Δ7,” “m7” and “−7” are the character groups that end with “7” and can be included in the chord type character groups. Since the number of characters in these character groups matches that of “d7,” they are correction candidates for “d7.” Therefore, it is determined that “d” is an incorrect character.
In a case where not following the chord notation rule CR, the recognized chord character group is corrected by the corrector 57 of
The chord root correction table ATa of
The chord type correction table ATb of
The chord root correction table ATa and the chord type correction table ATb are generated based on a result of erroneous recognition in the past, a result of simulation and so on. For example, it has been found empirically or by simulation that “A” may be erroneously recognized as “#” in regard to the chord root character groups. Therefore, it is defined in the chord root correction table ATa that “#” is to be corrected to “A.” A plurality of chord characters may be defined as correction candidates for one chord character that does not follow the chord notation rule. In that case, one chord character among the plurality of candidates is selectively used such that the chord character group follows the chord notation rule CR after the correction.
It is preferable that the chord root correction table ATa and the chord type correction table ATb are suitably updated. For example, in a case where a recognized chord character is not defined in the chord root correction table ATa or the chord type correction table ATb, the chord character and its corresponding correct chord character may be added to the chord root correction table ATa or the chord type correction table ATb. Alternatively, in a case where the result of correction with use of the chord root correction table ATa or the chord type correction table ATb is not appropriate, the chord root correction table ATa or the chord type correction table ATb may be revised based on the result.
When each chord character is recognized, a plurality of characters that are correction candidates may be acquired in regard to each chord character. In a case where a recognized chord character group includes a chord character that does not follow the chord notation rule CR, the recognized chord character group may be corrected with use of a character that follows the chord notation rule CR and is highly similar to the chord character to be corrected among the plurality of acquired characters.
In a case where a recognized chord character group includes “/” (slash), it may be determined that the recognized chord character group represents a slash chord. In this case, the recognized chord character group is divided into a numerator chord character group including one or a plurality of characters that are notated before “I” and a denominator chord character group including one or a plurality of characters that are notated after “/.” Further, the chord correctness determination and correction may be carried out similarly to the description above in regard to each of the numerator character group and the denominator character group.
In regard to each extracted chord character group, the position information is acquired by the position information acquirer 58 of
The position information is represented by the coordinate in a direction representing the progress of a music piece, for example. In the example of
Subsequently, a corresponding note is searched in regard to the chord character groups C1 to C3. For example, notes in a subject measure are detected, and the abscissa of each detected note is acquired. Further, the abscissa of each chord character group is compared with the abscissa of each note, and a note having the closest abscissa is specified in regard to each chord character group. In a case where the difference between the abscissa of each chord character group and the abscissa of the specified note is equal to or smaller than a predetermined threshold value, it is determined that the specified note corresponds to the chord character group. On the other hand, in a case where the difference between the abscissa of each chord character group and the abscissa of the specified note is larger than the threshold value, it is determined that there is no note corresponding to the chord character group.
In the example of
Meanwhile, the note having the abscissa closest to the chord character group C2 is n1. However, the difference between the abscissa of the chord character group C2 and the abscissa of the note n1 is larger than the threshold value. Therefore, it is determined that there is no note corresponding to the chord character group C2.
In a case where there is no note corresponding to any of the chord character groups, the time position is specified based on the positional relationship between the chord character group and a barline. Specifically, left and right barlines BL respectively corresponding to the start position and the end position of the subject measure are detected, and the position information of the two barlines BL is acquired. For example, the abscissa of each barline BL is acquired as the position information. The distance DS between the two detected barlines in the transverse direction corresponds to the length of one measure.
Then, as shown in the third field from the top in
Subsequently, it is determined which one of the unit segments A1 to A8 the chord character group C2 having no corresponding note corresponds to. For example, the plurality of virtual lines VL are moved in a leftward direction such that the chord character group C2 does not overlap with any of the virtual lines VL. The distance by which the plurality of virtual lines VL are moved is a half or less than a half of the length (DS/N) of one unit segment, for example. As a result, as shown in the fourth field from the top in
The chord information extracted in this manner is displayed on the screen of the display 6 by the display controller 60 of
The corrected chord character group may be displayed in a manner different from the uncorrected chord character group such that the user can distinguish the corrected chord character group from the uncorrected chord character group. In the example of
The information relating to all notes and barlines may be extracted from the score image data. Similarly, various other information such as repeat barlines and repeat symbols may be extracted from the score image data. In this case, the chord information can be displayed in various forms such as staff notation.
Next, the chord information extraction process using the chord information extraction method according to the present embodiment will be described.
First, the image data acquirer 51 acquires the score image data input by the score inputter 1 (step S1). Next, the character group extractor 52 extracts the image data of one or a plurality of chord character groups from the acquired score image data (step S2). Next, the position information acquirer 58 acquires the position information of each chord character group from the acquired score image data (step S3).
Next, the font receiver 53 determines whether a chord font has been designated by the user (step S4). For example, in the font designation screen DA of
In the step S8, the font information acquirer 55 acquires the chord font received in the step S5 or the font information representing the chord font determined in the step S7 (step S8). Next, the character group extractor 52 recognizes each chord character of the acquired chord character group based on the acquired font information (step S9).
Next, the determiner 56 determines whether the recognized chord character group follows the chord notation rule CR (step S10). In a case where the recognized chord character group does not follow the chord notation rule CR, the recognized chord character group is corrected by the corrector 57 based on the correction table AT to follow the chord notation rule CR (step S11).
Next, the time position specifier 59 specifies the time position of each chord information piece in the reference music piece based on the position information acquired in the step S3 (step S12). Next, the display 6 is controlled by the display controller 60 to display the chord information represented by the corrected chord character group (step S13). Thus, the chord information extraction process ends.
In the chord information extraction device 100 according to the above-mentioned embodiment, it is determined whether the chord character group extracted from the score image data follows the predetermined chord notation rule. In a case where not following the chord notation rule, the chord character group is corrected to follow the chord notation rule. Thus, even in a case where the chord character group is erroneously recognized, an appropriate chord character group that has been corrected to follow the chord notation rule can be acquired. Thus, the chord information can be accurately extracted from the score image data.
Further, in the above-mentioned embodiment, the extracted chord character group is divided into a chord root character group and a chord type character group. It is determined whether each of the chord root character group and the chord type character group are appropriate as the chord notation based on the predetermined chord root rule and chord type rule. Thus, the correctness determination of the chord character group can be carried out accurately.
Further, in the above-mentioned embodiment, the character, which does not follow the chord notation rule, among the extracted chord character group is corrected based on the predetermined correction table. Thus, the extracted chord character group can be corrected easily and appropriately.
Further, in the above-mentioned embodiment, each chord character of the chord character group is recognized based on the font information representing the font of the chord character group. Thus, each chord character is recognized with higher accuracy, so that the chord information can be extracted more accurately.
Further, in the above-mentioned embodiment, the time position of each chord information piece in the reference music piece is specified based on the position information of each chord character group in the music score. Thus, the extracted chord information can be displayed easily and efficiently, automatic accompaniment data can be generated easily and efficiently based on the extracted chord information, etc.
While the extracted chord information is displayed on the screen of the display 6 in the above-mentioned embodiment, another process may be carried out using the extracted chord information. For example, automatic accompaniment data for outputting automatic accompaniment may be generated based on the extracted chord information and its time position.
While the chord information is extracted from the score image data representing the staff notation in the above-mentioned embodiment, the chord information may be extracted from the score image data, including the chord information, of the music score in another form. For example, a tab score, a chord score or the like may be used as a reference score, and chord information may be extracted from score image data representing these scores.
While the chord information extraction device 100 includes the score inputter 1 in the above-mentioned embodiment, the score inputter 1 may be used as an external device of the chord information extraction device 100.
The chord information extraction device 100 may be applied to an electronic musical instrument such as an electronic keyboard musical instrument, and may be applied to another electronic apparatus such as a personal computer, a smartphone or a tablet terminal.
A chord information extraction device may comprise: a memory configured to store processor-executable instructions; and a processor configured to execute the processor-executable instructions stored in the memory to thereby realize: a character group extractor configured to extract a character group corresponding to chord information from score image data representing a music score; a determiner configured to determine whether the extracted character group follows a chord notation rule; and a corrector configured to, in a case where the determiner determines that the extracted character group does not follow the chord notation rule, correct the extracted character group such that the corrected extracted character group follows the chord notation rule.
While preferred embodiments of the present invention have been described above, it is to be understood that variations and modifications will be apparent to those skilled in the art without departing the scope and spirit of the present invention. The scope of the present invention, therefore, is to be determined solely by the following claims.
| Number | Name | Date | Kind |
|---|---|---|---|
| 4944022 | Yasujima | Jul 1990 | A |
| 5644652 | Bellegarda | Jul 1997 | A |
| 7642444 | Fujishima | Jan 2010 | B2 |
| 7960638 | Miyajima | Jun 2011 | B2 |
| 9040805 | Kobayashi | May 2015 | B2 |
| 9536508 | Okazaki | Jan 2017 | B2 |
| 9799315 | Hardi | Oct 2017 | B2 |
| 10013963 | Ka | Jul 2018 | B1 |
| 20060065100 | Funaki | Mar 2006 | A1 |
| 20080115656 | Sumita | May 2008 | A1 |
| 20150096433 | Watanabe | Apr 2015 | A1 |
| 20160148606 | Minamitaka | May 2016 | A1 |
| 20160210951 | Rutledge | Jul 2016 | A1 |
| 20190051275 | Ka | Feb 2019 | A1 |
| 20200202822 | Watanabe | Jun 2020 | A1 |
| 20200202823 | Watanabe | Jun 2020 | A1 |
| Number | Date | Country |
|---|---|---|
| S5886695 | Jun 1983 | JP |
| S63265377 | Nov 1988 | JP |
| H07200742 | Aug 1995 | JP |
| H1125229 | Jan 1999 | JP |
| H11161738 | Jun 1999 | JP |
| 2007122277 | May 2007 | JP |
| 4702139 | Jun 2011 | JP |
| 2015075575 | Apr 2015 | JP |
| Entry |
|---|
| Office Action issued in Japanese Appln. No. 2019-540227 dated Dec. 22, 2020. English machine translation provided. |
| International Search Report issued in Intl. Appln. No. PCT/JP2017/032379 dated Nov. 21, 2017. English translation provided. |
| Written Opinion issued in Intl. Appln. No. PCT/JP2017/032379 dated Nov. 21, 2017. |
| Number | Date | Country | |
|---|---|---|---|
| 20200202822 A1 | Jun 2020 | US |
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/JP2017/032379 | Sep 2017 | US |
| Child | 16804845 | US |
