This patent application claims priority, under 35 U.S.C. § 119, of Chinese Patent Application No. 201910655507.3, filed Jul. 19, 2019, entitled “METHOD, ELECTRONIC DEVICE AND COMPUTER PROGRAM PRODUCT FOR LOAD BALANCE.”
Embodiments of the present disclosure generally relate to a load management system, and more particularly, to a method, an electronic device and a computer program product for load balance.
Currently, there are various data protection products (such as Avamar vCP) for data backup in a cloud environment for cloud infrastructure tools (such as VMware vCloud Director) to protect data in applications on a cloud service platform. In the current data protection solutions, each data center on an organization on the cloud service platform is bounded to one of its corresponding back-end servers to enable data protection through backup. However, since each data center includes multiple applications and each application includes multiple virtual machines, the amount of data generated by the data center can be very large, resulting in a heavy load for the server for backup, or the amount of data can be small, resulting in a light load for the server. This may lead to an unbalanced load of multiple servers for backup.
Embodiments of the present disclosure design a solution of load balance.
In accordance with the first aspect, a method of load balance is provided. The method comprises: determining, in a round robin period, backup quota ratios for a plurality of servers used for data backup and associated with a cloud service platform; selecting, based on the backup quota ratios, one server from the plurality of servers; and in response to receiving a request for backup of data from an application on the cloud service platform, causing the backup of the data from the application to the selected server.
In accordance with the second aspect, an electronic device is provided, the electronic device comprises: at least one processor; and a memory coupled to the at least one processor, the memory including instructions stored therein, the instructions, when executed by the at least one processing unit, causing the device perform acts, the acts comprising: determining, in a round robin period, backup quota ratios for a plurality of servers used for data backup and associated with a cloud service platform; selecting, based on the backup quota ratios, one server from the plurality of servers; and in response to receiving a request for backup of data from an application on the cloud service platform, causing the backup of the data from the application to the selected server.
In accordance with the third aspect, a computer program product tangibly stored on a non-transitory computer readable medium is provided, the computer program product comprises machine executable instructions that, when executed, cause the machine to: determine, in a round robin period, backup quota ratios for a plurality of servers used for data backup and associated with a cloud service platform; select, based on the backup quota ratios, one server from the plurality of servers; and in response to receiving a request for backup of data from an application on the cloud service platform, cause the backup of the data from the application to the selected server.
The content described in the Summary is not intended to limit the key or essential features of the embodiments of the present disclosure, and is not intended to limit the scope of the disclosure. Other features of the present disclosure will be readily understood by the following description.
Through the following detailed description with reference to the accompanying drawings, the above and other objectives, features, and advantages of example embodiments of the present disclosure will become more apparent. Several example embodiments of the present disclosure will be illustrated by way of example but not limitation in the drawings in which:
In the various figures, the same or similar reference numerals indicate the same or similar components.
Hereinafter, various exemplary embodiments of the present disclosure will be described in detail with reference to the accompanying drawings. It should be noted that the figures and description are merely related to exemplary embodiments. It is to be noted that the alternative embodiments of the structures and methods disclosed herein are readily envisaged according to the following description, and may be used without departing from the principles of the disclosure.
It should be appreciated that description of those embodiments is merely to enable those skilled in the art to better understand and further implement example embodiments disclosed herein and is not intended for limiting the scope disclosed herein in any manner.
The backup of data generated on the cloud service platform to multiple servers on the backend is performed to protect the data on the platform.
As shown in
According to embodiments of the present disclosure, the present disclosure proposes a solution for balance load, in which an associated server for each application rather than for a data center is selected, based on backup quota ratios of a plurality of determined servers on the backend and load balance of a plurality of servers on the backend is achieved through round robin.
As shown in
It should be understood that
At block 310, the computing device 240 determines, in a round robin period, backup quota ratios for a plurality of servers 230 used for data backup and associated with a cloud service platform 210.
In some embodiments, the cloud service platform 210 includes an application 220 (220-1 . . . 220-N). In order to perform a backup of data generated in the application 220 on the cloud service platform 210 into the server 230, it is required to select a suitable server, for the application 220, from a plurality of servers. In the plurality of servers for backup on the backend, each server performs differently in terms of performance, capacity, load, and so on. In order to enable the server 230 to perform a backup of the data in the application 220 well, it is required to determine a suitable server based on the overall performance of the server.
In some embodiments, there are a plurality of applications 220-1 . . . 220-N on the cloud service platform 210 that need a data backup, that is, it is required to select a corresponding server for each of the plurality of applications 220-1 . . . 220-N. The computing device 240 can determine a suitable server based on the overall performance of a plurality of servers 230-1 . . . 230-L. For example, the server with the largest free capacity can be selected for the application 220. However, since the storage capacity of one server is limited, it is unrealistic to perform a backup of all of the applications to the server 230-1. As the backup of data from the application 220 to the server is performed, its overall performance will also change, and one of the other servers will become a server more suitable for backing up data. In other embodiments, each time a suitable application 230 is selected for an application 220, a suitable server is re-determined based on the overall performance of the server 230. In this way, although a suitable server for backing up data can be obtained in a timely updated manner, each update process consumes a large amount of computing resources, causing unnecessary loss to computing devices and components.
Therefore, based on the above situation, a round robin mechanism is needed when selecting an appropriate server for an application, the round robin mechanism being able to allocate, in turn, a plurality of servers to applications that needs data backup based on the backup quota ratios in one round robin period. Since the overall performance of the plurality of servers 230-1 . . . 230-L is different, the number of times each server is allocated with an application is different. The backup quota ratio indicates the proportional relationship of the number of times the plurality of servers 230-1 . . . 230-L are allocated with applications in one round robin period. For example, in a round robin period, based on the backup quota ratios, the computing device 240 performs one allocation for the server 230-1 each time when it performs two allocations for server 230-1. Thus, whenever an application on the cloud service platform 210 needs an associated server, the computing device 240 selects a suitable server for the application based on the backup quota ratios. The selected server can be a server with better overall performance, or with sub-optimal or worst overall performance. In this way, a server with better overall performance can be allocated with more applications, while a server with poor overall performance can be allocated with fewer applications. The allocation based on quota ratio can realize load balance of a plurality of servers while backing up data, avoiding the situation that some servers are overloaded and some servers are lightly loaded.
In some embodiments, the round robin period may be determined based on different factors, for example, based on a predetermined time period, every three days or every seven days can be considered as one round robin period and the backup quota ratio is updated after the round robin is ended. Or alternatively, for example, based on the number of times that the data backup operation is performed by at least some of the plurality of servers, for example, 2000 times, the time taken to perform the 2000 data backup operations is used as a round robin period. By empirically determining the round robin period, not only the load balance of a plurality of servers in the round robin period is achieved, but also the excessive update of the backup quota ratio, causing unnecessary waste of computing resources and unnecessary loss of system components, is avoided.
In some embodiments, the determination of the round robin period may also be based on the free capacity of at least some of the plurality of servers. When it is detected that the free capacity of the server is lower than the threshold, it means that the server does not have enough free capacity to continue the data backup. At that time, the duration of round robin currently having been performed is determined as the round robin period, and this round robin period is ended, available servers are re-determined and the backup quota ratios for a plurality of servers are recalculated. Or the determination of the round robin period may be based on the increasing rate of storage space occupancy of at least some of the plurality of servers. For example, it is detected that the increasing rate of storage space occupancy of the server is higher than the threshold, that is, the server performs a large amount of data backup in a short time, and the server changes significantly in terms of free space, space occupancy rate, and load. At this time, the duration of round robin can be determined as the round robin period and this round robin period is ended. By determining the round robin period based on the above manner, it is possible to avoid data backup failure due to insufficient free space of the server or late update on quota ratio due to data in a server increasing too fast.
It should be noted that the way to determine the round robin period above is merely an example and is not intended to limit the scope of the present disclosure.
At block 320, the computing device 240 selects, based on the backup quota ratios, one server from the plurality of servers 230-1 . . . 230-L.
In some embodiments, after backup quota ratios is obtained, when selecting a server for an application, based on the backup quota ratios, round robin of servers may be performed according to a certain policy, for example, a high quota ratio corresponds to a priority for allocation. In other embodiments, the round robin may not be performed according to a certain policy, as long as the quota ratio is met, for example, when selecting a server for an application, the counting function of the computing device 240 ensures the proportional relationship among the servers follows the backup quota ratio. That is, it is only required for the computing device 240 to select a server for the application based on the backup quota ratios, without being limited by the related policy of the selected server.
In some embodiments, a corresponding logical unit may be established for each back-end server to implement various logical functions and the logical unit has a one-to-one correspondence with the server. When establishing association between an application and a server, the application can be associated to a logical unit first. Then, a relationship between an application and a server can be established based on the relationship between the logical unit and the server. Associating an application directly to a logical unit rather than a storage entity helps to scale and perform various logical functions.
In some embodiments, after the server 230 is selected for the application 220 based on the backup quota ratios, the computing device 240 may also store an association between the application 220 and the server 230, for example, storing the association in a mapping table. For example, when the application 220-1 needs to backup data, the computing device 240 can directly look up the mapping table stored therein and determines the server 230-1 associated with application 220-1 and then backs up the data to the server.
It can be seen that in the process of selecting the associated server 230 for the application 220, the computing device 240 only needs to follow the determined backup quota ratio without being limited by the order of the selected servers.
At block 330, in response to receiving a request for backup of data from the application 220 on the cloud service platform 210, the computing device 240 causes the backup of the data from the application 220 to the selected server 230.
In some embodiments, when the application 220 on the cloud service platform 210 generates data and the data backup is required, a request for backup of the data is sent to the computing device 240, which, in response to the request, backs up the data to the corresponding database. In some embodiments, upon receiving a request for backup of the data, the computing device 240 looks up a server 230 associated with the application 220 sending the request based on a mapping table storing the association, then the data backup is performed.
In some embodiments, after a round robin period, the backup quota ratios of a plurality of servers may be updated for subsequent data backup for an application. As the applications continue their data backup to the corresponding server, the metadata of the server's attributes, such as the number of customer, space, load, are changing, which means that quota ratio of the server for round robin is also changing. After the round robin period, the server's metadata is re-acquired to update the backup quota ratio of a plurality of servers, for allocating applications to a plurality of servers subsequent. Updating the quota ratio of a server in a timely manner helps to achieve load balance of the server.
In summary, the method 300 enables load balance of the plurality of servers 230 as well as data backup, by determining the backup quota ratio of the server 230 and selecting a suitable server 230 for the application 220 based on the backup quota ratio, thereby solving the problem that some servers are overloaded and some are less loaded. Additionally, the above process is completed by the computing device rather than by a backup administrator, which potentially avoids resources waste.
At block 410, the computing device 240 obtains metadata of a plurality of servers 230, which describe attributes of the plurality of servers 230.
In some embodiments, the attributes of the server include, but are not limited to, the number of available client, free capacity, performance of a server rack, a load index, backup window duration, an increasing rate of storage space occupancy. The above attributes are usually able to characterize the overall performance of the server used for data backup.
In some embodiments, typically the client has a suggested value for the number of clients. The number of available client can be obtained by subtracting the number of registered clients from the suggested value. The more the number of available clients is, the higher priority the server has in terms of allocation.
In some embodiments, a server with more free capacity has a higher priority, and when the free capacity of the server is less than a threshold, no more applications are allocated to the server.
In some embodiments, the total rack size of the server is used as a measure of performance of a server rack. The larger the rack size is, the better the performance of the server rack is and the higher allocation priority it has.
In some embodiments, the load index represents load of the server, for example, the load condition of the server may be described by the total number of tasks that the server has performed in the past period of time; if the newly enabled server runs for less than one week, median or the average or the specified value is taken for calculation; the less the load is the higher priority the server has.
In some embodiments, the server performs maintenance tasks at a scheduled time each day, checking the system to ensure data consistency, in that duration, backup tasks are typically not performed, so servers with longer backup window durations have higher allocation priority.
In some embodiments, the increasing rate of storage occupancy indicates the increasing velocity of the occupied storage space of the server over a period of time. Generally, larger increasing rate of storage occupancy means that a large amount of storage space of the server is used in a short time period. The smaller the increasing rate of the storage occupancy is, the higher allocation priority the server has.
In some embodiments, for example, the following four attributes may be selected to measure the overall performance of a plurality of servers for backup: the number of available clients, free capacity, performance of server rank, and load index. The related metadata of the plurality of servers for describing the above four attributes are respectively obtained, as shown in Table 1.
Taking the server A as an example, the number of available clients of server A is 3800, the free capacity is 900 GB, the performance of the server rank is represented by the total rack size of 1.8 T, and the load index is represented by 3,500 tasks performed in the past period of time. The metadata in Table 1 above is used to describe the overall performance of servers A, B, C, and D.
At block 420, with the metadata as input, the backup quota ratios are determined based on a statistical model that is trained to describe the association between different values of the metadata and different backup quota ratios.
In some embodiments, the statistical model may select any model that can describe the association between different values of the metadata and different backup quota ratios. In this embodiment, a statistical model established based on an analytic hierarchy process is selected as an example. The core concept of analytic hierarchy process is to always compare multiple factors in pairs, which can realize a hierarchical qualitative and quantitative analysis to a decision. It is especially suitable for obtaining quota ratio of different servers between each other in this embodiment. In this example, the statistical model based on the analytic hierarchy method is defined as follows.
First, the mutual importance relationship between pairs of the selected four attributes is determined, where the number 1 indicates equal importance, the number 3 indicates that one of them is slightly more important than the other, and the number 5 indicates that one of them is moderately more important than the other, the number 7 indicates that one of them is extremely more important than the other, and the number 9 indicates that one of them is significantly important compared to the other. The mutual importance relationship between pairs of the four attributes in this example is shown in Table 2.
Taking the comparison result between the number of available clients and the free capacity as an example, the importance of the available clients is 1, and the importance of the free capacity is 9, so the value of the second column in the first row of the table is 1/9 and value of the first column in the second row is 9. Taking the performance of the server rack and load index as an example, the importance of the performance of the server rack is 1, and the importance of the load index is 3, so the value of fourth column in the third row is 1/3, and the value of the third column in the fourth row is 3. The standard matrix Ac of the statistical model based on the analytic hierarchy process in this example can be obtained:
Secondly, the maximum eigenvalue λmax is calculated, and any commonly used method for calculating the maximum eigenvalue can be employed. In this embodiment, the summation method is employed, and the formula is as follows:
Where n represents the feature size and W represents the feature vector. In some embodiments, the feature vector W can be calculated by normalizing the elements of Ac by columns, adding the elements of Ac by rows, normalizing the added row vectors to finally obtain W. Further, the maximum eigenvalue λmax can be calculated. In this example described in connection with Table 2, λmax=4.17.
According to the maximum eigenvalue and the dimension coefficient index RI, the standard weight Wmax of the statistical model can be obtained, wherein the dimension coefficient index RI is a given value in the analytic hierarchy process, as shown in Table 3.
In this embodiment, the matrix dimension is 4, and the corresponding RI value is 0.9; then the standard weight Wmax can be obtained based on the maximum eigenvalue Wmax and the RI value:
That is, in the calculation model based on the analytic hierarchy process in the present embodiment, the standard weight values of the four attributes are: number of registered client: 0.04, free capacity: 0.56, performance of rack: 0.13, and load index: 0.27.
Additionally or alternatively, the reliability of the statistical model can also be verified by calculating a one-time ratio. Specifically, the one-time index CI is first calculated as follows:
The one-off ratio is determined according to the ratio of CI and the dimension coefficient index RI of the analytic hierarchy process:
A value of CR less than 0.1 indicates that the model is reliable, otherwise, the model is not reliable. In this embodiment, CR=0.0647, and the calculation model is reliable.
The above process completed the training of the statistical model based on the analytic hierarchy process, and the weight allocation result of the four attributes of the model is obtained.
The metadata in Table 1 is used as input to the statistical model to calculate the backup quota ratios.
The hierarchy setting of the attribute of the number of available clients in terms of importance is shown in Table 4a. For the attribute of the number of available clients, the number of available clients of the server is firstly determined based on the suggested value of the number of server clients and the number of registered client; then the hierarchy relationship of importance of every two servers in terms of each of the four attributes is determined. For example, if the number of available clients of a server A is 1200 more than that of a server B, the importance value of A relative to B in terms of the number of available clients is 1/5, and the importance value of B relative to A is 5, as shown in Table 4b.
where W1 is the calculated weight allocation of the four servers in terms of the attribute of the number of available clients.
Similarly, the weight allocation of the four servers in terms of the other three attributes is calculated.
Table 5a shows the hierarchy settings of the four servers in terms of free capacity, and Table 5b is the table of importance in terms of free capacity, with W2 being the corresponding weight allocation.
Table 6a shows the hierarchy settings of the four servers in terms of performance of a server rack, and Table 6b is the table of importance in terms of performance of a server rack, with W3 being the corresponding weight allocation.
Table 7a shows the hierarchy settings of the four servers in terms of load index, and Table 7b is the table of importance in terms of the load index, with W4 being the corresponding weight allocation.
The weight values of the four servers in terms of the four attributes, namely, the number of registered clients, free capacity, performance of the server rack, and load index, are obtained therefrom, resulting in a weight matrix Wtotal.
Wtotal=|W1W2W3W4| (6)
The final statistical results are further obtained based on the weight values of the four attributes, with the number of registered clients being 0.04, free capacity being 0.56, performance of the server rack being 0.13, and load index being 0.27. The calculation process is as shown in Table 8.
Backup quota ratios in a round robin period are determined based on statistical results from statistical models. Continuing with the above embodiment as an example, the calculated weight values of the four servers are as follows: A: 0.18, B: 0.30, C: 0.29, and D: 0.21. The above results can be rounded up and simplified, resulting in the backup quota ratios of the four servers as 18:30:29:21. In the process of determining the server for the application, the above proportional relationship needs to be followed, that is, when 18 applications are allocated for the server A, 30 applications are allocated for the server B, 29 applications are allocated for the server C, and 21 applications are allocated for the server D. The method of determining the backup quota ratio based on the weight values of the servers described above is only exemplary, other conventional methods can also be used. For example, the above weights can be rounded up and rounded off, resulting in backup quota ratios of 2:3:3:2.
The following components in the device 500 are connected to the I/O interface 505: an input 506 such as a keyboard, a mouse and the like; an output unit 507 including various kinds of displays and a loudspeaker, etc.; a memory unit 508 including a magnetic disk, an optical disk, and etc.; a communication unit 509 including a network card, a modem, and a wireless communication transceiver, etc. The communication unit 509 allows the device 500 to exchange information/data with other devices through a computer network such as the Internet and/or various kinds of telecommunications networks.
Various processes and processing described above, e.g., the methods 300 and 400, may be executed by the processing unit 501. For example, in some embodiments, the methods 300 and 400 may be implemented as a computer software program that is tangibly embodied on a machine readable medium, e.g., the storage unit 508. In some embodiments, part or all of the computer programs may be loaded and/or mounted onto the device 500 via ROM 502 and/or communication unit 509. When the computer program is loaded to the RAM 503 and executed by the CPU 501, one or more steps of the methods 300 and 400 as described above may be executed.
The present disclosure may be a method, a device, a system, and/or a computer program product. The computer program product may include a computer readable storage medium (or media) having computer readable program instructions thereon for causing a processor to carry out aspects of the present disclosure.
The computer readable storage medium can be a tangible device that can retain and store instructions for use by an instruction execution device. The computer readable storage medium may be, for example, but is not limited to, an electronic storage device, a magnetic storage device, an optical storage device, an electromagnetic storage device, a semiconductor storage device, or any suitable combination of the foregoing. A non-exhaustive list of more specific examples of the computer readable storage medium includes the following: a portable computer diskette, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or Flash memory), a static random access memory (SRAM), a portable compact disc read-only memory (CD-ROM), a digital versatile disk (DVD), a memory stick, a floppy disk, a mechanically encoded device such as punch-cards or raised structures in a groove having instructions recorded thereon, and any suitable combination of the foregoing. A computer readable storage medium, as used herein, is not to be construed as being transitory signals per se, such as radio waves or other freely propagating electromagnetic waves, electromagnetic waves propagating through a waveguide or other transmission media (e.g., light pulses passing through a fiber-optic cable), or electrical signals transmitted through a wire.
Computer readable program instructions described herein can be downloaded to respective computing/processing devices from a computer readable storage medium or to an external computer or external storage device via a network, for example, the Internet, a local area network, a wide area network and/or a wireless network. The network may comprise copper transmission cables, optical transmission fibers, wireless transmission, routers, firewalls, switches, gateway computers and/or edge servers. A network adapter card or network interface in each computing/processing device receives computer readable program instructions from the network and forwards the computer readable program instructions for storage in a computer readable storage medium within the respective computing/processing device.
Computer readable program instructions for carrying out operations of the present disclosure may be assembler instructions, instruction-set-architecture (ISA) instructions, machine instructions, machine dependent instructions, microcode, firmware instructions, state-setting data, or either source code or object code written in any combination of one or more programming languages, including an object oriented programming language such as Smalltalk, C++ or the like, and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The computer readable program instructions may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of network, including a local area network (LAN) or a wide area network (WAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider). In some embodiments, electronic circuitry including, for example, programmable logic circuitry, field-programmable gate arrays (FPGA), or programmable logic arrays (PLA) may execute the computer readable program instructions by utilizing state information of the computer readable program instructions to personalize the electronic circuitry, in order to perform aspects of the present disclosure.
Aspects of the present disclosure are described herein with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems), and computer program products according to embodiments of the disclosure. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer readable program instructions.
These computer readable program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks. These computer readable program instructions may also be stored in a computer readable storage medium that can direct a computer, a programmable data processing apparatus, and/or other devices to function in a particular manner, such that the computer readable storage medium having instructions stored therein comprises an article of manufacture including instructions which implement aspects of the function/act specified in the flowchart and/or block diagram block or blocks.
The computer readable program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other device to cause a series of operational steps to be performed on the computer, other programmable apparatus or other device to produce a computer implemented process, such that the instructions which execute on the computer, other programmable apparatus, or other device implement the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present disclosure. In this regard, each block in the flowchart or block diagrams may represent a module, snippet, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reversed order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The descriptions of the various embodiments of the present disclosure have been presented for purposes of illustration, but are not intended to be exhaustive or limited to the embodiments disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the described embodiments. The terminology used herein was chosen to best explain the principles of the embodiments, the practical application or technical improvement over technologies found in the marketplace, or to enable others of ordinary skill in the art to understand the embodiments disclosed herein.
Number | Date | Country | Kind |
---|---|---|---|
201910655507.3 | Jul 2019 | CN | national |
Number | Name | Date | Kind |
---|---|---|---|
20050114281 | Riggs | May 2005 | A1 |
20060209682 | Filsfils | Sep 2006 | A1 |
20070180314 | Kawashima | Aug 2007 | A1 |
20130054536 | Sengupta | Feb 2013 | A1 |
20160026542 | Vasseur | Jan 2016 | A1 |
20160164787 | Roach | Jun 2016 | A1 |
20170132089 | Roehrsheim | May 2017 | A1 |
20170270010 | Formato | Sep 2017 | A1 |
20180232162 | Bode | Aug 2018 | A1 |
20180307437 | Suzuki | Oct 2018 | A1 |
Number | Date | Country | |
---|---|---|---|
20210019188 A1 | Jan 2021 | US |