Patent Application
20190196989
Embodiments of the present disclosure relate to the field of computers, and in particular, to a method, an apparatus, and a system for accessing a memory device.
A memory system is one of most important components in a computer system. A conventional memory system uses a synchronous double data rate (DDR) protocol to exchange data. A fixed read/write latency is used in the synchronous DDR protocol, and a latency, a granularity, and an order for access are all fixed. Therefore, in the synchronous DDR protocol, only data such as data content and a requested address needs to be transmitted to complete an access action.
As different memory media emerge, the synchronous DDR protocol can no longer adapt to all memory media, especially in a hybrid memory system. Different memory media in the hybrid memory system have different access latencies. Therefore, a requirement of the system cannot be met using the DDR protocol using a fixed latency. Asynchronous access is exactly a memory protocol used to resolve such a problem. In asynchronous access, access latencies are different in different memory access. Therefore, in addition to data content and a requested address, information such as a latency identifier, an access granularity, and a request identifier further needs to be transmitted. Transmitting the information occupies a large amount of bus bandwidth, resulting in increased load on the memory system.
In view of this, the present disclosure discloses a method, an apparatus, and a system for accessing a memory device method to implement asynchronous access to a memory device.
According to a first aspect, this application provides a system for accessing a memory device, where the system includes a memory controller and a memory device, the memory device includes a medium controller, a memory, and a buffer, and the medium controller is configured to receive a plurality of access requests from the memory controller, read, from the memory, data requested by each access request, and write the data into the buffer. The memory controller is configured to, after sending at least one access request to the medium controller, send a query request to the medium controller, where the query request is used to query whether data has been written into the buffer. The medium controller is configured to determine, based on the query request, whether data has been written into the buffer. If data has been written into the buffer, the medium controller is further configured to send the data that has been written into the buffer to the memory controller.
In a scenario in which storage media of a memory device have different access latencies, the memory controller actively sends a query request to the medium controller in order to implement an operation of accessing the memory device without adding an additional signal cable. After the medium controller receives the query request, if data has been written into the buffer, the medium controller may consider the query request as one instruction for reading the buffer, and return the data that has been written into the buffer to the memory controller.
With reference to the first aspect, in a first possible implementation of the first aspect, after determining that data has been written into the buffer, the medium controller is further configured to send a response message to the memory controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”, the memory controller is further configured to trigger a buffer read request based on the response message, and send the buffer read request to the medium controller, where the buffer read request is used to read the data that has been written into the buffer, and the medium controller is further configured to receive the buffer read request, read, based on the buffer read request, the data that has been written into the buffer, and trigger the operation of sending the data that has been written into the buffer to the memory controller.
The query request is used to query whether data has been written into the buffer, and the memory controller uses the buffer read request to implement an operation of reading the buffer in order to further reduce complexity of a storage protocol. Further, an amount of data in the buffer may be carried in the response message, and the memory controller may trigger the buffer read request based on the amount of data in the buffer. For example, if only one fixed-size piece of data can be read from the buffer once, and if the response message indicates that there are currently M pieces of data in the buffer, the memory controller may trigger M buffer read requests. The one piece of data means data that can be requested by one access request.
With reference to either the first aspect or the foregoing possible implementation of the first aspect, in a second possible implementation of the first aspect, the memory controller is further configured to send the query request to the medium controller based on a preset query period.
Further, the preset query period may be further dynamically adjusted based on a busy degree of an interconnection channel between the memory controller and the memory device. For example, when a bus or the channel is relatively busy, the preset query period may be prolonged to reduce query request sending frequency, and reduce occupancy of the bus or the channel. When a bus or the channel is relatively idle, the preset query period may be shortened to increase query request sending frequency, such that the memory controller can read to-be-accessed data as soon as possible.
With reference to any one of the first aspect and the foregoing possible implementations of the first aspect, in a third possible implementation of the first aspect, the plurality of access requests sent by the memory controller have at least two priorities, the memory device includes at least two buffers, and each buffer corresponds to one priority, and a query period of an access request is determined based on a priority of the access request, and access requests having different priorities correspond to different query periods.
Access requests of a computer system may have a plurality of priorities. Access requests having different priorities may be managed by disposing a plurality of buffers in the memory device. Each buffer corresponds to an access request of one priority. A query period of a corresponding query request is determined based on a priority of the access request. Therefore, a proper compromise can be made between a data return time and occupancy of an interconnection channel. For an access request having a high priority, a query period for sending the query request may be shorter, to ensure that important data is preferentially returned to the memory controller.
With reference to any one of the first aspect and the foregoing possible implementations of the first aspect, in a fourth possible implementation of the first aspect, the query request sent by the memory controller to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request.
When the memory controller queries a data write status of a specific buffer, the query request needs to carry indication information of the queried buffer. The indication information may be address information of the buffer, address information of a status register recording the data write status of the buffer, or the like.
With reference to any one of the first aspect and the foregoing possible implementations of the first aspect, in a fifth possible implementation of the first aspect, to ensure normal data communication, the memory controller is further configured to, before sending the query request to the medium controller, determine that an interconnection channel between the memory controller and the medium controller is in an idle state.
The query request is sent only when the interconnection channel is idle in order to prevent the query request from affecting another normal read/write operation.
With reference to any one of the first aspect and the foregoing possible implementations of the first aspect, in a sixth possible implementation of the first aspect, the memory device further includes a status register, and the status register is configured to record the data write status of the buffer, and when determining whether data has been written into the buffer, the medium controller is further configured to read the data write status of the buffer that is recorded in the status register, and determine, based on the data write status of the buffer, whether data has been written into the buffer.
After writing the to-be-accessed data into the buffer, the medium controller updates the status register, and after reading a value in the status register, performs a reset operation on the status register.
With reference to any one of the first aspect and the foregoing possible implementations of the first aspect, in a seventh possible implementation of the first aspect, because the to-be-accessed data may be returned out of order in an asynchronous access manner, the medium controller is further configured to, when sending the data that has been written into the buffer to the memory controller, send identification information to the memory controller, where the identification information is used to indicate an access request corresponding to the sent data.
Further, the identification information may be a request identifier (also referred to as ID), and the request ID may be carried in an access request sent by the memory controller. Alternatively, a synchronous request counter may be separately maintained on both the memory controller side and the medium controller side, and a value of the request counter is used to represent the request ID.
According to a second aspect, this application provides a method for accessing a memory device, where a memory device includes a medium controller, a memory, and a buffer, and the medium controller is configured to receive a plurality of access requests from a memory controller, read, from the memory, data requested by each access request, and write the data into the buffer, and the method includes sending, by the memory controller, at least one access request to the medium controller, sending, by the memory controller, a query request to the medium controller, where the query request is used to query whether data has been written into the buffer, and receiving, by the memory controller, the data that has been written into the buffer and that is sent by the medium controller.
In a scenario in which storage media of a memory device have different access latencies, the memory controller actively sends a query request to the medium controller in order to implement an operation of accessing the memory device without adding an additional signal cable. The query request may be considered as one instruction for reading the buffer. If data has been written into the buffer, the memory controller may directly receive the data that has been written into the buffer and that is sent by the medium controller.
With reference to the second aspect, in a first possible implementation of the second aspect, after sending, by the memory controller, a query request to the medium controller, the method further includes receiving, by the memory controller, a response message from the medium controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”, and sending, by the memory controller, a buffer read request to the medium controller based on the response message, where the buffer read request is used to read the data that has been written into the buffer.
The query request is used to query whether data has been written into the buffer, and the memory controller uses the buffer read request to implement an operation of reading the buffer in order to further reduce complexity of a storage protocol. Further, an amount of data in the buffer may be carried in the response message, and the memory controller may trigger the buffer read request based on the amount of data in the buffer.
With reference to either the second aspect or the foregoing possible implementation of the second aspect, in a second possible implementation of the second aspect, the sending, by the memory controller, a query request to the medium controller includes sending, by the memory controller, the query request to the medium controller based on a preset query period.
Further, the preset query period may be further dynamically adjusted based on a busy degree of an interconnection channel between the memory controller and the memory device. For example, when a bus or the channel is relatively busy, the preset query period may be prolonged to reduce query request sending frequency, and reduce occupancy of the bus or the channel. When a bus or the channel is relatively idle, the preset query period may be shortened to increase query request sending frequency, such that the memory controller can read to-be-accessed data as soon as possible.
With reference to any one of the second aspect and the foregoing possible implementations of the second aspect, in a third possible implementation of the second aspect, the plurality of access requests sent by the memory controller have at least two priorities, the memory device includes at least two buffers, and each buffer corresponds to one priority, and a query period of an access request is determined based on a priority of the access request, and access requests having different priorities correspond to different query periods.
Access requests of a computer system may have a plurality of priorities. Access requests having different priorities may be managed by disposing a plurality of buffers in the memory device. Each buffer corresponds to an access request of one priority. A query period of a corresponding query request is determined based on a priority of the access request. A proper compromise can be made between a data return time and occupancy of an interconnection channel.
With reference to any one of the second aspect and the foregoing possible implementations of the second aspect, in a fourth possible implementation of the second aspect, the query request sent by the memory controller to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request.
When the memory controller queries a data write status of a specific buffer, the query request needs to carry indication information of the queried buffer. The indication information may be address information of the buffer, address information of a status register recording the data write status of the buffer, or the like.
With reference to any one of the second aspect and the foregoing possible implementations of the second aspect, in a fifth possible implementation of the second aspect, to ensure normal data communication, before sending, by the memory controller, a query request to the medium controller, the method further includes determining, by the memory controller, that an interconnection channel between the memory controller and the medium controller is in an idle state.
The query request is sent only when the interconnection channel is idle in order to prevent the query request from affecting another normal read/write operation.
With reference to any one of the second aspect and the foregoing possible implementations of the second aspect, in a sixth possible implementation of the second aspect, the method further includes receiving, by the memory controller, identification information sent by the medium controller, where the identification information is used to indicate an access request corresponding to the received data.
Further, the identification information may be a request ID, and the request ID may be carried in an access request sent by the memory controller. Alternatively, a synchronous request counter may be separately maintained on both the memory controller side and the medium controller side, and a value of the request counter is used to represent the request ID.
According to a third aspect, this application provides a readable medium, including an executable instruction, where when a processor of a memory controller executes the executable instruction, the memory controller performs the method according to any one of the second aspect and the possible implementations of the second aspect.
According to a fourth aspect, this application provides a memory controller, including a processor, a memory, and a bus, where the memory is configured to store an executable instruction, the processor is connected to the memory using the bus, and when the memory controller runs, the processor executes the executable instruction stored in the memory, such that the memory controller performs the method according to any one of the second aspect and the possible implementations of the second aspect.
According to a fifth aspect, this application provides a method for accessing a memory device, where a memory device includes a medium controller, a memory, and a buffer, and the medium controller is configured to receive a plurality of access requests from a memory controller, read, from the memory, data requested by each access request, and write the data into the buffer, and the method includes receiving, by the medium controller, at least one access request from the memory controller, receiving, by the medium controller, a query request from the memory controller, where the query request is used to query whether data has been written into the buffer, determining, by the medium controller based on the query request, whether data has been written into the buffer, and if data has been written into the buffer, sending, by the medium controller, the data that has been written into the buffer to the memory controller.
In a scenario in which storage media of a memory device have different access latencies, the medium controller receives a query request actively sent by the memory controller in order to implement an operation of accessing the memory device without adding an additional signal cable. After the medium controller receives the query request, if data has been written into the buffer, the medium controller may consider the query request as one instruction for reading the buffer, and return the data that has been written into the buffer to the memory controller.
Optionally, the query request sent by the memory controller to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request. When the memory controller queries a data write status of a specific buffer, the query request needs to carry indication information of the queried buffer. The indication information may be address information of the buffer, address information of a status register recording the data write status of the buffer, or the like.
With reference to the fifth aspect, in a first possible implementation of the fifth aspect, after the medium controller determines that data has been written into the buffer, the method further includes sending, by the medium controller, a response message to the memory controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”, and receiving, by the medium controller, a buffer read request from the memory controller, where the buffer read request is used to read the data that has been written into the buffer.
The query request is used to query whether data has been written into the buffer, and the buffer read request is used to implement an operation of reading the buffer in order to further reduce complexity of a storage protocol. Further, an amount of data in the buffer may be carried in the response message, and the memory controller may trigger the buffer read request based on the amount of data in the buffer. For example, if only one fixed-size piece of data can be read by one buffer read request, and if the response message indicates that there are currently M pieces of data in the buffer, the memory controller may trigger M buffer read requests. The one piece of data means data that can be requested by one access request.
With reference to either the fifth aspect or the foregoing possible implementation of the fifth aspect, in a second possible implementation of the fifth aspect, the memory device further includes a status register, and the status register is configured to record the data write status of the buffer, and determining, by the medium controller, whether data has been written into the buffer includes reading, by the medium controller, the data write status of the buffer that is recorded in the status register, and determining, based on the data write status of the buffer, whether data has been written into the buffer.
After writing the to-be-accessed data into the buffer, the medium controller updates the status register, and after reading a value in the status register, performs a reset operation on the status register.
With reference to any one of the fifth aspect and the foregoing possible implementations of the fifth aspect, in a third possible implementation of the fifth aspect, the method further includes sending, by the medium controller, identification information to the memory controller, where the identification information is used to indicate an access request corresponding to the sent data.
Further, the identification information may be a request ID, and the request ID may be carried in an access request sent by the memory controller. Alternatively, a synchronous request counter may be separately maintained on both the memory controller side and the medium controller side, and a value of the request counter is used to represent the request ID.
According to a sixth aspect, this application provides a readable medium, including an executable instruction, where when a processor of a medium controller executes the executable instruction, the medium controller performs the method according to any one of the fifth aspect and the possible implementations of the fifth aspect.
According to a seventh aspect, this application provides a medium controller, including a processor, a memory, and a bus, where the memory is configured to store an executable instruction, the processor is connected to the memory using the bus, and when the medium controller runs, the processor executes the executable instruction stored in the memory, such that the medium controller performs the method according to any one of the fifth aspect and the possible implementations of the fifth aspect.
According to an eighth aspect, this application provides an apparatus for accessing a memory device, a memory device includes a medium controller, a memory, and a buffer, and the medium controller is configured to receive a plurality of access requests from the apparatus, read, from the memory, data requested by each access request, and write the data into the buffer, and the apparatus includes a sending unit configured to send at least one access request to the medium controller, where the sending unit is further configured to send a query request to the medium controller, where the query request is used to query whether data has been written into the buffer, and a receiving unit configured to receive the data that has been written into the buffer and that is sent by the medium controller.
With reference to the eighth aspect, in a first possible implementation of the eighth aspect, after the sending unit sends the query request to the medium controller, the receiving unit is further configured to receive a response message from the medium controller, where the response message is used to indicate a data write status of the buffer, and the sending unit is further configured to send a buffer read request to the medium controller based on the response message, where the buffer read request is used to read the data that has been written into the buffer.
With reference to either the eighth aspect or the foregoing possible implementation of the eighth aspect, in a second possible implementation of the eighth aspect, when sending the query request to the medium controller, the sending unit is further configured to send the query request to the medium controller based on a preset query period.
With reference to any one of the eighth aspect and the foregoing possible implementations of the eighth aspect, in a third possible implementation of the eighth aspect, the plurality of access requests of the apparatus have at least two priorities, the memory device includes at least two buffers, and each buffer corresponds to one priority, and a query period of an access request is determined based on a priority of the access request, and access requests having different priorities correspond to different query periods.
With reference to any one of the eighth aspect and the foregoing possible implementations of the eighth aspect, in a fourth possible implementation of the eighth aspect, the query request sent by the sending unit to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request.
With reference to any one of the eighth aspect and the foregoing possible implementations of the eighth aspect, in a fifth possible implementation of the eighth aspect, the apparatus further includes a determining unit, and before the sending unit sends the query request to the medium controller, the determining unit is configured to determine that an interconnection channel between a memory controller and the medium controller is in an idle state.
With reference to any one of the eighth aspect and the foregoing possible implementations of the eighth aspect, in a sixth possible implementation of the eighth aspect, the receiving unit is further configured to receive identification information sent by the medium controller, where the identification information is used to indicate an access request corresponding to the data received by the receiving unit.
The eighth aspect is an apparatus implementation of the memory controller corresponding to the method in the second aspect. Therefore, the description in any one of the second aspect and the possible implementations of the second aspect is correspondingly applicable to any one of the eighth aspect and the possible implementations of the eighth aspect. Details are not described herein again.
According to a ninth aspect, this application provides an apparatus for accessing a memory device, where a memory device includes the apparatus, a memory, and a buffer, and the apparatus is configured to receive a plurality of access requests from a memory controller, read, from the memory, data requested by each access request, and write the data into the buffer, and the apparatus includes a receiving unit configured to receive at least one access request from the memory controller, where the receiving unit is further configured to receive a query request from the memory controller, where the query request is used to query whether data has been written into the buffer, a determining unit configured to determine, based on the query request, whether data has been written into the buffer, and a sending unit configured to, if the determining unit determines that data has been written into the buffer, send the data that has been written into the buffer to the memory controller.
Optionally, the query request further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request. When the memory controller queries a data write status of a specific buffer, the query request needs to carry indication information of the queried buffer. The indication information may be address information of the buffer, address information of a status register recording the data write status of the buffer, or the like.
With reference to either the ninth aspect or the foregoing possible implementation of the ninth aspect, in a second possible implementation of the ninth aspect, after the determining unit determines that data has been written into the buffer, the sending unit is further configured to send a response message to the memory controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”, and the receiving unit is further configured to receive a buffer read request from the memory controller, where the buffer read request is used to read the data that has been written into the buffer.
With reference to any one of the ninth aspect and the foregoing possible implementations of the ninth aspect, in a third possible implementation of the ninth aspect, the memory device further includes a status register, and the status register is configured to record the data write status of the buffer, and the determining unit is further configured to read the data write status of the buffer that is recorded in the status register, and determine, based on the data write status of the buffer, whether data has been written into the buffer.
With reference to any one of the ninth aspect and the foregoing possible implementations of the ninth aspect, in a fourth possible implementation of the ninth aspect, the sending unit is further configured to send identification information to the memory controller, where the identification information is used to indicate an access request corresponding to the data sent by the sending unit.
The ninth aspect is an apparatus implementation of the medium controller corresponding to the method in the fifth aspect. Therefore, the description in any one of the fifth aspect and the possible implementations of the fifth aspect is correspondingly applicable to any one of the ninth aspect and the possible implementations of the ninth aspect. Details are not described herein again.
According to a tenth aspect, this application provides a memory device, where the memory device includes a memory, a buffer, and the apparatus in any one of the ninth aspect and the possible implementations of the ninth aspect.
According to the technical solutions disclosed in the present disclosure, in a scenario in which storage media of a memory device have different access latencies, the memory controller actively sends a query request to the medium controller in order to implement an operation of accessing the memory device without adding an additional signal cable. In comparison with an asynchronous protocol, in the embodiments of the present disclosure, less signaling is used to implement access to a hybrid memory system. Moreover, because the query request may be implemented using a read instruction in a storage protocol, the embodiments of the present disclosure have higher compatibility with various storage protocols.
To describe the technical solutions in some of the embodiments of the present disclosure more clearly, the following briefly describes the accompanying drawings describing some of the embodiments. The accompanying drawings in the following description show merely some embodiments of the present disclosure, and persons of ordinary skill in the art may still derive another drawing from these accompanying drawings without creative efforts.
The following describes the embodiments of the present disclosure with reference to the accompanying drawings.
During memory access, if an access latency of a memory medium is unknown, for example, because different memory media in a hybrid memory system have different access latencies, a requirement of the system cannot be met using a synchronous DDR protocol using a fixed latency. Because a dynamic random access memory (DRAM) and a non-volatile memory chip are integrated in a non-volatile dual in-line memory module (NVDIMM), the conventional DDR protocol cannot meet the requirement of the system.
If an asynchronous access protocol is used, latencies are different in different memory access. Therefore, when a memory controller accesses a memory device, not only address information of data but also an additional latency identifier and other additional information such as length information and a request identifier of a request packet need to be transmitted. Alternatively, an additional signal cable needs to be added between the memory controller and the memory device. The memory device actively pushes a status of an access request to the memory controller using the additional signal cable.
The present disclosure is to resolve some of the foregoing problems. According to the embodiments of the present disclosure, the memory controller sends a query instruction to the memory device to query a status of an access request in order to implement access to memory media having different latencies without modifying a conventional storage protocol (for example, DDR).
The processor 102 may be a general-purpose central processing unit (CPU), a microprocessor, an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA), or one or more integrated circuits. A specific implementation form of the processor 102 is not limited in this embodiment of the present disclosure.
The memory controller 104 is configured to respond to an access request from the processor 102, and communicate with the memory device 108 using an interconnection channel 106. The interconnection channel 106 may be a bus or another connection form. A connection form between the memory controller 104 and the memory device 108 is not limited in this embodiment of the present disclosure. For example, the memory controller 104 and the memory device 108 may be connected wirelessly. Alternatively, the memory device 108 is a remote memory. The memory controller 104 and the memory device 108 may be connected using various network protocols.
The memory device 108 may support a plurality of storage protocols, for example, the DDR fourth generation (DDR4) protocol and an additional protocol. A storage protocol supported by the memory device 108 is not limited in this embodiment of the present disclosure.
The memory device 108 includes a medium controller 110 and a memory 112. The medium controller 110 is configured to interact with the memory controller 104 and manage an access operation on the memory device 108.
The memory 112 includes a storage chip 114 and a storage chip 116, and is configured to store data required by the processor 102 of the system 100. The storage chip 114 and the storage chip 116 may be a same storage medium or different storage media. For example, in a hybrid memory system, a memory device includes different storage media. The storage chip 114 and the storage chip 116 each may be any non-volatile memory (NVM), any dynamic random access memory (DRAM), or the like. Further, the storage chip 114 and the storage chip 116 may be flash memories, ferroelectric random access memories (FeTRAM), nanowire-based random access memories, any DRAMs, or the like.
It should be understood that, although
As shown in
The buffer 118 is configured to buffer data stored in the memory 112. Further, after receiving an access request, the medium controller 110 first reads to-be-accessed data from the memory 112, and then writes the to-be-accessed data into the buffer 118. Subsequently, after receiving a new instruction sent by the memory controller, for example, a query request or a buffer read request described below, the medium controller 110 returns the to-be-accessed data in the buffer 118 to the memory controller 104.
The buffer 118 may be a first in first out (FIFO) queue. After receiving an instruction sent by the memory controller 104, the medium controller 110 returns data stored in the FIFO to the memory controller side based on an order in which data is written into the FIFO.
It should be understood that the memory device 108 may further include a read buffer and a write buffer. The write buffer is configured to buffer data to be written into the memory 112. The read buffer is configured to buffer data read from the memory 112. This is not limited in the present disclosure. For ease of description, unless otherwise indicated, the buffer 118 in this embodiment of the present disclosure is a read buffer.
In addition, the memory device 108 may have a plurality of buffers 118. Different buffers 118 may correspond to different access requests or correspond to access requests having different priorities. For example, access requests of a computer system may have a plurality of priorities. A priority of an access request for important data is higher than a priority of an access request for common data. Access requests having different priorities may be managed by disposing a plurality of buffers 118 in the memory device. Access requests correspond to different buffers based on different priorities. For ease of description, in this embodiment of the present disclosure, one of the buffers 118 is used for description. However, it should be understood that, a quantity of buffers 118 is not limited in this embodiment of the present disclosure.
The memory interface 120 is configured to connect to the interconnection channel 106, to implement interaction between the memory controller 104 and the medium controller 110.
Optionally, as shown in
Optionally, the status register 122 may store one binary bit, and may record two states “0” and “1”. For example, the state “0” may be used to indicate that no data has been written into the buffer 118, and the state “1” may be used to indicate that data has been written into the buffer 118. The medium controller 110 uses a status bit in the status register 122 to determine whether data has been written into the buffer 118.
Optionally, the status register 122 may store a plurality of binary bits, and may record a plurality of states. For example, if the status register 122 can record three binary bits, eight states can be recorded. If each access request can request one fixed-size piece of to-be-accessed data, after one piece of to-be-accessed data is written into the buffer 118 each time, the medium controller 110 updates the status register 122 by increasing a value in the status register 122 by 1. For example, if an original value in the status register 122 is “0”, and the state “0” indicates that no data has been written into the buffer 118, after writing to-be-accessed data into the buffer 118, the medium controller 110 may set the value in the status register 122 to “1”, to indicate that one piece of to-be-accessed data has been written into the buffer 118. If the value in the status register 122 is not “0”, for example, is “2”, it indicates that two pieces of to-be-accessed data have been written into the buffer 118. When the medium controller 110 increases the value in the status register 122 by 1 to obtain “3”, it indicates that new to-be-accessed data has been written into the buffer 118, and there are currently three pieces of to-be-accessed data in the buffer 118.
For example, each access request can read one piece of 64-byte to-be-accessed data. After writing the 64-byte to-be-accessed data into the buffer 118 based on the access request, the medium controller 110 increases the value in the status register 122 by 1 to indicate that one piece of new data has been written into the buffer.
For ease of description, unless otherwise indicated, in this embodiment of the present disclosure, one piece of data or one piece of to-be-accessed data is data that one access request requests to read.
It should be understood that
For example, in a more specific implementation of this embodiment of the present disclosure, as shown in
The first request counter 124 is configured to mark an access request sent by the memory controller 104 to the memory device 108. For example, each time the memory controller 104 sends one access request, a value of the first request counter 124 increases by 1, and the value of the first request counter 124 is used as a request ID to mark the sent access request. The second request counter 126 keeps synchronized with the first request counter 106, and is configured to mark an access request received by the memory device 108. For example, each time the memory device 108 receives one access request, a value of the second request counter 126 increases by 1, and the value of the second request counter 126 is used as a request ID to mark the received access request.
The medium controller 110 maintains a correspondence between an access request and accessed data. When accessed data is returned to the memory controller 104, a request ID of an access request corresponding to the accessed data is carried, and is used to identify a ranking of the accessed data. The memory controller 104 adjusts the ranking of the accessed data based on the request ID.
When the values of the first request counter 124 and the second request counter 126 reach maximum values that can be supported, a reset operation may be performed on the request counters, that is, the values of the request counters are set to 0 again. Counting manners of the first request counter 124 and the second request counter 126 are not limited in this embodiment of the present disclosure. For example, the first request counter 124 and the second request counter 126 may alternatively be used to mark an access request in a manner of subtraction by 1.
The memory controller 104 and the medium controller 110 described in this embodiment of the present disclosure may be implemented using programmable logic such as an ASIC or an FPGA.
The memory controller 104 and the medium controller 110 described in this embodiment of the present disclosure may alternatively be implemented using a readable storage medium storing a computer executable instruction. The readable storage medium may be a read-only memory (ROM), a static storage device, a dynamic storage device, a random access memory (also referred to as RAM), or the like, or another type of readable medium suitable for storing the computer executable instruction. For example, in this embodiment of the present disclosure, a downloadable computer instruction may be used, and may be transferred from a remote computer (for example, a server) to a requesting computer (for example, a client) through network transmission.
Step 402: A memory controller triggers an access request, and sends the access request to a medium controller.
Further, the memory controller sends at least one access request to the medium controller. Each access request carries address information of requested to-be-accessed data in a memory of a memory device.
The access request may be triggered by the memory controller after the memory controller receives an access instruction sent by a processor.
The address information of the to-be-accessed data may be physical address information of the to-be-accessed data in the memory. The access instruction sent by the processor carries virtual address information of the to-be-accessed data. The memory controller is further configured to convert the virtual address information of the to-be-accessed data into the physical address information based on a mapping relationship between a virtual address and a physical address.
During specific implementation, the medium controller may maintain the mapping relationship between a virtual address and a physical address. The address information carried in the access request may be the virtual address information of the to-be-accessed data.
In a specific implementation process, a size of to-be-accessed data that each access request can read may be a fixed value. To be specific, each access request can read one fixed-size piece of to-be-accessed data. For example, one access request can read 64-byte data. If the size of to-be-accessed data that each access request can request is a fixed value, the address information of the to-be-accessed data in the access request may be a starting address of the to-be-accessed data in the memory device.
It should be understood that forms of the access request and the address information of the to-be-accessed data are not limited in this embodiment of the present disclosure.
Step 404: The medium controller receives the access request, reads to-be-accessed data from a memory based on the access request, and writes the to-be-accessed data into a buffer.
After receiving each access request, the medium controller reads to-be-accessed data from the memory based on address information carried in the access request, and writes the data into the buffer. After the to-be-accessed data is written into the buffer, the data is in a ready state, indicating that the data can be read by the memory controller. When receiving, from the memory controller, an instruction for reading the buffer, the medium controller may return the data that has been written into the buffer to the memory controller.
Different storage media have different access latencies. Therefore, a time required for a process in which the medium controller reads to-be-accessed data from the memory and writes the data into the buffer is not transparent to the memory controller. The memory controller cannot know a time at which the medium controller completes the process. The memory controller needs to actively send a new instruction to query whether data has been written into the buffer.
Step 406: The memory controller sends a query request to the medium controller, where the query request is used to query whether data has been written into the buffer.
This embodiment of the present disclosure is applicable to a scenario in which an access latency of a memory medium is unknown during memory access. For example, different memory media in a hybrid memory system have different access latencies. Therefore, a requirement of the system cannot be met using a DDR protocol using a fixed latency. Because the memory controller does not know an access latency of the to-be-accessed data, the memory controller cannot know a time point at which the to-be-accessed data is written into the buffer. Therefore, a query request needs to be used to query whether data has been written into the buffer.
Further, the memory controller may send the query request to the medium controller based on a preset query period.
The preset query period may be further dynamically adjusted based on a busy degree of an interconnection channel between the memory controller and the memory device. For example, when a bus or the channel is relatively busy, the preset query period may be prolonged, to reduce query request sending frequency, and reduce occupancy of the bus or the channel. When a bus or the channel is relatively idle, the preset query period may be shortened, to increase query request sending frequency, such that the memory controller can read to-be-accessed data as soon as possible.
The preset query period may be further determined based on a priority of the access request, a plurality of access requests sent by the memory controller have at least two priorities, the memory device includes at least two buffers, and each buffer corresponds to one priority. A query period of an access request is determined based on a priority of the access request, and access requests having different priorities correspond to different query periods.
Access requests of a computer system may have a plurality of priorities. Access requests having different priorities may be managed by disposing a plurality of buffers in the memory device. Each buffer corresponds to an access request of one priority. For a buffer having a high priority, more frequent query requests may be used to ensure an operation latency for the corresponding high-priority access request.
Optionally, to ensure normal data communication, the memory controller may further send a query instruction to the medium controller after determining that an interconnection channel between the memory controller and the memory device is in an idle state.
It should be understood that some steps in this embodiment of the present disclosure may be performed without an order. For example, step S404 and step S406 may be performed without an order. When the memory controller sends the query request, the medium controller may have read, from the memory, the data requested by the access request and written the data into the buffer, or may have not written the data requested by the access request into the buffer.
Step 408: The medium controller receives the query request, determines whether data has been written into the buffer, and if no data has been written into the buffer, performs step 410, or if data has been written into the buffer, performs step 412.
The medium controller may record a data write status of the buffer by maintaining remaining space of the buffer. If the remaining space is the same as storage space of the buffer, it indicates that currently no data has been written into the buffer. If the remaining space is less than storage space of the buffer, it indicates that currently data has been written into the buffer, and a size of the data that has been written into the buffer is a difference between the storage space and the remaining space of the buffer. Further, the medium controller may maintain the remaining space of the buffer by maintaining a writable address bit of the buffer.
The medium controller may record a data write status of the buffer using a status register. After writing the to-be-accessed data into the buffer, the medium controller updates the status register. The status register is configured to record the data write status of the buffer. After receiving the query request, the medium controller reads the data write status of the buffer that is recorded in the status register, and determines, based on the data write status of the buffer, whether data has been written into the buffer.
The query request may be a read instruction for reading the status register, and the query request carries an address of the status register, such that the query request can be implemented using a read instruction supported by storage protocols, and the query request can be compatible with the storage protocols.
After reading data in the status register, the medium controller performs a reset operation on the status register.
The query request sent by the memory controller to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request. When the memory controller queries a data write status of a specific buffer, the query request needs to carry indication information of the queried buffer. The indication information may be address information of the buffer, address information of the status register recording the data write status of the buffer, or the like.
Step 410: The medium controller does not respond to the query request of the memory controller or sends an indication message to the memory controller, where the indication message is used to indicate that no data has been written into the buffer.
An access latency of a memory medium is unknown. Therefore, when the memory controller sends a query instruction, possibly no data has been written into the buffer. The medium controller may not respond to the query request, or send the indication message to the memory controller. The indication message is used to indicate that no data exists in the buffer.
If the memory controller has not received a response of the medium controller within a fixed time or receives the indication message that is sent by the medium controller and that is used to indicate that no data exists in the buffer, the memory controller may repeatedly send a query request to the medium controller using a particular policy. For a detailed policy, refer to step 406. Details are not described herein again.
Step 412: The medium controller sends the data that has been written into the buffer to the memory controller.
If data has been written into the buffer, the medium controller sends the data that has been written into the buffer to the memory controller.
In this embodiment of the present disclosure, an access latency of a storage medium is unknown. Therefore, a requirement of the system cannot be met using a synchronous storage protocol such as a DDR protocol using a fixed latency. After the memory controller sends an access request to the medium controller, an access latency is unknown, and the medium controller cannot actively return data to the memory controller without receiving an explicit instruction. Therefore, to determine a status of the to-be-accessed data, the memory controller needs to send a query instruction to the medium controller to read data in the buffer.
In a specific implementation of this embodiment of the present disclosure, the query instruction has two functions. One function is querying the data write status of the buffer, and the other function is implementing an operation of reading the buffer if data has been written into the buffer. After the medium controller receives the query request, if data has been written into the buffer, the medium controller may consider the query request as one instruction for reading the buffer, and return the data that has been written into the buffer to the memory controller.
In another specific implementation of this embodiment of the present disclosure, before sending the to-be-accessed data in the buffer to the memory controller, the medium controller further sends a response message to the memory controller. The response message is used to indicate that a data write status of the buffer is “already written with data”. The memory controller triggers a buffer read request based on the response message, and sends the buffer read request to the medium controller. The buffer read request is used to read the data that has been written into the buffer. The medium controller is further configured to receive the buffer read request sent by the memory controller, read, based on the buffer read request, the data that has been written into the buffer, and trigger the operation of sending the data that has been written into the buffer to the memory controller.
The query request is used to query whether data has been written into the buffer, and the buffer read request is used to implement an operation of reading the buffer in order to further reduce complexity of a storage protocol.
The buffer read request is further one instruction for reading the buffer, and carries address information of the buffer. After receiving the buffer read request, the medium controller triggers step 412.
The response message is used to indicate that data has been written into the buffer. Further, the response message may further indicate an amount of to-be-accessed data in the buffer. To be specific, the response message further carries the amount M of to-be-accessed data in the buffer. The buffer read request may carry amount information of data that the buffer read request requests to read in the buffer, and the amount information is generated based on the amount M.
If one buffer read request can read only one piece of to-be-accessed data in the buffer, that is, to-be-accessed data, for example, 64-byte fixed data, of only one access request can be read, the memory controller may send M buffer read requests to the medium controller based on the response message, to read all data in the buffer. After receiving the M buffer read requests, the medium controller returns to-be-accessed data in the buffer to the memory controller. M is a positive integer greater than 0.
In another specific implementation of this embodiment of the present disclosure, an access request cannot directly make the medium controller return to-be-accessed data requested by the access request. Due to such a characteristic of the access request to reduce a quantity of times of interaction between the memory controller and the medium controller, the query request may be implemented using a new access request.
For example, after the memory controller sends an access request for reading an address A, the medium controller fetches the data A indicated by the address A from a memory, and writes the data A into the buffer. Subsequently, the memory controller further sends an access request for reading an address B, and the access request for reading the address B can also implement a query instruction function. After receiving the access request for reading the address B, the medium controller reads data B indicated by the address B from the memory based on the access request for reading the address B, writes the data B into the buffer, queries the data write status of the buffer based on the access request for reading the address B, and directly returns the data A to the memory controller or sends a response message to the memory controller.
In this implementation, an amount of signaling exchanged between the memory controller and the medium controller is reduced, and load on a communications bus or a channel is lightened.
In another specific implementation of this embodiment of the present disclosure, the medium controller records a data write status of the buffer using a status register.
In
In another implementation of this embodiment of the present disclosure, the memory controller can read only one piece of to-be-accessed data in the buffer using one read instruction for the buffer, and the memory system considers the query request as one instruction for reading the buffer, such that a quantity of times of interaction between the memory controller and the medium controller is reduced.
Further, if only one piece of to-be-accessed data exists in the buffer, the medium controller may directly send the to-be-accessed data to the memory controller. If M is a positive integer greater than 1, the medium controller may send one piece of to-be-accessed data that has been first written into the buffer to the memory controller side based on a query instruction. For example, the buffer is a FIFO. The medium controller sends one piece of to-be-accessed data at the head of the queue to the memory controller, and sends a response message to the memory controller. The response message indicates an amount of remaining to-be-accessed data in the buffer. After receiving the response message, the memory controller needs to send only M−1 buffer read requests to the medium controller. After receiving the M−1 buffer read requests, the medium controller returns remaining M−1 pieces of to-be-accessed data in the buffer to the memory controller.
In this embodiment of the present disclosure, in an asynchronous access manner, the to-be-accessed data may be returned out of order. Therefore, when sending the data that has been written into the buffer to the memory controller, the medium controller further sends identification information to the memory controller. The identification information is used to indicate an access request corresponding to the data sent by the medium controller. To be specific, the identification information is used to indicate a correspondence between the to-be-accessed data and an access request.
Further, the identification information may be carried in data sent by the medium controller and is sent to the memory controller together with the data. Alternatively, data and identification information of the data may be sent alternately. It should be understood that a manner of sending data and identification information of the data is not limited in this embodiment of the present disclosure.
Further, in this embodiment of the present disclosure, a request ID is used to identify to-be-accessed data returned each time. When sending the to-be-accessed data to the memory controller, the medium controller further returns a request ID of an access request corresponding to the to-be-accessed data to the memory controller to implement out-of-order return of data.
In a specific implementation process, when sending an access request, the memory controller may also send a request ID corresponding to the access request to the medium controller.
In this embodiment of the present disclosure, the request ID may alternatively be recorded through synchronization between the memory controller and the medium controller. To be specific, the memory controller and the medium controller each have a request counter. A value of the request counter is used to record a request ID of an access request. Each time the memory controller sends one access request, a value of a first request counter on the memory controller side automatically increases by 1. Each time the medium controller receives one request, a value of a second request counter on the medium controller side automatically increases by 1. During returning of to-be-accessed data, a request ID is transferred to the memory controller together with the to-be-accessed data. An order in which access requests are sent is definitely consistent with an order in which the access requests are received. Therefore, request IDs are synchronized between the memory controller and the medium controller, such that out-of-order return for access requests is implemented. Detailed descriptions of the request counters are already provided above. Details are not described herein again.
According to the technical solution disclosed in this embodiment of the present disclosure, in a scenario in which storage media of a memory device have different access latencies, the memory controller actively sends a query request to the medium controller in order to implement an operation of accessing the memory device without adding an additional signal cable. In comparison with an asynchronous protocol, in this embodiment of the present disclosure, less signaling is used to implement access to the hybrid memory system. Moreover, because the query request may be implemented using a read instruction in a storage protocol, this embodiment of the present disclosure has higher compatibility with various storage protocols.
In the embodiments of the present disclosure, for compatibility with a storage protocol, an access request, a query request, and a buffer read request may all be implemented using read instructions in the storage protocol.
Step 1102: A memory controller triggers a first read instruction, and sends the first read instruction to a medium controller.
The first read instruction carries address information of to-be-accessed data in a memory device. One piece of to-be-accessed data that can be read by the first read instruction has a fixed size, for example, 64 bytes. For ease of description, in the following description, a size of one piece of to-be-accessed data is 64 bytes. However, it should be understood that, the size of one piece of to-be-accessed data is not limited in this embodiment of the present disclosure.
After sending the first read instruction, the memory controller increases a value of a first request counter on the memory controller side by 1, and uses a value of the first request counter obtained after the increase of 1 as a request ID of the access request. The request ID is used to identify the first read instruction.
Step 1104: The medium controller receives the first read instruction, reads, based on address information carried in the first read instruction, first (e.g., 64-byte to-be-accessed) data from a memory of a memory device, and writes the first data into a buffer.
After receiving the first read instruction, the medium controller increases a value of a second request counter on the medium controller side by 1 to keep synchronized with the first request counter on the memory controller side, and uses a value of the request counter obtained after the increase of 1 as the request ID of the access request. The request ID is used to identify the first read instruction. Further, the medium controller maintains a correspondence between the to-be-accessed data and the first read instruction, to be specific, records a request ID corresponding to each piece of to-be-accessed data to implement out-of-order return of data.
Step 1106: After writing the to-be-accessed data into the buffer, the medium controller updates a data write status of the buffer that is recorded in a status register.
The data write status may be a specific value, and is used to indicate a current amount of to-be-accessed data in the buffer. After writing the to-be-accessed data into the buffer, the medium controller increases a value in the status register by 1.
Step 1108: The memory controller triggers a second read instruction, and sends the second read instruction to the medium controller.
Further, the second read instruction carries an address of the status register, and is used to read the data write status of the buffer that is recorded in the status register.
Step 1110: The medium controller receives the second read instruction, and reads the status register based on an address of the status register that is carried in the second read instruction.
After reading a value N in the status register, the medium controller resets the status register.
Step 1112: The medium controller sends a value N in the status register to the memory controller, where the value N in the status register is used to indicate a current amount N of to-be-accessed data in the buffer.
Step 1114: After receiving the value N in the status register that is sent by the medium controller, the memory controller determines whether N is greater than 0, and if N is 0, it indicates that currently no to-be-accessed data has been written into the buffer, and the memory controller performs step 1108 again to send the second read instruction to the medium controller again based on a particular policy, or if N is greater than 0, the memory controller performs step 1116.
Step 1116: The memory controller triggers a third read instruction, and sends the third read instruction to the medium controller.
The third read instruction carries address information of the buffer, and is used to read the to-be-accessed data in the buffer.
Further, if one third read instruction can read a plurality of pieces of to-be-accessed data, the third read instruction further carries amount indication information of to-be-read data. The amount indication information is generated based on the value N. If each third read instruction can read only one piece of to-be-accessed data, the memory controller sends N third read instructions to the medium controller. Each third read instruction is used to read one piece of 64-byte to-be-accessed data.
Step 1118: The medium controller receives the third read instruction, and reads the to-be-accessed data in the buffer based on address information of the buffer that is carried in the third read instruction.
Further, the buffer may be a FIFO. If each third read instruction can read only one piece of to-be-accessed data, each third read instruction reads one piece of to-be-accessed data at the head of the FIFO queue. N third read instructions can read the first N pieces of to-be-accessed data from the buffer.
Step 1120: The medium controller sends, to the memory controller, N pieces of to-be-accessed data read from the buffer.
Further, each piece of to-be-accessed data carries a request ID corresponding to the piece of data, to indicate a request ranking of the to-be-accessed data.
Step 1122: The memory controller receives the N pieces of to-be-accessed data sent by the medium controller, and sends the N pieces of to-be-accessed data to a processor.
Further, each piece of to-be-accessed data carries a request ID of a first read instruction corresponding to the piece of data. Therefore, before sending the to-be-accessed data to the processor, the memory controller may further resort, based on the request ID in the to-be-accessed data, the to-be-accessed data that is returned out of order in order to ensure data correctness and integrity.
The embodiment of
A hardware structure of the memory controller or the medium controller described in the embodiments of the present disclosure may be implemented using an apparatus 1300 shown in
The processor 1302 is a control center of the apparatus 1300, and is configured to execute related programs, to implement the technical solutions provided in the embodiments of the present disclosure. The processor 1302 may be a general-purpose CPU, a microprocessor, an ASIC, or one or more integrated circuits, and is configured to execute related programs, to implement the technical solutions provided in the embodiments of the present disclosure.
The memory 1304 may be a ROM, a static storage device, a dynamic storage device, or a RAM. When software or firmware is used to implement the technical solutions provided in the embodiments of the present disclosure, program code for implementing the technical solutions provided in the embodiments of the present disclosure is stored in the memory 1304 and is executed by the processor 1302. The memory 1304 and the processor 1302 may be integrated together, or the memory 1304 may be integrated into the processor 1302, or may be one or more storage units independent of the processor 1302.
The communications interface 1306 maybe a transceiver apparatus such as a transceiver, and configured to implement communication between the apparatus 1300 and another device or a communications network.
The bus 1308 may include a channel for transferring information between components (for example, the processor 1302, the memory 1304, and the communications interface 1306) of the apparatus 1300.
It should be noted that although the apparatus 1300 shown in
The hardware structure shown in
The sending unit 1402 is configured to send at least one access request to the medium controller.
The sending unit 1402 is further configured to send a query request to the medium controller, where the query request is used to query whether data has been written into the buffer.
In a specific implementation process, the sending unit 1402 may be implemented using the processor 1302, the memory 1304, and the communications interface 1306 shown in
In a specific implementation process, the sending unit 1402 may send the query request to the medium controller based on a preset query period. The preset query period may be determined based on a priority of the access request. Access requests of the memory controller may have at least two priorities, the memory device includes at least two buffers, and each buffer corresponds to one priority. A query period of an access request is determined based on a priority of the access request, and access requests having different priorities correspond to different query periods.
The query request sent by the sending unit to the medium controller further carries buffer indication information, and the buffer indication information is used to indicate the buffer queried by the query request.
As shown in
In a specific implementation process, the determining unit may be implemented using the processor 1302 and the memory 1304 shown in
The receiving unit 1404 is configured to receive the data that has been written into the buffer and that is sent by the medium controller.
In a specific implementation process, the receiving unit 1404 may be implemented using the processor 1302, the memory 1304, and the communications interface 1306 shown in
Optionally, after the sending unit 1402 sends the query request to the medium controller, the receiving unit 1404 is further configured to receive a response message from the medium controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”. The sending unit 1402 is further configured to send a buffer read request to the medium controller based on the response message, where the buffer read request is used to read the data that has been written into the buffer.
The receiving unit 1404 is further configured to receive identification information sent by the medium controller, where the identification information is used to indicate an access request corresponding to the data received by the receiving unit 1404.
This embodiment of the present disclosure is an apparatus embodiment of the memory controller. The feature descriptions of the embodiments of
The receiving unit 1602 is configured to receive at least one access request from the memory controller.
In a specific implementation process, the receiving unit 1602 may be implemented using the processor 1302, the memory 1304, and the communications interface 1306 shown in
The receiving unit 1602 is further configured to receive a query request from the memory controller, where the query request is used to query whether data has been written into the buffer.
The determining unit 1604 is configured to determine, based on the query request, whether data has been written into the buffer.
In a specific implementation process, the determining unit may be implemented using the processor 1302 and the memory 1304 shown in
The sending unit 1606 is configured to, if the determining unit 1604 determines that data has been written into the buffer, send the data that has been written into the buffer to the memory controller.
In a specific implementation process, the sending unit 1606 may be implemented using the processor 1302, the memory 1304, and the communications interface 1306 shown in
Optionally, after the determining unit 1604 determines that data has been written into the buffer, the sending unit 1606 is further configured to send a response message to the memory controller, where the response message is used to indicate that a data write status of the buffer is “already written with data”. The receiving unit 1602 is further configured to receive a buffer read request from the memory controller, where the buffer read request is used to read the data that has been written into the buffer.
Optionally, the memory device further includes a status register, and the status register is configured to record the data write status of the buffer, and the determining unit 1604 is further configured to read the data write status of the buffer that is recorded in the status register, and determine, based on the data write status of the buffer, whether data has been written into the buffer.
The sending unit 1606 is further configured to send identification information to the memory controller, where the identification information is used to indicate an access request corresponding to the data sent by the sending unit 1606.
This embodiment of the present disclosure is an apparatus embodiment of the medium controller. The feature descriptions of the embodiments of
In the embodiments provided in this application, it should be understood that the disclosed system, device, and method may be implemented in other manners. For example, the described apparatus embodiment is merely an example. For example, the module division is merely logical function division and may be other division in implementation. For example, a plurality of modules or components may be combined or integrated into another system, or some features may be ignored or not performed. In addition, the displayed or discussed mutual couplings or direct couplings or communication connections may be implemented using some interfaces. The indirect couplings or communication connections between the apparatuses or modules may be implemented in an electronic form, a mechanical form, or another form.
The modules described as separate parts may or may not be physically separate, and parts displayed as modules may or may not be physical modules, that is, may be located in one position, or may be distributed on a plurality of network modules. Some or all of the modules may be selected based on actual needs to achieve the objectives of the solutions of the embodiments.
In addition, function modules in the embodiments of the present disclosure may be integrated into one processing module, or each of the modules may exist alone physically, or two or more modules may be integrated into one module. The integrated module may be implemented in a form of hardware, or may be implemented in a form of hardware in addition to a software function module.
When the foregoing integrated module is implemented in a form of a software function module, the integrated unit may be stored in a computer-readable storage medium. The software function module is stored in a storage medium and includes instructions for instructing a computer device (which may be a personal computer, a server, or a network device) to perform some of the steps of the methods described in the embodiments of the present disclosure. The storage medium includes any medium that can store program code, such as a removable hard disk, a read-only memory, a random access memory, a magnetic disk, or an optical disc.
Finally, it should be noted that the foregoing embodiments are merely intended to describe the technical solutions of the present disclosure, but not to limit the present disclosure. Although the present disclosure is described in detail with reference to the foregoing embodiments, persons of ordinary skill in the art should understand that they may still make modifications to the technical solutions described in the foregoing embodiments or make equivalent replacements to some technical features thereof, without departing from the protection scope of the technical solutions in the embodiments of the present disclosure.
| Number | Date | Country | Kind |
|---|---|---|---|
| 201610797658.9 | Aug 2016 | CN | national |
This application is a continuation of International Patent Application No. PCT/CN2017/099331 filed on Aug. 28, 2017, which claims priority to Chinese Patent Application No. 201610797658.9 filed on Aug. 31, 2016. The disclosures of the aforementioned applications are hereby incorporated by reference in their entireties.
| Number | Date | Country | |
|---|---|---|---|
| Parent | PCT/CN2017/099331 | Aug 2017 | US |
| Child | 16289134 | US |
