Low-latency data decryption interface

Abstract

Methods and apparatus for reducing the impact of latency associated with decrypting encrypted data are provided. Rather than wait until an entire packet of encrypted data is validated (e.g., by checking for data transfer errors), the encrypted data may be pipelined to a decryption engine as it is received, thus allowing decryption to begin prior to validation. In some cases, the decryption engine may be notified of data transfer errors detected during the validation process, in order to prevent reporting false security violations.

Description

BACKGROUND OF THE INVENTION

1. Field of the Invention

The present invention generally relates to data encryption and, more particularly, to methods and apparatus for reducing latency associated with decrypting previously encrypted data.

2. Description of the Related Art

A system on a chip (SOC) generally includes one or more integrated processor cores, some type of embedded memory, such as a cache shared between the processors cores, and peripheral interfaces, such as memory control components and external bus interfaces, on a single chip to form a complete (or nearly complete) system. The use of cache memory hierarchies is well established to improve a processor performance by reducing and/or eliminating read access requests to external main memory. As used herein, the term latency generally refers to the amount of time it takes before data is available at a processor core after a request from memory control for data that is not currently available in a nearby (L1 or L2) cache memory.

As part of an enhanced security feature, some SOCs encrypt some portions of data prior to storing it in external memory, for example, to prevent a hacker from obtaining instructions of a copyrighted program, such as a video game, or data that may be used to determine such instructions through reverse engineering. Such encrypted data must first be decrypted before it can be used by the processor in any computation. Therefore, an additional latency is introduced due to the need to decrypt data that was stored in external memory in an encrypted format.

This latency may add significant delay to the execution to be performed on the decrypted data. In addition, this latency may prevent the transfer of subsequent unencrypted data, which can further impact system performance. Accordingly, what is needed is a mechanism to minimize latency impacts of data that is to be decrypted.

SUMMARY OF THE INVENTION

The present invention generally provides methods and apparatus for reducing the amount of latency involved in decrypting encrypted data.

One embodiment provides a method of reducing the amount of latency associated with decrypting encrypted data transmitted in a data packet. The method generally includes receiving at least a portion of a first data packet containing at least a portion of a block of encrypted data, buffering the received portion of the block of encrypted data, and pipelining the received portion of the block of encrypted data to a decryption engine to begin decryption of the block of encrypted data prior to receiving remaining portions of the first data packet.

Another embodiment provides a method of reducing latency associated with decrypting data. The method generally includes: (a) receiving at least a portion of a data packet containing at least a portion of a block of encrypted data; (b) buffering the received portion of the block of encrypted data; (c) pipelining the received portion of the block of encrypted data to a decryption engine to begin decryption operations prior to checking the data packet for data transfer errors; (d) repeating operations (a)-(c) until the data packet is received in its entirety; and (e) checking the entire data packet for one or more data transfer errors.

Another embodiment provides a system for decrypting packets of encrypted data generally including a buffer device, a packet validation component, a decryption engine, and a packet decoder. The packet decoder is generally configured to receive portions of a data packet, buffer received portions of the data packets in the buffer device, and, if the data packet contains encrypted data, pipeline the received portions of the data packets to the decryption engine to begin decryption of the encrypted data prior to receiving remaining portions of a data packet.

Another embodiment provides a system on a chip (SOC) generally including one or more processor cores, a shared cache for holding data accessed by the one or more processor cores, a decryption engine, and a packet decoder. The packet decoder is generally configured to receive portions of a first data packet containing encrypted data and pipeline the received portions of the data packets to the decryption engine to begin decryption of the encrypted data prior to receiving the complete data packet and checking the complete data packet for data transfer errors.

BRIEF DESCRIPTION OF THE DRAWINGS

So that the manner in which the above recited features, advantages and objects of the present invention are attained and can be understood in detail, a more particular description of the invention, briefly summarized above, may be had by reference to the embodiments thereof which are illustrated in the appended drawings.

It is to be noted, however, that the appended drawings illustrate only typical embodiments of this invention and are therefore not to be considered limiting of its scope, for the invention may admit to other equally effective embodiments.

FIG. 1 illustrates an exemplary system including a central processing unit (CPU), in which embodiments of the present invention may be utilized.

FIG. 2 is a block diagram of components of the CPU, according to one embodiment of the present invention.

FIG. 3 is a flow diagram of exemplary operations for decrypting data according to one embodiment of the present invention.

FIG. 4 is a flow diagram of exemplary operations for detecting data transfer errors according to one embodiment of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

Embodiments of the present invention may be utilized to reduce the impact of latency associated with decrypting encrypted data. Rather than wait until an entire packet of encrypted data is validated (e.g., by checking for data transfer errors), the encrypted data may be pipelined to a decryption engine as it is received, thus allowing decryption to begin prior to validation. For some embodiments, the decryption engine may be notified of data transfer errors detected during the validation process, in order to prevent reporting false security violations.

As used herein, the term data packet generally refers to a stream of data sent over a bus in a predefined format, for example, including a header containing information about the data contained in the packet. Often, data packets will include some sort of validation value generated as a function of the data, referred to herein generically as checksum, regardless of its actual type, whether it be a cyclic redundancy check (CRC) value, hash value, or some other type of value. Further, while a distinction may be made in the following description between instructions and data acted on by those instructions, it should be understood that both such data and instructions may be contained as data in a data packet.

An Exemplary System

FIG. 1 illustrates an exemplary computer system 100 including a central processing unit (CPU) 110, in which embodiments of the present invention may be utilized. As illustrated, the CPU 110 may include one or more processor cores 112, which may each include any number of different type function units including, but not limited to arithmetic logic units (ALUs), floating point units (FPUs), and single instruction multiple data (SIMD) units. Examples of CPUs utilizing multiple processor cores include the Power PC line of CPUs, available from IBM.

As illustrated, each processor core 112 may have access to its own primary (L1) cache 114, as well as a larger secondary (L2) cache 116. The L2 cache 116 may be shared by each processor core 112 or each processor core 112 may have its own L2 cache 116. In general, copies of data utilized by the processor cores 112 may be stored locally in the L2 cache 116, preventing or reducing the number of relatively slower accesses to external main memory 140. Similarly, data utilized often by a processor core 112 may be stored in its L1 cache 114, preventing or reducing the number of relatively slower accesses to the L2 cache 116.

The CPU 110 may communicate with external devices, such as a graphics processing unit (GPU) 130 and/or a memory controller 136 via a system or frontside bus (FSB) 128. The CPU 110 may include an FSB interface 120 to pass data between the external devices and the processing cores 112 (through the L2 cache) via the FSB 128. An FSB interface 132 on the GPU 130 may have similar components as the FSB interface 120, configured to exchange data with one or more graphics processors 134, input output (I/O) unit 138, and the memory controller 136 (illustratively shown as integrated with the GPU 130). For some embodiments, the GPU 130 may utilize the same techniques and/or apparatus described herein to reduce latency associated with decrypting encrypted data.

As illustrated, the FSB interface 120 may include a physical layer 122, link layer 124, and transaction layer 126. The physical layer 122 may include hardware components for implementing the hardware protocol necessary for receiving and sending data over the FSB 128. The physical layer 122 may exchange data with the link layer 124 which may format data received from or to be sent to the transaction layer 126. As illustrated, the transaction layer 126 may exchange data with the processor cores 112 via a core bus interface (CBI) 118.

As previously described, as part of an enhanced security feature, the CPU 110 may encrypt some portions of data prior to storing it in main memory 140 (such encrypted portions of data are illustratively shown as protected data 142 in main memory 140). Accordingly, the CPU 110 may include a security component 150 used to encrypt such data prior to transmission over the FSB 128 by the FSB interface 120. Upon later retrieval of the encrypted data, the security component 150 may also be used to decrypt the encrypted data prior to passing it into the L2 cache 116 for use by one or more of the processor cores 112.

As shown in FIG. 2, a number of data streams (also referred to as virtual channels) may be established to exchange data between the processor cores 112 and external devices. Establishing the separate streams may improve overall system performance, for example, allowing one processing core to transfer data while another processes data (and is not transferring data). As illustrated, the streams may share a common buffer pool 210, with each stream utilizing its own portion of the buffer pool 210, in effect establishing separate buffers 211-217.

For some embodiments, data may be sent over the FSB as packets. Therefore, the link layer 124 may contain circuitry, such as a packet encoder 233 configured to encode into packets or “packetize” data received from the transaction layer 126 and a packet decoder 234 to decode packets of data received from the physical layer 122. As shown, the physical layer 122 may include a serializer 243 and a de-serializer 244 for generating and receiving such packets, respectively. Typically, the packet decoder 234 will include a packet validation component 235 configured to check a received data packet for data transfer errors, for example, by comparing a checksum calculated on the received data with a checksum contained in the data packet.

Low-Latency Data Decryption

The packet decoder 234 may forward received data to one or more receive buffers 215-217. The primary purpose of the receive buffers 215-217 may be for “speed matching” between the input and output interfaces of the FSB interface 120. As used herein, the term speed-matching generally refers to the need to accumulate a sufficient amount of data before forwarding it to account for the differences in clock speed and/or data width between the input and output interfaces (e.g., the FSB 128 and the CBI 118).

As illustrated, some of the data, such as data request and response commands sent to buffers 215 and 216, may be non-encrypted and may, therefore be passed directly to cache 116. Response data, on the other hand, may include both encrypted and non-encrypted data. While the non-encrypted data can be passed directly to cache 116, encrypted data 251 must first be decrypted. Therefore, the encrypted data 251 may be routed to the decryption engine 154. The decryption engine 154 may decrypt the encrypted data 251 and pass back decrypted data 252. As illustrated, the decrypted data 252 may be merged with the non-encrypted data and passed to the cache 116 using a multiplexor circuit 253. For example, the decryption engine 154 may assert a signal to the multiplexor circuit 253 when decrypted data 252 is available to be passed to the cache 116.

As previously described, in conventional decryption schemes, the decryption process may result in significant latency as the data is being decrypted. In conventional decryption schemes, a complete packet of data is validated before the data is sent to the decryption engine 154. However, embodiments of the present invention may reduce the amount of latency typically associated with data decryption by pipelining received encrypted data 251 to the decryption engine 154 prior to receiving and validating the entire data packet.

For example, the packet decoder 234 may transfer encrypted data 251 to the decryption engine 154 as it is received. In parallel, data validation may be performed by the validation component 235, for example, by generating a checksum on the encrypted data 251 as it is received. Accordingly, decryption operations may begin prior to validation, reducing total overall latency. Further, by allowing the encrypted data 251 to be pipelined to the decryption engine 154 and allowing the decrypted data 252 to be merged back with non-encrypted data, the packet decoder 234 may be freed up to receive subsequent packets of non-encrypted data. As a result, in contrast to conventional decryption schemes, schemes in accordance with embodiments of the present invention may prevent the latency associated with decryption from blocking the transfer of subsequently received non-encrypted data packets.

FIG. 3 illustrates exemplary operations 300 that may be performed, for example, by the illustrated components in the FSB interface 120, to decrypt encrypted data prior to validating a data packet containing the encrypted data. The operations begin, at step 302, by receiving a portion of data of a data packet.

For example, the data may be received by the packet decoder 234, from the de-serializer 244. In order to allow for later validation of the data packet by the packet validation component 235, the data is buffered (e.g., for speed-matching purposes) by the packet decoder 234, at step 304. As previously described, the data may be validated as it is received. If the data is not encrypted, as determined at step 306, and the data is not the last data in the packet, as determined at step 310, operations return to step 302 to receive another portion of data.

However, if the data is encrypted, the encrypted data is first pipelined to the decryption engine 154, at step 308. As a result, the decryption engine 154 may be able to begin decrypting the encrypted data without waiting until the entire data packet is received and validated. By allowing the decryption to start before the packet is validated, the total latency associated with the decryption may be reduced.

In some cases, due to the high speed in which data is transferred over the FSB 128, data transfer errors may occur. Therefore, once all of the data of the packet is received, as determined at step 310, the packet may be validated, at step 312. The packet may be validated using any suitable known or unknown techniques, such as by comparing a checksum, generated as a function of data in the packet, with a checksum sent with the packet. As previously described, the checksum may be any type of suitable value, such as a CRC value or hash value. Circuitry for generating the checksum may be included in the packet validation component 235.

Preventing False Security Violations

For some embodiments, some type of mechanism may be in place to detect security violations due to unauthorized tampering of encrypted data 251, for example, by examining the decrypted data 252. However, in some cases, unauthorized tampering may be indistinguishable from changes in the encrypted data 251, as received by the decryption engine 154, due to data transfer errors. Unfortunately, a failure to distinguish between modification of encrypted data 251 due to unauthorized tampering and modification due to data transfer errors may lead to the reporting of false security violations.

Therefore, for some embodiments, prior to passing decrypted data 252 to the cache 116, the decryption engine 154 may first determine if the data packet containing the encrypted data is validated. As illustrated in FIG. 2, for some embodiments, the packet validation component 235 may generate a (VALID/INVALID) signal to notify the decryption engine 154 validation (data transfer) errors have been detected in the data packet. In response to the signal, the decryption engine may discard decrypted data 252 and disregard any detected security violations.

FIG. 4 illustrates an exemplary sequence of operations 400 that may be performed, for example, by the packet validation component 235 and the decryption engine 154 to detect packet validation errors and prevent the reporting of false security violations. In the following description, it is assumed that a complete packet of data has been received.

The operations 400 begin, at step 402, by checking the complete packet for data transfer errors. If any data transfer errors are detected, as determined at step 404, the decrypted data 252 is disregarded, at step 406. Further, as any data transfer errors may have corrupted the encrypted data sent to the decryption engine 154, any security violations detected by the decryption engine 154 are disregarded, at step 408. Operations to retry reading the encrypted data may be performed, at step 410.

On the other hand, if no data transfer errors are detected, it can be assumed the decryption engine 154 received the encrypted data free of error. Therefore, any security violations detected at step 412 (e.g., using local ICVs as described above), may be assumed valid (e.g., resulting from tampering with the encrypted data) and are reported, at step 416. If no security violations are detected, the decrypted data 252 is passed to the cache memory 116, at step 414. As previously described, for some embodiments, the decrypted data 252 may be merged with subsequently received unencrypted data.

CONCLUSION

By pipelining encrypted data to a decryption engine prior to validating a complete packet containing the encrypted data, the latency associated with conventional decryption mechanisms may be reduced. The decryption engine may still be notified of validation errors, however, to prevent passing invalid data and the reporting of false security violations. Further, for some embodiments, subsequently received unencrypted data may be transferred prior to completion of the decryption operations.

While the foregoing is directed to embodiments of the present invention, other and further embodiments of the invention may be devised without departing from the basic scope thereof, and the scope thereof is determined by the claims that follow.

Claims

1. A system on a chip (SOC), comprising: one or more processor cores;a cache for holding data accessed by the one or more processor cores, including a received portion of a first data packet containing at least a portion of a block of encrypted data;a decryption engine; anda packet decoder configured to pipeline the received portion of the first data packet to the decryption engine to begin decryption of the encrypted data prior to receiving the complete first data packet and checking the complete first data packet for data transfer errors; and further configured, after receiving remaining portions of the first data packet, to: check the first data packet for data transfer errors using buffered portions of the encrypted data;check for security violations with the decryption engine after decryption of the block of encrypted data; anddisregard any detected security violations in response to detecting data transfer errors.

2. A system on a chip (SOC), comprising: one or more processor cores;a cache for holding data accessed by the one or more processor cores, including a received portion of a first data packet containing at least a portion of a block of encrypted data;a decryption engine; anda packet decoder configured to pipeline the received portion of the first data packet to the decryption engine to begin decryption of the encrypted data prior to receiving the complete first data packet and checking the complete first data packet for data transfer errors; and further configured, after receiving remaining portions of the first data packet, to: check the first data packet for data transfer errors using buffered portions of the encrypted data;check for security violations with the decryption engine after decryption of the block of encrypted data;disregard any detected security violations in response to detecting data transfer errors; andnotify the decryption engine in response to detecting data transfer errors.

3. A system on a chip (SOC), comprising: one or more processor cores;a cache for holding data accessed by the one or more processor cores, including a received portion of a first data packet containing at least a portion of a block of encrypted data;a decryption engine; anda packet decoder configured to pipeline the received portion of the first data packet to the decryption engine to begin decryption of the encrypted data prior to receiving the complete first data packet and checking the complete first data packet for data transfer errors; and further configured, after receiving remaining portions of the first data packet, to: check the first data packet for data transfer errors using buffered portions of the encrypted data;check for security violations with the decryption engine after decryption of the block of encrypted data;disregard any detected security violations in response to detecting data transfer errors; andbuffer received portions of a second data packet containing non-encrypted data prior to completion of decryption of the encrypted data contained in the first data packet.

4. The SOC of claim 3, wherein the packet decoder is further configured to pass the non-encrypted data to the cache prior to completion of decryption of the encrypted data contained in the first data packet.

5. The SOC of claim 4, further comprising circuitry for merging decrypted data from the decryption engine to be passed to the cache with the non-encrypted data.