The present technology pertains to distributed computing systems and more specifically to security in distributed computing systems.
The approaches described in this section could be pursued but are not necessarily approaches that have previously been conceived or pursued. Therefore, unless otherwise indicated, it should not be assumed that any of the approaches described in this section qualify as prior art merely by virtue of their inclusion in this section.
Encryption is the process of encoding a message or information in such a way that only authorized parties can access it and those who are not authorized cannot. Encryption does not by itself prevent interference, but denies the intelligible content to a would-be interceptor. In an encryption scheme, the intended information or message, referred to as plaintext, is encrypted using an encryption algorithm, referred to as a cipher, generating ciphertext that can only be read if decrypted. A cryptosystem is pair (encryption and decryption) of algorithms that take a key and convert plaintext to ciphertext and back.
Encryption is used by militaries and governments to facilitate secret communication. It is also used to protect information within civilian systems. Encryption can be used to protect data “at rest,” such as information stored on computers and storage devices. Encryption is also used to protect data in transit, for example, data being transferred via networks (e.g., the Internet, e-commerce), mobile telephones, Bluetooth devices and bank automatic teller machines (ATMs).
This summary is provided to introduce a selection of concepts in a simplified form that are further described in the Detailed Description below. This summary is not intended to identify key features or essential features of the claimed subject matter, nor is it intended to be used as an aid in determining the scope of the claimed subject matter.
The present disclosure is related to various systems and methods using enclave computing environments. Specifically, a method for performing computational operations on a server host may comprise: receiving an encrypted service request from a client host, the client host encrypting a service request to produce the encrypted service request using a shared secret, the service request specifying the computational operation; decrypting, in a secure enclave that is established by a secure environment, the encrypted service request using the shared secret to produce a decrypted service request, the secure enclave preventing other software running on the server host from accessing the shared secret and other data stored in the secure enclave; performing the computational operation, in the secure enclave, using the decrypted service request to generate a service result; encrypting, in the secure enclave, the service result using the shared secret to create an encrypted service result; and providing the encrypted service result to the client host, the client host decrypting the encrypted service result using the shared secret.
Embodiments are illustrated by way of example, and not by limitation, in the figures of the accompanying drawings, in which like references indicate similar elements and in which:
While this technology is susceptible of embodiment in many different forms, there is shown in the drawings and will herein be described in detail several specific embodiments with the understanding that the present disclosure is to be considered as an exemplification of the principles of the technology and is not intended to limit the technology to the embodiments illustrated. The terminology used herein is for the purpose of describing particular embodiments only and is not intended to be limiting of the technology. As used herein, the singular forms “a,” “an,” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will be further understood that the terms “comprises,” “comprising,” “includes,” and/or “including,” when used in this specification, specify the presence of stated features, integers, steps, operations, elements, and/or components, but do not preclude the presence or addition of one or more other features, integers, steps, operations, elements, components, and/or groups thereof. It will be understood that like or analogous elements and/or components, referred to herein, may be identified throughout the drawings with like reference characters. It will be further understood that several of the figures are merely schematic representations of the present technology. As such, some of the components may have been distorted from their actual scale for pictorial clarity.
Some embodiments of the present technology include a distributed application structure that partitions tasks or workloads between the providers of a resource or service, called server hosts, and service requesters, called client hosts. The client hosts and server hosts can each be separate hardware systems (although both client and server may reside in the same system) and communicate over a computer network. A server host runs one or more server programs which share their resources with client hosts. A client host does not necessarily share any of its resources, but requests a server's content or service function. Client hosts can initiate communication sessions with server hosts which await incoming requests.
Various embodiments of the present technology include a pair of software programs, the server program and the client program. The server program runs on a server host, a computing device that can provide one or more of a Trusted Execution Environment (TEE), Remote Attestation (RA) capabilities, and the like. The server program can run within the TEE on the server host. The client program can run on the client host, which can be a computing device that does not necessarily have special requirements, such as a TEE.
Server system 120A can be a physical computing system (e.g., hardware server) and/or virtualized computing environment (e.g., virtual machine, container, etc.). Virtualization is a foundational element of cloud computing. Virtual machines provide a substitute for a physical computing system and the functionality needed to execute entire operating systems. Virtual machines are created and run by a hypervisor which uses native execution to share and manage hardware, allowing for multiple environments which are isolated from one another, yet can exist on the same physical computing system.
Containers are an operating system-level virtualization method for deploying and running distributed applications without launching an entire virtual machine for each application. Containers can look like real computers from the point of view of programs running in them. Generally, a computer program running on an ordinary operating system can see all resources (e.g., connected devices, files and folders, network shares, CPU power, etc.) of that computer. However, programs running inside a container can only see the container's contents and devices assigned to the container. Containers can be arranged, coordinated, and managed by container orchestration (e.g., Kubernetes, Amazon Elastic Container Service, Docker Swarm, and the like). In contrast to hypervisor-based virtualization, containers may be an abstraction performed at the operating system (OS) level, whereas virtual machines are an abstraction of physical hardware.
Client system 110A can include cryptography engine 112. Server system 120A can include cryptography engine 122 and process 124. Cryptography engine 112, cryptography engine 122, and/or process 124 can include any of an application-specific integrated circuit (ASIC), field programmable gate array (FPGA), application-specific standard product (ASSP), an electronic circuit, system on a chip (SoC), a processor (shared, dedicated, or group), and the like that executes one or more software or firmware programs, a combinational logic circuit, and/or other suitable components that provide the described functionality.
Cryptography engine 112 can encrypt plaintext A to ciphertext A′ using an encryption algorithm and an encryption key. Ciphertext A′ can be sent from client system 110A to server system 120A over communications link 130. Cryptography engine 122 can decrypt ciphertext A′ to plaintext A using the encryption algorithm and a decryption key.
In symmetric-key encryption schemes, the encryption and decryption keys are the same. In symmetric-key encryption schemes, source system 110A and destination system 120A should have the same key in order to achieve secure communication over communications link 130. Examples of symmetric-key encryption schemes include: Twofish, Serpent, AES (Rijndael), Blowfish, CAST5, Kuznyechik, RC4, 3DES, Skipjack, Safer+/++(Bluetooth), and IDEA.
In public-key encryption schemes, the encryption key (public key) is published for anyone (e.g., client system 110A) to use and encrypt messages. However, only the receiving party (e.g., server system 120A) has access to the decryption key (private key) that enables messages to be read. Examples of public-key encryption schemes include: RSA, ElGamal, Elliptic Curve Cryptography (ECC), and Cramer-Shoup.
Process 124A can be any operation/analytic performed (or application which works) on information (e.g., plaintext A). For example, process 124A can be a database search, Internet search, financial transaction, ecommerce transaction, word processing application, spreadsheet application, and the like. Process 124A can produce plaintext result B, which is encrypted by Cryptography engine 122 to produce ciphertext B′ using an encryption algorithm and an encryption key (e.g., same or different from the encryption algorithm and an encryption key used to produce ciphertext A′). Cryptography engine 112 can decrypt ciphertext B′ to plaintext B using the (corresponding) encryption algorithm and a decryption key.
Although depicted as separate systems, client system 110A and server system 120A can be a single system where ciphertext (encrypted or encoded information) is created, stored, and (subsequently) converted back to plaintext (readable information). Communications link 130 can be various combinations and permutations of wired and wireless networks (e.g., Ethernet, Wi-Fi, Bluetooth, mobile broadband, the Internet, etc.), internal/external computer busses, and the like, such as described in relation to
Unauthorized system 140 may intercept communications (e.g., data packets), such as ciphertext A′ and/or B′, over communications link 130. Unauthorized system 140 can be controlled/operated by unauthorized party UP who is not authorized to receive communications from client system 110A or server system 120A, seeks to breach defenses and exploit weaknesses in system 100, for example, for profit and information gathering. Ciphertext A′ and/or B′ are intended to be incomprehensible to unauthorized party BH (due to encryption). While communications between client system 110A or server system 120A can be protected in this way, information within server system 120A may be less secure.
Malware 220A can be software (and/or or hardware) installed in server system 120B by an unauthorized party UP, who does not have authorization to access server system 120B. Unauthorized party UP can gain access to server system 120B to install malware 220A (among other activities) by exploiting weaknesses in the configuration of server system 120B (e.g., unchanged default passwords, failure to install updates, incorrect security/access settings, zero-day exploits, etc.), social engineering, phishing emails sent to authorized users, compromised webpages visited by authorized users, and the like. Since malware 220A operates within server system 120B, malware 220A can gain access to plain text A and/or B (
By way of non-limiting example, malware 220A can be a spy-chip (circuit) inserted into server system 120C (e.g., in a motherboard of server system 120C) and have access to a processor(s) and memory (not depicted in
Server system 120C can also include secure environment 310A. Secure environment 310A is a protected area of server system 120C. For example, the memory in which cryptography engine 122C and process 124C (including associated computer instructions and data) are stored is not accessible to other modules in server system 120C. Process 124C can process encrypted data that is decrypted by cryptography engine 122C only inside secure environment 310A. In this way, malware 220B cannot access/alter program information and data (e.g., plaintext, encryption/decryption keys, program code, etc.) of cryptography engine 122C and process 124C.
Secure environment 310A includes special-purpose hardware and/or software to produce a protected area. For example, secure environment includes an integrated circuit (e.g., processor, SoC, and the like) with special-purpose instructions to establish a secure enclave (referred hereinafter as a security processor). The special-purpose instructions allow user-level code to allocate private regions of memory, called secure enclaves, that are protected from processes running at higher privilege levels. In other words, secure enclaves can be regions of memory (such as memory inside the security processor) that are cordoned off to run code that the operating system (and/or hypervisor, processor System Management Mode (SMM), direct memory access (DMA) from peripherals, etc.) on server system 120C cannot access and/or change. The secure enclave creates a safe haven for sensitive program and/or data, even if malware 220B or another malady compromises server system 120C. In some embodiments, the security processor incorporates cryptography engine 122C.
By way of non-limiting example, the security processor is separate from the main processor (e.g., application processor). By way of additional non-limiting example, secure environment includes a (special purpose) operating system which runs on the security processor separate from the main processor (e.g., application processor). By way of further non-limiting example, server system 120C includes support for secure environment 310A (security processor) in the Basic Input/Output System (system BIOS). System BIOS is non-volatile firmware used to perform hardware initialization during the booting process (power-on startup), and to provide runtime services for operating systems and programs. Server system 120C can be physical (e.g., a hardware server) and/or virtualized (e.g., virtual machine, container, and the like) computing environments.
By way of non-limiting example, secure environment 310A (security processor) can include a unique key (e.g., 64-bits to 1,024 bits long) peculiar to each instance of secure environment 310A (security processor) and which is used to generate cryptographic keys inside secure environment 310A (security processor). By way of further non-limiting example, security processor can include a (dedicated) memory encryption/decryption engine for encrypting/decrypting data stored in memory external to the security processor (e.g., main memory, external memory caches, and the like) and in mass storage (e.g., hard disk, solid-state drive (SSD), flash memory, etc.). By way of additional non-limiting example, secure environment 310A (security processor) can perform various cryptographic algorithms, such as (by way of non-limiting example) SHA-256, RSA-3072, RSA-2048, Elliptic Curve Digital Signature Algorithm (ECDSA), Elliptic-curve Diffie-Hellman (ECDH) (key-agreement protocol), Advanced Encryption Standard-Galois/Counter Mode (AES-GCM), Advanced Encryption Standard-Cipher-based Message Authentication Code (AES-CMAC), AES-CTR, custom cryptographic algorithms (e.g., Carter-Wegman message authentication code (MAC) combined with AES-CTR), and the like.
By way of non-limiting example, secure environment 310A (security processor) may include one or more of: AMD Platform Security Processor (PSP) (also known as AMD Secure Technology), AMD Secure Execution Environment, ARM TrustZone, Intel Trusted Execution Technology (Intel TXT), Intel SGX Software Guard Extensions, and the like.
Key exchange 320 can perform key exchange on the server system side (e.g., server system 120A and 120B). Key exchange is when cryptographic keys are exchanged between two parties, allowing use of a cryptographic technique(s). Processing unit(s) 330 can be physical and/or logical core(s)), which carry out the instructions of a computer program by performing the basic arithmetic, logical, control, and input/output (I/O) operations specified by the instructions.
Alternatively or additionally, key exchange 320—in lieu of using a two-party cryptographic key exchange algorithm to establish a shared secret—can use a trusted third party to choose the secret and provide it to both the client system (e.g., client system 110A in
Memory control 340 can set aside a special memory region (secure enclave), which is protected from memory access (e.g., by the kernel, hypervisor, management engine, and direct memory access (DMA) accesses from peripherals) except by the program using the special memory region. By way of non-limiting example, memory control 340 can perform address translation to isolate the secure enclave from less privileged pieces of software (e.g., applications and operating systems).
Secure enclaves can prevent other processes running on the same hardware from observing the contents of the operations executed in the secure enclave, or the contents of the secure enclave's memory. However, information about what the secure enclave process (e.g., process 124C in
Other processes (e.g., malware 220B in
Leakage prevention 350 can ensure that each call into the enclave takes the same amount of time, regardless of the conditions under which the process is called. In some embodiments, leakage prevention 350 can represent improvements to process 124C (
Other processes (e.g., malware 220B in
Leakage prevention 350 can ensure all memory accesses are performed using a technique known as Oblivous RAM (ORAM). This technique passes all memory accesses through a data structure that randomly shuffles memory blocks while performing each read or write, in such a way that an outside observer cannot tell which block was accessed without being able to decrypt their contents. In various embodiments, leakage prevention 350 can represent improvements to process 124C (
Cache 360 can be a hardware cache memory which can be used by compute 330 to store code and data for programs (e.g., process 124C in
Communications links 130B can be various combinations and permutations of wired and wireless networks (e.g., Ethernet, Wi-Fi, Bluetooth, mobile broadband, the Internet, etc.), internal/external computer busses, and the like, such as described in relation to
In various embodiments, the shared secret can be provided to the server system and the client system in a secure manner by a third-party key broker or service. According to some embodiments, the shared secret can be established through direct exchange between the server system and the client system (e.g., using symmetric and/or asymmetric key systems). By way of non-limiting example, the shared secret can be established using the Diffie-Hellmann key exchange (DHKE), such as used by the Intel Software Guard Extensions (SGX) attestation process.
The server system can detect and decrypt from among multiple specific encryption methods used and/or specified by the client system when the shared secret is established. The server system can decrypt service requests (step 530), perform the search or computational operation (step 540), and encrypt the service result (step 550) using the encryption method specified by the client system.
At step 520, an encrypted service request can be received from the client system. In some embodiments, the encrypted service request is a search request or a computational operation request such as an analytic, which is encrypted by the client system using the shared secret as the encryption key. The encrypted service request is received by the server system from the client system as an encrypted message.
At step 530, the server system passes the encrypted service request to the secure environment (e.g., secure environment 310A (
At step 540, a computation operation can be performed within the secure environment using the decrypted service request. According to various embodiments, the server system performs the computational operation specified by the service request within the secure environment and produces the service result (result of performing the search or analytic). The data over which the service request is processed can be encrypted, unencrypted, or a combination thereof. When the data is encrypted, the data may (only) be decrypted within the secure environment as the service request is evaluated.
At step 550, the service result is encrypted. In some embodiments, the server system encrypts the service results using the shared secret within the secure environment.
At step 560, the encrypted service results can be provided to the client system. In various embodiments, the encrypted service results are sent from the server system to the client system as an encrypted message. In accordance with some embodiments, the client system receives the encrypted service result from the server system and decrypts the encrypted service result using the shared secret to obtain the results of its service request.
In various embodiments, other software (e.g., malware 220B in
The systems and methods of the present technology are an improvement to computer-related technology. For example, the systems and methods of the present technology provide a technical solution to the security problems posed by malware on server systems/hosts.
The components shown in
Mass data storage 630, which can be implemented with a magnetic disk drive, solid state drive, or an optical disk drive, is a non-volatile storage device for storing data and instructions for use by processor unit(s) 610. Mass data storage 630 stores the system software for implementing embodiments of the present disclosure for purposes of loading that software into main memory 620.
Portable storage device 640 operates in conjunction with a portable non-volatile storage medium, such as a flash drive, floppy disk, compact disk, digital video disc, or Universal Serial Bus (USB) storage device, to input and output data and code to and from the computer system 600 in
User input devices 660 can provide a portion of a user interface. User input devices 660 may include one or more microphones, an alphanumeric keypad, such as a keyboard, for inputting alphanumeric and other information, or a pointing device, such as a mouse, a trackball, stylus, or cursor direction keys. User input devices 660 can also include a touchscreen. Additionally, the computer system 600 as shown in
Graphics display system 670 include a liquid crystal display (LCD) or other suitable display device. Graphics display system 670 is configurable to receive textual and graphical information and processes the information for output to the display device.
Peripheral device(s) 680 may include any type of computer support device to add additional functionality to the computer system.
The components provided in the computer system 600 in
Some of the above-described functions may be composed of instructions that are stored on storage media (e.g., computer-readable medium). The instructions may be retrieved and executed by the processor. Some examples of storage media are memory devices, tapes, disks, and the like. The instructions are operational when executed by the processor to direct the processor to operate in accord with the technology. Those skilled in the art are familiar with instructions, processor(s), and storage media.
In some embodiments, the computing system 600 may be implemented as a cloud-based computing environment, such as a virtual machine and/or container operating within a computing cloud. In other embodiments, the computing system 600 may itself include a cloud-based computing environment, where the functionalities of the computing system 600 are executed in a distributed fashion. Thus, the computing system 600, when configured as a computing cloud, may include pluralities of computing devices in various forms, as will be described in greater detail below.
In general, a cloud-based computing environment is a resource that typically combines the computational power of a large grouping of processors (such as within web servers) and/or that combines the storage capacity of a large grouping of computer memories or storage devices. Systems that provide cloud-based resources may be utilized exclusively by their owners or such systems may be accessible to outside users who deploy applications within the computing infrastructure to obtain the benefit of large computational or storage resources.
The cloud is formed, for example, by a network of web servers that comprise a plurality of computing devices, such as the computing system 600, with each server (or at least a plurality thereof) providing processor and/or storage resources. These servers manage workloads provided by multiple users (e.g., cloud resource customers or other users). Typically, each user places workload demands upon the cloud that vary in real-time, sometimes dramatically. The nature and extent of these variations typically depends on the type of business associated with the user.
It is noteworthy that any hardware platform suitable for performing the processing described herein is suitable for use with the technology. The terms “computer-readable storage medium” and “computer-readable storage media” as used herein refer to any medium or media that participate in providing instructions to a CPU for execution. Such media can take many forms, including, but not limited to, non-volatile media, volatile media and transmission media. Non-volatile media include, for example, optical, magnetic, and solid-state disks, such as a fixed disk. Volatile media include dynamic memory, such as system random-access memory (RAM). Transmission media include coaxial cables, copper wire and fiber optics, among others, including the wires that comprise one embodiment of a bus. Transmission media can also take the form of acoustic or light waves, such as those generated during radio frequency (RF) and infrared (IR) data communications. Common forms of computer-readable media include, for example, a floppy disk, a flexible disk, a hard disk, magnetic tape, any other magnetic medium, a CD-ROM disk, digital video disk (DVD), any other optical medium, any other physical medium with patterns of marks or holes, a RAM, a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically erasable programmable read-only memory (EEPROM), a Flash memory, any other memory chip or data exchange adapter, a carrier wave, or any other medium from which a computer can read.
Various forms of computer-readable media may be involved in carrying one or more sequences of one or more instructions to a CPU for execution. A bus carries the data to system RAM, from which a CPU retrieves and executes the instructions. The instructions received by system RAM can optionally be stored on a fixed disk either before or after execution by a CPU.
Computer program code for carrying out operations for aspects of the present technology may be written in any combination of one or more programming languages, including an object oriented programming language such as JAVA, SMALLTALK, C++ or the like and conventional procedural programming languages, such as the “C” programming language or similar programming languages. The program code may execute entirely on the user's computer, partly on the user's computer, as a stand-alone software package, partly on the user's computer and partly on a remote computer or entirely on the remote computer or server. In the latter scenario, the remote computer may be connected to the user's computer through any type of wired and/or wireless network, including a (wireless) local area network (LAN/WLAN) or a (wireless) wide area network (WAN/WWAN), or the connection may be made to an external computer (for example, through the Internet using an Internet Service Provider, wireless Internet provider, and the like).
The corresponding structures, materials, acts, and equivalents of all means or step plus function elements in the claims below are intended to include any structure, material, or act for performing the function in combination with other claimed elements as specifically claimed. The description of the present technology has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. Exemplary embodiments were chosen and described in order to best explain the principles of the present technology and its practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
Aspects of the present technology are described above with reference to flowchart illustrations and/or block diagrams of methods, apparatus (systems) and computer program products according to embodiments of the invention. It will be understood that each block of the flowchart illustrations and/or block diagrams, and combinations of blocks in the flowchart illustrations and/or block diagrams, can be implemented by computer program instructions. These computer program instructions may be provided to a processor of a general purpose computer, special purpose computer, or other programmable data processing apparatus to produce a machine, such that the instructions, which execute via the processor of the computer or other programmable data processing apparatus, create means for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
These computer program instructions may also be stored in a computer readable medium that can direct a computer, other programmable data processing apparatus, or other devices to function in a particular manner, such that the instructions stored in the computer readable medium produce an article of manufacture including instructions which implement the function/act specified in the flowchart and/or block diagram block or blocks.
The computer program instructions may also be loaded onto a computer, other programmable data processing apparatus, or other devices to cause a series of operational steps to be performed on the computer, other programmable apparatus or other devices to produce a computer implemented process such that the instructions which execute on the computer or other programmable apparatus provide processes for implementing the functions/acts specified in the flowchart and/or block diagram block or blocks.
The flowchart and block diagrams in the Figures illustrate the architecture, functionality, and operation of possible implementations of systems, methods and computer program products according to various embodiments of the present technology. In this regard, each block in the flowchart or block diagrams may represent a module, segment, or portion of code, which comprises one or more executable instructions for implementing the specified logical function(s). It should also be noted that, in some alternative implementations, the functions noted in the block may occur out of the order noted in the figures. For example, two blocks shown in succession may, in fact, be executed substantially concurrently, or the blocks may sometimes be executed in the reverse order, depending upon the functionality involved. It will also be noted that each block of the block diagrams and/or flowchart illustration, and combinations of blocks in the block diagrams and/or flowchart illustration, can be implemented by special purpose hardware-based systems that perform the specified functions or acts, or combinations of special purpose hardware and computer instructions.
The description of the present technology has been presented for purposes of illustration and description, but is not intended to be exhaustive or limited to the invention in the form disclosed. Many modifications and variations will be apparent to those of ordinary skill in the art without departing from the scope and spirit of the invention. Exemplary embodiments were chosen and described in order to best explain the principles of the present technology and its practical application, and to enable others of ordinary skill in the art to understand the invention for various embodiments with various modifications as are suited to the particular use contemplated.
The present application is a continuation of U.S. patent application Ser. No. 17/074,217, filed on Oct. 19, 2020 and titled “Computational Operations in Enclave Computing Environments,” which is a continuation of U.S. patent application Ser. No. 16/170,032, filed on Oct. 25, 2018, now U.S. Pat. No. 10,902,133 issued on Jan. 26, 2021, and titled “Computational Operations in Enclave Computing Environments,” all of which are incorporated by reference herein in their entireties.
Number | Date | Country | |
---|---|---|---|
Parent | 17074217 | Oct 2020 | US |
Child | 18133452 | US | |
Parent | 16170032 | Oct 2018 | US |
Child | 17074217 | US |