DOCUMENT VERIFICATION WITH ID AUGMENTATION

Abstract

At least one node in a distributed hash tree document verification infrastructure is augmented with an identifier of an entity in a registration path. A data signature, which includes parameters for recomputation of a verifying value, and which is associated with a digital input record, will therefore also include data that identifies at least one entity in the hash tree path used for its initial registration in the infrastructure.

Description

FIELD OF THE INVENTION

This invention relates to an electronic system and method for verifying that a document is authentic.

BACKGROUND

The ability to verify the authenticity of documents (defined broadly as any set of digitized information) in the electronic age has become more challenging at the same time as it has become more needed. Documents in electronic form are everywhere in modern banking, commerce, government, law, indeed, in modern life in general. In a world where documents are created, submitted, processed, stored, considered, etc., all electronically, sometimes even in multiple locations in the “cloud” unknown to the users themselves, notary or other official seals, physical signatures, special papers and other such tools are becoming increasingly unsuitable and unreliable.

Perhaps the most common way at present to verify the authenticity of electronic documents is to use some form of digital signature to “sign” them, which is typically accomplished using some form of asymmetric cryptography. Many different signing schemes are known that are suitable for signing both individual and sets of documents. At present, the most common data-signing methods rely on some form of the PKI (Public Key Infrastructure). A disadvantage of PKI-based digital signature schemes, however, is that the keys can be compromised; once a key is known to be compromised, any signatures created with that key can no longer be relied on. Since the likelihood that a key will become compromised increases over time, signatures created using keyed cryptography are useful mostly for a short-term purposes.

One other common method for verification involves publication, including, for example (but not necessarily) proof of an order of receipt using a sequence value bound to the digital record. When publishing is used to make a verifiable binding, the service provider typically publishes a digital record together with a sequence value in a widely-witnessed manner, for example, in a newspaper. If the service provider commits to certain rules regarding publication, then the published content can be relied upon as having been certified by the service provider. Since no cryptographic keys are used in the publication method, the problem of key compromise is not a concern. However, the publication method is inefficiently slow and unsuitable for large document collections. Publication is realistic daily or weekly, but instant certificate creation, though demanded by the modern electronic market, is impossible.

When it comes to verifying the authenticity of digital documents, regardless of whether the user cares about proof of receipt order or not, most existing methods have the serious flaw that users must in some way trust some service provider and/or clock at some point. In short, one or both of two common problems beset known authentication schemes: either there must be some “trust authority” or the systems are not amenable to extensive scalability.

Guardtime AS of Tallinn, Estonia, provides a keyless, distributed hash tree-based data signature infrastructure that it currently refers to as the Keyless Signature Infrastructure (KSI). The KSI infrastructure provides a robust and scalable verification system that does not require a trusted authority and, as its name implies, does not need to rely on keys. Although such a distributed, hash tree-based infrastructure (Guardtime's or otherwise) can verify the authenticity of a given document to a very high degree of certainty (especially Guardtime's), in many cases it may be desirable to be able to verify not only the contents of a given document, but also to identify one or more of the entities involved in the original document-registration process.

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 illustrates various layers of a generalized digital record verification and signing infrastructure.

FIG. 2 illustrates the verification infrastructure along with various data and computational structures maintained and computed within the different layers.

FIG. 3 shows a subset of FIG. 2 to illustrate a digital signature and recomputation of authentication values using the signature.

FIG. 4 illustrates publication to create a permanent trust-free authentication feature.

FIG. 5 illustrates extension of a digital signature to enable system-independent authentication by recomputation.

FIG. 6 illustrates self-ID augmentation of the verification infrastructure.

FIG. 7 illustrates assigned-ID augmentation of the verification infrastructure.

FIG. 8 illustrates the verification infrastructure in terms of the main hardware components that will typically be used to implement aspects of the invention, as well as different ways to enable user-controlled identification.

DETAILED DESCRIPTION

To understand how ID augmentation of a verification infrastructure operates, it's helpful first to understand how the “bare” infrastructure works to enable document authentication. By way of example, a keyless, distributed, hash tree-based infrastructure as provided by Guardtime AS will therefore first be described, after which are described two different modifications to such an infrastructure to enable verifiable identification of any or all of the entities that participated in registration of a given document.

FIGS. 1 and 2 show the general Guardtime KSI infrastructure as having several different layers: a client layer 2000 comprising a number of client systems; a layer of gateways 3000; a layer including one or more aggregation systems 4000; and an uppermost layer 5000 that includes a “core”. Although FIG. 1 shows the various layers as being separate and distinct, some implementations of the main principles of the infrastructure might consolidate or do without some of the layers or might need to add additional layers for administrative or other purposes.

As FIG. 1 also illustrates, the core layer 5000 will in general be common to all users of the system and typically operated by a highest-level administrator/provider, whereas lower, subordinate layers 2000, 3000, 4000 will in many implementations have a unique configuration depending on the needs and preferences of users. The distinction between “core/common” and “unique/distributed” is not hard and fast, however—in some implementations, the core, that is, centrally administered system, will encompass structures and functions that also are used in lower layers. One of the advantages of this infrastructure is that it allows for almost unlimited scalability and reconfiguration of the non-core layers to meet particular implementation needs. All that is required is that the various layers perform the specified functions, with common protocols for entering a digital record into the verification system and for generating registration requests.

As FIG. 1 shows functionally and FIG. 8 shows in terms of hardware, a gateway in the layer 3000 will typically be a computer system such as a server with which one or more of the clients communicates, over a network or dedicated line, so as to receive requests for registration of each digital record that a client submits. In many implementations, a gateway will be a server controlled by an enterprise or some third-party provider, which may be a server known to and maybe even controlled by an organization to which the client user belongs, or a server accessed through a network such as the Internet. In short, a gateway may generally be any server located anywhere and configured to receive requests from clients for digital record registration. Gateway systems do not need to be of the same type; rather, one gateway might be a server within a company that employs many clients, whereas another gateway might be a server accessible online by arbitrary users. Of course, gateways could also be commercial systems, such that access for verification is granted only upon payment of a fee.

An aggregator in the aggregation layer 4000 will similarly be a computer system such as a server intended to receive registration requests, again, typically over a network or dedicated line, that have been consolidated (or “aggregated”) by respective gateways. Depending upon the scale and design requirements of a given implementation, any aggregator could also be controlled by the owner of the core, or the owner of the same systems as the gateways and clients, or could be provided by an entirely different entity, and in some cases it would also be possible to consolidate the aggregator and gateways for particular set of clients.

As an example, large corporations or government entities might prefer to implement and benefit from the advantages of the infrastructure using only their own dedicated systems. Nearer the other end of the spectrum of possibilities would be that the gateways and aggregators could all be configured using “cloud computing” such that a user at the client level has no idea where any particular gateway or aggregator is located or who controls the servers. One of the advantages of this infrastructure is that digital input records can still be verified with near total security even in situations where users and others do not know if they can trust the systems in the gateway or aggregation layers 3000, 4000; indeed, it is not even necessary to trust the administrator of the core 5000 in order to have essentially total reliability of verification.

The different terms “aggregator” in layer(s) 4000 and “gateway” in layer(s) 3000 are not intended to imply that the systems (such as servers) that comprise them are functionally significantly different—a gateway “aggregates” the requests of the clients it serves and as such could be viewed as a “local” or “lower level” aggregator in its own right. In many implementations, however, gateways may be under the control of entities more closely associated with the clients and aggregators will be more closely associated with the overall system administrator that maintains the core. This is also not a hard and fast distinction, however.

FIG. 2 shows the infrastructure of FIG. 1 in more detail. In particular, FIG. 2 illustrates various data structures used in the authentication process. In FIG. 2, the various clients are represented as 2010-1, . . . , 2010-n; gateways are represented as 3010-1, 3010-2, . . . , 3010-m; and two (by way of example only) aggregators are shown as 4010-1, 4010-k. An aggregator will typically communicate into each of the lowest level hash tree nodes within the core. Only two aggregators are shown in FIG. 2 for the sake of simplicity.

In one implementation, each client system that wishes to use the verification infrastructure is loaded with a software package or internal system routines for convenient or even automatic communication and submission “upwards” of digital information. The software package may include some application program interface (API) 2014 that transforms submitted digital records into a proper form for processing. A digital record 2012 created, selected, or otherwise input in any way is then submitted by way of the API 2014 to a software module 2016 that uses the digital data from the record 2012 as at least one argument in a transformation function such as a hash function.

Cryptographic hash functions are very well known in many areas of computer science and are therefore not described in greater detail here. Just one of many possible examples of a common class of hash functions that are suitable for use in this infrastructure are the various “secure hash algorithm” family (SHA-1, SHA-2, etc.).

Additional hashing within the client may be desired to include additional information depending on the design protocol of the infrastructure. Just a few of the many possible arguments the system designer might optionally choose to include as arguments of the additional hash function 2016 are an identifier of the person or entity requesting registration, an identifier of the particular client system being used, a time indication, information relating to the geographic location of the client or other system, or any other information desired to be incorporated as part of the registration request. A software module 2020 is preferably included to transmit the output of the transformation 2016 to higher layers of the infrastructure as a request (REQ), along with any other parameters and data necessary to communicate with a gateway and initiate the registration request.

It is assumed in this discussion that the transformation function 2016 is a hash function because this will be the most common and efficient design choice, and also because the properties of hash functions are so well understood; moreover, many different hash functions are used in the field of cryptology, security, etc., within commodity computers. One other advantageous property of hash functions is that they can reduce even large amounts of digital information to a size that is more easily processed, with a statistically insignificant chance of two different inputs leading to the same output. In other words, many well-known hash functions will be suitable for use throughout this infrastructure, and can be chosen using normal design considerations. Nonetheless, the function that transforms digital records into a form suitable for submission as a request need not be a hash function as long as its properties are known. For example, especially for small digital records, it may be more efficient simply to transmit the digital record data as is, in its entirety or some subset; in this case, the transformation function may simply be viewed as an identity function, which may then also append whatever other additional information is needed according to the core system administration to form a proper registration request.

The data structure of a binary hash tree is illustrated within the gateway 3010-2. Each of the lowest level nodes will correspond to the transformed dataset 2018 submitted as a request from a client, along with any other parameters or data used in any given implementation to form a request. As illustrated, the values represented by each pair of nodes in the data structure form inputs to a parent node, which then computes a combined output value, for example, as a hash of the two input values from its “children” nodes. Each thus combined output/hash value is then submitted as one of two inputs to a “grandparent” node, which in turn computes a combined output/hash value for these two inputs, and so on, until a single combined output/hash value is computed for the top node in the gateway.

Aggregators such as the system 4010-1 similarly include computation modules that compute combined output values for each node of a hash tree data structure. As in the gateways, the value computed for each node in the aggregator's data structure uses its two “children” nodes as inputs. Each aggregator will therefore ultimately compute an uppermost combined output value as the result of application of a hash function that includes information derived from the digital input record(s) of every client that submitted a request to a gateway in the data structure under that aggregator. Although it is of course possible, the aggregator layer 4000 does not necessarily need to be controlled by the same system administrator that is in charge of the core layer 5000. In other words, as long as they are implemented according to the required protocols and use the correct hash functions (or whatever other type of function is chosen in a given implementation), then the client, gateway, and aggregation layers may be configured to use any type of architecture that various users prefer.

In one embodiment, the core 5000 is maintained and controlled by the overall system administrator. Within the core, a hash tree data structure is computed using the root hash values of each aggregator as lowest level inputs. In effect, the hash computations and structure within the core form an aggregation of aggregation values. The core will therefore compute a single current uppermost core hash value at the respective tree node 5001 at each calendar time interval t0, t1, . . . , tn. This uppermost value is referred to here alternatively as the “calendar value” or “current calendar value” for the time interval. Note that the time origin and granularity are both design choices.

Note that the uppermost tree node 5001 represents the root node of the entire tree structure of nodes junior to it. As is explained later, this will change upon recomputation of a new uppermost core hash value at the end of the next period of accumulating requests and generating signature vectors (“also referred to as “data signatures”) containing recomputation parameters.

As system designers will understand, the various computational and administrative modules within clients, gateways, aggregators and the core itself comprise computer-executable instructions that may be provided, stored, loaded and executed from any known computer-readable storage medium, including downloading the code over a network into memory or other storage units, on physical media such as CD-ROM or other disks, on optical or magnetic storage media, on flash or other RAM-based memory devices, etc.

In FIG. 2, certain ones of the hash tree nodes in the gateway 3010-2, the aggregator 4010-1, and the core 5000 are marked with an “X”. Notice if one traverses the various tree paths upward from the value 2018 in the client 2010-1, it is possible to compute every value upward in the tree structures all the way to the most current uppermost core value 5001 given the values in the X-marked tree nodes (the siblings of the nodes in the direct recomputation path) and a knowledge of the hash functions applied at each successive parent node. In short, if a signature is associated with the digital record 2012 that includes all of the “X marked” values, and assuming predetermined hash functions (which may of course be the same or different functions), then re-computation of the hash values upward through all of the tree structures will yield the same value as in the current calendar value, but only if the starting input value representing the original digital record is in fact identical in every respect to the original. Even the slightest alteration to the digital input record of even a single bit in any of the values of the signature associated with a record 2012 will lead to a re-computed calendar value that is not identical to the one in node 5001. Note also that each uppermost computed value in the core—the current calendar value—contains information derived from every digital input record that is input into the system during the current calendar time interval.

FIG. 3 illustrates the “reduced” infrastructure whose hash tree node values contain the information necessary to recompute the hash tree path all the way to the top of the system to the value in node 5001. It is not necessary for the recomputation to be carried out in any gateway, aggregator or the core; indeed, it is not even necessary for recomputation to take place within the same client 2010-1 that originally submitted the verification request for the digital record 2012. All that is necessary is the vector containing the “sibling” tree values at each level, as well as knowledge of which hash functions are used to compute each parent node. In other words, given this information, even a third-party would be able to perform the recomputation and compare with the node value 5001 and thereby either to authenticate any given representation of what is supposed to be digital record 2012, or to detect any difference.

In FIG. 3, the sibling hash values needed for recomputation are numbered 0-9. If nodes are created in time order, and if order is important in the chosen hash function, then whether a sibling at each level is to the “right” or “left” in the hash structure will be relevant. In the example shown in FIG. 3, not only the value but also the order (0: from left, 1: from right) is indicated in the vector ({sibling values 0-9},{order bits},{other}) returned along with any other chosen information as the data signature 8000. At this point, one may see one advantage of using a binary hash tree structure: at each level, there will be only one sibling value needed for upward recomputation. Although a non-binary tree structure would be possible, one would then have to accept the increased computational, storage, and data-structural complexity. Comparing FIG. 2 and FIG. 3, one can also see that the computational burden to validate one of a set of N digital input records at any given time interval is proportional to only log₂N. To increase independence of the various layers—in particular, clients and later entities wishing to perform authentication through recomputation—it is advantageous for the entire calendar to be passed to the aggregators and even to the lower layers, even as far as to clients, every time a new calendar value is computed, that is, at the end of each calendar time interval. This then allows delegation and distribution of the computational workload without any compromise of the integrity of the system. FIG. 1 therefore shows a database or file (the “calendar”) 6000 that includes all calendar values from the beginning of system time. This would allow new aggregators, gateways and clients to join the infrastructure with minimal administrative burden and would enable recomputation and authentication of any digital record without having to involve levels higher than the client-level entity wishing to authenticate the digital record.

When the core computes the current calendar value 5001 at the new calendar time interval, it may return to aggregator 4010-1 its sibling (X-marked) lowest core node value from aggregator 4010-k, and the aggregator 4010-1 can then return downwards the X-marked hash values to the gateway 3010-2, which in turn can return downwards to the client 2010-1 all of the above, plus the X-marked hash values computed within that gateway's hash tree structure. In other words, not only may the hash computation infrastructure be distributed over various layers (vertically) and also “horizontally” at each layer, but the responsibility for communicating requests upward and partial or entire signature vectors downwards can also be distributed and can be carried out simultaneously in many different locations. Since a data signature is unique to the digital record that led to it, the procedure for returning a signature vector for each input digital record 2012 for client 2010-1 (note that a single client may input more than one digital record for verification in each time interval) is preferably duplicated for all digital input records received in the time interval over which values were accumulated for the computation of node value 5001.

The nature of the distributed infrastructure shown in FIG. 2 does not need to be static from one time interval to the next. Rather, each of the components below the core can be built asynchronously and independently of others; all that is needed for authenticating recomputation from a digital record up to the corresponding calendar value is the transformation function and other values that made up the original request, the vector of hash tree sibling values and knowledge of which hash functions are to be applied at each computation. Of course, the simplest case would be that the same hash function is used at every level. A somewhat more complicated choice would be to use the same hash function for all computations on a given level (within clients, within gateways, within aggregators, etc.) with variation between levels. Other even more complicated choices may of course be made as will be realized by those skilled in the art of such data structures and hash function computations. As long as the hash function used for each computation is known, the infrastructure will be able to validate a given input record.

In most cases, it is unlikely that the number of clients during a given computation interval will be exactly equal to a power of 2. Any known method may be used to adapt to the actual number of clients while still maintaining a binary hash tree structure throughout. As just one example of a solution to this, known dummy values may be used for all of the “missing” sibling node values. Alternatively, it is also possible to adjust the hash tree branches accordingly, in the manner of giving “byes” in single-elimination sports tournaments.

In one embodiment, the gateways 3000 may be more local to various clients whereas the aggregators are more regional. For example, it would be possible to locate aggregators in different parts of the world not only to distribute the workload, but also to increase throughput. Although it appears in FIGS. 1-3 that clients are associated with a particular gateway and gateways are associated with a particular aggregator, this is not necessary. Rather, client requests could be submitted over a network, and the first gateway that responds could then be associated with that client for that authentication transaction. Similarly, requests from gateways could be submitted to an open network and processed by whichever aggregator first establishes a connection. Locating aggregators and gateways both physically and logically in an efficient manner will therefore typically better distribute workload and reduce latency. This may not be desired in other implementations, however. For example, entities such as the government, defense contractors, or companies that wish to maintain strict security and tight control of the entire infrastructure could control and specify the relationship between all of the layers of the infrastructure, or any subset of these.

Assume now by way of example that some entity later wishes to verify that a digital record in question—a “candidate digital record”—is an identical copy of digital record 2012. Applying the same transformation function 2016 to the candidate digital record and recomputing upward using the corresponding data signature 8000, the entity should compute to the exact same calendar value that resulted from the original digital record's registration request. In some implementations, this level of verification is sufficient. As one possible example, if the calendar is distributed to enough independent aggregators, then if one malicious actor were to tamper with some calendar value, this could be detected if some procedure is implemented to compare with other copies of the same calendar.

As another example, in some implementations, users may choose or be obligated to rely on the security of the administrator of the core. In particular, government entities might implement a system in which users must simply rely on the government administrators. In these cases, recomputation up to the corresponding calendar value may be considered sufficiently reliable authentication. In the context of this infrastructure, this can be viewed as “first-level” verification. One hypothetical example of where such a system might be implemented would be where a government agency requires companies, laboratories, etc. to submit a copy of its calendar to the government entity every time the company's system updates its calendar. The government would then be able to audit the company's records and verify the authenticity of any given digital record by recomputing up to the proper calendar value, which the government will have stored. In practice, this would amount to requiring the company to keep updated a “calendar audit trail” with the auditing entity (such as the government).

Even in other instances, as long as the highest level system administrator trusts its ability to securely store calendars, it could be satisfied that a candidate digital record is authentic if recomputation leads to the appropriate stored calendar value. In a sense, it would be the system administrator itself in such cases that is looking for proof of the authenticity of candidate digital records as opposed to clients or other third-party entities. Consequently, the system administrator could trust the security of the recomputation and calendar values to the same extent it trusts itself to maintain the calendar copies.

All but the last digital record requesting registration in a calendar time period will typically need to wait for all other requests in the calendar time interval to be processed before a calendar value will be available that will enable authenticating recomputation. If the calendar time interval is kept short enough, this delay may be acceptable. To increase the level of security during the delay, it would also be possible to implement an option, whenever a client submits an authentication registration request, to generate and return not only the data signature vector but also a key-based signed certificate, which may be issued by any higher layer system such as the current gateway, aggregator, or even core.

FIG. 4 illustrates an extension of the basic calendar-reliant verification process that provides “second-level” verification that is a method for permanent verification with no need for keys or trust of any entity, not even the administrator of the core. In FIG. 4, all of the calendar values computed over a publication time interval Tp are themselves used as inputs to an additional hash tree structure that is preferably hashed together (for example, using a known Merkle tree structure) with previous calendar values to compute a composite calendar value (a “publication value”) that may then be submitted for publication in some medium 7000 such as a newspaper, online posting, etc., that forms an unchangeable record of the composite calendar value. Here, the term “unchangeable” means that it would be practically impossible for even the most malicious actor—even if this is the core administrator—to alter every publicly available occurrence of the value. It is not necessary for “published” to be in any medium accessible to the general public, although this is of course one option that removes all need for a trusted authority; rather, a large or perhaps closed organization that implements the entire infrastructure on its own might simply choose to keep a database or journal of the composite calendar values in some secure logical or physical location.

Because of the various data structures and procedures of the distributed infrastructure, the published composite calendar value may encode information obtained from every input digital record over the entire publication time interval, and if the current calendar value for the current calendar period is hashed together with the previous one, which is hashed with the one before it, and so on, as shown in FIG. 4, then each published composite calendar value will encode information from every digital record ever submitted for registration from the beginning of calendar time at t0. This guarantees the integrity of the entire system: Changing even a single bit in a single digital record registered in the past will cause a different publication value to be computed, which would then not match the actual publication value. Once the composite signature value (that is, the publication value) is published, there is never again any need to temporarily associate any signed digital certificate (which might be provided as before to increase security until the composite value is published, at which point it will not be needed) with the signature vector of the corresponding digital input record; rather, using the data signature vector and the calendar values (which are advantageously stored in each of the aggregators), one can then recompute hash values upward from any digital input record all the way to the published value. If the digital input record used in such recomputation leads to a match with the published value, then one can be certain to within the degree of certainty of the hash functions themselves that the digital input record being tested is identical to the one that originally received the corresponding signature vector.

FIG. 5 illustrates an optional extension of the signature vector to include the values obtained during computation of the publication value as well. Assume as before that the “X-marked” nodes are the sibling hash values for the digital record corresponding to the request REQ from client 2010-1. The X-marked values are sufficient to recompute the calendar value marked “C”, but the hash values in the nodes marked “E” in the data structure (in FIG. 5, the Merkle tree structure) within the core that converts calendar values into the publication value are necessary to recomputed all the way up to the published value 7000. At the end of the calendar period, the core therefore preferably extends or augments the signature vectors to include the “E” values, along with corresponding order bits as previously. With such an extended signature, any party can verify the authenticity of a given digital record as long as it has the extended signature vector, knowledge of the hash (or other) functions used, and the corresponding publication value—if recomputation leads to a match, then the digital record must be identical to the original; if not, then something has been altered. Note also that any change of order in the time of receipt for any two digital input records will also affect the computed values in the core as well as the published composite signature value.

In FIG. 4, eight calendar values are shown in each publication time interval Tp. In other words, in the illustration, the number of calendar time intervals in each publication time interval Tp is conveniently a power of 2. This may not be so in other implementations, depending on the choice of intervals. For example, if a calendar value is generated each second, but publication occurs only once every week (604,800 seconds), then there will not be a power of 2 number of calendar values as leaf nodes of the Merkle tree structure. As in other trees, this can be handled in a known manner as in giving “byes” in single-elimination sports tournaments by adjusting the tree branches, by using “dummy” inputs, etc.

Although it may in many cases be desirable or even required for the published value to encode information from the entire calendar from the beginning of calendar time, other alternatives can also be implemented as long as suitable bookkeeping routines are included. For example, rather than include all calendar values in the Merkle tree, at each publication time all of the most recent calendar values could be included in the publication computation along with a random sampling of calendar values from previous intervals. This would be one way, for example, to ensure that the number of included calendar values is conveniently a power of 2.

Similarly, in some contexts, government authorities require proof of records extending back only for some given time such as three years. In such cases it might be advantageous always to include only calendar values generated during this required period such that only relevant digital records are encoded in the most recent publication value.

Another alternative would be for there to be only a single computation of the publication value, including all calendar values from the beginning of system time. This might be useful, for example, in projects with clear time or digital record limits. For example, in litigation or transactions, parties often submit digital records to a “data room” for easy exchange. Calendar values could then be generated periodically as in other cases (perhaps with a longer calendar time interval since digital records will generally not be submitted as frequently as in large-scale, universally accessible implementations of the infrastructure's infrastructure), but with only a single computation of a publication value when all parties agree to close the data room. The publication value would then be a form of “seal” on the body of submitted digital records, which could later be used for recomputation and verification of any digital record ever submitted into the data room.

It is not absolutely necessary for the publication value to be computed using the Merkle hash tree data structure illustrated in FIG. 4. One alternative might be, for example, that all calendar values over the publication time interval are concatenated and then hashed as a whole together with a pseudorandom number, which then becomes part of the extended data signature vectors.

It is not a requirement for systems in any given layer to apply the same hash functions. For example, the transformation functions used in different client systems could be different. As long as the functions at each place in the recomputation path are known to whoever later wants to authenticate a digital record through recomputation, the authentication process will work properly. Adding a hash function identifier as an input parameter to the preparation of the registration request would be one convenient way to enable future users to correctly authenticate a digital record through recomputation.

The general verification infrastructure thus allows for provable authentication of particular documents, but the described data signature does not necessarily encode data that identifies which entities (such as which gateway(s), which aggregator(s), etc., took part in the registration of the document in the system, that is, in the creation of the document's data signature. As long as the hash function is known at each node of the tree, as well as the other immediate child of the node and, if the hash function inputs are non-commutative, the order (for example, left, right), it will be possible to verify a document using recomputation regardless of any information specific to the originally computing entities.

FIG. 6 illustrates a “self-ID embodiment” in which all or at least some of lower-level entities (in the illustrated example, gateways 3010-1, . . . , 3010-m) each include either a memory/storage value or other component ID1, . . . , IDm, respectively, that encodes an identifier for the entity. The identifiers may have a standard format, or may be generated by each entity according to its own conventions, as long as each identifier is in the proper form to be hashed together with the uppermost value (for example) of the sub-hash tree computed within the entity. In other words, the value passed “upward” in the hash tree from each such entity to the entity immediately superior to it in the tree hierarchy will be a hash of the otherwise computed uppermost value and the entity's identifier. The result of this augmentation of the hash tree computation with the ID “nodes” ID1, . . . , IDm is that the data signature for every document in the hash tree below the level of each respective entity will encode the identifier for that entity. Recomputation for verification of each such document will therefore require knowledge of the proper ID value ID1, . . . , IDm. In other words, successful recomputation will necessarily involve identification of each entity in a document's recomputation path for which an identifier node is implemented. (More than one entity in a path may have its own unique identifier.)

As FIG. 6 illustrates, the identifier ID1, . . . , IDm for each entity is preferably communicated upward to the next higher entity, which may include a storage component 4100 to keep track of the identifiers of the entities that “report” to it, that is, of its “child” entities. Although not strictly necessary for document-verifying recomputation, this will often be desirable for administrative and security reasons.

For administrative ease, the identifier for each entity may be fixed, but this is not necessary. For example, identifiers for an entity could be generated or changed according to a schedule, or according to some generating function, or even randomly, or include a time marker, as long as the identifier in use for the computation of a given data signature is known and associated with the entity at the time it was in use. The set (possibly time-varying or dependent on other designer-chosen parameters) of identifiers is then preferably maintained in the parent entity, such as in component 4100 for the sake of identity validation if necessary.

It is also not necessary for the component that generates or otherwise provides the identifier for a given entity to be a purely software component such as a memory or storage location or the output of a computation module. For example, the identifier for a gateway could be stored and encoded or generated in a hardware security key 3012 (FIG. 8), such as a “token” or “dongle”, magnetically, optically, RFID or otherwise encoded ID tag or badge, or even simply in a flash or similar memory device. Note that such a key would not be a “key” in the sense of PKI, so the infrastructure as such would still be keyless in the cryptographic sense; rather, the hardware key would function merely to input an identifier. It would be possible, however, for the identifier itself to be a PKI signature; the overall infrastructure would still not depend on any system of private/public keys. Additionally, it would also be possible that, in using PKI-based signing in the identifier, a HSM (hardware security module) could also be included that may demand a password or some biometric authentication, for example, to be re-enabled after a reboot of the respective entity. Regardless of the chosen implementation, such an “externally” provided or influenced identifier (in whole or in part) could function as a key to “unlock” or “activate” a particular entity in a registration path—for example, without insertion of the key with a valid (determined in any known manner) identifier, a gateway could be disabled from participating in document registration.

The identifier ID1, . . . , IDm could also be an input entered by an operator via a keyboard or other type of console 3011 (FIG. 8), thereby functioning as a form of identifying password that participates in the uppermost hash operation of an entity. The identifier could therefore encode not only information identifying the hardware entity (such as the server that implements a gateway or aggregator, etc.), but also the individual who has activated the entity for participation in the hash tree infrastructure. The identifier for an entity could also be provided by another entity higher up in the infrastructure hierarchy, for example, by an entity's parent (such as by an aggregator to a gateway, or even by the overall system administrator to all member entities in the infrastructure). Even in such a case, however, the configuration illustrated in FIG. 6 is referred to here as “self-ID augmentation” of the hash tree with an identifier node because the hash computation that involves the entity's identifier node occurs within the entity itself.

FIG. 7 illustrates an “assigned-ID augmentation” embodiment of the hash tree infrastructure. In this embodiment, the identifier for each child entity that is to be provided with one is assigned to the entity by its parent. In the example shown in FIG. 7, the identifiers ID1, . . . , IDm for gateways 3010-1, . . . , 3010-m are assigned to them by their common aggregator 4010-1. In this embodiment hashing of each identifier with the respective uppermost value of each gateway (the child entity in the illustrated example) occurs in the aggregator (the parent entity). As indicated by the dashed arrows, the parent entity may communicate the identifier for each entity to that entity, although this would not be necessary to enable authenticating recomputation for a candidate document (digital record). Thus, in this embodiment, all entities up to the level that assigns identifiers may function as before, possibly not even aware that they are identified within the data signatures of digital records in whose computation/recomputation paths they lie. Note that at least the network identity of child entities will be known to parent entities as a consequence of standard network protocols. Other known techniques may also be used over the network connection to identify the child entities, which will typically be servers.

Although hash node augmentation is illustrated in gateways and lowermost aggregators, respectively, in FIGS. 6 and 7, it may of course be implemented at any level, and indeed in more than one level at a time. Each identifier, when included in a data signature, will encode one part of the registration path in the hash tree for the digital record the data signature is associated with. The more entity identifiers are included, the more the path will be provably included in a data signature.

Claims

1. A method for authenticating digital records, comprising: receiving a current highest-level combined output value that is formed as digital combinations of successively lower-level combined output values computed in subordinate entities as node values of a tree data structure having lowest level inputs formed as digital transformations of digital input records input by user-level entites;computing a current calendar value as a digital combination of the current highest-level combined output values;returning the current calendar value to at least one subordinate entity, whereupon recomputation parameters are distributed downward to the user-level entities for association with respective ones of the digital input records such that an arbitrary subsequent test digital record is considered authenticated relative to the corresponding digital input record if, applying the corresponding digital transformation to the test digital record and, using the recomputation parameters to recomputed the node values upward through the tree data structure, the same current calendar value is attained as when it was originally computed with the corresponding digital input record forming the lowest level input; andcomputing an augmented node value in at least one of the subordinate entities as a digital combination of a corresponding one of the lower-level combined output values and an entity identifier, whereby the recomputation parameters distributed to entities subordinate to the entity associated with the identifier encode the identity of the identified entity in a recomputation path.

2. A method as in claim 1, in which the digital combinations are hash functions.

3. A method as in claim 1, in which the identifier is time-dependent.

4. A method as in claim 1, in which the augmented node is computed in the entity that the identifier is associated with.

5. A method as in claim 1, in which the identifier is provided from a hardware security key device.

6. A method as in claim 1, in which the identifier is provided by user input.

7. A method as in claim 1, in which the identifier for a subordinate entity is assigned to it by an immediately superior entity, in which the augmented node is computed in the superior entity using the identifier assigned to the subordinate entity.

8. A system for enabling authentication of digital records, comprising: a core system including modules: for receiving a current highest-level combined output value that is formed as digital combinations of successively lower-level combined output values computed in subordinate entities as node values of a tree data structure having lowest level inputs formed as digital transformations of digital input records input by user-level entites;for computing a current calendar value as a digital combination of the current highest-level combined output values; andfor returning the current calendar value to at least one subordinate entity, whereupon recomputation parameters are distributed downward to the user-level entities for association with respective ones of the digital input records such that an arbitrary subsequent test digital record is considered authenticated relative to the corresponding digital input record if, applying the corresponding digital transformation to the test digital record and, using the recomputation parameters to recomputed the node values upward through the tree data structure, the same current calendar value is attained as when it was originally computed with the corresponding digital input record forming the lowest level input;in which:the current highest-level combined output encodes at least one augmented node value computed in at least one of the subordinate entities as a digital combination of a corresponding one of the lower-level combined output values and an entity identifier, whereby the recomputation parameters distributed to entities subordinate to the entity associated with the identifier encode the identity of the identified entity in a recomputation path.

9. A system as in claim 8, in which the digital combinations are hash functions.

10. A system as in claim 8, in which the identifier is provided from a hardware security key device.

11. A system as in claim 8, in which the identifier is provided by user input.

12. A system as in claim 8, in which the augmented node is computed in the entity that the identifier is associated with.

13. A system as in claim 8, in which the identifier for a subordinate entity is assigned to it by an immediately superior entity, in which the augmented node is computed in the superior entity using the identifier assigned to the subordinate entity.

14. A computer readable storage medium having data stored therein representing software executable by a computer, the software including instructions to enabling authentication of digital records, the storage medium comprising: instructions for receiving a current highest-level combined output value that is formed as digital combinations of successively lower-level combined output values computed in subordinate entities as node values of a tree data structure having lowest level inputs formed as digital transformations of digital input records input by user-level entites;instructions for computing a current calendar value as a digital combination of the current highest-level combined output values; andinstructions for returning the current calendar value to at least one subordinate entity, whereupon recomputation parameters are distributed downward to the user-level entities for association with respective ones of the digital input records such that an arbitrary subsequent test digital record is considered authenticated relative to the corresponding digital input record if, applying the corresponding digital transformation to the test digital record and, using the recomputation parameters to recomputed the node values upward through the tree data structure, the same current calendar value is attained as when it was originally computed with the corresponding digital input record forming the lowest level input;in which:the current highest-level combined output encodes at least one augmented node value computed in at least one of the subordinate entities as a digital combination of a corresponding one of the lower-level combined output values and an entity identifier, whereby the recomputation parameters distributed to entities subordinate to the entity associated with the identifier encode the identity of the identified entity in a recomputation path.

15. A storage medium as in claim 14, further comprising computer-executable instructions for computing the digital combinations as hash functions.

16. A storage medium as in claim 14, further comprising computer-executable instructions for including a function of time in the identifier.

17. A storage medium as in claim 14, further comprising computer-executable instructions for computing the augmented node in the entity that the identifier is associated with.

18. A storage medium as in claim 14, further comprising computer-executable instructions for inputting the identifier from a hardware security key device.

19. A storage medium as in claim 14, further comprising computer-executable instructions for inputting the identifier via user input.

20. A storage medium as in claim 14, further comprising computer-executable instructions for assigning the identifier for a subordinate entity from an immediately superior entity and for computing the augmented node in the superior entity using the identifier assigned to the subordinate entity.