Patent Application
20150040184
1. Field of the Disclosure
The disclosure relates to methods and architectures of packing or enveloping data for cloud storage and transport using Wavefront multiplexing (WF muxing). It is focused to appearance of data package/envelop and reliability of enclosed data. Specifically, it relates to enveloping digital data for digital data management on software transactions, entertainment product distributions, legal data, medical data access and management, and many other private data applications which require identifiable accessing features; such as identities of who, where, when, and how.
According mail-on-line (http://www.dailymail.co.uk) on Aug. 31st, 2014, naked images of high-profile actors, models, singers and presenters have been leaked online in an apparent hacking leak linked to the Apple iCloud service. The photos appeared after a user on 4chan, an image sharing forum, posted private pictures of 101 celebrities including Jennifer Lawrence, Ariana Grande, Victoria Justice and Kate Upton. The images, which were posted on Sunday night, were reportedly accessed due to an iCloud leak that enabled celebrities' phones to be hacked. Apple has declined to comment. Privacy of the celebrities were terribly violated.
There are needs for better privacy protection on cloud. Enveloping techniques will enhance privacy protection on cloud.
WF muxing techniques have been presented extensively in the above mentioned US patent applications (patent application Ser. No. 12/848,953, 13/938,268, 13/953,715. The WF muxing techniques will use less memory space to achieve better redundancy, reliability, and survivability as compared to conventional techniques. In addition, these techniques enable capabilities of monitoring integrity of stored data sets without scrutinizing the stored data sets themselves. The same techniques can be extended to data streaming via cloud.
There are two more concerns. Many operators offer secured and encrypted storage services. However, secured files are only encrypted on the server side and therefore a client has to rely on honesty of the server operator. The second is concerns about the right of stored data; which are under debate.
This invention application addresses enhanced privacy, and reliability of data transports and stored data on cloud. Many of the data may even be image or audio related. Since multiple data sets to be transported or stored will be preprocessed on client sides, each of the transported or stored data on cloud is a multiplexed (muxed) data set individually which is unintelligible by itself. Therefore, the proposed approaches shall remove the concerns on professional integrity confidence of operators, and those on the right of stored data. Known images, audio tracks, or multimedia streams may all be used as digital “envelopes” for cloud data storage and transport. Most applications are aiming for games and entertainments in cloud communications. It may be applied as tools for various digital right management on copy right, protecting IP holders. Authentications with known “chokes or stamps” via these techniques for multilayer enveloping will be one highlight of this patent application.
Digital images will be used to exemplify the digital enveloping/de-enveloping techniques in this patent application. Other types of digital streams may be easily incorporated for the proposed enveloping techniques.
Embodiments of “writing” and “reading” processes will be summarized and presented concisely. “Writing” features a process on multiple original images concurrently via WF muxing transformations, generating WF muxed data to be stored on cloud. A “reading” process corresponds to a WF demuxing transformation on WF muxed data stored on cloud, reconstituting original data sets. The enveloping is a subset of “writing” procedures under constraints that enveloped messages, or products of the writing procedures, shall preserve some desired features in digital appearance, and the de-enveloping is a subset of reading procedures to reconstitute embedded mails from the enveloped messages.
Enveloping process is subsets of WF muxing process. A customized set of WF muxing on multiple digital files as inputs including at least a data message file and a selected digital envelop file, is configured to guarantee at least one of the multiple outputs comprising a weighted sum of all inputs with an appearance to human natural sensors substantially identical to the appearance of the selected digital envelop in a same image, video or audio format.
The output file is the file with enveloped or embedded messages. The embedded message may be reconstituted by a corresponding WF demuxing processor at destination with the known a priori information of the original digital envelope. In short, digital enveloping/de-enveloping can be implemented via WF muxing and demuxing formulations. WF muxed data featured enhanced privacy and redundancy in data transport and storage on cloud. On the other hand, data enveloping is an application in an opposite direction for WF muxing applications as far as redundancy is concerned. Enveloped data are intended only for limited receivers who has access to associated digital envelope data files with enhanced privacy for no or minimized redundancy.
Wavefront multiplexing/demultiplexing (WF muxing/demuxing) process features an algorithm invented by Spatial Digital Systems (SDS) for satellite communications where transmissions demand a high degree of power combining, security, reliability, and optimization. WF muxing/demuxing, embodying an architecture that utilizes multi-dimensional transmissions, has found applications in fields beyond the satellite communication domain. One such application is data transport/storage on cloud where privacy, data integrity, and redundancy are important. Enveloping and de-enveloping on digital data may be used for both data transport and data storage. They may be used for gifts and games such as digital fortune cookies. We will use data transport, such as delivering mails, to exemplify the concept of enveloping and de-enveloping digital data.
The invention of enveloping techniques is about to send not all but a portion of WF muxed data strings through cloud to destinations. An enveloped data streams are WF muxed with a known data files as an envelope which may be a sender's personal picture indicating who is sending the enveloped (embedded) data string. Different envelops may feature various pictures of sender's indicating sender's mood while sending the enveloped data. The digital envelopes may be an old digital video clip for delivering new digital data streams for communications among family members only. All family members shall have access to the original old video clip.
WF muxing/demuxing for enveloping are configured to use additional known digital data streams for probing, authentications and identifications. A method for enveloping and then storing data in IP cloud comprises: transforming multiple first data sets into multiple enveloped second data sets at a transmitting side, wherein one of said enveloped second data sets comprises a weighted sum of said first data sets; storing said enveloped second data sets in an IP cloud via an internet; and storing multiple links linking to said enveloped second data sets at said transmitting side.
A data processing method comprises: transforming multiple first data sets and a known data set into multiple enveloped second data sets at a transmitting side, wherein one of said enveloped second data sets comprises a weighted sum of said first data sets; and recovering a third data sets from some of said enveloped second data sets and said known data set at a receiving side, wherein one of said third data sets comprises a weighted sum of said some of said enveloped second data sets.
A method for storing data in IP cloud, comprises: transforming multiple first data sets into multiple enveloped second data sets at a transmitting side, wherein one of said enveloped second data sets comprises a weighted sum of said first data sets and carries unique appearances with intensities mainly controlled by one of said first data sets. The unique appearances may be images, sounds, and other features to human sensors.
This invention is about how to use enveloping techniques for digital right management. An original digital document is referred to as a mother edition of the document. Additional copies are generated as children editions; each will have unique identifiers embedded via the enveloping techniques with the mother edition as the digital envelop. The identifier associated with a child addition can only be recovered via processing with the mother edition. Only the children editions will be published and distributed, and the mother edition will be stored securely.
Mathematically, the mother edition document is represented as A and the identifier document for an x child edition as Dx. Since enveloping processing is a linear processing, the x-edition is related to X=M*A+Dx, where M is magnification factor and shall be greater than 1 under a boundary condition to enable the appearance of X substantially identical to that of the mother edition as far as to all nature human sensors are concerns. The Dx information is embedded and/or hided in the X; the child edition of the digital document, and is not intelligible through the X file alone.
A y child edition will be associated with another different Dy identifier.
In order to recover information on Dx from X, the recovering process will perform the operation of Dx=X−M*A or its equivalent, with the mother edition A available.
Similar techniques can be extended for broadcasting to deliver additional information to audience. A first mother document is represented as A and a second document as B. Since enveloping processing is a linear processing, the rebroadcasting-edition is related to X=M*A+B, where M is magnification factor and shall be greater than 1 under a boundary condition to enable the appearance of X substantially identical to that of the mother document A as far as to all nature human sensors are concerned. The B information is embedded and/or hided in the X; the re-broadcasting edition of the digital document, and is not intelligible through the X file alone. In order to recover information on B from X, the recovering process will perform the operation of B=X−M*A or its equivalent, with the mother edition A available.
Re-broadcasting may come from different channels concurrently, or same channel on different time, or different channel different time. This techniques can be used for DBS, Cable, Fiber, and other wireless or wired networks for either audio or video broadcasting. The embedded documents, B, may be other separated and different TV programs, house-keeping data for set-top-boxes, broadcasted Internet data to selected internet nodes, and/or others.
The drawings disclose illustrative embodiments of the present disclosure. They do not set forth all embodiments. Other embodiments may be used in addition or instead. Details that may be apparent or unnecessary may be omitted to save space or for more effective illustration. Conversely, some embodiments may be practiced without all of the details that are disclosed. When the same reference number or reference indicator appears in different drawings, it may refer to the same or like components or steps.
Aspects of the disclosure may be more fully understood from the following description when read together with the accompanying drawings, which are to be regarded as illustrative in nature, and not as limiting. The drawings are not necessarily to scale, emphasis instead being placed on the principles of the disclosure.
a illustrates a block diagram of enveloping for digital right management (DRM) applications by embedding identifiers of a child edition digital document/movie picture and then storing the document/movie pictures on cloud or having it distributed in accordance to some embodiments of this invention.
b illustrates a block diagram of de-enveloping digital documents or stored movie pictures on cloud to recover embedded identifiers in accordance to some embodiments of this invention.
a illustrates a block diagram of enveloping for broadcasting/re-broadcasting applications by embedding additional information in two child edition digital documents and then storing the documents on cloud or having them separately distributed in accordance to some embodiments of this invention.
b illustrates a block diagram of de-enveloping from two digital documents to recover embedded additional delivered information in accordance to some embodiments of this invention.
The present invention relates to distributed transport paths or storage with built-in redundancy via an M-to-M wavefront multiplexing (WF muxing) techniques; where M≧2 and must be an integer. The M inputs to the WF muxing comprising N streams of information data with additional M−N known data files; where N≧1 and is an integer. The M independent input data streams are transformed and concurrently converted into WF muxed domain with M output wavefront components (wfcs). Only M′ of the M outputs will be used for data transport and/or data storage on cloud, where M−N≦M′≦M; where M′ is an integer.
Furthermore, any one of the known data files may be chosen to serve as a digital transporting envelop and will be processed accordingly in an enveloping process as a part of the M-to-M WF muxing.
Multiple inputs to an M-to-M WF muxing processor are properly “emphasized” or “weighted” so that at least one of the M outputs will be selected to be a “carrier” for transporting embedded message. A selected “carrier”, an enveloped data file, shall appear substantially identical to the appearance of the selected digital envelop to human sensors. The identical appearance comprises unique and easily distinguishable features from other digital data files. These features may be visual pictures, videos, audio music, word files, or multimedia files
At least one of the enveloped data streams will be sent to a destination via cloud. An enveloped data stream may appear as a digital picture, a video clip, a music clip, an audio recording, or a digital cartoon while being transported or stored on cloud. Just as functions of regular envelops, these digital envelops may convey context and authors of the embedded mail, a preview of intentions and moods of the author, and or information of where the embedded mail coming from.
The digital envelop and the enveloped digital data stream shall have substantially identical features which are identifiable and distinguishable by human sensors; hearing, visually or both.
At destination, a desired receiver shall reconstitute the embedded information data by a post processing such as wavefront demultiplexing (WF demuxing) with the help of accessing the known file of the original digital envelop.
The present invention discloses operation concepts, methods and implementations of enveloping/de-enveloping via wavefront multiplexing for cloud transport as depicted in
In principle, the pre-processing and the post-processing are all performed in user segments and performed in equipment at the user end. For cloud storage, these enveloping/de-enveloping may also be performed in storage facilities of an operator. The operator will aggregate the data storage sets in cloud distributed over remote networks.
After the WF muxing, Es(t) is an enveloped data stream, and is the only file to be sent to a destination via IP networks 010. Es(t) features with a visual appearance nearly identical to the picture of the famous running horse in E5(t). At the destination, a receive can reconstitute the embedded message of “Open Sesame” written in Chinese via a 2*2 WF demuxer 140 or an equivalent post processor; only when the digital picture of the original envelop is available to the receiver. There are three segments including (1) a pre-processing 130, (2) IP propagation Channel 010, and (3) post processing 140 at downstream of the cloud.
Pre-storage processing 130:
In the pre-processing for mail enveloping, an 2-to-2 WF muxer 130 is used to convert 1 set of input mail data S(t) and a selected digital envelop string E5(t) to two output data strings, i.e. Es(t), and Ed(t), where:
Es(t)=S(t)+am*E5(t) (1-1)
Ed(t)=−S(t)+am*E5(t), (1-2)
A 2-to-2 Hadamard matrix (HM), in which all elements are “1” or “−1” only, is chosen for the 8-to-8 WF muxing. Equations (1-1) to (1-2) can be written in a matrix form as
The input ports of a WF muxer are referred to as slices, and its output ports are wavefront components (wfc's). The two input data sets S1 and am*E5, are connected to the input ports, i.e. slice 1, and slice 2 of the WF muxer respectively. The 2 output data sets i.e. O1-O2, are connected to the output ports, i.e. wfc1-wfc2, of the WF muxer 130 respectively.
In general a 2-to-2 WF muxing processor features 2 orthogonal wavefront vectors or WFV's. Let us define a coefficient wjk of a WF transformation to be the coefficient at the jth row and kth column of the WF muxer 130. A WF vector of the WF muxer 130 featuring a distribution among the 2 outputs, i.e. O1-O2 at the 2 WF component ports wfc1-wfc2, is defined as a 2-dimensional vector. They are mutually orthogonal. The two WFVs of the WF muxer 101 are:
WFV1=[w11,w21]T=[1,−1]T (3.1)
WFV2=[w12,w22]T=[1,1]T (3.2)
S(t), and E5(t) are “attached” to the 2 WF vectors by respectively connected to the two input ports of the WF muxing device 130. All components of the 2 orthogonal WFVs are related to input and output port numbers or (spatial) sequences, but are independent from the input and output data sets.
The arithmetic operations of “linear combinations” may operate on blocks of data after all inputs are aligned as digital streams sample-after-sample for various inputs. A “byte” of data may be “selected” as a sample and a block of X samples, i.e. 7 samples or 7 bytes, of a digital data stream will be treated as a numerical number for calculations in WF muxing transformations. Two streams of 7 samples or bytes may be the respective inputs of the 2-to-2 WF muxer. A block size of X+1 samples, i.e. 8 samples or 8 bytes in this case, will be reserved for the results of arithmetic operations on a number of the digital streams to avoid issues of overflows and underflows at the two outputs of the WF muxing transformations. There shall be 12.5% in data size overhead of the 7 byte arithmetic operations, with respect to the results in 8 byte forms in the outputs. In different embodiments, we may choose blocks with a block length of 99 bytes for arithmetic operation, i.e. X=99, reducing the operation overhead to 1%.
There are other choices in selecting data blocks for arithmetic operations of linear combinations or weighted sums in the WF muxing transformations. For imaging processing, a pixel by pixel as operation blocks may be more important preserving unique features for some applications, or a row or a column of pixels as a data block for efficient usage of storages.
In this example, only one of the two outputs will be delivered to a destination. The intended receiver must have “additional information” in order to reconstitute the embedded message or mail; “Open Sesame” and its Chinese translation in a word format written in 4 Chinese Characters. The additional information is the original file of the selected digital envelop. If both outputs were delivered to the receiver, both the embedded mail and the selected original digital envelop could all be reconstituted independently at the destination without any additional a priori known information.
In general at least one of WF muxed output streams from higher order muxing or multilayer enveloping will be sent to the destination 140 via IP cloud 010. The embedded mail is in the enveloped digital data stream. The higher order muxing is usually referred to an N-to-N WF muxing with N in between 4 and 5000. The numbers of WF muxed streams to be sent to a destination shall be always smaller than a critical numbers of muxed data streams; Ncr. There are not enough information in the Ncr independent muxed data streams to reconstitute the embedded information without any additional information known a priori.
Cloud 010:
Only one WF muxed file is sent from a source to a destination via the cloud 010. The original digital envelope file is known a priori to both the sender at a source and receiver at the destination. Therefore the required channel bandwidth for Es(t) is about the same as that of the embedded message, S(t). The differentials in required bandwidths between that for Es(t) and that for S(t) are due to processing overhead.
Post processing 140:
The post processing 140 for data retrieval comprises a WF demuxing processor, converting the received WF muxed data into an output of embedded data file. The original digital envelope file, E5(t), is also used as one of the inputs to the WF demuxing in the post processing. The received WF muxed data is substantially equivalent to the corresponding output data set, Es(t), of the WF muxing device in the preprocessing 130, if not contaminated, and is therefore represented by Es(t) or Es′(t). Similarly, the recovered embedded data file is substantially equivalent to the input data sets, S(t), and is therefore referred to as S(t) or S′(t).
According to equation (1-1); the recovered embedded data can be derived from the received WF muxed data Es(t) and the digital envelope E5(t);
S(t)=Es(t)−am*E5(t) (4)
where am can be experimentally optimized or through a priori knowledge set. Therefore, the missing second output of the WF muxing can also be re-constructed in the destination according to Equation (1-2) and Equation (4)
Ed(t)=−Es(t)+2*am*E5(t), (5)
A 2-to-2 Hadamard matrix with scaling factor of ½ may be chosen as the 2-to-2 WF demuxer. The matrix elements of 2-to-2 Hadamard matrix feature “1” or “−1” only. The relationship may be written in a matrix form as
SM=HM*D (6)
where: D=[D1,D2]T=[Es(t),Ed(t)]T (6-1)
SM=[S(t),am E5(t)]T (6-2)
The input ports of a WF demuxer in the post processor 140 are referred to as wavefront components (wfcs), i.e. wfc1, and wfc2, and its output ports are slices, i.e. slice1, and slice2. In this example, the 2 input data sets, i.e. Es(t) and Ed(t), are connected to its input ports wfc1-wfc2 of the WF demuxer 140, respectively. The retrieved data set, S1, is from its first output ports. Normally the second output of the demuxing device 140 will be “grounded” for this application.
As an option, the respective second output from the WF demuxing device 140 may be used to reconstitute a copy of the original digital envelop which will be compared to the known digital envelope file for the integrity of received data. It is a good indication that the received embedded data has been compromised only if a set of comparison results showing the two digital envelopes are different digital files.
Let us assume a 4-to-4 Hadamard transform as the WF muxing matrix.
The 4 WF muxed files Ov, Ox, Oy and Oz are in the second row 522. To create various camouflaged effects on the WF muxed data for storage; the original images have been “heavily weighted” for the “horse” painting. In order to assure that the A1 image of the Chinese horse painting to be more dominant features in the 4 multiplexed outputs as camouflaged, we have emphasized the pixel intensities of A1 via:
where am>1. Usually am is set to be greater than 10. It is also assumed the dimensions of pixel lattices among the 4 input images have been fully equalized. Depending on the selection of a camouflaging image, the emphasizing factor, am, may applied to any of the input images in ∥A∥. Furthermore, equation (7) may also be written equivalently as:
As a result, the image of “horse” painted by Xu Baihong becomes dominant among the 4 participating images and appears on all 4 WF muxed data, i.e. Ov, Ox, Oy and Oz, with appearances of various intensity settings.
Additional processing is required before the WF muxing to “flip rotate, zone-in or zone-out” images or appearances on the WF muxed files with respect to the appearance of the digital envelope.
Each of the WF muxed data sets Ov, Ox, Oy and Oz features a size about 2 to 3 times larger than those of the original images A1-A4 or recovered images Sv, Sx, Sy and Sz to avoid overflow and underflow in the simulations.
The images on the third row are restructured images via a reading process. A “reading” processing also features two steps. The first step involves retrieving all 4 WF muxed files individually from cloud. The second step involves via a wavefront demultiplexing transformation, converting the 4 WF muxed files, i.e. Ov, Ox, Oy and Oz, in into four recovered or reconstituted equalized files Sv, Sx, Sy and Sz in ∥S∥ substantially equivalent to the four equalized pictures A1-A4 respectively if the WF muxed files, i.e. Ov, Ox, Oy and Oz, are not contaminated. The four recovered or reconstituted equalized image files may then be converted via a de-equalizing process into four recovered or reconstituted image files Sv, Sx, Sy and Sz substantially equivalent to the four original pictures A1-A4 respectively.
Assuming all four files Ov, Ox, Oy and Oz are available, the WF demuxing transformation (WF demuxing) shall follow:
∥S∥=∥WDmx∥∥O∥. (8)
where, ∥WDmx∥∥WMux∥=∥I∥. (8-1)
More explicitly, “intensities” of individual pixels, in the lattice of the same row and column, of the 4 reconstituted images in Sv, Sx, Sy and Sz in ∥S∥ are 4 respective linear combinations, each of which is a linear combination of intensities of individual pixels, in the lattice of the same row and column, of the four WF muxed files, i.e. Ov, Ox, Oy and Oz, in ∥O∥, multiplied by four respective weighting parameters in ∥WDmx∥. For example, “intensities” of individual pixels, in the lattice of the 41th row and 51th column, of the 4 reconstituted or recovered images in Sv, Sx, Sy and Sz in are 4 respective linear combinations of intensities of each individual pixels, in the lattice of the 41th row and 51th column, of the four WF muxed files, i.e. Ov, Ox, Oy and Oz, in ∥O∥, multiplied by four respective weighting parameters in ∥WDmx∥.
For applications of enveloping, only one of the 4 WE muxed files is sent to a destination from a sender at a source via cloud instead of sending all 4 WE muxed files to cloud. As an example, A1 is the information data to be delivered to a destination via cloud and A4 is a selected digital envelope file. A2, A3 and A4 are known a priori to both the sender and a desired receiver at the destination.
Any one of the 4 files on the second row 522 can be used to convey the embedded message A1 via cloud. Let us select Ov. as the enveloped data file to be transported to destinations. It is clear that the image on enveloped data file, Ov, is a running horse which is substantially identical to the running horse image on the enveloping file, A4. The enveloped file, Oy, comprising information of the embedded message, A1, is the one to be sent to destinations via cloud.
We will not repeat all mathematical details on the Figure here. In short, we utilize the same mathematical manipulations for “enveloping” digital messages or embedding mails for cloud transport as those in “camouflaging” pictures in the above mentioned patent application. We want to show two important features of WF muxing/demuxing in the enveloping/de-enveloping applications. For an enveloping processing by a selected digital envelope (A4);
In another scenario, where A1 is the data set to be sent to a destination via cloud, A2 and A3 for authentication, and A4 as a selected digital envelope, Ov and Oz are sent to cloud. At the destination, a first reader has all three digital data file A2, A3, and A4, and only needs to access 1 of the 2 enveloped data files on cloud; Ov or Oz to recover the embedded images, Sv. It is important to notice that there is redundancy in wavefront multiplexed images as far as the first reader is concerned. On the other hand, a second reader does not have the digital “horse” A4 but has original digital files for both A2 and A3 and he must download both of two enveloped data files Ov and Oz sent via cloud in order to recover a the embedded image, A1. It is also important to notice that the second reader has the capability to capture the file of the digital envelope A4 for later usage.
For a third scenario, where A1, A2, and A3 are the data sets to be sent to a destination via cloud, and A4 as a selected digital envelope, Ov, Ox, and Oz are sent to cloud. At the destination, a first reader has only has a digital data file A4, and needs to access all 3 enveloped data files on cloud; Ov, Ox, and Oz to recover the embedded images, Sv. It is important to notice that there is no redundancy wavefront multiplexed images as far as the first reader is concerned. On the other hand, a second reader does not have the digital “horse” A4 and he may download all two enveloped data files Ov, Ox and Oz sent via cloud, but he will not be able to reconstitute the embedded image, A1.
For a fourth scenario, where A1, A2, and A3 are the data sets to be sent to a destination via cloud, and A4 as a selected digital envelope, Ov, Ox, Oy, and Oz are sent to cloud. At the destination, a first reader has only has a digital data file A4, and needs to access any 3 of the 4 enveloped data files on cloud; Ov, Ox, Oy, and Oz to recover the embedded images, Sv. It is important to notice that there is redundancy in wavefront multiplexed images as far as the first reader is concerned. On the other hand, a second reader does not have the digital “horse” A4 and he must download all four enveloped data files Ov, Ox Oy, and Oz sent via cloud, in order to reconstitute the embedded image, A1. There is no redundancy in wavefront multiplexed images as far as the second reader is concerned.
A message are embedded in the 2 enveloped data file Es(t) and Ed(t) are sent from a sender at a source to a receiver at a destination. The receiver utilizes both enveloped data sets to recover the embedded message and the original digital envelop which may be used for subsequent transmissions between the sender and the receiver. Once the digital envelop data becomes known to both sides of a cloud based communication channel, only one of the two WF muxed files either ES(t) or Ed(t) will be sent to cloud.
There are two enveloping processing in series in
In the second preprocessing 130-2, there are also two inputs, x(t) and E5(t), and only one output Es(t). E5(t) is a selected outer envelope and is also one of the candidate envelopes 180. The first output Es(t) features an appearance substantially identical to human sensors as that in E5(t).
There is no appearance of a phrase of “Open Sesame” and its Chinese translation in Es(t). The required bandwidth for transporting the Es(t) shall be near identical to that of sending S(t) via cloud when the enveloping files, E1(t) or E5(t) are properly chosen.
In other embodiments, images in the enveloping files may have been processed for various purposes such as minimized dynamic range of individual pixels or simply for enhanced authentication and identifications before WF muxing. Many can be pre-stored in the envelop candidate files as optional candidates. Certainly, these additional processing can be included as a part of the pre-processing 130 in
There are two de-enveloping processing in series. Each one is identical to the de-enveloping shown in
The first input Es(t) is a received data file in a desired receiver at a destination, and shall be substantially equivalent to the only output of the second pre-processing 130-2 in
A 4-to-4 WF muxing is implemented in the pre-processing 630. There are four inputs connected to S(t), E10(t), E1(t), and E5(t), and only one output used for Ex(t). The remaining three outputs of the WF muxing are grounded. S(t) comprises of a phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters, and is the message to be delivered to destinations via cloud. E5(t) is the selected envelope and is one of the candidate envelopes in the candidate file 180. The first output Ex(t) features an appearance substantially identical to human sensors as those in E5(t). The second and the third inputs E10(t) and E1(t) are also in the file 180 for candidate envelopes known a priori to both the sender and the receiver.
The mathematic derivations are identical to the ones for
The first output O1 is name Ex(t), the other 3 outputs are grounded in
Only one of the four WF muxed data set was sent to a destination via cloud 010. The required communication channel bandwidth may be nearly identical to that of S(t) signal itself, when the digital envelope, E5, is properly chosen and further optimized in pre-processing 630 accordingly.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) the only received data set, (2) E10(t) a known digital data in the envelop candidate file, (3) E1(t) a second known digital data in the envelop candidate file, and (4) E5(t) a known digital data for the selected digital envelop. Based on Equation (7-2);
Ex(t)=am*E5(t)+E1(t)+E10(t)+S(t) (8)
and S(t)=Ex(t)−(am*E5(t)+E1(t)+E10(t)) (8-1)
Only one received enveloped file Ex(t) is used in Equation (8-1). The second, the third, and the four inputs of the 4-to-4 WF demuxing are known data sets. The recovered S(t) from the WF demuxing shall be the embedded message delivered and shall comprise of the phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters.
Furthermore according to Equation (7-2), O2, O3, and O4 can now be reconstructed based on the recovered Ex(t). The restructured O2, O3, and O4 may be used for enhanced identifications.
A 4-to-4 WF muxing is implemented in the pre-processing 630. There are four inputs connected to S(t), E10(t), E1(t), and E5(t), and only two outputs used for Ex(t) and Ey(t). The remaining two outputs of the WF muxing are grounded. S(t) comprises of a phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters, and is the message to be delivered to destinations via cloud. E5(t) is the selected envelope and is one of the candidate envelopes in the candidate file 180. As to the first output Ex(t) and the third output Ey(t), each features an appearance substantially identical to human sensors as those in E5(t). The second and the third inputs E10(t) and E1(t) are also in the file 180 for candidate envelopes known a priori to both the sander and the receiver.
The mathematic derivations are identical to the ones for
The first and the third outputs, O1 and O3, are named Ex(t) and Ey(t) respectively. The other 2 outputs are grounded in
Only two of the four WF muxed data set are sent to a destination via cloud 010. The required communication channel bandwidth may be about twice as that of S(t) signal itself. Each of the two enveloped files may be as large as that of S(t) itself when the digital envelope, E5, is properly chosen and further optimized in pre-processing 630 accordingly. Additional bandwidth differentials are due to processing overhead.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) a first received data set, (2) Ey(t) a second received data set, (3) E10(t) a known digital data in the envelop candidate file 180, and (4) E5(t) a known digital data for the selected digital envelop. Based on Equation (7-3);
Ex(t)=am*E5(t)+E1(t)+E10(t)+S(t) (7-4)
Ey(t)=am*E5(t)+E1(t)−E10(t)−S(t) (7-5)
and S(t)=[Ex(t)−Ey(t)]/2−E10(t) (9)
Two received enveloped files, Ex(t) and Ey(t), are used in Equation (9). The third input for the 4-to-4 WF demuxing is E10(t); a known data set. The fourth input for the 4-to-4 WF demuxing is E5(t); also a known data set. But the formulation in Equation 9 does not need E5(t) in restoring S(t). However, there are 6 different combinations in choosing 2 from 4 WF muxed files as the 2 enveloped carriers. Many of the 6 configurations requires more than one known data sets among E10, E1, and E5 in order to restore S(t).
The recovered S(t) from the WF demuxing shall be the embedded message delivered and shall comprise of the phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters.
Furthermore according to Equation (7-2), O2, and O4 can now be reconstructed based on the recovered S(t) at the destination. The restructured O2, and O4 may be used for enhanced identifications.
A 4-to-4 WF muxing is implemented in the pre-processing 630. The four inputs are connected to S(t), E10(t), E1(t), and E5(t), and only three outputs used for Ex(t), Ey(t) and Ez(t). The remaining one output of the WF muxing is grounded. There are 4 possible configurations to choose 3 out of four outputs. S(t) comprises of a phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters, and is the message to be delivered to destinations via cloud. E5(t) is the selected envelope and is one of the candidate envelopes in the candidate file 180. As to the first output Ex(t), the second output Ey(t), and the third output Ez(t), each features an appearance substantially identical to human sensors as those in E5(t). The second and the third inputs E10(t) and E1(t) are also in the file 180 for candidate envelopes known a priori to both the sender and the receiver.
The mathematic derivations are identical to the ones for
The first, second and the third outputs, O1, O2, and O3, are named Ex(t), Ey(t), and Ez(t) respectively. The fourth output is grounded in
The required communication channel bandwidth may be about three times as that of S(t) signal itself. Each of the three enveloped files may be as large as that of S(t) itself when the digital envelope, E5, is properly chosen and further optimized in pre-processing 630 accordingly. Additional bandwidth differentials are due to processing overhead.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) a first received data set, (2) Ey(t) a second received data set, (3) E10(t) a known digital data in the envelop candidate file 180, and (4) E5(t) a known digital data for the selected digital envelop. Based on Equation (7-6);
Ex(t)=am*E5(t)+E1(t)+E10(t)+S(t) (7-8)
Ey(t)=am*E5(t)−E1(t)+E10(t)−S(t) (7-9)
Ez(t)=am*E5(t)+E1(t)−E10(t)−S(t) (7-10)
and S(t)=[Ex(t)−Ey(t)]/2+E1(t) (10)
Two received enveloped files, Ex(t) and Ey(t), are used in Equation (10). The third input for the 4-to-4 WF demuxing is E1(t); a known data set. The fourth input for the 4-to-4 WF demuxing is E5(t); also a known data set. But the formulation in Equation (10) does not need E5(t) in restoring S(t).
The recovered S(t) from the WF demuxing shall be the embedded message delivered and shall comprise of the phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters.
Furthermore according to Equation (7-2), O3, and O4 can now be reconstructed based on the recovered S(t) at the destination. The restructured O3, and O4 may be used for enhanced identifications.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) a first received data set, (2) Ey(t) a second received data set, (3) E10(t) a known digital data in the envelop candidate file 180, and (4) E5(t) a known digital data for the selected digital envelop. Based on Equation (7-6);
Ey(t)=am*E5(t)−E1(t)+E10(t)−S(t) (7-11)
Ez(t)=am*E5(t)+E1(t)−E10(t)−S(t) (7-12)
and S(t)=am*E5(t)−[Ey(t)+Ez(t)]/2 (11)
Two received enveloped files, Ey(t) and Ez(t), are used in Equation (11). The third input for the 4-to-4 WF demuxing is E1(t); a known data set. The fourth input for the 4-to-4 WF demuxing is E5(t); also a known data set. But the formulation in Equation (11) does not need E1(t) in restoring S(t). The recovered S(t) from the WF demuxing shall be the embedded message delivered and shall comprise of the phrase of “Open Sesame” and its Chinese translation by 4 Chinese characters. Furthermore O1 and O4 can now be reconstructed according to Equation (7-6) based on the recovered S(t) at the destination. The restructured O1 and O4 may be used for enhanced identifications.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) a first received data set, (2) Ey(t) a second received data set, (3) E1(t) a known digital data in the envelop candidate file 180, and (4) Ez(t) a third received data set.
Based on Equation (7-6);
Ex(t)=am*E5(t)+E1(t)+E10(t)+S(t) (7-13)
Ey(t)=am*E5(t)−E1(t)+E10(t)−S(t) (7-14)
Ez(t)=am*E5(t)+E1(t)−E10(t)−S(t) (7-15)
and S(t)=am*E5(t)−[Ey(t)+Ez(t)]/2 (12-1)
or S(t)=[Ex(t)−Ey(t)]/2−E1(t) (12-2)
or S(t)=[Ex(t)−Ez(t)]/2−E10(t) (12-3)
Two of the three received enveloped files, Ex(t), Ey(t) and Ez(t), are used in Equation (12). There are three options to restore the embedded mail, S(t); as delineated in Equations (12-1), (12-2), and (12-3), respectively. They all need a third input for the 4-to-4 WF demuxing. The required 3rd file for a restoration processing according to Equation (12-1) is the digital file of the original digital envelope E5(t). Similarly the 3rd files for those according to Equation (12-2) and (12-3) are the digital file of E1(t) and that of E10(t), respectively.
With the flexibility in all 3 techniques in Equations (12), a receiver may pick any first two of three possible arrivals, Ex(t), Ey (t) and Ez(t), in restoring the S(t). For delivering music or video clips, these techniques at a destination feature redundancies for better survivability, and enhanced streaming speed of S(t) using only first two arrivals and discarding the last (the third) arrival among the three WF muxed files sent by a source.
In different embodiments for various applications, multiple restoration means described above may be used to differentiating service preferences in a multicasting, or broadcasting modes. For those without accessing to E1 and E10; their services can be completely denied by sending Ey and Ez only via cloud 010. Similarly, controlling delivery of Ex(t) to a slower rate via cloud 010 in streaming a video clip, there will only be ⅓ probability at a normal rate to restore S(t) by using first two arrivals out of three total arrivals in a receiver at destinations. The corresponding overall flow rate may be degraded by ⅔ in receivers to a flow rate at 33% of a normal flow, when Ex(t) delivery are delayed significantly.
In the post-processing 640 a 4-to-4 WF demuxing is incorporated. There are four inputs; (1) Ex(t) a first received data set, (2) Ey(t) a second received data set, (3) E1(t) a known digital data in the envelop candidate file 180, and (4) Ez(t) a third received data set.
Based on Equation (7-6);
Ex(t)=am*E5(t)+E1(t)+E10(t)+S(t) (7-16)
Ey(t)=am*E5(t)−E1(t)+E10(t)−S(t) (7-17)
Ew(t)=am*E5(t)−E1(t)−E10(t)+S(t) (7-18)
and S(t)=E10(t)+[Ey(t)−Ew(t)]/2 (12-4)
or S(t)=[Ex(t)−Ey(t)]/2−E1(t) (12-5)
or S(t)=[Ex(t)+Ew(t)]/2−am E5(t) (12-6)
Two of the three received enveloped files, Ex(t), Ey(t) and Ew(t), are used in Equation (12). There are three options to restore the embedded mail, S(t); as delineated in Equations (12-4), (12-5), and (12-6), respectively. They all need a third input for the 4-to-4 WF demuxing; similar to the block diagram in
With the flexibility in all 3 techniques in Equations (12), a receiver may pick any first two of three possible arrivals, Ex(t), Ey (t) and Ew(t), in restoring the S(t). For delivering music or video clips, these techniques at a destination feature redundancies for better survivability, and enhanced streaming speed of S(t) using only first two arrivals and discarding the last (the third) arrival among the three WF muxed files sent by a source.
There are two enveloping processing in series in
In the second preprocessing 130, there are two inputs, w(t) and E5(t), and a first output assigned as output Es(t). The second output is grounded. E5(t) is a selected outer envelope and is also one of the candidate envelopes in the candidate file 180. The first output Es(t) features an appearance substantially identical to human sensors as that in E5(t).
Only one WF muxed file, Es(t) is sent to destinations via cloud 010. There is no phrase of “Open Sesame” or its Chinese translation on the appearance of Es(t). The required bandwidth for transporting the Es(t) shall be near identical to that of sending S(t) via cloud when the enveloping files, E4(t) or E5(t) are properly chosen.
In other embodiments, images in the enveloping files may have been processed for various purposes such as minimized dynamic range of individual pixels or simply for enhanced authentication and identifications before WF muxing. Many can be pre-stored in the envelop candidate files as optional candidates. Certainly, these additional processing can be included as a part of the first pre-processing 630 and/or the second 130.
Similarly, there are two outputs from the post processor 140. The first output w(t) of the first post processor 140 features an appearance substantially identical to human sensors as those in E4(t). The second output is grounded.
In the second post-processing 640, there are four inputs, connected to w(t), E10(t), E1(t), and E4(t). E4(t) is the selected inner envelope and is one of the candidate envelopes in the candidate file 180. E10(t) and E1(t) are digital files in the candidate file 180. There are two outputs, and the first one is assigned as output S(t) and a second one is grounded. The first output is the recovered embedded message.
It is conceivable to extend the double enveloping/de-enveloping depicted in
Enveloping and de-enveloping can be used as tools for digital right managements (DRM). We may use
When a pirate version is discovered, no mattered whether it was produced through a leak in a corrupted distribution channel, or through a new recording from a hidden video recorder in commercial movie theaters, we will reconstitute the embedded unique features on a copy; only with the original digital file of mother movie version through a corresponding de-enveloping processor in
In
The original mother movie versions of Em(t) will not be distributed at all. They may be stored in libraries or cloud storages. The child version movies are distributed for public release, featuring substantially identical picture quality to that of the mother movie version. However each child version movie copy is uniquely embedded by an enveloping process with uniquely identifiable features. The mother movie serve as the function of the digital envelope only. The embedded messages or unique features are part of the child copy, not in form a watermark or invisible watermark.
In general a child version movie comprises a WF multiplexed file of an M-to-M wavefront multiplexing processor where M≧2. In the M-to-M WF muxing, there generated M equations. A selected child version movie corresponds to only one of the M equations. For anyone associated distributions of the selected child version movie copy to alter the embedded identifiers, he or she must have access to the other M−1 WF muxed files or equivalently unique M−1 inputs of the M-to-M WF muxing. These inputs may be for additional probing, more privacy, and enhanced authentications. An enveloping process for M=2 is shown in
When pirate copies of child version movies are captured in market or intercepted in a distribution network, their origins can be identified by reconstituting the embedded identifier file through a WF demuxing processing shown in
For multilayer distributions, similar concepts can be extended for grand-children versions of movie publications. Every layer of movie distributers will have their tools to trace “leakages” in their respective distribution networks.
In other embodiments, the other two grounded inputs to the preprocessor or the enveloping processor 630 may be used for additional functions of authentications or additional privacy.
We have used movies in the DRM example. The same principle of enveloping/de-enveloping techniques for sounds or other audio IPs delivered via cloud or other public distribution networks.
Enveloping and de-enveloping can be used as tools for delivering additional embedded information during re-broadcasting to subscribers. We may use
At a subscriber receiver, the embedded independent news clip of special news reporting Idx(t) will be reconstituted and recovered through a corresponding de-enveloping processor 640 in
In
The original mother version of the news broadcast Em(t) and the child version copy of the news Echx(t) will be broadcasted or distributed through various channels, at different time slots, or combinations of both. The child version news broadcasting Exhx(t) shall feature substantially identical picture and voice quality to those of the mother version broadcasting news Em(t).
Furthermore each child version copy in a different embodiment may feature uniquely embedded short but different reporting. The mother version serve as the function of the common digital envelope only. The embedded messages or unique features are part of the child copies.
For multilayer distributions, similar concepts can be extended for grand-children versions of broadcasting.
In other embodiments, the other two grounded inputs to the preprocessor or the enveloping processor 630 may be used for additional functions of authentications or additional privacy.
We have used news broadcasting in the example. The same principle of enveloping/de-enveloping techniques are applicable for other IPs delivered via cloud or other distribution networks.
Enveloping and de-enveloping can be used as tools for delivering additional embedded information during re-broadcasting to subscribers.
At a subscriber receiver, the embedded unique feature of special reporting will be reconstituted and recovered through a corresponding de-enveloping processor 640 in
Many of the cable services and TV satellite providers are delivering same programs concurrently or nearly concurrently through multiple channels. On the other hand, many broadcasting platforms deliver identical program multiple times via the same channels. These repeated information delivery opportunities may be utilized for delivering additional information or digital documents via digital enveloping techniques.
The enveloping techniques for broadcasting may be extended to two way communications as well. Furthermore, they may also be utilized to deliver a set of new data via multiple broadcasting sessions. The enveloping mechanisms may be configured to have redundancy features, enabling recovering embedded message or data stream, say, when 3 out of 4 re-broadcasting sessions of a same program are available.
It is conceivable to deliver a new data set through multiple repeated broadcasting program.
As far as the regular subscribers are concerns, they may see the same repeated programs many times. For other subscriber groups with enveloping and de-enveloping capability, the additional channel capacity that the existing service providers have already had can also be utilized for delivering new additional data, documents and information. The additional channel capacity by enveloping techniques may be used to deliver more paid TV programs, stock exchange real time information, traffic condition broadcasting; and so on.
Additional Comments
With regards to the above applications via WF muxing, a WF muxer may alternatively perform a first non-orthogonal matrix on the inputs of the WF muxer. With regards to the above WF demuxing applications, a WF demuxer may alternatively perform a second non-orthogonal matrix, inverse to the first non-orthogonal matrix, on the inputs of the WF muxer.
The components, steps, features, benefits and advantages that have been discussed are merely illustrative. None of them, nor the discussions relating to them, are intended to limit the scope of protection in any way. Numerous other embodiments are also contemplated. These include embodiments that have fewer, additional, and/or different components, steps, features, benefits and advantages. These also include embodiments in which the components and/or steps are arranged and/or ordered differently.
Unless otherwise stated, all measurements, values, ratings, positions, magnitudes, sizes, and other specifications that are set forth in this specification, including in the claims that follow, are approximate, not exact. They are intended to have a reasonable range that is consistent with the functions to which they relate and with what is customary in the art to which they pertain. Furthermore, unless stated otherwise, the numerical ranges provided are intended to be inclusive of the stated lower and upper values. Moreover, unless stated otherwise, all material selections and numerical values are representative of preferred embodiments and other ranges and/or materials may be used.
The scope of protection is limited solely by the claims, and such scope is intended and should be interpreted to be as broad as is consistent with the ordinary meaning of the language that is used in the claims when interpreted in light of this specification and the prosecution history that follows, and to encompass all structural and functional equivalents thereof
This application claims the benefit of U.S. provisional application Ser. No. 62/038,767, entitled “Enveloping and De-enveloping for Cloud Computing via WF Muxing,” filed Aug. 18, 2014. This application is also related to a non-provisional application Ser. No. 12/848,953, filed on Aug. 2, 2012, a non-provisional application Ser. No. 13/938,268, filed on Jul. 10, 2013, a non-provisional application Ser. No. 13/953,715, filed on Jul. 29, 2013, and a non-provisional application Ser. No. 14/512,959, filed on Oct. 13, 2014; all of which are incorporated herein by reference in their entireties.
