A graphics engine, graphics processing unit (GPU), or visual processing unit (VPU), is a specialized electronic circuit designed to rapidly manipulate and alter memory to accelerate the creation of images in a frame buffer typically intended for output to a display. GPUs may be found in embedded systems, mobile phones, tablets, notebook computers, high performance computation (HPC) servers, and game consoles. In addition to manipulating computer graphics, a highly parallel architecture also enables a GPU to more generally perform processing of large blocks of video stream and image data in parallel.
Video streaming and display devices are now ubiquitous in electronic media. With the rapid development of image and video display devices, the colors and images can be received, manipulated, and reproduced in a variety of color gamuts. Such video/image data are often exchanged between devices having differing output display color gamuts. A device with narrower color gamut that simply clips all values outside the available display gamut may cause loss of details and a reduction in the sense of depth that reduces image quality and disrupts a user's viewing experience. Mapping between color gamuts of differing size (e.g., compression of pixel color values within a wider gamut to a narrower gamut) has therefore become an important function in graphical media processing.
International Color Consortium (ICC) color management defines a limited set of controls for gamut mapping while leaving the user to adjust the original image to fit their final aesthetic goal. These are formally defined as rendering intents which includes four general categories of gamut mapping: (a) Perceptual, which maps all colors smoothly into the target gamut, although those outside of the target gamut will move relatively more than those inside; (b) Saturated, which maintains relative saturation values of colors; (c) Relative colorimetric, which is a minimal color transformation that usually projects out-of-gamut colors to the gamut surface with little or no mapping of in-gamut colors; and (d) Absolute colorimetric, which matches measured value to measured value without aligning the neutral axes.
Gamut mapping/compression methods and systems covering one or more of the gamut mapping categories, which for example may be implemented within a device GPU, may improve user experience and therefore add significant value and functionality to a host electronic media device.
The material described herein is illustrated by way of example and not by way of limitation in the accompanying figures. For simplicity and clarity of illustration, elements illustrated in the figures are not necessarily drawn to scale. For example, the dimensions of some elements may be exaggerated relative to other elements for clarity. Further, where considered appropriate, reference labels have been repeated among the figures to indicate corresponding or analogous elements. In the figures:
One or more embodiments are described with reference to the enclosed figures. While specific configurations and arrangements are depicted and discussed in detail, it should be understood that this is done for illustrative purposes only. Persons skilled in the relevant art will recognize that other configurations and arrangements are possible without departing from the spirit and scope of the description. It will be apparent to those skilled in the relevant art that techniques and/or arrangements described herein may be employed in a variety of other systems and applications beyond what is described in detail herein.
Reference is made in the following detailed description to the accompanying drawings, which form a part hereof and illustrate exemplary embodiments. Further, it is to be understood that other embodiments may be utilized and structural and/or logical changes may be made without departing from the scope of claimed subject matter. Therefore, the following detailed description is not to be taken in a limiting sense and the scope of claimed subject matter is defined solely by the appended claims and their equivalents.
In the following description, numerous details are set forth, however, it will be apparent to one skilled in the art, that embodiments may be practiced without these specific details. Well-known methods and devices are shown in block diagram form, rather than in detail, to avoid obscuring more significant aspects. References throughout this specification to “an embodiment” or “one embodiment” mean that a particular feature, structure, function, or characteristic described in connection with the embodiment is included in at least one embodiment. Thus, the appearances of the phrase “in an embodiment” or “in one embodiment” in various places throughout this specification are not necessarily referring to the same embodiment. Furthermore, the particular features, structures, functions, or characteristics described in the context of an embodiment may be combined in any suitable manner in one or more embodiments. For example, a first embodiment may be combined with a second embodiment anywhere the particular features, structures, functions, or characteristics associated with the two embodiments are not mutually exclusive.
As used in the description of the exemplary embodiments and the appended claims, the singular forms “a”, “an” and “the” are intended to include the plural forms as well, unless the context clearly indicates otherwise. It will also be understood that the term “and/or” as used herein refers to and encompasses any and all possible combinations of one or more of the associated listed items.
As used throughout the description, and in the claims, a list of items joined by the term “at least one of” or “one or more of” can mean any combination of the listed terms. For example, the phrase “at least one of A, B or C” can mean A; B; C; A and B; A and C; B and C; or A, B and C.
The terms “coupled” and “connected,” along with their derivatives, may be used herein to describe functional or structural relationships between components. It should be understood that these terms are not intended as synonyms for each other. Rather, in particular embodiments, “connected” may be used to indicate that two or more elements are in direct physical, optical, or electrical contact with each other. “Coupled” may be used to indicated that two or more elements are in either direct or indirect (with other intervening elements between them) physical, optical, or electrical contact with each other, and/or that the two or more elements co-operate or interact with each other (e.g., as in a cause an effect relationship).
Some portions of the detailed descriptions provide herein are presented in terms of algorithms and symbolic representations of operations on data bits within a computer memory. Unless specifically stated otherwise, as apparent from the following discussion, it is appreciated that throughout the description, discussions utilizing terms such as “calculating,” “computing,” “determining” “estimating” “storing” “collecting” “displaying,” “receiving,” “consolidating,” “generating,” “updating,” or the like, refer to the action and processes of a computer system, or similar electronic computing device, that manipulates and transforms data represented as physical (electronic) quantities within the computer system's circuitry including registers and memories into other data similarly represented as physical quantities within the computer system memories or registers or other such information storage, transmission or display devices.
While the following description sets forth embodiments that may be manifested in architectures such system-on-a-chip (SoC) architectures or GPU architectures for example, implementation of the techniques and/or arrangements described herein are not restricted to particular architectures and/or computing systems and may be implemented by any architecture and/or computing system for similar purposes. Various architectures employing, for example, multiple integrated circuit (IC) chips and/or packages, and/or various computing devices and/or consumer electronic (CE) devices such as set-top boxes, smartphones, etc., may implement the techniques and/or arrangements described herein. Further, while the following description may set forth numerous specific details such as logic implementations, types and interrelationships of system components, logic partitioning/integration choices, etc., claimed subject matter may be practiced without such specific details. Furthermore, some material such as, for example, control structures and full software instruction sequences, may not be shown in detail in order not to obscure the material disclosed herein.
Certain portions of the material disclosed herein are implemented in hardware, for example as logic circuitry in a graphics processor. Certain other portions may be implemented in hardware, firmware, software, or any combination thereof. At least some of the material disclosed herein may also be implemented as instructions stored on a machine-readable medium, which may be read and executed by one or more processors (graphics processors and/or central processors). A machine-readable medium may include any medium and/or mechanism for storing or transmitting information in a form readable by a machine (e.g., a computing device). For example, a machine-readable medium may include read only memory (ROM); random access memory (RAM); magnetic disk storage media; optical storage media; flash memory devices; electrical, optical, acoustical, or other similarly non-transitory, tangible media.
One or more system, apparatus, method, and computer readable media are described below for compressing xvYCC (IEC 61966-2-4, January 2006) or sRGB (ITU-R BT.709-5, May 2008, or ITU-RBT.601-7, March 2011) color to a narrower gamut. Such embodiments may be utilized for example in processing video sequences provided in a wide gamut color space for display in sRGB color space. In further embodiments, an sRGB or xvYCC compliant input is compressed to a narrower gamut than the sRGB gamut. An output display supporting a color gamut 50% smaller than sRGB, or less, may be provided in devices, such as smartphones and tablets, as a means of reducing device cost. Embodiments described herein may be suitable one or more of ICC color mapping categories between such output displays and wider gamut raw image sources. As described further below, these embodiments may be implemented with a semi-fixed-hue gamut compression system that utilizes a fixed-hue gamut compression module capable of mapping 3D color space representations between well-defined gamuts (e.g., xvYCC to sRGB) together with a source-target gamut analysis module configured to assess pixel source and output display information. The source-target gamut analysis module may extend fixed-hue gamut compression functionality to a gamut that is narrower than sRGB and lacks a completely defined 3D color space. As described further below, narrow gamut color space primary chromaticity coordinates, and reference white point, provided for example by a display device manufacturer, are related to the sRGB color space as a basis for determining whether to perform compression, and if so, to suitably adjust parameters of a fixed-hue gamut compression module. Some of the techniques and systems described further below are referred to herein as “semi-fixed-hue” color adjustments because chrominance values for input pixels outside of a display gamut narrower than sRGB may be scaled based on a ratio between the display gamut area and the sRGB gamut area (within the xy chromaticity plane), and/or based on an sRGB boundary associated with a given hue angle.
Gamut compression architecture 148 includes source-target gamut analysis logic circuitry 146, which receives both source gamut information 108 associated with the source image 105 (e.g., associated input pixel values 106), and display gamut information 109 associated with an output display (or any other output destination). Source gamut information 108 includes input pixel xy chromaticity values for its color primaries (i.e. where the value in one color channel is 1 in a normalized 0-1 range, and others are 0). In exemplary embodiments, where an input image includes either xvYCC or sRGB data, source gamut information 108 includes primary chromaticity values xr
Gamut compression architecture 148 further includes gamut compression circuitry 147, which receives the input pixel values 106, and scales the values as needed to output gamut compressed pixel values 190. Gamut compression circuitry 147 is coupled to source-target gamut analysis logic circuitry 146 and further interfaces with application 126, for example through a graphics driver. Either or both source-target gamut analysis logic circuitry 146 and application 126 control the pixel value mapping performed by gamut compression circuitry 147. In the exemplary embodiment, parameters specifying a mapping mode 111 are passed to gamut compression circuitry 147. Compression parameters 112, determined based on the source and display gamut information (e.g., similarity flag SΔrgb
Method 201 begins at operation 210 with receipt or determination of the display gamut information (e.g., display gamut information 109 in
At operation 212, primary chromaticity values of the display gamut are compared to corresponding primary chromaticity values for a reference sRGB gamut. A similarity of primary chromaticity between the display gamut and the reference gamut is quantified and may be assigned to a similarity flag. In the exemplary embodiment, SΔrgb
Although 0.05 has been found to be an advantageous similarity threshold, this value may be varied and may be made a parameter configurable through a graphics driver, etc. Other mathematical functions that achieve a similar objective may be utilized in the alternative to assess a display's primary chromaticity similarity to sRGB, or any other fully-defined reference color space.
Areas of the sRGB reference gamut and the display gamut are further illustrated in
Method 201 (
For embodiments where neither the predetermined similarity threshold (e.g., for the exemplary narrow gamut illustrated in
As noted above, fixed-hue gamut compression may be utilized where the output display gamut is sRGB. The inventors have found that fixed-hue gamut compression embodiments can mitigate loss of image detail in an sRGB display of a source image that utilizes extended-gamut YCC, or xvYCC, color space. Method 301 begins at operation 345 where input image pixel values are transformed into Lightness-Chroma-Hue (LCH) space wherein the transformation from normalized, linear yuv to LCH is:
Method 301 continues with determining sRGB boundaries for a pixel hue angle at operation 346. For any given hue angle H, a hue plane can be drawn through the Y axis which is vertical to the UV plane and is inclined at angle H to the V axis. The intersection of this plane with the sRGB volume forms a region that delimits an RGB boundary corresponding with H. Letting pi be an input pixel represented in LCH space by an input pixel chroma cp
Returning to
Method 401 begins with receiving input pixel values up
V=(cv,lv) (6)
At operation 431, the direction for compressing out-of-range pixels in a hue plane is determined based on slope of the sRGB boundary line projection. Compression line slope mcomp (illustrated in
m
comp
=k×m
vert, (7)
where k is a tuning constant, which may be configurable through the graphics driver. Constant k is advantageously less than 1 to limit changes in luminance Y, and greater than 0 to avoid compressed color from becoming to pale. In an exemplary embodiment k˜⅛.
In equation (7), m is the slope of a line perpendicular to the sRGB boundary line projection:
Equations (8) and (9) accommodate top and bottom sRGB boundary lines forming vertex V on the LC plane, as further illustrated in
Continuing with method 401, at operation 432, chroma and lightness at the intersection of the compression line and L-axis are determined. This intersection may be expressed as:
At operation 433, a reference point
is determined, which will serve as the origin of the linear transformation for compressing pixel pi, where
A point nearest the input pixel pi on the sRGB boundary line projection along the compression direction is further determined. This intersection between the compression line and the RGB boundary line projection may be expressed as:
In
Returning to
At operation 436, chroma and lightness of the input pixel is mapped to an output pixel chroma and lightness through linear transformation based on the distances d(pi, Bp
For embodiments operating in the relative colorimetric mapping mode, where out-of-gamut colors are to be projected to the gamut surface with no mapping of in-gamut colors, the transformed chroma value is set equal to the chroma value at the boundary intersection point:
in response to the distance between the input pixel and the reference point d(pi, Rp
For embodiments operating in the perceptual mapping mode, where all source colors are smoothly mapped into the target gamut with those outside of the output gamut moving relatively more than those inside, the transformed chroma value is determined based on an internal and external line of compression. These lines are parallel to the sRGB boundary with the external line being farther from the reference point Rp
d(Rp
d
p
,final
=d(Rp
For equation (19),
d
p
,inner=max(d(Rp
d
p
,outer=(Rp
where din is the internal line of compression and dout is the external line of compression, which depend on the input pixel value:
Here din1, dout1, din,default, dout,default are parameters that control the level of compression, and are configurable through a graphics driver in the exemplary embodiment.
Method 401 then proceeds to operation 437 where the UV compression scaling factor sfp
otherwise:
sf
p
=sf
global, (27)
which enables the saturation mode where the relative saturation values of all colors are maintained through a scaling by a predetermined global scaling factor. In an exemplary embodiment, sfglobal is configurable through a graphics driver.
Method 401 then completes with compressing the value of the input pixel pi as:
u
p
,out
=u
p
,in
;v
p
,out
=v
p
,in
;y
p
,out
=y
p
,in if cp
u
p
,out
=u
p
,in
×sf
p
;v
p
,out
=v
p
,in
×sf
p
;y
p
,out
=l
p
,output. (29)
Color space conversion circuitry 520, coupled to an output of xvYCC decoding circuitry 510, performs the YUV to LCH conversion operation on the YUV/YCbCr format pixel values. Scaling and transformed luminance calculation circuitry 530, coupled to an output of color space conversion circuitry 520 and in or more memory 560, fetches chroma and lightness values for the sRGB boundary projection vertex V based on hue angle H, from lookup table 531. Scaling and transformed luminance calculation circuitry 530 further determines the sRGB boundaries, compression slope and linear transform parameters as a function of the mapping mode flag 533 stored in memory 560. Fixed-hue gamut compression circuitry 540 is coupled to outputs of xvYCC decoding circuitry 510, color space conversion circuitry 520, and scaling and transformed luminance calculation circuitry 530. Fixed-hue gamut compression circuitry 540 receives input pixel chroma cp
Method 601 begins with receiving input pixel values 106 and an indication of the mapping mode. In embodiments where gamut compression module 145 (
In embodiments where gamut compression module 145 (
sf
p
=AR
Δrgb
−Δrgb
, if (compressflag=1) & (mode=saturation|relative); (30)
Source-target gamut analysis circuitry 146 (
In embodiments where gamut compression module 145 (
sf
p
=f(din,dout), if (compressflag=1) & (mode=perceptual), where (31)
f(din, dout) is a function dependent on din, dout introduced in equations (21) and (22). Compression level parameters din1, dout1, din,default, dout,default are determined at operation 650 as functions proportional to ARΔrgb
In embodiments, system 1000 includes a platform 1002 coupled to a HID 1020. Platform 1002 may receive captured personal media data from a personal media data services device(s) 1030, a personal media data delivery device(s) 1040, or other similar content source. A navigation controller 1050 including one or more navigation features may be used to interact with, for example, platform 1002 and/or HID 1020. Each of these components is described in greater detail below.
In embodiments, platform 1002 may include any combination of a chipset 1005, processor 1010, memory 1012, storage 1014, graphics processor 1015, applications 1016 and/or radio 1018. Chipset 1005 may provide intercommunication among processor 1010, memory 1012, storage 1014, graphics processor 1015, applications 1016, or radio 1018. For example, chipset 1005 may include a storage adapter (not depicted) capable of providing intercommunication with storage 1014.
Processor 1010 may be implemented as one or more Complex Instruction Set Computer (CISC) or Reduced Instruction Set Computer (RISC) processors; x86 instruction set compatible processors, multi-core, or any other microprocessor or central processing unit (CPU). In embodiments, processor 1010 may be a multi-core processor(s), multi-core mobile processor(s), and so forth.
Memory 1012 may be implemented as a volatile memory device such as, but not limited to, a Random Access Memory (RAM), Dynamic Random Access Memory (DRAM), or Static RAM (SRAM).
Storage 1014 may be implemented as a non-volatile storage device such as, but not limited to, a magnetic disk drive, optical disk drive, tape drive, an internal storage device, an attached storage device, flash memory, battery backed-up SDRAM (synchronous DRAM), and/or a network accessible storage device. In embodiments, storage 1014 may include technology to increase the storage performance enhanced protection for valuable digital media when multiple hard drives are included, for example.
Graphics processor 1015 may perform processing of images such as still or video media data for display, or perform general computing functions in a highly parallel manner. Graphics processor 1015 may include one or more GPU, or visual processing unit (VPU), for example. An analog or digital interface may be used to communicatively couple graphics processor 1015 and display 1020. For example, the interface may be any of a High-Definition Multimedia Interface, Display Port, wireless HDMI, and/or wireless HD compliant techniques. Graphics processor 1015 may be integrated with central processor 1010 onto a single chip (i.e., SoC) as a graphics core or provided as part of chipset 1005. In some implementations, graphics processor 1015 may be a stand-alone card communicatively coupled to chipset 1005. In various exemplary embodiments, graphics processor 1015 and/or central processor 1010 invokes or otherwise implements video enhancement operations including gamut compression. Graphics processor 1015 includes functionality to perform source/output gamut analysis methods upon which fixed and semi-fixed video gamut compression processes may be predicated, for example as described elsewhere herein.
The fixed and semi-fixed-hue gamut compression processes as described herein may be implemented in various hardware architectures, cell designs, or “IP cores.” As still another embodiment, the methods and functions described herein in the context of graphics processor may be extended to a general-purpose processor, including a multi-core processor. In further embodiments, the methods and functions may be implemented in a purpose-built consumer electronics device, such as a game console processor.
Radio 1018 may include one or more radios capable of transmitting and receiving signals using various suitable wireless communications techniques. Such techniques may involve communications across one or more wireless networks. Example wireless networks include (but are not limited to) wireless local area networks (WLANs), wireless personal area networks (WPANs), wireless metropolitan area network (WMANs), cellular networks, and satellite networks. In communicating across such networks, radio 1018 may operate in accordance with one or more applicable standards in any version.
In embodiments, HID 1020 may include any television type monitor or display. HID 1020 may include, for example, a computer display screen, touch screen display, video monitor, television-like device, and/or a television. HID 1020 may be digital and/or analog.
In embodiments, HID 1020 may be a holographic display. Also, HID 1020 may be a transparent surface that may receive a visual projection. Such projections may convey various forms of information, images, and/or objects. For example, such projections may be a visual overlay for a mobile augmented reality (MAR) application. Under the control of one or more software applications 1016, platform 1002 may display user interface 1022 on HID 1020.
In embodiments, platform 1002 may receive control signals from navigation controller 1050 having one or more navigation features. The navigation features of controller 1050 may be used to interact with user interface 1022, for example. In embodiments, navigation controller 1050 may be a pointing device that may be a computer hardware component (specifically, a human interface device) that allows a user to input spatial (e.g., continuous and multi-dimensional) data into a computer. Many systems such as graphical user interfaces (GUI), and televisions and monitors allow the user to control and provide data to the computer or television using physical gestures.
Movements of the navigation features of controller 1050 may be replicated on a display (e.g., HID 1020) by movements of a pointer, cursor, focus ring, or other visual indicators displayed on the display. For example, under the control of software applications 1016, the navigation features located on navigation controller 1050 may be mapped to virtual navigation features displayed on user interface 1022, for example. In embodiments, controller 1050 may not be a separate component but may be integrated into platform 1002 and/or HID 1020. The present disclosure, however, is not limited to the elements or in the context shown or described herein.
In embodiments, system 1000 may be implemented as a wireless system, a wired system, or a combination of both. When implemented as a wireless system, system 1000 may include components and interfaces suitable for communicating over a wireless shared media, such as one or more antennas, transmitters, receivers, transceivers, amplifiers, filters, control logic, and so forth. An example of wireless shared media may include portions of a wireless spectrum, such as the RF spectrum and so forth. When implemented as a wired system, system 1000 may include components and interfaces suitable for communicating over wired communications media, such as input/output (I/O) adapters, physical connectors to connect the I/O adapter with a corresponding wired communications medium, a network interface card (NIC), disc controller, video controller, audio controller, and the like. Examples of wired communications media may include a wire, cable, metal leads, printed circuit board (PCB), backplane, switch fabric, semiconductor material, twisted-pair wire, co-axial cable, fiber optics, and so forth.
As described above, system 1000 may be embodied in varying physical styles or form factors.
Examples of a mobile computing device may include a personal computer (PC), laptop computer, ultra-laptop computer, tablet, touch pad, portable computer, handheld computer, palmtop computer, personal digital assistant (PDA), cellular telephone, combination cellular telephone/PDA, television, smart device (e.g., smartphone, tablet or smart television), mobile internet device (MID), messaging device, data communication device, and so forth.
Examples of a mobile computing device also may include computers and/or media capture/transmission devices configured to be worn by a person, such as a wrist computer, finger computer, ring computer, eyeglass computer, belt-clip computer, arm-band computer, shoe computers, clothing computers, and other wearable computers. In various embodiments, for example, a mobile computing device may be implemented as a smart phone capable of executing computer applications, as well as voice communications and/or data communications. Although some embodiments may be described with a mobile computing device implemented as a smart phone by way of example, it may be appreciated that other embodiments may be implemented using other wireless mobile computing devices as well. The embodiments are not limited in this context.
As shown in
Embodiments described herein may be implemented using hardware elements, software elements, or a combination of both. Examples of hardware elements or modules include: processors, microprocessors, circuitry, circuit elements (e.g., transistors, resistors, capacitors, inductors, and so forth), integrated circuits, application specific integrated circuits (ASIC), programmable logic devices (PLD), digital signal processors (DSP), field programmable gate array (FPGA), logic gates, registers, semiconductor device, chips, microchips, chip sets, and so forth. Examples of software elements or modules include: applications, computer programs, application programs, system programs, machine programs, operating system software, middleware, firmware, routines, subroutines, functions, methods, procedures, software interfaces, application programming interfaces (API), instruction sets, computing code, computer code, code segments, computer code segments, data words, values, symbols, or any combination thereof. Determining whether an embodiment is implemented using hardware elements and/or software elements may vary in accordance with any number of factors considered for the choice of design, such as, but not limited to: desired computational rate, power levels, heat tolerances, processing cycle budget, input data rates, output data rates, memory resources, data bus speeds and other design or performance constraints.
One or more aspects of at least one embodiment may be implemented by representative instructions stored on a machine-readable storage medium. Such instructions may reside, completely or at least partially, within a main memory and/or within a processor during execution thereof by the machine, the main memory and the processor portions storing the instructions then also constituting a machine-readable storage media. Programmable logic circuitry may have registers, state machines, etc. configured by the processor implementing the computer readable media. Such logic circuitry, as programmed, may then be understood to have been physically transformed into a system falling within the scope of the embodiments described herein. Instructions representing various logic within the processor, which when read by a machine may also cause the machine to fabricate logic adhering to the architectures described herein and/or to perform the techniques described herein. Such representations, known as cell designs, or IP cores, may be stored on a tangible, machine-readable medium and supplied to various customers or manufacturing facilities to load into the fabrication machines that actually make the logic or processor.
While certain features set forth herein have been described with reference to embodiments, this description is not intended to be construed in a limiting sense. Hence, various modifications of the implementations described herein, as well as other implementations, which are apparent to persons skilled in the art to which the present disclosure pertains are deemed to be within the spirit and scope of the present disclosure.
The following examples pertain to particular exemplary embodiments.
In one or more first embodiment, a computer-implemented image processing method includes receiving input image pixel values, determining source gamut information associated with the input image pixel values, and performing a comparison between the sRGB color gamut and an output color gamut associated with an image pixel destination. The method includes adjusting one or more of the input image pixel values by performing a fixed-hue gamut compression or a semi-fixed-hue gamut compression depending upon the comparison and the source gamut information. The method includes storing the color adjusted input image pixel to a memory.
In furtherance of the one or more first embodiment, performing the comparison between the sRGB color gamut and the output color gamut further comprises comparing xy chromaticity values of sRGB primaries to xy chromaticity values of output gamut primaries, and comparing an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries.
In furtherance of the one or more first embodiment, performing the comparison between the sRGB color gamut and the output color gamut further comprises comparing xy chromaticity values of sRGB primaries to xy chromaticity values of the output gamut primaries, and comparing an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries. The method further comprises bypassing the gamut compression in response to the xy chromaticity values of the output gamut primaries differing from the xy chromaticity values of sRGB primaries by more than a first predetermined threshold, and the output gamut area failing to be smaller than the sRGB gamut area by a second predetermined threshold.
In furtherance of the one or more first embodiment, performing the comparison between the sRGB color gamut and the output color gamut further comprises: comparing xy chromaticity values of sRGB primaries to xy chromaticity values of the output gamut primaries; and comparing an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries. The method further comprises performing the semi-fixed-hue gamut compression with a chrominance compression scaling factor determined based on a ratio of the output gamut area and the sRGB gamut area, and based on a mapping mode selectable between a perceptual mode and at least one of a saturation mode and relative colorimetric mode.
In furtherance of the embodiment immediately above, performing the semi-fixed-hue gamut compression further comprises determining a chrominance compression scaling factor based on a ratio of the output gamut area to the sRGB gamut area (AR), and scaling a chrominance value of the input pixels with the chrominance compression scaling factor.
In furtherance of the embodiment immediately above, determining the chrominance compression scaling factor based the AR further comprises setting the chrominance compression scaling factor equal to a function of the AR in response to a selection of the saturation mode or relative colorimetric mode, or determining an inner and outer line of compression within which pixel values are to be compressed based on the AR in response to a selection of the perceptual mode.
In furtherance of the embodiment immediately above, the semi-fixed-hue gamut compression further comprises transforming the input pixel values from luma, chrominance (YUV) space to lightness, chroma, hue (LCH) space, determining an sRGB boundary for a hue angle of an input pixel, determining a compression line slope and linear transform parameters based on the sRGB boundary, and moving a pixel value outside of the sRGB boundary inward based at least on the compression line slope, linear transform parameters, and the inner and outer line of compression.
In furtherance of the one or more first embodiment, the fixed-hue gamut compression further comprises transforming the input pixel values from luma, chrominance (YUV) space to lightness, chroma, hue (LCH) space; determining a chroma and lightness value of a vertex of the sRGB boundary based on a hue angle of the input pixel; determining a compression line intersecting the input pixel L and C values based on a slope of an sRGB boundary line intersecting the vertex; determining a first distance between the input pixel L and C values and corresponding values at an intersection of the compression line and the L-axis; determining a second distance between the input pixel L and C values and corresponding values at an intersection of the compression line and the sRGB boundary; and linearly transforming the input pixel L and C values based on the first and second distances. The linearly transforming further comprises determining an internal line and external line of compression parallel to, and on either side of the sRGB boundary, based on the on the comparison between the sRGB color gamut and the output color gamut. The linearly transforming further comprises moving pixel input values on the sRGB boundary to the internal line of compression. The linearly transforming further comprises moving pixel input values on the external line of compression to the sRGB boundary. The linearly transforming further comprises moving pixel input values on the sRGB boundary to the internal line of compression.
In furtherance of the embodiment immediately above, determining the internal line and external line of compression based on the on the comparison between the sRGB color gamut and the output color gamut further comprises determining default values for the internal and external lines of compression associated with the sRGB gamut, and modifying the default values as a function of a difference between an output gamut area defined by xy chromaticity values of the output gamut primaries, and an sRGB gamut area defined by xy chromaticity values of the sRGB primaries.
In furtherance of the embodiment immediately above, the semi-fixed-hue gamut compression further comprises determining a chrominance compression scaling factor based on a ratio of the linearly transformed the input pixel C value and the input pixel C, and multiplying the input pixel U and V values by the chrominance compression scaling factor.
In one or more second embodiment, an adaptive color compression module includes an input to receive image pixel values. The module includes a source-target gamut analysis module coupled to the image pixel value input, the source-target gamut analysis module having logic circuitry to determine source gamut information associated with the input image pixel values, and to perform a comparison between the sRGB color gamut and an output color gamut associated with an image pixel destination. The adaptive color compression module includes a color gamut compression module coupled to the source-target gamut analysis module, the color gamut compression module including logic circuitry to adjust a color of one or more of the input image pixel values by adapting between a fixed-hue gamut compression mode and a semi-fixed-hue gamut compression mode based on the comparison and the source gamut information.
In furtherance of the one or more second embodiment, the source-target gamut analysis module is further to compare xy chromaticity values of sRGB primaries to xy chromaticity values of output gamut primaries, and compare an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries.
In furtherance of the embodiment immediately above, the source-target gamut analysis module is further to cause the gamut compression module to bypass gamut compression in response to the xy chromaticity values of the output gamut primaries differing from the xy chromaticity values of sRGB primaries by more than a first predetermined threshold, and the output gamut area failing to be smaller than the sRGB gamut area by a second predetermined threshold.
In furtherance of the embodiment immediately above, the source-target gamut analysis module is further to receive a mapping mode signal, set a chrominance compression scaling factor equal to a function of the AR in response to the mapping mode signal being indicative of a saturation mode or a relative colorimetric mode, or determine an inner and outer line of compression within which pixel values are to be compressed based on the AR in response to the mapping mode signal being indicative of a perceptual mode. Also in furtherance of the embodiment immediately above the gamut compression module is further to perform semi-fixed-hue gamut compression with a chrominance compression scaling factor determined based on a ratio of the output gamut area and the sRGB gamut area, and further based on a mapping mode selectable between a perceptual mode and at least one of a saturation mode and relative colorimetric mode.
In furtherance of the embodiment immediately above, the gamut compression module further includes a color space conversion logic circuit to transform the input pixel values from luma, chrominance (YUV) space to lightness, chroma, hue (LCH) space. The gamut compression module further includes a scaling and transformed luminance calculation logic circuit, coupled to the color space conversion logic circuit, and to determine an sRGB boundary for a hue angle of an input pixel, determine a compression line slope and linear transform parameters based on the sRGB boundary. The gamut compression module further includes a fixed-hue gamut compression logic circuit to move a pixel value outside of the sRGB boundary inward based at least on the compression line slope, linear transform parameters, and the inner and outer line of compression.
In one or more third embodiment, a mobile device includes a display screen having an output color gamut, a memory to store raw image pixel values having a source color gamut, and a processor including the color gamut compression module in any of the embodiments above with the color gamut compression module coupled to the memory to receive the image pixel values, and further coupled to the display to output the image pixel values subsequent to the color adjustment.
In one or more fourth embodiment, one or more computer-readable storage media, with instructions stored thereon, which when executed by a processor, cause the processor to perform a method comprising receiving input image pixel values, determining source gamut information associated with the input image pixel values, and performing a comparison between the sRGB color gamut and an output color gamut associated with an image pixel destination. The method performed further includes adjusting one or more of the input image pixel values by performing a fixed-hue gamut compression or a semi-fixed-hue gamut compression depending on the comparison and the source gamut information. The method performed further includes storing the color adjusted input image pixel to a memory.
In furtherance of the one or more fourth embodiment, the instructions stored thereon, which when executed by the processor, further cause the processor to perform the method further comprising comparing xy chromaticity values of sRGB primaries to xy chromaticity values of output gamut primaries, and comparing an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries.
In furtherance of the one or more fourth embodiment, the instructions stored thereon, which when executed by the processor, further cause the processor to perform the further comprising: comparing xy chromaticity values of sRGB primaries to xy chromaticity values of the output gamut primaries, and comparing an output gamut area defined by the xy chromaticity values of the output gamut primaries with an sRGB gamut area defined by the xy chromaticity values of the sRGB primaries. The media further comprises instructions stored thereon, which when executed by the processor, further cause the processor to perform the further comprising bypassing the gamut compression in response to the chromaticity values of the output gamut primaries differing from the chromaticity values of sRGB primaries by more than a first predetermined threshold, and the output gamut area failing to be smaller than the sRGB gamut area by a second predetermined threshold.
In one or more fifth embodiment, one or more computer-readable storage media, with instructions stored thereon, which when executed by a processor, cause the processor to perform any of the first embodiments described above.
In one or more sixth embodiment, an adaptive color compression means includes an input means for receiving input image pixel values. The color compression means comprises an input analysis means for determining source gamut information associated with the input image pixel values. The color compression means comprises a gamut analysis means for performing a comparison between the sRGB color gamut and an output color gamut associated with an image pixel destination. The color compression means comprises a gamut compression means for adjusting one or more of the input image pixel values by performing a fixed-hue gamut compression or a semi-fixed-hue gamut compression depending upon the comparison and the source gamut information.
In one or more seventh embodiment, a mobile device, includes a display means having an output color gamut, a memory means for storing raw image pixel values having a source color gamut, and a processor including an adaptive color gamut compression means. The adaptive color gamut compression means further includes an input means for receiving input image pixel values. The adaptive color gamut compression means an input analysis means for determining source gamut information associated with the input image pixel values. The adaptive color gamut compression means a gamut analysis means for performing a comparison between the sRGB color gamut and an output color gamut associated with an image pixel destination. The adaptive color gamut compression means includes a gamut compression means for adjusting one or more of the input image pixel values by performing a fixed-hue gamut compression or a semi-fixed-hue gamut compression depending upon the comparison and the source gamut information. The adaptive color gamut compression means is coupled to the memory means to receive the image pixel values, and is coupled to the display means to output the image pixel values subsequent to the color adjustment.
In one or more eighth embodiment, any of the first embodiments described above include the fixed-hue gamut compression, and the fixed-hue gamut compression further comprises transforming the input pixel values from luma, chrominance (YUV) space to lightness, chroma, hue (LCH) space. The fixed-hue gamut compression further comprises determining a chroma and lightness value of a vertex of the sRGB boundary based on a hue angle of the input pixel. The fixed-hue gamut compression further comprises determining a compression line intersecting the input pixel L and C values based on a slope of an sRGB boundary line intersecting the vertex. The fixed-hue gamut compression further comprises determining a first distance between the input pixel L and C values and corresponding values at an intersection of the compression line and the L-axis. The fixed-hue gamut compression further comprises determining a second distance between the input pixel L and C values and corresponding values at an intersection of the compression line and the sRGB boundary. The fixed-hue gamut compression further comprises linearly transforming the input pixel L and C values based on the first and second distances. The linearly transforming further comprises determining an internal line and external line of compression parallel to, and on either side of the sRGB boundary, based on the on the comparison between the sRGB color gamut and the output color gamut. The linearly transforming further comprises moving pixel input values on the sRGB boundary to the internal line of compression. The linearly transforming further comprises moving pixel input values on the external line of compression to the sRGB boundary. The linearly transforming further comprises moving pixel input values on the sRGB boundary to the internal line of compression.
It will be recognized that the embodiments are not limited to the exemplary embodiments so described, but can be practiced with modification and alteration without departing from the scope of the appended claims. For example, the above embodiments may include specific combination of features. However, the above embodiments are not limited in this regard and, in embodiments, the above embodiments may include the undertaking only a subset of such features, undertaking a different order of such features, undertaking a different combination of such features, and/or undertaking additional features than those features explicitly listed. Scope should, therefore, be determined with reference to the appended claims, along with the full scope of equivalents to which such claims are entitled.
The present application claims the benefit of priority of National Phase Application PCT/US2014/032245, filed on 28 Mar. 2014, and of U.S. Provisional Application No. 61/829,310, filed 31 May 2013, and titled “A Semi-fixed Hue Compression Method for sRGB to Low-Gamut Mapping”, the contents of which are hereby incorporated in their entirety for all purposes.
Filing Document | Filing Date | Country | Kind |
---|---|---|---|
PCT/US14/32245 | 3/28/2014 | WO | 00 |
Number | Date | Country | |
---|---|---|---|
61829310 | May 2013 | US |