|Publication number||US5341228 A|
|Application number||US 07/801,921|
|Publication date||23 Aug 1994|
|Filing date||3 Dec 1991|
|Priority date||4 Dec 1990|
|Also published as||US5477305, US5543941, US5708518, US5726772|
|Publication number||07801921, 801921, US 5341228 A, US 5341228A, US-A-5341228, US5341228 A, US5341228A|
|Inventors||Kevin J. Parker, Theophano Mitsa|
|Original Assignee||Research Corporation Technologies|
|Export Citation||BiBTeX, EndNote, RefMan|
|Patent Citations (34), Non-Patent Citations (7), Referenced by (93), Classifications (20), Legal Events (8)|
|External Links: USPTO, USPTO Assignment, Espacenet|
This application is a continuation-in-part of U.S. patent application Ser. No. 07/622,056, filed Dec. 4, 1990, now U.S. Pat. No. 5,111,310 and entitled METHOD AND APPARATUS FOR HALFTONE RENDERING OF A GRAY SCALE IMAGE USING A BLUE NOISE MASK.
The present invention relates generally to the halftoning of images. More particularly, the present invention relates to a method of and system for rendering a halftone by utilizing a pixel-by-pixel comparison of the gray scale image against a blue noise mask.
Many printing devices are not capable of reproducing gray scale images because they are bi-level. As a result, the binary representation of a gray scale image is a necessity in a wide range of applications such as laser printers, facsimile machines, lithography (newspaper printing), liquid crystal displays and plasma panels. Gray scale images are typically converted to binary images using halftone techniques. Halftoning renders the illusion of various shades of gray by using only two levels, black and white, and can be implemented either digitally (facsimile machines, laser printers) or optically (newspaper printing).
Halftoning algorithms are classified into point and neighborhood algorithms according to the number of points from the input gray scale image required to calculate one output point in the output binary image. In the case of digital halftoning, points correspond to pixels. In point algorithms, the halftoning is accomplished by a simple pointwise comparison of the gray scale image against a nonimage, usually aperiodic (but not always) array or mask. For every point in the input image, depending on which point value (the gray scale image or the mask) is larger, either a 1 or 0 is placed respectively at the corresponding location in the binary output image. Halftoning using neighborhood algorithms is not done by simple pointwise comparison, but usually requires filtering operations that involve a number of points from the input gray scale image in order to calculate one point in the output image.
At present, given the existing halftoning algorithms, the choice for a specific halftoning algorithm depends on the target device and always requires a trade-off between image quality and speed. Neighborhood halftoning algorithms result in a good image quality (although the image is not completely artifact free), but they are slow and cannot be optically implemented. That leaves point algorithms as the only choice for optical applications such as newspaper printing. Point algorithms are fast and are suitable for all target devices, but the output usually suffers from artifacts such as periodic artifacts and false contours.
The halftoning system disclosed herein utilizes a point algorithm, and combines the output image quality of neighborhood algorithms with the speed and wide application range of point algorithms. A point algorithm is utilized and the halftoning is achieved by a pixelwise comparison against a nonimage array, called the "blue noise" mask.
The digital halftoning of images with multiple levels, such as gray scale levels, is known in the art. Two major techniques are currently in use. They are the ordered dither and the error diffusion methods. See Digital Halftoning by R. Ulichney, MIT Press, Cambridge, Mass. (1987). See also R. W. Floyd and L. Steinberg, "Adaptive algorithm for spatial gray scale", SID International Symposium Digest of Technical Papers, pps. 36-37. The Floyd and Steinberg paper is directed to the digital halftoning of a gray scale.
The major ordered dither techniques are the clustered-dot dither and dispersed-dot dither techniques. A white noise random dither technique is seldom utilized because it produces the poorest quality image and, of the other two dither techniques, clustered-dot is by far the most used. Both of those techniques are based upon a threshold screen pattern that is of a fixed size. For example, 6×6 threshold screens may be compared with the digital input values. If the input digital value is greater than the screen pattern number, a 1 is produced and, if it is less, a 0 value is assigned. The number of levels that can be represented using either technique depends on the size of the screen. For example, a 6×6 screen can produce 36 unique levels.
More levels can be achieved with larger patterns, however, a reduction in the effective resolution occurs because the ability to transition among levels is at a coarser pitch. At the pixel rate of about 300 to 500 per inch, which is the average pixel rate of copiers and laser printers, the pattern artifacts are visible for screen patterns larger than 4×4, and, since 16 levels do not provide an adequate precision for typical continuous-tone imagery, a suboptimal resolution is usually obtained.
One solution to such a problem is disclosed by Ulichney in a paper "Dithering with Blue Noise" published in the Proceedings of the IEEE, Vol. 76, No. 1, January 1988. In that article, a method of spatial dithering is described which renders the illusion of continuous-tone pictures on displays that are capable of only producing binary picture elements. The method produces a blue noise pattern high frequency white noise from a filter to provide desirable properties for halftoning. More specifically, Ulichney uses perturbed-weight error diffusion methods which when digitally implemented run at a much slower speed (approximately 100 times slower) than is attainable with the present invention.
Error diffusion techniques, such as that disclosed in the Ulichney IEEE article, are fundamentally different from ordered dither techniques in that there is no fixed screen pattern. Rather, a recursive algorithm is used that attempts to correct errors made by representing the continuous signal by binary values.
The error diffusion method described by Ulichney, and others, such as Floyd and Steinberg, also has the disadvantage that it requires scanning, convolution-style calculations and, although it can be implemented for use with copiers, facsimile machines, etc., requires local calculations. It cannot, however, be optically implemented. In addition, all error diffusion techniques, including those described by Ulichney and Floyd and Steinberg, show scanning and start-up artifacts, which are not present in the instant invention. Also, while Ulichney describes a method that produces blue noise, the blue noise patterns produced by the present invention are more isotropic than those produced by Ulichney or other error diffusion methods. Utilizing ordered dither methods produces notably periodic patterns that are even much more obtrusive than those produced by error diffusion methods.
In some prior art systems, all dot profiles corresponding to different gray levels were derived independently, as if each grade level was its own special case. Thus, for example, in U.S. Pat. No. 4,920,501, to Sullivan et al., many individual dot profiles, corresponding to the desired number of gray levels, must be stored. In the present invention, on the other hand, dot profiles are built "on top of" the profiles from lower gray levels, such that a single valued 2-dimensional function, that is, the cumulative array or blue noise mask, can be constructed. When that single valued function is thresholded at any level, the resulting binary pattern is exactly the blue noise dot profile design for that particular gray level, p(i,j,g), where p can be one or zero corresponding to black or white, i and j are coordinates of pixels, and g represents a gray level 0<g<1.
Another drawback to prior art methods is that the dot profile for a given gray level was designed to have blue noise properties by indirect methods, such as using an error diffusion filter with perturbed weights (Ulichney) or by a "simulated annealing" algorithm, as in U.S. Pat. No. 4,920,501. The method disclosed herein is advantageous with respect to the prior art in that the desired blue noise power spectrum is produced through the use of a filter on the dot profile and is implemented directly in the transform domain. Such filtering results in a nearly ideal blue noise pattern with implicit long-scale periodicity because of the circular convolution implicit in the use of discrete Fourier transforms. However, the filtered pattern is no longer binary. Thus, a minimization of error approach is utilized in which the largest differences between the ideal, filtered, blue noise pattern and the unfiltered dot profile are identified. The magnitude and location of those differences indicate the pixels in which ones and zeros could be changed to produce a more ideal blue noise dot profile.
Display devices, including printing devices as well as media, have their own unique input-output characteristics. In some uses, such as medical ultrasound imaging, the user has traditionally been provided with some control as to the final gray scale mapping. For example, the user may be able to select between high and low contrast images. The display and film characteristics, however, must be accounted for in each rendition.
In the area of halftone rendering, traditional halftone screens using small (for example, 8×8 pixel kernels) provide only limited degrees of freedom to alter the input-output characteristics and usually a linear cumulative distribution function (CDF) has been reported. See Digital Halftoning by R. Ulichney, MIT Press, Cambridge, Mass. (1987). See also, R. Bayer, "An Optimum Method for 2 Level Rendition of Continuous Tone Pictures", IEEE International Conf. Comm., 1973, and G. C. Reid, Postscript Language Program Design (green book), Addison-Wesley Publishing Co., New York, N.Y. (1988), page 137. By a linear CDF, it is meant that 10% of the halftone kernel pixel contents will be less than 10% of the maximum value and that 50% of the pixels will contain values less than 50% of the maximum values, and so forth.
In the case of the blue noise mask method disclosed herein, a large unstructured pattern of, for example, 256×256 pixel kernels, provides sufficient degrees of freedom to modify the cumulative distribution function so as to provide both linear and non-linear mappings of input and output characteristics. That makes it possible to construct specialized blue noise masks in which a particular printer output and media characteristics can be compensated for by a modified blue noise mask generated as disclosed in this application.
The present inventive method herein may also be applied to color halftoning, by independently thresholding each of the component colors against the disclosed blue noise mask and then overprinting. Such method produces a pleasing pattern without any blurring of the image. Such method is a great improvement over the known prior art, which is discussed below.
In U.S. Pat. No. 5,010,398, there is disclosed a method for color corrections by dry dye etching using a photographically produced mask which may be used in the production of printing plates for printing reproductions of colored originals and in which a contact print is overexposed to a photographic mask. The photographic mask is constituted so as to isolate a selected area in addition to being exposed normally for obtaining an exact copy of an original halftone separation. The mask is electronically generated by scanning each separation, digitizing each signal and then storing the digital values in a digital storage device.
U.S. Pat. No. 4,974,067 relates to a multi-step digital color image reproducing method and apparatus which separates an original image into a plurality of color components to produce image data associated with each respective one of the color components. The image data are individually processed to provide record color component density data which data are used to record a halftone representation pattern of that color component.
An apparatus and methods for digital halftoning is disclosed in U.S. Pat. No. 4,924,301 for producing halftone screens or color separations from continuous tone intensity signals that are supplied by an optical scanner. Using a digital signal processor, the continuous tone intensity values are processed to establish memory maps which, in conjunction with a digital data output device such as a laser printer, produces the desired halftone screen. The digital signal processor utilizes a dither matrix in order to produce halftone screens having a screen angle that does not substantially differ from the screen angles of the yellow, cyan and magenta color separations in conventional four color halftone printing. A dither array is also utilized to produce the halftone screens having a screen angle that substantially differs from the screen angle used in the black halftone color separation in conventional four color halftone printing.
U.S. Pat. No. 4,342,046 relates to a contact screen for making color separation halftone blocks for use in a picture reproducing machine in which a plurality of halftone screens having different screen angles are arranged on a base film in the corresponding positions of color separation reproduction pictures to be reproduced on the base film and transparent blank spaces are formed between two adjacent halftone screens.
A method and apparatus for making monochrome facsimiles of color images on color displays is disclosed in U.S. Pat. No. 4,308,533 for making 35 MM color slides from a color image created on a color cathode tube terminal. U.S. Pat. No. 3,085,878 relates to the preparation of traditional halftone screens for color separation.
U.S. Pat. No. 4,657,831 relates to the production of electrophotographic color proofs of halftone dot pattern images which closely simulate the dot gain of prints made with lithographic plates and liquid inks.
A process for the production of photographic masks is disclosed in U.S. Pat. No. 4,997,733 in which such masks are used for the tonal correction by dry dot etching in which the selection of a particular halftone color separation image or overlaying registering combination of halftone color separation images is determined on the basis of optical density differences in at least one such halftone color separation. Such differences include differences in contrast, between each area to be isolated as a substantially transparent area, and at least one particular background area surrounding each area to be isolated.
U.S. Pat. No. 4,477,833 is directed to a method of color conversion with improved interpolation in which an apparatus for converting a color image from one colored space to another colored space includes a memory which stores a finite number of output signals which represent colors in the output space and which is addressed by signals representing a color in the input space. The interpolation process is utilized in order to derive an output color value for an input color located between colors stored in the memory.
A method and apparatus for producing halftone printing forms with rotated screens based upon randomly selected screen threshold values is disclosed in U.S. Pat. No. 4,700,235. The screens have arbitrary screen angles and screen width. Screen dots are exposed on a recording media by means of a recording element whose exposure beam is switched on and off by a control signal.
None of the foregoing references have the advantages of the use of the blue noise mask method disclosed herein in producing pleasing, isotropic, non-clumpy, moire resistant patterns with only some spreading out of the color or ink but with no blurring of the image.
In view of the foregoing, it should be apparent that there still exists a need in the art for a method of and apparatus for the halftone rendering of gray scale images in which a digital data processor is utilized in a simple and precise manner to accomplish the halftone rendering to provide a binary scale image which is characterized by the pixelwise comparison of the image being analyzed against a blue noise mask. There also exists a need for the modification of such halftone rendering process in order to counter some undesirable printer and media dependent effects such that the halftone rendering of gray scales is modified to produce input and output characteristics unique to a particular type of device or media and in which the images produced are superior to those produced without such modification process.
It should likewise be apparent that there still exists a need in the art for a method for color halftoning by independently thresholding each of the component colors against a blue noise mask in order to produce a pleasing, isotropic, non-clumpy, moire resistant pattern with only some spreading out of the color or ink but with no blurring of the image.
More particularly, it is an object of this invention to provide a system for the halftone rendering of a gray scale image which has a simple and reliable mechanism for producing the desired image.
Still more particularly, it is an object of this invention to provide a system for the halftone rendering of a gray scale image which can be implemented either digitally or optically.
It is another object of this invention to provide a system for the halftone rendering of a gray scale image which tailors the image thus produced to compensate for particular output printer and media characteristics such that the undesired display of media characteristics can be substantially eliminated.
It is yet another object of this invention to provide a system for the halftone rendering of continuous tone color images such that pleasing images are produced with little spreading out of the color and with no blurring of the image.
Briefly described, these and other objects of the invention are accomplished by generating a blue noise mask which, when thresholded at any gray level g, produces a blue noise binary pattern appropriate for that gray level. After the blue noise mask has been generated, it is stored in a PROM. The image to be halftoned is then read by a scanner on a pixel-by-pixel basis and compared to the corresponding stored pixel in the blue noise mask to produce the resulting binary array. The binary image array is then converted to a binary display which is the resultant halftoned image.
After the blue noise mask has been generated and stored, it may be modified to tailor it for a particular output printer and media characteristics such that compensation is provided in a blue noise mask for undesired display and media characteristics. The blue noise mask is modified by altering the first order statistics or the cumulative distribution function (CDF) to counter such undesirable printer and media dependent effects. The blue noise mask may be modified in a variety of ways, all of which usually include punching the blue noise mask. Punching the blue noise mask involves setting the extreme low values to a certain minimum value, for example, 0 and setting the extreme high values to a certain maximum value, for example 255. The values between the maximum and the minimum are then re-linearized.
The method of generating and utilizing the blue noise mask discussed above can also be applied to color halftoning, by independently thresholding each one of the component colors against the blue noise mask and then overprinting the halftoned component color images. The blue noise mask can also be shifted by one pixel before it is used on each of the different color planes. In that manner, the color energy is spread out over a larger space. For example, the blue noise mask can be shifted one pixel up or to the side, when the red image and blue image are being halftoned, respectively. Other variations and modifications for using the blue noise mask for color halftoning are discussed in the specification. Such principles may be used for either RGB halftoning or CMYK color printing.
In an optical implementation, the gray scale image is photographed through the generated blue noise mask and the resultant superposition is printed onto a high contrast film. An additive photographic process may also be utilized in which the blue noise mask is added to the gray scale image at the film plane, for example, by a double exposure process. The photographic blue noise mask can be obtained from a calculated blue noise array using a film printer interfaced to the PROM or computer in which the blue noise mask array is stored.
FIG. 1 is a drawing showing the power spectrum of a blue noise pattern formed in accordance with the present invention;
FIG. 2 is a diagram of a flow chart for the design of the blue noise mask of the present invention;
FIG. 3 is a diagram of a flow chart for the digital implementation of halftoning using a blue noise mask in accordance with the present invention;
FIG. 4 is a schematic block diagram of a hardware system for digitally implementing halftoning using the blue noise mask in accordance with the present invention;
FIG. 5 is a drawing of a multiplicative photographic process utilized for optically implementing halftoning using a blue noise mask in accordance with the present invention;
FIG. 6 is a drawing of an additive photographic process which may be utilized in the optical implementation of halftoning using a blue noise mask in connection with the process shown in FIG. 5;
FIG. 7 is a diagram of a flow chart showing the modification of a blue noise mask to produce a punched, linearized version of that blue noise mask;
FIG. 8 is a diagram of a flow chart for the modification of a blue noise mask using the concave down sigma curve modification to produce a high resolution version of the blue noise mask;
FIG. 9 is a diagram of a flow chart for the modification of a blue noise mask using the concave up sigma curve modification to produce a low resolution version of the blue noise mask;
FIG. 10 is a drawing showing the relationship of the number of pixels to the value of pixels for a linear blue noise mask;
FIG. 11 is a drawing showing the relationship between the number of pixels and the value of pixels for a non-linear, high contrast blue noise mask produced after applying the CDSC direct mapping processing with punch; and
FIG. 12 is a diagram of a flow chart showing the application of a blue noise mask to color halftoning.
Prior to referring to the drawings, the following description of the theoretical underpinnings of the present invention is provided.
As described above, the present invention is a halftone rendering system which accomplishes its function by a pixel-by-pixel comparison of a gray scale image against a "blue noise" mask. As referred to herein, the term "blue noise" is a pattern with negligible low frequency components which possesses certain visually pleasing properties, as described by R. Ulichney in his book, Digital Halftoning.
In the present invention, depending upon which pixel is larger, either the gray scale image or the blue noise mask, a 1 or a 0 is placed in the binary (black or white) image file which is the halftone rendered version of the gray scale image. Using the notation that the gray scale image is M×N pixels in size and B-bits of gray per pixel, the blue noise mask can be a smaller array J×K in size where J is less than or equal to M and K is less than or equal to N with only B-1 bits per pixel.
The blue noise mask described herein is constructed to have unique first and second order properties. When thresholded at any level, for example at A% of the maximum level, exactly A out of every 100 pixels will be greater than the threshold value. In addition, the spatial distribution of the pixels above the threshold is arranged in such a manner as to form a blue noise pattern which has been shown to be visually pleasing.
The disclosed blue noise mask, therefore, has the characteristic that the first order statistics are uniformly distributed over gray levels. That is, when the blue noise mask is thresholded at a gray level g, exactly g×100% of all values are below the threshold. For g=0.5, exactly 50% of the blue noise mask pixels are above, and 50% below the threshold value. The blue noise mask disclosed herein also has the characteristic that when thresholded at any level g, the resulting bit pattern has a power spectrum consistent with and approximating the ideal blue noise pattern for that threshold. In addition, since the blue noise image is constructed with explicit "wraparound" properties, a small blue noise pattern of J×K pixels can be used to halftone render a larger M×N pixel's image, because the pixel-by-pixel comparison can proceed modulo J and modulo K in the respective directions, with no apparent discontinuities or obvious periodicities. However, the value of (J×K) should not be smaller than X/2, where X is the number of levels of the original gray scale image.
It is also desirable to describe the digital halftoning system of the present invention for the analog case in which discrete space is replaced by continuous space. Using such notation, x and y represent continuous space, while i and j represent discrete space. Thus, the gray scale image is denoted by f(x,y), the blue noise mask is denoted by m(x,y) and the output (halftoned) binary image is denoted by h(x,y).
Thus, for a B-bit image array f(i,j), the blue noise mask array m(i,j) is a B-bit array such that, when thresholded against f(i,j), up to 2B levels of varying distribution of black and white dots can be represented on a rectangular grid. Note that the dimensions of the blue noise mask can be smaller than those of the gray scale image and that the halftoning of the gray scale image is achieved by a periodic repetition of m(i,j) over the entire image plane. For example, for a 256×256 8-bit class of images, a 128×128 8-bit blue noise mask array can be used.
The binary pattern that results after thresholding the blue noise mask at a constant level g is called the dot profile for that level. The dot profiles are arrays that have the same dimensions as the mask array, and consist of ones and zeros. The ratio of ones to zeros is different for every dot profile and depends on the gray level that particular dot profile represents. In the notation used herein, the higher the gray level, the more ones and less zeros that will be contained in the dot profile. p(i,j,g) is used to denote the value of the dot profile at pixel location (i,j) and for the gray level g. g=0 is used to represent black and g=1 is used to represent white. Thus, 0≦g≦1. Also, by denoting as fi,j the value of the discrete space function f(i,j) at pixel location (i,j), a N×N binary image h(x,y) can be written as follows in terms of the dot profiles: ##EQU1## where R is the spacing between the addressable points on the display device, and rect(x)=1 is |x|<1/2 and rect(x)=0 otherwise. Therefore, for any gray scale image, the corresponding binary image h(x,y) can be constructed as follows in terms of the dot profiles: For every pixel in the gray scale image array f(i,j) that is at the (i,j) location and has a value fi,j =g, the corresponding pixel in the binary image array h(i,j) has a value that is given by the value of the g-level dot profile at the (i,j) location.
The dot profiles for every level are designed and combined in such a way as to build a single valued function, the blue noise mask. The blue noise mask is constructed such that when thresholded at any level, the resulting dot profile is a locally aperiodic and isotropic binary pattern with small low-frequency components, which in the halftoning literature, is known as a blue noise pattern. Those dot profiles are not independent of each other, but the dot profile for level g1 +Δg is constructed from the dot profile for level g1 by replacing some selected zeros with ones. For example, for a N×N B-bit mask array and maximum pixel value given by 2B, Δg is given by Δg=1/2B and the number of zeros that will change to ones, in order to go from level g1 to level g1 +Δg is N2 /2B.
As the dot profile is changed from its pattern at g1 to g1 +Δg, another array called the cumulative array is incremented in such a way as to keep track of the changes in dot profiles from gray level to gray level. That cumulative array (not a binary array but a B-bit array) becomes the blue noise mask because, when thresholded at any level g, the resulting binary pattern reproduces the dot profile for that level.
Referring now to the figures wherein like reference numerals are used throughout, there is shown in FIG. 1 a diagram of the power spectrum of a blue noise pattern which is free of a low frequency component and is radially symmetric. The absence of low frequency components in the frequency domain corresponds to the absence of disturbing artifacts in the spatial domain. Radial symmetry in the frequency domain corresponds to isotropy in the spatial domain. Isotropy, aperiodicity and the lack of low-frequency artifacts are all desirable properties in halftoning because they lead to visually pleasing patterns.
As shown in FIG. 1, the cutoff frequency fg, which is termed the Principal Frequency, depends as follows on the gray level g: ##EQU2## where R, as before, is the distance between addressable points on the display and the gray level g is normalized between 0 and 1. As can be seen from the above equation, fg achieves its maximum value where g=1/2, since at that level the populations of black and white dots are equal and thus very high frequency components appear in the binary image.
For a N×N B-bit image with 2B as the maximum pixel value, the blue noise mask is constructed as follows: First, the dot profile p[i,j,1/2] that corresponds to the 50% gray level is created. That dot profile is generated from a white noise pattern after filtering it with a highpassed circularly symmetric filter and results in a binary pattern having visually annoying low frequency components. In order to give blue noise properties to the p[i,j,1/2] dot profile, the following iteration procedure is utilized, similar to that shown in FIG. 2, which is a flow chart showing the steps for designing a blue noise mask for generating level g+Δg from level g.
Step 1. Take the 2-dimensional Fourier transform of the dot profile p[i,j,1/2] and obtain the dot profile P[u,v,1/2], where u and v are the transformed coordinates, and P represents the Fourier Transform.
Step 2. Apply a blue noise filter D(u,v,1/2) to the spectrum P[u,v,1/2] and in that way obtain the new spectrum P'[u,v,1/2]=P[u,v,1/2] x D(u,v,1/2). The blue noise filter is designed to produce in the dot profile spectrum P'[u,v,1/2] an average cross section along a radially symmetric line shown in FIG. 1. The principal frequency is given by fg =1√2 R.
Step 3. Take the Inverse Fourier transform of P'[u,v,1/2] and obtain p'[i,j,1/2], which is no longer binary but has much better blue noise properties.
Step 4. Form the difference e[i,j,1/2]=p'[i,j,1/2]-p[i,j,1/2]. That difference is referred to as the error array.
Step 5. Classify all pixels into two classes according to the value of p[i,j,1/2] for each pixel; all the zeros belong in the first class and all the ones in the second. Then, rank order all the pixels in those two classes according to the value of e[i,j,1/2] for each pixel.
Step 6. Set a limit, λ.sub.ε =ε, for the magnitude of the highest acceptable error. That limit is usually set equal to the average magnitude error. For the zeros, λ.sub.ε =ε and for the ones, λ.sub.ε =-ε. Change all the pixels that contain a zero and have an error higher than the defined limit to ones. Similarly, change all the pixels that contain a one and have an error smaller than the defined negative limit to zeros. The number of zeros that are changed to ones must be equal to the number of ones that are changed to zeros so that the total average is preserved. The initialization process is then complete.
The above procedure is then repeated until no pixels have an error higher than some predetermined error. Note that the magnitude of the average error becomes lower for both zeros and ones every time the procedure is repeated.
In order to finish the initialization procedure, refer to another N×N array, which is denoted as c[i,j,1/2] and referred to as the cumulative array, and give a value of 2B-1 to every pixel whose corresponding pixel in the dot profile has a value of zero, and give a value of 2B-1 -1 otherwise. In that way, when the cumulative array, which eventually will become the blue noise mask, is thresholded at a 50% gray level, the resulting dot profile is equal to p[i,j,1/2].
After having generated in the above fashion the dot profile for the 1/2 gray level, the 1/2+Δg gray level is then constructed, where Δg is usually taken as 1/2B, the quantization limit. In general Δg≧1/2B. The dot profile for the 1/2+Δg gray level is generated from the dot profile for the 1/2 level by converting N2 /2B zeros to ones. The selection of the pixels that contain a zero and will be replaced by a one is done following a procedure similar to the one described previously for the design of the 1/2 dot profile in FIG. 2.
In general, the dot profile for the g+Δg level can be generated from the dot profile for the g level, as shown in FIG. 2. Up to Step 4, the procedure for the creation of the g+Δg dot profile is exactly the same as the procedure for the creation of the initial dot profile for the 1/2 level. It is important to note that in Step 2, the principal frequency of the blue noise filter is updated for every level according to equation (2). After Step 4, the purpose is to go up one gray level and thus only zeros are changed to ones. Using the error array, the pixels that contain a zero are classified in Step 5 and rank ordered, and then N2 /2B selected zeros are changed to ones in Step 6:
p[i,j,g]=0∩e[i,j,g]≧l.sub.c →p[i,j,g+Δg]=1; g>1/2 (3)
Every time a zero is changed to one, the statistics of its neighborhood change and therefore the information contained in the error array for its neighboring pixels may not be valid any more. For that reason, only a few zeros are replaced with ones and then the error array is recalculated or an additional criteria is checked, such as, neighborhood mean and runlengths. Finally, the cumulative array is updated in Step 7 by adding one only to those pixels that still correspond to a zero in the dot profile p[i,j,g+Δg]:
c[i,j,g+Δg]=c[i,j,g]+p[i,j,g+Δg]; g>1/2 (4)
where the bar indicates a logical "not" operation changing zeros to ones and vice versa.
In that fashion, when the blue noise mask is thresholded at a constant level g+Δg, the resulting binary pattern is the dot profile p[i,j,g+Δg]. That procedure is repeated until the dot profiles for all the gray levels from 1/2+Δg up to 1 are created. The levels from 1/2-Δg to 0 are created in the same way with the only difference that the ones are changed to zeros and the cumulative array is updated as follows:
c[i,j,g-Δg]=c[i,j,g]-p[i,j,g-Δg]; g<1/2 (5)
When the process has been implemented for all gray levels g, the cumulative array contains the desired blue noise dot profile for all levels, and is therefore the desired blue noise mask.
Once the blue noise mask has been generated, as described in connection with FIGS. 1 and 2, it can be used in a halftoning process. Since halftoning using a blue noise mask is a point algorithm, it can therefore be implemented either digitally or optically.
A flow chart depicting the digital implementation of halftoning using a blue noise mask according to the present invention is shown in FIG. 3. In digital applications such as facsimile machines and laser printers, the instant method requires much less memory and/or computation than do other blue-noise-producing techniques such as error diffusion taught by Ulichney and by Sullivan et al. in U.S. Pat. No. 4,920,501, issued Apr. 24, 1990.
The necessary memory needed to store the blue noise mask array is stored on a PROM, as shown in FIG. 4. Then, the halftoning of a N×N gray scale image array f(i,j) against the blue noise mask array m(i,j) is implemented as follows: The i and j variables are first set to 0 at steps 300 and 302, respectively. The next pixel fi,j is then scanned at step 304. A determination is made at step 306 to determine if the value of that pixel fi,j is greater than the value of the corresponding element in the blue mask array mi,j.
If it is determined at step 306 that the value of the gray scale image array pixel is greater than the value of the blue noise mask array pixel, then the value of the resulting array hi,j is set equal to 0 at step 310.
If an affirmative determination is made at step 306, then the value of the resulting array element hi,j is set equal to 1 at step 308. After steps 308 and 310, a determination is then made at step 312 of whether j is greater than N-1. That indicates the end of a row or column. If a negative determination is made at step 312, then j is set equal to j+1 at step 314 and the program then returns to step 304 to scan the next pixel.
If an affirmative determination is made at step 312, that indicates that the end of the scanned line has been reached. Then, the instant method is applied to the first pixels (j=0) of the next line. A determination is then made at step 318 of whether i is greater than N-1. If an affirmative determination is made at step 318, that indicates that the end of the image has been reached, and the program then ends at 320.
If a negative determination is made at step 318, that indicates that the end of the image may not have been reached and that additional pixels remain. Thus, the next line is scanned. The value of i is then set equal to i+1 at step 322, the value j is set equal to zero at step 316 and then the next pixel is scanned at step 304.
FIG. 4 shows an example of the hardware which may used for the digital implementation of halftoning using a blue noise mask as discussed in the instant application. It should be understood that the hardware implementation can be either digital or analog, for example, using an operational amplifier in place of the comparator 402 in the analog case. It is a significant advantage of digital halftoning using a blue noise mask that it is much faster than the other known blue noise producing techniques, because the halftoning is done by a simple pixelwise comparison. The digital halftoning using a blue noise mask process of the present invention can be speeded up even further by performing the comparison step in parallel, since all of the thresholds are preassigned.
As shown in FIG. 4, a scanner 400 is used to scan an image and convert the pixels on that image from an array of f(x,y) to the gray scale image array f(i,j). The output from the scanner 400 is fed to a first input of the comparator 402.
As previously described, the blue noise mask array m(i,j) is stored in the PROM 406 which may be located in a computer 405. The output from the PROM 406 is fed to the second input of the comparator 402. The output of the comparator is the binary image array h(i,j) which is fed to a binary display 404 which converts that array into the final image array h(x,y).
As previously discussed, the present halftoning using a blue noise mask invention can also be implemented in an optical or photographic manner. An example of an optical application of the present halftoning system is the photographic process used in newspaper printing. Such a process can be either multiplicative or additive.
In the multiplicative photographic process, the gray scale image f(x,y) 500 is photographed through the blue noise mask 502 which has a transmittance m(x,y) and the resultant superposition h(x,y)=f(x,y) x m(x,y) is printed onto high contrast film 504, such as high gamma film. That procedure is shown in FIG. 5. It should be understood that a point fp in the array f(x,y) corresponds to a dot hp in the array h(x,y), whose size and shape depends on the gray level that fp represents.
FIG. 6 shows the additive photographic process in which the blue noise mask is added to the gray scale image at the film plane by a double exposure. The gray scale image array and blue noise mask array are added by adder 600 and then fed to the high gamma film 504 which produces the halftoned output. The adder 600 is in simplest form a repeated exposure of the film 504, where the image and the blue noise mask are exposed separately onto the film 504, which is then developed.
In general, a gray scale photographic blue noise mask m(x,y) can be obtained from a calculated array m(i,j) using a film printer such as a Dunn camera interfaced to a PROM or a computer. The conversion from discrete points to a continuous image is then given by equation (1). Print film or transparency film is exposed by the computer controlled film printer so as to produce a photographic blue noise mask.
The blue noise mask can also be used for halftoning in applications that involve multibit and color displays. The digital halftoning process for a binary display using a blue noise mask (FIG. 2) can also be expressed as follows:
wherein int denotes integer truncation and the gray levels of m(i,j) and f(i,j) vary between 0 and 1. In general, for a K-bit display, the output image array h(i,j) can be written as follows: ##EQU3## The 2K -1 threshold values are equally spaced between 0 and 1. A non-uniform quantizer is also possible.
It is also possible to modify the blue noise mask in order to minimize undesirable printer and media dependent effects. That may be accomplished by modifying the first order statistics or the cumulative distribution function (CDF) of the blue noise mask (BNM). Such modification is useful in an environment such as medical ultrasound imaging in which the user, using the present invention, may be able to select between high and low contrast images and the display and film characteristics of such medical ultrasound imaging equipment can be accounted for in each rendition. In the case of blue noise masks, a large unstructured pattern of, for example, 256×256 pixel kernels provides sufficient degrees of freedom with which to modify the CDF so as to provide both linear and non-linear mappings of the input and output. That makes it possible to construct specialized blue noise masks for a particular output printer. Medium characteristics can also be minimized in such modified blue noise masks. Therefore, as will be described hereafter, the present invention provides for the altering of the cumulative distribution function of the blue noise mask that would otherwise be utilized so as to produce unique and more desirable input-output characteristics. While three such examples of such modified blue noise masks are discussed herein, those of ordinary skill in the art will readily recognize other ways in which to modify the blue noise mask in order to achieve similar results.
The first order statistics of the blue noise mask can be obtained directly from the mask itself as previously discussed. The method for modifying the mask involves taking each individual value of the mask and mapping it into a new value (known as direct value mapping), while avoiding certain extreme points of the blue noise mask. In that manner, the same, non-clumpy image can be produced. The mapping can be performed in such a manner that some undesirable printer output characteristics can be eliminated. For instance, when the output device produces low contrast images, the mapping can be chosen to modify the mask and the CDF of the mask in order to enable more pixels to be deposited in the light and dark regions. That will result in the production of a higher contrast image.
The mapping function operates on pixels of the blue noise mask, b(i,j), that are equal to a specific value, g, and sets that specific value equal to a new value, g':
for all b(i,j)=g→b'(i,j)=g' (8)
where f(g)=g' is a single valued, non-linear mapping function chosen to alter the image rendering, and b'(i,j) is the output, modified blue noise mask.
FIGS. 7-9 show diagrams of the flow charts for producing three different modifications of the blue noise mask, the linear or punch version, the high contrast concave down sigma curve (CDSC) and the low contrast concave up sigma curve (CUSC). All versions include the "punch". Punching the blue noise mask means that the extreme low values are set to a certain minimum value, such as 0, and that the extreme high values are set to a certain maximum value, such as 255, and the values between the maximum and minimum values are then re-linearized.
The CDSC modification of the blue noise mask is accomplished by setting F(g)=g3 which produces a "high contrast" mapping. The CUSC modification sets f(g)=to g-3, thus producing a flatter or low contrast curve.
After the modification of the blue noise mask is accomplished, halftoning of the desired image using that mask is done in the manner previously described. That is, the halftoning is performed by comparing the values of the image with the values of the modified mask. If the value of the image is larger, the value of the new image is rendered as black. Otherwise, the value of the new image will be set to white. The new image is then stored in a more compact form (reduced from 8-bits) because there is only one bit per pixel in a binary or halftone image. In the modified masks, each value in the blue noise mask is mapped to a new value based upon the variable selected by the user, such as punch, CDSC and CUSC. Halftoning is then performed based on those new values. By choosing different values, users can modify the image to eliminate artifacts and other defects caused by the specific printer and/or media being utilized.
The new halftone screens created using the modified CDF or gray scale characteristics of the blue noise mask have non-linear input-output characteristics. While the gray scale characteristics of the blue noise mask are modified, the isotropic, unstructured, visually pleasing pattern of black and white pixels produced by such blue noise masks are preserved.
FIG. 7 is a diagram of the flow chart for modifying a blue noise mask to produce a linearized version of the initial blue noise mask. At step 700, the value b(i,j)=g of the blue noise mask to be modified is read. At 702, the maximum and minimum values specified by the user are obtained. The values of the blue noise mask obtained at step 700 are then re-linearized at step 704 by setting r=255/(max-min) and then calculating the values of the modified blue noise mask b'(i,j)=((b(i,j))-min)*r. In this example, we assume an 8-bit blue noise mask is being used, hence, max and min will lie between 0 and 255, respectively.
A determination is then made at step 706 of whether each value of the modified blue noise mask b'(i,j) is greater than the max value. If an affirmative determination is made at step 706, then the value of that pixel b'(i,j) is set equal to the max value. After step 710 or if a negative determination is made at step 706, then a determination is made at step 708 of whether the value of the pixel of the modified blue noise mask b'(i,j) is less than the minimum value. If an affirmative determination is made at step 708, then the value of that pixel b'(i,j) is set equal to the minimum value at step 712. After step 712 or if a negative determination is made at step 708, the modified blue noise mask is assembled by writing the values of such modified blue noise mask b'(i,j) into memory at step 714.
FIG. 8 shows a diagram of the flow chart for generating a modified high contrast version of the blue noise mask. At step 800, the values of the blue noise mask b(i,j)=g are read. At step 802, the constants a, b, c which are to be utilized in step 804 are obtained from the user, as well as the max and min values. The constants a, b and c are chosen so as to generate unique mathematical mapping. The center point of inflection is given by the constant a, usually chosen near 128 for a symmetric, 8-bit mask. The steepness of the curve is given by the constant c and the offset of the curve, if desired, by the constant b.
Directly mapping occurs at step 804 in which each pixel value for the modified blue noise mask b'(i,j) is calculated to be equal to (b(i,j)-a)3 /c3 +b. This function replaces a linear input-output relation with a steepened, non-linear relation. The linear input-output relation being replaced is shown, for example, in FIG. 10 which shows the CDF versus the value of pixels for a linear blue noise mask. FIG. 11 shows the CDF versus the value of pixels for a non-linear, high contrast blue noise mask, after applying the CDSC direct mapping with punch.
A determination is then made at step 806 of whether each new pixel value b'(i,j) is greater than the maximum value. If an affirmative determination is made at step 806, then the new pixel value b'(i,j) is set equal to the maximum value at step 810. After step 810 or if a negative determination is made at step 806, then a determination is made at step 808 of whether the new pixel value b'(i,j) is less than the minimum value.
If an affirmative determination is made at step 808, then the new pixel value b'(i,j) is set equal to the minimum value. After step 812 or if a negative determination is made at step 808, then the values of the modified blue noise mask b'(i,j) are written into memory at step 814.
FIG. 9 shows a diagram of the flow chart for the modification of a blue noise mask to produce a CUSC low contrast version of the original blue noise mask. The values of the blue noise mask b(i,j)=g are read at step 900 and then the constants a, b and c are obtained, as well as the maximum and minimum values at step 902. Such constants and maximum and minimum values are provided by the user.
At step 904, a direct mapping process is accomplished in which the array of values of the modified blue noise mask b'(i,j) is calculated as equal to cbrt (b(i,j)-b)*c+a. This function, where "cbrt" stands for the cube root, changes a linear input-output relation to a low contrast, non-linear input-output relation. The constants a, b and c give the offset, center point and gain, respectively.
At step 906, a determination is made for each pixel of the blue noise mask of whether its value is greater than the maximum value. Thus, a determination is made of whether b'(i,j) is greater than the maximum value.
If an affirmative determination is made at step 906, then for each pixel in the array b'(i,j) which is greater than the maximum value, its value is set to the maximum value at step 910.
If a negative determination is made at step 906 or after step 910, a determination is made at step 908 of which pixel value, if any, in the modified blue noise mask b'(i,j) is less than the minimum value. If an affirmative determination is made at step 908, then for each pixel value in the modified blue noise mask b'(i,j) which is less than the minimum value, that value is set equal to the minimum value at step 912.
After step 912 or if a negative determination is made at step 908, the values of the modified blue noise mask b'(i,j) are written into memory at step 914.
The instant method can also be applied to color halftoning, by independently thresholding each one of the component colors against the blue noise mask and then overprinting. In that manner, the blue noise mask disclosed herein can be applied simply to the component colors of RGB, CMYK and others for color printing. For example, an Optronix scanner can be used as the scanner 400 shown in FIG. 4 to input three separate files of 8-bits in depth each, for the red, blue and green components of an image. Prior to displaying such image, a blue noise mask generated according to the method disclosed herein can be applied separately to each of the red, green and blue images. The resulting images may then be displayed on a binary RGB video screen or printed.
It has also been discovered that an improvement in the clarity of the displayed RGB image can be achieved when the pixels of the blue noise mask are shifted by one pixel when used on the different color planes. For example, the (i,j) pixel of the blue noise mask can be shifted such that the blue noise mask which is applied to the red image color plane has each of its pixel values shifted up by one pixel when halftoning the red image. When halftoning the blue image, the blue noise mask has each of its pixel values shifted by one pixel to the side. In that manner, the color energy is spread out over a larger space. It should be noted, however, that no shifting of the RGB images with respect to each other occurs, as that would cause blurring of the resulting image. Instead, as discussed above, the respective blue noise masks used to halftone the red and blue images have their pixel values shifted by one pixel up or to the side, respectively.
The foregoing method is shown in FIG. 12 which is a diagram of a flow chart for implementing halftoning of a color image using the foregoing method. The color image 1200 to be scanned is scanned by a scanner 400 to produce three continuous tone color planes 1202, 1204 and 1206, one for each of the three colors, red, green and blue, respectively. The values in each of these planes or arrays are added to the blue noise mask as shown in FIG. 6. Alternatively, a comparator can be used, as shown in FIG. 4. However, the (i,j) pixel of the red image is compared against the shifted (i+1,j) pixel of the blue noise mask. The (i,j) pixel of the green image is compared against the (i,j) pixel of the blue noise mask. The (i,j) pixel of the blue image is compared against the (i,j+1) pixel of the blue noise mask. Such comparisons take place at steps 1208, 1210 and 1212.
Each of these three planes or arrays are thresholded or are printed on high gamma film at step 504 in order to produce three halftone images at steps 1214, 1216 and 1218. The halftone image hR (i,j) represents the (i,j) pixel of the halftone red image. The elements at 1216 and 1218 likewise represent the halftone of the green and blue images, respectively. These images are combined at step 404 by a printer or display in order to produce a three color halftone image at step 1220. It should be noted that the halftoning of each of the components of the color image uses a shifted version of the blue noise mask as disclosed herein to produce a useful spreading out of the color without introducing blur into the halftone image.
A variation of this method of separately halftoning the different color planes of an image is to use the inverse of a blue noise mask for one color, where the inverse is defined as (Maxval-BNM) for each pixel. The Maxval is the maximum value of the blue noise mask (for example, 255 for the 8-bit blue noise mask). To produce the modified blue noise mask, the value of each pixel is subtracted from the Maxval to produce each new value for each pixel. This inverse process can be thought of as exchanging the "peaks and valleys of the blue noise mask," and results in the spreading out of the energy in the color pattern of the color image.
Many modifications of this process are likewise possible, such as different one shift patterns, or multiple shift patterns of the pixel values of a generated blue noise mask. While it has been found, for example, in low resolution 300 dpi systems, that one pixel shift produces a visually pleasing result, ten shifts have been found to produce an annoying correlation between different color dots while larger shifts of about forty-five pixels produce an acceptable, uncorrelated pattern of colored dots.
Of course, other possible modifications can also produce acceptable results, for example, the placing of one color plane blue noise mask at 45° with respect to another as is done in conventional four color printing. However, it has been found that the simple one-shift pattern described above is most effective at producing a pleasing, isotropic, non-clumpy moire resistant pattern with some spreading out of the color or ink but with no blurring of the image. Similar principles apply of course for CMYK color printing, where the halftoning can be done on the C, M and Y color images, and then the black image (K) can be added as necessary according to conventional color printing models.
Although only a preferred embodiment is specifically illustrated and described herein, it will be readily appreciated that many modifications and variations of the present invention are possible in light of the above teachings and within the purview of the appended claims without departing from the spirit and intended scope of the invention.
|Cited Patent||Filing date||Publication date||Applicant||Title|
|US3085878 *||29 Sep 1958||16 Apr 1963||Rochester Inst Tech||Half-tone screen for color separation|
|US4084196 *||31 Jan 1977||11 Apr 1978||Dacom, Inc.||Electronic half-tone generating means for facsimile reproduction system|
|US4276569 *||20 Apr 1979||30 Jun 1981||Exxon Research & Engineering Co.||Method and apparatus for producing a facsimile gray scale|
|US4308553 *||3 Mar 1980||29 Dec 1981||Xerox Corporation||Method and apparatus for making monochrome facsimiles of color images on color displays|
|US4342046 *||12 Aug 1980||27 Jul 1982||Dainippon Screen Seizo Kabushiki Kaisha||Contact screen for making color separation halftone blocks|
|US4409623 *||25 Jan 1982||11 Oct 1983||Nippon Telegraph & Telephone Public Corporation||Method and equipment for processing gray scale facsimile signal|
|US4412256 *||9 Jul 1981||25 Oct 1983||Siemens Aktiengesellschaft||Method and apparatus for the representation of gray scale values in facsimile transmission|
|US4425642 *||8 Jan 1982||10 Jan 1984||Applied Spectrum Technologies, Inc.||Simultaneous transmission of two information signals within a band-limited communications channel|
|US4477833 *||25 Apr 1983||16 Oct 1984||R. R. Donnelley & Sons Company||Method of color conversion with improved interpolation|
|US4657831 *||11 Mar 1986||14 Apr 1987||Eastman Kodak Company||Color proofing method and article|
|US4669869 *||8 May 1980||2 Jun 1987||Sullivan Donald F||Photoprinting process and apparatus for exposing paste-consistency photopolymers|
|US4698691 *||26 Nov 1984||6 Oct 1987||Ricoh Company, Ltd.||Halftone image processing method|
|US4700235 *||6 Nov 1984||13 Oct 1987||Dr. Ing. Rudolf Hell Gmbh||Method and apparatus for producing half-tone printing forms with rotated screens on the basis of randomly selected screen threshold values|
|US4736254 *||21 Nov 1985||5 Apr 1988||Matsushita Electric Industrial Co., Ltd.||Method and apparatus for generating pseudo-halftone dots by comparing gray scale values of an original with dither threshold values stored in cells of a matrix array divided into imaginary matrices of elemental areas each containing one cell|
|US4742558 *||7 Feb 1985||3 May 1988||Nippon Telegraph & Telephone Public Corporation||Image information retrieval/display apparatus|
|US4758886 *||24 Jul 1986||19 Jul 1988||Minnesota Mining And Manufacturing Company||Optimal color half-tone patterns for raster-scan images|
|US4783838 *||24 Dec 1985||8 Nov 1988||Konishiroku Photo Industry Co., Ltd.||Image processing method and apparatus therefor|
|US4786975 *||25 Jan 1988||22 Nov 1988||Siemens Aktiengesellschaft||Method for coding facsimiles|
|US4800442 *||18 May 1987||24 Jan 1989||Canon Kabushiki Kaisha||Apparatus for generating an image from a digital video signal|
|US4819075 *||23 Sep 1987||4 Apr 1989||Hitachi, Ltd.||Solid state imaging apparatus with means for controlling signal accumulation period|
|US4833531 *||16 Apr 1987||23 May 1989||Konishiroku Photo Industry Co., Ltd.||Technique for interpolating a color image for image enlargement or reduction based on look-up tables stored in memory|
|US4885576 *||2 Apr 1986||5 Dec 1989||International Business Machines Corporation||Soft copy display of facsimile images|
|US4912569 *||24 Jan 1989||27 Mar 1990||Eastman Kodak Company||Method for thresholding an image signal|
|US4920501 *||19 Oct 1988||24 Apr 1990||Eastman Kodak Company||Digital halftoning with minimum visual modulation patterns|
|US4924301 *||8 Nov 1988||8 May 1990||Seecolor Corporation||Apparatus and methods for digital halftoning|
|US4974067 *||5 Jun 1987||27 Nov 1990||Ricoh Company, Ltd.||Multi-step-digital color image reproducing method and apparatus|
|US4975786 *||23 Dec 1988||4 Dec 1990||Canon Kabushiki Kaisha||Image processing method and apparatus with error diffusion capability|
|US4997733 *||9 Feb 1989||5 Mar 1991||Agfa-Gevaert, N.V.||Process for the production of photographic masks|
|US5010398 *||29 Jun 1989||23 Apr 1991||Agfa-Gevaert, N.V.||Method for colour correction by dry dot etching using photographically produced mask|
|US5079624 *||25 Aug 1989||7 Jan 1992||Fuji Xerox Co., Ltd.||Digital image processing apparatus|
|US5109282 *||20 Jun 1990||28 Apr 1992||Eye Research Institute Of Retina Foundation||Halftone imaging method and apparatus utilizing pyramidol error convergence|
|US5111310 *||4 Dec 1990||5 May 1992||Research Technologies Corporation, Inc.||Method and apparatus for halftone rendering of a gray scale image using a blue noise mask|
|EP0152355A2 *||12 Feb 1985||21 Aug 1985||Nippon Telegraph And Telephone Corporation||Image information retrieval/display apparatus|
|WO1990004898A1 *||12 Oct 1989||3 May 1990||Eastman Kodak Company||Digital halftoning with minimum visual modulation patterns|
|1||*||COMPUTERS & GRAPHICS, Vol. 7, 1983, PIRSCH et al., "Transmission of Gray Level Images by Multilevel Dither Techniques", pp. 31-44.|
|2||*||FUJITSU SCIENTIFIC AND TECHNICAL JOURNAL, March 1984, YOSHIDA et al., "Pel Pattern Predictive Coding of Dithered Images", pp. 99-118.|
|3||*||IBM JOURNAL OF RESEARCH AND DEVELOPMENT, Januari 1987, G. GOERTZEL, G.R. THOMPSON, "Digital Halftoning on the IBM 4250 Printer".|
|4||*||IBM TECHNICAL DISCLOSURE BULLETIN, Vol. 28, No. 1, June 1985, "Digital Color Reproduction", pp. 438-439.|
|5||*||IEEE TRANSACTIONS OR COMMUNICATIONS, Vol. Com-29, No. 12, December 1981, NETRAVALI et al., "A Picture Browsing System".|
|6||*||IEEE TRANSACTIONS, December 1981, J.C. STOFFEL, J.F. MORELAND, "A Survey of Electronic Techniques for Pictorial Image Reproduction".|
|7||*||PROCEEDINGS OF THE IEEE, Vol. 76, No. 1, Januari 1988, ROBERT A. ULICHNEY, "Dithering with Blue Noise", pp. 56-79.|
|Citing Patent||Filing date||Publication date||Applicant||Title|
|US5463720 *||28 Sep 1992||31 Oct 1995||Granger; Edward M.||Blue noise based technique for use in a halftone tile oriented screener for masking screener induced image artifacts|
|US5553200 *||3 Mar 1995||3 Sep 1996||Electronics For Imaging, Inc.||Method and apparatus for providing bit-rate reduction and reconstruction of image data using dither arrays|
|US5557709 *||1 Jul 1994||17 Sep 1996||Seiko Epson Corporation||Method and apparatus for dither array generation to reduce artifacts in halftoned images|
|US5673121 *||17 Jun 1996||30 Sep 1997||Xerox Corporation||Stochastic halftoning screening method|
|US5686953 *||22 Nov 1994||11 Nov 1997||Minnesota Mining And Manufacturing Company||Imaging system and method using linear perceived optical density interface|
|US5708518||11 Apr 1995||13 Jan 1998||Research Corporation Technologies, Inc.||Method and apparatus for halftone rendering of a gray scale image using a blue noise mask|
|US5726772||6 Oct 1995||10 Mar 1998||Research Corporation Technologies||Method and apparatus for halftone rendering of a gray scale image using a blue noise mask|
|US5734752 *||24 Sep 1996||31 Mar 1998||Xerox Corporation||Digital watermarking using stochastic screen patterns|
|US5737453 *||17 May 1996||7 Apr 1998||Canon Information Systems, Inc.||Enhanced error-diffusion method for color or black-and-white reproduction|
|US5740279 *||26 Nov 1996||14 Apr 1998||Xerox Corporation||Cluster dot halftoning system|
|US5742405 *||26 Jan 1995||21 Apr 1998||Eastman Kodak Company||Method and system for forming multi-level halftone images from an input digital image|
|US5748860 *||6 Jun 1995||5 May 1998||R.R. Donnelley & Sons Company||Image processing during page description language interpretation|
|US5757516 *||4 Jan 1994||26 May 1998||Canon Inc.||Noise quenching method and apparatus for a colour display system|
|US5764810 *||20 Dec 1995||9 Jun 1998||R.R. Donnelley & Sons Company, Inc.||Screenless conversion of continuous tone images with alterable dot spacing patterns|
|US5787238 *||14 Nov 1996||28 Jul 1998||Xerox Corporation||Clustered halftone dot design process|
|US5790703 *||21 Jan 1997||4 Aug 1998||Xerox Corporation||Digital watermarking using conjugate halftone screens|
|US5812744 *||30 Apr 1996||22 Sep 1998||Hewlett Packard Company||Joint design of dither matrices for a set of colorants|
|US5818604 *||2 May 1996||6 Oct 1998||Agfa-Gevaert||High precision gradation compensation for stochastic screening|
|US5822451 *||5 Jun 1996||13 Oct 1998||Eastman Kodak Company||Method for halftoning a multi-channel digital color image|
|US5838462 *||1 Apr 1996||17 Nov 1998||Xerox Corporation||Hybrid imaging system|
|US5859955 *||21 Jan 1997||12 Jan 1999||Xerox Corporation||Stochastically clustered dot halftoning system|
|US5892496 *||21 Dec 1995||6 Apr 1999||Advanced Micro Devices, Inc.||Method and apparatus for displaying grayscale data on a monochrome graphic display|
|US5912745 *||8 Apr 1997||15 Jun 1999||Digital Equipment Corporation||Void and cluster apparatus and method for generating dither templates|
|US5946452 *||14 Feb 1997||31 Aug 1999||Eastman Kodak Company||Partially correlated minimum visibility halftone patterns for digital printers|
|US5978556 *||14 Jul 1998||2 Nov 1999||Xerox Corporation||Clustered halftone dot design process|
|US6025930 *||12 Aug 1997||15 Feb 2000||International Business Machines Corporation||Multicell clustered mask with blue noise adjustments|
|US6124844 *||2 Jan 1997||26 Sep 2000||Canon Kabushiki Kaisha||Force field halftoning|
|US6172773||10 May 1999||9 Jan 2001||Compaq Computer Corporation||Void and cluster apparatus and method for generating dither templates|
|US6304340||18 Nov 1998||16 Oct 2001||Xerox Corporation||Composite halftone screens with stochastically distributed clusters or lines|
|US6474766||29 Mar 2001||5 Nov 2002||Sony Corporation||System and method for color dither matrix creation using human-vision-system gray matrix with cluster radii|
|US6493112||11 Jan 1999||10 Dec 2002||University Of Delaware||Method and apparatus for producing halftone images using green-noise masks having adjustable coarseness|
|US6542258||9 Sep 1998||1 Apr 2003||Hewlett-Packard Company||Fast building of masks for use in incremental printing|
|US6577408 *||5 Feb 1999||10 Jun 2003||Hewlett-Packard Development Company, L.P.||Method and apparatus for correcting blue drift in an image scanner|
|US6606168||31 Mar 1999||12 Aug 2003||3M Innovative Properties Company||Narrow band, anisotropic stochastic halftone patterns and methods of creating and using the same|
|US6629739||14 Dec 2000||7 Oct 2003||Xerox Corporation||Apparatus and method for drop size switching in ink jet printing|
|US6697169||8 Dec 1999||24 Feb 2004||Sharp Laboratories Of America, Inc.||Enhanced error diffusion using a correlated chromatic noise pattern|
|US6753131||21 Oct 1999||22 Jun 2004||President And Fellows Of Harvard College||Transparent elastomeric, contact-mode photolithography mask, sensor, and wavefront engineering element|
|US6788432||9 Sep 1998||7 Sep 2004||Hewlett-Packard Development Company, L.P.||Optimal-size and nozzle-modulated printmasks for use in incremental printing|
|US6798537||24 Jan 2000||28 Sep 2004||The University Of Delaware||Digital color halftoning with generalized error diffusion vector green-noise masks|
|US6813044||16 Jun 2003||2 Nov 2004||3M Innovative Properties Company||Narrow band, anisotropic stochastic halftone patterns and methods of creating and using the same|
|US6842538 *||23 Mar 2001||11 Jan 2005||Shih-Jong J. Lee||Automatic detection of alignment or registration marks|
|US6862109 *||24 Feb 2003||1 Mar 2005||Hewlett-Packard Development Company, L.P.||Fast building of masks for use in incremental printing|
|US6862112||23 Mar 2001||1 Mar 2005||Sony Corporation||System and method for color dither matrix creation using human-vision-system gray matrix with multi-cell replacement|
|US6867884||7 Jul 2000||15 Mar 2005||Kodak Polychrome Graphics, Llc||Halftone dot placement for multi-color images|
|US6965452||9 Sep 1998||15 Nov 2005||Hewlett-Packard Development Company, L.P.||Masks on demand for use in incremental printing|
|US7031024||13 Mar 2003||18 Apr 2006||Hewlett-Packard Development Company, L.P.||Image data processing methods, image data processing apparatuses and scanner systems|
|US7064869||22 Jun 2001||20 Jun 2006||Eastman Kodak Company||Method for halftoning a multi-channel digital color image having at least one group of similar color channels|
|US7130083 *||5 Jun 2000||31 Oct 2006||Canon Kabushiki Kaisha||Image recording apparatus, image recording method, method for controlling the image recording apparatus, storage medium storing a program capable of being read by a computer, and image processing method|
|US7139101||31 Oct 2002||21 Nov 2006||Xerox Corporation||Anisotropic stochastic screen|
|US7262885||25 Jun 2001||28 Aug 2007||Xerox Corporation||Stochastic halftone screening method|
|US7477422 *||30 Mar 2006||13 Jan 2009||Canon Kabushiki Kaisha||Image recording apparatus, image recording method, method for controlling the image recording apparatus, storage medium storing a program capable of being read by a computer, and image processing method|
|US7920294||2 Jan 2007||5 Apr 2011||Canon Kabushiki Kaisha||Data processing method, data processing apparatus, method for generating dither pattern, and dither pattern|
|US7961355 *||20 Dec 2007||14 Jun 2011||Seiko Epson Corporation||Generation of dither matrix|
|US8164787||30 Jan 2007||24 Apr 2012||Dai Nippon Printing Co., Ltd.||Thermal transfer recording device and image formation method|
|US8477361||6 Dec 2007||2 Jul 2013||Canon Kabushiki Kaisha||Image data generating apparatus and image data generating method for generating image data when an image is printed in a divided manner|
|US8537076||24 Jul 2003||17 Sep 2013||Entropic Communications, Inc.||Video circuit|
|US8724164||14 Nov 2012||13 May 2014||Seiko Epson Corporation||Printing device, printing method and program thereof|
|US8767264||23 Mar 2012||1 Jul 2014||Seiko Epson Corporation||Printing device and printing method|
|US8928934||7 Apr 2014||6 Jan 2015||Seiko Epson Corporation||Printing device, printing method and program thereof|
|US9132632||30 Jun 2014||15 Sep 2015||Seiko Epson Corporation||Printing device and printing method|
|US9501261 *||6 May 2014||22 Nov 2016||Qualcomm Incorporated||Binary array with LSB dithering in a closed loop system|
|US9614998 *||26 May 2014||4 Apr 2017||Ricoh Company, Ltd.||Mechanism for generating a hybrid halftone using a DMSSA screen|
|US20020071140 *||7 Dec 2000||13 Jun 2002||Takashi Suzuki||Threshold matrix, and method and apparatus of reproducing gray levels using threshold matrix|
|US20020159095 *||23 Mar 2001||31 Oct 2002||Cooper Ted J.||System and method for color dither matrix creation using human-vision-system gray matrix with multi-cell replacement|
|US20020164077 *||23 Mar 2001||7 Nov 2002||Lee Shih-Jong J.||Automatic detection of alignment or registration marks|
|US20020196469 *||25 Jun 2001||26 Dec 2002||Xerox Corporation||Stochastic halftone screening method|
|US20030081228 *||22 Jun 2001||1 May 2003||Eastman Kodak Company||Method for halftoning a multi-channel digital color image having at least one group of similar color channels|
|US20030107768 *||4 Dec 2001||12 Jun 2003||Crounse Kenneth R.||Halftoning with uniformly dispersed dot growth|
|US20040085553 *||30 Oct 2002||6 May 2004||Eastman Kodak Company||Multitoning a digital image having at least one group of similar colors channels|
|US20040085588 *||31 Oct 2002||6 May 2004||Xerox Corporation||Anisotropic stochastic screen|
|US20050253784 *||24 Jul 2003||17 Nov 2005||De Greef Petrus M||Video circuit|
|US20050275899 *||3 May 2005||15 Dec 2005||Ding-Yun Chen||Dithering method and related apparatus using aperiodic tiling rule|
|US20060187507 *||30 Mar 2006||24 Aug 2006||Canon Kabushiki Kaisha||Image recording apparatus, image recording method, method for controlling the image recording apparatus, storage medium storing a program capable of being read by a computer, and image processing method|
|US20070109604 *||2 Jan 2007||17 May 2007||Canon Kabushiki Kaisha||Data processing method, data processing apparatus, method for generating dither pattern, and dither pattern|
|US20080137146 *||6 Dec 2007||12 Jun 2008||Canon Kabushiki Kaisha||Image data generating apparatus, image printing apparatus, and image data generating method|
|US20080158611 *||20 Dec 2007||3 Jul 2008||Seiko Epson Corporation||Generation of dither matrix|
|US20090034006 *||3 Aug 2007||5 Feb 2009||Blondal Daniel J||Stochastic halftone images based on screening parameters|
|US20090034008 *||3 Aug 2007||5 Feb 2009||Lawrence Croft||Method for generating stochastic dither matrix|
|US20090066776 *||30 Oct 2006||12 Mar 2009||Dai Nippon Printing Co., Ltd.||Thermal recording apparatus, image forming method, and printed object|
|US20090109490 *||30 Mar 2007||30 Apr 2009||Lau Daniel L||Method of producing improved lenticular images|
|US20090147277 *||30 Jan 2007||11 Jun 2009||Takayuki Ohkubo||Thermal transfer recording device and image formation method|
|US20140253976 *||26 May 2014||11 Sep 2014||Infoprint Solutions Company Llc||Hybrid Halftone Generation Mechanism|
|US20150324170 *||6 May 2014||12 Nov 2015||Qualcomm Incorporated||Binary array with lsb dithering in a closed loop system|
|EP0785667A3 *||31 Dec 1996||30 Sep 1998||Canon Kabushiki Kaisha||Force field halftoning|
|EP1946932A1 *||30 Oct 2006||23 Jul 2008||Dai Nippon Printing Co., Ltd.||Thermal recording device, image forming method, and printed object|
|EP1946932A4 *||30 Oct 2006||30 Sep 2009||Dainippon Printing Co Ltd||Thermal recording device, image forming method, and printed object|
|EP1980404A1 *||30 Jan 2007||15 Oct 2008||Dainippon Printing Co., Ltd.||Thermal transfer recording device and image formation method|
|EP1980404A4 *||30 Jan 2007||30 Sep 2009||Dainippon Printing Co Ltd||Thermal transfer recording device and image formation method|
|EP2595373A2||13 Nov 2012||22 May 2013||Seiko Epson Corporation||Printing device, printing method and program thereof|
|EP2595373A3 *||13 Nov 2012||19 Oct 2016||Seiko Epson Corporation||Printing device, printing method and program thereof|
|WO1996027261A1 *||1 Mar 1996||6 Sep 1996||Electronics For Imaging, Inc.||Method and apparatus for providing bit-rate reduction and reconstruction of image data using dither arrays|
|WO2002005545A1 *||11 Jan 2001||17 Jan 2002||Imation Corp.||Halftone dot placement for multi-color images|
|WO2007088831A1||30 Jan 2007||9 Aug 2007||Dai Nippon Printing Co., Ltd.||Thermal transfer recording device and image formation method|
|U.S. Classification||358/534, 358/3.19, 358/523, 358/536, 358/465|
|International Classification||H04N1/52, G06T3/40, H04N1/41, H04N1/40, H04N1/405|
|Cooperative Classification||G06T3/40, H04N1/40075, H04N1/4051, H04N1/4105, G06T3/4084|
|European Classification||G06T3/40T, G06T3/40, H04N1/40N, H04N1/405B, H04N1/41B|
|24 Mar 1992||AS||Assignment|
Owner name: RESEARCH CORPORATION, TECHNOLOGIES, INC., ARIZONA
Free format text: ASSIGNMENT OF ASSIGNORS INTEREST.;ASSIGNORS:PARKER, KEVIN J.;MITSA, THEOPHANO;REEL/FRAME:006054/0199;SIGNING DATES FROM 19920227 TO 19920312
|27 Dec 1994||CC||Certificate of correction|
|24 Jan 1995||CC||Certificate of correction|
|25 Jul 1995||CC||Certificate of correction|
|5 Sep 1995||CC||Certificate of correction|
|30 Jan 1998||FPAY||Fee payment|
Year of fee payment: 4
|31 Jan 2002||FPAY||Fee payment|
Year of fee payment: 8
|28 Dec 2005||FPAY||Fee payment|
Year of fee payment: 12