US20010048764A1 - Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices - Google Patents
Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices Download PDFInfo
- Publication number
- US20010048764A1 US20010048764A1 US09/364,365 US36436599A US2001048764A1 US 20010048764 A1 US20010048764 A1 US 20010048764A1 US 36436599 A US36436599 A US 36436599A US 2001048764 A1 US2001048764 A1 US 2001048764A1
- Authority
- US
- United States
- Prior art keywords
- sub
- pixel
- samples
- image
- pixel elements
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/005—Adapting incoming signals to the display format of the display terminal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/22—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the display of characters or indicia using display control signals derived from coded signals representing the characters or indicia, e.g. with a character-code memory
- G09G5/24—Generation of individual character patterns
- G09G5/28—Generation of individual character patterns for enhancement of character form, e.g. smoothing
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0242—Compensation of deficiencies in the appearance of colours
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2320/00—Control of display operating conditions
- G09G2320/02—Improving the quality of display appearance
- G09G2320/0271—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping
- G09G2320/0276—Adjustment of the gradation levels within the range of the gradation scale, e.g. by redistribution or clipping for the purpose of adaptation to the characteristics of a display device, i.e. gamma correction
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0457—Improvement of perceived resolution by subpixel rendering
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/10—Mixing of images, i.e. displayed pixel being the result of an operation, e.g. adding, on the corresponding input pixels
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/02—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed
- G09G5/024—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators characterised by the way in which colour is displayed using colour registers, e.g. to control background, foreground, surface filling
Definitions
- the present invention concerns techniques for enhancing the resolution of images, such as fonts, line drawings, or black-and-white or full-color images for example, to be rendered on a patterned output device, such as a flat panel video monitor or an LCD video monitor for example.
- a patterned output device such as a flat panel video monitor or an LCD video monitor for example.
- the present invention may be used in the context of patterned output devices such as flat panel video monitors, or LCD video monitors for example.
- the present invention may be used as a part of processing to produce higher resolution images, such as more legible text for example, on LCD video monitors.
- display devices in general, and flat panel display devices, such as LCD monitors for example, in particular are known by those skilled in the art, they are discussed in ⁇ 1.2.1 below for the reader's convenience. Then, known ways of rendering text, line art and graphics on such displays are discussed in ⁇ 1.2.2, 1.2.3 and 1.2.4 below.
- Color display devices have become the principal display devices of choice for most computer users. Color is typically displayed on a monitor by operating the display device to emit light (such as a combination of red, green, and blue light for example) which results in one or more colors being perceived by the human eye.
- light such as a combination of red, green, and blue light for example
- color video monitors in general, and LCD video monitors in particular, are known to those skilled in the art, they are introduced below for the reader's convenience.
- cathode ray tube (or CRT) video monitors are first introduced.
- LCD video monitors are introduced.
- Cathode ray tube (CRT) display devices include phosphor coatings which may be applied as dots in a sequence on the screen of the CRT.
- a different phosphor coating is normally associated with the generation of different colors, such as red, green, and blue for example. Consequently, repeated sequences of phosphor dots are defined on the screen of the video monitor.
- a phosphor dot When a phosphor dot is excited by a beam of electrons, it will generate its associated color, such as red, green and blue for example.
- pixel is commonly used to refer to one spot in a group of spots, such as rectangular grid of thousands of such spots for example.
- the spots are selectively activated to form an image on the display device.
- a single triad of red, green and blue phosphor dots cannot be uniquely selected. Consequently, the smallest possible pixel size will depend on the focus, alignment and bandwidth of the electron guns used to excite the phosphor dots.
- the light emitted from one or more triads of red, green and blue phosphor dots in various arrangements known for CRT displays, tend to blend together giving, at a distance, the appearance of a single colored light source.
- the intensity of the light emitted from the additive primary colors can be varied to achieve the appearance of almost any desired color pixel. Adding no color, i.e., emitting no light, produces a black pixel. Adding 100 percent of all three (3) colors produces a white pixel.
- color LCD video monitors are now introduced in ⁇ 1.2.1.2 below.
- Portable computing devices also referred to generally as computing appliances or untethered computing appliances
- LCDs liquid crystal displays
- flat panel displays tend to be smaller and lighter than CRT displays.
- flat panel displays are well suited for battery powered applications since they typically consume less power than comparably sized CRT displays.
- LCD flat panel monitors are even becoming more popular in the desktop computing environment.
- Color LCD displays are examples of display devices which distinctly address elements (referred to herein as pixel sub-components, pixel sub-elements, or simply, emitters) to represent each pixel of an image being displayed.
- each pixel element of a color LCD display includes three (3) non-square elements. More specifically, each pixel element may include adjacent red, green and blue (RGB) pixel sub-components. Thus, a set of RGB pixel sub-components together define a single pixel element.
- RGB pixel sub-components which are commonly arranged to form stripes along the display.
- the RGB stripes normally run the entire length of the display in one direction.
- the resulting RGB stripes are sometimes referred to as “RGB striping”.
- FIG. 1 illustrates a known LCD screen 100 comprising pixels arranged in a plurality of rows (R 1 -R 12 ) and columns (C 1 -C 16 ). That is, a pixel is defined at each row-column intersection. Each pixel includes a red pixel sub-component, depicted with moderate stippling, a green component, depicted with dense stippling, and a blue component, depicted with sparse stippling.
- FIG. 2 illustrates the upper left hand portion of the known display 100 in greater detail.
- each pixel element such as, the (R2, C4) pixel element for example, comprises three (3) distinct sub-element or sub-components; a red sub-component 206 , a green sub-component 207 and a blue sub-component 208 .
- each known pixel sub-component 206 , 207 , 208 is 1 ⁇ 3, or approximately 1 ⁇ 3, the width of a pixel while being equal, or approximately equal, in height to the height of a pixel.
- the three 1 ⁇ 3 width, full height, pixel sub-components 206 , 207 , 208 define a single pixel element.
- RGB pixel sub-components 206 , 207 , 208 form what appear to be vertical color stripes on the display 100 . Accordingly, the arrangement of 1 ⁇ 3 width color sub-components 206 , 207 , 208 , in the known manner illustrated in FIGS. 1 and 2, exhibit what is sometimes called “vertical striping”.
- the RGB pixel sub-components are generally used as a group to generate a single colored pixel corresponding to a single sample of the image to be represented. More specifically, in known systems, luminous intensity values for all the pixel sub-components of a pixel element are generated from a single sample of the image to be rendered.
- a “font” is a set of characters of the same typeface (such as Times Roman, Courier New, etc.), the same style (such as italic), the same weight (such as bold and, strictly speaking, the same size). Characters may include symbols, such as the “Parties MT”, “Webdings”, and “Wingdings” symbol groups found on the WordTM word processor from Microsoft Corporation of Redmond, Wash. for example.
- a “typeface” is a specific named design of a set of printed characters (e.g., Helvetica Bold Oblique), that has a specified obliqueness (i.e., degree of slant) and stoke weight (i.e., line thickness).
- a typeface is not the same as a font, which is a specific size of a specific typeface (such as 12-point Helvetica Bold Oblique). However, since some fonts are “scalable”, the terms “font” and “typeface” may sometimes be used interchangeably.
- a “typeface family” is a group of related typefaces. For example, the Helvetica family may include Helvetica, Helvetica Bold, Helvetica Oblique and Helvetica Bold Oblique.
- font outline technology such as scalable fonts for example, to facilitate the rendering and display of text.
- TrueTypeTM fonts from Microsoft Corporation of Redmond, Wash. are an example of such technology.
- various font sets such as “Times New Roman,” “Onyx,” “Courier New,” etc. for example, may be provided.
- the font set normally includes an analytic outline representation, such as a series of contours for example, for each character which may be displayed using the provided font set.
- the contours may be straight lines or curves for example.
- Curves may be defined by a series of points that describe second order Bezier-splines for example.
- the points defining a curve are typically numbered in consecutive order. The ordering of the points may be important.
- the character outline may be “filled” to the right of curves when the curves are followed in the direction of increasing point numbers.
- the analytic character outline representation may be defined by a set of points and mathematical formulas.
- a “font unit” may be defined as the smallest measurable unit in an “em” square, which is an imaginary square that is used to size and align glyphs (a “glyph” can be thought of as a character).
- FIG. 3 illustrates an “em” square 310 around a character outline 320 of the letter Q.
- an “em” was approximately equal to the width of a capital M.
- glyphs could not extend beyond the em square.
- the dimensions of an “em” square are those of the full body height 340 of a font plus some extra spacing. This extra spacing was provided to prevent lines of text from colliding when typeset without extra leading was used.
- portions of glyphs can extend outside of the em square.
- the portion of the character outline 320 above the baseline 330 is referred to as the “ascent” 342 of the glyph.
- the portion of the character outline 320 below the baseline 330 is referred to as the “decent” 344 of the glyph. Note that in some languages, such as Japanese for example, the characters sit on the baseline, with no portion of the character extending below the baseline.
- the stored outline character representation normally does not represent space beyond the maximum horizontal and vertical boundaries of the character (also referred to as “white space” or “side bearings”). Therefore, the stored character outline portion of a character font is often referred to as a black body (or BB).
- a font generator is a program for transforming character outlines into bitmaps of the style and size required by an application. Font generators (also referred to as “rasterizers”) typically operate by scaling a character outline to a requested size and can often expand or compress the characters that they generate.
- a character font In addition to stored black body character outline information, a character font normally includes black body size, black body positioning, and overall character width information. Black body size information is sometimes expressed in terms of the dimensions of a bounding box used to define the vertical and horizontal borders of the black body.
- Box 408 is a bounding box which defines the size of the black body 407 of the character (A).
- the total width of the character (A), including white space to be associated with the character (A), is denoted by an advance width (or AW) value 402 .
- the advance width typically starts to a point left of the bounding box 408 .
- This point 404 is referred to as the left side bearing point (or LSBP).
- the left side bearing point 404 defines the horizontal starting point for positioning the character (A) relative to a current display position.
- the horizontal distance 410 between the left end of the bounding box 408 and the left side bearing point 404 is referred to as the left side bearing (or LSB).
- the left side bearing 410 indicates the amount of white space to be placed between the left end of the bounding box 408 of a current character (A) and the right side bearing point of the preceding character (not shown).
- the point 406 to the right of the bounding box 408 at the end of the advance width 402 is referred to as the right side bearing point (or RSBP).
- the right side bearing point 406 defines the end of the current character (A) and the point at which the left side bearing point 404 ′ of the next character (I) should be positioned.
- the horizontal distance 412 between the right end of the bounding box 408 and the right side bearing point 406 is referred to as the right side bearing (or RSB).
- the right side bearing 412 indicates the amount of white space to be placed between the right end of the bounding box 408 of a current character (A) and the left side bearing point 404 ′ of the next character (I).
- the left and right side bearings may have zero (0) or negative values.
- metrics analogous to advance width, left side bearing and right side bearing namely, advance height (AH), top side bearing (TSB) and bottom side bearing (BSB)—may be used.
- a scalable font file normally includes black body size, black body positioning, and overall character width information for each supported character.
- the black body size information may include horizontal and vertical size information expressed in the form of bounding box 408 dimensions.
- the black body positioning information may expressed as a left side bearing value 410 .
- Overall character width information may be expressed as an advance width 402 .
- FIG. 5 is a high level diagram of processes that may be performed when an application requests that text be rendered on a display device.
- text may be rendered by: (i) loading a font and supplying it to a rasterizer; (ii) scaling the font outline based on the point size and the resolution of the display device; (iii) applying hints to the outline; (iv) filling the grid fitted outline with pixels to generate a raster bitmap; (v) scanning for dropouts (optional); (vi) caching the raster bitmap; and (vii) transferring the raster bitmap to the display device.
- the font unit coordinates used to define the position of points defining contours of a character outline are scaled to device specific pixel coordinates. That is, when the resolution of the em square is used to define a character outline, before that character can be displayed, it must be scaled to reflect the size, transformation and the characteristics of the output device on which it is to be rendered.
- the scaled outline describes the character outline in units that reflect the absolute unit of measurement used to measure pixels of the output device, rather than the relative system of measurement of font units per em.
- the resolution of the output device may be specified by the number of dots or pixels per inch (dpi).
- a VGA video monitor may be treated as a 96 dpi device
- a laser printer may be treated as a 300 dpi device
- an EGA video monitor may be treated as a 96 dpi device in the horizontal (X) direction, but a 72 dpi device in the vertical (Y) direction.
- FIG. 5 is a high level diagram of processes which may be performed by a known text rendering system.
- an application process 510 such as a word processor or contact manager for example, may request that text be displayed and may specify a point size for the text.
- the application process 510 may also request a font name, background and foreground colors and a screen location at which the text is to be rendered.
- the text and, if applicable, the point size, 512 are provided to a graphics display interface (or GDI) process (or more generally, a graphics display interface) 522 .
- GDI graphics display interface
- the GDI process 522 uses display information 524 (which may include such display resolution information as pixels per inch on the display) and character information 525 (which may be a character outline information which may be represented as points defining a sequence of contours such as lines and curves, advance width information and left side bearing information) to generate glyphs (or to access cached glyphs which have already been generated).
- Glyphs may include a bitmap of a scaled character outline (or a bounding box 308 containing black body 307 information), advance width 302 information, and left side bearing 310 information. Each of the bits of the bitmap may have associated red, green and blue luminous intensity values.
- the graphics display interface process 522 is described in more detail in ⁇ 1.2.2.2.1.1 below.
- the graphics display interface process 522 , the display information 524 , and the glyph cache 526 may be a part of, and effected by, an operating system, such as the Windows® CE or Windows NT® operating systems (from Microsoft Corporation of Redmond, Wash.) for example.
- an operating system such as the Windows® CE or Windows NT® operating systems (from Microsoft Corporation of Redmond, Wash.) for example.
- Glyphs (also referred to as digital font representations) 528 ′ or 528 , either from the glyph cache 526 or from the graphics display interface process 522 , are then provided to a display driver management process (or more generally, a display driver manager) 535 .
- the display driver management process 535 may be a part of a display (or video) driver 530 .
- a display driver 530 may be software which permits a computer operating system to communicate with a particular video display.
- the display driver management process 535 may invoke a color palette selection process 538 . These processes 535 and 538 serve to convert the character glyph information into the actual pixel intensity values.
- the display driver management process 535 receives, as input, glyphs and display information 524 ′.
- the display information 524 ′ may include, for example, foreground/background color information, color palette information and pixel value format information.
- the processed pixel values may then be forwarded as video frame part(s) 540 along with screen (and perhaps window) positioning information (e.g., from the application process 510 and/or operating system), to a display (video) adapter 550 .
- a display adapter 550 may include electronic components that generate a video signal sent to the display 560 .
- a frame buffer process 552 may be used to store the received video frame part(s) in a screen frame buffer 554 of the display adapter 550 .
- Using the screen frame buffer 554 allows a single image of, e.g., a text string, to be generated from glyphs representing several different characters.
- the video frame(s) from the screen frame buffer 554 is then provided to a display adaptation process 553 which adapts the video for a particular display device.
- the display adaptation process 558 may also be effected by the display adapter 550 .
- the adapted video is presented to the display device 560 , such as an LCD display for example, for rendering.
- FIG. 6 illustrates processes that may be performed by a graphics display interface (or GDI) process 522 , as well as data that may be used by the GDI process 522 .
- the GDI process 522 may include a glyph cache management process (or more generally, a glyph cache manager) 610 which accepts text, or more specifically, requests to display text, 512 .
- the request may include the point size of the text.
- the glyph cache management process 610 forwards this request to the glyph cache 526 . If the glyph cache 526 includes the glyph corresponding to the requested text character, it provides it for downstream processing.
- a type rasterization process 620 may be effected by hardware and/or software and converts a character outline (which may, recall, include points which define contours such as lines and curves based on mathematical formulas) into a raster (that is, a bitmapped) image. Each pixel of the bitmap image may have a color value and a brightness for example.
- a type rasterization process is described in ⁇ 1.2.2.2.1.1.1 below.
- the type rasterization process 620 basically transforms character outlines into bitmapped images.
- the scale of the bitmap may be based on the point size of the font and the resolution (e.g., pixels per inch) of the display device 560 .
- the text, font, and point size information may be obtained from the application 510 , while the resolution of the display device 560 may be obtained from a system configuration or display driver file or from monitor settings stored in memory by the operating system.
- the display information 524 may also include foreground/background color information, gamma values, color palette information and/or display adapter/display device pixel value format information. To reiterate, this information may be provided from the graphics display interface 522 in response to a request from the application process 510 .
- the background color information is what is being rendered on the display (such as a bitmap image or other text for example) and is provided from the display device 560 or the video frame buffer 554 .
- the rasterization process may include two (2) or three (3) sub-steps or sub-processes.
- the character outline is scaled using a scaling process 622 . This process is described below.
- the scaled image generated by the scaling process 622 may be placed on a grid and have portions extended or shrunk using a hinting process 626 . This process is also described below.
- an outline fill process 628 is used to fill the grid-fitted outline to generate a raster bitmap. This process is also described below.
- the font unit coordinates used to define the position of points defining contours of a character outline were scaled to device specific pixel coordinates. That is, since the resolution of the em square was used to define a character outline, before that character could be displayed, it was scaled to reflect the size, transformation and the characteristics of the output device on which it was to be rendered. Recall that the scaled outline describes the character outline in units that reflect the absolute unit of measurement used to measure pixels of the output device, rather than the relative system of measurement of font units per em.
- the resolution of an output device may be specified by the number of dots or pixels per inch (dpi).
- hinting also referred to as “instructing a glyph”
- the purpose of hinting is to ensure that critical characteristics of the original font design are preserved when the glyph is rendered at different sizes and on different devices. Consistent stem weights, consistent “color” (that is, in this context, the balance of black and white on a page or screen), even spacing, and avoiding pixel dropout are common goals of hinting.
- uninstructed, or unhinted, fonts would generally produce good quality results at sufficiently high resolutions and point sizes.
- legibility may become compromised at smaller point sizes on lower resolution displays. For example, at low resolutions, with few pixels available to describe the character shapes, features such as stem weights, crossbar widths and serif details can become irregular, or inconsistent, or even missed completely.
- hinting may involve “grid placement” and “grid fitting”.
- Grid placement is used to align a scaled character within a grid, that is used by a subsequent outline fill process 628 , in a manner intended to optimize the accurate display of the character using the available sub-pixel elements.
- Grid fitting involves distorting character outlines so that the character better conforms to the shape of the grid. Grid fitting ensures that certain features of the glyphs are regularized. Since the outlines are only distorted at a specified number of smaller sizes, the contours of the fonts at high resolutions remain unchanged and undistorted.
- sub-pixel element boundaries may be treated as boundaries along which characters can, and should, be aligned or boundaries to which the outline of a character should be adjusted.
- the hinted image 627 is overscaled four (4) times in both the X and Y directions.
- the image is then sampled, i.e. for every physical pixel, which is represented by 4-by-4 portion of the grid in an overscaled image, the blend factor alpha is computed for that pixel by simply counting the squares having centers which lie within the glyph outline and dividing the result by 16.
- the foreground/background blend factor alpha is expressed as k/16 and is computed for every pixel.
- This whole process is also called standard anti-aliasing filtering. Unfortunately, however, such standard anti-aliasing tends to blur the image.
- the outline fill process 628 basically determines whether the center of each pixel is enclosed within the character outline. If the center of a pixel is enclosed within the character outline, that pixel is turned ON. Otherwise, the pixel is left OFF.
- the problem of “pixel dropout” may occur whenever a connected region of a glyph interior contains two ON pixels that cannot be connected by a straight line that passes through only those ON pixels. Pixel dropout may be overcome by looking at an imaginary line segment connected two adjacent pixel centers, determining whether the line segment is intersected by both an on-transition contour and off-transition contour, determining whether the two contour lines continue in both directions to cut other line segments between adjacent pixel centers and, if so, turning pixels ON.
- the rasterized glyphs are then cached in glyph cache 526 .
- Caching glyphs is useful. More specifically, since most Latin fonts have only about 200 characters, a reasonably sized cache makes the speed of the rasterizer almost meaningless. This is because the rasterizeer runs once, for example when a new font or point size is selected. Then, the bitmaps are transferred out of the glyph cache 526 as needed.
- the scaling process 622 of the known system just described may introduce certain rounding errors. Constraints are enforced by (i) scaling the size and positioning information included in a character font as a function of the point size and device resolution as just described above, and (ii) then rounding the size and positioning values to integer multiples of the pixel size used in the particular display device. Using pixel size units as the minimum (or “atomic”) distance unit produces what is called “pixel precision” since the values are accurate to the size of one (1) pixel.
- Rounding size and positioning values of character fonts to pixel precision introduces changes, or errors, into displayed images.
- Each of these errors may be up to 1 ⁇ 2 a pixel in size (assuming that values less than 1 ⁇ 2 a pixel are rounded down and values greater than or equal to 1 ⁇ 2 a pixel are rounded up).
- the overall width of a character may be less precise than desired since the character's AW is (may be) rounded.
- the positioning of a character's black body within the total horizontal space allocated to that character may be sub-optimal since the left side bearing is (may be) rounded.
- the changes introduced by rounding using pixel precision can be significant.
- Rounding position values for line drawings to pixel precision introduces changes, or errors, into displayed images.
- Each of these errors may be up to 1 ⁇ 2 a pixel in size (assuming that values less than 1 ⁇ 2 a pixel are rounded down and values greater than or equal to 1 ⁇ 2 a pixel are rounded up).
- the overall width of a line section may be less precise than desired since the width or weight of the line is (may be) rounded.
- an overscaling or oversampling process may accept analytic character information, such as contours for example, and a scale factor or grid and overscale or oversample the analytic character information to produce an overscaled or oversampled image.
- the overscaled or oversampled image generated has a higher resolution than the display upon which the character is to be rendered. If, for example, the display is a RGB striped LCD monitor, the ultra-resolution image may have a resolution corresponding to the sub-pixel component resolution of the display, or an integer multiple thereof.
- the ultra-resolution image 704 may have a pixel resolution in the Y direction and a 1 ⁇ 3 (or 1 ⁇ 3N, where N is an integer) pixel resolution in the X direction.
- the ultra-resolution image may have a pixel resolution in the X direction and a 1 ⁇ 3 (or 1 ⁇ 3N) pixel resolution in the Y direction.
- a process for combining displaced samples of the ultra-resolution image 624 ′ may be used to generate another ultra-resolution image (or an image with sub-pixel information) which is then cached.
- the cached character information may then be accessed by a compositing process which uses foreground and background color information.
- An analytic image such as a line drawing for example, may be applied to the oversampling/overscaling process as was the case with the character analytic image. However, since the analytic image may have different units than that of the character analytic image, the scale factor applied may be different. In any event, the downstream processes may be similarly applied.
- an ultra resolution image is already “digitized”, that is, not merely mathematically expressed contours or lines between points, it may be applied directly to a process for combining displaced samples of the ultra-resolution image to generate another ultra-resolution image (or an image with sub-pixel information). Downstream processing may then be similarly applied.
- the functionality of the overscaling/oversampling process and the processes for combining displaced samples may be combined into a single step analytic to digital sub-pixel resolution conversion process.
- FIGS. 1 and 2 illustrate vertical striping in a conventional RGB LCD display device.
- FIGS. 3 and 4 illustrate certain font technology terms.
- FIG. 5 illustrates processes that may be performed in a font or character rendering system in which the present invention may be implemented.
- FIG. 6 illustrates processes that may be performed in a graphics display interface.
- FIG. 7 illustrates processes that may be performed in a line art or graphics rendering system in which the present invention may be implemented.
- FIG. 8 illustrates processes that may be used to effect various aspects of the present invention.
- FIG. 9 illustrates an overscaling process operating on character outline information.
- FIG. 10 is a block diagram of a computer architecture which may be used to implement various aspects of the present invention.
- FIG. 11 illustrates the operation of an ideal analog to digital sub-pixel conversion method.
- FIG. 12 is a high level flow diagram of that method.
- FIG. 13 illustrates the operation of a disfavored downsampling method.
- FIG. 14 is a high level flow diagram of that method.
- FIG. 15 illustrates the operation of a method for deriving sub-pixel element information from color scan lines.
- FIG. 16 is a high level flow diagram of that method.
- FIG. 17 illustrates the operation of an alternative method for deriving sub-pixel element information from color scan lines.
- FIG. 18 is a high level flow diagram of that method.
- FIG. 19 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient information, as well as foreground and background color information.
- FIG. 20 is a high level flow diagram of that method.
- FIG. 21 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information.
- FIG. 22 is a high level flow diagram of that method.
- FIG. 23 illustrates the operation of an alternative method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information.
- FIG. 24 is a high level flow diagram of that method.
- FIG. 25 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information, where the foreground and/or background color information may vary based on the position of a pixel within the image.
- FIG. 26 is a high level flow diagram of that method.
- FIG. 27 illustrates the operation of an alternative method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information, where the foreground and/or background color information may vary based on the position of a pixel within the image.
- FIG. 28 is a high level flow diagram of that method.
- FIG. 29 is a high level block diagram of a machine which may be used to implement various aspects of the present invention.
- FIG. 30 illustrates samples derived from a portion of an overscaled character outline.
- FIG. 31 illustrates the operations of alternative sample combination techniques.
- the present invention concerns novel methods, apparatus and data structures for rendering text, line art and graphics on displays having sub-pixel components.
- the following description is presented to enable one skilled in the art to make and use the invention, and is provided in the context of particular applications and their requirements.
- Various modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles set forth below may be applied to other embodiments and applications.
- the present invention is not intended to be limited to the embodiments shown.
- FIG. 8 is a high level diagram of processes that may be performed to effect various aspects of the present invention, as well as data accepted by or generated by such processes.
- the processes may act on an analytic image 512 / 525 , such as contours, foreground and background colors of a character; an analytic image information 702 ′, such as lines, points, contours, foreground and background colors of line art; or an image 704 ′ having a higher resolution than that of the display 560 (also referred to as an “ultra-resolution image”).
- Processes associated with rendering a character image 512 / 525 are addressed in ⁇ 4.1.1 below.
- Processes associated with rendering a non-character analytic image 702 ′ are addressed in ⁇ 4.1.2 below.
- Processes associated with rendering an ultra-resolution image 704 ′ are addressed in ⁇ 4.1.3 below.
- An overscaling or oversampling process 622 ′/ 710 ′ may accept analytic character information, such as contours for example, and a scale factor or grid 820 and overscale and/or oversample the analytic character information.
- analytic character information such as contours for example
- a scale factor or grid 820 overscale and/or oversample the analytic character information.
- overscaling means stretching the analytic character outline while leaving the coordinate system unchanged
- oversampling means compressing the grid defined by the coordinate system while leaving the analytic character outline unchanged.
- an overscaled analytic image 805 is generated.
- the overscaled analytic image 805 may then be sampled by sampling process 806 to generate ultra-resolution digital image information 810 .
- the ultra-resolution digital image information 810 is generated directly.
- the ultra-resolution image 810 has a higher resolution than the display 560 upon which the character is to be rendered.
- the display is a RGB striped LCD monitor for example, the ultra-resolution image may have a resolution corresponding to the sub-pixel component resolution of the display, or an integer multiple thereof.
- the ultra-resolution image 810 may have a pixel resolution in the Y direction and a 1 ⁇ 3 (or ⁇ fraction ( 1 / 3 ) ⁇ N, where N is an integer) pixel resolution in the X direction. If, on the other hand, a horizontally striped RGB LCD monitor is to be used, the ultra-resolution image 810 may have a pixel resolution in the X direction and a 1 ⁇ 3 (or 1 ⁇ 3N) pixel resolution in the Y direction.
- the optional hinting process 626 ′ may apply hinting instructions to the overscaled analytic image 805 .
- N an arbitrarily large number
- the resulting scaled analytic image 808 may then be sampled by the sampling process 806 to generate the ultra-resolution image 810 . Consequently, the resulting ultra-resolution digital image information 810 is overscaled by Z (e.g., six (6)) in the X direction.
- the scaled analytic image 805 may be directly sampled by the sampling process 806 to generate an ultra-resolution image 810 .
- FIG. 9 illustrates an example of the operation of an exemplary overscaling/oversampling process 622 ′/ 710 ′ used in the case of a vertically striped LCD monitor.
- font vector graphics e.g., the character outline
- point size e.g., the character outline
- display resolution e.g., the display resolution
- the font vector graphics (e.g., the character outline) 512 / 525 / 910 is rasterized based on the point size, display resolution and the overscale factors (or oversample rate).
- the Y coordinate values of the character outline in units of font units
- the X coordinate values of the character outline are overscaled as shown in 930 and rounded to the nearest integer scan conversion source sample (e.g., pixel sub-component) value.
- the resulting data 940 is the character outline in units of pixels in the Y direction and units of scan conversion source samples (e.g., pixel sub-components) in the X direction.
- a process 830 for combining displaced (e.g., adjacent, spaced, or overlapping) samples of the ultra-resolution image 624 ′ can be used to generate another ultra-resolution image 840 (or an image with sub-pixel information) which may then be cached into cache storage 880 by the optional caching process 870 .
- Each sample of the ultra-resolution image 840 may be based on the same number or differing numbers of samples from the ultra-resolution image 810 .
- the cached character information 870 may then be accessed by a compositing process 850 which uses the foreground and background color information 524 ′.
- the analytic image 702 ′ such as a line drawing for example, may be applied to the oversampling/overscaling process 622 ′/ 710 ′ as was the case with the character analytic image 512 / 525 .
- the scale factor 820 applied may be different.
- the downstream processes may be similarly applied.
- an ultra resolution image 704 ′ is already “digitized”, that is, not merely mathematically expressed contours or lines between points, it may be applied directly to the process 830 for combining displaced samples of the ultra-resolution image 810 to generate another ultra-resolution image 840 (or an image with sub-pixel information). Downstream processing may then be similarly applied.
- the functionality of the overscaling/oversampling process 622 ′/ 710 ′ and the processes 830 for combining displaced samples may be combined into a single step analytic to digital sub-pixel resolution conversion process 860 .
- the present invention may be used in the context of increasing the resolution of text to be rendered on a display, an analytic image, such as line art for example, to be rendered on a display, or ultra-resolution graphics to be rendered on a display.
- the techniques of the present invention may be applied to a known character rendering system such as that illustrated in FIG. 6 and described in ⁇ 1.2.2.2.1 above.
- the graphics display interface 522 would be modified. More specifically, the scaling process 622 and the outline fill process 628 would be replaced with the overscaling/oversampling process 622 ′/ 710 ′, the downscaling process 807 , the sampling process 806 , and the process 830 for combining displaced samples of the present invention, or alternatively, replaced with the analog to digital sub-pixel conversion process 860 of the present invention.
- the techniques of the present invention may be similarly applied to a known analytic image rendering system.
- intermediate results such as the results generated from a first filtering act of a two-part filtering technique
- the second filtering act of the two-part filtering technique may then be performed on such intermediate results.
- the final result of the second filtering act may then be cached.
- the first filtering act of the two-part filtering technique may be performed by a font driver, while the second filtering act of the two-part filtering technique may then be performed by the graphics display interface (or “GDI”) of the operating system.
- GDI graphics display interface
- FIGS. 10 and 29 and the following discussion provide a brief, general description of an exemplary apparatus in which at least some aspects of the present invention may be implemented.
- Various methods of the present invention will be described in the general context of computer-executable instructions, such as program modules and/or routines for example, being executed by a computing device such as a personal computer.
- Other aspects of the invention will be described in terms of physical hardware such as display device components and display screens for example.
- Program modules may include routines, programs, objects, components, data structures (e.g., look-up tables, etc.) that perform task(s) or implement particular abstract data types.
- Program modules may be practiced with other configurations, including hand held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network computers, minicomputers, set top boxes, mainframe computers, displays used in, e.g., automotive, aeronautical, industrial applications, and the like.
- At least some aspects of the present invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices linked through a communications network.
- program modules may be located in local and/or remote memory storage devices.
- FIG. 10 is a block diagram of an exemplary apparatus 1000 which may be used to implement at least some aspects of the present invention.
- a personal computer 1020 may include a processing unit 1021 , a system memory 1022 , and a system bus 1023 that couples various system components including the system memory 1022 to the processing unit 1021 .
- the system bus 1023 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures.
- the system 1022 memory may include read only memory (ROM) 1024 and/or random access memory (RAM) 1025 .
- ROM read only memory
- RAM random access memory
- a basic input/output system 1026 (BIOS), including basic routines that help to transfer information between elements within the personal computer 1020 , such as during start-up, may be stored in ROM 1024 .
- the personal computer 1020 may also include a hard disk drive 1027 for reading from and writing to a hard disk, (not shown), a magnetic disk drive 1028 for reading from or writing to a (e.g., removable) magnetic disk 1029 , and an optical disk drive 1030 for reading from or writing to a removable (magneto) optical disk 1031 such as a compact disk or other (magneto) optical media.
- the hard disk drive 1027 , magnetic disk drive 1028 , and (magneto) optical disk drive 1030 may be coupled with the system bus 1023 by a hard disk drive interface 1032 , a magnetic disk drive interface 1033 , and a (magneto) optical drive interface 1034 , respectively.
- the drives and their associated storage media provide nonvolatile storage of machine readable instructions, data structures, program modules and other data for the personal computer 1020 .
- exemplary environment described herein employs a hard disk, a removable magnetic disk 1029 and a removable optical disk 1031 , those skilled in the art will appreciate that other types of storage media, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROM), and the like, may be used instead of, or in addition to, the storage devices introduced above.
- storage media such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROM), and the like, may be used instead of, or in addition to, the storage devices introduced above.
- a number of program modules may be stored on the hard disk 1023 , magnetic disk 1029 , (magneto) optical disk 1031 , ROM 1024 or RAM 1025 , such as an operating system 1035 , one or more application programs 1036 , other program modules 1037 , display driver 530 / 1032 , and/or program data 1038 for example.
- the RAM 1025 can also be used for storing data used in rendering images for display as will be discussed below.
- a user may enter commands and information into the personal computer 1020 through input devices, such as a keyboard 1040 and pointing device 1042 for example. Other input devices (not shown) such as a microphone, joystick, game pad, satellite dish, scanner, or the like may also be included.
- a monitor 560 / 1047 or other type of display device may also be connected to the system bus 1023 via an interface, such as a display adapter 550 / 1048 , for example.
- the personal computer 1020 may include other peripheral output devices (not shown), such as speakers and printers for example.
- the personal computer 1020 may operate in a networked environment which defines logical connections to one or more remote computers, such as a remote computer 1049 .
- the remote computer 1049 may be another personal computer, a server, a router, a network PC, a peer device or other common network node, and may include many or all of the elements described above relative to the personal computer 1020 .
- the logical connections depicted in FIG. 10A include a local area network (LAN) 1051 and a wide area network (WAN) 1052 (such as an intranet and the Internet for example).
- LAN local area network
- WAN wide area network
- the personal computer 1020 When used in a LAN, the personal computer 1020 may be connected to the LAN 1051 through a network interface adapter card (or “NIC”) 1053 .
- the personal computer 1020 When used in a WAN, such as the Internet, the personal computer 1020 may include a modem 1054 or other means for establishing communications over the wide area network 1052 .
- the modem 1054 which may be internal or external, may be connected to the system bus 1023 via the serial port interface 1046 .
- at least some of the program modules depicted relative to the personal computer 1020 may be stored in the remote memory storage device.
- the network connections shown are exemplary and other means of establishing a communications link between the computers may be used.
- FIG. 29 is a more general machine 2900 which may effect at least some aspects of the present invention.
- the machine 2900 basically includes a processor(s) 2902 , an input/output interface unit(s) 2904 , a storage device(s) 2906 , and a system bus or network 2908 for facilitating data and control communications among the coupled elements.
- the processor(s) 2902 may execute machine-executable instructions to effect one or more aspects of the present invention. At least a portion of the machine executable instructions and data structures may be stored (temporarily or more permanently) on the storage devices 2906 and/or may be received from an external source via an input interface unit 2904 .
- FIG. 11 illustrates an operation of an exemplary resolution enhancement method 1200 which may be used to effect the analytic to digital sub-pixel conversion process 860 .
- FIG. 12 is a flow diagram of this method 1200 .
- continuous one dimensional RGB functions (or functions of other color spaces) 1110 are accepted in act 1210 .
- Each one of the color component inputs 1110 are then sampled (or filtered) as shown in act 1220 .
- these filters 1120 may be a three-emitter (where an “emitter” is a sub-pixel component) wide box filter. Notice that the filters 1120 are spatially displaced from one another.
- the spatially displaced filters may be spaced, immediately adjacent, or partially overlapping.
- the output of each of the filters 1120 is a color value 1130 of an emitter.
- These values 1130 may be gamma corrected (or adjusted) based on a gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 1230 .
- the method 1200 is then left via RETURN node 1240 .
- the method 1200 is ideal in that there are no extra aliasing artifacts introduced. However, to effect the filters 1120 , an integral over a continuous function 1110 is evaluated. This integration is possible when the input image 1110 is described analytically, but this is not always the case.
- FIG. 13 illustrates an operation of a disfavored exemplary resolution enhancement method 1400 .
- FIG. 14 is a flow diagram of this method 1400 .
- a luminance image (Y) 1310 is sampled three (3) times per output pixel (which works out to once per sub-pixel component in a striped RGB monitor) as shown in act 1410 .
- This sampling generates three luminance Y samples 1320 per pixel.
- three adjacent samples are box filtered, that is averaged together (Note filters 1330 of FIG. 13.), to generate red, green and blue sub-pixel component values 1340 , as shown in act 1420 .
- the method 1400 is then left via RETURN node 1430 .
- this method 1400 since this method 1400 only samples three (3) times per pixel, it produces aliasing artifacts. More specifically, sampling at a particular frequency “folds” frequencies above the Nyquist rate down to frequencies below the Nyquist rate. In this method 1400 , frequencies above 3/2 cycles per pixel are folded down to frequencies below that rate. In particular, sampling three (3) times per output pixel causes input frequencies of two (2) cycles per pixel to be aliased down to one (1) cycle per pixel which causes unwanted color fringing. Also, the method 1400 does not generalize correctly to full color images since it operates on luminance (Y) only. Further, device response (e.g., gamma) correction is not effected.
- FIG. 15 illustrates an operation of an exemplary resolution enhancement method 1600 .
- This method 1600 may be used to effect the process 830 for combining displaced samples.
- FIG. 16 is a flow diagram of this method 1600 . Referring to both FIGS. 15 and 16, the following loop of acts is performed for each color scan line 1510 as defined by 1610 and 1660 . First, discrete values of the color scan line 1510 are accepted as shown in act 1620 .
- the samples 1515 are filtered (e.g., averaged) to generate new samples of a three (3) times oversampled color scan line 1520 as shown in act 1640 .
- the new samples 1520 are filtered again, for example with box filters shown as brackets 1525 , to generate color values 1530 associated with sub-pixel components.
- the filters e.g., box filters
- the filters 1525 are centered at locations that correspond to the centers of the sub-pixel elements.
- the filters 1525 are offset, and consequently operate at distinct positions within the image, for each of the color components as shown.
- the offset of the filters 1525 such that they operate at distinct positions within the image distinguishes the present invention over standard anti-aliasing techniques.
- Each of the filters 1525 may also have distinct filter weighting coefficients, which further distinguishes the present invention over standard anti-aliasing techniques. These acts are repeated if there are any further colors to be processed as shown by loop 1610 - 1660 . Once all of the colors are processed, the filter output may be gamma corrected (or adjusted) based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 1670 . The process 1600 is left via RETURN node 1680 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 1600 of FIG. 16.
- the number of samples per emitter N may be two (2). This minimizes extra aliasing artifacts.
- Setting the samples per emitter N to be greater than two (2) yields even less aliasing, but, as stated above, adds computational complexity.
- FIG. 17 illustrates an operation of an exemplary resolution enhancement method 1800 .
- This method 1800 may be used to effect the process 830 for combining displaced samples.
- FIG. 18 is a flow diagram of this method 1800 .
- the method 1800 of FIG. 18 is similar to that method 1600 of FIG. 16. However, the per-emitter pre-filtering ( 1640 ) and the filtering ( 1650 ) are combined into one filter. This is possible since both operations are linear.
- each color scan line 1710 as defined by acts 1810 and 1840 .
- discrete values of the color scan line 1710 are accepted as shown in act 1820 .
- the scan line 1710 of the associated color being processed is then filtered, in one step, to generate a color scan line as shown in act 1830 .
- a filter e.g., a box filter
- the filter 1720 may be centered at the sub-pixel element location.
- the offset of the filters 1720 such that they operate at distinct positions within the image distinguishes the present invention over standard anti-aliasing techniques.
- filters can be used and other values of N can be used.
- These acts are repeated if there are any further colors to be processed as shown by loop 1810 - 1840 .
- the filter output may be gamma corrected (or adjusted) based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 1850 .
- the process 1800 is then left via RETURN node 1860 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 1800 of FIG. 18.
- fonts (and line art) are typically not a general RGB image. Rather, fonts (and line art) may be described as a blend (also referred to as “alpha” or ⁇ ) between a foreground color and a background color. Assume that the blending coefficient at a location x is ⁇ (x), the foreground color is f and the background color is b. Assume further that a filter output is expressed as L[ ]. Then, the output of a filter of the present invention applied to a font image may be expressed as:
- equation (2) may be expressed as:
- FIG. 19 illustrates an operation of an exemplary resolution enhancement method 2000 .
- the method 2000 may be used to effect the process 830 for combining displaced samples.
- FIG. 20 is a flow diagram of this method 2000 .
- an analytic blending coefficient (alpha) 1910 is filtered, using displaced filters (See, e.g., three times oversampling filters 1920 .), to generate oversampled blend coefficient values 1930 as shown in act 2010 .
- displaced filters See, e.g., three times oversampling filters 1920 .
- oversampled blend coefficient values 1930 as shown in act 2010 .
- color samples 1940 are determined based on the foreground 1932 , the background 1934 , and the blend coefficient samples 1930 .
- the output 1940 may then be gamma corrected (or adjusted) 1950 based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 2050 .
- an inverse display response (e.g., gamma) correction may be performed on the foreground 1932 and background 1934 colors before the blend operation.
- the method 2000 is then left via RETURN node 2060 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 2000 of FIG. 20.
- FIG. 21 illustrates an operation of an exemplary resolution enhancement method 2200 .
- FIG. 22 is a flow diagram of this method 2200 .
- the method 2200 may be used to effect the process 830 for combining displaced samples.
- This method is somewhat of a hybrid between the method 1600 of FIG. 16 and the method 2000 of FIG. 20.
- oversampled blending coefficient (alpha) samples 2110 are accepted as shown in act 2210 .
- These oversampled samples are then filtered (e.g., averaged) (See bracket 2115 .) to generate a new set of blend coefficients (alphas) 2120 as shown in act 2220 .
- the new set of blend coefficients (alphas) 2120 are filtered again (See, e.g., the filters 2125 .) to generate a final set of blend coefficients (alphas) 2130 .
- the final set of blend coefficients (alsphs) 2130 may be cached.
- the process then continues as did the process 2000 . More specifically, as shown by loop 2240 - 2250 , for each color, color samples 2140 are determined based on the foreground 2132 , the background 2134 , and the final set of blend coefficient samples 2130 .
- the output 2140 may then be gamma corrected (or adjusted) 2150 based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 2270 .
- an inverse display response (e.g., gamma) correction may be performed on the foreground 2132 and background 2134 colors before the blend operation.
- the method 2200 is then left via RETURN node 2280 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 2200 of FIG. 22.
- FIG. 21 illustrates an exemplary operation of the method 2400 of FIG. 24.
- the method 2400 may be used to effect the process 830 for combining displaced samples. Referring to both FIGS. 23 and 24, oversampled blending coefficient (alpha) samples 2110 are accepted as shown in act 2410 .
- oversampled samples are then filtered (See, e.g., the filters 2320 .) to generate a final set of blend coefficients (alphas) 2330 as shown in act 2420 .
- the process then continues as did the process 2200 . More specifically, as shown by loop 2430 - 2450 , for each color, color samples 2340 are determined based on the foreground 2132 , the background 2134 , and the final set of blend coefficient samples 2330 .
- the output 2340 may then be gamma corrected (or adjusted) 2150 based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 2460 .
- an inverse display response (e.g., gamma) correction may be performed on the foreground 2132 and background 2134 colors before the blend operation.
- the method 2400 is then left via RETURN node 2470 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 2400 of FIG. 24.
- the blend coefficient (alpha) would be applied to a constant foreground color 2132 r, 2132 g, 2132 b and a constant background color 2134 r, 2134 g, 2134 b.
- the image such as a character image
- the blend coefficients (alphas) can be used to interpolate between a non-constant foreground and/or background colors.
- the method 2600 of FIG. 26 is similar to the method 2200 of FIG. 22, but permits the foreground and/or background colors to change with position.
- the method 2600 may be used to effect the process 830 for combining displaced samples.
- FIG. 25 illustrates an example of the operation of the method 2600 of FIG. 26. Referring to both FIGS. 25 and 26, oversampled blending coefficient (alpha) samples 2110 are accepted as shown in act 2610 . These oversampled samples are then filtered (e.g., averaged) (See bracket 2115 .) to generate a new set of blend coefficients (alphas) 2120 as shown in act 2620 .
- the new set of blend coefficients (alphas) 2120 are filtered (See, e.g., the filters 2125 .) to generate a final set of blend coefficients (alphas) 2130 .
- This final set of blend coefficients (alphas) 2130 may then be cached.
- color values 2540 associated with sub-pixel components are determined based on the foreground 2132 at the position, the background 2134 at the position, and the final set of blend coefficient samples 2130 .
- these loops can be re-ordered such that a position loop is nested within a color loop.
- the output 2540 may then be gamma corrected (or adjusted) 2550 based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 2690 .
- an inverse display response (e.g., gamma) correction may be performed on the foreground 2532 and background 2534 colors before the blend operation.
- the method 2600 is then left via RETURN node 2695 .
- the separate colors, as well as the separate foreground and background colors at separate positions, may be processed in parallel rather than in a sequence of loops as depicted in the method 2600 of FIG. 26.
- the method 2800 of FIG. 28 is similar to the method 2400 of FIG. 24, but permits the foreground and/or background colors to change with position. Further, the method 2800 of FIG. 28 is similar to the method 2600 of FIG. 26 but combines the separate acts of filtering 2620 and 2630 into a single operation. The method 2800 may be used to effect the process 830 for combining displaced samples.
- FIG. 27 illustrates an example of the operation of the method 2800 of FIG. 28. Referring to both FIGS. 27 and 28, oversampled blending coefficient (alpha) samples 2110 are accepted as shown in act 2810 .
- oversampled samples are then filtered (See, e.g., the filters 2320 .) to generate a final set of blend coefficients (alphas) 2330 as shown in act 2820 .
- the method 2800 then continues as did the method 2600 . More specifically, as shown by nested loops 2830 - 2870 and 2840 - 2860 , for each position and for each color (which may vary with position), color samples 2740 are determined based on the foreground 2732 at the position, the background 2734 at the position, and the final set of blend coefficient samples 2330 . In an alternative embodiment, these loops can be reordered such that a position loop is nested within a color loop.
- the output 2740 may then be gamma corrected (or adjusted) 2750 based on the gamma (or other) response of the display 560 on which the image is to be rendered as shown in act 2880 .
- an inverse display response (e.g., gamma) correction may be performed on the foreground 2732 and background 2734 colors before the blend operation.
- the method 2800 is then left via RETURN node 2890 .
- the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the method 2800 of FIG. 28.
- FIG. 30 illustrates a scan line 3010 from a portion of an overscaled character 940 ′ (Recall, FIG. 9 in which the letter Q was overscaled in the horizontal direction.).
- each sample of the scan line 3010 has a value of “0” if its center is outside of the character outline 940 ′ and a value of “1” if its center is within the character outline 940 ′.
- Other ways of determining the value of scanline 3010 samples may be used instead.
- a sample of the scanline 3010 may have a value of “1” if it is more than a predetermined percentage (e.g., 50%) within the character outline 940 ′, and a value of “0” if it is less than or equal to the predetermined percentage within the character outline 940 ′.
- a predetermined percentage e.g. 50%
- 0 if it is less than or equal to the predetermined percentage within the character outline 940 ′.
- FIG. 31 illustrates exemplary one-part and two-part filtering techniques which may be used to filter samples of a scanline 3010 .
- the exemplary one-part filtering technique is illustrated below the scanline 3010 and the exemplary two-part filtering technique is illustrated above the scanline 3010 .
- the scanline 3010 In the exemplary one-part filtering technique illustrated below the scanline 3010 , notice that filters, depicted as brackets 3110 , operate on six (6) samples of the scanline 3010 and are offset by two (2) samples. The sums of the samples of the scanline 3010 within the filters 3110 are shown in line 3120 .
- the scanline 3010 is derived from a character outline 940 ′ overscaled six (6) times in the horizontal (or X) direction.
- each filter of the first set of filters operate on two (2) samples of the scanline 3010 and are offset by two (2) samples.
- the averages of the samples of the scanline 3010 within the filters 3130 are shown in line 3140 .
- each filter of the second set of filters depicted as brackets 3150 , operate on three (3) results 3140 generated from the first set of filters 3130 and are offset by one (1) result 3140 (which corresponds to two (2) samples of the scanline 3010 ).
- the average of the results 3140 within each filter 3150 of the second set of filters is determined as shown by line 3160 .
- the scanline 3010 is derived from a character outline 940 ′ overscaled six (6) times in the horizontal (or X) direction.
- exemplary filters were described as performing averaging or summing operations, other type of filters may be used. For example, a filter that weights certain samples more than others may be used.
- the present invention can be used to improve the resolution of analytic image information, such as character information and line art for example, to be rendered on a patterned display device. Further, the present invention can be used to improved the resolution of ultra resolution image information, such as graphics for example, to be rendered on a patterned display device.
Abstract
Description
- § 1.1 Field of the Invention
- The present invention concerns techniques for enhancing the resolution of images, such as fonts, line drawings, or black-and-white or full-color images for example, to be rendered on a patterned output device, such as a flat panel video monitor or an LCD video monitor for example.
- § 1.2 Related Art
- The present invention may be used in the context of patterned output devices such as flat panel video monitors, or LCD video monitors for example. In particular, the present invention may be used as a part of processing to produce higher resolution images, such as more legible text for example, on LCD video monitors. Although the structure and operation of display devices in general, and flat panel display devices, such as LCD monitors for example, in particular, are known by those skilled in the art, they are discussed in § 1.2.1 below for the reader's convenience. Then, known ways of rendering text, line art and graphics on such displays are discussed in §§ 1.2.2, 1.2.3 and 1.2.4 below.
- § 1.2.1 Display Devices
- Color display devices have become the principal display devices of choice for most computer users. Color is typically displayed on a monitor by operating the display device to emit light (such as a combination of red, green, and blue light for example) which results in one or more colors being perceived by the human eye.
- Although color video monitors in general, and LCD video monitors in particular, are known to those skilled in the art, they are introduced below for the reader's convenience. In § 1.2.1.1 below, cathode ray tube (or CRT) video monitors are first introduced. Then, in § 1.2.1.2 below, LCD video monitors are introduced.
- § 1.2.1.1 CRT Video Monitors
- Cathode ray tube (CRT) display devices include phosphor coatings which may be applied as dots in a sequence on the screen of the CRT. A different phosphor coating is normally associated with the generation of different colors, such as red, green, and blue for example. Consequently, repeated sequences of phosphor dots are defined on the screen of the video monitor. When a phosphor dot is excited by a beam of electrons, it will generate its associated color, such as red, green and blue for example.
- The term “pixel” is commonly used to refer to one spot in a group of spots, such as rectangular grid of thousands of such spots for example. The spots are selectively activated to form an image on the display device. In most color CRTs, a single triad of red, green and blue phosphor dots cannot be uniquely selected. Consequently, the smallest possible pixel size will depend on the focus, alignment and bandwidth of the electron guns used to excite the phosphor dots. The light emitted from one or more triads of red, green and blue phosphor dots, in various arrangements known for CRT displays, tend to blend together giving, at a distance, the appearance of a single colored light source.
- In color displays, the intensity of the light emitted from the additive primary colors (such as red, green, and blue) can be varied to achieve the appearance of almost any desired color pixel. Adding no color, i.e., emitting no light, produces a black pixel. Adding 100 percent of all three (3) colors produces a white pixel.
- Having introduced color CRT video monitors, color LCD video monitors are now introduced in § 1.2.1.2 below.
- § 1.2.1.2 LCD Video Monitors
- Portable computing devices (also referred to generally as computing appliances or untethered computing appliances) often use liquid crystal displays (LCDs) or other flat panel display devices, instead of CRT displays. This is because flat panel displays tend to be smaller and lighter than CRT displays. In addition, flat panel displays are well suited for battery powered applications since they typically consume less power than comparably sized CRT displays. Further, LCD flat panel monitors are even becoming more popular in the desktop computing environment.
- Color LCD displays are examples of display devices which distinctly address elements (referred to herein as pixel sub-components, pixel sub-elements, or simply, emitters) to represent each pixel of an image being displayed. Normally, each pixel element of a color LCD display includes three (3) non-square elements. More specifically, each pixel element may include adjacent red, green and blue (RGB) pixel sub-components. Thus, a set of RGB pixel sub-components together define a single pixel element.
- Known LCD displays generally include a series of RGB pixel sub-components which are commonly arranged to form stripes along the display. The RGB stripes normally run the entire length of the display in one direction. The resulting RGB stripes are sometimes referred to as “RGB striping”. Common LCD monitors used for computer applications, which are wider than they are tall, tend to have RGB vertical stripes. Naturally, however, some LCD monitors may have RGB horizontal stripes.
- FIG. 1 illustrates a known
LCD screen 100 comprising pixels arranged in a plurality of rows (R1-R12) and columns (C1-C16). That is, a pixel is defined at each row-column intersection. Each pixel includes a red pixel sub-component, depicted with moderate stippling, a green component, depicted with dense stippling, and a blue component, depicted with sparse stippling. FIG. 2 illustrates the upper left hand portion of theknown display 100 in greater detail. Note how each pixel element, such as, the (R2, C4) pixel element for example, comprises three (3) distinct sub-element or sub-components; ared sub-component 206, agreen sub-component 207 and ablue sub-component 208. In the exemplary display illustrated, each knownpixel sub-component pixel sub-components - As illustrated in FIG. 1, one known arrangement of
RGB pixel sub-components display 100. Accordingly, the arrangement of ⅓width color sub-components - In known systems, the RGB pixel sub-components are generally used as a group to generate a single colored pixel corresponding to a single sample of the image to be represented. More specifically, in known systems, luminous intensity values for all the pixel sub-components of a pixel element are generated from a single sample of the image to be rendered.
- Having introduced the general structure and operation of known LCD displays, known techniques for rendering text on such LCD displays, as well as perceived shortcomings of such known techniques, are introduced in § 1.2.2 below. Then, known techniques for rendering line art or images on such LCD displays, as well as perceived shortcomings of such known techniques, are introduced in § 1.2.3 below. Finally, rendering graphics is introduced in § 1.2.4 below.
- § 1.2.2 Rendering Text on Displays
- The expression of textual information using font sets is introduced in § 1.2.2.1 below. Then, the rendering of textual information using so-called pixel precision and perceived shortcomings of doing so are introduced in § 1.2.2.2 below.
- § 1.2.2.1. Font Sets
- A “font” is a set of characters of the same typeface (such as Times Roman, Courier New, etc.), the same style (such as italic), the same weight (such as bold and, strictly speaking, the same size). Characters may include symbols, such as the “Parties MT”, “Webdings”, and “Wingdings” symbol groups found on the Word™ word processor from Microsoft Corporation of Redmond, Wash. for example. A “typeface” is a specific named design of a set of printed characters (e.g., Helvetica Bold Oblique), that has a specified obliqueness (i.e., degree of slant) and stoke weight (i.e., line thickness). Strictly speaking, a typeface is not the same as a font, which is a specific size of a specific typeface (such as 12-point Helvetica Bold Oblique). However, since some fonts are “scalable”, the terms “font” and “typeface” may sometimes be used interchangeably. A “typeface family” is a group of related typefaces. For example, the Helvetica family may include Helvetica, Helvetica Bold, Helvetica Oblique and Helvetica Bold Oblique.
- Many modern computer systems use font outline technology, such as scalable fonts for example, to facilitate the rendering and display of text. TrueType™ fonts from Microsoft Corporation of Redmond, Wash. are an example of such technology. In such systems, various font sets, such as “Times New Roman,” “Onyx,” “Courier New,” etc. for example, may be provided. The font set normally includes an analytic outline representation, such as a series of contours for example, for each character which may be displayed using the provided font set. The contours may be straight lines or curves for example. Curves may be defined by a series of points that describe second order Bezier-splines for example. The points defining a curve are typically numbered in consecutive order. The ordering of the points may be important. For example, the character outline may be “filled” to the right of curves when the curves are followed in the direction of increasing point numbers. Thus the analytic character outline representation may be defined by a set of points and mathematical formulas.
- The point locations may be described in “font units” for example. A “font unit” may be defined as the smallest measurable unit in an “em” square, which is an imaginary square that is used to size and align glyphs (a “glyph” can be thought of as a character). FIG. 3 illustrates an “em” square310 around a
character outline 320 of the letter Q. Historically, an “em” was approximately equal to the width of a capital M. Further, historically, glyphs could not extend beyond the em square. More generally, however, the dimensions of an “em” square are those of thefull body height 340 of a font plus some extra spacing. This extra spacing was provided to prevent lines of text from colliding when typeset without extra leading was used. Further, in general, portions of glyphs can extend outside of the em square. The coordinates of the points defining the lines and curves (or contours) may be positioned relative to a baseline 330 (Y coordinate=0). The portion of thecharacter outline 320 above thebaseline 330 is referred to as the “ascent” 342 of the glyph. The portion of thecharacter outline 320 below thebaseline 330 is referred to as the “decent” 344 of the glyph. Note that in some languages, such as Japanese for example, the characters sit on the baseline, with no portion of the character extending below the baseline. - The stored outline character representation normally does not represent space beyond the maximum horizontal and vertical boundaries of the character (also referred to as “white space” or “side bearings”). Therefore, the stored character outline portion of a character font is often referred to as a black body (or BB). A font generator is a program for transforming character outlines into bitmaps of the style and size required by an application. Font generators (also referred to as “rasterizers”) typically operate by scaling a character outline to a requested size and can often expand or compress the characters that they generate.
- In addition to stored black body character outline information, a character font normally includes black body size, black body positioning, and overall character width information. Black body size information is sometimes expressed in terms of the dimensions of a bounding box used to define the vertical and horizontal borders of the black body.
- Certain terms used to define a character are now defined with reference to FIG. 4, which illustrates character outlines of the letters A and
I 400.Box 408 is a bounding box which defines the size of theblack body 407 of the character (A). The total width of the character (A), including white space to be associated with the character (A), is denoted by an advance width (or AW)value 402. The advance width typically starts to a point left of thebounding box 408. Thispoint 404 is referred to as the left side bearing point (or LSBP). The leftside bearing point 404 defines the horizontal starting point for positioning the character (A) relative to a current display position. Thehorizontal distance 410 between the left end of thebounding box 408 and the leftside bearing point 404 is referred to as the left side bearing (or LSB). The left side bearing 410 indicates the amount of white space to be placed between the left end of thebounding box 408 of a current character (A) and the right side bearing point of the preceding character (not shown). Thepoint 406 to the right of thebounding box 408 at the end of theadvance width 402 is referred to as the right side bearing point (or RSBP). The rightside bearing point 406 defines the end of the current character (A) and the point at which the leftside bearing point 404′ of the next character (I) should be positioned. Thehorizontal distance 412 between the right end of thebounding box 408 and the rightside bearing point 406 is referred to as the right side bearing (or RSB). The right side bearing 412 indicates the amount of white space to be placed between the right end of thebounding box 408 of a current character (A) and the leftside bearing point 404′ of the next character (I). Note that the left and right side bearings may have zero (0) or negative values. Note also that in characters used in Japanese and other Far Eastern languages, metrics analogous to advance width, left side bearing and right side bearing—namely, advance height (AH), top side bearing (TSB) and bottom side bearing (BSB)—may be used. - As discussed above, a scalable font file normally includes black body size, black body positioning, and overall character width information for each supported character. The black body size information may include horizontal and vertical size information expressed in the form of
bounding box 408 dimensions. The black body positioning information may expressed as a leftside bearing value 410. Overall character width information may be expressed as anadvance width 402. - § 1.2.2.2 Rendering Text to Pixel Precision
- In the following, known techniques for rendering text on an output device such as a display (or printer) is described in § 1.2.2.2.1. Then, an example illustrating round-off errors which may occur when using such known techniques is described in § 1.2.2.2.2.
- § 1.2.2.2.1 Technique for Rendering Text
- FIG. 5 is a high level diagram of processes that may be performed when an application requests that text be rendered on a display device. Basically, as will be described in more detail below, text may be rendered by: (i) loading a font and supplying it to a rasterizer; (ii) scaling the font outline based on the point size and the resolution of the display device; (iii) applying hints to the outline; (iv) filling the grid fitted outline with pixels to generate a raster bitmap; (v) scanning for dropouts (optional); (vi) caching the raster bitmap; and (vii) transferring the raster bitmap to the display device.
- In the case of scaling fonts, the font unit coordinates used to define the position of points defining contours of a character outline are scaled to device specific pixel coordinates. That is, when the resolution of the em square is used to define a character outline, before that character can be displayed, it must be scaled to reflect the size, transformation and the characteristics of the output device on which it is to be rendered. The scaled outline describes the character outline in units that reflect the absolute unit of measurement used to measure pixels of the output device, rather than the relative system of measurement of font units per em. Specifically, with known techniques, values in the em square are converted to values in the pixel coordinate system in accordance with the following formula:
- where the character outline size is in font units, and output device resolution is in pixels/inch.
- The resolution of the output device may be specified by the number of dots or pixels per inch (dpi). For example, a VGA video monitor may be treated as a 96 dpi device, a laser printer may be treated as a 300 dpi device, an EGA video monitor may be treated as a 96 dpi device in the horizontal (X) direction, but a 72 dpi device in the vertical (Y) direction. The font units per em may (but need not) be chosen to be a power of two (2), such as 2048 (=211) for example.
- FIG. 5 is a high level diagram of processes which may be performed by a known text rendering system. As shown in FIG. 5, an
application process 510, such as a word processor or contact manager for example, may request that text be displayed and may specify a point size for the text. Although not shown in FIG. 5, theapplication process 510 may also request a font name, background and foreground colors and a screen location at which the text is to be rendered. The text and, if applicable, the point size, 512 are provided to a graphics display interface (or GDI) process (or more generally, a graphics display interface) 522. TheGDI process 522 uses display information 524 (which may include such display resolution information as pixels per inch on the display) and character information 525 (which may be a character outline information which may be represented as points defining a sequence of contours such as lines and curves, advance width information and left side bearing information) to generate glyphs (or to access cached glyphs which have already been generated). Glyphs may include a bitmap of a scaled character outline (or a bounding box 308 containing black body 307 information), advance width 302 information, and left side bearing 310 information. Each of the bits of the bitmap may have associated red, green and blue luminous intensity values. The graphics displayinterface process 522 is described in more detail in § 1.2.2.2.1.1 below. The graphics displayinterface process 522, thedisplay information 524, and theglyph cache 526 may be a part of, and effected by, an operating system, such as the Windows® CE or Windows NT® operating systems (from Microsoft Corporation of Redmond, Wash.) for example. - Glyphs (also referred to as digital font representations)528′ or 528, either from the
glyph cache 526 or from the graphicsdisplay interface process 522, are then provided to a display driver management process (or more generally, a display driver manager) 535. The displaydriver management process 535 may be a part of a display (or video)driver 530. Typically, adisplay driver 530 may be software which permits a computer operating system to communicate with a particular video display. Basically, the displaydriver management process 535 may invoke a colorpalette selection process 538. Theseprocesses driver management process 535 receives, as input, glyphs anddisplay information 524′. Thedisplay information 524′ may include, for example, foreground/background color information, color palette information and pixel value format information. - The processed pixel values may then be forwarded as video frame part(s)540 along with screen (and perhaps window) positioning information (e.g., from the
application process 510 and/or operating system), to a display (video)adapter 550. Adisplay adapter 550 may include electronic components that generate a video signal sent to thedisplay 560. Aframe buffer process 552 may be used to store the received video frame part(s) in ascreen frame buffer 554 of thedisplay adapter 550. Using thescreen frame buffer 554 allows a single image of, e.g., a text string, to be generated from glyphs representing several different characters. The video frame(s) from thescreen frame buffer 554 is then provided to a display adaptation process 553 which adapts the video for a particular display device. Thedisplay adaptation process 558 may also be effected by thedisplay adapter 550. - Finally, the adapted video is presented to the
display device 560, such as an LCD display for example, for rendering. - Having provided an overview of a text rendering system, the graphics
display interface process 522 is now described in more detail in § 1.2.2.2.1.1 below. The processes which may be performed by the display driver are then described in more detail in § 1.2.2.2.1.2 below. - § 1.2.2.2.1.1 Graphics Display Interface
- FIG. 6 illustrates processes that may be performed by a graphics display interface (or GDI)
process 522, as well as data that may be used by theGDI process 522. As shown in FIG. 6, theGDI process 522 may include a glyph cache management process (or more generally, a glyph cache manager) 610 which accepts text, or more specifically, requests to display text, 512. The request may include the point size of the text. The glyphcache management process 610 forwards this request to theglyph cache 526. If theglyph cache 526 includes the glyph corresponding to the requested text character, it provides it for downstream processing. If, on the other hand, theglyph cache 526 does not have the glyph corresponding to the requested text character, it so informs the glyphcache management process 610 which, in turn, submits a request to generate the needed glyph to the type rasterization process (or more generally, a type rasterizer) 620. Basically, atype rasterization process 620 may be effected by hardware and/or software and converts a character outline (which may, recall, include points which define contours such as lines and curves based on mathematical formulas) into a raster (that is, a bitmapped) image. Each pixel of the bitmap image may have a color value and a brightness for example. A type rasterization process is described in § 1.2.2.2.1.1.1 below. - § 1.2.2.2.1.1.1 Rasterizer
- To reiterate, the
type rasterization process 620 basically transforms character outlines into bitmapped images. The scale of the bitmap may be based on the point size of the font and the resolution (e.g., pixels per inch) of thedisplay device 560. The text, font, and point size information may be obtained from theapplication 510, while the resolution of thedisplay device 560 may be obtained from a system configuration or display driver file or from monitor settings stored in memory by the operating system. Thedisplay information 524 may also include foreground/background color information, gamma values, color palette information and/or display adapter/display device pixel value format information. To reiterate, this information may be provided from thegraphics display interface 522 in response to a request from theapplication process 510. If, however, the background of the text requested is to be transparent (as opposed to Opaque), the background color information is what is being rendered on the display (such as a bitmap image or other text for example) and is provided from thedisplay device 560 or thevideo frame buffer 554. - Basically, the rasterization process may include two (2) or three (3) sub-steps or sub-processes. First, the character outline is scaled using a
scaling process 622. This process is described below. Next, the scaled image generated by thescaling process 622 may be placed on a grid and have portions extended or shrunk using a hintingprocess 626. This process is also described below. Then, anoutline fill process 628 is used to fill the grid-fitted outline to generate a raster bitmap. This process is also described below. - When scaling fonts in conventional systems such as TrueType™ from Microsoft Corporation of Redmond, Wash., the font unit coordinates used to define the position of points defining contours of a character outline were scaled to device specific pixel coordinates. That is, since the resolution of the em square was used to define a character outline, before that character could be displayed, it was scaled to reflect the size, transformation and the characteristics of the output device on which it was to be rendered. Recall that the scaled outline describes the character outline in units that reflect the absolute unit of measurement used to measure pixels of the output device, rather than the relative system of measurement of font units per em. Thus, recall that values in the em square were converted to values in the pixel coordinate system in accordance with the following formula:
- where the character outline size is in font units, and output device resolution is in pixels/inch.
- Recall that the resolution of an output device may be specified by the number of dots or pixels per inch (dpi).
- The purpose of hinting (also referred to as “instructing a glyph”) is to ensure that critical characteristics of the original font design are preserved when the glyph is rendered at different sizes and on different devices. Consistent stem weights, consistent “color” (that is, in this context, the balance of black and white on a page or screen), even spacing, and avoiding pixel dropout are common goals of hinting. In the past, uninstructed, or unhinted, fonts would generally produce good quality results at sufficiently high resolutions and point sizes. However, for many fonts, legibility may become compromised at smaller point sizes on lower resolution displays. For example, at low resolutions, with few pixels available to describe the character shapes, features such as stem weights, crossbar widths and serif details can become irregular, or inconsistent, or even missed completely.
- Basically, hinting may involve “grid placement” and “grid fitting”. Grid placement is used to align a scaled character within a grid, that is used by a subsequent
outline fill process 628, in a manner intended to optimize the accurate display of the character using the available sub-pixel elements. Grid fitting involves distorting character outlines so that the character better conforms to the shape of the grid. Grid fitting ensures that certain features of the glyphs are regularized. Since the outlines are only distorted at a specified number of smaller sizes, the contours of the fonts at high resolutions remain unchanged and undistorted. - In grid placement, sub-pixel element boundaries may be treated as boundaries along which characters can, and should, be aligned or boundaries to which the outline of a character should be adjusted.
- Other known hinting instructions may also be carried out on the scaled character outline.
- In an implementation of anti-aliased text for TrueType™ fonts supported in
Windows NT™ 4, the hintedimage 627 is overscaled four (4) times in both the X and Y directions. The image is then sampled, i.e. for every physical pixel, which is represented by 4-by-4 portion of the grid in an overscaled image, the blend factor alpha is computed for that pixel by simply counting the squares having centers which lie within the glyph outline and dividing the result by 16. As a result, the foreground/background blend factor alpha is expressed as k/16 and is computed for every pixel. This whole process is also called standard anti-aliasing filtering. Unfortunately, however, such standard anti-aliasing tends to blur the image. Similar implementation exists in Windows 95 and Windows 98, and the only difference is that the image is overscaled two (2) times in both X and Y, so that alpha for every pixel is expressed as k/4, where k is a number of squares within the glyph outline. - The
outline fill process 628 basically determines whether the center of each pixel is enclosed within the character outline. If the center of a pixel is enclosed within the character outline, that pixel is turned ON. Otherwise, the pixel is left OFF. The problem of “pixel dropout” may occur whenever a connected region of a glyph interior contains two ON pixels that cannot be connected by a straight line that passes through only those ON pixels. Pixel dropout may be overcome by looking at an imaginary line segment connected two adjacent pixel centers, determining whether the line segment is intersected by both an on-transition contour and off-transition contour, determining whether the two contour lines continue in both directions to cut other line segments between adjacent pixel centers and, if so, turning pixels ON. - The rasterized glyphs are then cached in
glyph cache 526. Caching glyphs is useful. More specifically, since most Latin fonts have only about 200 characters, a reasonably sized cache makes the speed of the rasterizer almost meaningless. This is because the rasterizeer runs once, for example when a new font or point size is selected. Then, the bitmaps are transferred out of theglyph cache 526 as needed. - The
scaling process 622 of the known system just described may introduce certain rounding errors. Constraints are enforced by (i) scaling the size and positioning information included in a character font as a function of the point size and device resolution as just described above, and (ii) then rounding the size and positioning values to integer multiples of the pixel size used in the particular display device. Using pixel size units as the minimum (or “atomic”) distance unit produces what is called “pixel precision” since the values are accurate to the size of one (1) pixel. - Rounding size and positioning values of character fonts to pixel precision introduces changes, or errors, into displayed images. Each of these errors may be up to ½ a pixel in size (assuming that values less than ½ a pixel are rounded down and values greater than or equal to ½ a pixel are rounded up). Thus, the overall width of a character may be less precise than desired since the character's AW is (may be) rounded. In addition, the positioning of a character's black body within the total horizontal space allocated to that character may be sub-optimal since the left side bearing is (may be) rounded. At small point sizes, the changes introduced by rounding using pixel precision can be significant.
- § 1.2.3 Rendering Line Drawings
- As was the case when scaling character outlines, when rendering line drawings, the boundaries between the (black) line portions and the (white) background are typically forced to correspond to pixel boundaries. This may be done by rounding the position values of the (black) line portions to integer multiples of the pixel size used in the particular display device. Referring to FIG. 7, this may be done by a
scaling process 710 which acceptsanalytic image information 702 and generates pixel resolutiondigital image information 728. To reiterate, using pixel size units as the minimum (or “atomic”) positioning unit produces what is called “pixel precision” since the position values are accurate to the size of one (1) pixel. - Rounding position values for line drawings to pixel precision introduces changes, or errors, into displayed images. Each of these errors may be up to ½ a pixel in size (assuming that values less than ½ a pixel are rounded down and values greater than or equal to ½ a pixel are rounded up). Thus, the overall width of a line section may be less precise than desired since the width or weight of the line is (may be) rounded.
- § 1.2.4 Rendering Graphics
- Similar to text and line drawings, certain graphics, represented analytically or by a resolution higher than that of a display device650, may have to be scaled and rounded to correspond to the resolution of the display device 650. Referring to FIG. 7, this may be done by a
scaling process 710 which accepts ultra resolutiondigital image information 704 and generates pixel resolution digital image information. Thus, rounding errors can be introduced here as well. - § 1.2.5 Unmet Needs
- In view of the errors introduced when rounding character values, line drawings, or high resolution or analytic graphics to pixel precision as introduced above, methods and apparatus to improve character spacing and positioning, to increase the legibility and perceived quality of text, to improve the resolution of line drawings, and/or to improve the resolution of images are needed. Such methods and apparatus should not blur the image, as occurs when standard anti-aliasing is used.
- The present invention improves the resolution of images (either analog images, analytic images, or images having a higher resolution than that of a display device) to be rendered on patterned displays. In one aspect of the present invention, an overscaling or oversampling process may accept analytic character information, such as contours for example, and a scale factor or grid and overscale or oversample the analytic character information to produce an overscaled or oversampled image. The overscaled or oversampled image generated has a higher resolution than the display upon which the character is to be rendered. If, for example, the display is a RGB striped LCD monitor, the ultra-resolution image may have a resolution corresponding to the sub-pixel component resolution of the display, or an integer multiple thereof. For example, if a vertically striped RGB LCD monitor is to be used, the
ultra-resolution image 704 may have a pixel resolution in the Y direction and a ⅓ (or ⅓N, where N is an integer) pixel resolution in the X direction. If, on the other hand, a horizontally striped RGB LCD monitor is to be used, the ultra-resolution image may have a pixel resolution in the X direction and a ⅓ (or ⅓N) pixel resolution in the Y direction. Then a process for combining displaced samples of theultra-resolution image 624′ may be used to generate another ultra-resolution image (or an image with sub-pixel information) which is then cached. The cached character information may then be accessed by a compositing process which uses foreground and background color information. - An analytic image, such as a line drawing for example, may be applied to the oversampling/overscaling process as was the case with the character analytic image. However, since the analytic image may have different units than that of the character analytic image, the scale factor applied may be different. In any event, the downstream processes may be similarly applied.
- Since an ultra resolution image is already “digitized”, that is, not merely mathematically expressed contours or lines between points, it may be applied directly to a process for combining displaced samples of the ultra-resolution image to generate another ultra-resolution image (or an image with sub-pixel information). Downstream processing may then be similarly applied.
- In one embodiment of the present invention, the functionality of the overscaling/oversampling process and the processes for combining displaced samples may be combined into a single step analytic to digital sub-pixel resolution conversion process.
- FIGS. 1 and 2 illustrate vertical striping in a conventional RGB LCD display device.
- FIGS. 3 and 4 illustrate certain font technology terms.
- FIG. 5 illustrates processes that may be performed in a font or character rendering system in which the present invention may be implemented.
- FIG. 6 illustrates processes that may be performed in a graphics display interface.
- FIG. 7 illustrates processes that may be performed in a line art or graphics rendering system in which the present invention may be implemented.
- FIG. 8 illustrates processes that may be used to effect various aspects of the present invention.
- FIG. 9 illustrates an overscaling process operating on character outline information.
- FIG. 10 is a block diagram of a computer architecture which may be used to implement various aspects of the present invention.
- FIG. 11 illustrates the operation of an ideal analog to digital sub-pixel conversion method.
- FIG. 12 is a high level flow diagram of that method.
- FIG. 13 illustrates the operation of a disfavored downsampling method.
- FIG. 14 is a high level flow diagram of that method.
- FIG. 15 illustrates the operation of a method for deriving sub-pixel element information from color scan lines.
- FIG. 16 is a high level flow diagram of that method.
- FIG. 17 illustrates the operation of an alternative method for deriving sub-pixel element information from color scan lines.
- FIG. 18 is a high level flow diagram of that method.
- FIG. 19 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient information, as well as foreground and background color information.
- FIG. 20 is a high level flow diagram of that method.
- FIG. 21 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information.
- FIG. 22 is a high level flow diagram of that method.
- FIG. 23 illustrates the operation of an alternative method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information.
- FIG. 24 is a high level flow diagram of that method.
- FIG. 25 illustrates the operation of a method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information, where the foreground and/or background color information may vary based on the position of a pixel within the image.
- FIG. 26 is a high level flow diagram of that method.
- FIG. 27 illustrates the operation of an alternative method for deriving sub-pixel element information from blend coefficient samples, as well as foreground and background color information, where the foreground and/or background color information may vary based on the position of a pixel within the image.
- FIG. 28 is a high level flow diagram of that method.
- FIG. 29 is a high level block diagram of a machine which may be used to implement various aspects of the present invention.
- FIG. 30 illustrates samples derived from a portion of an overscaled character outline.
- FIG. 31 illustrates the operations of alternative sample combination techniques.
- The present invention concerns novel methods, apparatus and data structures for rendering text, line art and graphics on displays having sub-pixel components. The following description is presented to enable one skilled in the art to make and use the invention, and is provided in the context of particular applications and their requirements. Various modifications to the disclosed embodiments will be apparent to those skilled in the art, and the general principles set forth below may be applied to other embodiments and applications. Thus, the present invention is not intended to be limited to the embodiments shown.
- Functions which may be performed by the present invention are introduced in § 4.1 below. Then, exemplary environments in which the present invention may operate are then described in § 4.2 below. Thereafter, exemplary embodiments, methods, and data structures which may be used to effect various aspects of the present invention are described in § 4.3 below. Finally, conclusions about the present invention are presented in § 4.4 below.
- § 4.1 Functions Which May Be Performed
- FIG. 8 is a high level diagram of processes that may be performed to effect various aspects of the present invention, as well as data accepted by or generated by such processes. As shown, the processes may act on an
analytic image 512/525, such as contours, foreground and background colors of a character; ananalytic image information 702′, such as lines, points, contours, foreground and background colors of line art; or animage 704′ having a higher resolution than that of the display 560 (also referred to as an “ultra-resolution image”). Processes associated with rendering acharacter image 512/525 are addressed in § 4.1.1 below. Processes associated with rendering a non-characteranalytic image 702′ are addressed in § 4.1.2 below. Processes associated with rendering anultra-resolution image 704′ are addressed in § 4.1.3 below. - § 4.1.1 Processes Associated With Rendering Character Images
- An overscaling or
oversampling process 622′/710′ may accept analytic character information, such as contours for example, and a scale factor orgrid 820 and overscale and/or oversample the analytic character information. In this context, given an analytic character outline arranged on a grid defined by a coordinate system, overscaling means stretching the analytic character outline while leaving the coordinate system unchanged, while oversampling means compressing the grid defined by the coordinate system while leaving the analytic character outline unchanged. In the first case, in which the analytic character outline is overscaled, an overscaledanalytic image 805 is generated. The overscaledanalytic image 805 may then be sampled bysampling process 806 to generate ultra-resolutiondigital image information 810. In the second case, in which the analytic character outline (which may have been overscaled) is oversampled, the ultra-resolutiondigital image information 810 is generated directly. Theultra-resolution image 810 has a higher resolution than thedisplay 560 upon which the character is to be rendered. In one example, if the display is a RGB striped LCD monitor for example, the ultra-resolution image may have a resolution corresponding to the sub-pixel component resolution of the display, or an integer multiple thereof. For example, if a vertically striped RGB LCD monitor is to be used, theultra-resolution image 810 may have a pixel resolution in the Y direction and a ⅓ (or {fraction (1/3)}N, where N is an integer) pixel resolution in the X direction. If, on the other hand, a horizontally striped RGB LCD monitor is to be used, theultra-resolution image 810 may have a pixel resolution in the X direction and a ⅓ (or ⅓N) pixel resolution in the Y direction. - The optional hinting
process 626′ may apply hinting instructions to the overscaledanalytic image 805. In one embodiment, the overscaling and/oroversampling process 622′/710′ overscales the analytic image 515/525 by a factor of an arbitrarily large number N (e.g., N=sixteen (16)) in the X direction and does not scale the analytic image 515/525 in the Y direction. By doing this, in many cases, the hinting instructions of the optional hintingprocess 626′ will not cause problems in the X direction, which might otherwise occur. In this embodiment, the downscalingprocess 807 scales the hinted image by Z/N, where Z is the number of samples per pixel element desired (e.g., Z/N={fraction (6/16)}). The resulting scaledanalytic image 808 may then be sampled by thesampling process 806 to generate theultra-resolution image 810. Consequently, the resulting ultra-resolutiondigital image information 810 is overscaled by Z (e.g., six (6)) in the X direction. Naturally, in alternative embodiments, the scaledanalytic image 805 may be directly sampled by thesampling process 806 to generate anultra-resolution image 810. - FIG. 9 illustrates an example of the operation of an exemplary overscaling/
oversampling process 622′/710′ used in the case of a vertically striped LCD monitor. First, font vector graphics (e.g., the character outline), point size and display resolution are accepted. This information is denoted 512/525/910 in FIG. 9. The font vector graphics (e.g., the character outline) 512/525/910 is rasterized based on the point size, display resolution and the overscale factors (or oversample rate). As shown in the example of FIG. 9, the Y coordinate values of the character outline (in units of font units) are scaled as shown in 920 and rounded to the nearest integer pixel value. On the other hand, the X coordinate values of the character outline (in units of font units) are overscaled as shown in 930 and rounded to the nearest integer scan conversion source sample (e.g., pixel sub-component) value. The resultingdata 940 is the character outline in units of pixels in the Y direction and units of scan conversion source samples (e.g., pixel sub-components) in the X direction. - Then, referring back to FIG. 8, a
process 830 for combining displaced (e.g., adjacent, spaced, or overlapping) samples of theultra-resolution image 624′ can be used to generate another ultra-resolution image 840 (or an image with sub-pixel information) which may then be cached intocache storage 880 by theoptional caching process 870. Each sample of theultra-resolution image 840 may be based on the same number or differing numbers of samples from theultra-resolution image 810. Thecached character information 870 may then be accessed by acompositing process 850 which uses the foreground andbackground color information 524′. - § 4.1.2 Processes Associated with Processing Non-character Analytic Images
- The
analytic image 702′, such as a line drawing for example, may be applied to the oversampling/overscaling process 622′/710′ as was the case with the characteranalytic image 512/525. However, since theanalytic image 702′ may have different units than that of the characteranalytic image 512/525, thescale factor 820 applied may be different. In any event, the downstream processes may be similarly applied. - § 4.1.3 Processes Associated with Processing Ultra-resolution Images
- Since an
ultra resolution image 704′ is already “digitized”, that is, not merely mathematically expressed contours or lines between points, it may be applied directly to theprocess 830 for combining displaced samples of theultra-resolution image 810 to generate another ultra-resolution image 840 (or an image with sub-pixel information). Downstream processing may then be similarly applied. - § 4.1.4 Alternative Processing of Analytic Images
- As shown, the functionality of the overscaling/
oversampling process 622′/710′ and theprocesses 830 for combining displaced samples may be combined into a single step analytic to digital sub-pixelresolution conversion process 860. - Having introduced processes which may perform functions related to various aspects of the present invention, exemplary apparatus, methods and data structures which may be used to effect these processes are described in § 4.3 below. First, however, an exemplary environment in which the present invention may operate is introduced in § 4.2 below.
- § 4.2 Exemplary Environments in which the Invention May Operate
- As alluded to above, the present invention may be used in the context of increasing the resolution of text to be rendered on a display, an analytic image, such as line art for example, to be rendered on a display, or ultra-resolution graphics to be rendered on a display.
- The techniques of the present invention may be applied to a known character rendering system such as that illustrated in FIG. 6 and described in § 1.2.2.2.1 above. The graphics display
interface 522 would be modified. More specifically, thescaling process 622 and theoutline fill process 628 would be replaced with the overscaling/oversampling process 622′/710′, the downscalingprocess 807, thesampling process 806, and theprocess 830 for combining displaced samples of the present invention, or alternatively, replaced with the analog to digitalsub-pixel conversion process 860 of the present invention. The techniques of the present invention may be similarly applied to a known analytic image rendering system. In some embodiments of the present invention, intermediate results, such as the results generated from a first filtering act of a two-part filtering technique, may be generated. The second filtering act of the two-part filtering technique may then be performed on such intermediate results. The final result of the second filtering act may then be cached. In such embodiments, the first filtering act of the two-part filtering technique may be performed by a font driver, while the second filtering act of the two-part filtering technique may then be performed by the graphics display interface (or “GDI”) of the operating system. - Finally, techniques of the present invention may be applied to a known graphics rendered system such as that illustrated in FIG. 7 and described in §§ 1.2.3 and 1.2.4 above. The
scaling process 710 would be replaced with ascaling process 622′/710′ and aprocess 830 for combining displaced samples, or just aprocess 830 for combining displaced samples. - § 4.3 Exemplary Embodiments, Methods, and Data Structures
- Exemplary apparatus in which at least some aspects of the present invention may be implemented are disclosed in § 4.3.1 below. Then, exemplary methods for effecting processes of the present invention are disclosed in § 4.3.2.
- § 4.3.1 Exemplary Apparatus
- FIGS. 10 and 29 and the following discussion provide a brief, general description of an exemplary apparatus in which at least some aspects of the present invention may be implemented. Various methods of the present invention will be described in the general context of computer-executable instructions, such as program modules and/or routines for example, being executed by a computing device such as a personal computer. Other aspects of the invention will be described in terms of physical hardware such as display device components and display screens for example.
- Naturally, the methods of the present invention may be effected by apparatus other than those described. Program modules may include routines, programs, objects, components, data structures (e.g., look-up tables, etc.) that perform task(s) or implement particular abstract data types. Moreover, those skilled in the art will appreciate that at least some aspects of the present invention may be practiced with other configurations, including hand held devices, multiprocessor systems, microprocessor-based or programmable consumer electronics, network computers, minicomputers, set top boxes, mainframe computers, displays used in, e.g., automotive, aeronautical, industrial applications, and the like. At least some aspects of the present invention may also be practiced in distributed computing environments where tasks are performed by remote processing devices linked through a communications network. In a distributed computing environment, program modules may be located in local and/or remote memory storage devices.
- FIG. 10 is a block diagram of an
exemplary apparatus 1000 which may be used to implement at least some aspects of the present invention. Apersonal computer 1020 may include aprocessing unit 1021, asystem memory 1022, and asystem bus 1023 that couples various system components including thesystem memory 1022 to theprocessing unit 1021. Thesystem bus 1023 may be any of several types of bus structures including a memory bus or memory controller, a peripheral bus, and a local bus using any of a variety of bus architectures. Thesystem 1022 memory may include read only memory (ROM) 1024 and/or random access memory (RAM) 1025. A basic input/output system 1026 (BIOS), including basic routines that help to transfer information between elements within thepersonal computer 1020, such as during start-up, may be stored inROM 1024. Thepersonal computer 1020 may also include ahard disk drive 1027 for reading from and writing to a hard disk, (not shown), amagnetic disk drive 1028 for reading from or writing to a (e.g., removable)magnetic disk 1029, and anoptical disk drive 1030 for reading from or writing to a removable (magneto)optical disk 1031 such as a compact disk or other (magneto) optical media. Thehard disk drive 1027,magnetic disk drive 1028, and (magneto)optical disk drive 1030 may be coupled with thesystem bus 1023 by a harddisk drive interface 1032, a magneticdisk drive interface 1033, and a (magneto)optical drive interface 1034, respectively. The drives and their associated storage media provide nonvolatile storage of machine readable instructions, data structures, program modules and other data for thepersonal computer 1020. Although the exemplary environment described herein employs a hard disk, a removablemagnetic disk 1029 and a removableoptical disk 1031, those skilled in the art will appreciate that other types of storage media, such as magnetic cassettes, flash memory cards, digital video disks, Bernoulli cartridges, random access memories (RAMs), read only memories (ROM), and the like, may be used instead of, or in addition to, the storage devices introduced above. - A number of program modules may be stored on the
hard disk 1023,magnetic disk 1029, (magneto)optical disk 1031,ROM 1024 orRAM 1025, such as anoperating system 1035, one ormore application programs 1036,other program modules 1037,display driver 530/1032, and/orprogram data 1038 for example. TheRAM 1025 can also be used for storing data used in rendering images for display as will be discussed below. A user may enter commands and information into thepersonal computer 1020 through input devices, such as akeyboard 1040 andpointing device 1042 for example. Other input devices (not shown) such as a microphone, joystick, game pad, satellite dish, scanner, or the like may also be included. These and other input devices are often connected to theprocessing unit 1021 through aserial port interface 1046 coupled to the system bus. However, input devices may be connected by other interfaces, such as a parallel port, a game port or a universal serial bus (USB). Amonitor 560/1047 or other type of display device may also be connected to thesystem bus 1023 via an interface, such as adisplay adapter 550/1048, for example. In addition to themonitor 560/1047, thepersonal computer 1020 may include other peripheral output devices (not shown), such as speakers and printers for example. - The
personal computer 1020 may operate in a networked environment which defines logical connections to one or more remote computers, such as aremote computer 1049. Theremote computer 1049 may be another personal computer, a server, a router, a network PC, a peer device or other common network node, and may include many or all of the elements described above relative to thepersonal computer 1020. The logical connections depicted in FIG. 10A include a local area network (LAN) 1051 and a wide area network (WAN) 1052 (such as an intranet and the Internet for example). - When used in a LAN, the
personal computer 1020 may be connected to theLAN 1051 through a network interface adapter card (or “NIC”) 1053. When used in a WAN, such as the Internet, thepersonal computer 1020 may include amodem 1054 or other means for establishing communications over thewide area network 1052. Themodem 1054, which may be internal or external, may be connected to thesystem bus 1023 via theserial port interface 1046. In a networked environment, at least some of the program modules depicted relative to thepersonal computer 1020 may be stored in the remote memory storage device. The network connections shown are exemplary and other means of establishing a communications link between the computers may be used. - FIG. 29 is a more
general machine 2900 which may effect at least some aspects of the present invention. Themachine 2900 basically includes a processor(s) 2902, an input/output interface unit(s) 2904, a storage device(s) 2906, and a system bus ornetwork 2908 for facilitating data and control communications among the coupled elements. The processor(s) 2902 may execute machine-executable instructions to effect one or more aspects of the present invention. At least a portion of the machine executable instructions and data structures may be stored (temporarily or more permanently) on thestorage devices 2906 and/or may be received from an external source via aninput interface unit 2904. - Having described exemplary apparatus which may be used to effect at least some aspects of the present invention, exemplary methods for effecting at least some of the processes discussed in § 4.1 above are described.
- § 4.3.2 Exemplary Methods
- In each of the following exemplary methods, a one-part filtering act or a two-part filtering act is referenced. An example of applying a one-part filter and a two-part filter are described in § 4.3.3 below with reference to FIGS. 30 and 31. First, however, the exemplary methods are described below.
- FIG. 11 illustrates an operation of an exemplary
resolution enhancement method 1200 which may be used to effect the analytic to digitalsub-pixel conversion process 860. FIG. 12 is a flow diagram of thismethod 1200. Referring to both FIGS. 11 and 12, continuous one dimensional RGB functions (or functions of other color spaces) 1110 are accepted inact 1210. Each one of thecolor component inputs 1110 are then sampled (or filtered) as shown inact 1220. As shown by the brackets 1120 of FIG. 11, these filters 1120 may be a three-emitter (where an “emitter” is a sub-pixel component) wide box filter. Notice that the filters 1120 are spatially displaced from one another. The spatially displaced filters may be spaced, immediately adjacent, or partially overlapping. The output of each of the filters 1120 is a color value 1130 of an emitter. These values 1130 may be gamma corrected (or adjusted) based on a gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 1230. Themethod 1200 is then left viaRETURN node 1240. - The
method 1200 is ideal in that there are no extra aliasing artifacts introduced. However, to effect the filters 1120, an integral over acontinuous function 1110 is evaluated. This integration is possible when theinput image 1110 is described analytically, but this is not always the case. - FIG. 13 illustrates an operation of a disfavored exemplary
resolution enhancement method 1400. FIG. 14 is a flow diagram of thismethod 1400. Referring to both FIGS. 13 and 14, a luminance image (Y) 1310 is sampled three (3) times per output pixel (which works out to once per sub-pixel component in a striped RGB monitor) as shown inact 1410. This sampling generates threeluminance Y samples 1320 per pixel. Then, three adjacent samples are box filtered, that is averaged together (Note filters 1330 of FIG. 13.), to generate red, green and blue sub-pixel component values 1340, as shown inact 1420. Themethod 1400 is then left viaRETURN node 1430. - Unfortunately, since this
method 1400 only samples three (3) times per pixel, it produces aliasing artifacts. More specifically, sampling at a particular frequency “folds” frequencies above the Nyquist rate down to frequencies below the Nyquist rate. In thismethod 1400, frequencies above 3/2 cycles per pixel are folded down to frequencies below that rate. In particular, sampling three (3) times per output pixel causes input frequencies of two (2) cycles per pixel to be aliased down to one (1) cycle per pixel which causes unwanted color fringing. Also, themethod 1400 does not generalize correctly to full color images since it operates on luminance (Y) only. Further, device response (e.g., gamma) correction is not effected. - FIG. 15 illustrates an operation of an exemplary
resolution enhancement method 1600. Thismethod 1600 may be used to effect theprocess 830 for combining displaced samples. FIG. 16 is a flow diagram of thismethod 1600. Referring to both FIGS. 15 and 16, the following loop of acts is performed for each color scan line 1510 as defined by 1610 and 1660. First, discrete values of the color scan line 1510 are accepted as shown inact 1620. The scanline 1510 of the associated color being processed comprises N samples per emitter (which may be 3N per pixel in an RGB striped monitor). As shown in FIG. 15, the scan lines 1510 contain N=2 samples per emitter. Then, the samples 1515 are filtered (e.g., averaged) to generate new samples of a three (3) times oversampled color scan line 1520 as shown inact 1640. Then, as shown inact 1650, the new samples 1520 are filtered again, for example with box filters shown asbrackets 1525, to generatecolor values 1530 associated with sub-pixel components. In the illustrated embodiment, the filters (e.g., box filters) 1525 are centered at locations that correspond to the centers of the sub-pixel elements. Thus, notice that thefilters 1525 are offset, and consequently operate at distinct positions within the image, for each of the color components as shown. The offset of thefilters 1525 such that they operate at distinct positions within the image distinguishes the present invention over standard anti-aliasing techniques. Each of thefilters 1525 may also have distinct filter weighting coefficients, which further distinguishes the present invention over standard anti-aliasing techniques. These acts are repeated if there are any further colors to be processed as shown by loop 1610-1660. Once all of the colors are processed, the filter output may be gamma corrected (or adjusted) based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 1670. Theprocess 1600 is left viaRETURN node 1680. - As shown in FIG. 15, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 1600 of FIG. 16. - The number of samples per emitter N may be two (2). This minimizes extra aliasing artifacts. As N increases, the computational load for filtering increases. For N=2, frequencies that are five (5) cycles per pixel get aliased into one (1) cycle per pixel. However, the frequency spectrum of edges tend to go as 1/f, so that using N=2 sampling should yield about 2.5 times less color fringing due to aliasing than N=1. Setting the samples per emitter N to be greater than two (2) yields even less aliasing, but, as stated above, adds computational complexity. Further, the output of the N=2 filters require less precision to store exactly, and therefore consume less memory and may be faster due to decreased memory bandwidth requirements. For example, for a patterned display device have three color emitters per pixel, if N≧3, more than one byte per pixel may be needed to store the character information.
- FIG. 17 illustrates an operation of an exemplary
resolution enhancement method 1800. Thismethod 1800 may be used to effect theprocess 830 for combining displaced samples. FIG. 18 is a flow diagram of thismethod 1800. Themethod 1800 of FIG. 18 is similar to thatmethod 1600 of FIG. 16. However, the per-emitter pre-filtering (1640) and the filtering (1650) are combined into one filter. This is possible since both operations are linear. - Referring now to both FIGS. 17 and 18, the following loop of acts is performed for each color scan line1710 as defined by
acts act 1820. The scan line 1710 of the associated color being processed is then filtered, in one step, to generate a color scan line as shown inact 1830. As shown, a filter (e.g., a box filter) 1720 may be applied to a six-times oversampled (N=2) scanline for each color. Thefilter 1720 may be centered at the sub-pixel element location. Thus, notice that thefilters 1720 are offset, and consequently operate at distinct positions within the image, for each of the color components as shown. The offset of thefilters 1720 such that they operate at distinct positions within the image distinguishes the present invention over standard anti-aliasing techniques. Naturally, other filters can be used and other values of N can be used. These acts are repeated if there are any further colors to be processed as shown by loop 1810-1840. Once all of the colors are processed, the filter output may be gamma corrected (or adjusted) based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 1850. Theprocess 1800 is then left viaRETURN node 1860. - As shown in FIG. 17, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 1800 of FIG. 18. - The
methods - L[fα(x)+b(1−α(x))] (2)
- Since L is linear, equation (2) may be expressed as:
- fL[α(x)]+b(1−L[α(x)]) (3)
- As these expressions show, only alpha need be filtered. The results of the filtering can then be used as new blending coefficients between the foreground color and the background color. The following methods exploit this observation.
- FIG. 19 illustrates an operation of an exemplary
resolution enhancement method 2000. Themethod 2000 may be used to effect theprocess 830 for combining displaced samples. FIG. 20 is a flow diagram of thismethod 2000. Referring to both FIGS. 19 and 20, an analytic blending coefficient (alpha) 1910 is filtered, using displaced filters (See, e.g., three times oversampling filters 1920.), to generate oversampledblend coefficient values 1930 as shown inact 2010. Then, as shown by loop 2020-2040, for each color,color samples 1940 are determined based on the foreground 1932, the background 1934, and theblend coefficient samples 1930. Theoutput 1940 may then be gamma corrected (or adjusted) 1950 based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 2050. Although not shown in FIG. 19, an inverse display response (e.g., gamma) correction may be performed on the foreground 1932 and background 1934 colors before the blend operation. Themethod 2000 is then left viaRETURN node 2060. As can be seen from FIG. 19, in one embodiment, there are three (3)alpha oversamples 1930 per pixel, one (1) per sub-pixel component. - As shown in FIG. 19, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 2000 of FIG. 20. - FIG. 21 illustrates an operation of an exemplary
resolution enhancement method 2200. FIG. 22 is a flow diagram of thismethod 2200. Themethod 2200 may be used to effect theprocess 830 for combining displaced samples. This method is somewhat of a hybrid between themethod 1600 of FIG. 16 and themethod 2000 of FIG. 20. Referring to both FIGS. 21 and 22, oversampled blending coefficient (alpha)samples 2110 are accepted as shown inact 2210. These oversampled samples are then filtered (e.g., averaged) (Seebracket 2115.) to generate a new set of blend coefficients (alphas) 2120 as shown inact 2220. Then, as shown inact 2230, the new set of blend coefficients (alphas) 2120 are filtered again (See, e.g., thefilters 2125.) to generate a final set of blend coefficients (alphas) 2130. The final set of blend coefficients (alsphs) 2130 may be cached. The process then continues as did theprocess 2000. More specifically, as shown by loop 2240-2250, for each color,color samples 2140 are determined based on the foreground 2132, the background 2134, and the final set ofblend coefficient samples 2130. Theoutput 2140 may then be gamma corrected (or adjusted) 2150 based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 2270. Although not shown in FIG. 21, an inverse display response (e.g., gamma) correction may be performed on the foreground 2132 and background 2134 colors before the blend operation. Themethod 2200 is then left viaRETURN node 2280. As can be seen from FIG. 21, in one embodiment, there are three (3)alpha oversamples 2130 per pixel, one (1) per sub-pixel component. - As shown in FIG. 21, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 2200 of FIG. 22. - Notice from FIG. 21 that the first filtering (e.g., averaging)
act 2220 and thesecond filtering act 2230 of themethod 2200 effectively generate one (1) final blend coefficient (alpha)sample 2130 from six (6) oversampled blend coefficient (alpha)samples 2110. Themethod 2400 of FIG. 24 combines these two filtering operations into a single filtering operation. FIG. 23 illustrates an exemplary operation of themethod 2400 of FIG. 24. Themethod 2400 may be used to effect theprocess 830 for combining displaced samples. Referring to both FIGS. 23 and 24, oversampled blending coefficient (alpha)samples 2110 are accepted as shown inact 2410. These oversampled samples are then filtered (See, e.g., thefilters 2320.) to generate a final set of blend coefficients (alphas) 2330 as shown inact 2420. The process then continues as did theprocess 2200. More specifically, as shown by loop 2430-2450, for each color,color samples 2340 are determined based on the foreground 2132, the background 2134, and the final set ofblend coefficient samples 2330. Theoutput 2340 may then be gamma corrected (or adjusted) 2150 based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 2460. Although not shown in FIG. 23, an inverse display response (e.g., gamma) correction may be performed on the foreground 2132 and background 2134 colors before the blend operation. Themethod 2400 is then left viaRETURN node 2470. As can be seen from FIG. 23, in one embodiment, there are three (3)alpha oversamples 2330 per pixel, one (1) per sub-pixel component. - As shown in FIG. 23, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 2400 of FIG. 24. - In the
methods 2200 of FIG. 22 and 2400 of FIG. 24, it was assumed that the blend coefficient (alpha) would be applied to aconstant foreground color constant background color - The
method 2600 of FIG. 26 is similar to themethod 2200 of FIG. 22, but permits the foreground and/or background colors to change with position. Themethod 2600 may be used to effect theprocess 830 for combining displaced samples. FIG. 25 illustrates an example of the operation of themethod 2600 of FIG. 26. Referring to both FIGS. 25 and 26, oversampled blending coefficient (alpha)samples 2110 are accepted as shown inact 2610. These oversampled samples are then filtered (e.g., averaged) (Seebracket 2115.) to generate a new set of blend coefficients (alphas) 2120 as shown inact 2620. Then, as shown inact 2630, the new set of blend coefficients (alphas) 2120 are filtered (See, e.g., thefilters 2125.) to generate a final set of blend coefficients (alphas) 2130. This final set of blend coefficients (alphas) 2130 may then be cached. As shown by nested loops 2640-2680 and 2650-2670, for each position and for each color (which may vary with position),color values 2540 associated with sub-pixel components are determined based on the foreground 2132 at the position, the background 2134 at the position, and the final set ofblend coefficient samples 2130. In an alternative embodiment, these loops can be re-ordered such that a position loop is nested within a color loop. Theoutput 2540 may then be gamma corrected (or adjusted) 2550 based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 2690. Although not shown in FIG. 25, an inverse display response (e.g., gamma) correction may be performed on the foreground 2532 and background 2534 colors before the blend operation. Themethod 2600 is then left viaRETURN node 2695. As can be seen from FIG. 25, in one embodiment, there are three (3)alpha oversamples 2130 per pixel, one (1) per sub-pixel component. - As shown in FIG. 25, the separate colors, as well as the separate foreground and background colors at separate positions, may be processed in parallel rather than in a sequence of loops as depicted in the
method 2600 of FIG. 26. - The
method 2800 of FIG. 28 is similar to themethod 2400 of FIG. 24, but permits the foreground and/or background colors to change with position. Further, themethod 2800 of FIG. 28 is similar to themethod 2600 of FIG. 26 but combines the separate acts offiltering method 2800 may be used to effect theprocess 830 for combining displaced samples. FIG. 27 illustrates an example of the operation of themethod 2800 of FIG. 28. Referring to both FIGS. 27 and 28, oversampled blending coefficient (alpha)samples 2110 are accepted as shown inact 2810. These oversampled samples are then filtered (See, e.g., thefilters 2320.) to generate a final set of blend coefficients (alphas) 2330 as shown inact 2820. Themethod 2800 then continues as did themethod 2600. More specifically, as shown by nested loops 2830-2870 and 2840-2860, for each position and for each color (which may vary with position),color samples 2740 are determined based on the foreground 2732 at the position, the background 2734 at the position, and the final set ofblend coefficient samples 2330. In an alternative embodiment, these loops can be reordered such that a position loop is nested within a color loop. Theoutput 2740 may then be gamma corrected (or adjusted) 2750 based on the gamma (or other) response of thedisplay 560 on which the image is to be rendered as shown inact 2880. Although not shown in FIG. 27, an inverse display response (e.g., gamma) correction may be performed on the foreground 2732 and background 2734 colors before the blend operation. Themethod 2800 is then left viaRETURN node 2890. As can be seen from FIG. 27, in one embodiment, there are three (3)alpha oversamples 2130 per pixel, one (1) per sub-pixel component. - As shown in FIG. 27, the separate colors may be processed in parallel rather than in a sequence of loops as depicted in the
method 2800 of FIG. 28. - § 4.3.3 Exemplary Filtering Methods
- FIG. 30 illustrates a
scan line 3010 from a portion of anoverscaled character 940′ (Recall, FIG. 9 in which the letter Q was overscaled in the horizontal direction.). In this example, each sample of thescan line 3010 has a value of “0” if its center is outside of thecharacter outline 940′ and a value of “1” if its center is within thecharacter outline 940′. Other ways of determining the value ofscanline 3010 samples may be used instead. For example, a sample of thescanline 3010 may have a value of “1” if it is more than a predetermined percentage (e.g., 50%) within thecharacter outline 940′, and a value of “0” if it is less than or equal to the predetermined percentage within thecharacter outline 940′. These “samples” may correspond to alpha values, or color component values. - FIG. 31 illustrates exemplary one-part and two-part filtering techniques which may be used to filter samples of a
scanline 3010. The exemplary one-part filtering technique is illustrated below thescanline 3010 and the exemplary two-part filtering technique is illustrated above thescanline 3010. - In the exemplary one-part filtering technique illustrated below the
scanline 3010, notice that filters, depicted asbrackets 3110, operate on six (6) samples of thescanline 3010 and are offset by two (2) samples. The sums of the samples of thescanline 3010 within thefilters 3110 are shown inline 3120. In this example, it is assumed that thescanline 3010 is derived from acharacter outline 940′ overscaled six (6) times in the horizontal (or X) direction. For example, the display on which the character is to be rendered may include three (3) sub-pixel elements per pixel, and the overscaling factor may be 3N, where N=2. The two (2) sample offset between each of thefilters 3110 may correspond to the N=2 component of the overscaling factor. - In the exemplary two-part filtering technique illustrated above the
scanline 3010, notice that each filter of the first set of filters, depicted asbrackets 3130, operate on two (2) samples of thescanline 3010 and are offset by two (2) samples. The averages of the samples of thescanline 3010 within thefilters 3130 are shown in line 3140. Notice further that each filter of the second set of filters, depicted asbrackets 3150, operate on three (3) results 3140 generated from the first set offilters 3130 and are offset by one (1) result 3140 (which corresponds to two (2) samples of the scanline 3010). The average of the results 3140 within eachfilter 3150 of the second set of filters is determined as shown byline 3160. Recall that in this example, it is assumed that thescanline 3010 is derived from acharacter outline 940′ overscaled six (6) times in the horizontal (or X) direction. For example, the display on which the character is to be rendered may include three (3) sub-pixel elements per pixel, and the overscaling factor may be 3N, where N=2. - Although the exemplary filters were described as performing averaging or summing operations, other type of filters may be used. For example, a filter that weights certain samples more than others may be used.
- § 4.4 Conclusions
- As can be appreciated from the foregoing description, the present invention can be used to improve the resolution of analytic image information, such as character information and line art for example, to be rendered on a patterned display device. Further, the present invention can be used to improved the resolution of ultra resolution image information, such as graphics for example, to be rendered on a patterned display device.
Claims (39)
Priority Applications (15)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US09/364,365 US6393145B2 (en) | 1999-01-12 | 1999-07-30 | Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices |
AT00909900T ATE408215T1 (en) | 1999-01-12 | 2000-01-12 | METHOD AND APPARATUS FOR IMPROVING THE RESOLUTION OF IMAGES DISPLAYED ON STRUCTURED DISPLAY DEVICES |
PCT/US2000/000804 WO2000042762A2 (en) | 1999-01-12 | 2000-01-12 | Methods, apparatus and data structures for enhancing resolution images to be rendered on patterned display devices |
DE60040209T DE60040209D1 (en) | 1999-01-12 | 2000-01-12 | METHOD AND DEVICE FOR IMPROVING THE RESOLUTION OF IMAGES SUBJECT TO STRUCTURED DISPLAY DEVICES |
AU25048/00A AU2504800A (en) | 1999-01-12 | 2000-01-12 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
JP2000594071A JP4820004B2 (en) | 1999-01-12 | 2000-01-12 | Method and system for filtering image data to obtain samples mapped to pixel subcomponents of a display device |
AU32083/00A AU3208300A (en) | 1999-01-12 | 2000-01-12 | Methods, apparatus and data structures for enhancing the resolution of images tobe rendered on patterned display devices |
DE60040063T DE60040063D1 (en) | 1999-01-12 | 2000-01-12 | FILTRATION OF IMAGE DATA FOR GENERATING PATTERNS SHOWN ON PICTURE COMPONENTS OF A DISPLAY DEVICE |
EP00903277A EP1161739B1 (en) | 1999-01-12 | 2000-01-12 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
US09/481,163 US6973210B1 (en) | 1999-01-12 | 2000-01-12 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
EP00909900A EP1157538B1 (en) | 1999-01-12 | 2000-01-12 | Methods and apparatus for enhancing the resolution of images to be rendered on patterned display devices |
PCT/US2000/000847 WO2000042564A2 (en) | 1999-01-12 | 2000-01-12 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
AT00903277T ATE406647T1 (en) | 1999-01-12 | 2000-01-12 | FILTERING OF IMAGE DATA FOR GENERATING PATTERNS IMAGED ON PICTURE DOT COMPONENTS OF A DISPLAY DEVICE |
JP2000594248A JP4667604B2 (en) | 1999-01-12 | 2000-01-12 | Method, apparatus and data structure for increasing the resolution of an image rendered on a patterned display device |
US11/166,658 US7085412B2 (en) | 1999-01-12 | 2005-06-24 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11557299P | 1999-01-12 | 1999-01-12 | |
US09/364,365 US6393145B2 (en) | 1999-01-12 | 1999-07-30 | Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/481,163 Continuation-In-Part US6973210B1 (en) | 1999-01-12 | 2000-01-12 | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
Publications (2)
Publication Number | Publication Date |
---|---|
US20010048764A1 true US20010048764A1 (en) | 2001-12-06 |
US6393145B2 US6393145B2 (en) | 2002-05-21 |
Family
ID=26813345
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US09/364,365 Expired - Lifetime US6393145B2 (en) | 1999-01-12 | 1999-07-30 | Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices |
Country Status (7)
Country | Link |
---|---|
US (1) | US6393145B2 (en) |
EP (1) | EP1157538B1 (en) |
JP (1) | JP4667604B2 (en) |
AT (1) | ATE408215T1 (en) |
AU (1) | AU3208300A (en) |
DE (1) | DE60040209D1 (en) |
WO (1) | WO2000042762A2 (en) |
Cited By (69)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20020062324A1 (en) * | 2000-09-25 | 2002-05-23 | Mccully Nathaniel M. | Setting text composition spacing amount |
US20020085006A1 (en) * | 2000-09-25 | 2002-07-04 | Shade Marilyn E. | Composite font editing device and computer program |
US20030063317A1 (en) * | 2001-09-28 | 2003-04-03 | Mccully Nathaniel | Line leading from an arbitrary point |
US20030095135A1 (en) * | 2001-05-02 | 2003-05-22 | Kaasila Sampo J. | Methods, systems, and programming for computer display of images, text, and/or digital content |
US20030151607A1 (en) * | 2000-02-12 | 2003-08-14 | Mccully Nathaniel M. | Method for calculating CJK emboxes in fonts |
US20030229856A1 (en) * | 2000-02-12 | 2003-12-11 | Lynn Heath A. | Text grid creation tools |
EP1424675A2 (en) * | 2002-11-27 | 2004-06-02 | Matsushita Electric Industrial Co., Ltd. | Display apparatus, method and program with selective image smoothing based on subpixel colour values |
US20040104917A1 (en) * | 2002-12-03 | 2004-06-03 | Platt John C. | Alpha correction to compensate for lack of gamma correction |
US20040125107A1 (en) * | 2002-12-26 | 2004-07-01 | Mccully Nathaniel M. | Coordinating grid tracking and mojikumi spacing of Japanese text |
US20040125108A1 (en) * | 2002-12-26 | 2004-07-01 | Mccully Nathaniel M. | Coordinating grid tracking and mojikumi spacing of Japanese text |
US20040212620A1 (en) * | 1999-08-19 | 2004-10-28 | Adobe Systems Incorporated, A Corporation | Device dependent rendering |
US20040227771A1 (en) * | 2003-05-16 | 2004-11-18 | Arnold R. David | Dynamic selection of anti-aliasing procedures |
US20040227770A1 (en) * | 2003-05-16 | 2004-11-18 | Dowling Terence S. | Anisotropic anti-aliasing |
US20040268255A1 (en) * | 2000-02-12 | 2004-12-30 | Mccully Nathaniel M. | Method for aligning text to baseline grids and to CJK character grids |
US20050162428A1 (en) * | 2004-01-26 | 2005-07-28 | Beat Stamm | Adaptively filtering outlines of typographic characters to simplify representative control data |
US20050177786A1 (en) * | 2000-09-25 | 2005-08-11 | Adobe Systems Incorporated, A Delaware Corporation | Text composition spacing amount setting device with icon indicators |
US20050184991A1 (en) * | 2004-01-26 | 2005-08-25 | Beat Stamm | Dynamically determining directions of freedom for control points used to represent graphical objects |
US20050219247A1 (en) * | 2004-03-31 | 2005-10-06 | Adobe Systems Incorporated, A Delaware Corporation | Edge detection based stroke adjustment |
US20050225575A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc | Novel subpixel layouts and arrangements for high brightness displays |
US20050225548A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc | System and method for improving sub-pixel rendering of image data in non-striped display systems |
US20050225562A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc. | Systems and methods for improved gamut mapping from one image data set to another |
US20050225561A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc. | Systems and methods for selecting a white point for image displays |
US20050253865A1 (en) * | 2004-05-11 | 2005-11-17 | Microsoft Corporation | Encoding ClearType text for use on alpha blended textures |
US6993709B1 (en) | 2000-02-12 | 2006-01-31 | Adobe Systems Incorporated | Smart corner move snapping |
US20060080081A1 (en) * | 2004-10-01 | 2006-04-13 | Menninga Eric A | Rule-based text layout |
US7039862B2 (en) | 2002-05-10 | 2006-05-02 | Adobe Systems Incorporated | Text spacing adjustment |
US7079151B1 (en) * | 2002-02-08 | 2006-07-18 | Adobe Systems Incorporated | Compositing graphical objects |
US20060244686A1 (en) * | 2005-04-04 | 2006-11-02 | Clairvoyante, Inc | Systems And Methods For Implementing Improved Gamut Mapping Algorithms |
US20060284872A1 (en) * | 2005-06-15 | 2006-12-21 | Clairvoyante, Inc | Improved Bichromatic Display |
US20070030272A1 (en) * | 2004-03-31 | 2007-02-08 | Dowling Terence S | Glyph Outline Adjustment While Rendering |
US7187382B2 (en) | 2004-01-26 | 2007-03-06 | Microsoft Corporation | Iteratively solving constraints in a font-hinting language |
US20070064020A1 (en) * | 2002-01-07 | 2007-03-22 | Clairvoyante, Inc. | Color flat panel display sub-pixel rendering and driver configuration for sub-pixel arrangements with split sub-pixels |
US7219309B2 (en) | 2001-05-02 | 2007-05-15 | Bitstream Inc. | Innovations for the display of web pages |
US20070176935A1 (en) * | 2004-03-31 | 2007-08-02 | Adobe Systems Incorporated | Adjusted Stroke Rendering |
US20070177215A1 (en) * | 2006-02-01 | 2007-08-02 | Microsoft Corporation | Text rendering contrast |
US7268758B2 (en) | 2004-03-23 | 2007-09-11 | Clairvoyante, Inc | Transistor backplanes for liquid crystal displays comprising different sized subpixels |
US7296227B2 (en) | 2001-02-12 | 2007-11-13 | Adobe Systems Incorporated | Determining line leading in accordance with traditional Japanese practices |
US7307646B2 (en) | 2001-05-09 | 2007-12-11 | Clairvoyante, Inc | Color display pixel arrangements and addressing means |
US20080068383A1 (en) * | 2006-09-20 | 2008-03-20 | Adobe Systems Incorporated | Rendering and encoding glyphs |
US20080186325A1 (en) * | 2005-04-04 | 2008-08-07 | Clairvoyante, Inc | Pre-Subpixel Rendered Image Processing In Display Systems |
US20080198163A1 (en) * | 2005-01-25 | 2008-08-21 | Sony Computer Entertainment Inc. | Drawing Method, Image Generating Device, And Electronic Information Apparatus |
US20080316211A1 (en) * | 2007-06-22 | 2008-12-25 | Clegg Derek B | Adaptive and Dynamic Text Filtering |
US20090097723A1 (en) * | 2007-10-15 | 2009-04-16 | General Electric Company | Method and system for visualizing registered images |
GB2454856A (en) * | 2006-09-19 | 2009-05-27 | Adobe Systems Inc | Rendering and encoding glyphs |
US7590299B2 (en) | 2004-06-10 | 2009-09-15 | Samsung Electronics Co., Ltd. | Increasing gamma accuracy in quantized systems |
US7592996B2 (en) | 2006-06-02 | 2009-09-22 | Samsung Electronics Co., Ltd. | Multiprimary color display with dynamic gamut mapping |
US7598955B1 (en) | 2000-12-15 | 2009-10-06 | Adobe Systems Incorporated | Hinted stem placement on high-resolution pixel grid |
US7598961B2 (en) | 2003-10-21 | 2009-10-06 | Samsung Electronics Co., Ltd. | method and apparatus for converting from a source color space to a target color space |
US20090289943A1 (en) * | 2008-05-22 | 2009-11-26 | Howard Teece | Anti-aliasing system and method |
US7639258B1 (en) | 2004-03-31 | 2009-12-29 | Adobe Systems Incorporated | Winding order test for digital fonts |
US7646430B2 (en) | 2003-10-28 | 2010-01-12 | Samsung Electronics Co., Ltd. | Display system having improved multiple modes for displaying image data from multiple input source formats |
US7688335B2 (en) | 2001-05-09 | 2010-03-30 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7719536B2 (en) | 2004-03-31 | 2010-05-18 | Adobe Systems Incorporated | Glyph adjustment in high resolution raster while rendering |
US7864194B2 (en) | 2003-03-04 | 2011-01-04 | Samsung Electronics Co., Ltd. | Systems and methods for motion adaptive filtering |
US7876341B2 (en) | 2006-08-28 | 2011-01-25 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
US8018476B2 (en) | 2006-08-28 | 2011-09-13 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
US8022969B2 (en) | 2001-05-09 | 2011-09-20 | Samsung Electronics Co., Ltd. | Rotatable display with sub-pixel rendering |
US8085271B2 (en) | 2007-06-08 | 2011-12-27 | Apple Inc. | System and method for dilation for glyph rendering |
US8134583B2 (en) | 2002-01-07 | 2012-03-13 | Samsung Electronics Co., Ltd. | To color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels |
US8144094B2 (en) | 2003-06-06 | 2012-03-27 | Samsung Electronics Co., Ltd. | Liquid crystal display backplane layouts and addressing for non-standard subpixel arrangements |
US8259127B2 (en) | 2006-09-30 | 2012-09-04 | Samsung Electronics Co., Ltd. | Systems and methods for reducing desaturation of images rendered on high brightness displays |
US20120242898A1 (en) * | 2005-04-11 | 2012-09-27 | Sony Corporation | Information processing device and information processing method, program storage medium, program, data structure, and manufacturing method for storage medium |
US8378947B2 (en) | 2003-03-04 | 2013-02-19 | Samsung Display Co., Ltd. | Systems and methods for temporal subpixel rendering of image data |
US8390646B2 (en) | 2004-04-09 | 2013-03-05 | Samsung Display Co., Ltd. | Subpixel rendering filters for high brightness subpixel layouts |
US8736533B2 (en) * | 2010-01-06 | 2014-05-27 | Sang Tae Lee | Cost-effective display methods and apparatuses |
US20140226878A1 (en) * | 2010-10-12 | 2014-08-14 | International Business Machines Corporation | Deconvolution of digital images |
US9384537B2 (en) * | 2014-08-31 | 2016-07-05 | National Taiwan University | Virtual spatial overlap modulation microscopy for resolution improvement |
CN108510084A (en) * | 2018-04-04 | 2018-09-07 | 百度在线网络技术(北京)有限公司 | Method and apparatus for generating information |
WO2021113309A1 (en) * | 2019-12-06 | 2021-06-10 | Magic Leap, Inc. | Encoding stereo splash screen in static image |
Families Citing this family (114)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6750875B1 (en) * | 1999-02-01 | 2004-06-15 | Microsoft Corporation | Compression of image data associated with two-dimensional arrays of pixel sub-components |
US7274383B1 (en) * | 2000-07-28 | 2007-09-25 | Clairvoyante, Inc | Arrangement of color pixels for full color imaging devices with simplified addressing |
US6950115B2 (en) | 2001-05-09 | 2005-09-27 | Clairvoyante, Inc. | Color flat panel display sub-pixel arrangements and layouts |
US7283142B2 (en) * | 2000-07-28 | 2007-10-16 | Clairvoyante, Inc. | Color display having horizontal sub-pixel arrangements and layouts |
WO2002011112A2 (en) | 2000-07-28 | 2002-02-07 | Clairvoyante Laboratories, Inc. | Arrangement of color pixels for full color imaging devices with simplified addressing |
US7184066B2 (en) * | 2001-05-09 | 2007-02-27 | Clairvoyante, Inc | Methods and systems for sub-pixel rendering with adaptive filtering |
US7221381B2 (en) | 2001-05-09 | 2007-05-22 | Clairvoyante, Inc | Methods and systems for sub-pixel rendering with gamma adjustment |
JP4106888B2 (en) * | 2001-09-19 | 2008-06-25 | カシオ計算機株式会社 | Liquid crystal display device and portable terminal device |
US20030117423A1 (en) * | 2001-12-14 | 2003-06-26 | Brown Elliott Candice Hellen | Color flat panel display sub-pixel arrangements and layouts with reduced blue luminance well visibility |
WO2003053068A2 (en) | 2001-12-14 | 2003-06-26 | Clairvoyante Laboratories, Inc. | Improvements to color flat panel display sub-pixel arrangements and layouts with reduced visibility of a blue luminance well |
US7492379B2 (en) * | 2002-01-07 | 2009-02-17 | Samsung Electronics Co., Ltd. | Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with increased modulation transfer function response |
US20040051724A1 (en) * | 2002-09-13 | 2004-03-18 | Elliott Candice Hellen Brown | Four color arrangements of emitters for subpixel rendering |
US6897879B2 (en) * | 2002-03-14 | 2005-05-24 | Microsoft Corporation | Hardware-enhanced graphics acceleration of pixel sub-component-oriented images |
US7030894B2 (en) * | 2002-08-07 | 2006-04-18 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US7317465B2 (en) * | 2002-08-07 | 2008-01-08 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US6963319B2 (en) * | 2002-08-07 | 2005-11-08 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US7172288B2 (en) * | 2003-07-31 | 2007-02-06 | Hewlett-Packard Development Company, L.P. | Display device including a spatial light modulator with plural image regions |
US7034811B2 (en) * | 2002-08-07 | 2006-04-25 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US20040080479A1 (en) * | 2002-10-22 | 2004-04-29 | Credelle Thomas Lioyd | Sub-pixel arrangements for striped displays and methods and systems for sub-pixel rendering same |
KR100436715B1 (en) * | 2002-11-04 | 2004-06-22 | 삼성에스디아이 주식회사 | Method of fast processing image data for improving reproducibility of image |
US7046256B2 (en) * | 2003-01-22 | 2006-05-16 | Clairvoyante, Inc | System and methods of subpixel rendering implemented on display panels |
US7038697B2 (en) * | 2003-02-25 | 2006-05-02 | Microsoft Corporation | Color gradient paths |
US6917368B2 (en) * | 2003-03-04 | 2005-07-12 | Clairvoyante, Inc. | Sub-pixel rendering system and method for improved display viewing angles |
US7098936B2 (en) * | 2003-03-11 | 2006-08-29 | Hewlett-Packard Development Company, L.P. | Image display system and method including optical scaling |
US7352374B2 (en) * | 2003-04-07 | 2008-04-01 | Clairvoyante, Inc | Image data set with embedded pre-subpixel rendered image |
US7268748B2 (en) * | 2003-05-20 | 2007-09-11 | Clairvoyante, Inc | Subpixel rendering for cathode ray tube devices |
US7230584B2 (en) * | 2003-05-20 | 2007-06-12 | Clairvoyante, Inc | Projector systems with reduced flicker |
US20040233308A1 (en) * | 2003-05-20 | 2004-11-25 | Elliott Candice Hellen Brown | Image capture device and camera |
US7209105B2 (en) * | 2003-06-06 | 2007-04-24 | Clairvoyante, Inc | System and method for compensating for visual effects upon panels having fixed pattern noise with reduced quantization error |
US7187353B2 (en) * | 2003-06-06 | 2007-03-06 | Clairvoyante, Inc | Dot inversion on novel display panel layouts with extra drivers |
US20040246280A1 (en) * | 2003-06-06 | 2004-12-09 | Credelle Thomas Lloyd | Image degradation correction in novel liquid crystal displays |
US7218301B2 (en) * | 2003-06-06 | 2007-05-15 | Clairvoyante, Inc | System and method of performing dot inversion with standard drivers and backplane on novel display panel layouts |
US8035599B2 (en) | 2003-06-06 | 2011-10-11 | Samsung Electronics Co., Ltd. | Display panel having crossover connections effecting dot inversion |
US7289114B2 (en) * | 2003-07-31 | 2007-10-30 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
US7190380B2 (en) * | 2003-09-26 | 2007-03-13 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
US7109981B2 (en) * | 2003-07-31 | 2006-09-19 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
US7253811B2 (en) * | 2003-09-26 | 2007-08-07 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
EP1524625A2 (en) * | 2003-10-17 | 2005-04-20 | Matsushita Electric Industrial Co., Ltd. | Enhancement of interpolated image |
US7525526B2 (en) * | 2003-10-28 | 2009-04-28 | Samsung Electronics Co., Ltd. | System and method for performing image reconstruction and subpixel rendering to effect scaling for multi-mode display |
US7301549B2 (en) * | 2003-10-30 | 2007-11-27 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames on a diamond grid |
US6927890B2 (en) * | 2003-10-30 | 2005-08-09 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US20050093894A1 (en) * | 2003-10-30 | 2005-05-05 | Tretter Daniel R. | Generating an displaying spatially offset sub-frames on different types of grids |
US7286121B2 (en) * | 2003-12-23 | 2007-10-23 | Microsoft Corporation | Sub-component based rendering of objects having spatial frequency dominance parallel to the striping direction of the display |
US7355612B2 (en) | 2003-12-31 | 2008-04-08 | Hewlett-Packard Development Company, L.P. | Displaying spatially offset sub-frames with a display device having a set of defective display pixels |
US6984040B2 (en) * | 2004-01-20 | 2006-01-10 | Hewlett-Packard Development Company, L.P. | Synchronizing periodic variation of a plurality of colors of light and projection of a plurality of sub-frame images |
US7086736B2 (en) * | 2004-01-20 | 2006-08-08 | Hewlett-Packard Development Company, L.P. | Display system with sequential color and wobble device |
US7463272B2 (en) * | 2004-01-30 | 2008-12-09 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
US7483044B2 (en) * | 2004-01-30 | 2009-01-27 | Hewlett-Packard Development Company, L.P. | Displaying sub-frames at spatially offset positions on a circle |
US7471843B2 (en) * | 2004-02-04 | 2008-12-30 | Sharp Laboratories Of America, Inc. | System for improving an image displayed on a display |
US7660485B2 (en) * | 2004-04-08 | 2010-02-09 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames using error values |
US20050225571A1 (en) * | 2004-04-08 | 2005-10-13 | Collins David C | Generating and displaying spatially offset sub-frames |
US20050225570A1 (en) * | 2004-04-08 | 2005-10-13 | Collins David C | Generating and displaying spatially offset sub-frames |
US7173698B2 (en) * | 2004-04-13 | 2007-02-06 | The United States Of America As Represented By The Secretary Of The Army | Simultaneous 4-stokes parameter determination using a single digital image |
US20050250821A1 (en) * | 2004-04-16 | 2005-11-10 | Vincent Sewalt | Quaternary ammonium compounds in the treatment of water and as antimicrobial wash |
US7023449B2 (en) * | 2004-04-30 | 2006-04-04 | Hewlett-Packard Development Company, L.P. | Displaying least significant color image bit-planes in less than all image sub-frame locations |
US7148901B2 (en) * | 2004-05-19 | 2006-12-12 | Hewlett-Packard Development Company, L.P. | Method and device for rendering an image for a staggered color graphics display |
US7657118B2 (en) * | 2004-06-09 | 2010-02-02 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames using image data converted from a different color space |
US20050275669A1 (en) * | 2004-06-15 | 2005-12-15 | Collins David C | Generating and displaying spatially offset sub-frames |
US7668398B2 (en) * | 2004-06-15 | 2010-02-23 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames using image data with a portion converted to zero values |
US7453478B2 (en) * | 2004-07-29 | 2008-11-18 | Hewlett-Packard Development Company, L.P. | Address generation in a light modulator |
US7522177B2 (en) * | 2004-09-01 | 2009-04-21 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US7453449B2 (en) * | 2004-09-23 | 2008-11-18 | Hewlett-Packard Development Company, L.P. | System and method for correcting defective pixels of a display device |
US7474319B2 (en) * | 2004-10-20 | 2009-01-06 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames |
US7676113B2 (en) * | 2004-11-19 | 2010-03-09 | Hewlett-Packard Development Company, L.P. | Generating and displaying spatially offset sub-frames using a sharpening factor |
US8872869B2 (en) * | 2004-11-23 | 2014-10-28 | Hewlett-Packard Development Company, L.P. | System and method for correcting defective pixels of a display device |
US7466291B2 (en) * | 2005-03-15 | 2008-12-16 | Niranjan Damera-Venkata | Projection of overlapping single-color sub-frames onto a surface |
US7443364B2 (en) * | 2005-03-15 | 2008-10-28 | Hewlett-Packard Development Company, L.P. | Projection of overlapping sub-frames onto a surface |
US9282335B2 (en) | 2005-03-15 | 2016-03-08 | Hewlett-Packard Development Company, L.P. | System and method for coding image frames |
US7274449B1 (en) | 2005-06-20 | 2007-09-25 | United States Of America As Represented By The Secretary Of The Army | System for determining stokes parameters |
US20070002083A1 (en) * | 2005-07-02 | 2007-01-04 | Stephane Belmon | Display of pixels via elements organized in staggered manner |
US7407295B2 (en) * | 2005-07-26 | 2008-08-05 | Niranjan Damera-Venkata | Projection of overlapping sub-frames onto a surface using light sources with different spectral distributions |
US7387392B2 (en) * | 2005-09-06 | 2008-06-17 | Simon Widdowson | System and method for projecting sub-frames onto a surface |
JP4856925B2 (en) * | 2005-10-07 | 2012-01-18 | 株式会社リコー | Image processing apparatus, image processing method, and image processing program |
US20070091277A1 (en) * | 2005-10-26 | 2007-04-26 | Niranjan Damera-Venkata | Luminance based multiple projector system |
US7470032B2 (en) * | 2005-10-27 | 2008-12-30 | Hewlett-Packard Development Company, L.P. | Projection of overlapping and temporally offset sub-frames onto a surface |
US20070097146A1 (en) * | 2005-10-27 | 2007-05-03 | Apple Computer, Inc. | Resampling selected colors of video information using a programmable graphics processing unit to provide improved color rendering on LCD displays |
US20070097017A1 (en) * | 2005-11-02 | 2007-05-03 | Simon Widdowson | Generating single-color sub-frames for projection |
US20070132967A1 (en) * | 2005-12-09 | 2007-06-14 | Niranjan Damera-Venkata | Generation of image data subsets |
US20070133087A1 (en) * | 2005-12-09 | 2007-06-14 | Simon Widdowson | Generation of image data subsets |
US7559661B2 (en) | 2005-12-09 | 2009-07-14 | Hewlett-Packard Development Company, L.P. | Image analysis for generation of image data subsets |
US20070133794A1 (en) * | 2005-12-09 | 2007-06-14 | Cloutier Frank L | Projection of overlapping sub-frames onto a surface |
US20070132965A1 (en) * | 2005-12-12 | 2007-06-14 | Niranjan Damera-Venkata | System and method for displaying an image |
US7868888B2 (en) * | 2006-02-10 | 2011-01-11 | Adobe Systems Incorporated | Course grid aligned counters |
US7499214B2 (en) * | 2006-03-20 | 2009-03-03 | Hewlett-Packard Development Company, L.P. | Ambient light absorbing screen |
US7295312B1 (en) | 2006-05-10 | 2007-11-13 | United States Of America As Represented By The Secretary Of The Army | Rapid 4-Stokes parameter determination via Stokes filter wheel |
US7800628B2 (en) * | 2006-06-16 | 2010-09-21 | Hewlett-Packard Development Company, L.P. | System and method for generating scale maps |
US9137504B2 (en) * | 2006-06-16 | 2015-09-15 | Hewlett-Packard Development Company, L.P. | System and method for projecting multiple image streams |
US20070291184A1 (en) * | 2006-06-16 | 2007-12-20 | Michael Harville | System and method for displaying images |
US7907792B2 (en) * | 2006-06-16 | 2011-03-15 | Hewlett-Packard Development Company, L.P. | Blend maps for rendering an image frame |
US7854518B2 (en) * | 2006-06-16 | 2010-12-21 | Hewlett-Packard Development Company, L.P. | Mesh for rendering an image frame |
US20080002160A1 (en) * | 2006-06-30 | 2008-01-03 | Nelson Liang An Chang | System and method for generating and displaying sub-frames with a multi-projector system |
US20080001977A1 (en) * | 2006-06-30 | 2008-01-03 | Aufranc Richard E | Generating and displaying spatially offset sub-frames |
US20080024389A1 (en) * | 2006-07-27 | 2008-01-31 | O'brien-Strain Eamonn | Generation, transmission, and display of sub-frames |
US20080024683A1 (en) * | 2006-07-31 | 2008-01-31 | Niranjan Damera-Venkata | Overlapped multi-projector system with dithering |
US20080024469A1 (en) * | 2006-07-31 | 2008-01-31 | Niranjan Damera-Venkata | Generating sub-frames for projection based on map values generated from at least one training image |
US20080043209A1 (en) * | 2006-08-18 | 2008-02-21 | Simon Widdowson | Image display system with channel selection device |
KR100782505B1 (en) * | 2006-09-19 | 2007-12-05 | 삼성전자주식회사 | Method and apparatus for display video using contrast tone in mobile phone |
US20080095363A1 (en) * | 2006-10-23 | 2008-04-24 | Dicarto Jeffrey M | System and method for causing distortion in captured images |
US20080101711A1 (en) * | 2006-10-26 | 2008-05-01 | Antonius Kalker | Rendering engine for forming an unwarped reproduction of stored content from warped content |
US7742011B2 (en) * | 2006-10-31 | 2010-06-22 | Hewlett-Packard Development Company, L.P. | Image display system |
US7855807B2 (en) * | 2007-04-12 | 2010-12-21 | Xerox Corporation | Digital image processor spot color workflow test file |
US20090027504A1 (en) * | 2007-07-25 | 2009-01-29 | Suk Hwan Lim | System and method for calibrating a camera |
US7986356B2 (en) * | 2007-07-25 | 2011-07-26 | Hewlett-Packard Development Company, L.P. | System and method for determining a gamma curve of a display device |
JP5326485B2 (en) * | 2008-10-17 | 2013-10-30 | カシオ計算機株式会社 | Display device and display method thereof |
US20100123721A1 (en) * | 2008-11-18 | 2010-05-20 | Hon Wah Wong | Image device and data processing system |
US8328365B2 (en) | 2009-04-30 | 2012-12-11 | Hewlett-Packard Development Company, L.P. | Mesh for mapping domains based on regularized fiducial marks |
JP2011066738A (en) * | 2009-09-18 | 2011-03-31 | Sanyo Electric Co Ltd | Projection type video display device |
US9235575B1 (en) | 2010-03-08 | 2016-01-12 | Hewlett-Packard Development Company, L.P. | Systems and methods using a slideshow generator |
CN103038568A (en) | 2010-04-16 | 2013-04-10 | 弗莱克斯照明第二有限责任公司 | Front illumination device comprising a film-based lightguide |
JP2013525955A (en) | 2010-04-16 | 2013-06-20 | フレックス ライティング 2,エルエルシー | Lighting device with film-based light guide |
US9520101B2 (en) | 2011-08-31 | 2016-12-13 | Microsoft Technology Licensing, Llc | Image rendering filter creation |
WO2014074104A1 (en) * | 2012-11-09 | 2014-05-15 | Monotype Imaging Inc. | Supporting scalable fonts |
US8982120B1 (en) * | 2013-12-18 | 2015-03-17 | Google Inc. | Blurring while loading map data |
US11915071B1 (en) | 2022-10-26 | 2024-02-27 | Kyocera Document Solutions Inc. | Caching outline characters in printed documents |
Family Cites Families (33)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US4136359A (en) | 1977-04-11 | 1979-01-23 | Apple Computer, Inc. | Microcomputer for use with video display |
US4278972A (en) | 1978-05-26 | 1981-07-14 | Apple Computer, Inc. | Digitally-controlled color signal generation means for use with display |
US4217604A (en) | 1978-09-11 | 1980-08-12 | Apple Computer, Inc. | Apparatus for digitally controlling pal color display |
US4463380A (en) * | 1981-09-25 | 1984-07-31 | Vought Corporation | Image processing system |
US5561365A (en) | 1986-07-07 | 1996-10-01 | Karel Havel | Digital color display system |
US5341153A (en) | 1988-06-13 | 1994-08-23 | International Business Machines Corporation | Method of and apparatus for displaying a multicolor image |
US5543819A (en) | 1988-07-21 | 1996-08-06 | Proxima Corporation | High resolution display system and method of using same |
EP0368572B1 (en) * | 1988-11-05 | 1995-08-02 | SHARP Corporation | Device and method for driving a liquid crystal panel |
EP0376332B1 (en) | 1988-12-29 | 1995-03-08 | Sony Corporation | Display device |
US5254982A (en) | 1989-01-13 | 1993-10-19 | International Business Machines Corporation | Error propagated image halftoning with time-varying phase shift |
US5185602A (en) | 1989-04-10 | 1993-02-09 | Cirrus Logic, Inc. | Method and apparatus for producing perception of high quality grayscale shading on digitally commanded displays |
US5298915A (en) | 1989-04-10 | 1994-03-29 | Cirrus Logic, Inc. | System and method for producing a palette of many colors on a display screen having digitally-commanded pixels |
JPH0817086B2 (en) | 1989-05-17 | 1996-02-21 | 三菱電機株式会社 | Display device |
US5138303A (en) | 1989-10-31 | 1992-08-11 | Microsoft Corporation | Method and apparatus for displaying color on a computer output device using dithering techniques |
JPH03201788A (en) | 1989-12-28 | 1991-09-03 | Nippon Philips Kk | Color display device |
JP3071229B2 (en) | 1990-04-09 | 2000-07-31 | 株式会社リコー | Graphic processing unit |
JP3579061B2 (en) | 1992-08-31 | 2004-10-20 | 株式会社東芝 | Display device |
US5349451A (en) | 1992-10-29 | 1994-09-20 | Linotype-Hell Ag | Method and apparatus for processing color values |
JP3547015B2 (en) | 1993-01-07 | 2004-07-28 | ソニー株式会社 | Image display device and method for improving resolution of image display device |
US5633654A (en) | 1993-11-12 | 1997-05-27 | Intel Corporation | Computer-implemented process and computer system for raster displaying video data using foreground and background commands |
JP2726631B2 (en) | 1994-12-14 | 1998-03-11 | インターナショナル・ビジネス・マシーンズ・コーポレイション | LCD display method |
AU6766096A (en) * | 1995-08-04 | 1997-03-05 | Microsoft Corporation | Method and system for rendering graphical objects to image chunks and combining image layers into a display image |
US6005582A (en) * | 1995-08-04 | 1999-12-21 | Microsoft Corporation | Method and system for texture mapping images with anisotropic filtering |
US5977977A (en) * | 1995-08-04 | 1999-11-02 | Microsoft Corporation | Method and system for multi-pass rendering |
US5867166A (en) * | 1995-08-04 | 1999-02-02 | Microsoft Corporation | Method and system for generating images using Gsprites |
US5870097A (en) * | 1995-08-04 | 1999-02-09 | Microsoft Corporation | Method and system for improving shadowing in a graphics rendering system |
JP2861890B2 (en) | 1995-09-28 | 1999-02-24 | 日本電気株式会社 | Color image display |
US5847698A (en) | 1996-09-17 | 1998-12-08 | Dataventures, Inc. | Electronic book device |
US5949643A (en) | 1996-11-18 | 1999-09-07 | Batio; Jeffry | Portable computer having split keyboard and pivotal display screen halves |
DE19746576A1 (en) * | 1997-10-22 | 1999-04-29 | Zeiss Carl Fa | Process for image formation on a color screen and a suitable color screen |
JPH11305738A (en) * | 1998-04-22 | 1999-11-05 | Oki Electric Ind Co Ltd | Device and method for generating display data |
US6278434B1 (en) * | 1998-10-07 | 2001-08-21 | Microsoft Corporation | Non-square scaling of image data to be mapped to pixel sub-components |
AU2504800A (en) * | 1999-01-12 | 2000-08-01 | Microsoft Corporation | Filtering image data to obtain samples mapped to pixel sub-components of a display device |
-
1999
- 1999-07-30 US US09/364,365 patent/US6393145B2/en not_active Expired - Lifetime
-
2000
- 2000-01-12 DE DE60040209T patent/DE60040209D1/en not_active Expired - Lifetime
- 2000-01-12 AT AT00909900T patent/ATE408215T1/en not_active IP Right Cessation
- 2000-01-12 JP JP2000594248A patent/JP4667604B2/en not_active Expired - Lifetime
- 2000-01-12 AU AU32083/00A patent/AU3208300A/en not_active Abandoned
- 2000-01-12 EP EP00909900A patent/EP1157538B1/en not_active Expired - Lifetime
- 2000-01-12 WO PCT/US2000/000804 patent/WO2000042762A2/en active Application Filing
Cited By (135)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20040212620A1 (en) * | 1999-08-19 | 2004-10-28 | Adobe Systems Incorporated, A Corporation | Device dependent rendering |
US7646387B2 (en) | 1999-08-19 | 2010-01-12 | Adobe Systems Incorporated | Device dependent rendering |
US7425960B2 (en) | 1999-08-19 | 2008-09-16 | Adobe Systems Incorporated | Device dependent rendering |
US7305617B2 (en) | 2000-02-12 | 2007-12-04 | Adobe Systems Incorporated | Method for aligning text to baseline grids and to CJK character grids |
US20030151607A1 (en) * | 2000-02-12 | 2003-08-14 | Mccully Nathaniel M. | Method for calculating CJK emboxes in fonts |
US20030229856A1 (en) * | 2000-02-12 | 2003-12-11 | Lynn Heath A. | Text grid creation tools |
US7320104B2 (en) | 2000-02-12 | 2008-01-15 | Adobe Systems Incorporated | Text grid creation tools |
US20040268255A1 (en) * | 2000-02-12 | 2004-12-30 | Mccully Nathaniel M. | Method for aligning text to baseline grids and to CJK character grids |
US6993709B1 (en) | 2000-02-12 | 2006-01-31 | Adobe Systems Incorporated | Smart corner move snapping |
US7071941B2 (en) * | 2000-02-12 | 2006-07-04 | Adobe Systems Incorporated | Method for calculating CJK emboxes in fonts |
US6928611B2 (en) | 2000-09-25 | 2005-08-09 | Adobe Systems Incorporated | Setting text composition spacing amount |
US7168037B2 (en) | 2000-09-25 | 2007-01-23 | Adobe Systems Incorporated | Text composition spacing amount setting device with icon indicators |
US20020062324A1 (en) * | 2000-09-25 | 2002-05-23 | Mccully Nathaniel M. | Setting text composition spacing amount |
US20050177786A1 (en) * | 2000-09-25 | 2005-08-11 | Adobe Systems Incorporated, A Delaware Corporation | Text composition spacing amount setting device with icon indicators |
US6985146B2 (en) | 2000-09-25 | 2006-01-10 | Adobe System Incorporated | Composite font editing device and computer program |
US20020085006A1 (en) * | 2000-09-25 | 2002-07-04 | Shade Marilyn E. | Composite font editing device and computer program |
US7598955B1 (en) | 2000-12-15 | 2009-10-06 | Adobe Systems Incorporated | Hinted stem placement on high-resolution pixel grid |
US7296227B2 (en) | 2001-02-12 | 2007-11-13 | Adobe Systems Incorporated | Determining line leading in accordance with traditional Japanese practices |
US7287220B2 (en) * | 2001-05-02 | 2007-10-23 | Bitstream Inc. | Methods and systems for displaying media in a scaled manner and/or orientation |
US20040177323A1 (en) * | 2001-05-02 | 2004-09-09 | Kaasila Sampo J. | Methods and systems for displaying media in a scaled manner and/or orientation |
US7219309B2 (en) | 2001-05-02 | 2007-05-15 | Bitstream Inc. | Innovations for the display of web pages |
US7222306B2 (en) | 2001-05-02 | 2007-05-22 | Bitstream Inc. | Methods, systems, and programming for computer display of images, text, and/or digital content |
US7737993B2 (en) | 2001-05-02 | 2010-06-15 | Kaasila Sampo J | Methods, systems, and programming for producing and displaying subpixel-optimized images and digital content including such images |
US20030095135A1 (en) * | 2001-05-02 | 2003-05-22 | Kaasila Sampo J. | Methods, systems, and programming for computer display of images, text, and/or digital content |
US8223168B2 (en) | 2001-05-09 | 2012-07-17 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data |
US7889215B2 (en) | 2001-05-09 | 2011-02-15 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7864202B2 (en) | 2001-05-09 | 2011-01-04 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7916156B2 (en) | 2001-05-09 | 2011-03-29 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US8022969B2 (en) | 2001-05-09 | 2011-09-20 | Samsung Electronics Co., Ltd. | Rotatable display with sub-pixel rendering |
US7689058B2 (en) | 2001-05-09 | 2010-03-30 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7307646B2 (en) | 2001-05-09 | 2007-12-11 | Clairvoyante, Inc | Color display pixel arrangements and addressing means |
US7688335B2 (en) | 2001-05-09 | 2010-03-30 | Samsung Electronics Co., Ltd. | Conversion of a sub-pixel format data to another sub-pixel data format |
US7167274B2 (en) | 2001-09-28 | 2007-01-23 | Adobe Systems Incorporated | Line leading from an arbitrary point |
US20030063317A1 (en) * | 2001-09-28 | 2003-04-03 | Mccully Nathaniel | Line leading from an arbitrary point |
US8134583B2 (en) | 2002-01-07 | 2012-03-13 | Samsung Electronics Co., Ltd. | To color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels |
US7755652B2 (en) | 2002-01-07 | 2010-07-13 | Samsung Electronics Co., Ltd. | Color flat panel display sub-pixel rendering and driver configuration for sub-pixel arrangements with split sub-pixels |
US8456496B2 (en) | 2002-01-07 | 2013-06-04 | Samsung Display Co., Ltd. | Color flat panel display sub-pixel arrangements and layouts for sub-pixel rendering with split blue sub-pixels |
US20070064020A1 (en) * | 2002-01-07 | 2007-03-22 | Clairvoyante, Inc. | Color flat panel display sub-pixel rendering and driver configuration for sub-pixel arrangements with split sub-pixels |
US20060244756A1 (en) * | 2002-02-08 | 2006-11-02 | Adobe Systems Incorporated | Compositing graphical objects |
US7079151B1 (en) * | 2002-02-08 | 2006-07-18 | Adobe Systems Incorporated | Compositing graphical objects |
US7039862B2 (en) | 2002-05-10 | 2006-05-02 | Adobe Systems Incorporated | Text spacing adjustment |
EP1424675A2 (en) * | 2002-11-27 | 2004-06-02 | Matsushita Electric Industrial Co., Ltd. | Display apparatus, method and program with selective image smoothing based on subpixel colour values |
EP1424675A3 (en) * | 2002-11-27 | 2008-10-29 | Matsushita Electric Industrial Co., Ltd. | Display apparatus, method and program with selective image smoothing based on subpixel colour values |
US6933947B2 (en) * | 2002-12-03 | 2005-08-23 | Microsoft Corporation | Alpha correction to compensate for lack of gamma correction |
US20050151753A1 (en) * | 2002-12-03 | 2005-07-14 | Microsoft Corporation | Alpha correction to compensate for lack of gamma correction |
US20040104917A1 (en) * | 2002-12-03 | 2004-06-03 | Platt John C. | Alpha correction to compensate for lack of gamma correction |
US7142220B2 (en) | 2002-12-03 | 2006-11-28 | Microsoft Corporation | Alpha correction to compensate for lack of gamma correction |
US7123261B2 (en) | 2002-12-26 | 2006-10-17 | Adobe Systems Incorporated | Coordinating grid tracking and mojikumi spacing of Japanese text |
US20040125108A1 (en) * | 2002-12-26 | 2004-07-01 | Mccully Nathaniel M. | Coordinating grid tracking and mojikumi spacing of Japanese text |
US20040125107A1 (en) * | 2002-12-26 | 2004-07-01 | Mccully Nathaniel M. | Coordinating grid tracking and mojikumi spacing of Japanese text |
US7864194B2 (en) | 2003-03-04 | 2011-01-04 | Samsung Electronics Co., Ltd. | Systems and methods for motion adaptive filtering |
US8378947B2 (en) | 2003-03-04 | 2013-02-19 | Samsung Display Co., Ltd. | Systems and methods for temporal subpixel rendering of image data |
US8704744B2 (en) | 2003-03-04 | 2014-04-22 | Samsung Display Co., Ltd. | Systems and methods for temporal subpixel rendering of image data |
US7006107B2 (en) | 2003-05-16 | 2006-02-28 | Adobe Systems Incorporated | Anisotropic anti-aliasing |
GB2418579B (en) * | 2003-05-16 | 2006-11-15 | Adobe Systems Inc | Anisotropic Anti-aliasing |
US7002597B2 (en) | 2003-05-16 | 2006-02-21 | Adobe Systems Incorporated | Dynamic selection of anti-aliasing procedures |
WO2004104937A3 (en) * | 2003-05-16 | 2005-02-24 | Adobe Systems Inc | Anisotropic anti-aliasing |
US20040227770A1 (en) * | 2003-05-16 | 2004-11-18 | Dowling Terence S. | Anisotropic anti-aliasing |
GB2418579A (en) * | 2003-05-16 | 2006-03-29 | Adobe Systems Inc | Anisotropic Anti-aliasing |
US20040227771A1 (en) * | 2003-05-16 | 2004-11-18 | Arnold R. David | Dynamic selection of anti-aliasing procedures |
WO2004104937A2 (en) * | 2003-05-16 | 2004-12-02 | Adobe Systems Incorporated | Anisotropic anti-aliasing |
US8144094B2 (en) | 2003-06-06 | 2012-03-27 | Samsung Electronics Co., Ltd. | Liquid crystal display backplane layouts and addressing for non-standard subpixel arrangements |
US7598961B2 (en) | 2003-10-21 | 2009-10-06 | Samsung Electronics Co., Ltd. | method and apparatus for converting from a source color space to a target color space |
US7646430B2 (en) | 2003-10-28 | 2010-01-12 | Samsung Electronics Co., Ltd. | Display system having improved multiple modes for displaying image data from multiple input source formats |
US7236174B2 (en) | 2004-01-26 | 2007-06-26 | Microsoft Corporation | Adaptively filtering outlines of typographic characters to simplify representative control data |
US20050162428A1 (en) * | 2004-01-26 | 2005-07-28 | Beat Stamm | Adaptively filtering outlines of typographic characters to simplify representative control data |
US7187382B2 (en) | 2004-01-26 | 2007-03-06 | Microsoft Corporation | Iteratively solving constraints in a font-hinting language |
US7292247B2 (en) | 2004-01-26 | 2007-11-06 | Microsoft Corporation | Dynamically determining directions of freedom for control points used to represent graphical objects |
US20050184991A1 (en) * | 2004-01-26 | 2005-08-25 | Beat Stamm | Dynamically determining directions of freedom for control points used to represent graphical objects |
US7268758B2 (en) | 2004-03-23 | 2007-09-11 | Clairvoyante, Inc | Transistor backplanes for liquid crystal displays comprising different sized subpixels |
US7602390B2 (en) | 2004-03-31 | 2009-10-13 | Adobe Systems Incorporated | Edge detection based stroke adjustment |
US7333110B2 (en) | 2004-03-31 | 2008-02-19 | Adobe Systems Incorporated | Adjusted stroke rendering |
US7719536B2 (en) | 2004-03-31 | 2010-05-18 | Adobe Systems Incorporated | Glyph adjustment in high resolution raster while rendering |
US20070176935A1 (en) * | 2004-03-31 | 2007-08-02 | Adobe Systems Incorporated | Adjusted Stroke Rendering |
US20070030272A1 (en) * | 2004-03-31 | 2007-02-08 | Dowling Terence S | Glyph Outline Adjustment While Rendering |
US7639258B1 (en) | 2004-03-31 | 2009-12-29 | Adobe Systems Incorporated | Winding order test for digital fonts |
US7408555B2 (en) | 2004-03-31 | 2008-08-05 | Adobe Systems Incorporated | Adjusted Stroke Rendering |
US7580039B2 (en) | 2004-03-31 | 2009-08-25 | Adobe Systems Incorporated | Glyph outline adjustment while rendering |
US20050219247A1 (en) * | 2004-03-31 | 2005-10-06 | Adobe Systems Incorporated, A Delaware Corporation | Edge detection based stroke adjustment |
US7619637B2 (en) | 2004-04-09 | 2009-11-17 | Samsung Electronics Co., Ltd. | Systems and methods for improved gamut mapping from one image data set to another |
US7301543B2 (en) | 2004-04-09 | 2007-11-27 | Clairvoyante, Inc. | Systems and methods for selecting a white point for image displays |
US7583279B2 (en) | 2004-04-09 | 2009-09-01 | Samsung Electronics Co., Ltd. | Subpixel layouts and arrangements for high brightness displays |
US7825921B2 (en) | 2004-04-09 | 2010-11-02 | Samsung Electronics Co., Ltd. | System and method for improving sub-pixel rendering of image data in non-striped display systems |
US20050225575A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc | Novel subpixel layouts and arrangements for high brightness displays |
US20050225561A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc. | Systems and methods for selecting a white point for image displays |
US20050225574A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc | Novel subpixel layouts and arrangements for high brightness displays |
US20050225548A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc | System and method for improving sub-pixel rendering of image data in non-striped display systems |
US20050225562A1 (en) * | 2004-04-09 | 2005-10-13 | Clairvoyante, Inc. | Systems and methods for improved gamut mapping from one image data set to another |
US8390646B2 (en) | 2004-04-09 | 2013-03-05 | Samsung Display Co., Ltd. | Subpixel rendering filters for high brightness subpixel layouts |
US7864188B2 (en) | 2004-04-09 | 2011-01-04 | Samsung Electronics Co., Ltd. | Systems and methods for selecting a white point for image displays |
US7505053B2 (en) | 2004-04-09 | 2009-03-17 | Samsung Electronics Co., Ltd. | Subpixel layouts and arrangements for high brightness displays |
US20050253865A1 (en) * | 2004-05-11 | 2005-11-17 | Microsoft Corporation | Encoding ClearType text for use on alpha blended textures |
US7545389B2 (en) * | 2004-05-11 | 2009-06-09 | Microsoft Corporation | Encoding ClearType text for use on alpha blended textures |
US7590299B2 (en) | 2004-06-10 | 2009-09-15 | Samsung Electronics Co., Ltd. | Increasing gamma accuracy in quantized systems |
US7594171B2 (en) | 2004-10-01 | 2009-09-22 | Adobe Systems Incorporated | Rule-based text layout |
US7783969B1 (en) | 2004-10-01 | 2010-08-24 | Adobe Systems Incorporated | Rule-based text layout |
US20060080081A1 (en) * | 2004-10-01 | 2006-04-13 | Menninga Eric A | Rule-based text layout |
US20080198163A1 (en) * | 2005-01-25 | 2008-08-21 | Sony Computer Entertainment Inc. | Drawing Method, Image Generating Device, And Electronic Information Apparatus |
US7884825B2 (en) * | 2005-01-25 | 2011-02-08 | Sony Computer Entertainment Inc. | Drawing method, image generating device, and electronic information apparatus |
US20060244686A1 (en) * | 2005-04-04 | 2006-11-02 | Clairvoyante, Inc | Systems And Methods For Implementing Improved Gamut Mapping Algorithms |
US8013867B2 (en) | 2005-04-04 | 2011-09-06 | Samsung Electronics Co., Ltd. | Systems and methods for implementing improved gamut mapping algorithms |
US20080186325A1 (en) * | 2005-04-04 | 2008-08-07 | Clairvoyante, Inc | Pre-Subpixel Rendered Image Processing In Display Systems |
US8704847B2 (en) * | 2005-04-04 | 2014-04-22 | Samsung Display Co., Ltd. | Pre-subpixel rendered image processing in display systems |
US10075668B2 (en) * | 2005-04-11 | 2018-09-11 | Sony Corporation | Information processing device and information processing method, program storage medium, program, data structure, and manufacturing method for storage medium |
US20120242898A1 (en) * | 2005-04-11 | 2012-09-27 | Sony Corporation | Information processing device and information processing method, program storage medium, program, data structure, and manufacturing method for storage medium |
US7705855B2 (en) | 2005-06-15 | 2010-04-27 | Samsung Electronics Co., Ltd. | Bichromatic display |
US20060284872A1 (en) * | 2005-06-15 | 2006-12-21 | Clairvoyante, Inc | Improved Bichromatic Display |
US20070177215A1 (en) * | 2006-02-01 | 2007-08-02 | Microsoft Corporation | Text rendering contrast |
US7592996B2 (en) | 2006-06-02 | 2009-09-22 | Samsung Electronics Co., Ltd. | Multiprimary color display with dynamic gamut mapping |
US7876341B2 (en) | 2006-08-28 | 2011-01-25 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
US8018476B2 (en) | 2006-08-28 | 2011-09-13 | Samsung Electronics Co., Ltd. | Subpixel layouts for high brightness displays and systems |
GB2454856A (en) * | 2006-09-19 | 2009-05-27 | Adobe Systems Inc | Rendering and encoding glyphs |
GB2454856B (en) * | 2006-09-19 | 2011-08-24 | Adobe Systems Inc | Image mask generation |
US20080068383A1 (en) * | 2006-09-20 | 2008-03-20 | Adobe Systems Incorporated | Rendering and encoding glyphs |
WO2008036771A2 (en) * | 2006-09-20 | 2008-03-27 | Adobe Systems Incorporated | Rendering and encoding glyphs |
WO2008036771A3 (en) * | 2006-09-20 | 2008-11-13 | Adobe Systems Inc | Rendering and encoding glyphs |
GB2455258B (en) * | 2006-09-20 | 2011-08-24 | Adobe Systems Inc | Rendering and encoding glyphs |
US8259127B2 (en) | 2006-09-30 | 2012-09-04 | Samsung Electronics Co., Ltd. | Systems and methods for reducing desaturation of images rendered on high brightness displays |
US8085271B2 (en) | 2007-06-08 | 2011-12-27 | Apple Inc. | System and method for dilation for glyph rendering |
US20080316211A1 (en) * | 2007-06-22 | 2008-12-25 | Clegg Derek B | Adaptive and Dynamic Text Filtering |
US7944447B2 (en) * | 2007-06-22 | 2011-05-17 | Apple Inc. | Adaptive and dynamic text filtering |
US20110216073A1 (en) * | 2007-06-22 | 2011-09-08 | Clegg Derek B | Adaptive and dynamic text filtering |
US8098250B2 (en) | 2007-06-22 | 2012-01-17 | Apple Inc. | Adaptive and dynamic text filtering |
US8090168B2 (en) * | 2007-10-15 | 2012-01-03 | General Electric Company | Method and system for visualizing registered images |
US20090097723A1 (en) * | 2007-10-15 | 2009-04-16 | General Electric Company | Method and system for visualizing registered images |
US20090289943A1 (en) * | 2008-05-22 | 2009-11-26 | Howard Teece | Anti-aliasing system and method |
US8736533B2 (en) * | 2010-01-06 | 2014-05-27 | Sang Tae Lee | Cost-effective display methods and apparatuses |
US20140226878A1 (en) * | 2010-10-12 | 2014-08-14 | International Business Machines Corporation | Deconvolution of digital images |
US9508116B2 (en) * | 2010-10-12 | 2016-11-29 | International Business Machines Corporation | Deconvolution of digital images |
US10140495B2 (en) | 2010-10-12 | 2018-11-27 | International Business Machines Corporation | Deconvolution of digital images |
US10803275B2 (en) | 2010-10-12 | 2020-10-13 | International Business Machines Corporation | Deconvolution of digital images |
US9384537B2 (en) * | 2014-08-31 | 2016-07-05 | National Taiwan University | Virtual spatial overlap modulation microscopy for resolution improvement |
CN108510084A (en) * | 2018-04-04 | 2018-09-07 | 百度在线网络技术(北京)有限公司 | Method and apparatus for generating information |
WO2021113309A1 (en) * | 2019-12-06 | 2021-06-10 | Magic Leap, Inc. | Encoding stereo splash screen in static image |
US11941408B2 (en) | 2019-12-06 | 2024-03-26 | Magic Leap, Inc. | Encoding stereo splash screen in static image |
Also Published As
Publication number | Publication date |
---|---|
DE60040209D1 (en) | 2008-10-23 |
WO2000042762A2 (en) | 2000-07-20 |
EP1157538A4 (en) | 2003-03-26 |
JP2002535711A (en) | 2002-10-22 |
AU3208300A (en) | 2000-08-01 |
EP1157538A1 (en) | 2001-11-28 |
JP4667604B2 (en) | 2011-04-13 |
EP1157538B1 (en) | 2008-09-10 |
US6393145B2 (en) | 2002-05-21 |
WO2000042762B1 (en) | 2001-01-18 |
ATE408215T1 (en) | 2008-09-15 |
WO2000042762A3 (en) | 2000-12-21 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6393145B2 (en) | Methods apparatus and data structures for enhancing the resolution of images to be rendered on patterned display devices | |
US6282327B1 (en) | Maintaining advance widths of existing characters that have been resolution enhanced | |
US6339426B1 (en) | Methods, apparatus and data structures for overscaling or oversampling character feature information in a system for rendering text on horizontally striped displays | |
JP4633263B2 (en) | Display character positioning method and apparatus | |
US6356278B1 (en) | Methods and systems for asymmeteric supersampling rasterization of image data | |
EP2579246B1 (en) | Mapping samples of foreground/background color image data to pixel sub-components | |
US6342890B1 (en) | Methods, apparatus, and data structures for accessing sub-pixel data having left side bearing information | |
US6219025B1 (en) | Mapping image data samples to pixel sub-components on a striped display device | |
EP1576797B1 (en) | Methods and apparatus for filtering and caching data representing images | |
US7408555B2 (en) | Adjusted Stroke Rendering | |
EP1741063B1 (en) | Edge detection based stroke adjustment | |
US20030193515A1 (en) | High resolution display of image data using pixel sub-components | |
JPH08255254A (en) | Font rendering method using gray scale processing of grid fitted font | |
WO2000021070A1 (en) | Mapping image data samples to pixel sub-components on a striped display device | |
WO2000067196A1 (en) | Method, apparatus and data structures for maintaining a consistent baseline position in a system for rendering text | |
WO2000067247A1 (en) | Methods, apparatus and data structures for determining glyph metrics for rendering text on horizontally striped displays | |
WO2002001546A1 (en) | Data structures for overscaling or oversampling character in a system for rendering text on horizontally striped displays | |
EP1226508B1 (en) | Adjusting character dimensions to compensate for low contrast character features |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: KENT STATE UNIVERSTIY, OHIO Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:WOOLVERTON, CHRISTOPHER J.;REEL/FRAME:009132/0210 Effective date: 19980415 |
|
AS | Assignment |
Owner name: MICROSOFT CORPORATION, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BETRISEY, CLAUDE;DRESEVIC, BODIN;MITCHELL, DONALD P.;AND OTHERS;REEL/FRAME:010498/0465;SIGNING DATES FROM 20000106 TO 20000112 |
|
STCF | Information on status: patent grant |
Free format text: PATENTED CASE |
|
CC | Certificate of correction | ||
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
FPAY | Fee payment |
Year of fee payment: 12 |
|
AS | Assignment |
Owner name: MICROSOFT TECHNOLOGY LICENSING, LLC, WASHINGTON Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNOR:MICROSOFT CORPORATION;REEL/FRAME:034541/0001 Effective date: 20141014 |