US20020138835A1

US20020138835A1 - Decimation method for providing pig windows

Info

Publication number: US20020138835A1
Application number: US10/101,985
Authority: US
Inventors: Daniel O'Connor; Arthur Ng
Original assignee: Index Systems LLC
Current assignee: Index Systems LLC
Priority date: 1999-03-31
Filing date: 2002-03-20
Publication date: 2002-09-26
Also published as: EP1169853A1; US6397386B1; AU4056800A; WO2000059213A9; JP2003517222A; CA2363441A1; CN1346568A; WO2000059213A1

Abstract

A decimation system and method for providing video data to a PIG window in an EPG environment. In one embodiment, the system includes an EPG system having a picture in guide window, a tuner to generate a video signal, a decoder coupled to the tuner to receive the video signal and generate pixels based on the received signal, a PIG generator coupled to the decoder that performs a real time weighted averaging to select a subset of the pixels; and a display generator to display the subset of the pixels in the PIG window on a monitor.

Description

RELATED APPLICATIONS

This application is a continuation of U.S. application Ser. No. 09/540,570, filed on Mar. 31, 2000, which claims priority of U.S. Provisional Application No. 60/127,270, filed on Mar. 31, 1999, the disclosure of which is incorporated fully herein by reference.[0001]

BACKGROUND OF THE INVENTION

The present invention relates generally to graphical/video display systems and methods, and in particular to methods and systems for optimizing graphical/video displays, such as Picture-In-Guide (“PIG”) windows and their memory requirements.

Generally, televisions and television systems, such as computers to operate as televisions, provide information to a user through a display. One example is an electronic program guide (“EPG”). An EPG provides a user or television viewer with updatable television schedule information in the form of an on-screen graphical display. The EPG may provide scheduling information for current and future broadcast programs as well as summaries of television program content for a particular program. The EPG may also provide one or more regions (windows) for previewing different television programs simultaneous with the displayed schedule information or with broadcast of the television program. Often the EPG divides the display into multiple portions or regions of varying size and resolution to provide multiple types of information.

Conventionally, most television systems do not optimally use their available resources, such as memory space or processor bandwidth to effectively and efficiently provide information through the PIG window to a user. Therefore, there is a need for a method and system for providing a real-time and high quality video in a smaller PIG screen with minimum memory requirement.

SUMMARY OF THE INVENTION

The present invention is a decimation system and method for providing video data to a PIG window. One video pixel for every several video pixels is output, in real time, for the PIG window based on some (pixel) averaging algorithms. In one embodiment, only the two previous pixel lines are buffered, eliminating the need for buffering of the entire frame. This system produces real-time and high quality video in a smaller PIG screen with minimum memory requirement.

In one embodiment, the system of the present invention includes an EPG system having a picture in guide window, a tuner to generate a video signal, a decoder coupled to the tuner to receive the video signal and generate pixels based on the received signal, a PIG generator coupled to the decoder that performs a real time weighted averaging to select a subset of the pixels; and a display generator to display the subset of the pixels in the PIG window on a monitor.

Many of the features of this invention will be more readily appreciated as the same becomes better understood by reference to the following detailed description and considered in connection with the accompanying drawings. [0007]

BRIEF DESCRIPTION OF THE DRAWINGS

FIG. 1 is an exemplary PIG display of an EPG according to one embodiment of the present invention; [0008]
FIG. 2 is a simplified exemplary block diagram of a television system that includes a decimation system according to one embodiment of the present invention; [0009]
FIG. 3 is an exemplary averaging window for three pixel lines according to one embodiment of the present invention.[0010]

DETAIL DESCRIPTION

This invention relates to a decimation system and method for providing video data to a PIG window, preferably in an EPG. In one embodiment of the present invention, one video pixel for every several video pixels is output for the PIG window based on some (pixel) averaging algorithms. The earliest versions of on-screen EPGs provided for the storage of program schedule information in an electronic memory connected to the television receiver and generally provided for the on-screen formatting and display of the program schedule information on the television screen. The early EPGs typically overlaid the television programming. Later EPGs provided PIG display of the television program simultaneous with the display of the EPG. In PIG format, the moving, real time images of one television channel are displayed on the background of the EPG in a PIG window overlaid on a small area of the background. [0011]
The PIG display, according to one embodiment of the present invention, includes a real-time video image of a tuned television program displayed in a small window inset in a larger graphic guide. The PIG display provides many options to the viewer. The viewer may continue to view the television program s/he was watching before entering the guide while browsing through the television scheduling information in the guide. Alternatively, the program displayed in the PIG window may change for corresponding to a selected channel in the guide as the viewer cursors through program listings in the guide. The viewer may also pull up the PIG display to find out more information about the program s/he is currently watching, such as start/stop time or a program synopsis, while continuing to view the program in the inset PIG window. [0012]
FIG. 1 illustrates a [0013] PIG display 10 of an electronic program guide (EPG) including a grid portion 22 and a picture window 12. The picture window 12, hereafter referred to as the PIG window, contains a video image of the television program displayed in the full-screen video display, but in reduced size, generally reduced by a factor of three in both width and height, i.e., {fraction (1/9)} the size of the screen. However, other reduction factors are also possible and are within the scope of the invention. Below window 12 are Panel Ad Windows 14, and 16 (“Ad Windows”). Windows 12, 14, and 16 each typically occupy about {fraction (1/9)} of the total screen area. Another possible screen for display in a PIG system is a full-screen graphics display. The PIG window may also be used to display advertisement including text and video previews of goods, services, or television programs.
The [0014] grid portion 22 of the PIG display 10 takes up a majority of the screen. The grid portion generally includes text, icons, and background graphics of several different colors. The graphics may include highlighting of text or sections of the screen. In an EPG system, the viewer can generally navigate through different guides without changing the television program displayed in the PIG window 12. The remainder of the screen area is typically occupied (moving from top to bottom of the screen) by an action key bar 18, a navigation bar 20, and an information box 24 (the “detailed information area”).
In one embodiment of the present invention, when the viewer places a cursor on a [0015] different channel designation 52 or program title in the grid portion, the system automatically tunes the associated tuner to the selected channel and displays the program broadcast on that channel in the PIG window 12.
According to one embodiment of the invention, the components necessary to generate a [0016] PIG display 10 are provided on a single chip to be incorporated into televisions, PC/TVs, VCRs, stand-alone units, satellite receivers, or the like. By providing all the components on a single chip, the overall package size can be reduced as well as the overall gate count and bus interface size of that chip.
FIG. 2 is a block diagram of the components of one embodiment of the invention provided on a [0017] single chip 21. These include a microprocessor 30, a memory controller or direct memory access (DMA) device 31, synchronization regenerating (synch) circuitry 28 and 78, VBI slicer 37, NTSC decoder 79, PIG generator 32, pixel clock generator 38, display generator 34, color space converter 60, digital-to-analog conversion (DAC) 36, digital video output 80.
The [0018] microprocessor 30 configures and coordinates the activities of all of the other components on the chip 21 via two-way communication paths without participating in any data movement operations, such as the VBI slicer 37 writing EPG data to memory via the DMA engine 31. The microprocessor 30 accesses RAM 26 using the DMA engine 31 as a proxy by providing address information and either providing data (in the case of a write) or receiving data (in the case of a read).
Preferably, there is only one RAM, although this invention will work with any number of RAMs. This RAM and the [0019] microprocessor 30 may be part of the chip 21 or may be external. The decision of internal versus external RAM and/or microprocessor is driven by economic and technological constraints. RAM 26 is accessed by four different components: the microprocessor 30, the PIG generator 32, the VBI slicer 37, and the display generator 34. This places a high access load on the RAM as all four components may vie for access to the RAM simultaneously. If all access requests cannot be satisfied simultaneously (either by using a RAM that can access several bytes per cycle or using several RAMs or using a RAM whose cycle time is several times faster than the chip cycle time), a multiplexing device is necessary to resolve the arbitration between the components. Accordingly, the microprocessor 30, PIG generator 32, VBI slicer 37, and the display generator 34 each access the RAM 26 through the DMA 31. The DMA is a multiplexing and arbitrating circuit that facilitates the sharing of the RAM 26 by switching access between the four components in turn. The DMA may include buffer memory to temporarily store data input from out-of-turn components between access cycles. The DMA 31 stores text and video data in the correct addresses in the RAM 26 and then retrieves the appropriate data from a selected address from the RAM 26 when needed.
In one embodiment, the system can receive two independent video signals from two [0020] independent tuners 50. In a unit with two tuners, this allows chip 21 to collect data from one channel while the user is in the guide viewing a different channel. Other embodiments with more than two tuners for receiving more than two video signals to display in a plurality of PIG windows are also possible. In a unit with one tuner, both video inputs would be connected to the one tuner.
The [0021] picture video input 76 from one of the tuners 50 is connected to the NTSC decoder 79. The NTSC decoder takes an analog input and outputs digital pixels either R, G, B or Y, U, V in sufficient resolution for the desired PIG picture quality.
To implement a low-cost PIG device for use in a PIG system, the incoming video data is decimated before the video data is stored in a memory device. Thus the resulting PIG has a limited resolution. In one embodiment, a weighted averaging algorithm is used to select one pixel out of nine pixels (decimation by 9). The incoming digitized video data is buffered in a low-cost memory, such as a shift register, to carry out the averaging algorithm. [0022]
For example, for an immediate neighbor averaging, the adjacent pixels in a sliding window (nine pixels) for the current line, the two previous lines are stored in the buffer (shift register) and the desired averaging function is performed on them to obtain one weighted pixel for each nine pixels. The resulting pixel is then converted to video signal for display in a PIG window, or it is stored in memory to be used for PIG window display. For a nine pixel sliding window, only two previous lines of video data need to be buffered. [0023]
Referring now to FIG. 3, sliding [0024] window 130 contains nine pixels. The two previous lines l and m are buffered. When pixel Pnj+1 of the new line n arrives, the averaging algorithm is performed, and the resulting (weighted) pixel is output in real time. When the next pixel Pnj+2 arrives, it is buffered but, the averaging algorithm is not performed until Pnj+3 and Pnj+4 arrive. As Pnj+4 arrives, the sliding window shifts to the right by three pixels to position 131. The averaging algorithm is performed and again, the next (weighted) pixel is output in real time. When the end of line is reached, the sliding window moves down by three pixels to the beginning of lines Ln+1, Ln+2, and Ln+3. No decimation is carried out until lines Ln+1 and Ln+2 are buffered. Once lines Ln+1 and Ln+2 are buffered, the decimation continues as indicated above.
The following illustrates an example for a polynomial weighted averaging algorithm: [0025]

Field Line Pixels

1 1 1 2 3 4 5 6 7 8 9

2 1 1 2 3 4 5 6 7 8 9

1 2 1 2 3 4 5 6 7 8 9

2 2 1 2 3 4 5 6 7 8 9

1 3 1 2 3 4 5 6 7 8 9

2 3 1 2 3 4 5 6 7 8 9
As [0026] field 1, line 1 is received, pixels 1, 2, and 3 are summed together and stored, similarly for 4, 5, and 6 and 7, 8, and 9. The same procedure is used for line 3. The procedure is repeated for every line in field 1. When field 2 is received, field 2, line 1 is added to field 1, line 1 and field 1, line 3. Field 2, line 2 and field 2, line 3 are added to field 1, line 3, etc.
Note: pixel locations are marked (field-line-pixel). A field is assumed to have lines [0027] 1-240 inclusive active video lines. Each line is assumed to have 640 pixels.
The locations in memory after the first field is received would be: [0028]
memory [[0029] 1]=(1-1-1)+2*(1-1-2)+(1-1-3)+(1-2-1)+2*(1-2-2)+(1-2-3)
memory [[0030] 2]=(1-1-4)+2*(1-1-5)+(1-1-6)+(1-2-7)+2*(1-2-8)+(1-2-9)
. . . [0031]
. . . [0032]
memory [[0033] 213]=(1-1-637)+2*(1-1-638)+(1-1-639)+(1-2-637)+2*(1-2-638)+(1-2-639)
memory [[0034] 214]=2*(1-3-1)+4*(1-3-2)+2*(1-3-3)
memory [[0035] 215]=2*(1-3-4)+4*(1-3-5)+2*(1-3-6)
. . . [0036]
memory [[0037] 426]=2*(1-3-637)+4*(1-3-638)+2*(1-3-639)
. . . [0038]
memory [[0039] 33868]=2*(1-240-1)+4*(1-240-2)+2*(1-240-3)
. . . [0040]
memory [[0041] 34080]=2*(1-240-637)+4*(1-240-638)+2*(1-240-639)
As the second field is received, the following pixels are output: [0042]
pixel [[0043] 1]={memory[1]+2*(2-1-1)+4*(2-1-2)+2*(2-1-3)}/16
pixel [[0044] 2]={memory[2]+2*(2-1-4)+4*(2-1-5)+2*(2-1-6)}/16
. . . [0045]
pixel [[0046] 213]={memory[213]+2*(2-1-637)+4*(2-1-638)+2*(2-1-639)}/16
pixel [[0047] 214]={memory[214]+(2-2-1)+2*(2-2-2)+(2-2-3)+(2-3-1)+2*(2-3-2)+(2-3-3)}/16
. . . [0048]
The memory is updated with [0049] terms involving field 2 only.
memory [[0050] 1]=2*(2-1-1)+4*(2-1-2)+2*(2-1-3)
memory [[0051] 2]=2*(2-1-4)+4*(2-1-5)+2*(2-1-6)
. . . [0052]
memory [[0053] 213]=2*(2-1-637)+4*(2-1-638)+2*(2-1-639)
memory [[0054] 214]=(2-2-1)+2*(2-2-2)+(2-2-3)+(2-3-1)+2*(2-3-2)+(2-3-3)
. . . [0055]
As the [0056] next field 1 is received the output pixels are:
pixel [[0057] 1]={memory[1]+(1-1-1)+2*(1-1-2)+(1-1-3)+(1-2-1)+2*(1-2-2)+(1-2-3)}/16 and so on . . . .
This algorithm converts every nine pixels into one pixel using polynomial weighted averaging with binary coefficients, without having to store the entire frames. As a result, a PIG window of a one-ninth the size of the original display window is generated. The picture is de-interlaced before the averaging and then re-interlaced after the averaging is completed. [0058]
Assuming the binary coefficients for the nine-pixel window are [0059]
a, b, c, [0060]
d, e, f, [0061]
g, h, i, [0062]
in one embodiment, the transfer function performed by the algorithm is: (a+2b+c+2d+4e+2f+g+2h+i)/16. The averaging algorithm is performed in real time before the video data is stored. A minimum amount of memory is needed because only the two previous lines of each field, sufficient for carrying out the algorithm, are stored. The algorithm also counter balances the motion effects by assigning a heavier weight to the center pixel (i.e., 4e). [0063]
It will be recognized by those skilled in the art that various modifications may be made to the illustrated and other embodiments of the invention described above, without departing from the broad inventive scope thereof. It will be understood therefore that the invention is not limited to the particular embodiments or arrangements disclosed, but is rather intended to cover any changes, adaptations or modifications which are within the scope and spirit of the invention as defined by the appended claims. [0064]

Claims

What is claimed is:

1. An electronic program guide (EPG) including a picture in guide (PIG) window comprising:

a monitor having a display screen;

a tuner to generate a video signal;

a decoder coupled to the tuner to receive the video signal and generate pixels for each line of a video picture based on the received signal;

a two-line buffer to store pixels for previous two lines of the video picture;

a PIG generator coupled to the decoder to perform in real time weighted averaging to generate a subset of the pixels of the video picture for display in the PIG window, wherein the subset of the pixels are generated based on the stored pixels for previous two lines and a current line of pixels being generated by the decoder; and

a display generator to display the subset of the pixels in the PIG window on the display screen.

2. The EPG of claim 1, wherein the PIG generator performs the real time weighted averaging to select one pixel out of nine pixels for display in the pIG window.

3. The EPG of claim 2, wherein the memory buffers 3 adjacent pixels in a 3×3 sliding window for the current line and the previous two lines, and the PIG generator performs the real time weighted averaging to select one pixel out of the nine pixels from the sliding window.

4. The EPG of claim 1, wherein the PIG generator performs a real time polynomial weighted averaging with binary coefficients.

5. The EPG of claim 4, wherein the PIG generator in real time selects one pixel out of the nine pixels based on a transfer function of (a+2b+c+2d+4e+2f+g+2h+i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3×3 sliding window.

6. The EPG of claim 1, further comprising means for displaying in the PIG window information about a television program.

7. The EPG of claim 1, further comprising:

means for displaying television program listings in a first area of the screen;

an input device to selectively mark one of the displayed program listings; and

a controller responsive to the input device for controlling the display generator to display in the PIG window simultaneously with the program listings video clips of the marked program.

8. The EPG of claim 7, wherein the marked program is a currently telecast television program and the video clip is a live telecast of the marked program.

9. The EPG of claim 7, wherein the marked program is a future telecast television program and the video clip is a preview of the marked program.

10. A television system for receiving a video signal, comprising:

a monitor having a display screen;

a plurality of tuners to generate a plurality of video signals that carry video images and program data related to video programs;

a PIG generator coupled to the monitor and the tuners to display a first video image in a PIG window on the screen responsive to a first video signal generated by one of the plurality of tuners, wherein the PIG generator performs a real time weighted averaging to select one pixel out of nine pixels from the first video signal to display the respective video image in the PIG window; and

a controller for coupling the program data to the PIG generator to display the program data in a second area on the screen contemporaneously with the video image displayed in the PIG window.

11. The television system of claim 10, further comprising a memory to buffer pixels corresponding to two previous lines of the generated video signals.

12. The television system of claim 10, wherein the memory buffers pixels for the two previous lines and pixels for a current line in a 3×3 sliding window, and the PIG generator performs the real time weighted averaging to generate one pixel out of the nine pixels in the sliding window.

13. The EPG system of claim 12, wherein the PIG chip in real time selects one pixel out of the nine pixels based on a transfer function of (a+2b+c+2d+4e+2f+g+2h+i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3×3 sliding window.

14. A method for displaying video data in a picture in guide (PIG) window displayed within an electronic program guide (EPG), the method comprising:

receiving a video signal;

generating pixels for each line of a video picture based on the received signal;

buffering pixels for previous two lines of the video picture in a two-line buffer;

performing a real time weighted averaging to generate a subset of the pixels of the video picture for display in the PIG window, wherein the subset of the pixels are generated based on the stored pixels for previous two lines and a current line of pixels being generated by the decoder to select a subset of the pixels; and

displaying the subset of the pixels in the PIG window on the monitor.

15. The method of claim 14, wherein the step of buffering comprises buffering 3 adjacent pixels in a 3×3 sliding window for the current line and the previous two lines, and the step of performing a real time weighted averaging comprises performing the real time weighted averaging for selecting one pixel out of the nine pixels in the sliding window.

16. The method of claim 15, wherein the step of performing a real time weighted averaging comprises selecting one pixel out of the nine pixels based on a transfer function of (a+2b+c+2d+4e+2f+g+2h+i)/16, wherein a, b, c, d, e, f, g, h, and i are binary coefficients for the respective pixels in the 3×3 sliding window.

17. The method of claim 14, further comprising displaying in the PIG window information about a television program.

18. The method of claim 14, further comprising:

displaying television program listings in a first area of the screen;

selectively marking one of the displayed program listings; and

controlling the display generator to display in the PIG window simultaneously with the program listings video clips of the marked program.

19. The method of claim 18, wherein the marked program is a currently telecast television program and the video clip is a live telecast of the marked program.

20. The method of claim 18, wherein the marked program is a future telecast television program and the video clip is a preview of the marked program.