EP1840836A1 - Method of performing fast compression and decompression for image - Google Patents

Method of performing fast compression and decompression for image Download PDF

Info

Publication number
EP1840836A1
EP1840836A1 EP05850055A EP05850055A EP1840836A1 EP 1840836 A1 EP1840836 A1 EP 1840836A1 EP 05850055 A EP05850055 A EP 05850055A EP 05850055 A EP05850055 A EP 05850055A EP 1840836 A1 EP1840836 A1 EP 1840836A1
Authority
EP
European Patent Office
Prior art keywords
perform
image data
data block
dct
coefficient
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
EP05850055A
Other languages
German (de)
French (fr)
Other versions
EP1840836A4 (en
EP1840836B1 (en
Inventor
Jian Wang
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Peking University
Peking University Founder Group Co Ltd
Beijing Founder Electronics Co Ltd
Original Assignee
Peking University
Peking University Founder Group Co Ltd
Beijing Founder Electronics Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Peking University, Peking University Founder Group Co Ltd, Beijing Founder Electronics Co Ltd filed Critical Peking University
Publication of EP1840836A1 publication Critical patent/EP1840836A1/en
Publication of EP1840836A4 publication Critical patent/EP1840836A4/en
Application granted granted Critical
Publication of EP1840836B1 publication Critical patent/EP1840836B1/en
Not-in-force legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/12Selection from among a plurality of transforms or standards, e.g. selection between discrete cosine transform [DCT] and sub-band transform or selection between H.263 and H.264
    • H04N19/122Selection of transform size, e.g. 8x8 or 2x4x8 DCT; Selection of sub-band transforms of varying structure or type
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/14Coding unit complexity, e.g. amount of activity or edge presence estimation
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/60Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using transform coding

Landscapes

  • Engineering & Computer Science (AREA)
  • Multimedia (AREA)
  • Signal Processing (AREA)
  • Physics & Mathematics (AREA)
  • Discrete Mathematics (AREA)
  • General Physics & Mathematics (AREA)
  • Compression Or Coding Systems Of Tv Signals (AREA)
  • Compression Of Band Width Or Redundancy In Fax (AREA)
  • Compression, Expansion, Code Conversion, And Decoders (AREA)

Abstract

The present invention relates to an image compression and decompression method, in particular in the areas of computer image processing and data compression. The currently, the process speed for which JPEG (Joint Photographic Experts Group, a compression standard) is applied, it's not all too satisfactory. One aspect of the present invention is simplify compression process based on particular features of an image, thus achieve the aim of accelerate the processing speed. Apply the process described in the present invention, the processing speed for JPEG compression/decompression would rise, without suffers quality reduction compare to current JPEG compression/decompression method.

Description

    Technical Field
  • The present invention relates to computer image processing and data compression technology, in particular to a process of accelerated image compression and decompression.
  • Background of the Invention
  • Joint Photographic Experts Group (JPEG) is a committee under International Standard Organization (ISO) responsible for setting up the static image compression formats international standard which is widely used in the areas of image storage and digital cameras. JPEG proposes a number of processes for image compression and decompression based on the discrete cosine transform (DCT) and the inverse discrete cosine transform (IDCT).
  • A known process of image compression based on the DCT comprises the following steps.
  • Step 1 is a pre-processing step by inputting image data. The purpose of this step is to pre-process the input data so as to make the input data match the following steps, or so as to achieve desirable compression result. This step comprises splitting an original image data into a plurality of 8x8 blocks, standardizing the pixels of the input image, and performing a color space transformation, etc.
  • Step 2 is to perform the DCT. The input of this step is 8x8 image data blocks, wherein all the values of pixels are standardized. The equation for the DCT is: F u v = 1 4 C u C v f x y cos π 2 x + 1 u 16 cos π 2 y + 1 v 16
    Figure imgb0001

    wherein:
    u, v, x, y = 0, 1,2.......7;
    (x, y) represents the coordinate of a point within a block before the DCT, where (0,0) is the coordinate of the pixel on the top left corner of a block; f(x, y) is the value of the pixel at the coordinate (x, y) before the DCT; (u, v) is the coordinate of the pixel after the DCT; F(u, v) is the value of the pixel at the coordinate (u, v) after the DCT.
    as u, v = 0, C(u), C(v)=1/sqrt(2), where sqrt means the square root calculation.
  • Step 3 is to perform quantization. The input of this step is the data block after the DCT and a designated quantization matrix. All elements in the quantization matrix are non-zero positive integrals. Assuming that the quantization matrix is Q(x, y), the quantization is conducted according to the following equation: F x y = F x y / Q x y + 0.5
    Figure imgb0002
    where x, y = 0, 1, 2 ... 7, [ ] means the result would be round off to an integral, and adding 0.5 is to help with the rounding off.
  • Step 4 is to perform one dimensional prediction of a direct current (DC) coefficient. F (0, 0) is called as a DC coefficient, and the other elements are known as Alternating Current (AC) coefficients. To process the DC coefficient, assuming P is the DC coefficient of a preceding image block, which is also the prediction value of the current DC coefficient, the equation for prediction is shown as below:
    F (0, 0) = F (0, 0)-P; // the value of DC coefficient after prediction
    The predicted value of the DC coefficient for the next image block becomes:
    P = P + F (0, 0); // the value of DC coefficient predicted for the next image block.
  • Step 5 is to perform DC Entropy coding. The input of this step is the DC coefficient in the matrix which is the output of step 4. The black element on the top left corner of Figure 2 represents the DC coefficient.
  • Step 6 is to perform an AC Entropy coding, the input of which are the AC coefficients in the outputting matrix of step 4, wherein AC coefficients are arranged in "zigzag"order and a run-length encoding algorithm for entropy coding is employed, referring to Figure 2. Besides the black element on the top left corner of the data block, the rest of elements in Figure 2 are AC coefficients. The bending line indicates AC coefficients being encoded in a zigzag manner. Figure 3 is flow chart for showing the AC coefficient entropy run length coding process.
  • Decompression based on the IDCT, which is the reverse of the compression, is described below.
  • Step 1 is to perform DC coefficient entropy decoding.
  • Step 2 is to perform AC coefficients entropy decoding.
  • Step 3 is to perform one dimensional inverse prediction of the DC coefficient according to the following equation: P = F 0 0 = F 0 0 - P
    Figure imgb0003
  • Step 4 is to perform the inverse quantization process according to the following equation: F x y = F x y × Q x y .
    Figure imgb0004
  • Step 5 is to perform the IDCT according to the following equation: f x y = 1 4 C u C v F u v cos π 2 x + 1 u 16 cos π 2 y + 1 v 16
    Figure imgb0005
  • Step 6 is a post-processing step, which is a reverse of the pre-processing.
  • Figure 1 shows a flowchart of JPEG compression/decompression process based on the DCT and the IDCT. Details of JPEG is disclosed by the International Telegraph and Telephone Consultative Committee (CCITT) in the document with reference number CCITT Rec.T.81(1992E) with the title "Information Technology-Digital Compression and Coding of Continuous-Tone Still Images-Requirement and Guideline".
  • Currently, the JPEG compression process based on the DCT is able to provide an acceptable compression rate. Moreover, when a compressed image is decompressed, the difference between the original image and the decompressed one is hard to be detectable visually. But, its processing speed is not good. It is obvious from the equations for the DCT and the IDCT that a heavy load of calculation is required. Although a lot of accelerated processes are proposed to reduce the work load of calculation, those known accelerated processes cannot be applied to process those images with high resolution. And, the processing speed is still one major obstacle for JPEG applications.
  • Summary of the Invention
  • In order to overcome the shortcomings in the prior art, the objective of present invention is to increase the processing speed of JPEG compression/decompression process based on the DCT and the IDCT without impacting the quality of the image.
  • To achieve above mentioned objective, one aspect of present invention is to provide a process for image data compression, comprising the following steps:
    • step 1 is to pre-process an input image, comprising splitting an original image data into a plurality of image data blocks, standardizing pixels of the image, and performing a color space transformation;
    • step 2 is to determine whether a given data block satisfies a requirement for an accelerated compression, wherein, if yes, step 3 is carried out, otherwise step 4 is carried out; and wherein the requirement is satisfied when all pixel values in one image block are equal;
    • step 3 is to perform a simplified DCT on the image data block and go to step 5;
    • step 4 is to perform a DCT on the image data block;
    • step 5 is to quantify a resulting data block after its DCT;
    • step 6 is to perform one dimensional prediction on a DC coefficient of the data block;
    • step 7 is to perform DC entropy coding on the DC coefficient of the data block; and
    • step 8 is to perform AC entropy coding on AC coefficients of the data block, and end the process.
  • Further, to improve the compression process, the determination of the above step 2 could be further improved by combing a number of image data into a "unit" for comparison, rather than one image datum at one time.
  • Further, if the requirement is satisfied, the DCT and the quantization are merged to form a simple DCT-quantization process, the DC entropy coding and the AC entropy coding are merged to form a simple entropy coding process, a preferred workflow for accelerated compression is listed below:
    • step 1 is to pre-process the inputted image;
    • step 2 is to determine whether the given data block satisfies the requirement, if yes, step 8 is carried out, otherwise step 4 is carried out, wherein the requirement is satisfied when all pixel values in an image block are equal;
    • step 3 is to perform the DCT on the image data block;
    • step 4 is to quantify the resulting data block after its DCT;
    • step 5 is to perform one dimensional prediction on the DC coefficient of the data block;
    • step 6 is to perform the DC entropy coding on the DC coefficient of the data block;
    • step 7 is to perform the AC entropy coding on the AC coefficients of the data block;
    • step 8 is to perform the simplified DCT-quantization process;
    • step 9 is to perform one dimensional prediction on the DC coefficient of the data block; and
    • step 10 is to perform the simple entropy coding, and end the process.
  • The present invention also provides a process for image data decompression, compriseing the following steps:
    • step 1 is to input a compressed image data block, performing a DC coefficient entropy decoding on the image data block;
    • step 2 is to perform a AC coefficients entropy decoding;
    • step 3 is to perform one dimensional inverse prediction on a DC coefficient of the image data block;
    • step 4 is to perform a inverse quantization on a quantified image data block;
    • step 5 is to determine whether a given image data block satisfies a first requirement of an accelerated decoding process, if yes, step 6 is carried out, otherwise, step 7 is carried out, wherein the first requirement is that all the AC coefficients in the given image data block equals to zero;
    • step 6 is to perform a simplified DCT, then step 8 is carried out;
    • step 7 is to perform a DCT; and
    • step 8 is to post-process the image data and output image data that have been decompressed.
  • Further, to improve the decompression process, the step 5 in the decompression process is further improved by combining a number of image data into a "unit", and performing a comparison in view of the unit, rather than one datum by one datum.
  • Still further, when the image data is decompressed, a start point of the accelerated process is forwarded, and wherein if a second requirement for the accelerated decompression is satisfied, the AC entropy decoding process is omitted, and the inverse quantization and DCT process both are simplified, wherein a preferred workflow for the accelerated decompression is listed below:
    • step 1 is to perform DC entropy decoding on the DC coefficients in the image data block.
    • step 2 is to determine whether the image data block satisfies a second requirement for the accelerated decompression process, if yes, step 7 is carried out, otherwise step 3 is carried out, wherein the second requirement is that a first coded AC coefficient is an end code such as End of Block,;
    • step 3 is to perform the entropy decoding on the AC coefficients in the image data block;
    • step 4 is to perform one dimensional inverse prediction on the DC coefficient in the image data block;
    • step 5 is to perform the inverse quantization;
    • step 6 is to perform an IDCT, and go to step 9 after the IDCT is completed;
    • step 7 is to perform one dimensional inverse prediction on the DC coefficient in the image data block;
    • step 8 is to perform a simple IDCT-inverse quantization process; and
    • step 9 is to post-process the image data and output a decompressed image data.
  • The present invention could accelerate the processing speed of JPEG compression/decompression based on the DCT and the IDCT, without impacting the quality of an image and without increasing the time length for the process.
  • Brief Description of the Drawing
  • Figure 1 is a flow chart for a typical JPEG compression/decompression process based on the DCT and the IDCT;
  • Figure 2 is a layout view for the zigzag AC coefficients;
  • Figure 3 is a flow chart for AC coefficients entropy run length coding;
  • Figure 4 is a work chart of an accelerated JPEG compression/decompression process; and
  • Figure 5 shows a flow chart of a preferable accelerated JPEG compression/decompression process.
  • Detailed Description
  • The invention will be now described herein with reference to embodiments and drawings.
  • Figures 4 and 5 show a basic accelerated JPEG compression process based on the DCT.
  • Specifically, step 1 is to pre-process an input image, including splitting the input image data into a plurality of image data blocks, standardizing values of pixels of the image, and conducting a color space transformation.
  • Step 2 is to determine whether a given image block satisfies with the requirement for accelerated compression. If yes, the procedure goes to step 3, otherwise, goes to step 4. The input of this step is a plurality of 8x8 image data blocks. And, all the values of pixels have been standardized. The mentioned requirement is that all the values of pixels in one image block are equal. JPEG can process both 8 bits and 12 bits of pixel depths according to the following pseudo-codes:
     For 8 bits pixel depth:
     for (int n=1; n<64; n++)
             if (f[0]!=f[n])    return false;
     return true;
In the worst case, the above needs 63 comparisons.
     For 12 bits pixel depth:
     int tmp=read_bit(f,12); // read 12 bits from the data stream
     for (int n=1; n<64; n++)
         if(read(f,12)!=tmp)    return false;
     return true;
wherein f represents a data stream. The worst case for the above operation is to perform 64 iterations and 63 comparisons. The return value "true" means the satisfaction of the requirement, while the return value "false" means the dissatisfaction of the requirement.
  • Step 3 is to perform a simplified DCT and proceed to step 5 after completing the transformation. An equation for performing a simplified DCT is listed below: assuming f(x, y) is a matrix before the DCT, F(x, y) is a matrix after the IDCT, where x, y = 0, 1, 2 ...7, For x, y =0, F(x, y) = f(0, 0) x 8; For x !=0 or y !=0, F(x, y) =0.
  • Step 4 is to perform the DCT as mentioned in the Background.
  • Step 5 is to perform the quantization process as mentioned in the Background.
  • Step 6 is to perform one dimensional prediction on a DC coefficient as mentioned in the Background.
  • Step 7 is to perform the DC coefficient entropy coding as mentioned in the Background.
  • Step 8 is to perform AC coefficients entropy coding as mentioned in the Background.
  • Above process is shown in Figure 4.
  • To achieve a better result than the prior art, step 2 of the present embodiment further comprises a step of combining a number of data to form a large "unit" and perform comparison in view of the unit, rather than performing the comparison one datum by one datum.
  • In view of the requirement of accelerated compression process of step 2, the following pseudo-code provides a quicker determination than the basic process:
  •           unsigned int*p = (unsigned int*)f;
              unsigned int temp = circle_left_shift(p[0],8); // circle to the left by
    shifting 8 bits (of course, it would work as well if shifting to the right by 8 bits);
             for ( int n = 0; n<64/sizeof(int); n++)
                 if(temp ! = p[n])    return false
             return true;
  • It is provable that the above is equivalent to step 2 of the basic accelerated compression process. For the majority of 32-bit CPU currently in use, even in the worst scenario, it only needs one circle shift operation and 16 comparisons. At the worst case, the time-consumption of the above is 1/4 of that of step 2 of the basic process. To those CUPs with 64 or 128 bits of registers (i.e. Intel CUP with MMX), the time-consumption of the above would only be 1/8 or 1/16 in comparing with step 2 of the basic process.
  • In the condition of satisfaction of the requirement of accelerated compression, the optimization is not limited to the DCT. The step of performing the quantization and the step of performing entropy coding may be also optimized, too. A preferred accelerated compression process is shown as below:
    • step 1 is to pre-process, which is conducted identically to the step of pre-processing in the background portion;
    • step 2 is to determine whether a given image data block satisfies with a requirement of the accelerated compression. If yes, the procedure goes to step 8, otherwise to step 3; wherein the said requirement of accelerated compression is the same as the requirement mentioned in step 2 of the basic process. The determination of satisfaction of the requirement could be done according to the above step 2 as well as the improved step 2;
    • step 3 is to perform the DCT as mentioned in the background portion;
    • step 4 is to perform the quantization process as mentioned in the background portion;
    • step 5 is to perform one dimensional prediction one DC coefficient as mentioned in the background portion;
    • step 6 is to perform DC coefficient entropy coding as mentioned in the background portion;
    • step 7 is to perform AC coefficients entropy coding as mentioned in the background portion;
    • step 8 is to perform a simplified DCT-quantization process, wherein assuming F is a matrix before the process, f represents a matrix after the transformation, Q is a quantization matrix F 0 0 = f 0 0 * 8 / Q 0 0 ;
      Figure imgb0006
      since (8/Q(0, 0) is actually a constant, this step conducts once only;
    • step 9 is to perform one dimensional prediction on the DC coefficient as mentioned in the background portion; and
    • step 10 is to simplify the entropy coding and ending the procedure, wherein
    • the entropy coding only needs to perform twice as below:
      DC_code(F(0,0)); //DC entropy coding for DC coefficient after prediction
      AC_code(EOB); //code word for ending the encoding.
  • Figure 5 shows the compression process in detail. It is noted that there are dash lines in Figure 5, which represents that the above procedure could return to the process as mentioned in the background portion at any appropriate time. This is regarded as a variation of the accelerated compression process of the present invention.
  • For the JPEG decompression process based on the IDCT, a basic accelerated decompression process is given as follows:
    • step 1 is to perform a DC coefficient decoding as mentioned in the background;
    • step 2 is to perform AC coefficients decoding as mentioned in the background;
    • step 3 is to perform one dimensional DC coefficient inverse prediction as mentioned in the background;
    • step 4 is to perform the inverse quantization as mentioned in the background;
    • step 5 is to determine whether a given image block satisfies with the first requirement of accelerated decompression. If yes, the procedure goes to step 6, otherwise to step 7; wherein the input of this step is a data block of 64 bits including AC and DC coefficients; the first requirement is that all AC coefficients in the input data block equals to zero. The following is the pseudo-code that determines whether the first requirement of accelerated decompression is satisfied. Assuming that F is the inputted data block,
             for ( int n =1 ; n<64; n++)
                 if (F[0]!=0)
                 return false;    //the requirement is not satisfied
             return true          //the requirement is satisfied
    in the worst case, 63 iterations in above pseudo-code are needed;
    • step 6 is to perform a simplified the IDCT and then proceeding to step 8, wherein the performing is conducted according to an equation as follows: assume F(x, y) represents a matrix before the IDCT, and f(x, y) represents a matrix after the IDCT, where x, y = 0, 1, 2 ...7,
      f(x, y) = F(0, 0) /8, for x, y = 0, 1, 2...7;
    • step 7 is to perform the IDCT as mentioned in the background; and
    • step 8 is to perform the post-processing as mentioned in the background.
  • The detailed process is shown in Figure 4.
  • In order to achieve a better result than the prior art, step 5 of the present embodiment could be improved by further comprising a step of combining a number of data to form a lager "unit" and perform the comparison thereof, rather than performing the comparison one datum by one datum.
  • In view of step 5 of the present embodiment (the first requirement of accelerated decompression process), the following pseudo-code provides a quicker determination than the basic process:
  •               unsigned int temp = F[0]; // storing DC coefficient
                  F[0]=0;                   //clearing DC coefficient
                  unsigned int*p = (unsigned int*)(&F(0, 0));
                  for (int n=0, n<64*sizeof(short)/sizeof(int); n++)
                      if (p[n]!=0)
                          {
                              F[0]=temp;
                              Return false;//the requirement is not satisfied
                          }
                      F[0] = temp;
                      Return true;         //the requirement is satisfied
  • It is provable that the above is equivalent to step 5 of the basic accelerated compression process. For the majority of 32-bit CPUs currently in use, even in the worst case, the time-consumption of the above is 1/2 of that of the counterpart of the basic process. To CPUs with 64 or 128 bits registers (i.e. Intel CUP with MMX), the time-consumption would be 1/4 or 1/8 in comparing with the step 5 of the basic process.
  • Although step 5 of the basic accelerated decompression process is optimized already according to the invention, the other steps of the basic process may be optimized, too, in a condition of satisfaction of the second requirement of accelerated decompression.
  • A preferable accelerated decompression process is shown as follows:
    • step 1 is to perform DC coefficient entropy decoding as mentioned in the background;
    • step 2 is to determine whether a given image data block satisfies with the second requirement of accelerated decompression, and if yes, the procedure goes to step 7, otherwise, goes to step 3; wherein the second requirement is that the first AC coefficients entropy coding is the flag of end of the block with the following pseudo-code:
      R = DECODE (); //decoding the first encoded AC coefficient
      if ( R == EOB) //checking if it is the flag of end of the block
      return true; // the requirement is satisfied
      return false; // the requirement is not satisfied it is noted that, when the second requirement is satisfied, the AC coefficients entropy decoding will be omitted;
    • step 3 is to perform AC coefficients entropy decoding as mentioned in the background;
    • step 4 is to perform one dimensional inverse DC coefficient prediction as mentioned in the background;
    • step 5 is to perform the inverse quantization as mentioned in the background;
    • step 6 is to perform the IDCT and then proceed to step 9 as mentioned in the background;
    • step 7 is to perform one dimensional DC coefficient inverse prediction as mentioned in the background;
    • step 8 is to perform a simplified the IDCT-quantization process, wherein, assuming that F represents a matrix before the transformation, f represents a matrix after the transformation, and Q represents a quantization matrix,
      F(x, y) = F(0, 0) *(Q(0, 0)/8), for x, y = 0, 1, 2...7.
      Note Q(0, 0) is a constant; and
    • step 9 is to perform the post-processing as mentioned in the background.
  • Please refer to the decompression section of Figure 5 for details. It is noted that dash lines occur in Figure 5, which represents that the procedure could return to the process as mentioned in the background at an appropriate timing. It is regarded as a variation of the accelerated decompression process of the present invention.
  • Claims (6)

    1. A process for image data compression, comprising the following steps:
      step 1 is to pre-process an input image, comprising splitting an original image data into a plurality of image data blocks, standardizing pixels of the image, and performing a color space transformation;
      step 2 is to determine whether a given data block satisfies a requirement for an accelerated compression, wherein, if yes, step 3 is carried out, otherwise step 4 is carried out; and wherein the requirement is satisfied when all pixel values in one image block are equal;
      step 3 is to perform a simplified DCT on the image data block and go to step 5;
      step 4 is to perform a DCT on the image data block;
      step 5 is to quantify a resulting data block after its DCT;
      step 6 is to perform one dimensional prediction on a DC coefficient of the data block;
      step 7 is to perform DC entropy coding on the DC coefficient of the data block; and
      step 8 is to perform AC entropy coding on AC coefficients of the data block, and end the process.
    2. The process for image data compression according to claim 1, wherein the step 2 is further improved by combining a number of image data into a "unit" and performing a comparison in view of the unit, rather than one datum by one datum.
    3. The process for image data compression according to claim 1 or 2, wherein if the requirement is satisfied, the step of performing the DCT and the step for quantifying are merged to one step of performing a simplified DCT-quantization process; and the step of performing the DC entropy coding and performing the AC entropy coding are merged to form a simplified entropy coding, a preferred workflow for accelerated compression is listed below:
      step 1 is to pre-process the inputted image;
      step 2 is to determine whether the given data block satisfies the requirement, if yes, step 8 is carried out, otherwise step 4 is carried out, wherein the requirement is satisfied when all pixel values in an image block are equal;
      step 3 is to perform the DCT on the image data block;
      step 4 is to quantify the resulting data block after its DCT;
      step 5 is to perform one dimensional prediction on the DC coefficient of the data block;
      step 6 is to perform the DC entropy coding on the DC coefficient of the data block;
      step 7 is to perform the AC entropy coding on the AC coefficients of the data block;
      step 8 is to perform the simplified DCT-quantization process;
      step 9 is to perform one dimensional prediction on the DC coefficient of the data block; and
      step 10 is to perform the simple entropy coding, and end the process.
    4. A process for image data decompression, comprising the following steps:
      step 1 is to input a compressed image data block, performing a DC coefficient entropy decoding on the image data block;
      step 2 is to perform a AC coefficients entropy decoding;
      step 3 is to perform one dimensional inverse prediction on a DC coefficient of the image data block;
      step 4 is to perform a inverse quantization on a quantified image data block;
      step 5 is to determine whether a given image data block satisfies a first requirement of an accelerated decoding process, if yes, step 6 is carried out, otherwise, step 7 is carried out, wherein the first requirement is that all the AC coefficients in the given image data block equals to zero;
      step 6 is to perform a simplified DCT, then step 8 is carried out;
      step 7 is to perform a DCT; and
      step 8 is to post-process the image data and output image data that have been decompressed.
    5. The process for image data decompression according to claim 4, wherein the step 5 is further improved by combining a number of image data into a "unit", and performing a comparison in view of the unit, rather than one datum by one datum.
    6. The process for image data decompression according to claim 4, wherein when the image data is decompressed, a start point of the accelerated process is forwarded, and wherein if a second requirement for the accelerated decompression is satisfied, the AC entropy decoding process is omitted, and the inverse quantization and DCT process both are simplified, wherein a preferred workflow for the accelerated decompression is listed below:
      step 1 is to perform DC entropy decoding on the DC coefficients in the image data block.
      step 2 is to determine whether the image data block satisfies a second requirement for the accelerated decompression process, if yes, step 7 is carried out, otherwise step 3 is carried out, wherein the second requirement is that a first coded AC coefficient is an end code such as End of Block,;
      step 3 is to perform the entropy decoding on the AC coefficients in the image data block;
      step 4 is to perform one dimensional inverse prediction on the DC coefficient in the image data block;
      step 5 is to perform the inverse quantization;
      step 6 is to perform an IDCT, and go to step 9 after the IDCT is completed;
      step 7 is to perform one dimensional inverse prediction on the DC coefficient in the image data block;
      step 8 is to perform a simple IDCT-inverse quantization process; and
      step 9 is to post-process the image data and output a decompressed image data.
    EP05850055A 2005-01-07 2005-12-23 Method of performing fast compression for an image Not-in-force EP1840836B1 (en)

    Applications Claiming Priority (2)

    Application Number Priority Date Filing Date Title
    CNB2005100005896A CN1282107C (en) 2005-01-07 2005-01-07 Method for rapidly compressing and decompressing image
    PCT/CN2005/002292 WO2006072206A1 (en) 2005-01-07 2005-12-23 Method of performing fast compression and decompression for image

    Publications (3)

    Publication Number Publication Date
    EP1840836A1 true EP1840836A1 (en) 2007-10-03
    EP1840836A4 EP1840836A4 (en) 2009-03-04
    EP1840836B1 EP1840836B1 (en) 2012-01-25

    Family

    ID=34777986

    Family Applications (1)

    Application Number Title Priority Date Filing Date
    EP05850055A Not-in-force EP1840836B1 (en) 2005-01-07 2005-12-23 Method of performing fast compression for an image

    Country Status (6)

    Country Link
    US (1) US8548266B2 (en)
    EP (1) EP1840836B1 (en)
    JP (1) JP4831547B2 (en)
    CN (1) CN1282107C (en)
    AT (1) ATE543338T1 (en)
    WO (1) WO2006072206A1 (en)

    Families Citing this family (10)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JP5590390B2 (en) * 2010-07-15 2014-09-17 ソニー株式会社 Image processing apparatus and method
    JP5732765B2 (en) * 2010-07-22 2015-06-10 富士ゼロックス株式会社 Image data decoding device
    CN103413287B (en) * 2013-08-27 2016-09-14 浙江宇视科技有限公司 A kind of JPEG picture synthetic method and device
    KR102285940B1 (en) 2015-05-29 2021-08-05 에스케이하이닉스 주식회사 Data processing circuit, data storage device comprising data processing circuit and operating method thereof
    US11515897B2 (en) 2015-05-29 2022-11-29 SK Hynix Inc. Data storage device
    KR102347418B1 (en) * 2015-09-25 2022-01-06 에스케이하이닉스 주식회사 Data processing device and operating method thereof
    US10396827B2 (en) 2015-09-25 2019-08-27 SK Hynix Inc. Data storage device
    US11177835B2 (en) 2015-09-25 2021-11-16 SK Hynix Inc. Data storage device
    US11611359B2 (en) 2015-05-29 2023-03-21 SK Hynix Inc. Data storage device
    JP2020004033A (en) * 2018-06-27 2020-01-09 株式会社Screenホールディングス Image processing method, computer program, and recording medium

    Citations (4)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US5371611A (en) * 1992-08-26 1994-12-06 Kokusai Denshin Denwa Kabushiki Kaisha Method for and system of decoding compressed continuous-tone digital image data
    US5719961A (en) * 1994-07-22 1998-02-17 Apple Computer, Inc. Adaptive technique for encoder and decoder signal transformation
    EP0990992A2 (en) * 1998-09-28 2000-04-05 Siemens Aktiengesellschaft DCT/IDCT processor and data processing method
    EP1109410A2 (en) * 1999-12-17 2001-06-20 Xerox Corporation Method for JPEG decompression

    Family Cites Families (12)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    JPH07162861A (en) * 1993-12-10 1995-06-23 Fujitsu General Ltd Still picture reproducing device
    KR100346740B1 (en) 1996-09-21 2002-09-18 삼성전자 주식회사 Discrete cosine transform coefficients prediction method
    US6160918A (en) * 1997-10-02 2000-12-12 At&T Corp. Method and apparatus for fast image compression
    JP2000013596A (en) * 1998-06-18 2000-01-14 Minolta Co Ltd Device and method for processing image and recording medium with image processing program recorded there
    JP2000013612A (en) * 1998-06-18 2000-01-14 Minolta Co Ltd Device and method for image processing and recording medium recorded with image processing program
    JP2001145107A (en) * 1999-11-12 2001-05-25 Seiko Epson Corp Signal processor using dct and image-compressing device
    JP3538352B2 (en) * 1999-12-15 2004-06-14 シャープ株式会社 Image encoding method, image decoding method and color facsimile apparatus
    US6882685B2 (en) * 2001-09-18 2005-04-19 Microsoft Corporation Block transform and quantization for image and video coding
    JP2003324739A (en) 2002-05-01 2003-11-14 Sony Corp Circuit and method for two-dimensional discrete cosine transform, and apparatus and method for image data compression
    US7092448B2 (en) 2002-05-24 2006-08-15 Koninklijke Philips Electronics N.V. Method and system for estimating no-reference objective quality of video data
    KR100613732B1 (en) 2003-01-17 2006-08-18 아스텔 주식회사 Image Compression System for Digital Video Surveillance and Method for controlling the Same
    KR100497753B1 (en) 2003-02-14 2005-06-29 (주) 멀티비아 Moving-Picture Coding System And Method For Mobile Communication Terminal

    Patent Citations (4)

    * Cited by examiner, † Cited by third party
    Publication number Priority date Publication date Assignee Title
    US5371611A (en) * 1992-08-26 1994-12-06 Kokusai Denshin Denwa Kabushiki Kaisha Method for and system of decoding compressed continuous-tone digital image data
    US5719961A (en) * 1994-07-22 1998-02-17 Apple Computer, Inc. Adaptive technique for encoder and decoder signal transformation
    EP0990992A2 (en) * 1998-09-28 2000-04-05 Siemens Aktiengesellschaft DCT/IDCT processor and data processing method
    EP1109410A2 (en) * 1999-12-17 2001-06-20 Xerox Corporation Method for JPEG decompression

    Non-Patent Citations (5)

    * Cited by examiner, † Cited by third party
    Title
    BIK A. ET AL: "Efficient Exploitation of Parallelism on Pentium III and Pentium 4 Processor-Based Systems", INTEL TECHNOLOGY JOURNAL, [Online] vol. 5, no. 1, 28 February 2001 (2001-02-28), Retrieved from the Internet: URL:http://download.intel.com/technology/itj/q12001/pdf/art_6.pdf> [retrieved on 2009-11-26] *
    INDEPENDENT JPEG GROUP: "JPEG IMAGE COMPRESSION LIBRARY, RELEASE VERSION 6B"[Online] 27 May 1998 (1998-05-27), XP002507900 files: README; jdhuff.c; jidctflt.c; jdpostct.c Retrieved from the Internet: URL:http://www.ijg.org/files/jpegsrc.v6b.tar.gz> [retrieved on 2008-12-08] *
    PENNEBAKER W B ET AL: "The discrete cosine transform (DCT)" JPEG STILL IMAGE DATA COMPRESSION STANDARD, NEW YORK, VAN NOSTRAND REINHOLD, US, 1 January 1992 (1992-01-01), pages 29-64, XP002248710 ISBN: 978-0-442-01272-4 *
    See also references of WO2006072206A1 *
    WALLACE G K: "THE JPEG STILL PICTURE COMPRESSION STANDARD" IEEE TRANSACTIONS ON CONSUMER ELECTRONICS, IEEE SERVICE CENTER, NEW YORK, NY, US, vol. 38, no. 1, 1 February 1992 (1992-02-01), pages XVIII-XXXIV, XP000297354 ISSN: 0098-3063 *

    Also Published As

    Publication number Publication date
    CN1282107C (en) 2006-10-25
    JP4831547B2 (en) 2011-12-07
    CN1622137A (en) 2005-06-01
    EP1840836A4 (en) 2009-03-04
    US20090016629A1 (en) 2009-01-15
    ATE543338T1 (en) 2012-02-15
    EP1840836B1 (en) 2012-01-25
    US8548266B2 (en) 2013-10-01
    WO2006072206A1 (en) 2006-07-13
    JP2008527809A (en) 2008-07-24

    Similar Documents

    Publication Publication Date Title
    EP1840836A1 (en) Method of performing fast compression and decompression for image
    US7813575B2 (en) Enhancing compression while transcoding JPEG images
    CN101562749B (en) Video data compression with integrated lossy and lossless compression
    US20100040299A1 (en) Apparatus and method for decoding image data
    US20050201632A1 (en) Resolution changing method and apparatus
    EP1349395A2 (en) Moving picture coding method, moving picture coding apparatus, and moving picture coding program
    CN110896483A (en) Method for compressing and decompressing image data
    JPH08242378A (en) Method for efficiently and repeatedly decompressing standardadct compressed image
    CN1539239A (en) Interface encoding method and apparatus
    US20040131224A1 (en) Method for burying data in image, and method of extracting the data
    Li et al. A reversible data hiding scheme for JPEG images
    JPH07143488A (en) Method and device for decoding image data
    CN112449201B (en) Decoding method, encoding method, corresponding devices, electronic equipment and storage medium
    JPH09121352A (en) Method and apparatus for coding and decoding video data stream for all pixel in video data stream
    CN112714313A (en) Image processing method, device, equipment and storage medium
    US8116580B2 (en) Embedded high frequency image details
    CN100396101C (en) Image compression apparatus generating and using assistant images and a method thereof
    EP2154899A2 (en) Device and method for decoding image data
    JPH1098620A (en) Picture processor
    TWI384862B (en) Image decoding apparatus and method using the same
    US20090238483A1 (en) Image processing apparatus, image processing method, and computer program product
    JP2008109195A (en) Image processor
    JP2002209111A (en) Image encoder, image communication system and program recording medium
    JPH08289290A (en) Image reproducing device
    JP2006304270A (en) Decoding apparatus, dequantizing method, and program thereof

    Legal Events

    Date Code Title Description
    PUAI Public reference made under article 153(3) epc to a published international application that has entered the european phase

    Free format text: ORIGINAL CODE: 0009012

    17P Request for examination filed

    Effective date: 20070807

    AK Designated contracting states

    Kind code of ref document: A1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

    DAX Request for extension of the european patent (deleted)
    A4 Supplementary search report drawn up and despatched

    Effective date: 20090204

    17Q First examination report despatched

    Effective date: 20090427

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R079

    Ref document number: 602005032449

    Country of ref document: DE

    Free format text: PREVIOUS MAIN CLASS: G06T0009000000

    Ipc: H04N0007300000

    RTI1 Title (correction)

    Free format text: METHOD OF PERFORMING FAST COMPRESSION FOR AN IMAGE

    GRAP Despatch of communication of intention to grant a patent

    Free format text: ORIGINAL CODE: EPIDOSNIGR1

    RIC1 Information provided on ipc code assigned before grant

    Ipc: G06T 9/00 20060101ALI20110714BHEP

    Ipc: H04N 7/30 20060101AFI20110714BHEP

    GRAS Grant fee paid

    Free format text: ORIGINAL CODE: EPIDOSNIGR3

    GRAA (expected) grant

    Free format text: ORIGINAL CODE: 0009210

    AK Designated contracting states

    Kind code of ref document: B1

    Designated state(s): AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IS IT LI LT LU LV MC NL PL PT RO SE SI SK TR

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: FG4D

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: EP

    REG Reference to a national code

    Ref country code: AT

    Ref legal event code: REF

    Ref document number: 543338

    Country of ref document: AT

    Kind code of ref document: T

    Effective date: 20120215

    REG Reference to a national code

    Ref country code: IE

    Ref legal event code: FG4D

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R096

    Ref document number: 602005032449

    Country of ref document: DE

    Effective date: 20120322

    REG Reference to a national code

    Ref country code: NL

    Ref legal event code: VDEP

    Effective date: 20120125

    LTIE Lt: invalidation of european patent or patent extension

    Effective date: 20120125

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: IS

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120525

    Ref country code: LT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: NL

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: BE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: BG

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120425

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: GR

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120426

    Ref country code: FI

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: PL

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: PT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120525

    Ref country code: LV

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    REG Reference to a national code

    Ref country code: AT

    Ref legal event code: MK05

    Ref document number: 543338

    Country of ref document: AT

    Kind code of ref document: T

    Effective date: 20120125

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: CY

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: CZ

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: SE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: SI

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: EE

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: RO

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: DK

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: SK

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    Ref country code: IT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    PLBE No opposition filed within time limit

    Free format text: ORIGINAL CODE: 0009261

    STAA Information on the status of an ep patent application or granted ep patent

    Free format text: STATUS: NO OPPOSITION FILED WITHIN TIME LIMIT

    26N No opposition filed

    Effective date: 20121026

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: AT

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R097

    Ref document number: 602005032449

    Country of ref document: DE

    Effective date: 20121026

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: ES

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120506

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: MC

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20121231

    REG Reference to a national code

    Ref country code: CH

    Ref legal event code: PL

    REG Reference to a national code

    Ref country code: IE

    Ref legal event code: MM4A

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: IE

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20121223

    Ref country code: LI

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20121231

    Ref country code: CH

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20121231

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: TR

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20120125

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: LU

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20121223

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: HU

    Free format text: LAPSE BECAUSE OF FAILURE TO SUBMIT A TRANSLATION OF THE DESCRIPTION OR TO PAY THE FEE WITHIN THE PRESCRIBED TIME-LIMIT

    Effective date: 20051223

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 11

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 12

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 13

    REG Reference to a national code

    Ref country code: FR

    Ref legal event code: PLFP

    Year of fee payment: 17

    PGFP Annual fee paid to national office [announced via postgrant information from national office to epo]

    Ref country code: DE

    Payment date: 20211124

    Year of fee payment: 17

    Ref country code: FR

    Payment date: 20211216

    Year of fee payment: 17

    Ref country code: GB

    Payment date: 20211125

    Year of fee payment: 17

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R081

    Ref document number: 602005032449

    Country of ref document: DE

    Owner name: PEKING UNIVERSITY, CN

    Free format text: FORMER OWNERS: BEIJING FOUNDER ELECTRONICS CO., LTD., BEIJING, CN; PEKING UNIVERSITY, BEIJING, CN; PEKING UNIVERSITY FOUNDER GROUP CO., LTD., BEIJING, CN

    Ref country code: DE

    Ref legal event code: R081

    Ref document number: 602005032449

    Country of ref document: DE

    Owner name: NEW FOUNDER HOLDINGS DEVELOPMENT LIMITED LIABI, CN

    Free format text: FORMER OWNERS: BEIJING FOUNDER ELECTRONICS CO., LTD., BEIJING, CN; PEKING UNIVERSITY, BEIJING, CN; PEKING UNIVERSITY FOUNDER GROUP CO., LTD., BEIJING, CN

    Ref country code: DE

    Ref legal event code: R081

    Ref document number: 602005032449

    Country of ref document: DE

    Owner name: BEIJING FOUNDER ELECTRONICS CO., LTD., CN

    Free format text: FORMER OWNERS: BEIJING FOUNDER ELECTRONICS CO., LTD., BEIJING, CN; PEKING UNIVERSITY, BEIJING, CN; PEKING UNIVERSITY FOUNDER GROUP CO., LTD., BEIJING, CN

    Ref country code: DE

    Ref legal event code: R082

    Ref document number: 602005032449

    Country of ref document: DE

    Representative=s name: SAMSON & PARTNER PATENTANWAELTE MBB, DE

    REG Reference to a national code

    Ref country code: DE

    Ref legal event code: R119

    Ref document number: 602005032449

    Country of ref document: DE

    REG Reference to a national code

    Ref country code: GB

    Ref legal event code: 732E

    Free format text: REGISTERED BETWEEN 20230622 AND 20230628

    GBPC Gb: european patent ceased through non-payment of renewal fee

    Effective date: 20221223

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: GB

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20221223

    Ref country code: DE

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20230701

    PG25 Lapsed in a contracting state [announced via postgrant information from national office to epo]

    Ref country code: FR

    Free format text: LAPSE BECAUSE OF NON-PAYMENT OF DUE FEES

    Effective date: 20221231