WO2000048116A1 - Method and apparatus for the recovery of compression constants in the encoded domain - Google Patents

Method and apparatus for the recovery of compression constants in the encoded domain Download PDF

Info

Publication number
WO2000048116A1
WO2000048116A1 PCT/US2000/003595 US0003595W WO0048116A1 WO 2000048116 A1 WO2000048116 A1 WO 2000048116A1 US 0003595 W US0003595 W US 0003595W WO 0048116 A1 WO0048116 A1 WO 0048116A1
Authority
WO
WIPO (PCT)
Prior art keywords
encoded data
candidate
set forth
neighboring
offset
Prior art date
Application number
PCT/US2000/003595
Other languages
French (fr)
Inventor
Tetsujiro Kondo
James J. Carrig
Sugata Ghosal
Kohji Ohta
Yasuhiro Fujimori
Yasuaki Takahashi
Hideo Nakaya
Original Assignee
Sony Electronics, Inc.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Sony Electronics, Inc. filed Critical Sony Electronics, Inc.
Priority to AU33619/00A priority Critical patent/AU3361900A/en
Publication of WO2000048116A1 publication Critical patent/WO2000048116A1/en

Links

Classifications

    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • H04N19/895Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder in combination with error concealment
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/102Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or selection affected or controlled by the adaptive coding
    • H04N19/124Quantisation
    • H04N19/126Details of normalisation or weighting functions, e.g. normalisation matrices or variable uniform quantisers
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/134Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the element, parameter or criterion affecting or controlling the adaptive coding
    • H04N19/136Incoming video signal characteristics or properties
    • H04N19/137Motion inside a coding unit, e.g. average field, frame or block difference
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/10Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding
    • H04N19/169Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding
    • H04N19/17Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object
    • H04N19/176Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using adaptive coding characterised by the coding unit, i.e. the structural portion or semantic portion of the video signal being the object or the subject of the adaptive coding the unit being an image region, e.g. an object the region being a block, e.g. a macroblock
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/46Embedding additional information in the video signal during the compression process
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/70Methods or arrangements for coding, decoding, compressing or decompressing digital video signals characterised by syntax aspects related to video coding, e.g. related to compression standards
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/85Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression
    • H04N19/89Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using pre-processing or post-processing specially adapted for video compression involving methods or arrangements for detection of transmission errors at the decoder
    • HELECTRICITY
    • H04ELECTRIC COMMUNICATION TECHNIQUE
    • H04NPICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N19/00Methods or arrangements for coding, decoding, compressing or decompressing digital video signals
    • H04N19/90Methods or arrangements for coding, decoding, compressing or decompressing digital video signals using coding techniques not provided for in groups H04N19/10-H04N19/85, e.g. fractals
    • H04N19/98Adaptive-dynamic-range coding [ADRC]

Definitions

  • the present invention relates to the recovery of data. More particularly, the present invention relates to the recovery of lost/damaged compression constants in a bitstream of compressed data.
  • the discrete data points that make up a digital image are known as pixels.
  • each pixel is represented independently using 8 bits, but other representations also are used for the purposes of compression or analysis.
  • Most of the alternative representations begin by dividing this raw data into disjoint sets. For historical reasons, these sets are referred to as "blocks", even though they may not have a traditional block shape. The alternative representation then characterizes the data by some block-wide information and per-pixel information.
  • block-wide information examples include the minimum pixel value (MIN), the maximum pixel value (MAX), and the dynamic range of the pixel values (DR).
  • Per-pixel information may indicate where the pixel value lies within the range specified by the global information. For compression to be achieved, the per- pixel information must use only a few bits of storage so that the total number of bits used is less than that required to store the raw image.
  • the block data is comprised of the MIN, DR and Qbit number (defined below), and the pixel data is comprised of Q codes.
  • a Q code is an integer in the range [0,2 Q -1] that identifies one value in the set ⁇ MIN, MIN+1, ....,MAX ⁇ .
  • Temporal compression is feasible for a sequence of like images spanning more than one instance in time.
  • An image frame is defined as the 2-dimensional collection of pixels arising within a given time period. It is well known that data from corresponding locations of temporally close image frames is likely to contain similar values. When this is true, compression is improved by encoding each of these like values only once.
  • multiple image frames are encoded by adding a motion flag (MF) to the block information of the first example.
  • This MF indicates whether or not data from each frame is encoded using separate Q codes. If no motion is indicated, the same Q codes are used to represent each frame of data. If motion is indicated, then separate Q codes are used to encode each frame.
  • Recovery methods fall into two categories: decoded domain, and encoded domain.
  • Decoded domain techniques restore portions of the image to its raw data format and then exploit local correlation properties to estimate the missing data.
  • Data recovery including recovery of compression constants, may be performed in the decoded domain.
  • additional computation and time, and therefore additional expense, is required to perform and evaluate decodings.
  • a lost/ damaged compression constant is recovered by determining at least one candidate compression constant, adjusting encoded data to a common scale, scoring the candidate compression constant using the adjusted encoded data, and selecting the candidate compression constant with the best score as the recovered compression constant.
  • the encoded data is adjusted by the addition of an offset.
  • the encoded data may have been randomized prior to the function which caused data loss (e.g., transmission/storage of the encoded data); therefore a derandomization process may be applied to the data.
  • a plurality of blocks may be processed wherein the scoring is performed across a plurality of blocks.
  • Figure la illustrates one embodiment of the system of the present invention
  • Figure lb illustrates another embodiment of the system of the present invention.
  • Figure 2 illustrates one embodiment of the method of the present invention.
  • Figure 3a illustrates one embodiment of randomization
  • Figures 3b, 3c and 3d illustrate alternate embodiments of a randomization process.
  • Figure 4 illustrates an example of complementary blocks of data.
  • Figure 5 illustrates an example of adjustment of encoded data to a common scale.
  • ADRC Adaptive Dynamic Range Coding
  • Figure la is a simplified functional block diagram of circuitry that may be utilized to implement the processes described herein.
  • the circuitry may be implemented in specially configured logic, such as large scale integration (LSI) logic or programmable gate arrays.
  • LSI large scale integration
  • the circuitry may be implemented in code executed by a specially configured or general purpose processor, which executes instructions stored in a memory or other storage device or transmitted across a transmission medium.
  • the present invention may be implemented as a combination of the above.
  • candidate determination logic 10 generates at least one possible candidate of the lost or damaged (lost/damaged) compression constant and corresponding candidate encoded data using the candidate compression constant.
  • the candidate data are stored in memory 15; alternately, the candidate data are not stored, but are simply output by candidate determination logic 10 to adjustment logic 25.
  • Derandomization logic 20 is optionally included to derandomize encoded data that had been randomized at the time the data was encoded. As will be explained more fully below, this optional process provides more information for candidate selection as incorrect candidates will tend to score very poorly and correct candidates score significantly.
  • Adjustment logic 25 adjusts the encoded data of a neighboring block and candidate encoded data determined using the candidate compression constant to a common scale.
  • the adjusted encoded data are input to scoring logic 30 which determines a score, for example, based upon correlation of neighboring data.
  • scoring logic 30 determines a score, for example, based upon correlation of neighboring data.
  • encoded data from a neighboring block is used to determine correlation.
  • Other embodiments of correlation may also be used.
  • Selection logic 35 selects the best scoring candidate as the recovered compression constant. The output of selection logic 35 is then used to decode the encoded data.
  • the process of decoding the encoded data using the compression constants varies according the encoding process used and will not be discussed in detail herein. However, the decoding process may similarly be implemented in specially configured or programmable logic or by a processor
  • Figure la is illustrative of logic utilized to process the candidate decodings serially. In another embodiment, sufficient logic and memory is provided to process the candidate decodings in parallel. Furthermore, other embodiments are also contemplated which include logic and memory for performing processes across multiple blocks. This will be described in more detail below.
  • FIG. lb An alternate embodiment of the circuit for recovering lost/damaged compression constants is shown in Figure lb.
  • the methods described herein can be implemented on a specially configured or general purpose processor. Instructions are stored in the memory 75 and accessed by the processor 70 to perform many of the steps described herein.
  • An input 65 receives the input bitstream and forwards the data to the processor 70 and the output 80 outputs data.
  • the output may consist of the decoded data, such as image data decoded once the compression constant is recovered, sufficient to drive an external device such as display 60.
  • the output 80 outputs the selected candidate decoding.
  • the recovered compression constant is then processed by processor 70 or input to other circuitry (not shown) to generate the decoded data.
  • Figure 2 is illustrative of one embodiment of a method for recovery of lost/damaged compression constants in accordance with the teachings of the present invention.
  • the candidate compression constants and corresponding candidate encodings are determined.
  • candidate encodings are accessed from the bitstream in accordance with a particular candidate compression constant.
  • the candidate encodings for each candidate decoding can be determined serially, as is shown in Figure 2. Alternately the candidate data for all candidate decodings can be determined in one step at the beginning of the process.
  • candidate MF or Qbit values are used to identify the corresponding Q codes from the bitstream(referred to herein as candidate Q codes).
  • a derandomization process is applied to the candidate Q codes determined in step 210. Derandomization will be applied if the original data was randomized at the time of encoding. The randomization pattern is chosen based on the values for the compression constants.
  • Randomization may be applied to destroy the correlation of incorrect candidate decodings.
  • the randomization process does not change the properties of the correct candidate, as it is restored to its original condition.
  • subsequent derandomized data will tend to result in candidate decodings that exhibit highly correlated properties indicative that a good candidate decoding is selected, or highly uncorrelated properties indicative that the corresponding candidate decoding is not a good selection.
  • the randomization process is chosen such that a correct derandomization results in a candidate decoding exhibiting highly correlated properties and an incorrect derandomization results in a decoding exhibiting uncorrelated properties.
  • Encoding parameters may be used to perform the randomization and derandomization processors.
  • randomization is achieved using a code reallocation process.
  • reallocation is performed using a masking key.
  • a key referred to herein as KEY
  • KEY is used to mask a bitstream of Q codes.
  • KEY may be used to mask a bitstream of Q codes corresponding to three blocks of data.
  • Each key element (dj) of the masking key is generated by the combination of certain compression constants, used to encode a corresponding block of data.
  • the MF and Qbit values are used to define KEY.
  • KEY is formed according to the following:
  • the result of the process is a randomization of Q codes, for example, as shown in Figure 3a.
  • bit reallocation is achieved by simple bit weight inversion.
  • the inversion pattern is determined according to the number of bits used for encoding (e.g., Qbit). This randomization process can improve recovery of MF and Qbit values. Examples are shown in Figures 3b, 3c and 3d.
  • Figure 3b illustrates a bit reallocation process for 2 bit encoding
  • Figure 3c illustrates a bit reallocation process for a 3 bit encoding
  • Figure 3d illustrates a bit reallocation process for a 4 bit encoding.
  • the randomization process can be performed individually or together.
  • the bit reallocation process can be applied to the data followed by application of the code reallocation process to the bit reallocated data.
  • the candidate Q codes of the block and the Q codes of a neighboring block having undamaged compression constants are adjusted to a common scale. This overcomes the problems that may arise if the two blocks have different Qbit values such that the Q codes of the two blocks may not correspond to the same relative quantization levels.
  • the adjustment process recalibrates the Q codes to common levels for comparison.
  • Figure 4 illustrates two blocks that originate from overlapping areas of an image portion; it is reasonable to assume that these two blocks have similar DR and MIN values. If the two blocks have similar DR and MIN values, a natural correspondence arises between the Q codes of the first block and the Q codes of the second block. This correspondence is better evaluated by mapping to a common scale.
  • the Qbit number Q is taken from the set ⁇ 0,1...4 ⁇ , uniform quantization levels are used and all Q codes are adjusted to the range as shown in Figure 5.
  • the adjusted Q codes of the first block e.g., the candidate encoded values
  • the adjusted Q codes of the second block e.g., encoded value of a neighboring block
  • the adjustment is simply the difference between MIN values.
  • the MIN values may not be known and therefore it is preferable to estimate the difference.
  • q ⁇ and q2 may respectively represent the mean or median or some other function of adjusted Q code values from the first block and second block.
  • the average is taken over all the Q codes in a block.
  • a weighted average is computed wherein a Q code is counted once for each boundary it shares with a pixel from the other, i.e.., complementary, block.
  • a Q code is counted once for each boundary it shares with a pixel from the other, i.e.., complementary, block.
  • those Q codes may be omitted form the average calculation.
  • the constant term 2 4 ⁇ Q is omitted from the above equation, then it will be absorbed into the constant o in the subsequent equation. This leads to a more streamlined equation.
  • o might be defined as an approximation of the average difference. For example,
  • index set I counts over to the set of usable neighboring relations and N is approximately the number of elements in I . This approximation may be used to reduce the complexity of the computation of o .
  • the score for each candidate is measured and may be stored.
  • the score is a measure indicative of local correlation.
  • the most highly correlated candidate is the most likely candidate.
  • measures can be used, including horizontal correlation, vertical correlation, smoothness and spatial activity.
  • a measure of correlation may include absolute difference or linear error. The absolute difference is determined by calculating the total absolute difference of adjacent Q codes of adjacent blocks.
  • the absolute difference is determined according to the following:
  • AE represents the absolute difference measure
  • c ⁇ t represents the adjusted Q code value of the i-th Q code of the first block
  • a,' represents the adjusted Q code value of the i-th Q code of the second block.
  • a small AE value indicates a high degree of local correlation. Conversely, a large AE value indicates a lack of local correlation. Therefore, the candidate with the smallest absolute error is the most likely candidate.
  • the AE of the correct decoding is a fixed number.
  • the AE of the other candidates depends on how the bitstream is read.
  • the randomization/ derandomization processes e.g., step 220
  • the AE subsequently determined during decoding can be raised so that the distinction between the correct candidate and incorrect candidates is clear.
  • derandomization using incorrect candidates will result in random Q codes rendering typically a large AE compared to the AE corresponding to the correct candidate.
  • the randomization and therefore subsequent derandomization processes can be extended to multiple, e.g., three, blocks. If a single randomization sequence is applied to a bitstream composed of a group of encoded blocks, then either all the Q codes arising from these blocks will be correctly decoded or none of these Q codes will be correctly decoded. This all-or- none approach can be used to improve the performance of the decoder. Since there are multiple blocks on which to base the decision of which candidate is correct, the probability of making an incorrect decision may be quite small. However, if more than one damaged Qbit or MF value exists in the group of blocks, the number of candidates is multiplicative, therefore increasing the amount of computation required. One way to process is to sum the AE measurements from each block in the group. The candidate corresponding to the smallest sum may then be selected as the proper decoding.
  • the process can be extended to use the correlation information with respect to multiple neighboring blocks.
  • an offset is determined for each neighboring block relative to the encoded block to compensate for that block's MIN and/or DR value. Correlation can then be determined using the above described equations wherein the set of usable neighboring values includes values from more than one neighboring block.
  • the present invention may be used with any form of correlated data, including without limitation photographs or other two-dimensional static images, holograms, or other three-dimensional static images, video or other two-dimensional moving images, three-dimensional moving images, a monaural sound stream, or sound separated into a number of spatially related streams, such as stereo.

Abstract

The system and method provides an innovative technique for recovering lost or damaged compression constants in the encoded domain. In one embodiment, a lost/damaged compression constant is recovered by determining (210) at least one candidate compression constant, adjusting encoded (230) data to a common scale, scoring (250) the candidate compression constant using the adjusted encoded data, and selecting (260) the candidate compression constant with the best score as the recovered compression constant.

Description

METHOD AND APPARATUS FOR THE RECOVERY OF COMPRESSION CONSTANTS IN THE ENCODED DOMAIN
BACKGROUND OF THE INVENTION
1. FIELD OF THE INVENTION
The present invention relates to the recovery of data. More particularly, the present invention relates to the recovery of lost/damaged compression constants in a bitstream of compressed data.
2. ART BACKGROUND
It is often desirable to compress data, such as video images or sound data, for transmission and storage. Typically, when data is compressed, compression constants are generated. These constants are transmitted or stored along with the compressed image. Problems can arise if the compression constants are lost or damaged prior to decompression of the data. As an illustration, the discussion below illustrates the problems that arise if image data compression constants are lost.
The discrete data points that make up a digital image are known as pixels. Typically, each pixel is represented independently using 8 bits, but other representations also are used for the purposes of compression or analysis. Most of the alternative representations begin by dividing this raw data into disjoint sets. For historical reasons, these sets are referred to as "blocks", even though they may not have a traditional block shape. The alternative representation then characterizes the data by some block-wide information and per-pixel information.
Examples of block-wide information include the minimum pixel value (MIN), the maximum pixel value (MAX), and the dynamic range of the pixel values (DR). Per-pixel information may indicate where the pixel value lies within the range specified by the global information. For compression to be achieved, the per- pixel information must use only a few bits of storage so that the total number of bits used is less than that required to store the raw image. In one example, the block data is comprised of the MIN, DR and Qbit number (defined below), and the pixel data is comprised of Q codes. A Q code is an integer in the range [0,2Q-1] that identifies one value in the set {MIN, MIN+1, ....,MAX}. Since the Qbit number is generally small and the DR value may be relatively large, it is generally not possible to represent all pixel values exactly. Therefore, some quantization error is introduced when pixel values are reduced to Q code values. For instance, if the Qbit number is 3, then it is generally possible to represent 23 = 8 values from the set {MIN, MIN+1, ...,MAX} without any error. Pixels with other values are rounded to one of these eight values. This rounding introduces quantization error.
Temporal compression is feasible for a sequence of like images spanning more than one instance in time. An image frame is defined as the 2-dimensional collection of pixels arising within a given time period. It is well known that data from corresponding locations of temporally close image frames is likely to contain similar values. When this is true, compression is improved by encoding each of these like values only once.
In a second example, multiple image frames are encoded by adding a motion flag (MF) to the block information of the first example. This MF indicates whether or not data from each frame is encoded using separate Q codes. If no motion is indicated, the same Q codes are used to represent each frame of data. If motion is indicated, then separate Q codes are used to encode each frame.
If any of the block information is lost, the damage to the image is potentially large since many pixels are affected. For this reason, it is desirable to have techniques for estimating the values of this lost data. For example, if the MF value is damaged, there are two possible interpretations of the input bitstream. One interpretation expects the same Q codes to be used for both frames, and the second interpretation expects the frames to use different Q codes. If the wrong interpretation is chosen, then all the pixels in the block are potentially damaged. Even worse, all the pixels in subsequent blocks could be damaged since the decoder has lost its place in the bitstream. For this reason it is important to have a highly accurate recovery method.
Recovery methods fall into two categories: decoded domain, and encoded domain. Decoded domain techniques restore portions of the image to its raw data format and then exploit local correlation properties to estimate the missing data. Data recovery, including recovery of compression constants, may be performed in the decoded domain. However, additional computation and time, and therefore additional expense, is required to perform and evaluate decodings. SUMMARY OF THE INVENTION
The system and method of the present invention provides an innovative technique for recovering lost or damaged (lost/damaged) compression constants in the encoded domain. In one embodiment, a lost/ damaged compression constant is recovered by determining at least one candidate compression constant, adjusting encoded data to a common scale, scoring the candidate compression constant using the adjusted encoded data, and selecting the candidate compression constant with the best score as the recovered compression constant. In one embodiment, the encoded data is adjusted by the addition of an offset. Furthermore, in another embodiment, the encoded data may have been randomized prior to the function which caused data loss (e.g., transmission/storage of the encoded data); therefore a derandomization process may be applied to the data. In another embodiment, a plurality of blocks may be processed wherein the scoring is performed across a plurality of blocks. BRIEF DESCRIPTION OF THE DRAWINGS
The objects, features and advantages of the present invention will be apparent from the following detailed description in which:
Figure la illustrates one embodiment of the system of the present invention, and Figure lb illustrates another embodiment of the system of the present invention.
Figure 2 illustrates one embodiment of the method of the present invention. Figure 3a illustrates one embodiment of randomization, Figures 3b, 3c and 3d illustrate alternate embodiments of a randomization process.
Figure 4 illustrates an example of complementary blocks of data.
Figure 5 illustrates an example of adjustment of encoded data to a common scale. DETAILED DESCRIPTION
In the following description, for purposes of explanation, numerous details are set forth in order to provide a thorough understanding of the present invention. However, it will be apparent to one skilled in the art that these specific details are not required in order to practice the present invention. In other instances, well known electrical structures and circuits are shown in block diagram form in order not to obscure the present invention unnecessarily.
The following is described in the context of Adaptive Dynamic Range Coding (ADRC) encoded images, and more particularly to the recovery of lost or damaged (lost/damaged) motion flag (MF) and/or Qbit values. However, it is contemplated that the present invention is not limited to ADRC encoding and the particular compression constants generated; rather it will be apparent that the present invention is applicable to different compression technologies and different types of data, including, but not limited to, sound data and the like.
One embodiment of the system of the present invention is illustrated in Figure la. Figure la is a simplified functional block diagram of circuitry that may be utilized to implement the processes described herein. For example, the circuitry may be implemented in specially configured logic, such as large scale integration (LSI) logic or programmable gate arrays. Alternately, as is illustrated in Figure lb, the circuitry may be implemented in code executed by a specially configured or general purpose processor, which executes instructions stored in a memory or other storage device or transmitted across a transmission medium. Furthermore, the present invention may be implemented as a combination of the above.
Referring to Figure la, candidate determination logic 10, generates at least one possible candidate of the lost or damaged (lost/damaged) compression constant and corresponding candidate encoded data using the candidate compression constant. In one embodiment, the candidate data are stored in memory 15; alternately, the candidate data are not stored, but are simply output by candidate determination logic 10 to adjustment logic 25.
Derandomization logic 20 is optionally included to derandomize encoded data that had been randomized at the time the data was encoded. As will be explained more fully below, this optional process provides more information for candidate selection as incorrect candidates will tend to score very poorly and correct candidates score significantly.
Adjustment logic 25, adjusts the encoded data of a neighboring block and candidate encoded data determined using the candidate compression constant to a common scale.
The adjusted encoded data are input to scoring logic 30 which determines a score, for example, based upon correlation of neighboring data. In one embodiment, encoded data from a neighboring block is used to determine correlation. Other embodiments of correlation may also be used.
Selection logic 35 selects the best scoring candidate as the recovered compression constant. The output of selection logic 35 is then used to decode the encoded data. The process of decoding the encoded data using the compression constants varies according the encoding process used and will not be discussed in detail herein. However, the decoding process may similarly be implemented in specially configured or programmable logic or by a processor
Figure la is illustrative of logic utilized to process the candidate decodings serially. In another embodiment, sufficient logic and memory is provided to process the candidate decodings in parallel. Furthermore, other embodiments are also contemplated which include logic and memory for performing processes across multiple blocks. This will be described in more detail below.
An alternate embodiment of the circuit for recovering lost/damaged compression constants is shown in Figure lb. The methods described herein can be implemented on a specially configured or general purpose processor. Instructions are stored in the memory 75 and accessed by the processor 70 to perform many of the steps described herein. An input 65 receives the input bitstream and forwards the data to the processor 70 and the output 80 outputs data.
In one embodiment, the output may consist of the decoded data, such as image data decoded once the compression constant is recovered, sufficient to drive an external device such as display 60. In another embodiment, the output 80 outputs the selected candidate decoding. The recovered compression constant is then processed by processor 70 or input to other circuitry (not shown) to generate the decoded data.
Figure 2 is illustrative of one embodiment of a method for recovery of lost/damaged compression constants in accordance with the teachings of the present invention. At step 210, the candidate compression constants and corresponding candidate encodings are determined. In one embodiment, candidate encodings are accessed from the bitstream in accordance with a particular candidate compression constant. The candidate encodings for each candidate decoding can be determined serially, as is shown in Figure 2. Alternately the candidate data for all candidate decodings can be determined in one step at the beginning of the process. In the present embodiment, candidate MF or Qbit values (depending upon the constant to be recovered) are used to identify the corresponding Q codes from the bitstream(referred to herein as candidate Q codes).
Optionally, a derandomization process, step 220, is applied to the candidate Q codes determined in step 210. Derandomization will be applied if the original data was randomized at the time of encoding. The randomization pattern is chosen based on the values for the compression constants.
Randomization may be applied to destroy the correlation of incorrect candidate decodings. The randomization process does not change the properties of the correct candidate, as it is restored to its original condition. In particular, by utilizing randomization across multiple blocks, subsequent derandomized data will tend to result in candidate decodings that exhibit highly correlated properties indicative that a good candidate decoding is selected, or highly uncorrelated properties indicative that the corresponding candidate decoding is not a good selection. The randomization process is chosen such that a correct derandomization results in a candidate decoding exhibiting highly correlated properties and an incorrect derandomization results in a decoding exhibiting uncorrelated properties. Encoding parameters may be used to perform the randomization and derandomization processors.
In one embodiment, randomization is achieved using a code reallocation process. In one embodiment, reallocation is performed using a masking key. Thus, during the encoding process, a key, referred to herein as KEY, is used to mask a bitstream of Q codes. KEY may be used to mask a bitstream of Q codes corresponding to three blocks of data. Each key element (dj) of the masking key is generated by the combination of certain compression constants, used to encode a corresponding block of data.
For example, in one embodiment, the MF and Qbit values are used to define KEY. Alternately, the masking key is generated from DR and MIN values. More particularly, for 4 bit ADRC encoding which uses MF and Qbit values to generate KEY, the value of the key elements composing KEY are determined in accordance with the following equation: di = 5 -mi + qj where i=0, 1, 2 and qi represents the number of quantization bits; qj = 0, 1, 2, 3, 4 and mj represents the motion flag (MF) value, for example, 0 for a stationary block and 1 for a motion block.
Continuing with the present example, if KEY is generated using three blocks, KEY is formed according to the following:
Figure imgf000009_0001
The result of the process is a randomization of Q codes, for example, as shown in Figure 3a.
It therefore follows that during recovery of MF or Qbit data, a bit derandomization process is performed in which possible KEY values are regenerated depending upon the values used to create the masking keys. The regenerated KEY values are used to unmask the received bitstream of Q codes resulting in candidate encoded data. Thus, if the MF or Qbit value used to generate the mask is not correct, the corresponding Q codes will exhibit a low level of correlation, which will be typically readily detectable.
In another embodiment, a randomization process, referred to herein as bit reallocation, is applied to the data. In one embodiment, bit reallocation is achieved by simple bit weight inversion. The inversion pattern is determined according to the number of bits used for encoding (e.g., Qbit). This randomization process can improve recovery of MF and Qbit values. Examples are shown in Figures 3b, 3c and 3d. Figure 3b illustrates a bit reallocation process for 2 bit encoding, Figure 3c illustrates a bit reallocation process for a 3 bit encoding and Figure 3d illustrates a bit reallocation process for a 4 bit encoding.
In another embodiment, the randomization process can be performed individually or together. For example, the bit reallocation process can be applied to the data followed by application of the code reallocation process to the bit reallocated data.
Referring back to Figure 2, at step 230, the candidate Q codes of the block and the Q codes of a neighboring block having undamaged compression constants are adjusted to a common scale. This overcomes the problems that may arise if the two blocks have different Qbit values such that the Q codes of the two blocks may not correspond to the same relative quantization levels. The adjustment process recalibrates the Q codes to common levels for comparison.
The problem this step of the process addresses may be better understood by reference to Figure 4. Figure 4 illustrates two blocks that originate from overlapping areas of an image portion; it is reasonable to assume that these two blocks have similar DR and MIN values. If the two blocks have similar DR and MIN values, a natural correspondence arises between the Q codes of the first block and the Q codes of the second block. This correspondence is better evaluated by mapping to a common scale. In one embodiment, if the Qbit number Q is taken from the set {0,1...4}, uniform quantization levels are used and all Q codes are adjusted to the range as shown in Figure 5. Thus one possible adjustment is performed according to the following: c j = adj(e) = 2^ - e + 2<-Q where e represents the original Q code value, ^. represents the adjusted Q code value and Q represents the Qbit number.
Alternately, a more general approach can be taken by assuming that the DR values are the same and to adjust for possible differences in MIN values. Thus, continuing with the above example, the adjusted Q codes of the first block, e.g., the candidate encoded values, would remain in the range of 0-32, but the adjusted Q codes of the second block, e.g., encoded value of a neighboring block, would be in the range [o, 32+o] where o represents an offset.
If both the MIN values are known, then the adjustment is simply the difference between MIN values. However, the MIN values may not be known and therefore it is preferable to estimate the difference. One such estimation is the difference in average adjusted Q code values for the two blocks, determined as: o = q\ - q2 where o represents the offset, ql is the average of adjusted Q code values from the first block and q2 is the average of adjusted Q code values from the second block. Alternately, q\ and q2 may respectively represent the mean or median or some other function of adjusted Q code values from the first block and second block. In one embodiment, the average is taken over all the Q codes in a block. In another embodiment, a weighted average is computed wherein a Q code is counted once for each boundary it shares with a pixel from the other, i.e.., complementary, block. In addition, if some Q codes are lost/ damaged, those Q codes may be omitted form the average calculation.
Using the offset, the adjusted Q codes may be defined as: a 1 = adj( el ) a2 = adj(e2) + o where al represents the adjusted value of a Q code value from the first block, and al represents the adjusted value of a Q code value from the second block, and adj(eϊ),adj(e2) represents adjusted Q code values for the first block and the second block and correspond to the equation adj(e) defined above. In addition, if the constant term 24~Q is omitted from the above equation, then it will be absorbed into the constant o in the subsequent equation. This leads to a more streamlined equation. In an alternate embodiment, o might be defined as an approximation of the average difference. For example,
Figure imgf000012_0001
where the index set I counts over to the set of usable neighboring relations and N is approximately the number of elements in I . This approximation may be used to reduce the complexity of the computation of o .
At step 240 in Figure 2, the score for each candidate is measured and may be stored. The score is a measure indicative of local correlation. The most highly correlated candidate is the most likely candidate. A variety of measures can be used, including horizontal correlation, vertical correlation, smoothness and spatial activity. In addition, a measure of correlation may include absolute difference or linear error. The absolute difference is determined by calculating the total absolute difference of adjacent Q codes of adjacent blocks.
In one embodiment, the absolute difference is determined according to the following:
Figure imgf000012_0002
where AE represents the absolute difference measure, cιt represents the adjusted Q code value of the i-th Q code of the first block and a,' represents the adjusted Q code value of the i-th Q code of the second block. A small AE value indicates a high degree of local correlation. Conversely, a large AE value indicates a lack of local correlation. Therefore, the candidate with the smallest absolute error is the most likely candidate.
The AE of the correct decoding is a fixed number. The AE of the other candidates, however, depends on how the bitstream is read. As noted earlier, the randomization/ derandomization processes (e.g., step 220) assist in the determination of the correct candidate. By randomizing the bitstream during the encoding process using the correct Qbit and MF values, the AE subsequently determined during decoding can be raised so that the distinction between the correct candidate and incorrect candidates is clear. In particular, derandomization using incorrect candidates will result in random Q codes rendering typically a large AE compared to the AE corresponding to the correct candidate.
In an alternate embodiment, the randomization and therefore subsequent derandomization processes can be extended to multiple, e.g., three, blocks. If a single randomization sequence is applied to a bitstream composed of a group of encoded blocks, then either all the Q codes arising from these blocks will be correctly decoded or none of these Q codes will be correctly decoded. This all-or- none approach can be used to improve the performance of the decoder. Since there are multiple blocks on which to base the decision of which candidate is correct, the probability of making an incorrect decision may be quite small. However, if more than one damaged Qbit or MF value exists in the group of blocks, the number of candidates is multiplicative, therefore increasing the amount of computation required. One way to process is to sum the AE measurements from each block in the group. The candidate corresponding to the smallest sum may then be selected as the proper decoding.
In another embodiment in which a block having a damaged Qbit or MF flag value is adjacent to multiple neighboring blocks, the process can be extended to use the correlation information with respect to multiple neighboring blocks. In this embodiment, an offset is determined for each neighboring block relative to the encoded block to compensate for that block's MIN and/or DR value. Correlation can then be determined using the above described equations wherein the set of usable neighboring values includes values from more than one neighboring block.
Although the present invention is discussed with respect to image data, the present invention may be used with any form of correlated data, including without limitation photographs or other two-dimensional static images, holograms, or other three-dimensional static images, video or other two-dimensional moving images, three-dimensional moving images, a monaural sound stream, or sound separated into a number of spatially related streams, such as stereo.
The invention has been described in conjunction with the preferred embodiment. It is evident that numerous alternatives, modifications, variations and uses will be apparent to those skilled in the art in light of the foregoing description.

Claims

CLAIMSWhat is claimed is:
1. A method for recovery of lost compression constants of encoded data, said method comprising the steps of: determining (210) a plurality of candidate compression constants; accessing (220) candidate encoded data corresponding to each candidate compression constant; adjusting (230) candidate encoded data and neighboring encoded data to a common scale; scoring (240) at least one candidate compression constant using the adjusted encoded data; and selecting (260) as the compression constant the candidate compression constant corresponding to the best score.
2. The method as set forth in claim 1, wherein the step of determining uses candidate compression constants in the range of allowable values.
3. The method as set forth in claim 1, wherein the step of determining uses candidate compression constants in the range of allowable quantization bit numbers.
4. The method as set forth in claim 1, wherein the encoded data is generated by ADRC encoding.
5. The method as set forth in claim 1, wherein the encoded data is selected from the group consisting of image data and sound data.
6. The method as set forth in claim 1, wherein the step of accessing uses candidate compression constants that correspond to a number of bits remaining to decode.
7. The method as set forth in claim 1, wherein at least one of the candidate encoded data and neighboring encoded data are adjusted by an addition of an offset.
8. The method as set forth in claim 7, wherein the offset is determined according to the following equation: o = ave(q,)- ave(q,' ) where o represents the offset, qx represents candidate encoded data, q represents neighboring encoded data and ave represents a function selected from the group of average, mean and median functions.
9. The method of claim 7, wherein the offset is determined from the candidate encoded data and neighboring encoded data.
10. The method as set forth in claim 7, wherein the offset is determined as an approximation of an average difference between candidate encoded data and neighboring encoded data.
11. The method as set forth in claim 7, wherein the offset is determined according to the following equation:
Figure imgf000016_0001
where o represents the offset, N represents an approximation of the number of elements in the set I of usable neighboring encoded data, qt represents candidate encoded data, and <?,' represents neighboring encoded data.
12. The method as set forth in claim 1, wherein the step of scoring comprises the step of determining a measure of correlation.
13. The method as set forth in claim 12, wherein the encoded data comprises image data and the measure is related to local image correlation.
14. The method as set forth in claim 12, wherein the measure of correlation is determined from a difference function between candidate encoded data and neighboring encoded data.
15. The method as set forth in claim 12, wherein the measure is determined according to the following equation:
Figure imgf000016_0002
where AE represents an absolute error measure related to local image correlation, at represents the adjusted Q code value of the candidate encoded data, and a ' represents the adjusted Q code value of the neighboring encoded data and / represents a set of usable neighboring encoded data.
16. The method as set forth in claim 1, wherein the encoded data is randomized, said method further comprising the step of derandomizing the randomized encoded data.
17. The method as set forth in claim 16, wherein the step of derandomizing comprises the steps of: using at least one candidate compression constant to define a randomization pattern; and derandomizing the randomized encoded data using the randomization pattern.
18. The method as set forth in claim 16, wherein the step of derandomizing comprises the step of performing a bit reallocation process of the randomized encoded data.
19. The method as set forth in claim 16, wherein the encoded data comprises a plurality of blocks, and said step of performing derandomization is applied to the plurality of blocks.
20. The method as set forth in claim 1, wherein the step of scoring at least one candidate compression constant is performed in parallel for each of a plurality of candidate compression constants.
21. The method as set forth in claim 1, wherein the neighboring encoded data comprises a plurality of blocks, said step of scoring comprises the step of determining a measure of a level of correlation across the plurality of blocks.
22. A system for recovering lost compression constants of encoded data comprising: an input configured to received the encoded data; candidate logic (10) configured to determine a plurality of candidate compression constants and corresponding candidate encoded data; adder logic (25) configured to adjust the candidate encoded data and neighboring encoded data to a common scale; scoring logic (30) configured to score the candidate compression constants using the adjusted encoded data; select logic (35) configured to select as the compression constant the candidate compression constant corresponding to the best score.
23. The system as set forth in claim 22, wherein the candidate logic, adder logic, scoring logic and select logic is configured in at least one ASIC.
24. The system as set forth in claim 22, wherein the candidate logic, adder logic, scoring logic and select logic is configured in at least one large scale integration (LSI) component.
25. The system as set forth in claim 22, wherein at least one of the candidate encoded data and neighboring encoded data are adjusted by addition of an offset.
26. The system as set forth in claim 22, wherein the encoded data is selected from the group consisting of image data and sound data.
27. The system as set forth in claim 22, wherein the candidate logic uses candidate compression constants in the range of allowable quantization bit numbers.
28. The system as set forth in claim 22, wherein the encoded data is generated by ADRC encoding.
29. The system as set forth in claim 25, wherein the offset is determined according to the following equation: o = ave{q)- ave{q; ) where o represents the offset, q, represents candidate encoded data, q,' represents neighboring encoded data and ave represents an average function selected from the group of average, mean and median functions.
30. The system of claim 25, wherein the offset is determined from the encoded data and neighboring encoded data.
31. The system as set forth in claim 25, wherein the offset is determined as an approximation of an average difference between encoded data and neighboring encoded data.
32. The system as set forth in claim 25, wherein the offset is determined according to the following equation:
Figure imgf000019_0001
where o represents the offset, N represents an approximation of the number of elements in the set of I of usable neighboring encoded data, qt represents encoded data, and <?,' represents neighboring encoded data.
33. The system as set forth in claim 22, wherein the scoring logic is configured to determine a measure of correlation.
34. The system as set forth in claim 33, wherein the encoded data comprises image data and the measure is related to local image correlation.
35. The system as set forth in claim 33, wherein the measure of correlation is determined from a difference function between encoded data and neighboring encoded data.
36. The system as set forth in claim 33, wherein the measure is determined according to the following equation:
Figure imgf000019_0002
where AE represents an absolute error measure related to local image correlation, at represents the adjusted Q code value of the candidate encoded data, and α ' represents the adjusted Q code value of the neighboring encoded data and I represents a set of usable neighboring encoded data.
37. The system as set forth in claim 22, wherein the encoded data is randomized, said system further comprising derandomization logic configured to derandomized the randomized encoded data.
38. The system as set forth in claim 37, wherein the derandomization logic is configured to use a candidate compression constant to define a randomization pattern and derandomize the randomized encoded data using the randomization pattern.
39. The system as set forth in claim 37, wherein the derandomization logic is configured to perform a bit reallocation to derandomize the randomized encoded data.
40. The system as set forth in claim 37, wherein the encoded data comprises a plurality of blocks, said derandomization logic processing the plurality of blocks.
41. The system as set forth in claim 22, wherein the scoring logic is configured to execute parallel processes for each of a plurality of candidate compression constants.
42. The system as set forth in claim 22, wherein the neighboring encoded data comprises a plurality of blocks, and said scoring logic is configured to determine a measure of a level of correlation across the plurality of blocks.
43. The system as set forth in claim 22, wherein a processor comprises the candidate logic, adder logic, scoring logic and select logic.
44. A computer readable medium containing executable instructions, which, when executed in a processing system, causes the system to perform the steps for recovery of lost/ damaged compression constants of encoded data, comprising : determining (210) a plurality of candidate compression constants; accessing (220) candidate encoded data corresponding to each candidate compression constant; adjusting (230)candidate encoded data and neighboring encoded data to a common scale; scoring (240) at least one candidate compression constant using the adjusted encoded data; and selecting (260) as the compression constant the candidate compression constant corresponding to the best score.
45. The computer readable medium as set forth in claim 44, wherein the encoded data is selected from the group consisting of image data and sound data.
46. The computer readable medium as set forth in claim 44, wherein the encoded data and neighboring encoded data are adjusted by addition of an offset and the offset is determined according to the following equation: o = αve (<?.)- ave{qj' ) where o represents the offset, qx represents candidate encoded data, q,' represents neighboring encoded data and ave represents an average function.
47. The computer readable medium as set forth in claim 44, wherein the candidate encoded data and neighboring encoded data are adjusted by addition of an offset and the offset is determined from the candidate encoded data and neighboring encoded data.
48. The computer readable medium as set forth in claim 44, wherein the candidate encoded data and neighboring encoded data are adjusted by addition of an offset and the offset is determined as an approximation of an average difference between candidate encoded data and neighboring encoded data.
49. The computer readable medium as set forth in claim 44, wherein the step of determining uses candidate compression constants in the range of allowable quantization bit numbers.
50. The computer readable medium as set forth in claim 44, wherein the encoded data is generated by ADRC encoding.
51. The computer readable medium as set forth in claim 44, wherein the candidate encoded data and neighboring encoded data are adjusted by addition of an offset and the offset is determined according to the following equation:
Figure imgf000021_0001
where o represents the offset, N represents an approximation of the number of elements in the set / of usable neighboring encoded data, qt represents candidate encoded data, and <?,' represents neighboring encoded data.
52. The computer readable medium as set forth in claim 44, wherein the scoring is performed by determining a measure of a level of correlation.
53. The computer readable medium as set forth in claim 52, wherein the measure is determined according to the following equation:
Figure imgf000022_0001
where AE represents an absolute error measure related to local image correlation, a, represents the adjusted Q code value of the candidate encoded data, and a,' represents the adjusted Q code value of the neighboring encoded data and / represents a set of usable neighboring encoded data.
54. The computer readable medium as set forth in claim 52, wherein the measure of correlation is determined from a difference function between candidate encoded data and neighboring encoded data.
55. The computer readable medium as set forth in claim 52, wherein the encoded data comprises image data and the measure is related to local image correlation.
56. The computer readable medium as set forth in claim 44, wherein the encoded data is randomized, and further comprising instructions, which when executed, derandomize the randomized encoded data.
57. The computer readable medium as set forth in claim 44, wherein scoring at least one candidate compression constant is performed in parallel for each of a plurality of candidate compression constants.
58. The computer readable medium as set forth in claim 44, wherein the neighboring encoded data comprises a plurality of blocks, and scoring determines a measure of a level of correlation across the plurality of blocks.
59. An apparatus for recovery of lost compression constants of encoded data, said method comprising the steps of: means for determining (210) a plurality of candidate compression constants; means for accessing (220) candidate encoded data corresponding to each candidate compression constant; means for adjusting (230) candidate encoded data and neighboring encoded data to a common scale; means for scoring (240) at least one candidate compression constant using the adjusted encoded data; and means for selecting (260) as the compression constant the candidate compression constant corresponding to the best score.
60. The apparatus as set forth in claim 59, wherein at least one of the candidate encoded data and neighboring encoded data are adjusted by an addition of an offset.
61. The apparatus as set forth in clam 59, wherein the encoded data is randomized, said apparatus further comprising a means for randomizing the randomized encoded data.
PCT/US2000/003595 1999-02-12 2000-02-10 Method and apparatus for the recovery of compression constants in the encoded domain WO2000048116A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU33619/00A AU3361900A (en) 1999-02-12 2000-02-10 Method and apparatus for the recovery of compression constants in the encoded domain

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US09/250,032 US6178266B1 (en) 1999-02-12 1999-02-12 Method and apparatus for the recovery of compression constants in the encoded domain
US09/250,032 1999-02-12

Publications (1)

Publication Number Publication Date
WO2000048116A1 true WO2000048116A1 (en) 2000-08-17

Family

ID=22946029

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US2000/003595 WO2000048116A1 (en) 1999-02-12 2000-02-10 Method and apparatus for the recovery of compression constants in the encoded domain

Country Status (3)

Country Link
US (1) US6178266B1 (en)
AU (1) AU3361900A (en)
WO (1) WO2000048116A1 (en)

Families Citing this family (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6686955B1 (en) * 1999-01-29 2004-02-03 International Business Machines Corporation Lightweight image manipulation for maximizing the capacity of digital photo storage media
US6700934B2 (en) 2001-03-14 2004-03-02 Redrock Semiconductor, Ltd. Error detection using a maximum distance among four block-motion-vectors in a macroblock in a corrupted MPEG-4 bitstream
US9307122B2 (en) * 2006-09-27 2016-04-05 Core Wireless Licensing S.A.R.L. Method, apparatus, and computer program product for providing motion estimation for video encoding

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5241381A (en) * 1990-08-31 1993-08-31 Sony Corporation Video signal compression using 2-d adrc of successive non-stationary frames and stationary frame dropping
US5594807A (en) * 1994-12-22 1997-01-14 Siemens Medical Systems, Inc. System and method for adaptive filtering of images based on similarity between histograms

Family Cites Families (73)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US3311879A (en) 1963-04-18 1967-03-28 Ibm Error checking system for variable length data
US3805232A (en) 1972-01-24 1974-04-16 Honeywell Inf Systems Encoder/decoder for code words of variable length
FR2387557A1 (en) 1977-04-14 1978-11-10 Telediffusion Fse NOISE VISIBILITY REDUCTION SYSTEMS ON TELEVISION IMAGES
GB2073534B (en) 1980-04-02 1984-04-04 Sony Corp Error concealment in digital television signals
GB2084432A (en) 1980-09-18 1982-04-07 Sony Corp Error concealment in digital television signals
US4574393A (en) * 1983-04-14 1986-03-04 Blackwell George F Gray scale image processor
JPH0746864B2 (en) 1984-08-22 1995-05-17 ソニー株式会社 High efficiency encoder
DE3582314D1 (en) 1984-12-19 1991-05-02 Sony Corp HIGH-PERFORMANCE TECHNOLOGY FOR ENCODING A DIGITAL VIDEO SIGNAL.
JPH0793724B2 (en) 1984-12-21 1995-10-09 ソニー株式会社 High efficiency coding apparatus and coding method for television signal
JP2512894B2 (en) 1985-11-05 1996-07-03 ソニー株式会社 High efficiency coding / decoding device
JP2670259B2 (en) 1985-11-29 1997-10-29 ソニー株式会社 High efficiency coding device
JPH0746862B2 (en) 1985-11-30 1995-05-17 ソニー株式会社 Frame dropping compression encoding and decoding method
JP2612557B2 (en) 1985-12-18 1997-05-21 ソニー株式会社 Data transmission receiving system and data decoding device
JPS62231569A (en) 1986-03-31 1987-10-12 Fuji Photo Film Co Ltd Quantizing method for estimated error
JP2751201B2 (en) 1988-04-19 1998-05-18 ソニー株式会社 Data transmission device and reception device
JP2508439B2 (en) 1987-05-29 1996-06-19 ソニー株式会社 High efficiency encoder
DE3869475D1 (en) 1987-06-02 1992-04-30 Siemens Ag METHOD FOR DETERMINING MOTION VECTOR FIELDS FROM DIGITAL IMAGE SEQUENCES.
US5122873A (en) 1987-10-05 1992-06-16 Intel Corporation Method and apparatus for selectively encoding and decoding a digital motion video signal at multiple resolution levels
JP2629238B2 (en) * 1988-02-05 1997-07-09 ソニー株式会社 Decoding device and decoding method
US4953023A (en) 1988-09-29 1990-08-28 Sony Corporation Coding apparatus for encoding and compressing video data
JP2900385B2 (en) 1988-12-16 1999-06-02 ソニー株式会社 Framing circuit and method
JP3018366B2 (en) 1989-02-08 2000-03-13 ソニー株式会社 Video signal processing circuit
US5208816A (en) 1989-08-18 1993-05-04 At&T Bell Laboratories Generalized viterbi decoding algorithms
JPH03141752A (en) 1989-10-27 1991-06-17 Hitachi Ltd Picture signal transmitting method
JPH0474063A (en) 1990-07-13 1992-03-09 Matsushita Electric Ind Co Ltd Coding method for picture
JP2650472B2 (en) 1990-07-30 1997-09-03 松下電器産業株式会社 Digital signal recording apparatus and digital signal recording method
GB9019538D0 (en) 1990-09-07 1990-10-24 Philips Electronic Associated Tracking a moving object
US5416651A (en) 1990-10-31 1995-05-16 Sony Corporation Apparatus for magnetically recording digital data
US5243428A (en) 1991-01-29 1993-09-07 North American Philips Corporation Method and apparatus for concealing errors in a digital television
US5636316A (en) 1990-12-05 1997-06-03 Hitachi, Ltd. Picture signal digital processing unit
JP2906671B2 (en) 1990-12-28 1999-06-21 ソニー株式会社 Highly efficient digital video signal encoding apparatus and method
DE69226095T2 (en) 1991-01-17 1999-03-11 Sharp Kk Image coding and decoding system using an orthogonal transformation and bit allocation method
US5455629A (en) 1991-02-27 1995-10-03 Rca Thomson Licensing Corporation Apparatus for concealing errors in a digital video processing system
JPH04358486A (en) 1991-06-04 1992-12-11 Toshiba Corp High efficiency code signal processing unit
JP2766919B2 (en) 1991-06-07 1998-06-18 三菱電機株式会社 Digital signal recording / reproducing device, digital signal recording device, digital signal reproducing device
US5263026A (en) 1991-06-27 1993-11-16 Hughes Aircraft Company Maximum likelihood sequence estimation based equalization within a mobile digital cellular receiver
JP3141896B2 (en) 1991-08-09 2001-03-07 ソニー株式会社 Digital video signal recording device
DE69217150T2 (en) 1991-09-30 1997-07-17 Philips Electronics Nv Motion vector estimation, motion picture coding and storage
JPH05103309A (en) 1991-10-04 1993-04-23 Canon Inc Method and device for transmitting information
US5398078A (en) 1991-10-31 1995-03-14 Kabushiki Kaisha Toshiba Method of detecting a motion vector in an image coding apparatus
JP3278881B2 (en) 1991-12-13 2002-04-30 ソニー株式会社 Image signal generator
JPH05236427A (en) 1992-02-25 1993-09-10 Sony Corp Device and method for encoding image signal
US5325203A (en) 1992-04-16 1994-06-28 Sony Corporation Adaptively controlled noise reduction device for producing a continuous output
US5359694A (en) 1992-07-27 1994-10-25 Teknekron Communications Systems, Inc. Method and apparatus for converting image data
US5438369A (en) 1992-08-17 1995-08-01 Zenith Electronics Corporation Digital data interleaving system with improved error correctability for vertically correlated interference
US5481554A (en) 1992-09-02 1996-01-02 Sony Corporation Data transmission apparatus for transmitting code data
JPH06153180A (en) 1992-09-16 1994-05-31 Fujitsu Ltd Picture data coding method and device
JPH06121192A (en) 1992-10-08 1994-04-28 Sony Corp Noise removing circuit
EP0596826B1 (en) 1992-11-06 1999-04-28 GOLDSTAR CO. Ltd. Shuffling method for a digital videotape recorder
US5689302A (en) 1992-12-10 1997-11-18 British Broadcasting Corp. Higher definition video signals from lower definition sources
US5477276A (en) 1992-12-17 1995-12-19 Sony Corporation Digital signal processing apparatus for achieving fade-in and fade-out effects on digital video signals
JPH06205386A (en) 1992-12-28 1994-07-22 Canon Inc Picture reproduction device
US5805762A (en) 1993-01-13 1998-09-08 Hitachi America, Ltd. Video recording device compatible transmitter
US5416847A (en) 1993-02-12 1995-05-16 The Walt Disney Company Multi-band, digital audio noise filter
US5737022A (en) 1993-02-26 1998-04-07 Kabushiki Kaisha Toshiba Motion picture error concealment using simplified motion compensation
JP3259428B2 (en) 1993-03-24 2002-02-25 ソニー株式会社 Apparatus and method for concealing digital image signal
KR100261072B1 (en) 1993-04-30 2000-07-01 윤종용 Digital signal processing system
JP3557626B2 (en) 1993-08-27 2004-08-25 ソニー株式会社 Image restoration apparatus and method
KR960012931B1 (en) 1993-08-31 1996-09-25 대우전자 주식회사 Channel error concealing method for classified vector quantized video
US5663764A (en) 1993-09-30 1997-09-02 Sony Corporation Hierarchical encoding and decoding apparatus for a digital image signal
JP3590996B2 (en) 1993-09-30 2004-11-17 ソニー株式会社 Hierarchical encoding and decoding apparatus for digital image signal
US5617333A (en) 1993-11-29 1997-04-01 Kokusai Electric Co., Ltd. Method and apparatus for transmission of image data
JP3271108B2 (en) 1993-12-03 2002-04-02 ソニー株式会社 Apparatus and method for processing digital image signal
JPH07203428A (en) 1993-12-28 1995-08-04 Canon Inc Image processing method and its device
JP3161217B2 (en) 1994-04-28 2001-04-25 松下電器産業株式会社 Image encoding recording device and recording / reproducing device
US5903481A (en) 1994-09-09 1999-05-11 Sony Corporation Integrated circuit for processing digital signal
US5852470A (en) 1995-05-31 1998-12-22 Sony Corporation Signal converting apparatus and signal converting method
US5552608A (en) 1995-06-26 1996-09-03 Philips Electronics North America Corporation Closed cycle gas cryogenically cooled radiation detector
US5946044A (en) 1995-06-30 1999-08-31 Sony Corporation Image signal converting method and image signal converting apparatus
KR0155900B1 (en) 1995-10-18 1998-11-16 김광호 Phase error detecting method and phase tracking loop circuit
KR100197366B1 (en) 1995-12-23 1999-06-15 전주범 Apparatus for restoring error of image data
KR100196872B1 (en) 1995-12-23 1999-06-15 전주범 Apparatus for restoring error of image data in image decoder
US6134269A (en) 1996-09-25 2000-10-17 At&T Corp Fixed or adaptive deinterleaved transform coding for image coding and intra coding of video

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5241381A (en) * 1990-08-31 1993-08-31 Sony Corporation Video signal compression using 2-d adrc of successive non-stationary frames and stationary frame dropping
US5594807A (en) * 1994-12-22 1997-01-14 Siemens Medical Systems, Inc. System and method for adaptive filtering of images based on similarity between histograms

Also Published As

Publication number Publication date
AU3361900A (en) 2000-08-29
US6178266B1 (en) 2001-01-23

Similar Documents

Publication Publication Date Title
KR100220678B1 (en) Method for rectifying channel errors in an image signal transmitted from a block-based encoder
US11134242B2 (en) Adaptive prediction of coefficients of a video block
US6643410B1 (en) Method of determining the extent of blocking artifacts in a digital image
KR20070023695A (en) Method and device for encoding blocks of values
KR100704736B1 (en) Apparatus and method for the recovery of compression constants in the encoded domain and computer readable medium
KR100828353B1 (en) Method for dividing the image block and Apparatus thereof
EP0985318B1 (en) System for extracting coding parameters from video data
Douda et al. A reduced domain pool based on DCT for a fast fractal image encoding
US6178266B1 (en) Method and apparatus for the recovery of compression constants in the encoded domain
US6535148B1 (en) Method and apparatus for truncated decoding
CN1126376C (en) Method for eliminating error in bit data flow and apparatus thereof
US20030212944A1 (en) Method and apparatus for error data recovery
CN100459714C (en) Method of measuring blocking artefacts
EP2647199B1 (en) Method and apparatus for measuring quality of video based on frame loss pattern
US6473876B1 (en) Method and apparatus for encoding of bitstreams using rotation
Luyen et al. An efficient reversible data hiding based on improved pixel value ordering method
JPH1098620A (en) Picture processor
EP1151615B1 (en) Apparatus and method for the recovery of compression constants in the encoded domain
Kim et al. Blocking effect reduction based on optimal filtering
JPH099065A (en) Picture data compression encoding method and decoding method
Kim et al. A method for blocking effect reduction based on optimal filtering
JPH07184208A (en) Moving picture coder and decoder
JPH05304659A (en) Decoder for block conversion code
Ryu et al. Search region prediction for motion estimation based on neural network vector quantization
Lu et al. A simulation of variable block size vector quantization of image coding

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AE AL AM AT AU AZ BA BB BG BR BY CA CH CN CR CU CZ DE DK DM EE ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK SL TJ TM TR TT TZ UA UG UZ VN YU ZA ZW

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): GH GM KE LS MW SD SL SZ TZ UG ZW AM AZ BY KG KZ MD RU TJ TM AT BE CH CY DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA GN GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase