US20060291751A1 - Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) - Google Patents
Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) Download PDFInfo
- Publication number
- US20060291751A1 US20060291751A1 US11/302,073 US30207305A US2006291751A1 US 20060291751 A1 US20060291751 A1 US 20060291751A1 US 30207305 A US30207305 A US 30207305A US 2006291751 A1 US2006291751 A1 US 2006291751A1
- Authority
- US
- United States
- Prior art keywords
- resolution
- robust
- super
- images
- low
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Classifications
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4053—Super resolution, i.e. output image resolution higher than sensor resolution
Abstract
Description
- This application claims priority from U.S. provisional patent application No. 60/637282 filed Dec. 16, 2004, which is incorporated herein by reference.
- This invention was supported in part by the National Science Foundation under grant CCR-9984246 and by the US Air Force under contract F49620-03-01-0387. The U.S. Government may have certain rights in the invention.
- This invention relates generally to high resolution image restoration and reconstruction. More particularly, it relates to a method for computing a high resolution gray-tone image from a sequence of low-resolution images.
- Super-resolution image reconstruction is a kind of digial image processing that increases the resolvable detail in images. The earliest techniques for super-resolution generated a still image of a scene from a collection of similar lower-resolution images of the same scene. For example, several frames of low-resolution video may be combined using super-resolution techniques to produce a single still image whose resolution is significantly higher than that of any single frame of the original video. Because each low-resolution frame is slightly different and contributes some unique information that is absent from the other frames, the reconstructed still image has more information, i.e., higher resolution, than that of any one of the originals alone. Super-resolution techniques have many applications in diverse areas such as medical imaging, remote sensing, surveillance, still photography, and motion pictures.
- The details of how to reconstruct the best high-resolution image from multiple low-resolution images is a complicated problem that has been an active topic of research for many years, and many different techniques have been proposed. One reason the super-resolution reconstruction problem is so challenging is because the reconstruction process is, in mathematical terms, an under-constrained inverse problem. In the mathematical formulation of the problem, the known low-resolution images are represented as resulting from a transformation of the unknown high-resolution image by effects of image warping due to motion, optical blurring, sampling, and noise. When the model is inverted, the original set of low-resolution images does not, in general, determine a single high-resolution image as a unique solution. Moreover, in cases where a unique solution is determined, it is not stable, i.e., small noise perturbations in the images can result in large differences in the super-resolved image. To address these problems, super-resolution techniques require the introduction of additional assumptions (e.g., assumptions about the nature of the noise, blur, or spatial movement present in the original images). Part of the challenge rests in selecting constraints that sufficiently restrict the solution space without an unacceptable increase in the computational complexity. Another challenge is to select constraints that properly restrict the solution space to good high-resolution images for a wide variety of input image data. For example, constraints that are selected to produce optimal results for a restricted class of image data (e.g., images limited to pure translational movement between frames and common space-invariant blur) may produce significantly degraded results for images that deviate even slightly from the restricted class. In summary, super-resolution techniques should be computationally efficient and produce desired improvements in image quality that are robust to variations in the properties of input image data.
- One popular approach to super-resolution known in the art is based on a maximum likelihood (ML) estimator that uses the L2 norm (i.e., least-squares). The inventors have discovered that this least-squares-based approach is not robust, and produces images with visually apparent errors in some cases (e.g., images with non-Gaussian noise). Upon further investigation, the inventors discovered a superior ML estimator which is based on the L1 norm instead of the L2 norm (i.e., least-squares). They have demonstrated that this L1 norm has a higher breakpoint value and is a demonstrably more robust estimator than the prior L2 norm. In the case of pure translational motion, the method may be implemented using an extremely efficient pixel-wise “shift-and-add” technique.
- It is known in the art of super-resolution to introduce a regularization term into the model to help stabilize the solution, remove image artifacts, and improve the rate of convergence. The regularization term compensates for missing measurement information by introducing some general information about the desired super-resolved solution, and is often implemented as a penalty factor in the generalized minimization cost function. A common regularization cost function is the class of Tikhonov cost functions, which is based on the L2 norm and constrains the total image energy or imposes spatial smoothness. This type of regularization term, however, removes sharp edges along with image noise. A regularization term that preseves edges better is the total variation (TV) method which limits the total change in the image as measured by the L1 norm of the magnitude of the gradient. The inventors have discovered that the TV method may be improved by combining it with a bilateral filter to provide a very robust regularization method, which they call bilateral TV. They have shown that bilateral TV not only produces sharp edges and retains point-like details in the super-resolved image but also allows for computationally efficient implementation superior to other regularization methods.
- Accordingly, in one aspect, the invention provides a method for computing a high resolution gray-tone image from a sequence of low-resolution images using an L1 norm minimization and robust regularization based on a bilateral prior to deal with different data and noise models. This robust super-resolution technique uses the L1 norm both for the regularization and the data fusion terms. Whereas the former is responsible for edge preservation, the latter seeks robustness with respect to motion error, blur, outliers, and other kinds of errors not explicitly modeled in the fused images.
- This computationally inexpensive method is resilient against errors in motion and blur estimation, resulting in images with sharp edges. The method also reduces the effects of aliasing, noise and compression artifacts. The method's performance is superior to other super-resolution methods and has fast convergence.
- Details of various embodiments of the present invention are disclosed in the following appendices:
- Appendix A: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Fast and Robust Multiframe Super Resolution” IEEE Trans. Image. Processing, October 2004, Vol. 13, No. 10, pp. 1327-1344.
- Appendix B: Sina Farsiu, Dirk Robinson, Michael Elad, Peyman Milanfar “Advances and Challenges in Super-Resolution” International Journal of Imaging Systems and Technology, August 2004, Vol. 14, No 2, pp. 47-57.
- As one of ordinary skill in the art will appreciate, various changes, substitutions, and alterations could be made or otherwise implemented without departing from the principles of the present invention. Accordingly, the examples and drawings disclosed herein including the appendix are for purposes of illustrating the preferred embodiments of the present invention and are not to be construed as limiting the invention.
Claims (2)
Priority Applications (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/302,073 US20060291751A1 (en) | 2004-12-16 | 2005-12-12 | Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) |
US11/601,518 US7477802B2 (en) | 2004-12-16 | 2006-11-16 | Robust reconstruction of high resolution grayscale images from a sequence of low resolution frames |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US63728204P | 2004-12-16 | 2004-12-16 | |
US11/302,073 US20060291751A1 (en) | 2004-12-16 | 2005-12-12 | Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) |
Related Child Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/601,518 Continuation US7477802B2 (en) | 2004-12-16 | 2006-11-16 | Robust reconstruction of high resolution grayscale images from a sequence of low resolution frames |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060291751A1 true US20060291751A1 (en) | 2006-12-28 |
Family
ID=37567431
Family Applications (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/302,073 Abandoned US20060291751A1 (en) | 2004-12-16 | 2005-12-12 | Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) |
US11/601,518 Active 2026-12-08 US7477802B2 (en) | 2004-12-16 | 2006-11-16 | Robust reconstruction of high resolution grayscale images from a sequence of low resolution frames |
Family Applications After (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/601,518 Active 2026-12-08 US7477802B2 (en) | 2004-12-16 | 2006-11-16 | Robust reconstruction of high resolution grayscale images from a sequence of low resolution frames |
Country Status (1)
Country | Link |
---|---|
US (2) | US20060291751A1 (en) |
Cited By (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050163402A1 (en) * | 2003-09-30 | 2005-07-28 | Seiji Aiso | Generation of high-resolution image based on multiple low-resolution images |
US20090274385A1 (en) * | 2008-04-30 | 2009-11-05 | Nec Laboratories America | Super resolution using gaussian regression |
TWI396142B (en) * | 2008-09-11 | 2013-05-11 | Nat Univ Tsing Hua | Method of 3d image reconstitution with complementary fusion |
US8750647B2 (en) | 2011-02-03 | 2014-06-10 | Massachusetts Institute Of Technology | Kinetic super-resolution imaging |
CN103854267A (en) * | 2014-03-12 | 2014-06-11 | 昆明理工大学 | Image fusion and super-resolution achievement method based on variation and fractional order differential |
WO2014102458A1 (en) * | 2012-12-31 | 2014-07-03 | Nokia Corporation | Method and apparatus for image fusion |
CN104408697A (en) * | 2014-10-23 | 2015-03-11 | 西安电子科技大学 | Image super-resolution reconstruction method based on genetic algorithm and regular prior model |
CN107194889A (en) * | 2017-05-11 | 2017-09-22 | 西安电子科技大学 | The bilateral full variational regularization image denoising method of piecemeal |
CN110930304A (en) * | 2018-09-20 | 2020-03-27 | 东华大学 | Image set super-resolution self-adaptive threshold selection method based on full-scale quality sum |
WO2021083020A1 (en) * | 2019-11-01 | 2021-05-06 | RealMe重庆移动通信有限公司 | Image fusion method and apparatus, and storage medium and terminal device |
CN112950464A (en) * | 2021-01-25 | 2021-06-11 | 西安电子科技大学 | Binary super-resolution reconstruction method without regularization layer |
CN113064165A (en) * | 2021-03-22 | 2021-07-02 | 电子科技大学 | Scanning radar pitch-azimuth two-dimensional super-resolution method |
Families Citing this family (83)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US8666196B2 (en) * | 2005-01-19 | 2014-03-04 | The United States Of America As Represented By The Secretary Of The Army | System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images |
US8577184B2 (en) * | 2005-01-19 | 2013-11-05 | The United States Of America As Represented By The Secretary Of The Army | System and method for super-resolution imaging from a sequence of color filter array (CFA) low-resolution images |
US20070031058A1 (en) * | 2005-06-08 | 2007-02-08 | Canamet Canadian National Medical Technologies Inc. | Method and system for blind reconstruction of multi-frame image data |
US8203132B2 (en) * | 2005-09-08 | 2012-06-19 | Carestream Health, Inc. | Apparatus and method for imaging ionizing radiation |
US8041409B2 (en) * | 2005-09-08 | 2011-10-18 | Carestream Health, Inc. | Method and apparatus for multi-modal imaging |
US20100220836A1 (en) * | 2005-09-08 | 2010-09-02 | Feke Gilbert D | Apparatus and method for multi-modal imaging |
US8660631B2 (en) * | 2005-09-08 | 2014-02-25 | Bruker Biospin Corporation | Torsional support apparatus and method for craniocaudal rotation of animals |
US20090281383A1 (en) * | 2005-09-08 | 2009-11-12 | Rao Papineni | Apparatus and method for external fluorescence imaging of internal regions of interest in a small animal using an endoscope for internal illumination |
US8050735B2 (en) * | 2005-09-08 | 2011-11-01 | Carestream Health, Inc. | Apparatus and method for multi-modal imaging |
US8155475B2 (en) * | 2007-03-12 | 2012-04-10 | Varian Medical Systems, Inc. | Method and apparatus to facilitate transforming grayscale level values |
US8150199B2 (en) * | 2007-03-29 | 2012-04-03 | Texas Instruments Incorporated | Methods and apparatus for image enhancement |
WO2009034688A1 (en) * | 2007-09-10 | 2009-03-19 | Nikon Corporation | Image processing method and program |
JP4876048B2 (en) * | 2007-09-21 | 2012-02-15 | 株式会社日立製作所 | Video transmission / reception method, reception device, video storage device |
US20090110285A1 (en) * | 2007-10-26 | 2009-04-30 | Technion Research And Development Foundation Ltd | Apparatus and method for improving image resolution using fuzzy motion estimation |
TWI382754B (en) * | 2008-01-24 | 2013-01-11 | Asustek Comp Inc | Method of adjusting blur image |
US8306121B2 (en) * | 2008-03-17 | 2012-11-06 | Ati Technologies Ulc | Method and apparatus for super-resolution of images |
US8139886B2 (en) * | 2008-06-23 | 2012-03-20 | Microsoft Corporation | Blur estimation |
US8238694B2 (en) * | 2008-10-03 | 2012-08-07 | Microsoft Corporation | Alignment of sharp and blurred images based on blur kernel sparseness |
US9064476B2 (en) * | 2008-10-04 | 2015-06-23 | Microsoft Technology Licensing, Llc | Image super-resolution using gradient profile prior |
JP2010140460A (en) * | 2008-11-13 | 2010-06-24 | Sony Corp | Apparatus, method and program for processing image |
JP5173873B2 (en) * | 2008-11-20 | 2013-04-03 | キヤノン株式会社 | Image coding apparatus and control method thereof |
JP5116650B2 (en) * | 2008-12-10 | 2013-01-09 | キヤノン株式会社 | Image coding apparatus and control method thereof |
US8331714B2 (en) * | 2009-02-23 | 2012-12-11 | Sharp Laboratories Of America, Inc. | Methods and systems for image processing |
US8750637B2 (en) * | 2009-03-30 | 2014-06-10 | Telefonaktiebolaget L M Ericsson (Publ) | Barcode processing |
CN102396000B (en) * | 2009-04-17 | 2013-08-21 | 香港科技大学 | Method, device and system for facilitating motion estimation and compensation of feature-motion decorrelation |
US8958484B2 (en) * | 2009-08-11 | 2015-02-17 | Google Inc. | Enhanced image and video super-resolution processing |
US8571355B2 (en) * | 2009-08-13 | 2013-10-29 | Samsung Electronics Co., Ltd. | Method and apparatus for reconstructing a high-resolution image by using multi-layer low-resolution images |
US8611690B2 (en) * | 2009-10-21 | 2013-12-17 | Hewlett-Packard Development Company, L.P. | Real-time video deblurring |
US8264553B2 (en) * | 2009-11-12 | 2012-09-11 | Microsoft Corporation | Hardware assisted image deblurring |
US8330827B2 (en) * | 2009-11-19 | 2012-12-11 | Eastman Kodak Company | Increasing image resolution using combined differential image |
US8665367B2 (en) * | 2010-01-29 | 2014-03-04 | Sharp Laboratories Of America, Inc. | Video resolution enhancement technique |
WO2011100723A2 (en) * | 2010-02-12 | 2011-08-18 | The Regents Of The University Of California | Graphics processing unit-based fast cone beam computed tomography reconstruction |
JP2011180798A (en) * | 2010-03-01 | 2011-09-15 | Sony Corp | Image processing apparatus, image processing method, and program |
JP5184574B2 (en) * | 2010-04-30 | 2013-04-17 | パナソニック株式会社 | Imaging apparatus, image processing apparatus, and image processing method |
JP2012004908A (en) * | 2010-06-17 | 2012-01-05 | Sony Corp | Image processing device, image processing method and program |
US8687011B2 (en) | 2010-10-28 | 2014-04-01 | Microsoft Corporation | Techniques for efficient sampling for image effects |
JP5679791B2 (en) * | 2010-12-14 | 2015-03-04 | キヤノン株式会社 | Image projection apparatus, control method therefor, and program |
US9251565B2 (en) * | 2011-02-03 | 2016-02-02 | Massachusetts Institute Of Technology | Hyper-resolution imaging |
JP2012186593A (en) * | 2011-03-04 | 2012-09-27 | Sony Corp | Image processing system, image processing method, and program |
DE202012013411U1 (en) | 2011-04-25 | 2016-11-15 | Terra Bella Technologies Inc. | Systems for overhead image and video display |
TWI435286B (en) * | 2011-05-04 | 2014-04-21 | Altek Corp | Image processing method and apparatus |
TWI549096B (en) * | 2011-05-13 | 2016-09-11 | 華晶科技股份有限公司 | Image processing device and processing method thereof |
TWI479455B (en) * | 2011-05-24 | 2015-04-01 | Altek Corp | Method for generating all-in-focus image |
US8594464B2 (en) * | 2011-05-26 | 2013-11-26 | Microsoft Corporation | Adaptive super resolution for video enhancement |
US9124797B2 (en) | 2011-06-28 | 2015-09-01 | Microsoft Technology Licensing, Llc | Image enhancement via lens simulation |
JP6112624B2 (en) | 2011-08-02 | 2017-04-12 | ビューズアイキュー インコーポレイテッドViewsIQ Inc. | Apparatus and method for digital microscope imaging |
US20130177242A1 (en) * | 2012-01-10 | 2013-07-11 | James E. Adams, Jr. | Super-resolution image using selected edge pixels |
KR101804215B1 (en) | 2012-03-06 | 2017-12-05 | 삼성전자주식회사 | A method and an apparatus for estimating a non-uniform motion blur robustly |
WO2013148142A1 (en) * | 2012-03-29 | 2013-10-03 | Nikon Corporation | Algorithm for minimizing latent sharp image cost function and point spread function cost function with a spatial mask in a regularization term |
US9245328B2 (en) | 2012-03-29 | 2016-01-26 | Nikon Corporation | Algorithm for minimizing latent sharp image cost function and point spread function with a spatial mask in a fidelity term |
TWI563471B (en) * | 2012-04-24 | 2016-12-21 | Altek Corp | Image processing device and processing method thereof |
WO2013165595A1 (en) * | 2012-04-30 | 2013-11-07 | Nikon Corporation | Point spread function cost function with non-uniform weights |
US9137526B2 (en) | 2012-05-07 | 2015-09-15 | Microsoft Technology Licensing, Llc | Image enhancement via calibrated lens simulation |
FR2994307B1 (en) | 2012-08-06 | 2015-06-05 | Commissariat Energie Atomique | METHOD AND DEVICE FOR RECONSTRUCTION OF SUPER-RESOLUTION IMAGES |
WO2015017194A1 (en) * | 2013-07-29 | 2015-02-05 | Nikon Corporation | Multiple phase method for image deconvolution |
JP6236259B2 (en) | 2013-09-06 | 2017-11-22 | 株式会社東芝 | Image processing apparatus, image processing method, and image processing program |
US9076236B2 (en) | 2013-09-12 | 2015-07-07 | At&T Intellectual Property I, L.P. | Guided image upsampling using bitmap tracing |
WO2015047538A1 (en) * | 2013-09-30 | 2015-04-02 | Nikon Corporation | Psf estimation using multiple smaller images |
US10165263B2 (en) | 2013-09-30 | 2018-12-25 | Nikon Corporation | Point spread function estimation of optics blur |
CN103646237B (en) * | 2013-12-18 | 2017-01-11 | 清华大学 | Method for processing low-resolution facial videos |
US9159121B2 (en) * | 2014-02-18 | 2015-10-13 | Signal Processing, Inc. | Method for image denoising |
US20150363916A1 (en) * | 2014-06-12 | 2015-12-17 | Samsung Electronics Co., Ltd. | Low power demosaic with intergrated chromatic aliasing repair |
WO2015192056A1 (en) | 2014-06-13 | 2015-12-17 | Urthecast Corp. | Systems and methods for processing and providing terrestrial and/or space-based earth observation video |
CN104123561B (en) * | 2014-07-10 | 2018-04-13 | 中国矿业大学 | Fuzzy C-mean algorithm remote sensing image automatic classification method based on spatial attraction model |
US10871561B2 (en) | 2015-03-25 | 2020-12-22 | Urthecast Corp. | Apparatus and methods for synthetic aperture radar with digital beamforming |
CN104732508B (en) * | 2015-04-16 | 2017-07-04 | 湘潭大学 | Based on the image interfusion method that distributed compression is perceived |
US9443288B1 (en) * | 2015-04-22 | 2016-09-13 | Adobe Systems Incorporated | Scale adaptive blind deblurring |
CA2990063A1 (en) | 2015-06-16 | 2017-03-16 | King Abdulaziz City Of Science And Technology | Efficient planar phased array antenna assembly |
JP6618786B2 (en) * | 2015-11-17 | 2019-12-11 | キヤノンメディカルシステムズ株式会社 | Magnetic resonance imaging apparatus and image processing apparatus |
US10955546B2 (en) | 2015-11-25 | 2021-03-23 | Urthecast Corp. | Synthetic aperture radar imaging apparatus and methods |
US9990699B1 (en) * | 2016-03-21 | 2018-06-05 | Rockwell Collins, Inc. | Block match denoising for real-time imaging |
KR101871098B1 (en) * | 2017-01-12 | 2018-06-25 | 포항공과대학교 산학협력단 | Apparatus and method for image processing |
CA3064735C (en) | 2017-05-23 | 2022-06-21 | Urthecast Corp. | Synthetic aperture radar imaging apparatus and methods |
US11378682B2 (en) | 2017-05-23 | 2022-07-05 | Spacealpha Insights Corp. | Synthetic aperture radar imaging apparatus and methods for moving targets |
US10462361B2 (en) | 2017-09-26 | 2019-10-29 | Rosemount Aerospace Inc. | Seeker with dynamic resolution imaging |
US10284810B1 (en) * | 2017-11-08 | 2019-05-07 | Qualcomm Incorporated | Using low-resolution frames to increase frame rate of high-resolution frames |
CA3083033A1 (en) | 2017-11-22 | 2019-11-28 | Urthecast Corp. | Synthetic aperture radar apparatus and methods |
CN109087273B (en) * | 2018-07-20 | 2021-09-14 | 哈尔滨工业大学(深圳) | Image restoration method, storage medium and system based on enhanced neural network |
CN109658342A (en) * | 2018-10-30 | 2019-04-19 | 中国人民解放军战略支援部队信息工程大学 | The remote sensing image brightness disproportionation variation bearing calibration of double norm mixed constraints and system |
US11240465B2 (en) | 2020-02-21 | 2022-02-01 | Alibaba Group Holding Limited | System and method to use decoder information in video super resolution |
US11481876B2 (en) * | 2020-04-08 | 2022-10-25 | Mitsubishi Electric Research Laboratories, Inc. | Systems and methods for blind multi-spectral image fusion |
US11615510B2 (en) * | 2020-10-21 | 2023-03-28 | Samsung Electronics Co., Ltd. | Kernel-aware super resolution |
CN112946789B (en) * | 2021-01-29 | 2023-03-21 | 中国科学院长春光学精密机械与物理研究所 | Interference flat-plate imaging system based on super lens array and photonic integrated chip |
Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6411333B1 (en) * | 1999-04-02 | 2002-06-25 | Teralogic, Inc. | Format conversion using patch-based filtering |
US6434280B1 (en) * | 1997-11-10 | 2002-08-13 | Gentech Corporation | System and method for generating super-resolution-enhanced mosaic images |
US6650335B2 (en) * | 2001-02-22 | 2003-11-18 | Mitsubishi Electric Research Laboratories, Inc. | Method for extracting static and dynamic super-resolution textures form a sequence of images |
US6766067B2 (en) * | 2001-04-20 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | One-pass super-resolution images |
US7085323B2 (en) * | 2002-04-03 | 2006-08-01 | Stmicroelectronics, Inc. | Enhanced resolution video construction method and apparatus |
US7218796B2 (en) * | 2003-04-30 | 2007-05-15 | Microsoft Corporation | Patch-based video super-resolution |
Family Cites Families (7)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5995457A (en) * | 1993-12-22 | 1999-11-30 | Jamail; Randall H. | Method of masking data on digital video disks (DVD) |
US6542925B2 (en) * | 1995-05-30 | 2003-04-01 | Roy-G-Biv Corporation | Generation and distribution of motion commands over a distributed network |
US6021256A (en) * | 1996-09-03 | 2000-02-01 | Eastman Kodak Company | Resolution enhancement system for digital images |
US6122017A (en) * | 1998-01-22 | 2000-09-19 | Hewlett-Packard Company | Method for providing motion-compensated multi-field enhancement of still images from video |
US6304682B1 (en) * | 1998-10-02 | 2001-10-16 | Hewlett-Packard Company | Method for generated resolution enhanced still images from compressed video data |
US6470097B1 (en) * | 1999-01-22 | 2002-10-22 | Siemens Corporation Research, Inc. | Total variational blind image restoration from image sequences |
JP3729172B2 (en) * | 2002-12-16 | 2005-12-21 | ソニー株式会社 | Image encoding apparatus and method, and encoded image decoding apparatus and method |
-
2005
- 2005-12-12 US US11/302,073 patent/US20060291751A1/en not_active Abandoned
-
2006
- 2006-11-16 US US11/601,518 patent/US7477802B2/en active Active
Patent Citations (6)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6434280B1 (en) * | 1997-11-10 | 2002-08-13 | Gentech Corporation | System and method for generating super-resolution-enhanced mosaic images |
US6411333B1 (en) * | 1999-04-02 | 2002-06-25 | Teralogic, Inc. | Format conversion using patch-based filtering |
US6650335B2 (en) * | 2001-02-22 | 2003-11-18 | Mitsubishi Electric Research Laboratories, Inc. | Method for extracting static and dynamic super-resolution textures form a sequence of images |
US6766067B2 (en) * | 2001-04-20 | 2004-07-20 | Mitsubishi Electric Research Laboratories, Inc. | One-pass super-resolution images |
US7085323B2 (en) * | 2002-04-03 | 2006-08-01 | Stmicroelectronics, Inc. | Enhanced resolution video construction method and apparatus |
US7218796B2 (en) * | 2003-04-30 | 2007-05-15 | Microsoft Corporation | Patch-based video super-resolution |
Cited By (17)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7702184B2 (en) * | 2003-09-30 | 2010-04-20 | Seiko Epson Corporation | Generation of high-resolution image based on multiple low-resolution images |
US20100150474A1 (en) * | 2003-09-30 | 2010-06-17 | Seiko Epson Corporation | Generation of high-resolution images based on multiple low-resolution images |
US7953297B2 (en) | 2003-09-30 | 2011-05-31 | Seiko Epson Corporation | Generation of high-resolution images based on multiple low-resolution images |
US20050163402A1 (en) * | 2003-09-30 | 2005-07-28 | Seiji Aiso | Generation of high-resolution image based on multiple low-resolution images |
US20090274385A1 (en) * | 2008-04-30 | 2009-11-05 | Nec Laboratories America | Super resolution using gaussian regression |
US7941004B2 (en) * | 2008-04-30 | 2011-05-10 | Nec Laboratories America, Inc. | Super resolution using gaussian regression |
TWI396142B (en) * | 2008-09-11 | 2013-05-11 | Nat Univ Tsing Hua | Method of 3d image reconstitution with complementary fusion |
US8750647B2 (en) | 2011-02-03 | 2014-06-10 | Massachusetts Institute Of Technology | Kinetic super-resolution imaging |
CN103914815A (en) * | 2012-12-31 | 2014-07-09 | 诺基亚公司 | Image fusion method and device |
WO2014102458A1 (en) * | 2012-12-31 | 2014-07-03 | Nokia Corporation | Method and apparatus for image fusion |
CN103854267A (en) * | 2014-03-12 | 2014-06-11 | 昆明理工大学 | Image fusion and super-resolution achievement method based on variation and fractional order differential |
CN104408697A (en) * | 2014-10-23 | 2015-03-11 | 西安电子科技大学 | Image super-resolution reconstruction method based on genetic algorithm and regular prior model |
CN107194889A (en) * | 2017-05-11 | 2017-09-22 | 西安电子科技大学 | The bilateral full variational regularization image denoising method of piecemeal |
CN110930304A (en) * | 2018-09-20 | 2020-03-27 | 东华大学 | Image set super-resolution self-adaptive threshold selection method based on full-scale quality sum |
WO2021083020A1 (en) * | 2019-11-01 | 2021-05-06 | RealMe重庆移动通信有限公司 | Image fusion method and apparatus, and storage medium and terminal device |
CN112950464A (en) * | 2021-01-25 | 2021-06-11 | 西安电子科技大学 | Binary super-resolution reconstruction method without regularization layer |
CN113064165A (en) * | 2021-03-22 | 2021-07-02 | 电子科技大学 | Scanning radar pitch-azimuth two-dimensional super-resolution method |
Also Published As
Publication number | Publication date |
---|---|
US20070217713A1 (en) | 2007-09-20 |
US7477802B2 (en) | 2009-01-13 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060291751A1 (en) | Robust reconstruction of high resolution grayscale images from a sequence of low-resolution frames (robust gray super-resolution) | |
US20060291750A1 (en) | Dynamic reconstruction of high resolution video from low-resolution color-filtered video (video-to-video super-resolution) | |
US7412107B2 (en) | System and method for robust multi-frame demosaicing and color super-resolution | |
Gunturk et al. | Super-resolution reconstruction of compressed video using transform-domain statistics | |
Patanavijit et al. | A Lorentzian stochastic estimation for a robust iterative multiframe super-resolution reconstruction with Lorentzian-Tikhonov regularization | |
KR20120114386A (en) | Method and apparatus for noise reduction in video | |
Takeda et al. | Removing motion blur with space–time processing | |
Faramarzi et al. | Blind super resolution of real-life video sequences | |
Patanavijit | Super-resolution reconstruction and its future research direction | |
Choi et al. | Motion-blur-free camera system splitting exposure time | |
Wagner et al. | Image superresolution for improved automatic target recognition | |
Zhang et al. | Video superresolution reconstruction using iterative back projection with critical-point filters based image matching | |
Lertrattanapanich et al. | Latest results on high-resolution reconstruction from video sequences | |
Panagiotopoulou et al. | Super-resolution reconstruction of thermal infrared images | |
Srinivasan et al. | A study on super-resolution image reconstruction techniques | |
Takeda et al. | Spatio-temporal video interpolation and denoising using motion-assisted steering kernel (MASK) regression | |
El-Yamany et al. | An adaptive M-estimation framework for robust image super resolution without regularization | |
Salem et al. | Non-parametric super-resolution using a bi-sensor camera | |
Xiao et al. | A high-efficiency super-resolution reconstruction algorithm from image/video sequences | |
Patanavijit et al. | A robust iterative super-resolution reconstruction of image sequences using a Lorentzian Bayesian approach with fast affine block-based registration | |
Zerva et al. | Video Super-Resolution Using Plug-and-Play Priors | |
Li et al. | Reconstruction of bionic compound eye images based on superresolution algorithm | |
Lee et al. | Locally adaptive regularized super-resolution on video with arbitrary motion | |
Kasturiwala et al. | Superresolution: A novel application to image restoration | |
Lim et al. | Spatially adaptive regularized iterative high-resolution image reconstruction algorithm |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: REGENTS OF THE UNIVERSITY OF CALIFORNIA, SANTA CRU Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:MILANFAR, PEYMAN;FARSIU, SINA;ROBINSON, MICHAEL D.;REEL/FRAME:018670/0782 Effective date: 20061120 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |
|
AS | Assignment |
Owner name: NATIONAL SCIENCE FOUNDATION, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:UNIVERSITY OF CALIFORNIA;REEL/FRAME:025762/0349 Effective date: 20080724 |
|
AS | Assignment |
Owner name: AIR FORCE, UNITED STATES, VIRGINIA Free format text: CONFIRMATORY LICENSE;ASSIGNOR:CALIFORNIA, UNIVERSITY OF;REEL/FRAME:026420/0761 Effective date: 20080724 |