US20040120026A1 - Compensating for pixel defects by spatial translation of scene content - Google Patents
Compensating for pixel defects by spatial translation of scene content Download PDFInfo
- Publication number
- US20040120026A1 US20040120026A1 US10/327,412 US32741202A US2004120026A1 US 20040120026 A1 US20040120026 A1 US 20040120026A1 US 32741202 A US32741202 A US 32741202A US 2004120026 A1 US2004120026 A1 US 2004120026A1
- Authority
- US
- United States
- Prior art keywords
- image
- pixel
- spatial light
- light modulator
- modulator
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Granted
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/74—Projection arrangements for image reproduction, e.g. using eidophor
- H04N5/7416—Projection arrangements for image reproduction, e.g. using eidophor involving the use of a spatial light modulator, e.g. a light valve, controlled by a video signal
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/66—Transforming electric information into light information
Definitions
- This invention generally relates to digital printer apparatus that form a two-dimensional image onto a photosensitive medium and more particularly relates to apparatus and methods of compensating for localized pixel anomalies in a spatial light modulator.
- spatial light modulators are increasingly being used in digital printing applications as well.
- spatial light modulators provide significant advantages in cost and performance over earlier digital imaging technologies, both for line printing systems such as the printer depicted in U.S. Pat. No. 5,521,748, and for area printing systems such as the system described in U.S. Pat. No. 5,652,661.
- Two-dimensional spatial light modulators such as those using a digital micromirror device (DMD) from Texas Instruments, Dallas, Tex., or using a liquid crystal device (LCD) can be used to modulate an incoming optical beam for imaging.
- a spatial light modulator can be considered essentially as a two-dimensional array of light-valve elements, each element corresponding to an image pixel. Each array element is separately addressable and digitally controlled to modulate light by transmitting (or by blocking transmission of) incident light from a light source, typically by affecting the polarization state of the light.
- the transmissive spatial light modulator which, as its name implies, operates by selective transmission of an optical beam through individual array elements.
- the second type a later development, is a reflective spatial light modulator.
- the reflective spatial light modulator operates by selective reflection of an optical beam through individual array elements.
- a suitable example of an LCD reflective spatial light modulator relevant to this application utilizes an integrated CMOS backplane, allowing a small footprint and improved uniformity characteristics.
- Examples of printing apparatus using digital micromirror devices include that disclosed in U.S. Pat. No. 5,461,411.
- Photographic printers using the more readily available LCD technology are described in U.S. Pat. Nos. 5,652,661; 5,701,185; and 5,745,156, for example.
- LCD spatial light modulators have been developed and employed for digital projection systems for image display, such as is disclosed in U.S. Pat. No. 5,325,137 and in miniaturized image display apparatus suitable for mounting within a helmet or supported by eyeglasses, as is disclosed in U.S. Pat. No. 5,808,800.
- LCD projector and display designs in use typically employ one or more spatial light modulators, such as using one for each of the primary colors, as is disclosed in U.S. Pat. No. 5,743,610.
- imaging requirements for projector and display use differ significantly from imaging requirements for printing by photoprocessing apparatus.
- Projectors are optimized to provide maximum luminous flux to a screen, with secondary emphasis placed on characteristics important in printing, such as contrast and resolution.
- Optical systems for projector and display applications are designed for the response of the human eye, which, when viewing a display, is relatively insensitive to image artifacts and aberrations and to image non-uniformity, since the displayed image is continually refreshed and is viewed from a distance.
- Another key difference between display and print applications relates to uniform response of pixel elements. Fabrication methods for spatial light modulators are imperfect; as a result, some pixel sites do not perform properly. Thus, for example, an individual pixel may be “stuck” on or off regardless of the control logic signal it receives. Or, an individual pixel may remain in an unwanted half-way state, neither fully on or fully off regardless of the control logic signal applied to it. In display applications, particularly for moving images, individual pixel anomalies may not be readily visible to a viewing audience. However, in print applications, the same type of pixel condition can be readily apparent and can degrade the value of a print, causing “salt and pepper” effects, for example.
- Dithering methods have been developed for improving the relatively low fill factor and increasing the apparent resolution of spatial light modulators in printing applications.
- Dithering techniques operate by imaging multiple times with the same spatial light modulator in a pattern, making an initial exposure, then shifting the relative position of the spatial light modulator by a predetermined distance for each subsequent exposure, where the distance shifted in each move is less than or equal to one pixel-to-pixel distance. In this way, dithering allows each pixel from the original exposure to fill in the area surrounding it.
- the image data provided to the spatial light modulator is preferably changed with each shift operation, to effectively provide increased resolution.
- Dithering has also been proposed as a method for compensating for pixel site defects.
- experience has shown that dithering does not provide a satisfactory result with all types of pixel defects.
- pixels neighboring a defective pixel tend to overlap the space between pixels in the original exposure, dithering may help to mediate the effect of a pixel that may be stuck in a partially on state. That is, where pixel defects themselves cause only subtle tone shifts, dithering can be helpful.
- dithering has been found to make imaging defects more noticeable, providing unsatisfactory results in many cases. Thus, in some cases, dithering can actually enhance the damaging effects of a defective pixel, resulting in an unacceptable print.
- a spatial light modulator is relatively expensive to fabricate. As with similar types of devices, perfect performance comes at high cost. Low cost means accepting some number of bad pixel sites in the matrix of spatial light modulator pixels has been an economic compromise. It can be appreciated that it would be advantageous for a builder of imaging apparatus to be able to accept lower spatial light modulator quality and to compensate for modulator site defects at some suitable point in the optical system.
- an imaging apparatus forms an image on an imaging surface by modulating an area spatial light modulator having a pixel-to-pixel distance.
- the improved method for compensating for modulator pixel site response defects includes the steps of:
- the second image is a duplicate of the first image, shifted pixelwise correspondingly by the shift distance, such that the second image overlaps the first image with respect to the imaging surface.
- the present invention provides, in an imaging apparatus that forms an image on an imaging surface by modulating an area spatial light modulator having a resolution based on a pixel-to-pixel distance, an improved method for compensating for modulator pixel site response defects, comprising the steps of:
- a feature of the present invention is the use of different pixel source locations on the spatial light modulator to provide overlapped or adjacent pixels on the imaging surface.
- FIGS. 1 a and 1 b are schematic diagrams showing the components of different embodiments of an imaging apparatus that can be adapted to use the methods of the present invention.
- FIG. 2 is a plan view showing a basic pixel arrangement for a representative portion of a spatial light modulator
- FIG. 3 shows a dithering sequence conventionally used for increasing effective resolution and for improving pixel fill factor
- FIG. 4 a shows an example image resulting from conventional dithering with no pixel defects
- FIG. 4 b shows an example image resulting from conventional dithering with two pixel defects
- FIGS. 5 a and 5 b show, from the perspective of the imaging optics, image translation according to the present invention
- FIG. 5 c shows a side view corresponding to the views of FIGS. 5 a and 5 b;
- FIG. 6 shows a plane view of pixel imaging using the method of the present invention, with two pixel defects.
- FIG. 1 a there is shown, in simplified form, the basic arrangement of an exemplary prior art imaging apparatus 10 configured as a color printer.
- imaging apparatus 10 could be a printer, projector, or other image-forming device, when provided with the necessary support components.
- FIG. 1 a There are similar components for modulating each color, represented in FIG. 1 a with appended color designators when necessary: r for Red, g for Green, and b for Blue color.
- a photosensitive medium 32 fed from a reel 34 onto the image plane shown as a surface 36 has characteristic cyan, magenta, and yellow response corresponding to the modulated R, G, B colored light.
- a light source 20 r provides red light.
- Uniformizing optics 22 r perform basic functions that collect light and provide uniform light for modulation.
- a polarization beamsplitter 24 r directs unmodulated light to a spatial light modulator 30 r.
- the uniformized light from light source 20 r is modulated by spatial light modulator 30 r, passes through polarization beamsplitter 24 r, and is combined at dichroic X-cube 26 with modulated light from corresponding components in the green light path ( 20 g, 22 g, 24 g, 30 g ) and blue light path ( 20 b, 22 b, 24 b, 30 b ).
- the modulated color image is then directed by a lens 38 for printing or projection display at surface 36 .
- each spatial light modulator 30 is positionally located at an imaging plane P with respect to the imaging optics.
- FIG. 1 a represents a limited number of the possible embodiments for imaging apparatus 10 using the method of the present invention.
- simpler systems can be built using a single spatial light modulator 30 that is shared or multiplexed between two or three light paths, such as that shown in FIG. 1 b.
- a light source 20 provides an illumination beam of red, green, and blue light in a sequence, by means of a filter wheel 28 driven by a motor 18 , as is well known in the imaging art.
- Other methods for directing, as an illumination beam, one color at a time include using separate LEDs, for example.
- Uniformizing optics 22 homogenize the illumination beam and provide a uniform field to a polarizing device, such as a polarization beamsplitter 24 .
- a polarizing device such as a polarization beamsplitter 24 .
- Light of suitable polarity for modulation is then directed to a spatial light modulator 30 , which modulates the illumination beam with image data that corresponds to the color of the illumination beam provided.
- the sequencing of image data corresponds to the sequencing of color in the illumination beam.
- the modulated color image is then directed by lens 38 for printing or projection display at surface 36 .
- Spatial light modulator 30 is positionally located at an imaging plane P with respect to lens 38 and other imaging optics.
- FIGS. 1 a and 1 b A number of modifications is possible for the configurations of FIGS. 1 a and 1 b, using techniques well known in the imaging arts.
- one or more transmissive LCDs could be used instead of the reflective LCDs shown as spatial light modulators 30 , 30 r, 30 g, and 30 b.
- Pixel array 130 comprises individual pixels 72 arranged in a two-dimensional matrix having evenly spaced rows and columns as shown.
- the ideal representation of pixel array 130 in FIG. 2 assumes that there are no defective pixels 72 . In such an ideal case, there would be little reason to employ the method of the present invention, however, due to manufacturing imperfections, some small percentage of pixels 72 can be expected to be stuck on, stuck off, or unable to switch properly between states or otherwise respond to image logic control signals.
- a pixel-to-pixel distance D is a factor of the inherent spatial light modulator resolution, and is measured from the center of one pixel 72 to the center of an adjacent pixel 72 .
- FIG. 3 there is shown a conventional dithering pattern that has been proposed for compensating for low fill factor of pixels 72 and has also proposed as one method for compensation for defective pixels 72 .
- Dither movement of spatial light modulator 30 (FIGS. 1 a and 1 b ) or of some other component in the optics path for modulated light effectively shifts pixels 72 from an original imaging position 78 a to a second imaging position 78 b, then to a third imaging position 78 c, and then to a fourth imaging position 78 d.
- this repeated pattern can be effective for improving pixel fill factor, thereby minimizing space between pixels, and for increasing apparent resolution, as is shown in the dithered pixel array 130 representation of FIG. 4 a.
- pixels 72 exhibit some type of defect, the use of a dither pattern can actually tend to degrade the image.
- FIG. 4 b there is shown an example in which dithering of pixel array 130 enhances the effect of defective pixels 72 x.
- defective pixel 72 x can be stuck fully on or fully off. Where this causes a bright dot, use of conventional dithering accentuates the brightness. Similarly, a dark dot would also be enlarged.
- this negative effect increases with the number of imaging positions 78 a, 78 b, 78 c, 78 d, and any additional positions where exposure takes place in the dithering sequence.
- conventional dithering such as is shown using the pattern of FIG. 3 for example, can be deleterious where spatial light modulator 30 has defective pixels 72 x.
- dithering methods characteristically move spatial light modulator 30 in small increments of pixel-to-pixel distance and can yield unsatisfying results when one or more pixel sites are defective.
- the method of the present invention translates the image by an integral multiple of pixel-to-pixel distance, effectively “shifting the problem” so that a single defective pixel 72 x may be used in multiple exposures, but occupies a different position with respect to imaging surface 36 with each exposure, thereby affecting different portions of the final image.
- FIGS. 5 a and 5 b there is shown, from a perspective view, how the method of the present invention operates. In FIG.
- an actuator 40 is positioned at an edge of spatial light modulator 30 .
- Light modulated by spatial light modulator 30 is directed by system optics (as were shown in FIGS. 1 a and 1 b but are omitted from FIG. 3 for clarity) toward surface 36 for forming an image 50 thereon.
- Spatial light modulator 30 provides a pattern of on pixels 72 a and off pixels 72 b that form image 50 . Defective pixel 72 x, however, provides an unintended result on a defective imaged pixel 74 during exposure at this first position, where spatial light modulator 30 is aligned at location A.
- FIG. 5 b there is shown how translation of the image occurs and helps to distinguish translation from dithering.
- Actuator 40 shifts spatial light modulator 30 in a preferred direction by a distance nD that is an integral multiple (n) of the pixel-to-pixel distance. In so doing, the relative position of defective pixel 72 x with respect to image 50 on surface 36 is also shifted.
- the image formed on spatial light modulator is then translated by (n) pixels so that different on and off pixels 72 a and 72 b are imaged to corresponding pixel locations on image 50 . As a result, the negative impact of defective pixel 72 x on image 50 is minimized.
- the present invention provides a method wherein the damage done by defective pixel 72 x decreases with each exposure position used.
- pixel translation as illustrated in the sequence of FIGS. 5 a and 5 b, it is to be emphasized that (1) the same image data is used to form the image on spatial light modulator 30 at each position of spatial light modulator 30 and (2) the image itself is shifted by an integral multiple of the pixel-to-pixel distance.
- This translation behavior is in contrast to conventional dithering, in which (1) different image data is used at each position of spatial light modulator 30 , to enhance resolution and prevent blurring of the image; and (2) relative pixel positions are shifted by a fraction of the pixel-to-pixel distance.
- spatial light modulator 30 in the schematic of FIGS. 5 a and 5 b is for illustration only, to show the relative position of pixel 72 a, 72 b positions on spatial light modulator 30 and pixel 72 a′, 72 b′ positions on image 50 , without the complexity of representing the intermediate optical components.
- the light source (light sources 20 , 20 r, 20 g, or 20 b in FIGS. 1 a and 1 b ) would direct light through spatial light modulator 30 to form image 50 .
- the light source would reflect light from the surface of spatial light modulator 30 , so that the pixel locations shown would be facing image 50 , not visible from the rear view represented in FIGS. 5 a and 5 b.
- the present invention provides additional improvement by combining the following:
- a 3.5 ⁇ 3.5 dither pattern could be used, whereby spatial light modulator 30 is first translated three full pixels in a direction, then dithered 0.5 pixels in that same direction, with the corresponding change in image data. With such movement, the image that is provided at this position both provides the benefits of dithering and minimizes pixel 72 imaging defects. Further movement by 3.5 pixels in a second orthogonal direction, followed by imaging, followed by movement in additional directions with imaging, yields a result that has both the benefits of dithering, such as enhanced resolution and improved pixel fill factor, and the benefits of pixel translation, which dramatically reduces the negative impact of defective pixels 72 x. Moreover, negative effects of dithering, for pixels stuck fully on or fully off, are dramatically reduced.
- a bordering area 52 surrounds image area I and would be masked, such as using an aperture in the imaging optical system, for example.
- the actual bordering area 52 that is unused depends on the translation distance and is typically on the order of a few pixels along each edge of image area I.
- spatial light modulator 30 When used for full-color imaging, spatial light modulator 30 may be shared for successively imaging with light at a first wavelength, then at a second wavelength, and possibly at a third and additional wavelengths, as is noted hereinabove in the description for FIGS. 1 a and 1 b.
- separate exposures are provided for red, green, and blue color planes.
- spatial light modulator 30 When imaging the blue color plane, spatial light modulator 30 is moved a translation distance of three pixels. With such a pattern, the impact of defective pixels 72 x would be minimized, with imaging defects distributed differently over each color plane. Dithering could also be provided to supplement this translation step for added resolution and improved fill factor.
Abstract
Description
- Reference is made to commonly-assigned copending U.S. patent application Ser. No. 09/630,419, filed Aug. 1, 2002, entitled A METHOD AND APPARATUS FOR PRINTING MONOCHROMATIC IMAGING USING A SPATIAL LIGHT MODULATOR by Wong et al. and U.S. patent application Ser. No. 10/055,781, filed Jan. 23, 2002, entitled IMAGING APPARATUS USING DITHER TO MINIMIZE PIXEL EFFECTS by Roddy et al., the disclosures of which are incorporated herein.
- This invention generally relates to digital printer apparatus that form a two-dimensional image onto a photosensitive medium and more particularly relates to apparatus and methods of compensating for localized pixel anomalies in a spatial light modulator.
- Originally developed for forming images in display devices, spatial light modulators are increasingly being used in digital printing applications as well. In printing apparatus, spatial light modulators provide significant advantages in cost and performance over earlier digital imaging technologies, both for line printing systems such as the printer depicted in U.S. Pat. No. 5,521,748, and for area printing systems such as the system described in U.S. Pat. No. 5,652,661.
- Two-dimensional spatial light modulators, such as those using a digital micromirror device (DMD) from Texas Instruments, Dallas, Tex., or using a liquid crystal device (LCD) can be used to modulate an incoming optical beam for imaging. A spatial light modulator can be considered essentially as a two-dimensional array of light-valve elements, each element corresponding to an image pixel. Each array element is separately addressable and digitally controlled to modulate light by transmitting (or by blocking transmission of) incident light from a light source, typically by affecting the polarization state of the light.
- There are two basic types of spatial light modulators in current use. The first type developed was the transmissive spatial light modulator, which, as its name implies, operates by selective transmission of an optical beam through individual array elements. The second type, a later development, is a reflective spatial light modulator. As its name implies, the reflective spatial light modulator, operates by selective reflection of an optical beam through individual array elements. A suitable example of an LCD reflective spatial light modulator relevant to this application utilizes an integrated CMOS backplane, allowing a small footprint and improved uniformity characteristics.
- Examples of printing apparatus using digital micromirror devices (DMDs), include that disclosed in U.S. Pat. No. 5,461,411. Photographic printers using the more readily available LCD technology are described in U.S. Pat. Nos. 5,652,661; 5,701,185; and 5,745,156, for example.
- Conventionally, LCD spatial light modulators have been developed and employed for digital projection systems for image display, such as is disclosed in U.S. Pat. No. 5,325,137 and in miniaturized image display apparatus suitable for mounting within a helmet or supported by eyeglasses, as is disclosed in U.S. Pat. No. 5,808,800. LCD projector and display designs in use typically employ one or more spatial light modulators, such as using one for each of the primary colors, as is disclosed in U.S. Pat. No. 5,743,610.
- It is instructive to note that imaging requirements for projector and display use (as is typified in U.S. Pat. Nos. 5,325,137; 5,808,800; and 5,743,610) differ significantly from imaging requirements for printing by photoprocessing apparatus. Projectors are optimized to provide maximum luminous flux to a screen, with secondary emphasis placed on characteristics important in printing, such as contrast and resolution. Optical systems for projector and display applications are designed for the response of the human eye, which, when viewing a display, is relatively insensitive to image artifacts and aberrations and to image non-uniformity, since the displayed image is continually refreshed and is viewed from a distance. However, when viewing printed output from a high-resolution printing system, the human eye is not nearly as “forgiving” to artifacts and aberrations and to non-uniformity, since irregularities in optical response are more readily visible and objectionable on printed output. For this reason, there can be considerable complexity in optical systems for providing a uniform exposure energy for printing. Even more significant are differences in resolution requirements. Adapted for the human eye, projection and display systems are optimized for viewing at typical resolutions such as 72 dpi or less, for example. Photographic printing apparatus, on the other hand, must achieve much higher resolution, particularly apparatus designed for micrographics applications, which can be expected to provide 8,000 dpi for some systems. Thus, while LCD spatial light modulators can be used in a range of imaging applications from projection and display to high-resolution printing, the requirements on supporting optics can vary significantly.
- Another key difference between display and print applications relates to uniform response of pixel elements. Fabrication methods for spatial light modulators are imperfect; as a result, some pixel sites do not perform properly. Thus, for example, an individual pixel may be “stuck” on or off regardless of the control logic signal it receives. Or, an individual pixel may remain in an unwanted half-way state, neither fully on or fully off regardless of the control logic signal applied to it. In display applications, particularly for moving images, individual pixel anomalies may not be readily visible to a viewing audience. However, in print applications, the same type of pixel condition can be readily apparent and can degrade the value of a print, causing “salt and pepper” effects, for example.
- In addition to pixel defects described above, dust, dirt, cleaning residues, and other surface irregularities can contribute to non-uniform pixel-to-pixel response of a spatial light modulator, such as waviness and “water-stain” effects. These other effects can be subtler than those resulting from stuck pixels, however, results can be dissatisfying and the perceived value of print results is lowered when such imaging aberrations recur from print to print.
- Dithering methods have been developed for improving the relatively low fill factor and increasing the apparent resolution of spatial light modulators in printing applications. Commonly assigned U.S. patent application Ser. No. 09/630,419 and U.S. patent application Ser. No. 10/055,781, cited above, disclose various dithering approaches for this purpose. Dithering techniques operate by imaging multiple times with the same spatial light modulator in a pattern, making an initial exposure, then shifting the relative position of the spatial light modulator by a predetermined distance for each subsequent exposure, where the distance shifted in each move is less than or equal to one pixel-to-pixel distance. In this way, dithering allows each pixel from the original exposure to fill in the area surrounding it. The image data provided to the spatial light modulator is preferably changed with each shift operation, to effectively provide increased resolution.
- Dithering has also been proposed as a method for compensating for pixel site defects. However, experience has shown that dithering does not provide a satisfactory result with all types of pixel defects. Because pixels neighboring a defective pixel tend to overlap the space between pixels in the original exposure, dithering may help to mediate the effect of a pixel that may be stuck in a partially on state. That is, where pixel defects themselves cause only subtle tone shifts, dithering can be helpful. However, in cases where defective pixels have a fixed on or off state, dithering has been found to make imaging defects more noticeable, providing unsatisfactory results in many cases. Thus, in some cases, dithering can actually enhance the damaging effects of a defective pixel, resulting in an unacceptable print.
- A spatial light modulator is relatively expensive to fabricate. As with similar types of devices, perfect performance comes at high cost. Low cost means accepting some number of bad pixel sites in the matrix of spatial light modulator pixels has been an economic compromise. It can be appreciated that it would be advantageous for a builder of imaging apparatus to be able to accept lower spatial light modulator quality and to compensate for modulator site defects at some suitable point in the optical system.
- Thus can be seen that there is a need for an imaging method that compensates more effectively than conventional methods for pixel site defects in a spatial light modulator.
- According to one aspect of the present invention to provide, an imaging apparatus forms an image on an imaging surface by modulating an area spatial light modulator having a pixel-to-pixel distance. The improved method for compensating for modulator pixel site response defects includes the steps of:
- (a) forming a first image with the spatial light modulator at a first position within an image forming plane and directing the first image toward the imaging surface;
- (b) translating the spatial light modulator, over a shift distance, to a second position within the image forming plane, the shift distance being a multiple n times the pixel-to-pixel distance, wherein n is an integer greater than or equal to 2;
- (c) forming a second image with the spatial light modulator at the second position and directing the second image toward the imaging surface; and
- wherein the second image is a duplicate of the first image, shifted pixelwise correspondingly by the shift distance, such that the second image overlaps the first image with respect to the imaging surface.
- According to another aspect, the present invention provides, in an imaging apparatus that forms an image on an imaging surface by modulating an area spatial light modulator having a resolution based on a pixel-to-pixel distance, an improved method for compensating for modulator pixel site response defects, comprising the steps of:
- (a) forming a first image with the spatial light modulator at a first position within an image forming plane and directing the first image toward the imaging surface;
- (b) translating the spatial modulator, over a shift distance, to a second position within the image forming plane, the shift distance being greater than twice the pixel-to-pixel distance;
- (c) forming a second image with the spatial light modulator at the second position and directing the second image toward the imaging surface; and
- wherein the second image being different from the first image, thereby increasing image resolution with respect to the imaging surface.
- A feature of the present invention is the use of different pixel source locations on the spatial light modulator to provide overlapped or adjacent pixels on the imaging surface.
- It is an advantage of the present invention that it lowers the requirements for manufactured quality of a spatial light modulator, thereby decreasing the cost of the imaging apparatus.
- It is a further advantage of the present invention that it allows dithering after translation of the spatial light modulator, thereby minimizing the negative effects of defective pixels on the image surface and, at the same time, taking advantage of the benefits of dithering, such as increased pixel fill factor and improved image resolution.
- These and other objects, features, and advantages of the present invention will become apparent to those skilled in the art upon a reading of the following detailed description when taken in conjunction with the drawings wherein there is shown and described an illustrative embodiment of the invention.
- While the specification concludes with claims particularly pointing out and distinctly claiming the subject matter of the present invention, it is believed that the invention will be better understood from the following description when taken in conjunction with the accompanying drawings, wherein:
- FIGS. 1a and 1 b are schematic diagrams showing the components of different embodiments of an imaging apparatus that can be adapted to use the methods of the present invention.
- FIG. 2 is a plan view showing a basic pixel arrangement for a representative portion of a spatial light modulator;
- FIG. 3 shows a dithering sequence conventionally used for increasing effective resolution and for improving pixel fill factor;
- FIG. 4a shows an example image resulting from conventional dithering with no pixel defects;
- FIG. 4b shows an example image resulting from conventional dithering with two pixel defects;
- FIGS. 5a and 5 b show, from the perspective of the imaging optics, image translation according to the present invention;
- FIG. 5c shows a side view corresponding to the views of FIGS. 5a and 5 b; and
- FIG. 6 shows a plane view of pixel imaging using the method of the present invention, with two pixel defects.
- The present description is directed in particular to elements forming part of, or cooperating more directly with, apparatus in accordance with the invention. It is to be understood that elements not specifically shown or described may take various forms well known to those skilled in the art.
- Referring to FIG. 1a, there is shown, in simplified form, the basic arrangement of an exemplary prior
art imaging apparatus 10 configured as a color printer. It must be observed that, for the purposes of the present invention,imaging apparatus 10 could be a printer, projector, or other image-forming device, when provided with the necessary support components. For the sake of the present description, it is sufficient merely to note the overall arrangement of the basic components ofimaging apparatus 10 in the prior art arrangement of FIG. 1a. There are similar components for modulating each color, represented in FIG. 1a with appended color designators when necessary: r for Red, g for Green, and b for Blue color. For a printer, aphotosensitive medium 32, fed from areel 34 onto the image plane shown as asurface 36 has characteristic cyan, magenta, and yellow response corresponding to the modulated R, G, B colored light. For the red color light modulation path, alight source 20 r provides red light.Uniformizing optics 22 r perform basic functions that collect light and provide uniform light for modulation. Apolarization beamsplitter 24 r directs unmodulated light to a spatiallight modulator 30 r. The uniformized light fromlight source 20 r is modulated by spatiallight modulator 30 r, passes throughpolarization beamsplitter 24 r, and is combined at dichroic X-cube 26 with modulated light from corresponding components in the green light path (20 g, 22 g, 24 g, 30 g) and blue light path (20 b, 22 b, 24 b, 30 b). The modulated color image is then directed by alens 38 for printing or projection display atsurface 36. As indicated for the green color channel, each spatiallight modulator 30 is positionally located at an imaging plane P with respect to the imaging optics. - It must be observed that the arrangement of FIG. 1a represents a limited number of the possible embodiments for
imaging apparatus 10 using the method of the present invention. For example, simpler systems can be built using a single spatiallight modulator 30 that is shared or multiplexed between two or three light paths, such as that shown in FIG. 1b. In this configuration, alight source 20 provides an illumination beam of red, green, and blue light in a sequence, by means of afilter wheel 28 driven by amotor 18, as is well known in the imaging art. Other methods for directing, as an illumination beam, one color at a time include using separate LEDs, for example.Uniformizing optics 22 homogenize the illumination beam and provide a uniform field to a polarizing device, such as apolarization beamsplitter 24. Light of suitable polarity for modulation is then directed to a spatiallight modulator 30, which modulates the illumination beam with image data that corresponds to the color of the illumination beam provided. For this method, the sequencing of image data corresponds to the sequencing of color in the illumination beam. The modulated color image is then directed bylens 38 for printing or projection display atsurface 36. Spatiallight modulator 30 is positionally located at an imaging plane P with respect tolens 38 and other imaging optics. - A number of modifications is possible for the configurations of FIGS. 1a and 1 b, using techniques well known in the imaging arts. For example, one or more transmissive LCDs could be used instead of the reflective LCDs shown as spatial
light modulators - Referring to FIG. 2, there is shown the arrangement of an ideal imaged
pixel array 130 that would be provided by spatiallight modulator 30.Pixel array 130 comprisesindividual pixels 72 arranged in a two-dimensional matrix having evenly spaced rows and columns as shown. The ideal representation ofpixel array 130 in FIG. 2 assumes that there are nodefective pixels 72. In such an ideal case, there would be little reason to employ the method of the present invention, however, due to manufacturing imperfections, some small percentage ofpixels 72 can be expected to be stuck on, stuck off, or unable to switch properly between states or otherwise respond to image logic control signals. A pixel-to-pixel distance D is a factor of the inherent spatial light modulator resolution, and is measured from the center of onepixel 72 to the center of anadjacent pixel 72. - Referring to FIG. 3, there is shown a conventional dithering pattern that has been proposed for compensating for low fill factor of
pixels 72 and has also proposed as one method for compensation fordefective pixels 72. Dither movement of spatial light modulator 30 (FIGS. 1a and 1 b) or of some other component in the optics path for modulated light effectively shiftspixels 72 from anoriginal imaging position 78 a to asecond imaging position 78 b, then to athird imaging position 78 c, and then to afourth imaging position 78 d. Where spatiallight modulator 30 has well-behavedpixels 72, this repeated pattern can be effective for improving pixel fill factor, thereby minimizing space between pixels, and for increasing apparent resolution, as is shown in the ditheredpixel array 130 representation of FIG. 4a. However, wherepixels 72 exhibit some type of defect, the use of a dither pattern can actually tend to degrade the image. - Referring to FIG. 4b, there is shown an example in which dithering of
pixel array 130 enhances the effect ofdefective pixels 72 x. As a worst-case problem,defective pixel 72 x can be stuck fully on or fully off. Where this causes a bright dot, use of conventional dithering accentuates the brightness. Similarly, a dark dot would also be enlarged. With reference to FIG. 3, this negative effect increases with the number ofimaging positions light modulator 30 hasdefective pixels 72 x. Moreover, where twodefective pixels 72 x are adjacent or separated only by one or twoother pixels 72, even more dramatic degradation of the image can result from using conventional dithering. Other dithering methods, such as using a diagonal pattern, because they limit the area ofsurface 36 that is affected bydefective pixel 72 x, may reduce the impact ofdefective pixels 72 x, but with limited success. - As noted in the background material given above and shown with respect to FIG. 3, dithering methods characteristically move spatial
light modulator 30 in small increments of pixel-to-pixel distance and can yield unsatisfying results when one or more pixel sites are defective. Unlike conventional dithering, the method of the present invention translates the image by an integral multiple of pixel-to-pixel distance, effectively “shifting the problem” so that a singledefective pixel 72 x may be used in multiple exposures, but occupies a different position with respect toimaging surface 36 with each exposure, thereby affecting different portions of the final image. Referring to FIGS. 5a and 5 b, there is shown, from a perspective view, how the method of the present invention operates. In FIG. 5a, anactuator 40 is positioned at an edge of spatiallight modulator 30. Light modulated by spatiallight modulator 30 is directed by system optics (as were shown in FIGS. 1a and 1 b but are omitted from FIG. 3 for clarity) towardsurface 36 for forming animage 50 thereon. Spatiallight modulator 30 provides a pattern of onpixels 72 a and offpixels 72 b that formimage 50.Defective pixel 72 x, however, provides an unintended result on a defective imagedpixel 74 during exposure at this first position, where spatiallight modulator 30 is aligned at location A. - Referring to FIG. 5b, there is shown how translation of the image occurs and helps to distinguish translation from dithering.
Actuator 40 shifts spatiallight modulator 30 in a preferred direction by a distance nD that is an integral multiple (n) of the pixel-to-pixel distance. In so doing, the relative position ofdefective pixel 72 x with respect to image 50 onsurface 36 is also shifted. The image formed on spatial light modulator is then translated by (n) pixels so that different on and offpixels image 50. As a result, the negative impact ofdefective pixel 72 x onimage 50 is minimized. Thus, unlike the case with conventional dithering, wherein the damage done to the image increases with each exposure position in whichdefective pixel 72 x is used, the present invention provides a method wherein the damage done bydefective pixel 72 x decreases with each exposure position used. With pixel translation, as illustrated in the sequence of FIGS. 5a and 5 b, it is to be emphasized that (1) the same image data is used to form the image on spatiallight modulator 30 at each position of spatiallight modulator 30 and (2) the image itself is shifted by an integral multiple of the pixel-to-pixel distance. This translation behavior is in contrast to conventional dithering, in which (1) different image data is used at each position of spatiallight modulator 30, to enhance resolution and prevent blurring of the image; and (2) relative pixel positions are shifted by a fraction of the pixel-to-pixel distance. - It must be noted that the representation of spatial
light modulator 30 in the schematic of FIGS. 5a and 5 b is for illustration only, to show the relative position ofpixel light modulator 30 andpixel 72 a′, 72 b′ positions onimage 50, without the complexity of representing the intermediate optical components. For a transmissive LCD as spatiallight modulator 30, for example, the light source (light sources light modulator 30 to formimage 50. Conversely, for a reflective LCD or DMD as spatiallight modulator 30, the light source would reflect light from the surface of spatiallight modulator 30, so that the pixel locations shown would be facingimage 50, not visible from the rear view represented in FIGS. 5a and 5 b. - As a further option, the present invention provides additional improvement by combining the following:
- (1) translation of the image, or shifting movement of the image by nD, that is, by an integral multiple (n) of the pixel-to-pixel distance (D); with
- (2) dithering, or re-positioning of the
image pixels 72 by an added fractional increment fD, that is, by a fractional portion (f) of the pixel-to-pixel distance (D), along with modified image data for one ormore pixels 72. - Thus, for example, a 3.5×3.5 dither pattern could be used, whereby spatial
light modulator 30 is first translated three full pixels in a direction, then dithered 0.5 pixels in that same direction, with the corresponding change in image data. With such movement, the image that is provided at this position both provides the benefits of dithering and minimizespixel 72 imaging defects. Further movement by 3.5 pixels in a second orthogonal direction, followed by imaging, followed by movement in additional directions with imaging, yields a result that has both the benefits of dithering, such as enhanced resolution and improved pixel fill factor, and the benefits of pixel translation, which dramatically reduces the negative impact ofdefective pixels 72 x. Moreover, negative effects of dithering, for pixels stuck fully on or fully off, are dramatically reduced. - The relative benefits of the method of the present invention can be most clearly seen by comparing the example of FIG. 4b with the example of FIG. 6. Both examples begin with two
defective pixels 72 x on spatiallight modulator 30. Resultingpixel array 130 in FIG. 4b shows the impact of conventional dithering techniques. In contrast,pixel array 130 in FIG. 6 shows what happens when translation and dithering are combined. Unlike the image shown in FIG. 4b, in which the location of eachdefective pixel 72 x can be clearly identified, the image shown in FIG. 6 has only a hint ofdefective pixel 72 x location. - It must be noted that the translation technique of the present invention results in a slightly reduced image area I, as is shown in FIG. 6. A bordering
area 52 surrounds image area I and would be masked, such as using an aperture in the imaging optical system, for example. The actual borderingarea 52 that is unused depends on the translation distance and is typically on the order of a few pixels along each edge of image area I. - When used for full-color imaging, spatial
light modulator 30 may be shared for successively imaging with light at a first wavelength, then at a second wavelength, and possibly at a third and additional wavelengths, as is noted hereinabove in the description for FIGS. 1a and 1 b. In typical full-color printing applications, for example, separate exposures are provided for red, green, and blue color planes. In such a case, it may be advantages to translate spatiallight modulator 30 over a different distance for each color plane. For example, when imaging the red color plane, spatiallight modulator 30 is moved a translation distance of six pixels. When imaging the green color plane, spatiallight modulator 30 is moved a translation distance of four pixels. When imaging the blue color plane, spatiallight modulator 30 is moved a translation distance of three pixels. With such a pattern, the impact ofdefective pixels 72 x would be minimized, with imaging defects distributed differently over each color plane. Dithering could also be provided to supplement this translation step for added resolution and improved fill factor. - The invention has been described in detail with particular reference to certain preferred embodiments thereof, but it will be understood that variations and modifications can be effected within the scope of the invention as described above, and as noted in the appended claims, by a person of ordinary skill in the art without departing from the scope of the invention. For example, while the preferred embodiment uses an LCD, apparatus using other types of area spatial light modulator, such as a DMD, could alternately employ the same method. Spatial
light modulator 30 can be shifted in any suitable direction within the imaging plane.Actuator 40 can be any of a number of types of actuator, such as a piezoelectric or electromagnetic actuator, for example, and would typically cooperate with a component providing some type of opposing force, as is well known in the mechanical arts. - Thus, what is provided is a method for compensating for defective pixel conditions in an imaging apparatus.
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
-
Claims (17)
Priority Applications (5)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/327,412 US6751005B1 (en) | 2002-12-20 | 2002-12-20 | Compensating for pixel defects by spatial translation of scene content |
EP03078916A EP1432244B1 (en) | 2002-12-20 | 2003-12-10 | Compensating for pixel defects by spatial translation of scene content |
DE60307969T DE60307969T2 (en) | 2002-12-20 | 2003-12-10 | COMPENSATION OF PIXEL DEFECTS BY LOCAL MOVEMENT OF SCENE CONTENTS |
JP2003423117A JP2004206123A (en) | 2002-12-20 | 2003-12-19 | Compensating for pixel defect by spatial translation of scene content |
CNA2003101231325A CN1509887A (en) | 2002-12-20 | 2003-12-19 | Compensation for pixel defect with spatial translation of scenery contents |
Applications Claiming Priority (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US10/327,412 US6751005B1 (en) | 2002-12-20 | 2002-12-20 | Compensating for pixel defects by spatial translation of scene content |
Publications (2)
Publication Number | Publication Date |
---|---|
US6751005B1 US6751005B1 (en) | 2004-06-15 |
US20040120026A1 true US20040120026A1 (en) | 2004-06-24 |
Family
ID=32393141
Family Applications (1)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US10/327,412 Expired - Fee Related US6751005B1 (en) | 2002-12-20 | 2002-12-20 | Compensating for pixel defects by spatial translation of scene content |
Country Status (5)
Country | Link |
---|---|
US (1) | US6751005B1 (en) |
EP (1) | EP1432244B1 (en) |
JP (1) | JP2004206123A (en) |
CN (1) | CN1509887A (en) |
DE (1) | DE60307969T2 (en) |
Cited By (2)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060082567A1 (en) * | 2002-08-07 | 2006-04-20 | William Allen | Image display system and method |
US20060092189A1 (en) * | 2002-08-07 | 2006-05-04 | Allen William J | Image display system and method |
Families Citing this family (12)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US7068858B2 (en) * | 2002-10-31 | 2006-06-27 | Hewlett-Packard Development Company, L.P. | Projection system utilizing SLM pixels that include SLM pixel regions satisfying acceptable defective SLM pixel policy and SLM regions failing policy |
KR20050086953A (en) * | 2003-01-15 | 2005-08-30 | 마이크로닉 레이저 시스템즈 에이비 | A method to detect a defective pixel |
US7048384B2 (en) * | 2003-01-24 | 2006-05-23 | Honeywell International Inc. | Multiple scene projection system |
JP5586831B2 (en) * | 2004-11-10 | 2014-09-10 | トムソン ライセンシング | System and method for dark noise reduction in pulse width modulation (PWM) displays |
US7907486B2 (en) * | 2006-06-20 | 2011-03-15 | The Invention Science Fund I, Llc | Rotation responsive disk activation and deactivation mechanisms |
US20070081739A1 (en) * | 2005-10-11 | 2007-04-12 | International Business Machines Corporation | Modifying text or images when defect pixels are found on a display |
US20070290962A1 (en) * | 2006-06-19 | 2007-12-20 | Texas Instruments Incorporated | Method and system for displaying an image |
CN100573315C (en) * | 2007-04-04 | 2009-12-23 | 鸿富锦精密工业(深圳)有限公司 | Camera module stain test macro and method |
JP4931238B2 (en) * | 2007-08-14 | 2012-05-16 | キヤノン株式会社 | Imaging apparatus and driving method thereof |
KR101274707B1 (en) * | 2008-06-05 | 2013-06-12 | 엘지디스플레이 주식회사 | Compensation circuit of video display device for compensating display defect and method thereof |
KR102227632B1 (en) * | 2014-10-28 | 2021-03-16 | 삼성디스플레이 주식회사 | Display panel driving device, display device having the same, and method of driving the display device |
CN113766197A (en) * | 2020-06-05 | 2021-12-07 | 深圳光峰科技股份有限公司 | Optical engine system and projection system |
Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5325137A (en) * | 1991-08-28 | 1994-06-28 | Victor Company Of Japan, Ltd. | Overhead projector with a spatial light modulator |
US5461411A (en) * | 1993-03-29 | 1995-10-24 | Texas Instruments Incorporated | Process and architecture for digital micromirror printer |
US5521748A (en) * | 1994-06-16 | 1996-05-28 | Eastman Kodak Company | Light modulator with a laser or laser array for exposing image data |
US5652661A (en) * | 1995-06-07 | 1997-07-29 | Eastman Kodak Company | High speed photographic printer using optical and digital printing with an active matrix LCD |
US5701185A (en) * | 1994-11-21 | 1997-12-23 | Polaroid Corporation | Spatial light modulator assembly for adapting a photographic printer to print electronic images |
US5743610A (en) * | 1994-12-27 | 1998-04-28 | Seiko Epson Corporation | Projection-type display apparatus |
US5745156A (en) * | 1994-04-28 | 1998-04-28 | Xerox Corporation | Digital printer using two-dimensional, full frame light valve |
US5808800A (en) * | 1994-12-22 | 1998-09-15 | Displaytech, Inc. | Optics arrangements including light source arrangements for an active matrix liquid crystal image generator |
US5877844A (en) * | 1995-06-13 | 1999-03-02 | Fuji Photo Film Co., Ltd. | Image exposure method using display panel |
US6618185B2 (en) * | 2001-11-28 | 2003-09-09 | Micronic Laser Systems Ab | Defective pixel compensation method |
Family Cites Families (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5300942A (en) * | 1987-12-31 | 1994-04-05 | Projectavision Incorporated | High efficiency light valve projection system with decreased perception of spaces between pixels and/or hines |
JPH04253044A (en) * | 1990-12-27 | 1992-09-08 | Sanyo Electric Co Ltd | Liquid crystal projector |
US5386250A (en) * | 1993-08-09 | 1995-01-31 | Philips Electronics North America Corp. | Two-source illumination system |
US5715029A (en) * | 1994-10-25 | 1998-02-03 | Fergason; James L. | Optical dithering system using birefringence for optical displays and method |
-
2002
- 2002-12-20 US US10/327,412 patent/US6751005B1/en not_active Expired - Fee Related
-
2003
- 2003-12-10 EP EP03078916A patent/EP1432244B1/en not_active Expired - Fee Related
- 2003-12-10 DE DE60307969T patent/DE60307969T2/en not_active Expired - Lifetime
- 2003-12-19 CN CNA2003101231325A patent/CN1509887A/en active Pending
- 2003-12-19 JP JP2003423117A patent/JP2004206123A/en active Pending
Patent Citations (10)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US5325137A (en) * | 1991-08-28 | 1994-06-28 | Victor Company Of Japan, Ltd. | Overhead projector with a spatial light modulator |
US5461411A (en) * | 1993-03-29 | 1995-10-24 | Texas Instruments Incorporated | Process and architecture for digital micromirror printer |
US5745156A (en) * | 1994-04-28 | 1998-04-28 | Xerox Corporation | Digital printer using two-dimensional, full frame light valve |
US5521748A (en) * | 1994-06-16 | 1996-05-28 | Eastman Kodak Company | Light modulator with a laser or laser array for exposing image data |
US5701185A (en) * | 1994-11-21 | 1997-12-23 | Polaroid Corporation | Spatial light modulator assembly for adapting a photographic printer to print electronic images |
US5808800A (en) * | 1994-12-22 | 1998-09-15 | Displaytech, Inc. | Optics arrangements including light source arrangements for an active matrix liquid crystal image generator |
US5743610A (en) * | 1994-12-27 | 1998-04-28 | Seiko Epson Corporation | Projection-type display apparatus |
US5652661A (en) * | 1995-06-07 | 1997-07-29 | Eastman Kodak Company | High speed photographic printer using optical and digital printing with an active matrix LCD |
US5877844A (en) * | 1995-06-13 | 1999-03-02 | Fuji Photo Film Co., Ltd. | Image exposure method using display panel |
US6618185B2 (en) * | 2001-11-28 | 2003-09-09 | Micronic Laser Systems Ab | Defective pixel compensation method |
Cited By (4)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20060082567A1 (en) * | 2002-08-07 | 2006-04-20 | William Allen | Image display system and method |
US20060092189A1 (en) * | 2002-08-07 | 2006-05-04 | Allen William J | Image display system and method |
US7675510B2 (en) | 2002-08-07 | 2010-03-09 | Hewlett-Packard Development Company, L.P. | Image display system and method |
US7679613B2 (en) | 2002-08-07 | 2010-03-16 | Hewlett-Packard Development Company, L.P. | Image display system and method |
Also Published As
Publication number | Publication date |
---|---|
US6751005B1 (en) | 2004-06-15 |
EP1432244B1 (en) | 2006-08-30 |
JP2004206123A (en) | 2004-07-22 |
DE60307969T2 (en) | 2007-05-10 |
EP1432244A1 (en) | 2004-06-23 |
DE60307969D1 (en) | 2006-10-12 |
CN1509887A (en) | 2004-07-07 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US6215547B1 (en) | Reflective liquid crystal modulator based printing system | |
US6751005B1 (en) | Compensating for pixel defects by spatial translation of scene content | |
EP1174752B1 (en) | A method and apparatus for printing to a photosensitive media using multiple spatial light modulators | |
US8096665B2 (en) | Spatially offset multi-imager-panel architecture for projecting an image | |
US6980321B2 (en) | Method and apparatus for printing high resolution images using multiple reflective spatial light modulators | |
US6646716B1 (en) | Method and apparatus for printing multiple simultaneous images onto a photosensitive media | |
US6762785B2 (en) | Four color film writer | |
US6930797B2 (en) | Method and apparatus for printing high resolution images using multiple reflective spatial light modulators | |
EP1177908B1 (en) | A method and apparatus for monochromatic printing using a spatial light modulator | |
US6330018B1 (en) | Method and apparatus for printing high resolution images using reflective LCD modulators | |
US6624949B2 (en) | Printing apparatus for photosensitive media using dichroic prism in illumination path | |
US20060092390A1 (en) | Projector | |
US6980280B2 (en) | Two level image writer | |
US6480259B1 (en) | Method and apparatus for printing monochromatic images using a spatial light modulator having a selectable light source | |
JPH09244152A (en) | Image exposure device | |
US7136210B2 (en) | Light modulator | |
US7307764B2 (en) | Apparatus and method for controlled movement of pixel imaging device | |
JP2001083601A (en) | Projector | |
Kollarits et al. | Near-continuous-tone electronic color printing on low-sensitivity photographic materials | |
JPH117084A (en) | Image exposure device |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:BARNICK, WILLIAM M.;BERNARDI, BRYAN D.;MILLER, WILLIAM G.;AND OTHERS;REEL/FRAME:013635/0794;SIGNING DATES FROM 20021219 TO 20021220 |
|
FEPP | Fee payment procedure |
Free format text: PAYOR NUMBER ASSIGNED (ORIGINAL EVENT CODE: ASPN); ENTITY STATUS OF PATENT OWNER: LARGE ENTITY |
|
FPAY | Fee payment |
Year of fee payment: 4 |
|
FPAY | Fee payment |
Year of fee payment: 8 |
|
AS | Assignment |
Owner name: CITICORP NORTH AMERICA, INC., AS AGENT, NEW YORK Free format text: SECURITY INTEREST;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:028201/0420 Effective date: 20120215 |
|
AS | Assignment |
Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT, MINNESOTA Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:030122/0235 Effective date: 20130322 Owner name: WILMINGTON TRUST, NATIONAL ASSOCIATION, AS AGENT, Free format text: PATENT SECURITY AGREEMENT;ASSIGNORS:EASTMAN KODAK COMPANY;PAKON, INC.;REEL/FRAME:030122/0235 Effective date: 20130322 |
|
AS | Assignment |
Owner name: BANK OF AMERICA N.A., AS AGENT, MASSACHUSETTS Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (ABL);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031162/0117 Effective date: 20130903 Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE, DELAWARE Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031158/0001 Effective date: 20130903 Owner name: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT, NEW YORK Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031159/0001 Effective date: 20130903 Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNORS:CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT;WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT;REEL/FRAME:031157/0451 Effective date: 20130903 Owner name: BARCLAYS BANK PLC, AS ADMINISTRATIVE AGENT, NEW YO Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (SECOND LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031159/0001 Effective date: 20130903 Owner name: JPMORGAN CHASE BANK, N.A., AS ADMINISTRATIVE, DELA Free format text: INTELLECTUAL PROPERTY SECURITY AGREEMENT (FIRST LIEN);ASSIGNORS:EASTMAN KODAK COMPANY;FAR EAST DEVELOPMENT LTD.;FPC INC.;AND OTHERS;REEL/FRAME:031158/0001 Effective date: 20130903 Owner name: PAKON, INC., NEW YORK Free format text: RELEASE OF SECURITY INTEREST IN PATENTS;ASSIGNORS:CITICORP NORTH AMERICA, INC., AS SENIOR DIP AGENT;WILMINGTON TRUST, NATIONAL ASSOCIATION, AS JUNIOR DIP AGENT;REEL/FRAME:031157/0451 Effective date: 20130903 |
|
REMI | Maintenance fee reminder mailed | ||
LAPS | Lapse for failure to pay maintenance fees | ||
STCH | Information on status: patent discontinuation |
Free format text: PATENT EXPIRED DUE TO NONPAYMENT OF MAINTENANCE FEES UNDER 37 CFR 1.362 |
|
FP | Lapsed due to failure to pay maintenance fee |
Effective date: 20160615 |
|
AS | Assignment |
Owner name: KODAK (NEAR EAST), INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: QUALEX, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: CREO MANUFACTURING AMERICA LLC, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: PAKON, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK AMERICAS, LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: LASER PACIFIC MEDIA CORPORATION, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: FPC, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK PHILIPPINES, LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK AVIATION LEASING LLC, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: NPEC, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK REALTY, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK IMAGING NETWORK, INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 Owner name: KODAK PORTUGUESA LIMITED, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:JP MORGAN CHASE BANK, N.A., AS ADMINISTRATIVE AGENT;REEL/FRAME:049814/0001 Effective date: 20190617 |
|
AS | Assignment |
Owner name: KODAK PHILIPPINES LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: KODAK REALTY INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: LASER PACIFIC MEDIA CORPORATION, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: EASTMAN KODAK COMPANY, NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: KODAK (NEAR EAST) INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: KODAK AMERICAS LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: FAR EAST DEVELOPMENT LTD., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: QUALEX INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: NPEC INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 Owner name: FPC INC., NEW YORK Free format text: RELEASE BY SECURED PARTY;ASSIGNOR:BARCLAYS BANK PLC;REEL/FRAME:052773/0001 Effective date: 20170202 |