US20060012714A1 - Dual-scaler architecture for reducing video processing requirements - Google Patents
Dual-scaler architecture for reducing video processing requirements Download PDFInfo
- Publication number
- US20060012714A1 US20060012714A1 US11/179,222 US17922205A US2006012714A1 US 20060012714 A1 US20060012714 A1 US 20060012714A1 US 17922205 A US17922205 A US 17922205A US 2006012714 A1 US2006012714 A1 US 2006012714A1
- Authority
- US
- United States
- Prior art keywords
- video signal
- resolution
- horizontal
- vertical
- prescaled
- Prior art date
- Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
- Abandoned
Links
Images
Classifications
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
-
- G—PHYSICS
- G06—COMPUTING; CALCULATING OR COUNTING
- G06T—IMAGE DATA PROCESSING OR GENERATION, IN GENERAL
- G06T3/00—Geometric image transformation in the plane of the image
- G06T3/40—Scaling the whole image or part thereof
- G06T3/4023—Decimation- or insertion-based scaling, e.g. pixel or line decimation
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/005—Adapting incoming signals to the display format of the display terminal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/003—Details of a display terminal, the details relating to the control arrangement of the display terminal and to the interfaces thereto
- G09G5/006—Details of the interface to the display terminal
- G09G5/008—Clock recovery
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G5/00—Control arrangements or circuits for visual indicators common to cathode-ray tube indicators and other visual indicators
- G09G5/18—Timing circuits for raster scan displays
-
- H—ELECTRICITY
- H03—ELECTRONIC CIRCUITRY
- H03L—AUTOMATIC CONTROL, STARTING, SYNCHRONISATION, OR STABILISATION OF GENERATORS OF ELECTRONIC OSCILLATIONS OR PULSES
- H03L7/00—Automatic control of frequency or phase; Synchronisation
- H03L7/06—Automatic control of frequency or phase; Synchronisation using a reference signal applied to a frequency- or phase-locked loop
- H03L7/16—Indirect frequency synthesis, i.e. generating a desired one of a number of predetermined frequencies using a frequency- or phase-locked loop
- H03L7/18—Indirect frequency synthesis, i.e. generating a desired one of a number of predetermined frequencies using a frequency- or phase-locked loop using a frequency divider or counter in the loop
- H03L7/197—Indirect frequency synthesis, i.e. generating a desired one of a number of predetermined frequencies using a frequency- or phase-locked loop using a frequency divider or counter in the loop a time difference being used for locking the loop, the counter counting between numbers which are variable in time or the frequency divider dividing by a factor variable in time, e.g. for obtaining fractional frequency division
- H03L7/1974—Indirect frequency synthesis, i.e. generating a desired one of a number of predetermined frequencies using a frequency- or phase-locked loop using a frequency divider or counter in the loop a time difference being used for locking the loop, the counter counting between numbers which are variable in time or the frequency divider dividing by a factor variable in time, e.g. for obtaining fractional frequency division for fractional frequency division
- H03L7/1976—Indirect frequency synthesis, i.e. generating a desired one of a number of predetermined frequencies using a frequency- or phase-locked loop using a frequency divider or counter in the loop a time difference being used for locking the loop, the counter counting between numbers which are variable in time or the frequency divider dividing by a factor variable in time, e.g. for obtaining fractional frequency division for fractional frequency division using a phase accumulator for controlling the counter or frequency divider
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/10—Packet switching elements characterised by the switching fabric construction
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/41—Structure of client; Structure of client peripherals
- H04N21/426—Internal components of the client ; Characteristics thereof
- H04N21/42692—Internal components of the client ; Characteristics thereof for reading from or writing on a volatile storage medium, e.g. Random Access Memory [RAM]
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N21/00—Selective content distribution, e.g. interactive television or video on demand [VOD]
- H04N21/40—Client devices specifically adapted for the reception of or interaction with content, e.g. set-top-box [STB]; Operations thereof
- H04N21/43—Processing of content or additional data, e.g. demultiplexing additional data from a digital video stream; Elementary client operations, e.g. monitoring of home network or synchronising decoder's clock; Client middleware
- H04N21/44—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs
- H04N21/4402—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display
- H04N21/440218—Processing of video elementary streams, e.g. splicing a video clip retrieved from local storage with an incoming video stream, rendering scenes according to MPEG-4 scene graphs involving reformatting operations of video signals for household redistribution, storage or real-time display by transcoding between formats or standards, e.g. from MPEG-2 to MPEG-4
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/14—Picture signal circuitry for video frequency region
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N7/00—Television systems
- H04N7/01—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level
- H04N7/0117—Conversion of standards, e.g. involving analogue television standards or digital television standards processed at pixel level involving conversion of the spatial resolution of the incoming video signal
- H04N7/012—Conversion between an interlaced and a progressive signal
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2300/00—Aspects of the constitution of display devices
- G09G2300/04—Structural and physical details of display devices
- G09G2300/0404—Matrix technologies
- G09G2300/0408—Integration of the drivers onto the display substrate
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2310/00—Command of the display device
- G09G2310/02—Addressing, scanning or driving the display screen or processing steps related thereto
- G09G2310/0229—De-interlacing
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0414—Vertical resolution change
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0421—Horizontal resolution change
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0407—Resolution change, inclusive of the use of different resolutions for different screen areas
- G09G2340/0435—Change or adaptation of the frame rate of the video stream
-
- G—PHYSICS
- G09—EDUCATION; CRYPTOGRAPHY; DISPLAY; ADVERTISING; SEALS
- G09G—ARRANGEMENTS OR CIRCUITS FOR CONTROL OF INDICATING DEVICES USING STATIC MEANS TO PRESENT VARIABLE INFORMATION
- G09G2340/00—Aspects of display data processing
- G09G2340/04—Changes in size, position or resolution of an image
- G09G2340/0442—Handling or displaying different aspect ratios, or changing the aspect ratio
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
- H04L49/3018—Input queuing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04L—TRANSMISSION OF DIGITAL INFORMATION, e.g. TELEGRAPHIC COMMUNICATION
- H04L49/00—Packet switching elements
- H04L49/30—Peripheral units, e.g. input or output ports
- H04L49/3027—Output queuing
-
- H—ELECTRICITY
- H04—ELECTRIC COMMUNICATION TECHNIQUE
- H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
- H04N5/00—Details of television systems
- H04N5/44—Receiver circuitry for the reception of television signals according to analogue transmission standards
- H04N5/46—Receiver circuitry for the reception of television signals according to analogue transmission standards for receiving on more than one standard at will
Definitions
- the present invention relates generally to integrated circuits (ICs), and more particularly to video processor ICs. More particularly, the present invention relates to an architecture for a video processor IC.
- the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- Video processing hardware is generally used to perform selected pixel-based and frame-based processing steps on an incoming video stream and then scale the resulting video signal for output on a display.
- Scaling of the video signal may be used to provide appropriate pixel scale in multi-standard video applications. For example, in some applications, it is desirable to receive a video signal at DVD resolution (720 pixels by 480 pixels), for instance, from a DVD player, and to display the video signal on a VGA display device (resolution of 640 by 480 pixels). In this application, the horizontal resolution of the signal is scaled from 720 pixels to 640 pixels for full-screen display on the television.
- a set of vertical and horizontal scalers are provided in video processing ICs.
- SDTV standard definition television
- NTSC NTSC
- PAL PAL
- SECAM SECAM
- 720p 1080i
- 1080p 1080p
- i interlaced signal
- Conversion between these various video formats is usually performed by video processing ICs integrated into the display device, for example, a television or video display device.
- DVD format and PC formats including VGA, XGA, SXGA, and UXGA are currently in use.
- the architecture of some video processing ICs is adapted to process standard interlaced video (SDTV) at a pixel rate of 13.5 MHz.
- SDTV standard interlaced video
- non-HDTV broadcast signals are included in the formats referred to as SDTV.
- the extension of these video processing ICs for use in processing HDTV signals is nontrivial. For instance, as the clock rate of the video processing IC and the memory size provided increase, it becomes increasingly difficult to utilize hardware adapted for processing SDTV video signals to process HDTV video signals, while maintaining the resolution of the HDTV video signals.
- the present invention relates to an architecture for a video processor IC.
- the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- a video signal processor includes an input port adapted to receive an input video signal.
- the input video signal is characterized by a first horizontal resolution and a first vertical resolution.
- the input video signal is an HDTV video signal.
- the video signal processor also includes a pixel-based processor coupled to the input port and adapted to perform pixel-based processing of the input video signal and generate a processed video signal.
- the video signal processor further includes a prescaler coupled to the pixel-based processor and adapted to perform prescaling of the processed video signal.
- the prescaling process converts the processed video signal at the first horizontal resolution and the first vertical resolution to a prescaled video signal characterized by a second horizontal resolution and a second vertical resolution.
- the second horizontal resolution is less than the first horizontal resolution.
- the second vertical resolution is less than the first vertical resolution.
- the video signal processor additionally includes a frame-based processor coupled to the prescaler and adapted to perform frame-based processing of the prescaled video signal and a frame buffer coupled to the frame-based processor.
- the video signal processor includes a horizontal scaler coupled to the frame buffer and adapted to convert the horizontal scale of the prescaled video signal from the second horizontal resolution to a third horizontal resolution and a vertical scaler coupled to the horizontal scaler and adapted to convert the vertical scale of the prescaled video signal from the second vertical resolution to a third vertical resolution.
- the third horizontal and third vertical resolution is less than the first horizontal and first vertical resolution associated with the input video signal.
- a method of processing a video signal includes receiving a video signal characterized by a first horizontal resolution and a first vertical resolution and performing prescaling of the video signal to change the first horizontal resolution to a second horizontal resolution and the first vertical resolution to a second vertical resolution and produce a prescaled video signal.
- the first horizontal resolution is greater than the second horizontal resolution and the first vertical resolution is greater than the second vertical resolution.
- the method also includes performing storage of the prescaled video signal in a frame buffer.
- the method further includes performing horizontal scaling of the prescaled video signal to convert the prescaled video signal from the second horizontal resolution to a third horizontal resolution and performing vertical scaling of the prescaled video signal to convert the prescaled video signal from the second vertical resolution to a third vertical resolution. Moreover, the method includes providing an output video signal characterized by the third horizontal resolution and the third vertical resolution.
- Some embodiments provide video processor ICs with reduced processor requirements. Additionally, embodiments of the present invention reduce the bandwidth of high definition signals for processing by deinterlacers adapted to process standard definition signals. Moreover, some embodiments of the present invention provide reductions in the manufacturing cost of video processor IC components as well as the cost of internal and external memories utilized in video processing operations. Furthermore, embodiments of the present invention provide methods and apparatus which reduce the power consumption for video processing ICs as well as video processing systems. Depending upon the embodiment, one or more of these benefits may exist. These and other benefits have been described throughout the present specification and more particularly below.
- FIG. 1 is a simplified schematic diagram illustrating a video processor architecture according to an embodiment of the present invention
- FIG. 2 is a simplified flowchart illustrating a process flow according to an embodiment of the present invention
- FIG. 3 is a simplified schematic diagram illustrating a video processor architecture according to an alternative embodiment of the present invention.
- FIG. 4 is a simplified flowchart illustrating a process flow according to an alternative embodiment of the present invention.
- FIG. 5 is a simplified diagram illustrating a prescaling, processing, and scaling operation according to an embodiment of the present invention.
- FIG. 6 is a simplified diagram illustrating another prescaling, processing, and scaling operation according to another embodiment of the present invention.
- the present invention relates to an architecture for a video processor IC.
- the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- an exemplary deinterlacing algorithm included in a video processing IC utilized to process standard interlaced SDTV signals at a pixel rate of 13.5 MHz operates at a clock rate of 50 MHz for signal processing operations and uses a 32-bit memory system.
- a pixel rate of 74.25 MHz is used.
- the system clock operates at a clock rate of 275 MHz and a 64-bit memory system is generally utilized.
- the memories are DDR memories, whereas in other embodiments, the memories are SDRAMs.
- the size of frame buffers utilized during video processing operations is reduced. For example, in some video processors adapted to process HDTV signals, frame buffers with 16 MB capacities are utilized. According to embodiments of the present invention, frame buffers of 8 MB capacity or smaller are utilized to process prescaled HDTV signals.
- the increase in system clock rate generally necessitates a decrease in semiconductor process linewidth, for example from 0.18 ⁇ m geometries to 0.13 ⁇ m geometries.
- the increased memory requirements result in additional cost increases.
- the resolution of the video display device is less than the resolution of the input signal.
- content is displayed in a 1024 ⁇ 768 pixel progressively scanned format.
- Other display devices including VGA display devices, with resolutions of 640 ⁇ 480 pixels, SXGA display devices, with resolutions of 1280 ⁇ 1024 pixels, and UXGA display devices, with resolutions of 1600 ⁇ 1200 pixels, are included in embodiments of the present invention. If the incoming video signal provided to the XGA display device is an HDTV signal, the XGA display device is not capable of displaying the total resolution provided by the HDTV signal.
- the XGA display device provides a picture quality closer to HDTV than to regular television, the XGA display device will not display either the 1280 pixels present in the horizontal direction in a 720p signal (1280 ⁇ 720 pixels) or the 1920 pixels present in a 1080i format signal (1920 ⁇ 1080 pixels).
- the capability of maintaining the resolution of an HDTV signal does not provide a benefit to the viewer.
- a video processing IC incorporating a prescaler provides a benefit of reducing system bandwidth and memory resources utilized while producing an output signal to the display device appropriate to the display device's resolution.
- FIG. 1 is a simplified schematic diagram illustrating a video processor architecture according to an embodiment of the present invention.
- video processor 100 includes a number of processor elements and provides a dual-scaler architecture comprising a set of prescalers and a set of scalers.
- the dual-scaler architecture reduces the signal processing and memory requirements, enabling processing of high resolution signals with standard video processing components and algorithms.
- An input video signal is received at pixel-based processor 110 .
- pixel-based processing includes enhancements to video signals such as color adjustments, color conversion, format conversion, and the like.
- the signal is provided to a horizontal prescaler 112 .
- the horizontal prescaler reduces the horizontal pixel count of the input video signal, providing an output in the form of a prescaled video signal.
- the horizontal resolution may be decreased from 1920 pixels to 1024 pixels, this conversion being associated with scaling from HD resolution to XGA resolution.
- Embodiments of the present invention are not limited to conversion from HD resolutions to XGA resolutions.
- embodiments of the present invention provide for horizontal prescaling of HDTV signals for eventual display at EDTV, SDTV, VGA, XGA, SXGA, and other resolutions.
- the horizontal prescaler is adaptive and software programmable. These features enable the designer to select a scaling level that is appropriate to existing processor components.
- conventional scaling approaches and algorithms including finite impulse response (FIR) filters and downsampling techniques are utilized for the prescalers.
- FIR finite impulse response
- a vertical prescaler 114 is provided as an element of the video processing IC according to embodiments of the present invention. After processing by the horizontal prescaler, the signal is provided to the vertical prescaler, which performs a scaling operation on the pixels arrayed vertically. In some embodiments, the vertical scale of the video signal is reduced, for example, from that associated with an HDTV signal to that associated with an EDTV signal, an SDTV signal, or others.
- the vertical scale of the video signal is reduced, for example, from that associated with an HDTV signal to that associated with an EDTV signal, an SDTV signal, or others.
- Embodiments of the present invention provide for prescaling of the input video signal, thereby reducing the pixel count prior to substantial processing of the video signal. Accordingly, embodiments of the present invention provide video processing IC designers with methods and apparatus that utilize processor components developed for SDTV applications to convert and process HDTV video, producing a video signal matched to the resolution of display display devices at resolutions lower than HDTV resolutions.
- FIG. 1 illustrates both a horizontal and vertical prescalar
- embodiments of the present invention are not limited to this particular architecture.
- either a horizontal prescaler or a vertical prescaler are provided as appropriate to the particular application.
- a software bypass may be used to select the appropriate prescaling processing, including a resolution conversion factor equal to one.
- a horizontal prescaler is utilized to reduce the horizontal pixel count while maintaining the vertical pixel count.
- a horizontal prescaler may be utilized to reduce the horizontal pixel count from 1280 to 640, thereby reducing the total pixel count by a factor of two.
- high bandwidth signals such as HDTV signals with sampling rates about five times greater than SDTV signals are prescaled prior to some video processing steps.
- the prescaling step allows for reduction in signal bandwidth to levels suitable for processing by video processing components originally developed for SDTV applications, which are generally characterized by signal bandwidths about five times less than those associated with HDTV signals. Cost savings and other benefits will be evident to one of skill in the art.
- the signal is passed from the pixel-based processor 110 to the vertical prescaler, bypassing the horizontal prescaler as illustrated by processing path 130 .
- processing path 130 could be appropriate for processing a UXGA signal.
- processing path 132 is illustrated in FIG. 1 , whereby the horizontal prescaling is performed on the input signal and the signal is passed to the frame-based processor, bypassing the vertical prescaler.
- a 1080i signal is prescaled to generate a 960 ⁇ 1080 pixel signal in an embodiment of the present invention, without vertical prescaling of the signal.
- another processing path (not illustrated) is provided, in which both prescalers are bypassed and the video signal is passed from the pixel-base processor to the frame-based processor.
- Frame buffer 116 is provided according to embodiments of the present invention as illustrated in FIG. 1 .
- Frame buffer 116 is a DDR or a SDRAM frame buffer according to particular embodiments of the present invention.
- the frame buffer stores multiple frames or fields in memory, enabling subsequent processing at a frame/field level.
- frame-based processor 118 is illustrated in FIG. 1 .
- Frame-based processing includes a number of actions, including interlacing, automatic brightness adjustment, noise measurement and adjustment, and the like.
- frame buffers and frame-based processors may also be utilized to perform frame rate conversion.
- Deinterlacer 120 a second set of scalers including Horizontal Scaler 122 and Vertical Scaler 124 along with a Display Enhancer 126 are illustrated in FIG.
- a display enhancer performs processes including edge enhancement, color enhancement, and the like.
- the deinterlacer is combined with the frame-based processor, although this is not required by the present invention.
- Video output is provided at the output of the display enhancer, generally optimized for the particular display associated with the video processor IC.
- the scalers 122 and 124 convert the signal from the format provided by the deinterlacer 120 to the signal associated with a particular monitor or display device.
- embodiments of the present invention are capable of receiving multi-format signals as inputs and outputting a video signal adapted for display on a particular display device, the particular display device being characterized by a vertical and horizontal resolution, contrast ratio, and the like.
- FIG. 1 illustrates the set of prescalers 112 and 114 as utilized between the pixel-based and frame-based processing steps, this is not required by the present invention.
- the prescalers are employed prior to or following the pixel-based and frame-based processing steps as appropriate to the particular application.
- reduction of the pixel count prior to processing by deinterlacer 120 is provided by embodiments of the present invention.
- signal processing requirements for example, in the deinterlacer, are reduced by embodiments of the present invention.
- memory sizes provided and/utilized by the video processing IC are reduced, reducing system cost and complexity.
- video processing components such as a deinterlacer, generally utilized to process SDTV signals are utilized to process prescaled HDTV signals without significant reductions in final image quality.
- video processing components designed and fabricated using 0.18 ⁇ m technology are utilized to process HDTV signals generally processed using more advanced processor designs, larger die sizes, or smaller linewidth technologies such as 0.13 ⁇ m technologies.
- deinterlacer 120 is utilized, but embodiments of the present invention are not limited to interlaced video processing. In other embodiments, progressively scanned video signals are processed according to embodiments of the present invention.
- deinterlacer 120 is utilized, but embodiments of the present invention are not limited to interlaced video processing. In other embodiments, progressively scanned video signals are processed according to embodiments of the present invention.
- One of ordinary skill in the art would recognize many variations, modifications, and alternatives.
- FIG. 2 is a simplified flowchart illustrating a process flow 200 according to an embodiment of the present invention.
- an input video signal is received in step 210 .
- the input video signal is 25 an HDTV signal, for example a 720p, a 1080i, or a 1080p signal.
- the video signal is an EDTV video signal or an SDTV video signal.
- Pixel-based processing of the video signal is performed in step 212 .
- steps 214 and 216 respectively, horizontal and vertical prescaling of the video signal received in step 210 is performed.
- step 218 frame buffereing is performed and frame-based processing is performed is performed in step 220 .
- deinterlacing is performed in step 222 .
- this step becomes an optional step when progressively scan video signals are utilized.
- Embodiments of the present invention are not limited to interlaced video signals, but are also applicable to progressively scanned video signals.
- the frame-based processor and the deinterlacer are combined into a single component. In these embodiments, steps 220 and 222 are combined into a frame-based processing/deinterlacing process.
- step 224 horizontal scaling of the video signal is performed.
- this scaling step is accomplished in order to size the video signal for display on an appropriate display device.
- the 1080i HDTV signal is characterized by 1,920 horizontal pixels and 1,080 vertical pixels.
- the horizontal resolution of the signal is decreased by a factor of two, producing a signal with 960 horizontal pixels.
- the vertical prescaling step is not performed depending on the particular applications, resulting in a prescaled signal with 960 ⁇ 1080 pixels.
- the signal (at 960 ⁇ 1080 pixels) is scaled for display on an XGA display device, which supports a resolution of 1024 ⁇ 768 pixels. Scaling of the HD signal to other formats will be evident to one of skill in the art.
- step 224 the number of pixels in the horizontal and vertical direction is scaled by an appropriate factor.
- the prescaling of the video signal provides a reduction in the data bandwidth utilized during processing and memory operations without resulting in degradation of the video signal ultimately displayed.
- step 228 the display is enhanced as appropriate to display on the XGA display device and an XGA video output signal is provided in step 230 .
- the resolution of the prescaled video signal was less than the resolution of the input video signal in both the horizontal and vertical dimensions.
- prescaling is performed in a single dimension, for example the horizontal or the vertical dimension.
- the resolution of the output video signal was less than the prescaled video signal in both the horizontal and vertical dimensions.
- this scaling relationship is not required by embodiments of the present invention.
- the scaling of the video signal will be selected based on the display characteristics of the display device.
- FIG. 2 provides a particular processing sequence according to one embodiment of the present invention.
- Other sequence of steps may also be performed according to alternative embodiments.
- alternative embodiments of the present invention may perform the processing steps outlined above in a different order.
- the order in which the signals are processed using pixel-based and frame-based processing algorithms may be varied, with these processing steps being performed after the horizontal and vertical prescaling steps.
- the individual steps illustrated by this figure may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step.
- additional video processing and/or memory operations may be added or removed depending on the particular applications.
- One of ordinary skill in the art would recognize many variations, modifications, and alternatives.
- FIG. 3 is a simplified schematic diagram illustrating a video processor architecture according to an alternative embodiment of the present invention.
- a video input is received at an input of the video processor IC 300 .
- Prescaler 310 is utilized to prescale the video signal, thereby changing the horizontal and/or vertical resolution. In some embodiments, the resolution of the video signal as received is reduced by the prescaler, thereby reducing the cost and performance of processing and memory components utilized during subsequent video processing operations.
- Pixel-based processor 312 , frame buffer 314 and frame-based processor/deinterlacer 316 are utilized to further process the prescaled video signal. As illustrated in FIG. 3 , the deinterlacer is combined with the frame-based processor, although this is not required by the present invention.
- the deinterlacer is utilized to generate a progressively scanned signal from an interlaced signal.
- the reduction in pixel count provided by the prescaler may provide significant benefits at the deinterlacing step, as washererlacing methods and systems developed for SDTV signals may be utilized to process HDTV signals.
- Embodiments of the present invention are not limited to the use of a deinterlacer, but may also be utilized in processing progressively scanned signals.
- Scaler 318 is utilized to scale the resolution of the video signal to the resolution of the display device. For example, for an XGA display device, a resolution of 1024 ⁇ 768 is generated by a scaler. Both the prescaler and scalers provided by embodiments of the present invention are software programmable and adaptive to provide the system designer with multi-format input and output displays.
- Optional display enhancer 320 is utilized in some embodiments to further process the scaled video signal in preparation for display on a particular display device.
- FIG. 4 is a simplified flowchart illustrating a process flow 400 according to an alternative embodiment of the present invention.
- a video signal is received at step 410 and prescaling of the signal is performed in step 412 .
- the prescaling may be performed in the horizontal direction, the vertical direction, or both.
- Prescaling generally involves reducing the pixel content of the received video signal to produce a prescaled video signal with reduced pixel content.
- steps 414 and 416 the prescaled video signal is processed utilizing pixel-based and frame-based processing algorithms, respectively.
- these steps may be interchanged as appropriate to a particular application.
- step 418 the video signal is stored into memory utilizing a SDRAM frame buffer.
- a SDRAM frame buffer As will be evident to one of skill in the art, other memory devices are utilized in alternative embodiments.
- Deinterlacing is performed in step 420 . In embodiments utilizing progressively scanned input video signals, this step is removed, as the signal is already provided in a progressively scanned format.
- step 422 the video signal is scaled utilizing conventional methods to provide an output video signal matched to the display characteristics of the display device.
- step 424 the scaled video signal is enhanced for display, providing an output video signal in step 426 .
- FIG. 4 provides a particular processing sequence according to one embodiment of the present invention.
- Other sequence of steps may also be performed according to alternative embodiments.
- alternative embodiments of the present invention may perform the processing steps outlined above in a different order.
- the order in which the signals are processed using pixel-based and frame-based processing algorithms may be varied, with these processing steps being performed in reverse order.
- the individual steps illustrated by this figure may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step.
- additional video processing and/or memory operations may be added or removed depending on the particular applications.
- One of ordinary skill in the art would recognize many variations, modifications, and alternatives.
- FIG. 5 is a simplified diagram illustrating a prescaling, processing, and scaling operation according to an embodiment of the present invention.
- a 1080i input video signal 510 is received by the video processing IC.
- the resolution of this 1080i signal is 1,920 horizontal pixels by 1,080 vertical pixels.
- the video processing IC provided by embodiments of the present invention will provide an output signal for display on an XGA video display, such as an LCD display panel.
- the data rate for this input signal is 74.25 MHz, which is a higher data rate than that typically associated with SDTV video processing.
- many video processing ICs optimized for processing of SDTV formats run at data rates less than 74.25 MHz.
- the 1080i video signal is horizontally prescaled by a factor of 0.5 to generate a video signal 520 at a resolution of 960 horizontal pixels by 1,080 vertical pixels.
- video signal 520 is referred to as an intermediate interlaced picture.
- the data rate for the intermediate interlaced picture is 37.125 MHz, half of the data rate of the input video signal 510 .
- horizontal prescaling reduces the pixel rate to a level at which deinterlacing, described more fully below, is performed using hardware typically utilized for processing for 480i video signals.
- the horizontal prescaling performed at process 515 modifies the aspect ratio of the intermediate interlaced picture.
- vertical prescaling of the input signal is not performed.
- path 132 provides a processing flow in which only horizontal prescaling is performed.
- no vertical resolution is lost during image processing, as the limiting factor in this embodiment is the resolution of the XGA display panel.
- both horizontal and vertical prescaling are performed to reduce the data rate to levels predetermined by the system designer.
- vertical prescaling alone is performed in alternative embodiments.
- Frame buffer 530 is utilized to store frames or fields associated with the intermediate interlaced picture. As will be evident to one of skill in the art, frame buffering provides data utilized during subsequent frame-based processing steps.
- the interlaced video signal is deinterlaced to generate a progressively scanned image.
- the progressively scanned image also referred to as a progressive picture 540 has a resolution of 960 horizontal pixels by 1,080 vertical pixels.
- the progressive picture 540 is vertically down scaled by a factor of 32/45 to generate a progressively scanned picture 550 with a resolution of 960 horizontal pixels and 768 vertical pixels.
- a vertical scaling factor of 32/45 is utilized in the embodiment of the present invention illustrated in FIG. 5 , this is not required by the present invention.
- the vertical scaling factor, along with the horizontal scaling factor discussed below, combined with the initial prescaling factor (in either the horizontal, vertical, or both directions) is selected to provide an appropriate resolution for eventual display.
- vertical scaling of progressively scanned picture 540 by a factor of 32/45 results in an image with 768 vertical pixels, matched to the XGA display illustrated in FIG. 5 .
- prescaling and scaling factors are selected as appropriate to the particular application.
- prescaling and scaling factors are selected as appropriate to the particular application.
- One of ordinary skill in the art would recognize many variations, modifications, and alternatives.
- the progressive picture 550 is horizontally upscaled by a factor of 16/15 to generate a progressively scanned picture 560 with a resolution of 1,024 horizontal pixels by 768 vertical pixels.
- the data rate of the video signal 560 is 65 MHz.
- computationally intensive processes such as deinterlacing at step 535 , are performed on reduced data rate video signals.
- deinterlacing is performed on a signal at a data rate of 37.125 MHz, less than the input data rate of 74.25 MHz.
- frame-based processing components such as the deinterlacer, generally utilized for processing of SDTV and PC signals are utilized in embodiments of the present invention, thereby reducing system cost and increasing the range of available component.
- FIG. 6 is a simplified diagram illustrating another prescaling, processing, and scaling operation according to another embodiment of the present invention.
- a high-resolution input video signal in the form of a 1080p HDTV signal is received and processed for eventual display on an SVGA panel.
- the resolution of this 1080p signal is 1,920 horizontal pixels by 1,080 vertical pixels.
- the data rate for this signal is 148.5 MHz, twice that of the 1080i input video signal illustrated in FIG. 5 .
- the 1080p video signal is horizontally prescaled by a factor of 0.5 to generate a video signal 620 at a resolution of 960 horizontal pixels by 1,080 vertical pixels.
- the data rate of video signal 620 is 74.25 MHz, one half that of the 1080p video input signal.
- video signal 620 is referred to as an intermediate progressive picture A.
- the intermediate progressive picture A 620 is vertically prescaled by a factor of 0.5 to generate intermediate progressive picture B 630 with a resolution of 960 ⁇ 540 pixels and a data rate of 37.125 MHz.
- intermediate progressive picture B 630 is appropriate for processing using, for example, SDTV components.
- the aspect ratio of the image 630 is the same as the aspect ratio of the original input video signal 610 .
- Frame buffer 640 is utilized to store frames or fields associated with the intermediate progressive picture B. As a result of the prescaling operations, frame buffer size requirements are reduced by factor of four compared to requirements for the 1080p signal.
- no deinterlacer is utilized in the embodiment illustrated in FIG. 6 .
- intermediate progressive picture B is horizontally downscaled by a factor of 5 ⁇ 6 to generate a progressively scanned picture 650 at a resolution of 800 ⁇ 540.
- the progressive picture 650 is vertically upscaled by a factor of 10/9 to generate the output video signal 660 .
- the combination of horizontal and vertical prescaling, as well as the horizontal and vertical scaling in step 645 and step 655 are selected based on the resolution of the video signal received and the resolution of the output video signal generated. In the embodiment illustrated in FIG. 6 , these prescaling and scaling factors are selected to convert the 1080p HDTV video signal into an SVGA output signal. In alternative embodiments, the prescaling and scaling factors are selected as appropriate to the input and output signals.
- the order in which the horizontal and vertical scalers are utilized is modified, as both orders are included according to embodiments of the present invention.
- the scaling order is horizontal prescaling, vertical prescaling, vertical scaling, and horizontal scaling, as this order reduces the minimum line buffer requirement.
- the scaling order is not limited to the above mentioned order, as embodiments of the present invention provide for a variety of scaling orders.
- the horizontal and vertical scalers illustrated in these figures are general-purpose scalers, providing for both scaling up and scaling down as appropriate to the particular application.
- the prescalers are generally limited to downscaling operations, although downscaling is not required by the present invention.
Abstract
A video signal processor includes an input port adapted to receive an input video signal. The input video signal is characterized by a first horizontal resolution and a first vertical resolution. The video signal processor also includes a prescaler adapted to perform prescaling of the video signal, wherein prescaling converts the input video signal at the first horizontal resolution and the first vertical resolution to a prescaled video signal characterized by a second horizontal resolution and a second vertical resolution. The video signal processor additionally includes a frame buffer coupled to the prescaler. The video signal processor further includes a horizontal scaler adapted to convert the horizontal scale of the prescaled video signal from the second horizontal resolution to a third horizontal resolution and a vertical scaler adapted to convert the vertical scale of the prescaled video signal from the second vertical resolution to a third vertical resolution.
Description
- The present application claims benefit under 35 U.S.C. 119(e) of U.S. provisional application No. 60/558,647, filed Jul. 16, 2004, entitled “System And Method For Use In Video Processing Including A Programmable Input Device, A Pixel Clock Generator, And A Dual Scaler Architecture,” the contents of which is incorporated herein by reference in its entirety.
- NOT APPLICABLE
- The present invention relates generally to integrated circuits (ICs), and more particularly to video processor ICs. More particularly, the present invention relates to an architecture for a video processor IC. Merely by way of example, the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- Video processing hardware is generally used to perform selected pixel-based and frame-based processing steps on an incoming video stream and then scale the resulting video signal for output on a display. Scaling of the video signal may be used to provide appropriate pixel scale in multi-standard video applications. For example, in some applications, it is desirable to receive a video signal at DVD resolution (720 pixels by 480 pixels), for instance, from a DVD player, and to display the video signal on a VGA display device (resolution of 640 by 480 pixels). In this application, the horizontal resolution of the signal is scaled from 720 pixels to 640 pixels for full-screen display on the television. Generally, to provide for multi-format conversion, a set of vertical and horizontal scalers are provided in video processing ICs.
- A variety of standard definition television (SDTV) video formats are currently in use, including NTSC, PAL, and SECAM formats, as well as other conventional and non-conventional SDTV formats. Additionally, a number of high-definition television (HDTV) formats such as 720p, 1080i, and 1080p are also currently in use. In these HDTV formats, the letter “p” represents a progressively scanned signal and the letter “i” represents an interlaced signal. Conversion between these various video formats is usually performed by video processing ICs integrated into the display device, for example, a television or video display device. As discussed above, other formats, including the DVD format and PC formats including VGA, XGA, SXGA, and UXGA are currently in use.
- The architecture of some video processing ICs is adapted to process standard interlaced video (SDTV) at a pixel rate of 13.5 MHz. Generally, non-HDTV broadcast signals are included in the formats referred to as SDTV. The extension of these video processing ICs for use in processing HDTV signals is nontrivial. For instance, as the clock rate of the video processing IC and the memory size provided increase, it becomes increasingly difficult to utilize hardware adapted for processing SDTV video signals to process HDTV video signals, while maintaining the resolution of the HDTV video signals.
- Therefore, there is in need in the art for a method and apparatus for reducing processor and memory bandwidths in video processing ICs utilized to process multi-format video signals.
- According to the present invention, techniques related to integrated circuits (ICs), and more particularly to video processor ICs, are provided. More particularly, the present invention relates to an architecture for a video processor IC. Merely by way of example, the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- According to an embodiment of the present invention, a video signal processor is provided. The video signal processor includes an input port adapted to receive an input video signal. The input video signal is characterized by a first horizontal resolution and a first vertical resolution. In some embodiments, the input video signal is an HDTV video signal. The video signal processor also includes a pixel-based processor coupled to the input port and adapted to perform pixel-based processing of the input video signal and generate a processed video signal. The video signal processor further includes a prescaler coupled to the pixel-based processor and adapted to perform prescaling of the processed video signal. In embodiments of the present invention, the prescaling process converts the processed video signal at the first horizontal resolution and the first vertical resolution to a prescaled video signal characterized by a second horizontal resolution and a second vertical resolution. In some embodiments, the second horizontal resolution is less than the first horizontal resolution. In other embodiments, the second vertical resolution is less than the first vertical resolution.
- The video signal processor additionally includes a frame-based processor coupled to the prescaler and adapted to perform frame-based processing of the prescaled video signal and a frame buffer coupled to the frame-based processor. Moreover, the video signal processor includes a horizontal scaler coupled to the frame buffer and adapted to convert the horizontal scale of the prescaled video signal from the second horizontal resolution to a third horizontal resolution and a vertical scaler coupled to the horizontal scaler and adapted to convert the vertical scale of the prescaled video signal from the second vertical resolution to a third vertical resolution. In some embodiments, the third horizontal and third vertical resolution is less than the first horizontal and first vertical resolution associated with the input video signal.
- According to another embodiment of the present invention, a method of processing a video signal is provided. The method includes receiving a video signal characterized by a first horizontal resolution and a first vertical resolution and performing prescaling of the video signal to change the first horizontal resolution to a second horizontal resolution and the first vertical resolution to a second vertical resolution and produce a prescaled video signal. In some embodiments, the first horizontal resolution is greater than the second horizontal resolution and the first vertical resolution is greater than the second vertical resolution. The method also includes performing storage of the prescaled video signal in a frame buffer. The method further includes performing horizontal scaling of the prescaled video signal to convert the prescaled video signal from the second horizontal resolution to a third horizontal resolution and performing vertical scaling of the prescaled video signal to convert the prescaled video signal from the second vertical resolution to a third vertical resolution. Moreover, the method includes providing an output video signal characterized by the third horizontal resolution and the third vertical resolution.
- Numerous benefits are achieved using the present invention over conventional techniques. Some embodiments provide video processor ICs with reduced processor requirements. Additionally, embodiments of the present invention reduce the bandwidth of high definition signals for processing by deinterlacers adapted to process standard definition signals. Moreover, some embodiments of the present invention provide reductions in the manufacturing cost of video processor IC components as well as the cost of internal and external memories utilized in video processing operations. Furthermore, embodiments of the present invention provide methods and apparatus which reduce the power consumption for video processing ICs as well as video processing systems. Depending upon the embodiment, one or more of these benefits may exist. These and other benefits have been described throughout the present specification and more particularly below.
-
FIG. 1 is a simplified schematic diagram illustrating a video processor architecture according to an embodiment of the present invention; -
FIG. 2 is a simplified flowchart illustrating a process flow according to an embodiment of the present invention; -
FIG. 3 is a simplified schematic diagram illustrating a video processor architecture according to an alternative embodiment of the present invention; -
FIG. 4 is a simplified flowchart illustrating a process flow according to an alternative embodiment of the present invention; -
FIG. 5 is a simplified diagram illustrating a prescaling, processing, and scaling operation according to an embodiment of the present invention; and -
FIG. 6 is a simplified diagram illustrating another prescaling, processing, and scaling operation according to another embodiment of the present invention. - According to the present invention, techniques related to integrated circuits (ICs), and more particularly to video processor ICs, are provided. More particularly, the present invention relates to an architecture for a video processor IC. Merely by way of example, the invention has been applied to a dual-scaler architecture adapted to reduce the workload of a video processor IC receiving high definition video signals. But it would be recognized that the method and apparatus can be applied to both interlaced and progressive video signals and that the invention has a much broader range of applicability.
- As discussed above, the use of video processing ICs adapted to process SDTV video signals for processing of HDTV video signals presents a number of challenges. For instance, an exemplary deinterlacing algorithm included in a video processing IC utilized to process standard interlaced SDTV signals at a pixel rate of 13.5 MHz operates at a clock rate of 50 MHz for signal processing operations and uses a 32-bit memory system. To extend the capabilities of this video processing IC to an HDTV video signal such as a 1080i signal, a pixel rate of 74.25 MHz is used. Accordingly, the system clock operates at a clock rate of 275 MHz and a 64-bit memory system is generally utilized. In some embodiments, the memories are DDR memories, whereas in other embodiments, the memories are SDRAMs.
- Moreover, utilizing embodiments of the present invention, the size of frame buffers utilized during video processing operations is reduced. For example, in some video processors adapted to process HDTV signals, frame buffers with 16 MB capacities are utilized. According to embodiments of the present invention, frame buffers of 8 MB capacity or smaller are utilized to process prescaled HDTV signals. As will be evident to one of skill in the art, the increase in system clock rate generally necessitates a decrease in semiconductor process linewidth, for example from 0.18 μm geometries to 0.13 μm geometries. Moreover, the increased memory requirements result in additional cost increases.
- In some video applications, the resolution of the video display device is less than the resolution of the input signal. For example, for some video display devices, such as an XGA display device generally utilized with a PC, content is displayed in a 1024×768 pixel progressively scanned format. Other display devices, including VGA display devices, with resolutions of 640×480 pixels, SXGA display devices, with resolutions of 1280×1024 pixels, and UXGA display devices, with resolutions of 1600×1200 pixels, are included in embodiments of the present invention. If the incoming video signal provided to the XGA display device is an HDTV signal, the XGA display device is not capable of displaying the total resolution provided by the HDTV signal. Although the XGA display device provides a picture quality closer to HDTV than to regular television, the XGA display device will not display either the 1280 pixels present in the horizontal direction in a 720p signal (1280×720 pixels) or the 1920 pixels present in a 1080i format signal (1920×1080 pixels). Thus, for some XGA display devices (or other PC or TV displays), the capability of maintaining the resolution of an HDTV signal does not provide a benefit to the viewer. For these applications, and others, a video processing IC incorporating a prescaler provides a benefit of reducing system bandwidth and memory resources utilized while producing an output signal to the display device appropriate to the display device's resolution.
-
FIG. 1 is a simplified schematic diagram illustrating a video processor architecture according to an embodiment of the present invention. As illustrated inFIG. 1 ,video processor 100 includes a number of processor elements and provides a dual-scaler architecture comprising a set of prescalers and a set of scalers. As will be described more fully below, the dual-scaler architecture reduces the signal processing and memory requirements, enabling processing of high resolution signals with standard video processing components and algorithms. An input video signal is received at pixel-basedprocessor 110. Generally, pixel-based processing includes enhancements to video signals such as color adjustments, color conversion, format conversion, and the like. - After pixel-based processing of the input video signal, the signal is provided to a
horizontal prescaler 112. In an embodiment, the horizontal prescaler reduces the horizontal pixel count of the input video signal, providing an output in the form of a prescaled video signal. Merely by way of example, the horizontal resolution may be decreased from 1920 pixels to 1024 pixels, this conversion being associated with scaling from HD resolution to XGA resolution. Embodiments of the present invention are not limited to conversion from HD resolutions to XGA resolutions. Merely by way of example, embodiments of the present invention provide for horizontal prescaling of HDTV signals for eventual display at EDTV, SDTV, VGA, XGA, SXGA, and other resolutions. - In embodiments of the present invention, the horizontal prescaler is adaptive and software programmable. These features enable the designer to select a scaling level that is appropriate to existing processor components. In some embodiments, conventional scaling approaches and algorithms, including finite impulse response (FIR) filters and downsampling techniques are utilized for the prescalers.
- A
vertical prescaler 114 is provided as an element of the video processing IC according to embodiments of the present invention. After processing by the horizontal prescaler, the signal is provided to the vertical prescaler, which performs a scaling operation on the pixels arrayed vertically. In some embodiments, the vertical scale of the video signal is reduced, for example, from that associated with an HDTV signal to that associated with an EDTV signal, an SDTV signal, or others. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. - Embodiments of the present invention provide for prescaling of the input video signal, thereby reducing the pixel count prior to substantial processing of the video signal. Accordingly, embodiments of the present invention provide video processing IC designers with methods and apparatus that utilize processor components developed for SDTV applications to convert and process HDTV video, producing a video signal matched to the resolution of display display devices at resolutions lower than HDTV resolutions.
- Although
FIG. 1 illustrates both a horizontal and vertical prescalar, embodiments of the present invention are not limited to this particular architecture. In some alternative embodiments, either a horizontal prescaler or a vertical prescaler are provided as appropriate to the particular application. Additionally, a software bypass may be used to select the appropriate prescaling processing, including a resolution conversion factor equal to one. Merely by way of example, in a particular embodiment of the present invention, a horizontal prescaler is utilized to reduce the horizontal pixel count while maintaining the vertical pixel count. For example, in a conversion of a 720p signal to a VGA format, a horizontal prescaler may be utilized to reduce the horizontal pixel count from 1280 to 640, thereby reducing the total pixel count by a factor of two. According to embodiments of the present invention, high bandwidth signals, such as HDTV signals with sampling rates about five times greater than SDTV signals are prescaled prior to some video processing steps. The prescaling step allows for reduction in signal bandwidth to levels suitable for processing by video processing components originally developed for SDTV applications, which are generally characterized by signal bandwidths about five times less than those associated with HDTV signals. Cost savings and other benefits will be evident to one of skill in the art. - In other embodiments, the signal is passed from the pixel-based
processor 110 to the vertical prescaler, bypassing the horizontal prescaler as illustrated by processingpath 130. As an example, processingpath 130 could be appropriate for processing a UXGA signal. Moreover, processingpath 132 is illustrated inFIG. 1 , whereby the horizontal prescaling is performed on the input signal and the signal is passed to the frame-based processor, bypassing the vertical prescaler. As an example, a 1080i signal is prescaled to generate a 960×1080 pixel signal in an embodiment of the present invention, without vertical prescaling of the signal. Additionally, in some embodiments, another processing path (not illustrated) is provided, in which both prescalers are bypassed and the video signal is passed from the pixel-base processor to the frame-based processor. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. -
Frame buffer 116 is provided according to embodiments of the present invention as illustrated inFIG. 1 .Frame buffer 116 is a DDR or a SDRAM frame buffer according to particular embodiments of the present invention. Generally, the frame buffer stores multiple frames or fields in memory, enabling subsequent processing at a frame/field level. Additionally, frame-basedprocessor 118 is illustrated inFIG. 1 . Frame-based processing includes a number of actions, including interlacing, automatic brightness adjustment, noise measurement and adjustment, and the like. As will be evident to one of skill in the art, frame buffers and frame-based processors may also be utilized to perform frame rate conversion.Deinterlacer 120, a second set of scalers includingHorizontal Scaler 122 andVertical Scaler 124 along with aDisplay Enhancer 126 are illustrated inFIG. 1 . Generally, a display enhancer performs processes including edge enhancement, color enhancement, and the like. In some embodiments, the deinterlacer is combined with the frame-based processor, although this is not required by the present invention. Video output is provided at the output of the display enhancer, generally optimized for the particular display associated with the video processor IC. In some applications, thescalers deinterlacer 120 to the signal associated with a particular monitor or display device. Thus, embodiments of the present invention are capable of receiving multi-format signals as inputs and outputting a video signal adapted for display on a particular display device, the particular display device being characterized by a vertical and horizontal resolution, contrast ratio, and the like. - Although
FIG. 1 illustrates the set ofprescalers deinterlacer 120 is provided by embodiments of the present invention. As described throughout the specification, signal processing requirements, for example, in the deinterlacer, are reduced by embodiments of the present invention. Moreover, memory sizes provided and/utilized by the video processing IC are reduced, reducing system cost and complexity. - In a particular embodiment, video processing components, such as a deinterlacer, generally utilized to process SDTV signals are utilized to process prescaled HDTV signals without significant reductions in final image quality. As will be evident to one of skill in the art, the useful lifetime of well-developed processor designs currently in use for SDTV signal processing is extended by utilizing the methods and apparatus provided by embodiments of the present invention. As an example, video processing components designed and fabricated using 0.18 μm technology are utilized to process HDTV signals generally processed using more advanced processor designs, larger die sizes, or smaller linewidth technologies such as 0.13 μm technologies.
- As illustrated in
FIG. 1 ,deinterlacer 120 is utilized, but embodiments of the present invention are not limited to interlaced video processing. In other embodiments, progressively scanned video signals are processed according to embodiments of the present invention. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. -
FIG. 2 is a simplified flowchart illustrating aprocess flow 200 according to an embodiment of the present invention. As illustrated inFIG. 2 , an input video signal is received instep 210. In some embodiments of the present invention, the input video signal is 25 an HDTV signal, for example a 720p, a 1080i, or a 1080p signal. In alternative embodiments, the video signal is an EDTV video signal or an SDTV video signal. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. Pixel-based processing of the video signal is performed instep 212. Insteps step 210 is performed. - As described above, prescaling of high bandwidth video signals, such as HDTV signals, reduces the bandwidth of the video signal, thereby reducing performance requirements for processor components and memory. In
step 218, frame buffereing is performed and frame-based processing is performed is performed instep 220. In the embodiment, illustrated inFIG. 2 , deinterlacing is performed instep 222. Of course, this step becomes an optional step when progressively scan video signals are utilized. Embodiments of the present invention are not limited to interlaced video signals, but are also applicable to progressively scanned video signals. Moreover, in some embodiments, the frame-based processor and the deinterlacer are combined into a single component. In these embodiments,steps - In
step 224, horizontal scaling of the video signal is performed. Generally, this scaling step is accomplished in order to size the video signal for display on an appropriate display device. As an example, consider the processing of a 1080i video signal for display on an XGA display device. As received, the 1080i HDTV signal is characterized by 1,920 horizontal pixels and 1,080 vertical pixels. For this example, during horizontal prescaling instep 214, the horizontal resolution of the signal is decreased by a factor of two, producing a signal with 960 horizontal pixels. In some embodiments, the vertical prescaling step is not performed depending on the particular applications, resulting in a prescaled signal with 960×1080 pixels. After frame based processing/deinterlacing and frame buffering insteps - Accordingly, in
step 224, the number of pixels in the horizontal and vertical direction is scaled by an appropriate factor. As will evident to one of skill in the art, in this example, the prescaling of the video signal provides a reduction in the data bandwidth utilized during processing and memory operations without resulting in degradation of the video signal ultimately displayed. Instep 228, the display is enhanced as appropriate to display on the XGA display device and an XGA video output signal is provided instep 230. - In the foregoing example, the resolution of the prescaled video signal was less than the resolution of the input video signal in both the horizontal and vertical dimensions. However, this is not required by embodiments the present invention. In some embodiments, prescaling is performed in a single dimension, for example the horizontal or the vertical dimension. Moreover, in the foregoing example, the resolution of the output video signal was less than the prescaled video signal in both the horizontal and vertical dimensions. Likewise, this scaling relationship is not required by embodiments of the present invention. Depending on the particular applications, the scaling of the video signal will be selected based on the display characteristics of the display device. One of ordinary skill in the art would recognize many variations, modifications, and alternatives.
- It should be appreciated that the specific steps illustrated in
FIG. 2 provide a particular processing sequence according to one embodiment of the present invention. Other sequence of steps may also be performed according to alternative embodiments. For example, alternative embodiments of the present invention may perform the processing steps outlined above in a different order. For example, the order in which the signals are processed using pixel-based and frame-based processing algorithms may be varied, with these processing steps being performed after the horizontal and vertical prescaling steps. Moreover, the individual steps illustrated by this figure may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional video processing and/or memory operations may be added or removed depending on the particular applications. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. -
FIG. 3 is a simplified schematic diagram illustrating a video processor architecture according to an alternative embodiment of the present invention. As illustrated inFIG. 3 , a video input is received at an input of thevideo processor IC 300.Prescaler 310 is utilized to prescale the video signal, thereby changing the horizontal and/or vertical resolution. In some embodiments, the resolution of the video signal as received is reduced by the prescaler, thereby reducing the cost and performance of processing and memory components utilized during subsequent video processing operations. Pixel-basedprocessor 312,frame buffer 314 and frame-based processor/deinterlacer 316 are utilized to further process the prescaled video signal. As illustrated inFIG. 3 , the deinterlacer is combined with the frame-based processor, although this is not required by the present invention. In the embodiment illustrated inFIG. 3 , the deinterlacer is utilized to generate a progressively scanned signal from an interlaced signal. As will be evident to one of skill in the art, the reduction in pixel count provided by the prescaler may provide significant benefits at the deinterlacing step, as dienterlacing methods and systems developed for SDTV signals may be utilized to process HDTV signals. Embodiments of the present invention are not limited to the use of a deinterlacer, but may also be utilized in processing progressively scanned signals. -
Scaler 318 is utilized to scale the resolution of the video signal to the resolution of the display device. For example, for an XGA display device, a resolution of 1024×768 is generated by a scaler. Both the prescaler and scalers provided by embodiments of the present invention are software programmable and adaptive to provide the system designer with multi-format input and output displays.Optional display enhancer 320 is utilized in some embodiments to further process the scaled video signal in preparation for display on a particular display device. -
FIG. 4 is a simplified flowchart illustrating aprocess flow 400 according to an alternative embodiment of the present invention. A video signal is received at step 410 and prescaling of the signal is performed instep 412. As discussed above, the prescaling may be performed in the horizontal direction, the vertical direction, or both. Prescaling generally involves reducing the pixel content of the received video signal to produce a prescaled video signal with reduced pixel content. Insteps - In
step 418, the video signal is stored into memory utilizing a SDRAM frame buffer. As will be evident to one of skill in the art, other memory devices are utilized in alternative embodiments. Deinterlacing is performed instep 420. In embodiments utilizing progressively scanned input video signals, this step is removed, as the signal is already provided in a progressively scanned format. Instep 422, the video signal is scaled utilizing conventional methods to provide an output video signal matched to the display characteristics of the display device. Finally, instep 424, the scaled video signal is enhanced for display, providing an output video signal instep 426. - It should be appreciated that the specific steps illustrated in
FIG. 4 provide a particular processing sequence according to one embodiment of the present invention. Other sequence of steps may also be performed according to alternative embodiments. For example, alternative embodiments of the present invention may perform the processing steps outlined above in a different order. For example, the order in which the signals are processed using pixel-based and frame-based processing algorithms may be varied, with these processing steps being performed in reverse order. Moreover, the individual steps illustrated by this figure may include multiple sub-steps that may be performed in various sequences as appropriate to the individual step. Furthermore, additional video processing and/or memory operations may be added or removed depending on the particular applications. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. -
FIG. 5 is a simplified diagram illustrating a prescaling, processing, and scaling operation according to an embodiment of the present invention. In the embodiment of the present invention illustrated inFIG. 5 , a 1080iinput video signal 510 is received by the video processing IC. The resolution of this 1080i signal is 1,920 horizontal pixels by 1,080 vertical pixels. As will be described below, the video processing IC provided by embodiments of the present invention will provide an output signal for display on an XGA video display, such as an LCD display panel. The data rate for this input signal is 74.25 MHz, which is a higher data rate than that typically associated with SDTV video processing. As a result, many video processing ICs optimized for processing of SDTV formats run at data rates less than 74.25 MHz. - In
process 515, the 1080i video signal is horizontally prescaled by a factor of 0.5 to generate avideo signal 520 at a resolution of 960 horizontal pixels by 1,080 vertical pixels. In some embodiments of the present invention,video signal 520 is referred to as an intermediate interlaced picture. The data rate for the intermediate interlaced picture is 37.125 MHz, half of the data rate of theinput video signal 510. In a particular embodiment, horizontal prescaling reduces the pixel rate to a level at which deinterlacing, described more fully below, is performed using hardware typically utilized for processing for 480i video signals. - As illustrated in
FIG. 5 , the horizontal prescaling performed atprocess 515 modifies the aspect ratio of the intermediate interlaced picture. In the embodiment illustrated inFIG. 5 , vertical prescaling of the input signal is not performed. Referring toFIG. 1 ,path 132 provides a processing flow in which only horizontal prescaling is performed. In the embodiment illustrated inFIG. 5 , no vertical resolution is lost during image processing, as the limiting factor in this embodiment is the resolution of the XGA display panel. In other embodiments, both horizontal and vertical prescaling are performed to reduce the data rate to levels predetermined by the system designer. Of course, vertical prescaling alone is performed in alternative embodiments. -
Frame buffer 530 is utilized to store frames or fields associated with the intermediate interlaced picture. As will be evident to one of skill in the art, frame buffering provides data utilized during subsequent frame-based processing steps. Atprocess 535, the interlaced video signal is deinterlaced to generate a progressively scanned image. The progressively scanned image, also referred to as aprogressive picture 540 has a resolution of 960 horizontal pixels by 1,080 vertical pixels. - In
process 545, theprogressive picture 540 is vertically down scaled by a factor of 32/45 to generate a progressively scannedpicture 550 with a resolution of 960 horizontal pixels and 768 vertical pixels. Although a vertical scaling factor of 32/45 is utilized in the embodiment of the present invention illustrated inFIG. 5 , this is not required by the present invention. As will be evident to one of skill in the art, the vertical scaling factor, along with the horizontal scaling factor discussed below, combined with the initial prescaling factor (in either the horizontal, vertical, or both directions) is selected to provide an appropriate resolution for eventual display. As illustrated inFIG. 5 , vertical scaling of progressively scannedpicture 540 by a factor of 32/45 results in an image with 768 vertical pixels, matched to the XGA display illustrated inFIG. 5 . For applications utilizing alternative display formats, such as SXGA, prescaling and scaling factors are selected as appropriate to the particular application. One of ordinary skill in the art would recognize many variations, modifications, and alternatives. - In
process 555, theprogressive picture 550 is horizontally upscaled by a factor of 16/15 to generate a progressively scannedpicture 560 with a resolution of 1,024 horizontal pixels by 768 vertical pixels. The data rate of thevideo signal 560 is 65 MHz. Referring toFIG. 5 , computationally intensive processes, such as deinterlacing atstep 535, are performed on reduced data rate video signals. In the embodiment of the present invention illustrated inFIG. 5 , deinterlacing is performed on a signal at a data rate of 37.125 MHz, less than the input data rate of 74.25 MHz. Accordingly, frame-based processing components, such as the deinterlacer, generally utilized for processing of SDTV and PC signals are utilized in embodiments of the present invention, thereby reducing system cost and increasing the range of available component. -
FIG. 6 is a simplified diagram illustrating another prescaling, processing, and scaling operation according to another embodiment of the present invention. In the embodiment of the present invention illustrated inFIG. 6 , a high-resolution input video signal in the form of a 1080p HDTV signal is received and processed for eventual display on an SVGA panel. The resolution of this 1080p signal is 1,920 horizontal pixels by 1,080 vertical pixels. The data rate for this signal is 148.5 MHz, twice that of the 1080i input video signal illustrated inFIG. 5 . - In
process 615, the 1080p video signal is horizontally prescaled by a factor of 0.5 to generate avideo signal 620 at a resolution of 960 horizontal pixels by 1,080 vertical pixels. The data rate ofvideo signal 620 is 74.25 MHz, one half that of the 1080p video input signal. In some embodiments,video signal 620 is referred to as an intermediate progressive picture A. - In
process 625, the intermediateprogressive picture A 620 is vertically prescaled by a factor of 0.5 to generate intermediateprogressive picture B 630 with a resolution of 960×540 pixels and a data rate of 37.125 MHz. As will be evident to one of skill in the art, intermediateprogressive picture B 630 is appropriate for processing using, for example, SDTV components. The aspect ratio of theimage 630 is the same as the aspect ratio of the originalinput video signal 610.Frame buffer 640 is utilized to store frames or fields associated with the intermediate progressive picture B. As a result of the prescaling operations, frame buffer size requirements are reduced by factor of four compared to requirements for the 1080p signal. As thevideo signal 630 is already progressively scanned, no deinterlacer is utilized in the embodiment illustrated inFIG. 6 . - In
process 645, intermediate progressive picture B is horizontally downscaled by a factor of ⅚ to generate a progressively scannedpicture 650 at a resolution of 800×540. Finally, inprocess 655, theprogressive picture 650 is vertically upscaled by a factor of 10/9 to generate theoutput video signal 660. As will be evident to one of skill in the art, the combination of horizontal and vertical prescaling, as well as the horizontal and vertical scaling instep 645 and step 655, respectively, are selected based on the resolution of the video signal received and the resolution of the output video signal generated. In the embodiment illustrated inFIG. 6 , these prescaling and scaling factors are selected to convert the 1080p HDTV video signal into an SVGA output signal. In alternative embodiments, the prescaling and scaling factors are selected as appropriate to the input and output signals. - Referring to
FIGS. 5 and 6 , the order in which the horizontal and vertical scalers are utilized is modified, as both orders are included according to embodiments of the present invention. Generally, the scaling order is horizontal prescaling, vertical prescaling, vertical scaling, and horizontal scaling, as this order reduces the minimum line buffer requirement. As illustrated the figures, the scaling order is not limited to the above mentioned order, as embodiments of the present invention provide for a variety of scaling orders. Additionally, the horizontal and vertical scalers illustrated in these figures are general-purpose scalers, providing for both scaling up and scaling down as appropriate to the particular application. As illustrated in the figures, the prescalers are generally limited to downscaling operations, although downscaling is not required by the present invention. - It is also understood that the examples and embodiments described herein are for illustrative purposes only and that various modifications or changes in light thereof will be suggested to persons skilled in the art and are to be included within the spirit and purview of this application and scope of the appended claims.
Claims (22)
1. A video signal processor comprising:
an input port adapted to receive an input video signal, wherein the input video signal is characterized by a first horizontal resolution and a first vertical resolution;
a pixel-based processor coupled to the input port and adapted to perform pixel-based processing of the input video signal to generate a processed video signal;
a prescaler coupled to the pixel-based processor and adapted to perform prescaling of the processed video signal, wherein prescaling converts the processed video signal at the first horizontal resolution and the first vertical resolution to a prescaled video signal characterized by a second horizontal resolution and a second vertical resolution;
a frame-based processor coupled to the prescaler and adapted to perform frame-based processing of the prescaled video signal;
a frame buffer coupled to the frame-based processor;
a horizontal scaler coupled to the frame buffer and adapted to convert the horizontal scale of the prescaled video signal from the second horizontal resolution to a third horizontal resolution; and
a vertical scaler coupled to the horizontal scaler and adapted to convert the vertical scale of the prescaled video signal from the second vertical resolution to a third vertical resolution.
2. The video signal processor of claim 1 wherein the input video signal is an HDTV signal.
3. The video signal processor of claim 1 wherein the prescaler comprises at least one of a horizontal prescaler or a vertical prescaler.
4. The video signal processor of claim 1 wherein the prescaler comprises both a horizontal prescaler and a vertical prescaler.
5. The video signal processor of claim 1 further comprising a deinterlacer coupled to the frame buffer and a display enhancer coupled to the vertical scaler and adapted to provide an output video signal.
6. The video signal processor of claim 5 wherein the deinterlacer is coupled to the vertical scaler.
7. The video signal processor of claim 1 wherein the second horizontal resolution is less than or equal to the first horizontal resolution.
8. The video signal processor of claim 7 wherein the second vertical resolution is less than or equal to the first vertical resolution.
9. The video signal processor of claim 8 wherein the third horizontal resolution is at least less than the second horizontal resolution, greater than the second horizontal resolution, or equal to the second horizontal resolution.
10. The video signal processor of claim 9 wherein the third vertical resolution is at least less than the second vertical resolution, greater than the second vertical resolution, or equal to the second vertical resolution.
11. The videos signal processor of claim 1 wherein the frame buffer is an SDRAM frame buffer.
12. A method of processing a video signal, the method comprising:
receiving a video signal characterized by a first horizontal resolution and a first vertical resolution;
performing prescaling of the video signal to change the first horizontal resolution to a second horizontal resolution and the first vertical resolution to a second vertical resolution and produce a prescaled video signal;
performing storage of the prescaled video signal in a frame buffer;
performing scaling of the prescaled video signal to convert the prescaled video signal from the second horizontal resolution to a third horizontal resolution and from the second vertical resolution to a third vertical resolution;
providing an output video signal characterized by the third horizontal resolution and the third vertical resolution.
13. The method of claim 12 further comprising:
performing pixel-based and frame-based processing of the prescaled video signal.
14. The method of claim 12 further comprising enhancing the output video signal for display on a display device.
15. The video signal processor of claim 12 further comprising performing deinterlacing of the prescaled video signal.
16. The video signal processor of claim 15 wherein the step of deinterlacing is performed prior to the steps of performing horizontal scaling and vertical scaling of the prescaled video signal.
17. The video signal processor of claim 12 wherein the second horizontal resolution is less than the first horizontal resolution.
18. The video signal processor of claim 17 wherein the second vertical resolution is less than the first vertical resolution.
19. The video signal processor of claim 18 wherein the third horizontal resolution is less than the second horizontal resolution.
20. The video signal processor of claim 19 wherein the third vertical resolution is less than the second vertical resolution.
21. The video signal processor of claim 12 wherein the second horizontal resolution and the third horizontal resolution are equal.
22. The video signal processor of claim 12 wherein the second vertical resolution and the third vertical resolution are equal.
Priority Applications (1)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US11/179,222 US20060012714A1 (en) | 2004-07-16 | 2005-07-11 | Dual-scaler architecture for reducing video processing requirements |
Applications Claiming Priority (2)
Application Number | Priority Date | Filing Date | Title |
---|---|---|---|
US58864704P | 2004-07-16 | 2004-07-16 | |
US11/179,222 US20060012714A1 (en) | 2004-07-16 | 2005-07-11 | Dual-scaler architecture for reducing video processing requirements |
Publications (1)
Publication Number | Publication Date |
---|---|
US20060012714A1 true US20060012714A1 (en) | 2006-01-19 |
Family
ID=35785814
Family Applications (3)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/179,222 Abandoned US20060012714A1 (en) | 2004-07-16 | 2005-07-11 | Dual-scaler architecture for reducing video processing requirements |
US11/182,102 Expired - Fee Related US7253842B2 (en) | 2004-07-16 | 2005-07-14 | Locking display pixel clock to input frame rate |
US11/182,101 Abandoned US20060013243A1 (en) | 2004-07-16 | 2005-07-14 | Video processor with programmable input/output stages to enhance system design configurability and improve channel routing |
Family Applications After (2)
Application Number | Title | Priority Date | Filing Date |
---|---|---|---|
US11/182,102 Expired - Fee Related US7253842B2 (en) | 2004-07-16 | 2005-07-14 | Locking display pixel clock to input frame rate |
US11/182,101 Abandoned US20060013243A1 (en) | 2004-07-16 | 2005-07-14 | Video processor with programmable input/output stages to enhance system design configurability and improve channel routing |
Country Status (3)
Country | Link |
---|---|
US (3) | US20060012714A1 (en) |
CN (1) | CN1998139A (en) |
WO (3) | WO2006019867A2 (en) |
Cited By (15)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050262445A1 (en) * | 2004-05-24 | 2005-11-24 | Kabushiki Kaisha Toshiba | Information-processing apparatus and display control method |
US20050262444A1 (en) * | 2004-05-24 | 2005-11-24 | Kabushiki Kaisha Toshiba | Information-processing apparatus and display control method |
US20060017712A1 (en) * | 2004-07-21 | 2006-01-26 | Kabushiki Kaisha Toshiba | Information processing apparatus and display control method |
US20070258012A1 (en) * | 2006-05-04 | 2007-11-08 | Syntax Brillian Corp. | Method for scaling and cropping images for television display |
WO2008028276A1 (en) * | 2006-09-07 | 2008-03-13 | Miranda Technologies Inc. | Method and apparatus for displaying at least one video signal on at least one display |
US20090096876A1 (en) * | 2007-10-12 | 2009-04-16 | Tilman Herberger | System and method of automatically creating a multi/hybrid multimedia storage medium |
US7649735B2 (en) | 2005-07-13 | 2010-01-19 | Kabushiki Kaisha Toshiba | Information processing apparatus and video signal output control method |
USRE41104E1 (en) | 2004-09-30 | 2010-02-09 | Kabushiki Kaisha Toshiba | Information processing apparatus and display control method |
US20120013644A1 (en) * | 2007-03-13 | 2012-01-19 | Seiko Epson Corporation | Method of determining image transmission method, image supplying system, image supplying device, image display device, program and computer-readable recording medium |
US20120148209A1 (en) * | 2010-12-08 | 2012-06-14 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method, and program |
US8817111B2 (en) * | 2012-04-19 | 2014-08-26 | Scalable Display Technologies, Inc. | System and method of calibrating a display system free of variation in system input resolution |
US8847968B2 (en) | 2011-07-12 | 2014-09-30 | Qualcomm Incorporated | Displaying static images |
US9218762B2 (en) | 2010-09-01 | 2015-12-22 | Qualcomm Incorporated | Dimming techniques for emissive displays |
GB2541742A (en) * | 2015-08-28 | 2017-03-01 | Advanced Risc Mach Ltd | Method of and apparatus for scaling data arrays |
US11341606B2 (en) * | 2015-11-11 | 2022-05-24 | Texas Instruments Incorporated | Down scaling images in a computer vision system |
Families Citing this family (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
IL165852A (en) * | 2004-12-19 | 2010-12-30 | Rafael Advanced Defense Sys | System and method for image display enhancement |
US20080062312A1 (en) * | 2006-09-13 | 2008-03-13 | Jiliang Song | Methods and Devices of Using a 26 MHz Clock to Encode Videos |
US20080062311A1 (en) * | 2006-09-13 | 2008-03-13 | Jiliang Song | Methods and Devices to Use Two Different Clocks in a Television Digital Encoder |
KR101286541B1 (en) * | 2008-05-19 | 2013-07-23 | 엘지디스플레이 주식회사 | Liquid crystal display |
US7986190B1 (en) | 2009-10-30 | 2011-07-26 | Pmc-Sierra, Inc. | Jitter attenuation with a fractional-N clock synthesizer |
TWI520568B (en) * | 2010-05-25 | 2016-02-01 | 晨星半導體股份有限公司 | A control device and method for 3d display |
CN102376289B (en) * | 2010-08-06 | 2014-01-08 | 晨星软件研发(深圳)有限公司 | Display time sequence control circuit and method thereof |
US8462268B2 (en) * | 2010-12-10 | 2013-06-11 | Analog Devices, Inc. | Video processor timing generation |
US9392214B2 (en) | 2013-02-06 | 2016-07-12 | Gyrus Acmi, Inc. | High definition video recorder/player |
US20150189128A1 (en) * | 2013-12-27 | 2015-07-02 | Nathaniel D. Naegle | Synchronization of video based on clock adjustment |
TWI629661B (en) * | 2017-10-17 | 2018-07-11 | 冠捷投資有限公司 | Overclocking display method and display |
Citations (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6108047A (en) * | 1997-10-28 | 2000-08-22 | Stream Machine Company | Variable-size spatial and temporal video scaler |
US6141056A (en) * | 1997-08-08 | 2000-10-31 | Sharp Laboratories Of America, Inc. | System for conversion of interlaced video to progressive video using horizontal displacement |
US6339434B1 (en) * | 1997-11-24 | 2002-01-15 | Pixelworks | Image scaling circuit for fixed pixed resolution display |
US6407680B1 (en) * | 2000-12-22 | 2002-06-18 | Generic Media, Inc. | Distributed on-demand media transcoding system and method |
US6525742B2 (en) * | 1996-08-30 | 2003-02-25 | Hitachi, Ltd. | Video data processing device and video data display device having a CPU which selectively controls each of first and second scaling units |
US20030164897A1 (en) * | 2002-03-04 | 2003-09-04 | Chang-Lun Chen | Methods and apparatus for bridging different video formats |
US20030185306A1 (en) * | 2002-04-01 | 2003-10-02 | Macinnis Alexander G. | Video decoding system supporting multiple standards |
US6647061B1 (en) * | 2000-06-09 | 2003-11-11 | General Instrument Corporation | Video size conversion and transcoding from MPEG-2 to MPEG-4 |
US6661427B1 (en) * | 1998-11-09 | 2003-12-09 | Broadcom Corporation | Graphics display system with video scaler |
US6680752B1 (en) * | 2000-03-31 | 2004-01-20 | Ati International Srl | Method and apparatus for deinterlacing video |
US6690427B2 (en) * | 2001-01-29 | 2004-02-10 | Ati International Srl | Method and system for de-interlacing/re-interlacing video on a display device on a computer system during operation thereof |
US6710810B1 (en) * | 1998-07-02 | 2004-03-23 | Pioneer Electronic Corporation | Video signal processing apparatus with resolution enhancing feature |
US20040057624A1 (en) * | 2002-09-25 | 2004-03-25 | Aaron Wells | Integrated video decoding system with spatial/temporal video processing |
US20040114689A1 (en) * | 2002-12-13 | 2004-06-17 | Huipin Zhang | Wavelet based multiresolution video representation with spatially scalable motion vectors |
US6768774B1 (en) * | 1998-11-09 | 2004-07-27 | Broadcom Corporation | Video and graphics system with video scaling |
US20040202250A1 (en) * | 2003-04-14 | 2004-10-14 | Hao-Song Kong | Transcoding compressed videos to reducing resolution videos |
US6833875B1 (en) * | 1999-09-02 | 2004-12-21 | Techwell, Inc. | Multi-standard video decoder |
US20050111546A1 (en) * | 2003-11-24 | 2005-05-26 | Lg Electronics Inc. | Apparatus and method for converting resolution of compressed video |
US6909744B2 (en) * | 1999-12-09 | 2005-06-21 | Redrock Semiconductor, Inc. | Processor architecture for compression and decompression of video and images |
US20050162566A1 (en) * | 2004-01-02 | 2005-07-28 | Trumpion Microelectronic Inc. | Video system with de-motion-blur processing |
Family Cites Families (11)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
DE69324843T2 (en) * | 1992-02-19 | 1999-11-25 | Koninkl Philips Electronics Nv | Information transmission system and transmitter, receiver and recording medium used therein |
US5793656A (en) * | 1994-06-30 | 1998-08-11 | Hughes Electronics Corporation | Application-specific integrated circuits having programming functions |
US5719510A (en) * | 1996-03-27 | 1998-02-17 | Intel Corporation | Software configurable digital clock generator |
US6144374A (en) * | 1997-05-15 | 2000-11-07 | Orion Electric Co., Ltd. | Apparatus for driving a flat panel display |
US6208183B1 (en) * | 1999-04-30 | 2001-03-27 | Conexant Systems, Inc. | Gated delay-locked loop for clock generation applications |
TW484307B (en) * | 1999-06-25 | 2002-04-21 | Sanyo Electric Co | Apparatus for controlling a display device |
US6466189B1 (en) * | 2000-03-29 | 2002-10-15 | Koninklijke Philips Electronics N.V. | Digitally controlled current integrator for reflective liquid crystal displays |
US20030117382A1 (en) * | 2001-12-07 | 2003-06-26 | Pawlowski Stephen S. | Configurable panel controller and flexible display interface |
US6987424B1 (en) * | 2002-07-02 | 2006-01-17 | Silicon Laboratories Inc. | Narrow band clock multiplier unit |
DE60310373T2 (en) * | 2003-04-28 | 2007-09-27 | Accent S.P.A. | Clock generator with spectral dispersion |
US20060007200A1 (en) * | 2004-07-08 | 2006-01-12 | David Young | Method and system for displaying a sequence of image frames |
-
2005
- 2005-07-11 US US11/179,222 patent/US20060012714A1/en not_active Abandoned
- 2005-07-14 US US11/182,102 patent/US7253842B2/en not_active Expired - Fee Related
- 2005-07-14 US US11/182,101 patent/US20060013243A1/en not_active Abandoned
- 2005-07-15 CN CNA2005800238466A patent/CN1998139A/en active Pending
- 2005-07-15 WO PCT/US2005/024928 patent/WO2006019867A2/en active Application Filing
- 2005-07-15 WO PCT/US2005/025533 patent/WO2006010157A2/en active Application Filing
- 2005-07-15 WO PCT/US2005/024926 patent/WO2006019865A2/en active Application Filing
Patent Citations (20)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US6525742B2 (en) * | 1996-08-30 | 2003-02-25 | Hitachi, Ltd. | Video data processing device and video data display device having a CPU which selectively controls each of first and second scaling units |
US6141056A (en) * | 1997-08-08 | 2000-10-31 | Sharp Laboratories Of America, Inc. | System for conversion of interlaced video to progressive video using horizontal displacement |
US6108047A (en) * | 1997-10-28 | 2000-08-22 | Stream Machine Company | Variable-size spatial and temporal video scaler |
US6339434B1 (en) * | 1997-11-24 | 2002-01-15 | Pixelworks | Image scaling circuit for fixed pixed resolution display |
US6710810B1 (en) * | 1998-07-02 | 2004-03-23 | Pioneer Electronic Corporation | Video signal processing apparatus with resolution enhancing feature |
US6768774B1 (en) * | 1998-11-09 | 2004-07-27 | Broadcom Corporation | Video and graphics system with video scaling |
US6661427B1 (en) * | 1998-11-09 | 2003-12-09 | Broadcom Corporation | Graphics display system with video scaler |
US6833875B1 (en) * | 1999-09-02 | 2004-12-21 | Techwell, Inc. | Multi-standard video decoder |
US6909744B2 (en) * | 1999-12-09 | 2005-06-21 | Redrock Semiconductor, Inc. | Processor architecture for compression and decompression of video and images |
US6680752B1 (en) * | 2000-03-31 | 2004-01-20 | Ati International Srl | Method and apparatus for deinterlacing video |
US6647061B1 (en) * | 2000-06-09 | 2003-11-11 | General Instrument Corporation | Video size conversion and transcoding from MPEG-2 to MPEG-4 |
US6407680B1 (en) * | 2000-12-22 | 2002-06-18 | Generic Media, Inc. | Distributed on-demand media transcoding system and method |
US6690427B2 (en) * | 2001-01-29 | 2004-02-10 | Ati International Srl | Method and system for de-interlacing/re-interlacing video on a display device on a computer system during operation thereof |
US20030164897A1 (en) * | 2002-03-04 | 2003-09-04 | Chang-Lun Chen | Methods and apparatus for bridging different video formats |
US20030185306A1 (en) * | 2002-04-01 | 2003-10-02 | Macinnis Alexander G. | Video decoding system supporting multiple standards |
US20040057624A1 (en) * | 2002-09-25 | 2004-03-25 | Aaron Wells | Integrated video decoding system with spatial/temporal video processing |
US20040114689A1 (en) * | 2002-12-13 | 2004-06-17 | Huipin Zhang | Wavelet based multiresolution video representation with spatially scalable motion vectors |
US20040202250A1 (en) * | 2003-04-14 | 2004-10-14 | Hao-Song Kong | Transcoding compressed videos to reducing resolution videos |
US20050111546A1 (en) * | 2003-11-24 | 2005-05-26 | Lg Electronics Inc. | Apparatus and method for converting resolution of compressed video |
US20050162566A1 (en) * | 2004-01-02 | 2005-07-28 | Trumpion Microelectronic Inc. | Video system with de-motion-blur processing |
Cited By (26)
Publication number | Priority date | Publication date | Assignee | Title |
---|---|---|---|---|
US20050262445A1 (en) * | 2004-05-24 | 2005-11-24 | Kabushiki Kaisha Toshiba | Information-processing apparatus and display control method |
US20050262444A1 (en) * | 2004-05-24 | 2005-11-24 | Kabushiki Kaisha Toshiba | Information-processing apparatus and display control method |
US20060017712A1 (en) * | 2004-07-21 | 2006-01-26 | Kabushiki Kaisha Toshiba | Information processing apparatus and display control method |
US7619619B2 (en) | 2004-07-21 | 2009-11-17 | Kabushiki Kaisha Toshiba | Information processing apparatus and display control method |
USRE41104E1 (en) | 2004-09-30 | 2010-02-09 | Kabushiki Kaisha Toshiba | Information processing apparatus and display control method |
US7649735B2 (en) | 2005-07-13 | 2010-01-19 | Kabushiki Kaisha Toshiba | Information processing apparatus and video signal output control method |
US20100091445A1 (en) * | 2005-07-13 | 2010-04-15 | Kabushiki Kaisha Toshiba | Modeled after: information processing apparatus and video signal output control method |
US8081443B2 (en) | 2005-07-13 | 2011-12-20 | Kabushiki Kaisha Toshiba | Modeled after: information processing apparatus and video signal output control method |
US20070258012A1 (en) * | 2006-05-04 | 2007-11-08 | Syntax Brillian Corp. | Method for scaling and cropping images for television display |
US20080062304A1 (en) * | 2006-09-07 | 2008-03-13 | Claude Villeneuve | Method and apparatus for displaying at least one video signal on at least one display |
WO2008028276A1 (en) * | 2006-09-07 | 2008-03-13 | Miranda Technologies Inc. | Method and apparatus for displaying at least one video signal on at least one display |
US8533366B2 (en) * | 2007-03-13 | 2013-09-10 | Seiko Epson Corporation | Method of determining image transmission method, image supplying system, image supplying device, image display device, program and computer-readable recording medium |
US20120013644A1 (en) * | 2007-03-13 | 2012-01-19 | Seiko Epson Corporation | Method of determining image transmission method, image supplying system, image supplying device, image display device, program and computer-readable recording medium |
US20090096876A1 (en) * | 2007-10-12 | 2009-04-16 | Tilman Herberger | System and method of automatically creating a multi/hybrid multimedia storage medium |
US9218762B2 (en) | 2010-09-01 | 2015-12-22 | Qualcomm Incorporated | Dimming techniques for emissive displays |
US20120148209A1 (en) * | 2010-12-08 | 2012-06-14 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method, and program |
US8744233B2 (en) * | 2010-12-08 | 2014-06-03 | Canon Kabushiki Kaisha | Image signal processing apparatus, image signal processing method, and program |
US8847968B2 (en) | 2011-07-12 | 2014-09-30 | Qualcomm Incorporated | Displaying static images |
KR101523888B1 (en) * | 2011-07-12 | 2015-05-28 | 퀄컴 인코포레이티드 | Displaying static images |
US8817111B2 (en) * | 2012-04-19 | 2014-08-26 | Scalable Display Technologies, Inc. | System and method of calibrating a display system free of variation in system input resolution |
US20140362234A1 (en) * | 2012-04-19 | 2014-12-11 | Scalable Display Technologies, Inc. | System and method of calibrating a display system free of variation in system input resolution |
US9215455B2 (en) * | 2012-04-19 | 2015-12-15 | Scalable Display Technologies, Inc. | System and method of calibrating a display system free of variation in system input resolution |
GB2541742A (en) * | 2015-08-28 | 2017-03-01 | Advanced Risc Mach Ltd | Method of and apparatus for scaling data arrays |
GB2541742B (en) * | 2015-08-28 | 2019-03-20 | Advanced Risc Mach Ltd | Method of and apparatus for scaling data arrays |
US10255659B2 (en) | 2015-08-28 | 2019-04-09 | Arm Limited | Method of and apparatus for scaling data arrays |
US11341606B2 (en) * | 2015-11-11 | 2022-05-24 | Texas Instruments Incorporated | Down scaling images in a computer vision system |
Also Published As
Publication number | Publication date |
---|---|
WO2006019867A3 (en) | 2006-06-08 |
WO2006019865A2 (en) | 2006-02-23 |
US7253842B2 (en) | 2007-08-07 |
CN1998139A (en) | 2007-07-11 |
WO2006010157A3 (en) | 2007-02-15 |
WO2006019865A3 (en) | 2007-12-06 |
WO2006010157A2 (en) | 2006-01-26 |
WO2006019867A2 (en) | 2006-02-23 |
US20060012712A1 (en) | 2006-01-19 |
US20060013243A1 (en) | 2006-01-19 |
Similar Documents
Publication | Publication Date | Title |
---|---|---|
US20060012714A1 (en) | Dual-scaler architecture for reducing video processing requirements | |
US7420618B2 (en) | Single chip multi-function display controller and method of use thereof | |
JP5582429B2 (en) | Decoder and method | |
TWI397899B (en) | Display controller for displaying multiple windows and method for the same | |
US7880809B2 (en) | Method and system for motion adaptive deinterlacer with integrated directional filter | |
US7477319B2 (en) | Systems and methods for deinterlacing video signals | |
JP2009534931A (en) | Shared memory multi-video channel display apparatus and method | |
KR101335270B1 (en) | Shared memory multi video channel display apparatus and methods | |
JP5217037B2 (en) | Shared memory multi-video channel display apparatus and method | |
JP2002541742A (en) | Efficient image scaling for scan rate conversion | |
US20070024747A1 (en) | Video processing apparatus and method | |
EP1607934A2 (en) | Blur reduction in liquid crystal displays by frame rate control | |
Jaspers et al. | Chip-set for video display of multimedia information | |
US7412096B2 (en) | Method and system for interpolator direction selection during edge detection | |
US7570270B2 (en) | Buffer for driving display with asynchronous display engine | |
US5894329A (en) | Display control unit for converting a non-interlaced image into an interlaced image and displaying the converted image data | |
US8306350B2 (en) | Aspect ratio distortion minimization | |
US8253856B1 (en) | Method and/or architecture for interlaced video resampling and color format conversion using combined vertical-temporal resolution extensions | |
EP1848203A1 (en) | Method and system for video image aspect ratio conversion | |
US7519232B2 (en) | Method and system for detecting diagonal strength of an edge in an image | |
CN1901616A (en) | Double pantagraphic structure for processing video data | |
US7982752B2 (en) | Multi-format image display apparatus and method | |
US20100020236A1 (en) | Image display apparatus and method | |
Winzker et al. | P‐10: Integrated Display Architecture for Ultra‐Portable Multimediaprojectors | |
Lu et al. | An FIR-Based Video Format Conversion IC Design |
Legal Events
Date | Code | Title | Description |
---|---|---|---|
AS | Assignment |
Owner name: GREENFOREST CONSULTING, INC., CALIFORNIA Free format text: ASSIGNMENT OF ASSIGNORS INTEREST;ASSIGNORS:LOUIE, JAMES Y.;SHYU, MENQ YU;REEL/FRAME:018368/0841;SIGNING DATES FROM 20050711 TO 20050718 |
|
STCB | Information on status: application discontinuation |
Free format text: ABANDONED -- FAILURE TO RESPOND TO AN OFFICE ACTION |