WO2007073781A1 - Digital image acquisition system with portrait mode - Google Patents

Digital image acquisition system with portrait mode Download PDF

Info

Publication number
WO2007073781A1
WO2007073781A1 PCT/EP2006/007573 EP2006007573W WO2007073781A1 WO 2007073781 A1 WO2007073781 A1 WO 2007073781A1 EP 2006007573 W EP2006007573 W EP 2006007573W WO 2007073781 A1 WO2007073781 A1 WO 2007073781A1
Authority
WO
WIPO (PCT)
Prior art keywords
image
images
background
flash
portrait mode
Prior art date
Application number
PCT/EP2006/007573
Other languages
French (fr)
Inventor
Eran Steinberg
Peter Corcoran
Leendert Blonk
Original Assignee
Fotonation Vision Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Fotonation Vision Limited filed Critical Fotonation Vision Limited
Priority to DE602006006414T priority Critical patent/DE602006006414D1/en
Priority to AT06776529T priority patent/ATE429781T1/en
Priority to EP06776529A priority patent/EP1839435B1/en
Publication of WO2007073781A1 publication Critical patent/WO2007073781A1/en
Priority to US12/724,391 priority patent/US8212897B2/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04N—PICTORIAL COMMUNICATION, e.g. TELEVISION
    • H04N5/00—Details of television systems
    • H04N5/222—Studio circuitry; Studio devices; Studio equipment
    • H04N5/262—Studio circuits, e.g. for mixing, switching-over, change of character of image, other special effects ; Cameras specially adapted for the electronic generation of special effects
    • H04N5/272—Means for inserting a foreground image in a background image, i.e. inlay, outlay

Definitions

  • This invention related to a digital image acquisition system having a portrait mode for generating an image of a foreground object against a blurred background, and a corresponding method.
  • portrait images In digital cameras the depth of field (DOF) is typically much greater than for conventional cameras due to the image sensor being somewhat smaller than a 35mm film negative.
  • This problem can be corrected by careful photography combined with careful use of camera settings.
  • portrait images are often blurred manually by professional photographers using image processing algorithms.
  • a blurring algorithm may apply various techniques using convolution kernels to create the blurring effects. These effects are normally added on a desktop computer after an image has been captured. This may involve manual intervention and be time-consuming.
  • US 2003/0052991 discloses adjusting image brightness based on the depth of different image features.
  • a digital camera simulates the use of fill flash. The camera takes a series of photographs of a scene at various focus distances. The photographs are stored, along with their corresponding focus distances. The photographs are analysed to determine the distance to objects at various locations of the scene. Regions of a final photograph are selectively adjusted in brightness based on the distance information to simulate the effect that would have resulted had fill flash been used.
  • a digital image acquisition system having no photographic film
  • the system comprising an apparatus for capturing digital images and a flash unit for providing illumination during image capture, the system having a portrait mode for generating an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, the portrait mode further being operable to determine foreground and background regions of the scene using the first and second images, and to substitute the blurred background of the third image for the background of a substantially in-focus image of the scene.
  • the invention further provides a method of generating a digital image of a foreground object against a blurred background, the method comprising capturing first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, determining foreground and background regions of the scene using the first and second images, and substituting the blurred background of the third image for the background of a substantially in-focus image of the scene.
  • the substantially in-focus image is one of the first and second images.
  • the substantially in-focus image is a fourth image.
  • FIG. 1 is a block diagram of a camera apparatus operating in accordance with embodiments of the present invention.
  • FIG. 2 shows the workflow of the portrait mode processing according to a first embodiment.
  • FIG. 3 shows the workflow of the portrait mode processing according to a second embodiment.
  • FIG. 1 shows a block diagram of an image acquisition device 20 operating in accordance with embodiments of the present invention.
  • the processor 120 in response to a user input at 122, such as half pressing a shutter button (pre- capture mode 32), initiates and controls the digital photographic process.
  • Ambient light exposure is monitored using light sensor 40 in order to automatically determine if a flash is to be used.
  • a distance to the subject is determined using a focus component 50 which also focuses the image on image capture component 60.
  • processor 120 causes the flash 70 to generate a photographic flash in substantial coincidence with the recording of the image by image capture component 60 upon full depression of the shutter button.
  • the image capture component 60 digitally records the image in colour.
  • Tne image capture component preferably includes a CCD (charge coupled device) or CMOS to facilitate digital recording.
  • the flash may be selectively generated either in response to the light sensor 40 or a manual input 72 from the user of the camera.
  • the high resolution image recorded by image capture component 60 is stored in an image store 80 which may comprise computer memory such a dynamic random access memory or a non-volatile memory.
  • the camera is equipped with a display 100, such as an LCD, for preview and post-view of images.
  • the display 100 can assist the user in composing the image, as well as being used to determine focusing and exposure.
  • Temporary storage 82 is used to store one or more of the preview images and can be part of the image store 80 or a separate component.
  • the preview image is preferably generated by the image capture component 60.
  • preview images preferably have a lower pixel resolution than the main image taken when the shutter button is fully depressed, and are generated by subsampling a raw captured image using software 124 which can be part of the general processor 120 or dedicated hardware or combination thereof.
  • the pre-acquisition image processing may satisfy some predetermined test criteria prior to storing a preview image.
  • test criteria may be chronological, such as to constantly replace the previous saved preview image with a new captured preview image every 0.5 seconds during the pre- capture mode 32, until the final high resolution image is captured by full depression of the shutter button. More sophisticated criteria may involve analysis of the preview image content, for example, testing the image for changes, before deciding whether the new preview image should replace a previously saved image. Other criteria may be based on image analysis such as the sharpness, or metadata analysis such as the exposure condition, whether a flash is going to happen, and/or the distance to the subject.
  • test criteria are not met, the camera continues by capturing the next preview image without saving the current one. The process continues until the final high resolution image is acquired and saved by fully depressing the shutter button .
  • a new preview image will be placed on a chronological First In First Out (FIFO) stack, until the user takes the final picture.
  • FIFO First In First Out
  • the reason for storing multiple preview images is that the last preview image, or any single preview image, may not be the best reference image for comparison with the final high resolution image in, for example, a red-eye correction process or, in the present embodiments, portrait mode processing.
  • a better reference image can be achieved, and a closer alignment between the preview and the final captured image can be achieved in an alignment stage discussed later.
  • the camera is also able to capture and store in the temporary storage 82 one or more low resolution post-view images when the camera is in portrait mode, as will be to be described.
  • Post-view images are preferably the same as preview images, except that they occur after the main high resolution image is captured.
  • the camera 20 preferably has a user-selectable portrait mode 30.
  • camera software many include face detection functionality arranged to detect one or more faces in one or more of a series of preview images being captured and if so to switch to portrait mode.
  • portrait mode when the shutter button is depressed the camera is caused to automatically capture and store a series of images at close intervals so that the images are nominally of the same scene.
  • the particular number, resolution and sequence of images, whether flash is used or not, and whether the images are in or out of focus, depends upon the particular embodiment, as will be described.
  • a portrait mode processor 90 analyzes and processes the stored images according to a workflow to be described.
  • the processor 90 can be integral to the camera 20 - indeed, it could be the processor 120 with suitable programming - or part of an external processing device 10 such as a desktop computer. In this embodiment the processor 90 receives a main high resolution image from the image store 80 as well as one or more pre- or post-view images from the temporary storage 82.
  • the final processed image may be displayed on image display 100, saved on a persistent storage 112 which can be internal or a removable storage such as CF card, SD card or the like, or downloaded to another device, such as a personal computer, server or printer via image output means 110 which can be tethered or wireless.
  • a persistent storage 112 which can be internal or a removable storage such as CF card, SD card or the like
  • image output means 110 which can be tethered or wireless.
  • the processor 90 is implemented in an external device 10, such as a desktop computer
  • the final processed image may be returned to the camera 20 for storage and display as described above, or stored and displayed externally of the camera.
  • FIG. 2 illustrates the workflow of a first embodiment of portrait mode processing according to the invention.
  • the first image includes a high pixel resolution, in-focus, flash image of the subject of interest (image A), step 202. This is the main image whose background is to be substituted by a blurred background.
  • the second image includes a low pixel resolution, in-focus, non-flash post-view image (image B), step 204.
  • the third image includes a low pixel resolution, de-focussed (i.e. deliberately blurred) post-view image (image C), step 206.
  • image A could be taken non-flash and image B taken with flash. In general, one of them is taken with flash and one without. Normally, in portraiture, the main image A would be the flash image but this will depend on other lighting.
  • Image C can be flash or non-flash, but is preferably flash to provide a good contrast between foreground and background. It is to be understood that when we refer to an image being in- focus or blurred we are speaking in relative terms, since no image is perfectly in focus and especially not all over. Thus, by saying that images A and B are in focus we mean that these images, and especially in the case of image A and its background, are substantially more in focus than image C.
  • Images A and B are aligned in step 208, to compensate for any slight movement in the subject or camera between taking these images. Alignment may be performed globally across the entire images or locally using various techniques such as described in our co-pending PCT Application No. PCT/EP2006/005109 filed May 29, 2005 and will not be further described herein.
  • step 210 the images A and B are matched in pixel resolution by up-sampling image B and/or down-sampling image A.
  • step 212 the flash and non-flash images A and B are used to construct a foreground/background (f/b) map, step 212, which identifies foreground and background regions of the scene captured in the images A, B and C.
  • Processes 208, 210 and 212 are preferably as described in PCT application No. PCT/EP2006/005109.
  • the pixel resolution of blurred low resolution image C is matched to that of the original image A (i.e., as it was before any processing in steps 208 to 212) by up-sampling image C.
  • the blurred background from image C is used to replace the background in image A.
  • blocks of memory from the blurred background image C may be written to the corresponding blocks of image A, rather than replacing on a pixel by pixel basis.
  • image processing filters are applied to smooth the transition between the composited foreground and background regions of the composite image resulting from step 216.
  • one or both of the images B and C could be pre-view images rather than post-view images.
  • image B and/or image C could be the same resolution as the image A. This can serve to avoid the need to match image resolution at step 210 and/or 214.
  • FIG. 3 illustrates the workflow of a second embodiment of portrait mode processing according to the invention. Steps which are the same as those in FIG. 2 are given the same reference numerals. Only the differences in the two workflows will be described.
  • Images A and C are taken as before, but instead of taking a single image B, two images Bl and B2 are taken, both being low resolution post- view images but one being taken with flash and one without.
  • the two images Bl and B2 are used to construct the f/b map, steps 208A and 212A according to the principles of our co- pending PCT Application No. PCT/EP2006/005109, leaving a free choice as to whether the image A is taken with flash or not and avoiding the need to match image resolution at step 210 of FIG. 2.
  • any one or more of images Bl, B2 and C could be a pre-view image, and image C could be the same resolution as the image A to avoid the need to match image resolution at step 214.

Abstract

A digital image acquisition system having no photographic film comprises an apparatus for capturing digital images and a flash unit for providing illumination during image capture. The system has a portrait mode for generating an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images (A, B and C) of nominally the same scene. One of the first and second images (A, B) is taken with flash and the other is taken without flash, and the third image (C) is blurred compared to the first and second images. The portrait mode is further operable to determine foreground and background regions of the scene using the first and second images (A, B) , and to substitute the blurred background of the third image (C) for the background of an in-focus image of the scene. In one embodiment the in-focus image is one of the first and second images. In another embodiment the in-focus image is a fourth image .

Description

Digital Image Acquisition System With Portrait Mode
This invention related to a digital image acquisition system having a portrait mode for generating an image of a foreground object against a blurred background, and a corresponding method.
BACKGROUND
In digital cameras the depth of field (DOF) is typically much greater than for conventional cameras due to the image sensor being somewhat smaller than a 35mm film negative. This means that portrait images, in particular, will tend to have the background in sharp focus, which may not desirable as the photographer may wish to emphasize the person's face and de- emphasize the background of the picture. This problem can be corrected by careful photography combined with careful use of camera settings. Alternatively, portrait images are often blurred manually by professional photographers using image processing algorithms. A blurring algorithm may apply various techniques using convolution kernels to create the blurring effects. These effects are normally added on a desktop computer after an image has been captured. This may involve manual intervention and be time-consuming.
US 2003/0052991 discloses adjusting image brightness based on the depth of different image features. A digital camera simulates the use of fill flash. The camera takes a series of photographs of a scene at various focus distances. The photographs are stored, along with their corresponding focus distances. The photographs are analysed to determine the distance to objects at various locations of the scene. Regions of a final photograph are selectively adjusted in brightness based on the distance information to simulate the effect that would have resulted had fill flash been used.
DESCRIPTION OF THE INVENTION
According to the present invention there is provided a digital image acquisition system having no photographic film, the system comprising an apparatus for capturing digital images and a flash unit for providing illumination during image capture, the system having a portrait mode for generating an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, the portrait mode further being operable to determine foreground and background regions of the scene using the first and second images, and to substitute the blurred background of the third image for the background of a substantially in-focus image of the scene.
The invention further provides a method of generating a digital image of a foreground object against a blurred background, the method comprising capturing first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, determining foreground and background regions of the scene using the first and second images, and substituting the blurred background of the third image for the background of a substantially in-focus image of the scene. In one embodiment the substantially in-focus image is one of the first and second images.
In a second embodiment the substantially in-focus image is a fourth image.
BRIEF DESCRIPTION OF DRAWINGS
Embodiments of the invention will now be described, by way of example, with reference to the accompanying drawings, m which:
FIG. 1 is a block diagram of a camera apparatus operating in accordance with embodiments of the present invention.
FIG. 2 shows the workflow of the portrait mode processing according to a first embodiment.
FIG. 3 shows the workflow of the portrait mode processing according to a second embodiment.
DESCRIPTION OF PREFERRED EMBODIMENTS
FIG. 1 shows a block diagram of an image acquisition device 20 operating in accordance with embodiments of the present invention. The digital acquisition device 20, which in the present embodiment is a portable digital camera, includes a processor 120. It can be appreciated that many of the processes implemented in the digital camera may be implemented in or controlled by software operating in a microprocessor, central processing unit, controller, digital signal processor and/or an application specific integrated circuit, collectively depicted as block 120 labelled "processor". Generically, all user interface and control of peripheral components such as buttons and display is controlled by a microcontroller 122. The processor 120, in response to a user input at 122, such as half pressing a shutter button (pre- capture mode 32), initiates and controls the digital photographic process. Ambient light exposure is monitored using light sensor 40 in order to automatically determine if a flash is to be used. A distance to the subject is determined using a focus component 50 which also focuses the image on image capture component 60. If a flash is to be used, processor 120 causes the flash 70 to generate a photographic flash in substantial coincidence with the recording of the image by image capture component 60 upon full depression of the shutter button. The image capture component 60 digitally records the image in colour. Tne image capture component preferably includes a CCD (charge coupled device) or CMOS to facilitate digital recording. The flash may be selectively generated either in response to the light sensor 40 or a manual input 72 from the user of the camera. The high resolution image recorded by image capture component 60 is stored in an image store 80 which may comprise computer memory such a dynamic random access memory or a non-volatile memory. The camera is equipped with a display 100, such as an LCD, for preview and post-view of images.
In the case of preview images which are generated in the pre- capture mode 32 with the shutter button half-pressed, the display 100 can assist the user in composing the image, as well as being used to determine focusing and exposure.
Temporary storage 82 is used to store one or more of the preview images and can be part of the image store 80 or a separate component. The preview image is preferably generated by the image capture component 60. For speed and memory efficiency reasons, preview images preferably have a lower pixel resolution than the main image taken when the shutter button is fully depressed, and are generated by subsampling a raw captured image using software 124 which can be part of the general processor 120 or dedicated hardware or combination thereof. Depending on the settings of this hardware subsystem, the pre-acquisition image processing may satisfy some predetermined test criteria prior to storing a preview image. Such test criteria may be chronological, such as to constantly replace the previous saved preview image with a new captured preview image every 0.5 seconds during the pre- capture mode 32, until the final high resolution image is captured by full depression of the shutter button. More sophisticated criteria may involve analysis of the preview image content, for example, testing the image for changes, before deciding whether the new preview image should replace a previously saved image. Other criteria may be based on image analysis such as the sharpness, or metadata analysis such as the exposure condition, whether a flash is going to happen, and/or the distance to the subject.
If test criteria are not met, the camera continues by capturing the next preview image without saving the current one. The process continues until the final high resolution image is acquired and saved by fully depressing the shutter button .
Where multiple preview images can be saved, a new preview image will be placed on a chronological First In First Out (FIFO) stack, until the user takes the final picture. The reason for storing multiple preview images is that the last preview image, or any single preview image, may not be the best reference image for comparison with the final high resolution image in, for example, a red-eye correction process or, in the present embodiments, portrait mode processing. By storing multiple images, a better reference image can be achieved, and a closer alignment between the preview and the final captured image can be achieved in an alignment stage discussed later.
The camera is also able to capture and store in the temporary storage 82 one or more low resolution post-view images when the camera is in portrait mode, as will be to be described. Post-view images are preferably the same as preview images, except that they occur after the main high resolution image is captured.
The camera 20 preferably has a user-selectable portrait mode 30. (Alternatively, camera software many include face detection functionality arranged to detect one or more faces in one or more of a series of preview images being captured and if so to switch to portrait mode.) In portrait mode, when the shutter button is depressed the camera is caused to automatically capture and store a series of images at close intervals so that the images are nominally of the same scene. The particular number, resolution and sequence of images, whether flash is used or not, and whether the images are in or out of focus, depends upon the particular embodiment, as will be described. A portrait mode processor 90 analyzes and processes the stored images according to a workflow to be described. The processor 90 can be integral to the camera 20 - indeed, it could be the processor 120 with suitable programming - or part of an external processing device 10 such as a desktop computer. In this embodiment the processor 90 receives a main high resolution image from the image store 80 as well as one or more pre- or post-view images from the temporary storage 82.
Where the portrait mode processor 90 is integral to the camera 20, the final processed image may be displayed on image display 100, saved on a persistent storage 112 which can be internal or a removable storage such as CF card, SD card or the like, or downloaded to another device, such as a personal computer, server or printer via image output means 110 which can be tethered or wireless. In embodiments where the processor 90 is implemented in an external device 10, such as a desktop computer, the final processed image may be returned to the camera 20 for storage and display as described above, or stored and displayed externally of the camera.
FIG. 2 illustrates the workflow of a first embodiment of portrait mode processing according to the invention.
First, portrait mode is selected, step 200. Now, when the shutter button is fully depressed, the camera automatically captures and stores three digital images. The first image includes a high pixel resolution, in-focus, flash image of the subject of interest (image A), step 202. This is the main image whose background is to be substituted by a blurred background. The second image includes a low pixel resolution, in-focus, non-flash post-view image (image B), step 204. The third image includes a low pixel resolution, de-focussed (i.e. deliberately blurred) post-view image (image C), step 206.
These three images are taken in rapid succession so that the scene captured by each image is nominally the same. If desired image A could be taken non-flash and image B taken with flash. In general, one of them is taken with flash and one without. Normally, in portraiture, the main image A would be the flash image but this will depend on other lighting. Image C can be flash or non-flash, but is preferably flash to provide a good contrast between foreground and background. It is to be understood that when we refer to an image being in- focus or blurred we are speaking in relative terms, since no image is perfectly in focus and especially not all over. Thus, by saying that images A and B are in focus we mean that these images, and especially in the case of image A and its background, are substantially more in focus than image C.
At 200 to 206 of Fig. 2 the just-described preferably take place in the camera 20. The remaining steps now to be described can take place in the camera or in an external device 10.
Images A and B are aligned in step 208, to compensate for any slight movement in the subject or camera between taking these images. Alignment may be performed globally across the entire images or locally using various techniques such as described in our co-pending PCT Application No. PCT/EP2006/005109 filed May 29, 2005 and will not be further described herein. Then, step 210, the images A and B are matched in pixel resolution by up-sampling image B and/or down-sampling image A. Next, step 212, the flash and non-flash images A and B are used to construct a foreground/background (f/b) map, step 212, which identifies foreground and background regions of the scene captured in the images A, B and C. Processes 208, 210 and 212 are preferably as described in PCT application No. PCT/EP2006/005109.
At 214 the pixel resolution of blurred low resolution image C is matched to that of the original image A (i.e., as it was before any processing in steps 208 to 212) by up-sampling image C. Next, using the f/b map constructed at step 212, the blurred background from image C is used to replace the background in image A. To speed up this process, blocks of memory from the blurred background image C may be written to the corresponding blocks of image A, rather than replacing on a pixel by pixel basis. Finally, step 218, image processing filters are applied to smooth the transition between the composited foreground and background regions of the composite image resulting from step 216.
Variations of the foregoing embodiment are possible. For example, one or both of the images B and C could be pre-view images rather than post-view images. Also, image B and/or image C could be the same resolution as the image A. This can serve to avoid the need to match image resolution at step 210 and/or 214.
FIG. 3 illustrates the workflow of a second embodiment of portrait mode processing according to the invention. Steps which are the same as those in FIG. 2 are given the same reference numerals. Only the differences in the two workflows will be described.
In the embodiment of FIG. 3, upon fully depressing the shutter button the camera takes four images of the same nominal scene in rapid succession. Images A and C (steps 202 and 206) are taken as before, but instead of taking a single image B, two images Bl and B2 are taken, both being low resolution post- view images but one being taken with flash and one without. The two images Bl and B2 are used to construct the f/b map, steps 208A and 212A according to the principles of our co- pending PCT Application No. PCT/EP2006/005109, leaving a free choice as to whether the image A is taken with flash or not and avoiding the need to match image resolution at step 210 of FIG. 2.
As before, any one or more of images Bl, B2 and C could be a pre-view image, and image C could be the same resolution as the image A to avoid the need to match image resolution at step 214.
The invention is not limited to the embodiments described herein which may be amended or modified without departing from the scope of the present invention as set forth in the appended claims, and structural and functional equivalents thereof .
In methods that may be performed according to preferred embodiments herein and that may have been described above and/or claimed below, the operations have been described in selected typographical sequences. However, the sequences have been selected and so ordered for typographical convenience and are not intended to imply any particular order for performing the operations.

Claims

Claims
1. A digital image acquisition system having no photographic film, the system comprising an apparatus for capturing digital images and a flash unit for providing illumination during image capture, the system having a portrait mode for generating an image of a foreground object against a blurred background, the portrait mode being operable to capture first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, the portrait mode further being operable to determine foreground and background regions of the scene using the first and second images, and to substitute the blurred background of the third image for the background of a substantially in-focus image of the scene.
2. A system according to claim 1, wherein the substantially in-focus image is one of the first and second images.
3. A system according to claim 1, wherein the substantially in-focus image is a fourth image captured in the portrait mode .
4. A system according to claim 2, wherein the first and second images have different pixel resolutions with the substantially in-focus image having the higher resolution, the system is further configured to determine the foreground and background regions for matching the pixel resolutions of the first and second images by at least one of up-sampling the image of lower resolution and sub-sampling the image of higher resolution .
5. A system as claimed in claim 1 further being configured to determine the foreground and background regions for aligning two or more of the first, second and third images.
6. A system according to claim 4, wherein the image of lower resolution is a pre- or post-view image.
7. A system according to claim 3, wherein the first and second images have a lower pixel resolution than the fourth image .
8. A system according to claim 7, wherein the first and second images are pre- and/or post-view images.
9. A system as claimed in claim 1, wherein the third image has a lower pixel resolution than the substantially in-focus image.
10. A system according to claim 9, wherein the third image is a pre- or post-view image.
11. A system according to claim 1, wherein said digital image acquisition system is a digital camera.
12. A system according to claim 1, wherein said digital image acquisition system is a combination of a digital camera and an external processing device.
13. A system according to claim 1 wherein during determination of said foreground and background regions, exposure of the foreground region of the first or second second image taken without flash is adjusted to be nominally the same as exposure of foreground region of the other of the first or second image taken with flash.
14. A system as claimed in claim 12, wherein portrait mode processing to determine foreground and background regions of the scene using the first and second images and to substitute the blurred background of the third image for the background of a substantially in-focus image of the scene is performed in the external processing device.
15. A system as claimed in claim 1, in which said portrait mode is manually selectable by said user.
16. A system as claimed in claim 1 operable to analyse one or more of said first, second and third images to determine the presence of a face, and responsive to detecting a face for selecting said portrait mode.
17. A method of generating a digital image of a foreground object against a blurred background, the method comprising capturing first, second and third images of nominally the same scene, not necessarily in the order stated, one of the first and second images being taken with flash and the other being taken without flash, and the third image being blurred compared to the first and second images, determining foreground and background regions of the scene using the first and second images, and substituting the blurred background of the third image for the background of a substantially in-focus image of the scene.
18. A method according to claim 17, wherein the substantially in-focus image is one of the first and second images.
19. A method according to claim 17, wherein the substantially in-focus image is a fourth image.
PCT/EP2006/007573 2005-12-27 2006-07-31 Digital image acquisition system with portrait mode WO2007073781A1 (en)

Priority Applications (4)

Application Number Priority Date Filing Date Title
DE602006006414T DE602006006414D1 (en) 2005-12-27 2006-07-31 SYSTEM FOR RECORDING DIGITAL IMAGES WITH PORTRAIT MODE
AT06776529T ATE429781T1 (en) 2005-12-27 2006-07-31 SYSTEM FOR CAPTURING DIGITAL IMAGES WITH PORTRAIT MODE
EP06776529A EP1839435B1 (en) 2005-12-27 2006-07-31 Digital image acquisition system with portrait mode
US12/724,391 US8212897B2 (en) 2005-12-27 2010-03-15 Digital image acquisition system with portrait mode

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US11/319,766 2005-12-27
US11/319,766 US7692696B2 (en) 2005-12-27 2005-12-27 Digital image acquisition system with portrait mode

Publications (1)

Publication Number Publication Date
WO2007073781A1 true WO2007073781A1 (en) 2007-07-05

Family

ID=37198707

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2006/007573 WO2007073781A1 (en) 2005-12-27 2006-07-31 Digital image acquisition system with portrait mode

Country Status (6)

Country Link
US (2) US7692696B2 (en)
EP (1) EP1839435B1 (en)
AT (1) ATE429781T1 (en)
DE (1) DE602006006414D1 (en)
IE (1) IES20060563A2 (en)
WO (1) WO2007073781A1 (en)

Cited By (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1987436A2 (en) * 2006-02-14 2008-11-05 Fotonation Vision Limited Image blurring
EP2104335A1 (en) 2008-03-12 2009-09-23 Mindy AB An apparatus and a method for digital photographing
US7680342B2 (en) 2004-08-16 2010-03-16 Fotonation Vision Limited Indoor/outdoor classification in digital images
US7692696B2 (en) 2005-12-27 2010-04-06 Fotonation Vision Limited Digital image acquisition system with portrait mode
US7868922B2 (en) 2006-02-14 2011-01-11 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images
US7912285B2 (en) 2004-08-16 2011-03-22 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images with differential exposure calculations
US8363908B2 (en) 2006-05-03 2013-01-29 DigitalOptics Corporation Europe Limited Foreground / background separation in digital images
US8633999B2 (en) 2009-05-29 2014-01-21 DigitalOptics Corporation Europe Limited Methods and apparatuses for foreground, top-of-the-head separation from background
US8971628B2 (en) 2010-07-26 2015-03-03 Fotonation Limited Face detection using division-generated haar-like features for illumination invariance
US9019402B2 (en) 2011-02-18 2015-04-28 Fotonation Limited Dynamic range extension by combining differently exposed hand-held device-acquired images

Families Citing this family (87)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8199222B2 (en) 2007-03-05 2012-06-12 DigitalOptics Corporation Europe Limited Low-light video frame enhancement
US8417055B2 (en) * 2007-03-05 2013-04-09 DigitalOptics Corporation Europe Limited Image processing method and apparatus
US7792970B2 (en) * 2005-06-17 2010-09-07 Fotonation Vision Limited Method for establishing a paired connection between media devices
US9160897B2 (en) * 2007-06-14 2015-10-13 Fotonation Limited Fast motion estimation method
US7636486B2 (en) * 2004-11-10 2009-12-22 Fotonation Ireland Ltd. Method of determining PSF using multiple instances of a nominally similar scene
US7685341B2 (en) * 2005-05-06 2010-03-23 Fotonation Vision Limited Remote control apparatus for consumer electronic appliances
US8180173B2 (en) * 2007-09-21 2012-05-15 DigitalOptics Corporation Europe Limited Flash artifact eye defect correction in blurred images using anisotropic blurring
US8593542B2 (en) 2005-12-27 2013-11-26 DigitalOptics Corporation Europe Limited Foreground/background separation using reference images
US7639889B2 (en) * 2004-11-10 2009-12-29 Fotonation Ireland Ltd. Method of notifying users regarding motion artifacts based on image analysis
US8264576B2 (en) * 2007-03-05 2012-09-11 DigitalOptics Corporation Europe Limited RGBW sensor array
US8698924B2 (en) 2007-03-05 2014-04-15 DigitalOptics Corporation Europe Limited Tone mapping for low-light video frame enhancement
US8989516B2 (en) 2007-09-18 2015-03-24 Fotonation Limited Image processing method and apparatus
US7639888B2 (en) * 2004-11-10 2009-12-29 Fotonation Ireland Ltd. Method and apparatus for initiating subsequent exposures based on determination of motion blurring artifacts
US8503800B2 (en) 2007-03-05 2013-08-06 DigitalOptics Corporation Europe Limited Illumination detection using classifier chains
US8995715B2 (en) 2010-10-26 2015-03-31 Fotonation Limited Face or other object detection including template matching
US7715597B2 (en) 2004-12-29 2010-05-11 Fotonation Ireland Limited Method and component for image recognition
US7694048B2 (en) * 2005-05-06 2010-04-06 Fotonation Vision Limited Remote control apparatus for printer appliances
KR100657522B1 (en) * 2006-03-31 2006-12-15 삼성전자주식회사 Apparatus and method for out-focusing photographing of portable terminal
IES20070229A2 (en) * 2006-06-05 2007-10-03 Fotonation Vision Ltd Image acquisition method and apparatus
WO2008015978A1 (en) * 2006-08-02 2008-02-07 Panasonic Corporation Video image display device and video image display method
KR100883653B1 (en) * 2006-10-02 2009-02-18 삼성전자주식회사 Terminal having display button and method of displaying using the display button
CN101584205B (en) * 2007-01-15 2011-07-13 松下电器产业株式会社 Imaging device
US8649604B2 (en) 2007-03-05 2014-02-11 DigitalOptics Corporation Europe Limited Face searching and detection in a digital image acquisition device
US7773118B2 (en) * 2007-03-25 2010-08-10 Fotonation Vision Limited Handheld article with movement discrimination
US8031222B2 (en) * 2007-04-25 2011-10-04 Microsoft Corporation Multiple resolution capture in real time communications
US7916971B2 (en) 2007-05-24 2011-03-29 Tessera Technologies Ireland Limited Image processing method and apparatus
US20080309770A1 (en) * 2007-06-18 2008-12-18 Fotonation Vision Limited Method and apparatus for simulating a camera panning effect
JP5028574B2 (en) * 2007-08-10 2012-09-19 株式会社メガチップス Digital camera system
JP2009089174A (en) * 2007-10-01 2009-04-23 Fujifilm Corp Digital camera and photographing method thereof
KR101041366B1 (en) * 2007-11-02 2011-06-14 주식회사 코아로직 Apparatus for digital image stabilizing using object tracking and Method thereof
KR101023946B1 (en) * 2007-11-02 2011-03-28 주식회사 코아로직 Apparatus for digital image stabilizing using object tracking and Method thereof
JP5054583B2 (en) * 2008-03-17 2012-10-24 株式会社リコー Imaging device
KR101488795B1 (en) * 2008-03-25 2015-02-04 엘지전자 주식회사 Mobile terminal and control method thereof
KR101427660B1 (en) * 2008-05-19 2014-08-07 삼성전자주식회사 Apparatus and method for blurring an image background in digital image processing device
US8130278B2 (en) * 2008-08-01 2012-03-06 Omnivision Technologies, Inc. Method for forming an improved image using images with different resolutions
WO2010036251A1 (en) * 2008-09-24 2010-04-01 Nikon Corporation Method and device for image deblurring using joint bilateral filtering
WO2010063463A2 (en) * 2008-12-05 2010-06-10 Fotonation Ireland Limited Face recognition using face tracker classifier data
KR101532611B1 (en) * 2009-04-28 2015-07-01 삼성전자주식회사 Apparatus and method for processing digital image expressing zooming shot effect
KR20100118458A (en) * 2009-04-28 2010-11-05 엘지전자 주식회사 Method for processing image and mobile terminal having camera thereof
US8698747B1 (en) 2009-10-12 2014-04-15 Mattel, Inc. Hand-activated controller
KR101608970B1 (en) * 2009-11-27 2016-04-05 삼성전자주식회사 Apparatus and method for processing image using light field data
EP2545411B1 (en) 2009-12-11 2014-02-12 DigitalOptics Corporation Europe Limited Panorama imaging
US20110141229A1 (en) * 2009-12-11 2011-06-16 Fotonation Ireland Limited Panorama imaging using super-resolution
US10080006B2 (en) * 2009-12-11 2018-09-18 Fotonation Limited Stereoscopic (3D) panorama creation on handheld device
US8294748B2 (en) * 2009-12-11 2012-10-23 DigitalOptics Corporation Europe Limited Panorama imaging using a blending map
US20110141224A1 (en) * 2009-12-11 2011-06-16 Fotonation Ireland Limited Panorama Imaging Using Lo-Res Images
US20110141226A1 (en) * 2009-12-11 2011-06-16 Fotonation Ireland Limited Panorama imaging based on a lo-res map
US20110141225A1 (en) * 2009-12-11 2011-06-16 Fotonation Ireland Limited Panorama Imaging Based on Low-Res Images
US8692867B2 (en) * 2010-03-05 2014-04-08 DigitalOptics Corporation Europe Limited Object detection and rendering for wide field of view (WFOV) image acquisition systems
US8723912B2 (en) 2010-07-06 2014-05-13 DigitalOptics Corporation Europe Limited Scene background blurring including face modeling
US20120019688A1 (en) * 2010-07-20 2012-01-26 Research In Motion Limited Method for decreasing depth of field of a camera having fixed aperture
KR101661216B1 (en) * 2010-09-02 2016-09-29 삼성전자주식회사 Digital image processing apparatus, method for digital image signal processing, medium for recording the method
US8970770B2 (en) 2010-09-28 2015-03-03 Fotonation Limited Continuous autofocus based on face detection and tracking
US8659697B2 (en) 2010-11-11 2014-02-25 DigitalOptics Corporation Europe Limited Rapid auto-focus using classifier chains, MEMS and/or multiple object focusing
US8648959B2 (en) 2010-11-11 2014-02-11 DigitalOptics Corporation Europe Limited Rapid auto-focus using classifier chains, MEMS and/or multiple object focusing
US8308379B2 (en) 2010-12-01 2012-11-13 Digitaloptics Corporation Three-pole tilt control system for camera module
US8508652B2 (en) 2011-02-03 2013-08-13 DigitalOptics Corporation Europe Limited Autofocus method
US8587665B2 (en) 2011-02-15 2013-11-19 DigitalOptics Corporation Europe Limited Fast rotation estimation of objects in sequences of acquired digital images
US8587666B2 (en) 2011-02-15 2013-11-19 DigitalOptics Corporation Europe Limited Object detection from image profiles within sequences of acquired digital images
US8705894B2 (en) 2011-02-15 2014-04-22 Digital Optics Corporation Europe Limited Image rotation from local motion estimates
US8982180B2 (en) 2011-03-31 2015-03-17 Fotonation Limited Face and other object detection and tracking in off-center peripheral regions for nonlinear lens geometries
US8896703B2 (en) 2011-03-31 2014-11-25 Fotonation Limited Superresolution enhancment of peripheral regions in nonlinear lens geometries
US8947501B2 (en) 2011-03-31 2015-02-03 Fotonation Limited Scene enhancements in off-center peripheral regions for nonlinear lens geometries
US8723959B2 (en) 2011-03-31 2014-05-13 DigitalOptics Corporation Europe Limited Face and other object tracking in off-center peripheral regions for nonlinear lens geometries
EP2515526A3 (en) 2011-04-08 2014-12-24 FotoNation Limited Display device with image capture and analysis module
JP2012253531A (en) * 2011-06-02 2012-12-20 Sony Corp Imaging apparatus, imaging method, and image processing device
US8493459B2 (en) 2011-09-15 2013-07-23 DigitalOptics Corporation Europe Limited Registration of distorted images
US8493460B2 (en) 2011-09-15 2013-07-23 DigitalOptics Corporation Europe Limited Registration of differently scaled images
TW201320734A (en) * 2011-11-03 2013-05-16 Altek Corp Image processing method for producing background blurred image and image capturing device thereof
CN103095978A (en) * 2011-11-03 2013-05-08 华晶科技股份有限公司 Handling method for generating image with blurred background and image capturing device
US9007489B2 (en) * 2012-02-28 2015-04-14 Semiconductor Components Industries, Llc Method and apparatus for image background removal and replacement
WO2013136053A1 (en) 2012-03-10 2013-09-19 Digitaloptics Corporation Miniature camera module with mems-actuated autofocus
US9294667B2 (en) 2012-03-10 2016-03-22 Digitaloptics Corporation MEMS auto focus miniature camera module with fixed and movable lens groups
US9354486B2 (en) 2012-06-07 2016-05-31 DigitalOptics Corporation MEMS MEMS fast focus camera module
US9007520B2 (en) 2012-08-10 2015-04-14 Nanchang O-Film Optoelectronics Technology Ltd Camera module with EMI shield
US9001268B2 (en) 2012-08-10 2015-04-07 Nan Chang O-Film Optoelectronics Technology Ltd Auto-focus camera module with flexible printed circuit extension
US9242602B2 (en) 2012-08-27 2016-01-26 Fotonation Limited Rearview imaging systems for vehicle
US9124762B2 (en) 2012-12-20 2015-09-01 Microsoft Technology Licensing, Llc Privacy camera
US9081264B2 (en) 2012-12-31 2015-07-14 Digitaloptics Corporation Auto-focus camera module with MEMS capacitance estimator
TWI602153B (en) * 2013-07-09 2017-10-11 聚晶半導體股份有限公司 Image denoising method and image denoising apparatus
US9549129B2 (en) 2013-10-04 2017-01-17 Nokia Technologies Oy Method and apparatus for obtaining image
JP6285160B2 (en) * 2013-11-27 2018-02-28 京セラ株式会社 Device having camera function, photographing control method and program
US10110792B2 (en) * 2015-04-24 2018-10-23 Lifetouch Inc. Background replacement system and methods involving multiple captured images
US9674455B1 (en) 2016-03-15 2017-06-06 Donald Frederick Wright, Jr. Programmable manual mode for digital cameras
US10389948B2 (en) * 2016-12-06 2019-08-20 Qualcomm Incorporated Depth-based zoom function using multiple cameras
JP2021527263A (en) * 2018-06-12 2021-10-11 アイディー メトリクス グループ インコーポレイテッド Digital image generation method by active lighting system
CN113572980B (en) * 2020-04-28 2022-10-11 华为技术有限公司 Photographing method and device, terminal equipment and storage medium

Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994026057A1 (en) * 1993-04-29 1994-11-10 Scientific Generics Limited Background separation for still and moving images
US20010012063A1 (en) * 2000-02-08 2001-08-09 Masamine Maeda Image pickup apparatus

Family Cites Families (136)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4683496A (en) 1985-08-23 1987-07-28 The Analytic Sciences Corporation System for and method of enhancing images using multiband information
US5130935A (en) 1986-03-31 1992-07-14 Canon Kabushiki Kaisha Color image processing apparatus for extracting image data having predetermined color information from among inputted image data and for correcting inputted image data in response to the extracted image data
US5109425A (en) 1988-09-30 1992-04-28 The United States Of America As Represented By The United States National Aeronautics And Space Administration Method and apparatus for predicting the direction of movement in machine vision
JPH02281879A (en) 1989-04-24 1990-11-19 Hitachi Ltd Digital image editing device
US5086314A (en) * 1990-05-21 1992-02-04 Nikon Corporation Exposure control apparatus for camera
US5063448A (en) 1989-07-31 1991-11-05 Imageware Research And Development Inc. Apparatus and method for transforming a digitized signal of an image
EP0440786A1 (en) 1989-08-28 1991-08-14 Eastman Kodak Company A computer based digital image noise reduction method based on overlapping planar approximation
GB8928058D0 (en) 1989-12-12 1990-02-14 Crosfield Electronics Ltd Digital image generation
US5046118A (en) 1990-02-06 1991-09-03 Eastman Kodak Company Tone-scale generation method and apparatus for digital x-ray images
FR2673793B1 (en) 1991-03-05 1993-05-07 Thomson Video Equip METHOD AND DEVICE FOR OBTAINING DEPTH INFORMATION IN THE FIELD SEEN BY A TAKING DEVICE.
US5164993A (en) 1991-11-25 1992-11-17 Eastman Kodak Company Method and apparatus for automatic tonescale generation in digital radiographic images
US5345313A (en) 1992-02-25 1994-09-06 Imageware Software, Inc Image editing system for taking a background and inserting part of an image therein
US5329379A (en) 1992-10-22 1994-07-12 International Business Machines Corporation System and method of measuring fidelity of decompressed video signals and images
GB9321372D0 (en) 1993-10-15 1993-12-08 Avt Communications Ltd Video signal processing
US5504846A (en) 1993-12-16 1996-04-02 International Business Machines Corporation Method and apparatus for improved area demarcation in bit mapped image derived from multi-color bit mapped image
US5621868A (en) 1994-04-15 1997-04-15 Sony Corporation Generating imitation custom artwork by simulating brush strokes and enhancing edges
US5757376A (en) 1994-12-02 1998-05-26 Sony Corporation Method of producing image data and associated recording medium
JPH08223569A (en) 1995-02-10 1996-08-30 Matsushita Electric Ind Co Ltd Digital image transmission method and decoding synthesizer
EP0727760A3 (en) 1995-02-17 1997-01-29 Ibm Produce size recognition system
US5724456A (en) 1995-03-31 1998-03-03 Polaroid Corporation Brightness adjustment of images using digital scene analysis
US5812787A (en) 1995-06-30 1998-09-22 Intel Corporation Video coding scheme with foreground/background separation
US6008820A (en) 1995-08-04 1999-12-28 Microsoft Corporation Processor for controlling the display of rendered image layers and method for controlling same
US5880737A (en) 1995-08-04 1999-03-09 Microsoft Corporation Method and system for accessing texture data in environments with high latency in a graphics rendering system
US5990904A (en) 1995-08-04 1999-11-23 Microsoft Corporation Method and system for merging pixel fragments in a graphics rendering system
US5999189A (en) 1995-08-04 1999-12-07 Microsoft Corporation Image compression to reduce pixel and texture memory requirements in a real-time image generator
US5864342A (en) 1995-08-04 1999-01-26 Microsoft Corporation Method and system for rendering graphical objects to image chunks
US5844627A (en) 1995-09-11 1998-12-01 Minerya System, Inc. Structure and method for reducing spatial noise
US6122408A (en) 1996-04-30 2000-09-19 Siemens Corporate Research, Inc. Light normalization method for machine vision
US6956573B1 (en) 1996-11-15 2005-10-18 Sarnoff Corporation Method and apparatus for efficiently representing storing and accessing video information
US6184926B1 (en) 1996-11-26 2001-02-06 Ncr Corporation System and method for detecting a human face in uncontrolled environments
AUPO525897A0 (en) 1997-02-24 1997-03-20 Redflex Traffic Systems Pty Ltd Digital image processing
US5949914A (en) 1997-03-17 1999-09-07 Space Imaging Lp Enhancing the resolution of multi-spectral image data with panchromatic image data using super resolution pan-sharpening
US5878152A (en) 1997-05-21 1999-03-02 Cognex Corporation Depth from focal gradient analysis using object texture removal by albedo normalization
US6018590A (en) 1997-10-07 2000-01-25 Eastman Kodak Company Technique for finding the histogram region of interest based on landmark detection for improved tonescale reproduction of digital radiographic images
US7738015B2 (en) 1997-10-09 2010-06-15 Fotonation Vision Limited Red-eye filter method and apparatus
US7042505B1 (en) 1997-10-09 2006-05-09 Fotonation Ireland Ltd. Red-eye filter method and apparatus
US6407777B1 (en) 1997-10-09 2002-06-18 Deluca Michael Joseph Red-eye filter method and apparatus
US7352394B1 (en) * 1997-10-09 2008-04-01 Fotonation Vision Limited Image modification based on red-eye filter analysis
US7630006B2 (en) 1997-10-09 2009-12-08 Fotonation Ireland Limited Detecting red eye filter and apparatus using meta-data
US6061476A (en) 1997-11-24 2000-05-09 Cognex Corporation Method and apparatus using image subtraction and dynamic thresholding
US6744471B1 (en) 1997-12-05 2004-06-01 Olympus Optical Co., Ltd Electronic camera that synthesizes two images taken under different exposures
EP2252071A3 (en) 1997-12-05 2017-04-12 Dynamic Digital Depth Research Pty. Ltd. Improved image conversion and encoding techniques
US6069982A (en) 1997-12-23 2000-05-30 Polaroid Corporation Estimation of frequency dependence and grey-level dependence of noise in an image
US6483521B1 (en) 1998-02-02 2002-11-19 Matsushita Electric Industrial Co., Ltd. Image composition method, image composition apparatus, and data recording media
US6850236B2 (en) 1998-02-17 2005-02-01 Sun Microsystems, Inc. Dynamically adjusting a sample-to-pixel filter in response to user input and/or sensor input
JP2000102040A (en) 1998-09-28 2000-04-07 Olympus Optical Co Ltd Electronic stereo camera
US6278434B1 (en) 1998-10-07 2001-08-21 Microsoft Corporation Non-square scaling of image data to be mapped to pixel sub-components
JP2000209425A (en) 1998-11-09 2000-07-28 Canon Inc Device and method for processing image and storage medium
JP2000175052A (en) 1998-12-07 2000-06-23 Xerox Corp Processing method and system for pixel map expression
US6546117B1 (en) 1999-06-10 2003-04-08 University Of Washington Video object segmentation using active contour modelling with global relaxation
JP3849834B2 (en) * 1999-02-02 2006-11-22 富士写真フイルム株式会社 Auto white balance control method
US6920250B1 (en) 1999-03-04 2005-07-19 Xerox Corporation Additive model for efficient representation of digital documents
US6198505B1 (en) * 1999-07-19 2001-03-06 Lockheed Martin Corp. High resolution, high speed digital camera
US6556704B1 (en) * 1999-08-25 2003-04-29 Eastman Kodak Company Method for forming a depth image from digital image data
US6526161B1 (en) 1999-08-30 2003-02-25 Koninklijke Philips Electronics N.V. System and method for biometrics-based facial feature extraction
US6631206B1 (en) 1999-08-30 2003-10-07 University Of Washington Image filtering in HSI color space
US6704456B1 (en) 1999-09-02 2004-03-09 Xerox Corporation Automatic image segmentation in the presence of severe background bleeding
KR100311482B1 (en) 1999-10-21 2001-10-18 구자홍 Method of filtering control of image bilinear interpolation
US6577762B1 (en) 1999-10-26 2003-06-10 Xerox Corporation Background surface thresholding
US7103357B2 (en) 1999-11-05 2006-09-05 Lightsurf Technologies, Inc. Media spooler system and methodology providing efficient transmission of media content from wireless devices
US6538656B1 (en) 1999-11-09 2003-03-25 Broadcom Corporation Video and graphics system with a data transport processor
US6836273B1 (en) 1999-11-11 2004-12-28 Matsushita Electric Industrial Co., Ltd. Memory management method, image coding method, image decoding method, image display method, memory management apparatus, and memory management program storage medium
JP3306397B2 (en) 1999-11-25 2002-07-24 株式会社ソニー・コンピュータエンタテインメント Entertainment device, image generation method, and storage medium
DE19958553A1 (en) 1999-12-04 2001-06-07 Luratech Ges Fuer Luft Und Rau Image compression scheme for scanned images divides picture into three levels allows separate maximum compression of text and pictures
US6804408B1 (en) 1999-12-22 2004-10-12 Eastman Kodak Company Method for enhancing a digital image with noise-dependent control of texture
US7583292B2 (en) 1999-12-28 2009-09-01 Sony Corporation Signal processing device and method, and recording medium
US6683992B2 (en) 1999-12-28 2004-01-27 Matsushita Electric Industrial Co., Ltd. Image decoding apparatus and image coding apparatus
US6842196B1 (en) 2000-04-04 2005-01-11 Smith & Nephew, Inc. Method and system for automatic correction of motion artifacts
CA2309002A1 (en) 2000-05-23 2001-11-23 Jonathan Martin Shekter Digital film grain reduction
US6593925B1 (en) 2000-06-22 2003-07-15 Microsoft Corporation Parameterized animation compression methods and arrangements
ATE313218T1 (en) * 2000-08-25 2005-12-15 Fuji Photo Film Co Ltd DEVICE FOR PARALLAX IMAGE RECORDING AND PARALLAX IMAGE PROCESSING
JP2002077591A (en) * 2000-09-05 2002-03-15 Minolta Co Ltd Image processing device and imaging device
JP3395770B2 (en) 2000-09-29 2003-04-14 ミノルタ株式会社 Digital still camera
JP2002158893A (en) 2000-11-22 2002-05-31 Minolta Co Ltd Device and method for correcting picture and recording medium
US6678413B1 (en) 2000-11-24 2004-01-13 Yiqing Liang System and method for object identification and behavior characterization using video analysis
US6952286B2 (en) 2000-12-07 2005-10-04 Eastman Kodak Company Doubleprint photofinishing service with the second print having subject content-based modifications
US6989859B2 (en) * 2000-12-22 2006-01-24 Eastman Kodak Company Camera having user interface ambient sensor viewer adaptation compensation and method
JP2004526179A (en) 2000-12-22 2004-08-26 ヒューレット・パッカード・カンパニー Image composition evaluation method and apparatus
US6670963B2 (en) 2001-01-17 2003-12-30 Tektronix, Inc. Visual attention model
US6756993B2 (en) 2001-01-17 2004-06-29 The University Of North Carolina At Chapel Hill Methods and apparatus for rendering images using 3D warping techniques
CA2373707A1 (en) 2001-02-28 2002-08-28 Paul Besl Method and system for processing, compressing, streaming and interactive rendering of 3d color image data
US7215831B2 (en) 2001-04-26 2007-05-08 Georgia Tech Research Corp. Video enhancement using multiple frame techniques
US7715643B2 (en) 2001-06-15 2010-05-11 Sony Corporation Image processing apparatus and method, and image pickup apparatus
JP3624859B2 (en) * 2001-06-19 2005-03-02 カシオ計算機株式会社 Imaging device, soft focus image photographing method
US20050058322A1 (en) 2003-09-16 2005-03-17 Farmer Michael E. System or method for identifying a region-of-interest in an image
US6577821B2 (en) 2001-07-17 2003-06-10 Eastman Kodak Company Camera having oversized imager and method
US6930718B2 (en) 2001-07-17 2005-08-16 Eastman Kodak Company Revised recapture camera and method
US7650044B2 (en) 2001-07-30 2010-01-19 Cedara Software (Usa) Limited Methods and systems for intensity matching of a plurality of radiographic images
US7262798B2 (en) 2001-09-17 2007-08-28 Hewlett-Packard Development Company, L.P. System and method for simulating fill flash in photography
JP3999505B2 (en) 2001-11-30 2007-10-31 オリンパス株式会社 camera
US7092584B2 (en) 2002-01-04 2006-08-15 Time Warner Entertainment Company Lp Registration of separations
CN100338499C (en) 2002-02-27 2007-09-19 Cdm光学有限公司 Optimized image processing for wavefront coded imaging systems
JP4169522B2 (en) 2002-03-22 2008-10-22 株式会社リコー Image processing apparatus, image processing program, and storage medium for storing the program
US20030184671A1 (en) * 2002-03-28 2003-10-02 Robins Mark N. Glare reduction system for image capture devices
US7149974B2 (en) 2002-04-03 2006-12-12 Fuji Xerox Co., Ltd. Reduced representations of video sequences
US7081892B2 (en) 2002-04-09 2006-07-25 Sony Computer Entertainment America Inc. Image with depth of field using z-buffer image data and alpha blending
GB0212367D0 (en) 2002-05-29 2002-07-10 Eastman Kodak Co Image processing
US20040208385A1 (en) 2003-04-18 2004-10-21 Medispectra, Inc. Methods and apparatus for visually enhancing images
JP3903870B2 (en) 2002-07-29 2007-04-11 オムロンエンタテインメント株式会社 PHOTO PRINT DEVICE CONTROL METHOD, PHOTO PRINT DEVICE CONTROL PROGRAM, RECORDING MEDIUM CONTAINING PHOTO PRINT DEVICE CONTROL PROGRAM, PHOTO PRINT DEVICE, AND PRINT MEDIUM UNIT
CH695973A5 (en) 2002-08-16 2006-10-31 Alstom Technology Ltd Rotor for an electric machine.
WO2004036378A2 (en) 2002-10-15 2004-04-29 Mcintyre David J System and method for simulating visual defects
JP4222013B2 (en) 2002-12-02 2009-02-12 カシオ計算機株式会社 Image correction apparatus, character recognition method, and image correction program
EP1441529B1 (en) 2003-01-21 2008-07-23 Canon Kabushiki Kaisha Image-taking apparatus and image-taking system
KR100946888B1 (en) 2003-01-30 2010-03-09 삼성전자주식회사 Device and method for correcting a skew of image
US7295720B2 (en) 2003-03-19 2007-11-13 Mitsubishi Electric Research Laboratories Non-photorealistic camera
US7206449B2 (en) 2003-03-19 2007-04-17 Mitsubishi Electric Research Laboratories, Inc. Detecting silhouette edges in images
US7103227B2 (en) 2003-03-19 2006-09-05 Mitsubishi Electric Research Laboratories, Inc. Enhancing low quality images of naturally illuminated scenes
US7359562B2 (en) 2003-03-19 2008-04-15 Mitsubishi Electric Research Laboratories, Inc. Enhancing low quality videos of illuminated scenes
US7218792B2 (en) 2003-03-19 2007-05-15 Mitsubishi Electric Research Laboratories, Inc. Stylized imaging using variable controlled illumination
US7102638B2 (en) 2003-03-19 2006-09-05 Mitsubishi Eletric Research Labs, Inc. Reducing texture details in images
JP4232498B2 (en) * 2003-03-24 2009-03-04 富士ゼロックス株式会社 Subject photographing state determination device, image quality adjustment device, and image photographing device
US8593542B2 (en) 2005-12-27 2013-11-26 DigitalOptics Corporation Europe Limited Foreground/background separation using reference images
US7606417B2 (en) 2004-08-16 2009-10-20 Fotonation Vision Limited Foreground/background segmentation in digital images with differential exposure calculations
US20050017968A1 (en) 2003-07-21 2005-01-27 Stephan Wurmlin Differential stream of point samples for real-time 3D video
US20050140801A1 (en) 2003-08-05 2005-06-30 Yury Prilutsky Optimized performance and performance for red-eye filter method and apparatus
US20050031224A1 (en) 2003-08-05 2005-02-10 Yury Prilutsky Detecting red eye filter and apparatus using meta-data
US7064810B2 (en) 2003-09-15 2006-06-20 Deere & Company Optical range finder with directed attention
JP4127675B2 (en) 2003-12-09 2008-07-30 株式会社リコー Image processing device
JP4321287B2 (en) 2004-02-10 2009-08-26 ソニー株式会社 Imaging apparatus, imaging method, and program
US7317843B2 (en) 2004-04-01 2008-01-08 Microsoft Corporation Luminance correction
JP4814217B2 (en) 2004-04-15 2011-11-16 ドルビー ラボラトリーズ ライセンシング コーポレイション System and computer program for converting image from low dynamic range to high dynamic range
US9094615B2 (en) 2004-04-16 2015-07-28 Intheplay, Inc. Automatic event videoing, tracking and content generation
US20050243176A1 (en) * 2004-04-30 2005-11-03 James Wu Method of HDR image processing and manipulation
US7653255B2 (en) 2004-06-02 2010-01-26 Adobe Systems Incorporated Image region of interest encoding
US7015926B2 (en) 2004-06-28 2006-03-21 Microsoft Corporation System and process for generating a two-layer, 3D representation of a scene
US7457477B2 (en) 2004-07-06 2008-11-25 Microsoft Corporation Digital photography with flash/no flash extension
JP2006080632A (en) 2004-09-07 2006-03-23 Ricoh Co Ltd Digital still camera, printer, digital still camera printing system, control method and program therefor
CA2568633C (en) 2004-10-15 2008-04-01 Oren Halpern A system and a method for improving the captured images of digital still cameras
JP2006140594A (en) 2004-11-10 2006-06-01 Pentax Corp Digital camera
US8050511B2 (en) 2004-11-16 2011-11-01 Sharp Laboratories Of America, Inc. High dynamic range images from low dynamic range images
US7860332B2 (en) 2005-01-07 2010-12-28 Hewlett-Packard Development Company, L.P. Method and system for determining an indication of focus of an image
US7512262B2 (en) * 2005-02-25 2009-03-31 Microsoft Corporation Stereo-based image processing
US7692696B2 (en) 2005-12-27 2010-04-06 Fotonation Vision Limited Digital image acquisition system with portrait mode
IES20060559A2 (en) 2006-02-14 2006-11-01 Fotonation Vision Ltd Automatic detection and correction of non-red flash eye defects
EP1987436B1 (en) 2006-02-14 2015-12-09 FotoNation Limited Image blurring
US7864989B2 (en) * 2006-03-31 2011-01-04 Fujifilm Corporation Method and apparatus for adaptive context-aided human classification

Patent Citations (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1994026057A1 (en) * 1993-04-29 1994-11-10 Scientific Generics Limited Background separation for still and moving images
US20010012063A1 (en) * 2000-02-08 2001-08-09 Masamine Maeda Image pickup apparatus

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
BRAUN M ET AL: "Information Fusion of Flash and Non-Flash Images", INTERNET CITATION, 31 December 2002 (2002-12-31), XP002398967, Retrieved from the Internet <URL:http://graphics.stanford.edu/~georgp/vision.htm> [retrieved on 20060914] *
MORGAN MCGUIRE AND WOJCIECH MATUSIK AND HANSPETER PFISTER AND JOHN F. HUGHES AND FRÉDO DURAND: "Defocus video matting", SIGGRAPH 2005, 31 July 2005 (2005-07-31), XP002406140, Retrieved from the Internet <URL:http://www.cs.brown.edu/people/morgan/DefocusVideoMatting/mcg05-DefocusVideoMatting.pdf> [retrieved on 20061107] *
SCOTT KELBY: "Photoshop Elements 3: Down & Dirty Tricks", 27 December 2004, PEACHPIT PRESS, ISBN: 0-321-27835-6, XP002406719 *
SCOTT KELBY: "The Photoshop Elements 4 Book for Digital Photographers", 14 November 2005, NEW RIDERS, ISBN: 0-321-38483-0, XP002406720 *

Cited By (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7912285B2 (en) 2004-08-16 2011-03-22 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images with differential exposure calculations
US8175385B2 (en) 2004-08-16 2012-05-08 DigitalOptics Corporation Europe Limited Foreground/background segmentation in digital images with differential exposure calculations
US8170350B2 (en) 2004-08-16 2012-05-01 DigitalOptics Corporation Europe Limited Foreground/background segmentation in digital images
US7680342B2 (en) 2004-08-16 2010-03-16 Fotonation Vision Limited Indoor/outdoor classification in digital images
US7957597B2 (en) 2004-08-16 2011-06-07 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images
US7692696B2 (en) 2005-12-27 2010-04-06 Fotonation Vision Limited Digital image acquisition system with portrait mode
US8212897B2 (en) 2005-12-27 2012-07-03 DigitalOptics Corporation Europe Limited Digital image acquisition system with portrait mode
US7868922B2 (en) 2006-02-14 2011-01-11 Tessera Technologies Ireland Limited Foreground/background segmentation in digital images
US7953287B2 (en) 2006-02-14 2011-05-31 Tessera Technologies Ireland Limited Image blurring
EP1987436A2 (en) * 2006-02-14 2008-11-05 Fotonation Vision Limited Image blurring
EP1987436A4 (en) * 2006-02-14 2009-06-24 Fotonation Vision Ltd Image blurring
US8363908B2 (en) 2006-05-03 2013-01-29 DigitalOptics Corporation Europe Limited Foreground / background separation in digital images
EP2104335A1 (en) 2008-03-12 2009-09-23 Mindy AB An apparatus and a method for digital photographing
US8633999B2 (en) 2009-05-29 2014-01-21 DigitalOptics Corporation Europe Limited Methods and apparatuses for foreground, top-of-the-head separation from background
US8971628B2 (en) 2010-07-26 2015-03-03 Fotonation Limited Face detection using division-generated haar-like features for illumination invariance
US8977056B2 (en) 2010-07-26 2015-03-10 Fotonation Limited Face detection using division-generated Haar-like features for illumination invariance
US9019402B2 (en) 2011-02-18 2015-04-28 Fotonation Limited Dynamic range extension by combining differently exposed hand-held device-acquired images

Also Published As

Publication number Publication date
DE602006006414D1 (en) 2009-06-04
EP1839435A1 (en) 2007-10-03
US8212897B2 (en) 2012-07-03
US20070147820A1 (en) 2007-06-28
IES20060563A2 (en) 2006-11-01
US20100182458A1 (en) 2010-07-22
EP1839435B1 (en) 2009-04-22
US7692696B2 (en) 2010-04-06
ATE429781T1 (en) 2009-05-15

Similar Documents

Publication Publication Date Title
EP1839435B1 (en) Digital image acquisition system with portrait mode
US7868922B2 (en) Foreground/background segmentation in digital images
US20080309770A1 (en) Method and apparatus for simulating a camera panning effect
US20060171697A1 (en) Imaging apparatus, image storage apparatus, imaging method, storage method, recording medium recording imaging program, and recording medium recording storage program
JP4126721B2 (en) Face area extraction method and apparatus
IES20080161A2 (en) Face detection in mid-shot digital images
WO2017047012A1 (en) Imaging device and system including imaging device and server
US7692715B2 (en) Digital camera
US20060082672A1 (en) Filtering digital images
JP2008092299A (en) Electronic camera
WO2016165967A1 (en) Image acquisition method and apparatus
US8035692B2 (en) Image taking apparatus which forms an image of a subject on an imaging device to create image data representative of the subject
JP2002040321A (en) Electronic camera
JP2005033255A (en) Image processing method of digital image, digital camera and print system
JP2008109668A (en) Blemish repair tool for digital photographs in camera
JP4632417B2 (en) Imaging apparatus and control method thereof
JP2007049408A (en) Photographing device
JP5854235B2 (en) Imaging apparatus, imaging method, and program
US20210400192A1 (en) Image processing apparatus, image processing method, and storage medium
JP4636024B2 (en) Imaging device
JP2007259004A (en) Digital camera, image processor, and image processing program
JP2002044510A (en) Electronic camera
JP2002044516A (en) Electronic camera
IE20060563U1 (en) Digital image acquisition system with portrait mode
IES84401Y1 (en) Digital image acquisition system with portrait mode

Legal Events

Date Code Title Description
WWE Wipo information: entry into national phase

Ref document number: 2006776529

Country of ref document: EP

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWP Wipo information: published in national office

Ref document number: 2006776529

Country of ref document: EP

NENP Non-entry into the national phase

Ref country code: DE