CA2517989A1

CA2517989A1 - Best shooting moment selectable digital camera apparatus

Info

Publication number: CA2517989A1
Application number: CA002517989A
Authority: CA
Inventors: Jian Zhang; Wende Li; Jianqiang Huang
Original assignee: Individual
Current assignee: Individual
Priority date: 2005-01-05
Filing date: 2005-09-01
Publication date: 2006-07-05
Also published as: FI20051187L; CN100358340C; ITMI20051990A1; GB0519288D0; US20060147192A1; JP2006191526A; FR2880452A1; KR100676408B1; DE102005052901A1; RU2302026C2; KR20060080526A; FI20051187A0; CN1642233A; GB2422020B; GB2422020A; RU2005128136A

Abstract

The present invention relates to a best shooting moment selectable digital camera apparatus. This digital camera apparatus could decide the instantaneous best shooting moment to take photos. The technical scheme is: including camera head, memory circuit and signal processor, the signal processor includes the co-series face detecting module, eye & mouth positioning module and blink judging &
mouth open judging module, meanwhile, the face detecting module reads out the digital image from memory circuit and delivers the result into eye & mouth positioning module after face positioning, the eye & mouth positioning module delivers the result into blink judging & mouth open judging module after eye and mouth positioning, the blink judging 8c mouth open judging module sends out the judgment result; the controlling circuit issues a shoot controlling order when the judgment result of the said blink judging &. mouth open judging module means a best shooting moment.

Description

Best S6ootin~ Moment Selectable Digital Camera Annaratus FIELD OF THE INVENTION
The present invention relates to a best shooting moment selectable digital camera apparatus, especially relates to a digital camera apparatus that could obtain the person's face state to decide shooting moment. It is suitable for professional and amateur shutterbugs or ordinary users.
BACKGROUND OF THE INVENTION
The current typical digital camera apparatus has no funetian of allowing operator to select the best shaating moment. The typical digital camera apparatus has function of allowing operator to review the taken images after photo taking.
For example, the user displays the taken images on the display device after photo taking. For numerous taken images especially the more person's images, however, the photos quality is hard to be ensured owing to the instantaneous blinking or mood changing of shot person. The traditional digital camera apparatus couldn't distinguish the shooting moment, couldn't distinguish if the person is being blinking and if the person is wearing a cheerful expression, it thus brings about a tremendous difficulty of shooting moment selection to operator and results in a 24 poor photos quality.

The present invention is proposed to resolve the above problems to provide a best shooting moment selectable digital camera apparatus, This digital camera apparatus has the typical digital camera apparatus's functions not only, but also could decide the instantaneous best shooting moment to take image.
The technical scheme of the present invention is: A best shooting moment selectable digital camera apparatus, comprising a camera head and a memory circuit, characterized in that: the camera apparatus further includes:

Signal processor, including co-series face detecting module, eye & mouth positioning module and blink judging & mouth open judging module, in which:
The face detecting module reads out~tl~te digital image from memory circuit and delivers the result into eye 8c mouth positioning module after face positioning;
The eye & mouth positioning module delivers the result into blink judging &
mouth open judging module after eye and mouth positioning;
The blink judging & mouth open judging module sends out the ,judgment result;
The controlling circuit issues a shoot controlling order when the judgment result of the said blink judging &. mouth open judging module means a best shooting moment, and doesn't issue a shoot controlling order if the judgment result doesn't mean a best shooting moment.
The said face detecting module includes the multi..dimensioned template, awaiting-taken image and template matching arithmetic unit, the template matching arithmetic unit receives the mufti-dimensioned template and awaiting-taken image in memory, and delivers the arithmetic result into the face image position, the said mufti-dimensioned template, awaiting-taken image and face image position are stored at the various address of the memory respectively.
T'he said eye & mouth positioning module includes the awaiting-taken image, face image position and horizontal projecting & vertical projecting unit, the horizontal projecting & vertical projecting unit receives the awaiting-taken image and face image position in memory, and delivers the arithmetic result into the eye & mouth position, the said awaiting-taken image, face image position and eye &
mouth position are stored at the various address of the memory respectively.
The said blink judging & mouth open judging module includes the awaiting-taken image, eye & mouth position and blink judging &c mouth open judging unit, the blink judging & mouth open judging unit receives the awaiting-taken image and eye & mouth position in memory, obtains the blinl~
judging &. mouth open judging results for each person's face and issues the order a to the controlling circuit, the said awaiting-taken image and eye 8c mouth position are stared at the various address of the memory respectively.
The benel:icial effects of the present invention is: At time of photo taking, it could conveniently distinguish each person's dace expression, such as, if the eyes S are ope~red and if the person is wearing a cheerful expression, so as to select a best photo taking moment and thus improve greatly the photo taking quality.
BR~~SCIPTION OF THE Ap'PENDED DRAWINGS
Fig. 1 is a system block diagram showing the structure of the present invention.
Fig. ~ is a structure block diagram showing the signal processor in Fig. 1.
Fig. 3 is a structure block diagram showing the face detecting module in Fig.

2.
Fig. 4 is a structure block diagram showing the eye & mouth positioning module in Fig. 2.
Fig. 5 is a structure block diagram showing the blink judging & mouth open judging module in Fig. 2.
Fig. 6 is a principle block diagram showing the eye & mouth positioning module and blink judging & mouth open judging module.
Fig, 7 is a principle block diagram against the mouth open judging in the blink judging & mouth open judging module.
Fig. 8 is a flow chart showing the template matching in the present invention_ Fig. 9 is a flow chart showing the blink judging & mouth open judging module in the present invention.
Fig. 10 is a flow cha,rr showing the signal processor in the present invention.
DESCItLPTION OF THE EMBODIMENTS
As Fig. 1 shows, the preferred embodiment includes a camera head 1, memory circuit 2, signal processor 3 and controlling circuit 4, the camera head 1 stores the signals obtained and digitalized into the memory circuit 2, the signal processor 3 processes the digital images stared in the memory circuit 2, judges that if the person in the digital image is blinking and if the person is wearing a cheerful expression, and decides ifthis is the best shooting moment, in case of deciding that this is the best shooting moment, the signal processor 3 would issue a shoot controlling order via the controlling circuit 4.
As Fig. 2 shows, the signal processor 3 includes a co-series face detecting module 3-t, eye & mouth positioning module 3-2 and blink judging & mouth open judging module 3-3, the face detecting module 3-1 reads out the digital image from memory circuit and delivers the result into eye & mouth positioning module 3-2 after face positioning; the eye & mouth positioning module 3-2 delivers the result into blink judging & mouth open judging module 3-3 after eye and mouth positioning; the blink judging & mouth open judging module ~-3 sends the judgment result to the controlling circuit 4; at this time, the controlling circuit 4 issues a shoot controlling order when the judgment result received means a best shooting moment, and doesn't issue a shoot controlling order ifthe judgment result doesn't mean a best shooting moment.
As Fig. 3 shows, the said face detecting madul.e 3-1. includes the mufti-dimensioned template 3-1-1, awaiting-taken image 3-1-2 and template matching arithmetic unit 3-1-3, the template matching arithmetic unit receives the mufti-dimensioned template 3-1-1 and awaiting-taken image 3-1-2 in memory 2,~
and delivers the arithmetic result into the face image position 3-1-4, the said mufti-dimensioned template 3-1-l, awaiting-taken image 3-1-2 and face image position 3-1-4 are stored at the various address of memory 2 respectively. The mufti-dimensioned template is an average face template with 12 kinds of different sizes, it is obtained by plenty of .face image's analysis and trainings.
As Fig. 4 shows, the said eye & mouth positioning module 3-2 includes the awaiting-taken image 3-1-Z> face image position 3-1-4 and horizontal projecting &
vertaical projecting unit 3-2-1, the horizontal projecting & vertical projecting unit receives the awaiting-taken image 3-1-2 and face image position 3-1-4 in memory 2, and delivers the arithmetic result into the eye & mouth position 3-2-2, the said awaiting-taken image 3-1-2, face image position 3-1-4 and eye 8c mouth position 3-2-2 are stored at the various address of memory 2 respectively.
As Fig. S shawl, the said blink judging & mouth open judging module 3-3 includes the awaiting-taken image 3-1-2, eye 8c mouth position 3-2-2 and blink judging & mouth open judging unit 3-3-1, the blink judging & mouth open judging unit receives the awaiting-taken image 3-1-2 and eye & mouth position 3-2-2 in memory 2, obtains the blink judging & mouth open ,judging results for each person face and issues the order to the controlling circuit 4, the Said awaiting-taken image 3-1-2 and eye & mouth position 3-2-2 are stored at the various address of memory 2 respectively.
>~ ig. 6 is a principle block diagram showing the eye & mouth positioning module and blink judging & mouth open judging module, the eye & mouth 1 S position is decided conveniently by the projection in horizontal and vertical direction. The blink judging could be made according to if there are three peaks at the corresponding position in the vertical directional projection figure, there would be only one peak in the horizontal directional projection if both eye closed.
The mouth open ,judging could be made according to if the points that are gone from mouth center to top & bottom edges of mouth along the vertical direction have a continuous non-lip color.
Fig. 7 is a principle block diagram against the mouth open judging, based on the mouth center position obtained fmm Fig, 6, end out upward the mouth top edge yUp along the vertical direction, and find out downward the mouth bottom edge yl3n along the vertical direction, thus obtain the mouth opening (yUp-yDn), compare it with the experience threshold value obtained from statistic and judge if the mouth is open.
Fig. 8 is a flow chart showing a template matching in face detecting module 3-1:
s In 5801, start the template matching of face detecting.
In 5802, assign K,=1. K is the index of template.
In 5803, take out a certain template lV~k.
In S$04, divide the template Mk into N small blocks.
In 5805, effect the little wave transferring to each of the small blocks.
In S80f, take out the max. 114 element for each small block and farm a vector A(k).
In 5807, judge if all the templates are gone through. Enter into S$08 if YES, and enter into 5803 if N0.
In 5808, assign K=1. K is the index of template.
In 5809, initialize the X and Y for index the Image.
In 5810, read in the awaiting-taken photo Image.
In 5811, take out the block S of same sized as the module.
In 5812, divide the S into N small blocks.
In 5813, efFect the little wave transferring to each of the small blocks.
In 5814, take out the max. 114 element for each small block and form a vector B(k).
In S$15, increase the deviation of X and 'SC to make it appoint to the next pixel.
If the X is smaller than the image width, increase the X only by one pixel width, if X reaches to the image width, set X to zero and increase Y by a pixel.
In 5816, observe if the image edge is reached, enter into 5817 if YES and enter into 581 S if N(~.
In 5817, calculate the distance DistAB(k) of vector A(k) and B(k).
In 5818, observe if the DistAB(k) is more than the threshold DistThreoldK
measured from face. Enter into 5819 if YES and enter into 5820 if NO.
In 5819, record the face position.
In 5820, confirm if all the templates have been processed, enter into 5821 if 'YES and enter into 5809 if NtJ.
In S$22, end the process.

Fig, 9 is a .flow chart showing a blink judging 8c mouth open judging module 3-3:
In 5901, project the face image obtained from the face detecting module in the horizontal direction.
In 5902, judge that if the image obtained in the last step has two peaks, enter into 5904 if YES and enter into 5903 if NO.
In 5904, retard the coordinate position (y1, y2) of the horizontal peak calculated in 5902. In fact, the y1 is the projection position along the horizontal direction of the mouth center, and y2 is the projection position along the horizontal direction of the eye center.
In 5903, it is concluded that the eyes on face arc closed.
Ln 5905, record the peak coordinate position (y 1 ) calculated in 5902 and projected in the horizontal direction. In fact, the y1 is the projection position along the horizontal direction of the mouth center.
in 5906, project the face image obtained from the face detecting module in the vertical direction.
In 5907, judge that if the image obtained in the last step has three peaks, enter into 5909 if YES and enter into 5908 if NO.
In 5909, record the peak coordinate position (xl, x2, x3) calculated in 5907 and projected in the vertical direction. In fact, the x1, x2, x3 are respectively the projection position along the vertical direction of the center of right eye, mouth and left eye.
In 5910, retard the mouth center coordinates (x2, y1).
In 5911, initialize the yUp and yDn to the mouth vertical coordinate.
In 5912, observe if the pixel value at the coordinates (x2, yLlp) is within the lip color area. Enter into 5914 if Y'ES and enter into 5913 ifNO.
In 5913, increase the yUp by 1. In fact, it is to increase the vertical coordinate by 1 pixel position.
'When search the top edge of lip in 5912, 5913, the horizontal coordinate ~c2 is kept invariant, the y2 is increased, the increased y2 is referred to as yUp, and observe if the pixel value at the coordinates (x2, yLTp) is within the lip color area.
tn 5914, observe if the pixel value at the coordinates (x2, yDn) is within the lip color area. Enter into S91 fi if YES and enter into 5915 if N(~.
In 5915, decrease the yDn by 1. In fact, it is to decrease the vertical coordinate by 1 pixel position.
When search the bottom edge of !ip in 5914, S91 S, the horizontal coordinate x2 is kept invariant, the y2 is decreased, the decreased y2 is referred to as yDn, and observe if the pixel value at the coordinates (x2, yDn) is within the lip color area.
In 5915, subtract yT~n from yUp, and subtract the mouth opening threshold from it. Enter into S918 if it is bigger than the mouth open threshold and enter into 5917 if NO.
In S9I7, judge that the face area image is a closed mouth one.
In 5918, judge that the face area image is an opened mouth one.
In 5919, end the process.
Fig. 10 is a flaw chart showing a signal processor 3 in the present invention:
In S 1001, start to calculate.
In S 1002, assign X=1. X means the image frames to be collected. It is used to decide which frame of the taken image has the best effect.
24 In S 1003, collect the digital image of ImageX.
In S 1004, elect the model matching.
In 51005, record each face location of FA1, FA2, ..., FaN and the total faces quantity N.
In 51006, assign I~=1. K means each face position and is for each matched dace block.
In S 1007, read in the image block at Fak position from ImageX.
In 51008, project the ImageX.
In 51009, decide if there is any eye projection according to the projection image. Enter into S 1010 if YES and enter into S 1 O 14 if NO.

In S 1010, decide if there is any mouth projection according to the projection image. Enter into S 1011 if YES and enter into S 1014 if NO.
In S 1011, decide if need to judge the mouth open. Enter into S 1012 if YES
and enter into S 1013 if NO.
In S 1012, decide if the mouth is opened. Enter into S 1 O l 3 if YES and enter into S 1014 if NO.
In S 1013, increase the current better faces by 1, In 51014, decide if the normal bearing faces currently detected in the collected images being more than that of former detected, enter into S 1015 if YES
1 p and enter into S 1016 if NO.
In 1016, decide if all the faces in the current image are processed, enter into S'1017 if YES and enter into S 1018 if N~.
In S 1017, decide if enough games are processed, enter into S 1020 if YES and enter into S 1019 if NO.
In S 1020, store the best face image frames from the memory.
In 51021, issue the shoot controlling order to complete the following process and the shooting stare setting.

Claims

We claim:

1. A best shooting moment selectable digital camera apparatus, comprising a camera head (1) and a memory circuit (2), characterized in that: the camera further includes:
Signal processor (3), including co-series face detecting module (3-1), eye &
mouth positioning module (3-2) and blink judging & mouth open judging module (3-3), in which:
The face detecting module (3-1) reads out the digital image from memory circuit and delivers the result into eye & mouth positioning module (3-2) after face positioning;
The eye & mouth positioning module (3-2) delivers the result into blink judging & mouth open judging module (3-3) after eye and mouth positioning;
The blink judging & mouth open judging module (3-3) sends out the judgment result;
The controlling circuit (4) issues a shoot controlling order when the judgment result of the said blink judging & mouth open judging module (3-3) means a best shooting moment, and doesn't issue a shoot controlling order if the judgment result doesn't mean a best shooting moment.

2. The best shooting moment selectable digital camera apparatus according to Claim 1, characterized in that: the said face detecting module (3-1) includes the multi-dimensioned template (3-1-1), awaiting-taken image (3-1-2) and template matching arithmetic unit (3-1-3), the template matching arithmetic unit receives the multi-dimensioned template (3-1-1) and awaiting-taken image (3-1-2) in memory (2), and delivers the arithmetic result into the face image position (3-1-4), the said multi-dimensioned template (3-1-1), awaiting-taken image (3-1-2) and face image position (3-1-4) are stored at the various address of memory (2) respectively.

3. The best shooting moment selectable digital camera apparatus according to Claim 1, characterized in that; the said eye & mouth positioning module (3-2) includes the awaiting-taken image (3-1-2), face image position (3-1-4) and horizontal projecting & vertical projecting unit (3-2-1), the horizontal projecting &
vertical projecting unit receives the awaiting-taken image (3-1-2) and face image position (3-1-4) in memory (2), and delivers the arithmetic result into the eye &
mouth position (3-2-2), the said awaiting-taken image (3-1-2), face image position (3-1-4) and eye & mouth position (3-2-2) are stored at the various address of memory (2) respectively.

4. The best shooting moment selectable digital camera apparatus according to Claim 1, characterized in that: the said blink judging & mouth open judging module (3-3) includes the awaiting-taken image (3-1-2), eye & mouth position (3-2-2) and blink judging & mouth open judging unit (3-3-1), the blink judging &
mouth open judging unit receives the awaiting-taken image (3-1-2) and eye &
mouth position (3-2-2) in memory (2), obtains the blink judging & mouth open judging results for each person face and issues the order to the controlling circuit (4), the said awaiting-taken image (3-1-2) and eye & mouth position (3-2-2) are stored at the various address of memory (2) respectively.