WO1999066369A1

WO1999066369A1 - A system and method for dynamically synchronizing a digital soundtrack with a moving picture in motion picture media

Info

Publication number: WO1999066369A1
Application number: PCT/US1999/011439
Authority: WO
Inventors: William H. Mead
Original assignee: Sony Cinema Products Corporation
Priority date: 1998-06-15
Filing date: 1999-05-24
Publication date: 1999-12-23
Also published as: EP1086401B1; DE69922193D1; AU4096599A; US6417910B1; DE69922193T2; ATE283501T1; EP1086401A1; ES2233051T3

Abstract

In a system and method for dynamically synchronizing a digital soundtrack with a moving picture in motion picture media, the system includes a device for presenting the motion picture media, wherein the motion picture media further includes an analog soundtrack. The digital soundtrack further includes a variable delay to compensate for the distance between a frame in the moving picture and a portion of the digital soundtrack corresponding thereto. A synchronizing device is correlated to a digital soundtrack pickup and an analog soundtrack picture in a feedback loop. A processor in the synchronizing device is adapted to process the digital soundtrack and the analog soundtrack to generate a control signal based on the difference between the location of a transient reference in the analog soundtrack and the same transient in the digital soundtrack, and to use the control system to adjust the variable delay in the digital soundtrack for synchronization thereof.

Description

A SYSTEM AND METHOD FOR DYNAMICALLY SYNCHRONIZING

A DIGITAL SOUNDTRACK WITH A MOVING PICTURE

IN MOTION PICTURE MEDIA

BACKGROUND OF THE INVENTION

Field of the Invention

This invention relates generally to improvements in media sound playback systems, and, more particularly, to a new and improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in motion picture media which includes a reference analog soundtrack, whereby the digital soundtrack plays back in synchronization with the moving picture for efficient and effective media sound playback.

Description of the Related Art

Digital sound has become an important pan of the movie business, because of the high quality of reproduction which it provides.

Initially, analog sound was the only sound available for a movie. Analog sound in the movie business has made limited progress over the years, to being essentially marginally acceptable with relatively low quality sound provided thereby. The technical capabilities of the media for carrying analog sound were very limited, and did not meet the needs of the filmgoing public as well as the exhibitors to keep people coming to the theaters. In analog systems, there are two tracks in the film which play back in the theaters as four channels using a matrix encoding technology similar to quadrophonic sound to reproduce more channels than there actually are in the film, and similar in approach to stereophonic sound.

With the advent of digital sound in recent years, the digital sound provides a much greater dynamic range, representing a quality improvement over analog sound, in that the quiet movements are truly quiet, the loud moments may become very loud, and there are more surround channels including sub-woofer channels to support sounds such as for example very low frequency explosions.

At first, digital sound was an add-on to existing analog sound systems. The digital sound system included digital processing equipment including a digital reader to be mounted on the projector, and a separate digital processing box which fed digital sound to the amplifiers and to the loudspeakers. The only interface between the digital and analog systems was an automatic switch from the digital sound to the lower quality analog sound if there was a loss of digital sound, to provide continuous sound. Presently, digital sound systems and analog sound systems are integrated with the speaker systems in many theaters. However, problems may arise even if there is no loss of the digital soundtrack, for example where the digital soundtrack loses synchronization with the moving picture while the movie is being shown, which would prevent movie-goers from enjoying the movie. This condition may arise for any one of a number of reasons. The analog and digital soundtracks may be placed on the same film at different locations relative to each other, and at different locations relative to the location of the moving picture, to compensate for the locations of the analog and digital sound pickups relative to the picture gate and the lamphouse for projecting the moving pic_ture. The digital soundtrack may be recorded in the film with a delay to compensate for the location of the digital sound pickup ahead of the location of the picture gate and the lamphouse, and to compensate for the distance between the digital sound pickup and the picture gate and the lamphouse. The delay initially synchronizes the digital soundtrack with the moving picture.

However, errors may be introduced in the pickup of the digital soundtrack which would cause loss of synchronization with the moving picture. The projectionist may thread the film in the projector in such a way that the digital soundtrack may be ou_t of synchronization, by making the loop in the film too big or too small, which would change the distance of film travel between the digital sound pickup and the picture gate and lamphouse. Further, the design of the specific projector utilized may vary the distance between the digital sound pickup and the picture gate and lamphouse. Also, projectionists may not thread the film through all of the digital sound pickups associated with a projector, in systems wherein each pickup is adapted to function with one of a plurality of digital soundtrack formats. Errors may also occur in processing multiple prints of a film, causing the digital soundtrack to lose synchronization with the moving picture.

In view of these considerations, an effective operational system should be implemented in a motion picture projecting system for the dynamic synchronization of the digital soundtrack with the moving picture. Therefore, those concerned with the development and use of digital sound in motion pictures have recognized the need for improved systems and methods for synchronizing the high quality digital soundtrack with the moving picture in a motion picture film, such that moviegoers may fully enjoy the experience of viewing a film without the disruption thereof caused by a loss of synchronization. Accordingly, the present invention fulfills these needs by providing efficient and effective dynamic synchronization of the digital soundtrack with the moving picture for an enhanced moviegoing experience and increased patron enjoyment.

SUMMARY OF THE INVENTION Briefly, and in general terms, the present invention provides a new and improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in an efficient and effective manner, while enhancing the viewing experience for the moviegoer at a motion picture theater. The system provides dynamic synchronization of the digital soundtrack by using an analog soundtrack in the same media as a reference, for effective synchronization thereof.

By way of example, and not by way of limitation, the present invention provides a new and improved system and method for dynamically synchronizing the digital film soundtrack from a transient in the digital and analog soundtracks.

More particularly, the present invention includes motion picture media including a moving picture, a digital soundtrack, and an analog soundtrack, and means for presenting the motion picture media. The system in accordance with the present invention further includes means for dynamically synchronizing the digital soundtrack and the moving picture with the analog soundtrack as a reference therefor. This is accomplished automatically through a feedback loop which generates a control signal from correlated information in the digital and analog soundtracks and adjusts a variable delay in the digital soundtrack responsive thereto.

Therefore, one advantage of the present invention is that it includes a system for effectively synchronizing the digital soundtrack with the moving picture in motion picture media.

A further advantage is that the present invention provides dynamically synchronizes the digital soundtrack with the moving picture while the motion picture media is being presented by the projecting device.

Another advantage is that of the present invention provides automatic synchronization of the digital soundtrack and the moving picture upon loss of synchronization while the motion picture media is being presented by the projecting device.

These and other objects and advantages of the invention will become apparent from the following more detailed description, when taken in conjunction with the accompanying drawings of illustrative embodiments.

BRIEF DESCRIPTION OF THE DRAWINGS FIG. 1 is a fragmentary view of motion picture media which includes a digital soundtrack, an analog soundtrack, and a moving picture therein; FIG.2 is a partly representational paπly block diagram of a dynamically synchronizing media presenting system in accordance with the present invention; and FIG. 3 is a block diagram of a feedback loop for dynamic synchronization in the practice of the present invention.

DETAILED DESCRIPTION OF THE PREFERRED EMBODIMENTS

The present invention is directed to an improved system and method for dynamically synchronizing a digital soundtrack with a moving picture in an efficient and effective manner. The improved system and method provides synchronization of the moving picture and digital soundtrack responsive to a reference analog soundtrack, dynamically in real time while the moving picture is being presented on a screen, and wherein the digital soundtrack is in the same media as the analog soundtrack and the moving picture.

Referring now to the drawings, wherein like reference numerals denote like or corresponding parts throughout the drawing figures, and particularly to FIGS. 1 and 2, a system 10 is utilized for dynamically synchronizing a digital soundtrack 12 with a moving picture 14 in a motion picture media 16 such as a movie film, using a corresponding analog soundtrack 18 on the media 16 as a reference. The media 16 may further include sprocket perforations 20 for enabling the threading thereof into a device 22 for presenting the moving feature 14 on a screen 24. The presenting device 22 may comprise for example a motion picture projector. The system 10 further includes a device 26 for picking up the digital soundtrack 12, and a device 28 for picking up the analog soundtrack 18, which are associated with the presenting device 22. As shown in FIG. 2, the presenting device 22 includes an assembly 30 for projecting the moving picture 14 onto the screen 24. The projecting assembly 30 includes a picture gate and a lamphouse including a lamp and a lens assembly. The presenting device 22 further includes a plurality of rollers, takeup rollers, and shrocket wheels (not shown) through which the media 16 is threaded, which define a path of movement 32 for transporting the media 16 through the projecting device 22.

In accordance with the present invention, the system 10 also includes a device 34 for synchronizing the digital soundtrack 12 with the moving picture 14. The synchronization device 34 includes a processor 36 and software for processing digital signals, and is connected to the digital soundtrack pickup device 26, the analog soundtrack pickup device 28, and a speaker system 38, for broadcasting the digital soundtrack 12 and showing the moving picture 14 in synchronization therewith.

As seen in FIGS. 1-3, the system 10 further includes a feedback loop 40, wherein the digital soundtrack 12, which is processed through a variable delay 42 which delays the pickup of the digital soundtrack 12, is fed back through the synchronizing device 34 along with the analog soundtrack 18, and is processed through the synchronizing device 34 to generate a control signal 44 for controlling the variable delay 42. The variable delay 42 is adapted to compensate for the location of the digital sound pickup 26 ahead of the projecting assembly 30 for projecting the moving picture 14, and is variable responsive to the control signal 44.

The synchronization device 34 is adapted to detect a selectable reference which is common to the digital soundtrack 12 and the analog soundtrack 18. The reference may preferably comprise for example a transient element comprising a discrete sound-generating event in the media 16.

As illustrated in FIG. 1, the analog soundtrack 16 may be placed on the media 16 at a location thereon for example inside the sprocket perforations 20. The digital soundtrack 12 may be placed on the media 16 at a location thereon not otherwise used, such as for example in the edges of the media 16 outside the sprocket perforations 20. The analog soundtrack 16 may be recorded on the media 16 at a location ahead of the moving picture 14 thereon, for example at a standard location for thirty-five millimeter film of twenty frames ahead of the moving picture 14. The analog soundtrack 16 may then be picked up by the analog soundtrack pickup device 28, at a location thereof for example at a standard distance after the projecting assembly 30 in the path of movement 32 of the media 16 through the presenting device 22, to synchronize the analog soundtrack 16 with the moving picture 14. The digital soundtrack 12 may be recorded on the media 16 with a delay relative to the moving picture 14, and may then be picked up by the digital soundtrack pickup device 26 at the location thereof ahead of the projecting assembly 30 in the path of movement 32 of the media 16 through _the presenting device 22, to initially synchronize the digital soundtrack 12 with _the moving picture 14. The digital soundtrack 12 may then be synchronized with the moving picture 14 at the location where the media is to be presented, such as in an auditorium in a movie theater, by an installer by running a film, listening by headphones or in the auditorium, and adjusting the variable delay forward or backwards until synchronization is heard in the auditorium. The adjustment may be made in hardware by rotating a thumbled-wheel switch or in software on a laptop computer, to set the variable delay to the length of the path 32. After the delay is set and adjusted, a projectionist may introduce errors in installing a media 16 in a presenting device 22 for a particular show in a way which may cause the digital soundtrack 12 to be out of synchronization with the moving picture 14. In threading the media 16 into the projecting device 22, the projectionist may so configure the media 16 that the digital soundtrack 12 may be out of synchronization rela_tive to the moving picture 14. The projectionist may for example make a loop in the media 16 either too big or tightened too much, which would change the length of the path 32, for example to the extent of one or two frames in the media 16. Such a path change would throw the digital soundtrack 12 and the moving picture 14 out of synchronization. Also, the distance in the presenting device 22 between the digital sound_track pickup device 26 and the projecting assembly 30 may vary depending upon the specific equipmen_t, and may in particular for example vary from one foot to three or four feet because of the design thereof, which may also result in the loss of synchronization of the digital soundtrack 12 and the moving picture 14.

Further, the media 16 presently may include any of a plurality of different formats of the digital soundtrack 12, and the presenting device 22 may include a plurality of digital soundtrack pickup devices 26 associated therewith which have the capability of showing the different digital soundtrack formats. Projectionists may forget to thread the media 16 through all such digital soundtrack pickup devices 26, or may thread only one such device 26 which changes the length of the path 32 between the digital soundtrack pickup device 26 and the projecting assembly 30 which may also cause the digital soundtrack 26 to be out of synchronization. Aside from projectionist error, processing errors may occur, which may cause the digital soundtrack 12 to be placed on the media 16 at an unintended place, for example either slightly ahead or slightly behind where it should be relative to the moving picture 14. Such processing errors may include for example errors in laying up the digital soundtrack 12 in printing up the negative from one print of the media 16 to another. Also, uncertainty over where the absolute start mark may be located, such as a blip which may be in the wrong place relative to the digital soundtrack 12.

In the present invention, the synchronization device 34 herein is adapted to adjust the digital soundtrack delay 42 while the media 16 is being presented by the presenting device 22, to dynamically synchronize the digital soundtrack 12 with the moving picture 14 where both are embedded in the same media 16. The synchronization device 34 uses the analog soundtrack 18 as a guide reference, dynamically comparing thereto the same information in the digital soundtrack 12. The correlated information in the media 16, comprising the reference information in the analog soundtrack 18 and the same information in the digital soundtrack 12, may comprise a specific transition or the like constituting a signal with a unique characteristic, such as for example changes, pulses, a door slamming, a person starting to speak, a spoken syllable, an explosion or a gunshot. The analog soundtrack 18 and the digital soundtrack 12 are generally highly correlated, since both support the same movie and dialog.

In particular and in accordance with the present inven^tion, ^the processor

36 in _the synchroniza_tion device 34 is adapted to examine ^the con^ten^t of ^the analog soundtrack 18 and _the digital soundtrack 12 and derive a con^trol signal 44 from both soundtracks which represents the correlated information of a ^transient na^ture. The derived con_trol signal 44 cons_titutes an error signal which is either plus or minus depending upon how _the correlated information differs, and responsive thereto ^the synchroniza_tion device 34 dynamically adjusts and con^trols the variable delay line 42 between _the digital sound pickup 26 and the projecting assembly 30 ^to synchronize ^the digi_tal soundtrack 12 and the moving pic^ture 14.

In accordance wi_th _the present invention, the processor 36 analyzes ^the transien_ts in _the sound_track and may generate for example a charac^teristic ma_thema_tical signal cons_ti_tu_ting an error control signal 44 which may for example comprise a plus or minus vol_tage, which controls the variable delay line 42 ^to minimize the error signal, comprising a feedback loop 40. For example, if a signal is found in the analog sound_track 18, and _the same signal is found in the digi^tal soundtrack 12 wi^thin one second thereafter, _the assumption would be that the digi^tal sound^track 12 was running behind _the analog soundtrack 18, and a control signal comprising an error signal could be generated _tha_t would change the variable delay line 42 ^to move the digi_tal sound_track back _to minimize the error. The presen^t invention provides improved sys_tems and me_thods for synchronization of errors which manifes^t themselves _throughout _the showing of a film unless correc^ted. The synchroniza^tion device 34 is adap_ted to make an adjustment once for each showing of a film, usually wi_thin a short period of _time of the beginning of the presen^ta^tion of the film, such as for example within _the firs_t few seconds. The adjustmen^t is implemented wi^thin ^the time i_{t t}akes _to make the calcula_tion, generate the error signal, and correc^{t t}he error, which would also be dependent upon the types of transi^tions in ^the film.

In accordance with the present invention, the system and me^thod provide for dynamic synchronization in real time of the digi^tal soundtrack wi^th ^the moving pic_ture while _the moving picture is being projected on^to a screen, using ^the analog soundtrack as a reference.

I_t will be apparen_t from _the foregoing that, while particular forms of ^the inven_tion have been illus_tra_ted and described, various modifica^tions can be made withou_t depar_ting from _the spirit and scope of the invention. Accordingly, i^t is not in_tended _tha_{t t}he inven_tion be limited, except as by the appended claims.

Claims

WHAT IS CLAIMED IS:

1. A system for dynamically synchronizing a digital soundtrack and a moving picture, when the digital soundtrack and the moving picture are not in synchronization, comprising: motion picture media, which includes a moving picture, and a digital soundtrack and an analog soundtrack therein; means for presenting the motion picture media; and means for dynamically synchronizing the digital soundtrack with the moving picture in the motion picture media, wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture become out of synchronization while presenting the motion picture media in the presenting means.

2. The system of claim 1, wherein the synchronizing means include means for processing the digital soundtrack and the analog soundtrack.

3. The system of claim 1, wherein the presenting means include means for projecting the moving picture, further comprising means for detecting the digital soundtrack and means for detecting the analog soundtrack which are associated with the presenting means, and wherein the presenting means further include a path of movement of the motion picture media through the digital soundtrack detecting means, the analog soundtrack detecting means, and the moving picture projecting means.

4. The system of claim 1, wherein the motion picture media comprises a motion picture film.

5. The system of claim 1, wherein the synchronizing means automatically synchronize the digital soundtrack with the moving picture dynamically while presenting the motion picture media in the presenting means.

6. The system of claim 2, wherein the digital soundtrack includes a

va╧Ça ble delay therein relative to the moving picture, the analog soundtrack includes reference selectable therein and the digital soundtrack includes a corresponding reference selectable therein, and the processing means comprise means for detecting the selected analog soundtrack reference, the selected digital soundtrack reference, and the difference therebetween so as to generate a control signal derived therefrom, and for adjusting the digital soundtrack variable delay responsive to the control signal generated, so as to synchronize the digital soundtrack and the moving picture.

7. The system of claim 3, wherein the digital soundtrack detecting means are located in the media movement path before the location of the projecting

means.

8. The system of claim 3 , wherein the analog soundtrack detecting

means are located in the media movement path after the location of the projecting

means.

9. The system of claim 3, wherein the projecting means comprise elements for enabling the moving picture to be projected onto a screen.

10. The system of claim 6, wherein the selectable analog soundtrack reference and the corresponding selectable digital soundtrack reference comprise a transient element in the motion picture medⁱa.

11. The system of claim 6, further comprising a feedback loop which includes the digital soundtrack including the delay therein, the analog soundtrack, the synchronization means including the processing means, and the control signal.

12. The system of claim 10, wherein the transient element comprises a discrete sound-generating event in the motion picture media.

13. The system of claim 10, wherein the synchronizing means are further adapted to analyze the transient element and generate characteristic signals therefrom, and wherein the error signal comprises the difference between the locations of the transient element characteristic signals in the analog soundtrack and the digital soundtrack.

14. A method of dynamically synchronizing a digital soundtrack and a moving picture, when the digital soundtrack and the moving picture are not in synchronization, in a system which includes motion picture media, which includes a moving picture, and a digital soundtrack and an analog soundtrack therein, means for presenting the motion picture media, and means for dynamically synchronizing the digital soundtrack with the moving picture in the motion picture media, wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture become out of synchronization while presenting the motion picture media in the presenting means, comprising the steps of: presenting the motion picture media, including detecting the digital soundtrack, displaying the moving picture, and detecting the analog soundtrack; and dynamically synchronizing the digital soundtrack with the moving picture wherein the analog soundtrack is a reference therefor, when the digital soundtrack and the moving picture are not in synchronization while presenting the motion picture media in the presenting means.

15. The method of claim 14, wherein the synchronizing means include means for processing the digital soundtrack and the analog soundtrack, and the synchronizing step comprises processing the digital soundtrack and the analog soundtrack.

16. The me_thod of claim 14, wherein the presenting means include means for projec_ting the moving picture, further comprising means for detec^ting ^the digital sound_track and means for detecting the analog sound^track which are associated with the presen_ting means, and wherein the presenting means further include a path of movemen_t of the mo_tion picture media through the digital sound^track de^tecting means, _the analog sound_track detecting means, and the moving pic^ture projec^ting means, wherein _the synchronizing step comprises inserting ^the mo^tion pic^ture media in _the movemen_t pa_th such _tha_t the motion picture media moves firs^{t t}hrough ^the digital sound_track de_tec_ting means, then through the moving pic^ture projec^ting means, and then _through _the analog soundtrack detecting means.

17. The me_thod of claim 14, wherein the motion picture media comprises a mo_tion pic_ture film, the presenting step comprises presen^ting ^the mo^tion pic_ture film in _the presen_ting means, and the synchronizing s^tep comprises dynamically synchronizing _the digital soundtrack with the mo^tion pic^ture film responsive to the analog soundtrack.

18. The me_thod of claim 14, wherein the synchronizing means au_toma_tically synchronize _the digital soundtrack with the moving pic^ture dynamically while presen_ting _the mo_tion picture media in the presenting means, and ^the synchronizing s_tep includes au_tomatically synchronizing the digi^tal sound^track with the moving pic_ture dynamically while presenting the motion pic^ture media in the presenting means.

19. The me_thod of claim 15, wherein the digital soundtrack includes a variable delay _therein rela_tive _to the moving picture, the analog sound^track includes a reference selectable _therein and the digital soundtrack includes a corresponding reference selec_table therein, and the processing means comprise means for de^tec^ting the selec_ted analog sound_track reference, the selected digital sound^track reference, and the difference therebetween so as to generate a control signal derived therefrom, and for adjusting the digital soundtrack variable delay responsive to the control signal generated, so as to synchronize the digital soundtrack and the moving picture, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the control signal generated.

20. The method of claim 16, wherein the digital soundtrack detecting means are located in the media movement path before the location of the projecting means, and the synchronizing step comprises detecting the digital soundtrack before projecting the moving picture.

21. The method of claim 16, wherein the analog soundtrack detecting means are located in the media movement path after the location of the projecting means, and the synchronizing step comprises detecting the analog soundtrack after projecting the moving picture.

22. The method of claim 16, wherein the projecting means comprise an elements for enabling the moving picture to be projected onto a screen, and the projecting step comprises projecting the motion picture onto a screen.

23. The method of claim 19, wherein the selectable analog soundtrack reference and the corresponding selectable digital soundtrack reference comprise a transient element in the motion picture media, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the analog soundtrack transient and the digital soundtrack transient.

24. The method of claim 19, further comprising a feedback loop which includes the digital soundtrack including the variable delay therein, the analog soundtrack, the synchronizing means including the processing means, and the control signal, wherein the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to processing the digital soundtrack through the feedback loop.

25. The method of claim 23 , wherein the transient element comprises a discrete sound-generating event in the motion picture media, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the locations of the discrete sound-generating event in the analog soundtrack and in the digital soundtrack.

26. The method of claim 23, wherein the synchronizing means are further adapted to analyze the transient element and generate characteristic signals therefrom, and wherein the error signal comprises the difference between the location of the transient element characteristic signals in the analog soundtrack and the digital soundtrack, and the synchronizing step comprises adjusting the digital soundtrack variable delay responsive to the difference between the locations of the transient element characteristic signals in the analog soundtrack and the digital soundtrack.