WO2004052052A2 - Method and apparatus for processing audio signals from a bitstream - Google Patents

Method and apparatus for processing audio signals from a bitstream Download PDF

Info

Publication number
WO2004052052A2
WO2004052052A2 PCT/EP2003/013172 EP0313172W WO2004052052A2 WO 2004052052 A2 WO2004052052 A2 WO 2004052052A2 EP 0313172 W EP0313172 W EP 0313172W WO 2004052052 A2 WO2004052052 A2 WO 2004052052A2
Authority
WO
WIPO (PCT)
Prior art keywords
audio
channel
channel configuration
mixing
channels
Prior art date
Application number
PCT/EP2003/013172
Other languages
French (fr)
Other versions
WO2004052052A3 (en
Inventor
Jürgen Schmidt
Jens Spille
Ernst F. SCHRÖDER
Johannes Böhm
Original Assignee
Thomson Licensing S.A.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Thomson Licensing S.A. filed Critical Thomson Licensing S.A.
Priority to US10/536,539 priority Critical patent/US8082050B2/en
Priority to BR0316498-5A priority patent/BR0316498A/en
Priority to BRPI0316498-5A priority patent/BRPI0316498B1/en
Priority to JP2004556172A priority patent/JP5031988B2/en
Priority to EP03780037A priority patent/EP1568250B1/en
Priority to AU2003288154A priority patent/AU2003288154B2/en
Priority to CA2508220A priority patent/CA2508220C/en
Publication of WO2004052052A2 publication Critical patent/WO2004052052A2/en
Publication of WO2004052052A3 publication Critical patent/WO2004052052A3/en

Links

Classifications

    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S3/00—Systems employing more than two channels, e.g. quadraphonic
    • H04S3/008—Systems employing more than two channels, e.g. quadraphonic in which the audio signals are in digital form, i.e. employing more than two discrete digital channels
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • G—PHYSICS
    • G11—INFORMATION STORAGE
    • G11B—INFORMATION STORAGE BASED ON RELATIVE MOVEMENT BETWEEN RECORD CARRIER AND TRANSDUCER
    • G11B20/00—Signal processing not specific to the method of recording or reproducing; Circuits therefor
    • G11B20/10—Digital recording or reproducing
    • H—ELECTRICITY
    • H04—ELECTRIC COMMUNICATION TECHNIQUE
    • H04S—STEREOPHONIC SYSTEMS 
    • H04S1/00—Two-channel systems
    • H04S1/007—Two-channel systems in which the audio signals are in digital form

Definitions

  • the invention relates to a method and to an apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream, that each have a different number of channels and/or different channel configurations, and that are combined before being presented in a final channel configuration.
  • Audio composition means mixing multiple individual audio objects to create a single soundtrack, e.g. a single channel or a single stereo pair.
  • a set of instructions for mixdown is transmitted or trans- ferred in the bitstream.
  • the multiple audio objects are decoded separately, but not directly played back to a listener. Instead, the transmitted instructions for mixdown are used to prepare a single soundtrack from the decoded audio objects. This final soundtrack is then played for the listene-r.
  • ISO/IEC 14496:2001 is the second version of the MPEG-4 Audio standard, whereas ISO/IEC 14496 is the first version.
  • MPEG-4 Audio standard nodes for presenting audio are described. Header streams that contain configuration information, which is necessary for decoding the audio sub- streams are transported via MPEG-4 Systems.
  • the channel configuration of the audio decoder - for example 5.1 multichannel - can be fed inside the Compositor from one node to the following node so that the channel configuration information can reach the presenter, which is responsible for the correct loudspeaker mapping.
  • the presenter represents that final part of the audio chain which is no more under the control of the broadcaster or content provider, e.g.
  • 'Node' means a processing step or unit used in the above MPEG-4 standard, e.g. an interface carrying out time synchronisation between a decoder and subsequent processing units, or a corresponding interface between the presenter and an upstream processing unit.
  • the description consists of an encoded hierarchy or tree of nodes with attributes and other information including event sources and targets.
  • Leaf nodes in this tree correspond to elementary audio-visual data, whereas intermediate nodes group this material to form audio-visual objects, and perform e.g. grouping and transformation on such audio-visual objects (scene description nodes) .
  • Audio decoders either have a predetermined channel configu- ration by definition, or receive e.g. some configuration information items for setting their channel configuration.
  • the channel configuration of the audio decoders can be used for the loudspeaker mapping occurring after passing the sound node, see ISO/IEC 14496-3:2001, chapter 1.6.3.4 Channel Configuration.
  • an MPEG-4 player implementation passes these information items, that are transmitted within a received MPEG-4 bitstream, together with the decoder output or outputs through the audio nodes AudioSource and Sound2D to the presenter.
  • the channel configuration data ChannelConfig is to be used by the presenter to make the correct loudspeaker association, especially in case of multi-channel audio (numChan > 1) where the phaseGroup flags in the audio nodes are to be set .
  • AudioMix, AudioSwitch and AudioFX defined in the current MPEG-4 standard mentioned above can change the fixed channel assignment that is required for the correct channel representation, i.e. such audio nodes have a channel-variant be- haviour leading to conflicts in the channel configuration transmission.
  • a problem to be solved by the invention is to deal properly with such channel configuration conflicts such that the pre- senter can replay sound with the correct or the desired channel assignments.
  • This problem is solved by the method disclosed in claim 1.
  • An apparatus that utilises this method is disclosed in claim 3.
  • the invention discloses different but related ways of solving such channel configuration confusion by using channel- variant audio nodes.
  • An additional audio channel configuration node is used, or its functionality is added to the existing audio mixing and/or switching nodes.
  • This additional audio channel configuration node tags the correct channel configuration information items to the decoded audio data streams that pass through the Sound2D node to the presenter.
  • the invention enables the content provider or broadcaster to set the channel configuration in such a way that the presenter at receiver side can produce a cor- rect channel presentation under all circumstances.
  • An escape code value in the channel configuration data facilitates correct handling of not yet defined channel combinations even in case signals having different channel con- figurations are mixed and/or switched together.
  • the invention can also be used in any other multi-channel application wherein the received channel data are passed through a post processing unit having the inherent ability to interchange the received channels at reproduction.
  • the inventive method is suited for processing two or more initially decoded audio signals received or replayed from a bitstream, that each have a different number of channels and/or different channel configurations, and that are combined by mixing and/or switching before being presented in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information is attached, and wherein said mixing and/or switching is controlled such that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or following said switching is determined by related specific mixing and/or switching information provided from a content provider or broadcaster, and wherein to the combined data stream to be presented a correspondingly updated channel configuration information is attached.
  • the inventive apparatus includes:
  • Fig. 1 Transparent channel configuration information flow in a receiver
  • Fig. 3 Inventive receiver including an additional node AudioChannelConfig.
  • a first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input Inl of an AudioMix node or mixing stage 27.
  • a second decoder 22 provides a decoded ⁇ 2.0 stereo' signal via an AudioSource node or interface 25 to a second input In2 of AudioMix node 27.
  • the output signal from AudioMix node 27 having a 5.1 multichannel' format is fed to a first input of an AudioMix node 27 having a 5.1 multichannel' format is fed to a first input of an AudioMix node 27 having a 5.1 multichannel' format.
  • AudioSwitch node or switcher or mixing stage 28 A third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28.
  • AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes.
  • Audio switch node 28 produces or evaluates sequences of switching decisions related to the selection of which input channels are to be passed through as which output audio channels.
  • the corresponding whichChoice data field specifies the corresponding channel selections versus time instants.
  • the audio output signal from AudioSwitch node 28 having a l 2.0 stereo' format is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
  • Fig. 2 two different conflicts are shown.
  • the first conflict occurs in the mix node 27, where a mix of a stereo signal into the surround channels in a 5.1 configuration is shown.
  • the question is, for example, whether the resulting audio output signal should have 5.1 channels, or the 5.1 surround channels should become 2.0 stereo format channels.
  • the straightforward solution would be to assign input signal L2 to the first output channel lch and input signal R2 to the second output channel 2ch.
  • the content provider or broadcaster could desire to assign input signal L2 to output channel 4ch and input signal R2 to output channel 5ch instead.
  • the current version of the above MPEG-4 standard does not allow such feature.
  • the second conflict occurs in the sequence of whichChoice data field updates in the AudioSwitch node 28.
  • channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se- quentially selected at specified time instants.
  • the time instants in the whichChoice data field can be defined by e.g. every succeeding frame or group of frames, every predetermined time period (for instance 5 minutes) , each time the content provider or broadcaster has preset or commanded, or upon each mouse click of a user.
  • a first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input of an AudioMix node or mixing stage 27.
  • a second de- coder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input of AudioMix node 27.
  • the output signal from AudioMix node 27 having a '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28.
  • a third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28.
  • the decoders may each include at the input an internal or external decoding buffer.
  • the output signal from AudioSwitch node 28 having a '2.0 stereo' format is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
  • AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes .
  • a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes .
  • AudioChannelConfig node 30 A new audio node, called AudioChannelConfig node 30 is introduced between AudioSwitch node 28 and Sound2D node 29.
  • This node has the following properties or function: AudioChannelConfig ⁇ exposedField SFInt32 numChannel 0 exposedField MFInt32 phaseGroup 0 exposedField MFInt32 channelConfig 0 exposedField MFFloat channelLocation 0,0 exposedField MFFloat channelDirection 0,0 exposedField MFInt32 polarityPattern 1
  • SFInt32, MFInt32 and MFFloat are single field ( SF, containing a single value) and multiple field ⁇ MF, containing a mul tiple values and the quanti ty of values) data types that are defined in ISO/IEC 14772-1:1998, subclause 5.2.
  • 'Int32' means an integer number and 'Float' a floating point number.
  • 'exposedField' denotes a data field the content of which can be changed by the content provider or broadcaster per audio scene.
  • the phaseGroup specifies phase relationships in the node output, i.e.
  • the channelConfig field and the below channel configuration association table can be defined using a set of pre-defined index values, thereby using values from the ISO/IEC 14496- 3:2001 audio part standard, chapter 1.6.3.4. According to the invention, it is extended using some values of chapter 0.2.3.2 of the MPEG-2 audio standard ISO/IEC 13818-3:
  • an escape value '1' is defined in this table having e.g. index '1' in the table. If this value occurs, the desired channel configuration is not listed in the table and therefore the values in the channelLocation, channelDirection and polarityPattern fields are to be used for assigning the desired channels and their properties. If the channelConfig index is an index defined in the table, the channelLocation, channelDirection and polarityPattern fields are vectors of the length zero.
  • a 3D- float vector array can be defined, whereby the first 3 float values (three-dimensional vector) are associated with the first channel, the next 3 float values are associated with the second channel, and so on.
  • the values are defined as x,y,z values (right handed coordi na te system as used in ISO/IEC 14772 -1 (VRML 97) ) .
  • the channelLocation values describe the direction and the absolute distance in meter (the absolute distance has been used because simply the user can generate a normalised vector, as usually used in channel configuration) .
  • the channelDirection is a unit vector with the same coordinate system.
  • E.g. channelLocation [0, 0, -1] relative to the listening sweet spot means centre speaker in one-meter distance.
  • Three other examples are given in the three lines of table 2 :
  • the polarityPattern is an integer vector where the values are restricted to the values given in table 3. This is useful for example in case of Dolby ProLogic sound where the front channels have monopole pattern and the surround channel have dipole characteristic.
  • the polarityPattern can have values according to table 2
  • Table 1 polarityPattern association
  • the additional AudioChannelConfig node 30 is not inserted. Instead, the functionality of this node is added to nodes of the type AudioMix 27, AudioSwitch 28 and AudioFX (not depicted) .
  • the above values of the phaseGroup fields are additionally defined for the corresponding existing nodes AudioMix, AudioSwitch and AudioFX in the first version ISO/IEC 14496 of the MPEG-4 standard.

Abstract

In the MPEG-4 standard ISO/IEC 14496:2001 several audio objects that can be coded with different MPEG-4 format coding types can together form a composed audio system representing a single soundtrack from the several audio substreams. In a receiver the multiple audio objects are decoded separately, but not directly played back to a listener. Instead, transmitted instructions for mixdown are used to prepare a single soundtrack. Mixdown conflicts can occur in case the audio signals to be combined have different channel numbers or configurations. According to the invention an additional audio channel configuration node is used that tags the correct channel configuration information items to the decoded audio data streams to be presented. The invention enables the content provider to set the channel configuration in such a way that the presenter at receiver side can produce a correct channel presentation under all circumstances. An escape code value in the channel configuration data facilitates correct handling of not yet defined channel combinations.

Description

Method and Apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream
The invention relates to a method and to an apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream, that each have a different number of channels and/or different channel configurations, and that are combined before being presented in a final channel configuration.
Background
In the MPEG-4 standard ISO/IEC 14496:2001, in particular in part 3 Audio and in part 1 Systems, several audio objects that can be coded with different MPEG-4 format coding types can together form a composed audio system representing a single soundtrack from the several audio substreams . User interaction, terminal capability, and speaker configuration may be used when determining how to produce a single soundtrack from the component objects. Audio composition means mixing multiple individual audio objects to create a single soundtrack, e.g. a single channel or a single stereo pair. A set of instructions for mixdown is transmitted or trans- ferred in the bitstream. In a receiver the multiple audio objects are decoded separately, but not directly played back to a listener. Instead, the transmitted instructions for mixdown are used to prepare a single soundtrack from the decoded audio objects. This final soundtrack is then played for the listene-r.
ISO/IEC 14496:2001 is the second version of the MPEG-4 Audio standard, whereas ISO/IEC 14496 is the first version. In the above MPEG-4 Audio standard nodes for presenting audio are described. Header streams that contain configuration information, which is necessary for decoding the audio sub- streams are transported via MPEG-4 Systems. In a simple au- dio scene the channel configuration of the audio decoder - for example 5.1 multichannel - can be fed inside the Compositor from one node to the following node so that the channel configuration information can reach the presenter, which is responsible for the correct loudspeaker mapping. The presenter represents that final part of the audio chain which is no more under the control of the broadcaster or content provider, e.g. an audio amplifier having volume control and the attached loudspeakers . 'Node' means a processing step or unit used in the above MPEG-4 standard, e.g. an interface carrying out time synchronisation between a decoder and subsequent processing units, or a corresponding interface between the presenter and an upstream processing unit. In general, in ISO/IEC 14496-1:2001 the scene description is represented using a parametric approach. The description consists of an encoded hierarchy or tree of nodes with attributes and other information including event sources and targets. Leaf nodes in this tree correspond to elementary audio-visual data, whereas intermediate nodes group this material to form audio-visual objects, and perform e.g. grouping and transformation on such audio-visual objects (scene description nodes) . Audio decoders either have a predetermined channel configu- ration by definition, or receive e.g. some configuration information items for setting their channel configuration.
Invention
Normally, in an audio processing tree the channel configuration of the audio decoders can be used for the loudspeaker mapping occurring after passing the sound node, see ISO/IEC 14496-3:2001, chapter 1.6.3.4 Channel Configuration. There- fore, as shown in Fig. 1, an MPEG-4 player implementation passes these information items, that are transmitted within a received MPEG-4 bitstream, together with the decoder output or outputs through the audio nodes AudioSource and Sound2D to the presenter. The channel configuration data ChannelConfig is to be used by the presenter to make the correct loudspeaker association, especially in case of multi-channel audio (numChan > 1) where the phaseGroup flags in the audio nodes are to be set .
However, when combining or composing audio substreams having different channel assignments, e.g. 5.1 multichannel sur- round sound and 2.0 stereo, some of the audio nodes
(AudioMix, AudioSwitch and AudioFX) defined in the current MPEG-4 standard mentioned above can change the fixed channel assignment that is required for the correct channel representation, i.e. such audio nodes have a channel-variant be- haviour leading to conflicts in the channel configuration transmission.
A problem to be solved by the invention is to deal properly with such channel configuration conflicts such that the pre- senter can replay sound with the correct or the desired channel assignments. This problem is solved by the method disclosed in claim 1. An apparatus that utilises this method is disclosed in claim 3.
The invention discloses different but related ways of solving such channel configuration confusion by using channel- variant audio nodes. An additional audio channel configuration node is used, or its functionality is added to the existing audio mixing and/or switching nodes. This additional audio channel configuration node tags the correct channel configuration information items to the decoded audio data streams that pass through the Sound2D node to the presenter.
Advantageously, the invention enables the content provider or broadcaster to set the channel configuration in such a way that the presenter at receiver side can produce a cor- rect channel presentation under all circumstances. An escape code value in the channel configuration data facilitates correct handling of not yet defined channel combinations even in case signals having different channel con- figurations are mixed and/or switched together.
The invention can also be used in any other multi-channel application wherein the received channel data are passed through a post processing unit having the inherent ability to interchange the received channels at reproduction.
In principle, the inventive method is suited for processing two or more initially decoded audio signals received or replayed from a bitstream, that each have a different number of channels and/or different channel configurations, and that are combined by mixing and/or switching before being presented in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information is attached, and wherein said mixing and/or switching is controlled such that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or following said switching is determined by related specific mixing and/or switching information provided from a content provider or broadcaster, and wherein to the combined data stream to be presented a correspondingly updated channel configuration information is attached.
In principle the inventive apparatus includes:
- at least two audio data decoders that decode audio data received or replayed from a bitstream;
- means for processing the audio signals initially decoded by said audio data decoders, wherein at least two of said decoded audio signals each have a different number of channels and/or a different channel configuration, and wherein said processing includes combination by mixing and/or switching;
- means for presenting the combined audio signals in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information is attached, wherein in said processing means said mixing and/or switching is controlled such that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or following said switching is determined by related specific mixing and/or switching information provided from a content provider or broadcaster, and wherein to the combined data stream fed to said presenting means a correspondingly updated channel configuration information is attached.
Advantageous additional embodiments of the invention are disclosed in the respective dependent claims.
Drawings
Exemplary embodiments of the invention are described with reference to the accompanying drawings, which show in:
Fig. 1 Transparent channel configuration information flow in a receiver;
Fig. 2 Channel configuration flow conflicts in a receiver;
Fig. 3 Inventive receiver including an additional node AudioChannelConfig.
Exemplary embodiments
In Fig. 2 a first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input Inl of an AudioMix node or mixing stage 27. A second decoder 22 provides a decoded λ2.0 stereo' signal via an AudioSource node or interface 25 to a second input In2 of AudioMix node 27. The AudioMix node 27 represents a multi- channel switch that allows to connect any input channel or channels to any output channel or channels, whereby the effective amplification factors used thereby can have any value between ' 0'='off and x l'='on', e.g. '0.5', λ 0.6' or 0.707'. The output signal from AudioMix node 27 having a 5.1 multichannel' format is fed to a first input of an
AudioSwitch node or switcher or mixing stage 28. A third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28. The functionality of this AudioSwitch node 28 is similar to that of the AudioMix node 27, except that the 'amplification factors' used therein can have values ' 0'='off' or vl'='on' only. AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes. Audio switch node 28 produces or evaluates sequences of switching decisions related to the selection of which input channels are to be passed through as which output audio channels. The corresponding whichChoice data field specifies the corresponding channel selections versus time instants. The audio output signal from AudioSwitch node 28 having a l2.0 stereo' format is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
In Fig. 2 two different conflicts are shown. The first conflict occurs in the mix node 27, where a mix of a stereo signal into the surround channels in a 5.1 configuration is shown. The question is, for example, whether the resulting audio output signal should have 5.1 channels, or the 5.1 surround channels should become 2.0 stereo format channels. In case of selecting a 5.1 output format the straightforward solution would be to assign input signal L2 to the first output channel lch and input signal R2 to the second output channel 2ch. However, there are many other possibilities. The content provider or broadcaster could desire to assign input signal L2 to output channel 4ch and input signal R2 to output channel 5ch instead. However, the current version of the above MPEG-4 standard does not allow such feature.
The second conflict occurs in the sequence of whichChoice data field updates in the AudioSwitch node 28. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se- quentially selected at specified time instants. The time instants in the whichChoice data field can be defined by e.g. every succeeding frame or group of frames, every predetermined time period (for instance 5 minutes) , each time the content provider or broadcaster has preset or commanded, or upon each mouse click of a user. In the example given in
Fig. 2, at a first time instant input signal Cl is connected to output channel lch and input signal M is connected to output channel 2ch. At a second time instant input signal LI is connected to output channel lch and input signal Rl is connected to output channel 2ch. At a third time instant input signal LSI is connected to output channel lch and input signal RSI is connected to output channel 2ch. Within this sequence, channels out of the AudioMix node 27 output and the single channel output from AudioSource node 26 are se- quentially selected. However, because of the contradictory input information in node 28, no correct output channel configuration can be determined automatically based on the current version of the above MPEG-4 standard.
Based on the assumption that the content provider or broadcaster is to solve such conflicts, three inventive solutions are feasible that are explained in connection with Fig. 3. A first decoder 21 provides a decoded '5.1 multichannel' signal via an AudioSource node or interface 24 to a first input of an AudioMix node or mixing stage 27. A second de- coder 22 provides a decoded '2.0 stereo' signal via an AudioSource node or interface 25 to a second input of AudioMix node 27. The output signal from AudioMix node 27 having a '5.1 multichannel' format is fed to a first input of an AudioSwitch node or switcher or mixing stage 28. A third decoder 23 provides a decoded '1 (centre)' signal via an AudioSource node or interface 26 to a second input of AudioSwitch node 28. The decoders may each include at the input an internal or external decoding buffer. The output signal from AudioSwitch node 28 having a '2.0 stereo' format is passed via a Sound2D node or interface 29 to the input of a presenter or reproduction stage 20.
AudioMix node 27 and Audio switch node 28 are controlled by a control unit or stage 278 that retrieves and/or evaluates from the bitstream received from a content provider or broadcaster e.g. channel configuration data and other data required in the nodes, and feeds these data items to the nodes .
A new audio node, called AudioChannelConfig node 30 is introduced between AudioSwitch node 28 and Sound2D node 29. This node has the following properties or function: AudioChannelConfig{ exposedField SFInt32 numChannel 0 exposedField MFInt32 phaseGroup 0 exposedField MFInt32 channelConfig 0 exposedField MFFloat channelLocation 0,0 exposedField MFFloat channelDirection 0,0 exposedField MFInt32 polarityPattern 1
expressed in the MPEG-4 notation. SFInt32, MFInt32 and MFFloat are single field ( SF, containing a single value) and multiple field {MF, containing a mul tiple values and the quanti ty of values) data types that are defined in ISO/IEC 14772-1:1998, subclause 5.2. 'Int32' means an integer number and 'Float' a floating point number. 'exposedField' denotes a data field the content of which can be changed by the content provider or broadcaster per audio scene. The phaseGroup ( specifies phase relationships in the node output, i.e. specifies whether or not there are important phase rela tionships between mul tiple audio channels) and the numChannel (number of channels in the node output) fields are re-defined by the content provider due to the functional correlation with the channelConfig field or parameters. The channelConfig field and the below channel configuration association table can be defined using a set of pre-defined index values, thereby using values from the ISO/IEC 14496- 3:2001 audio part standard, chapter 1.6.3.4. According to the invention, it is extended using some values of chapter 0.2.3.2 of the MPEG-2 audio standard ISO/IEC 13818-3:
Figure imgf000011_0001
Figure imgf000012_0001
Advantageously, an escape value '1' is defined in this table having e.g. index '1' in the table. If this value occurs, the desired channel configuration is not listed in the table and therefore the values in the channelLocation, channelDirection and polarityPattern fields are to be used for assigning the desired channels and their properties. If the channelConfig index is an index defined in the table, the channelLocation, channelDirection and polarityPattern fields are vectors of the length zero.
In the channelLocation and channelDirection fields a 3D- float vector array can be defined, whereby the first 3 float values (three-dimensional vector) are associated with the first channel, the next 3 float values are associated with the second channel, and so on.
The values are defined as x,y,z values (right handed coordi na te system as used in ISO/IEC 14772 -1 (VRML 97) ) . The channelLocation values describe the direction and the absolute distance in meter (the absolute distance has been used because simply the user can generate a normalised vector, as usually used in channel configuration) . The channelDirection is a unit vector with the same coordinate system. E.g. channelLocation [0, 0, -1] relative to the listening sweet spot means centre speaker in one-meter distance. Three other examples are given in the three lines of table 2 :
Figure imgf000013_0001
The polarityPattern is an integer vector where the values are restricted to the values given in table 3. This is useful for example in case of Dolby ProLogic sound where the front channels have monopole pattern and the surround channel have dipole characteristic.
The polarityPattern can have values according to table 2
Figure imgf000013_0002
Table 1: polarityPattern association In an alternative embodiment of the invention, the additional AudioChannelConfig node 30 is not inserted. Instead, the functionality of this node is added to nodes of the type AudioMix 27, AudioSwitch 28 and AudioFX (not depicted) .
In an further alternative embodiment of the invention, the above values of the phaseGroup fields are additionally defined for the corresponding existing nodes AudioMix, AudioSwitch and AudioFX in the first version ISO/IEC 14496 of the MPEG-4 standard. This is a partial solution whereby the values for the phase groups are taken from above table 1 except the escape sequence. Higher values are reserved for private or future use. For example, channels having the phaseGroup 2 are identified as left/right front speakers.

Claims

Claims
1. Method for processing two or more initially decoded (21, 22, 23) audio signals received or replayed from a bit- stream, that each have a different number of channels and/or different channel configurations, and that are combined by mixing (27) and/or switching (28) before being presented (20) in a final channel configuration, wherein to each one of said initially decoded audio sig- nals a corresponding specific channel configuration information (ChannelConfig) is attached, characterised in that said mixing (27) and/or switching (28) is controlled such that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or following said switching is determined by related specific mixing and/or switching information (278) provided from a content provider or broadcaster, and in that to the combined data stream to be presented a correspondingly updated channel configuration information is attached (30) .
2. Method according to claim 1, wherein said bitstream has MPEG-4 format.
3. Apparatus for , and including: at least two audio data decoders (21, 22, 23) that decode audio data received or replayed from a bitstream; means (24 - 28) for processing the audio signals ini- tially decoded by said audio data decoders (21, 22, 23), wherein at least two of said decoded audio signals each have a different number of channels and/or a different channel configuration, and wherein said processing includes combination by mixing (27) and/or switching (28) ; - means (20) for presenting the combined audio signals in a final channel configuration, wherein to each one of said initially decoded audio signals a corresponding specific channel configuration information (ChannelConfig) is attached, wherein in said processing means (24 - 28) said mixing (27) and/or switching (28) is controlled such that in case of non-matching number of channels and/or types of channel configurations the number and/or configuration of the channels to be output following said mixing and/or following said switching is determined by related spe- cific mixing and/or switching information (278) provided from a content provider or broadcaster, and wherein to the combined data stream fed to said presenting means (20) a correspondingly updated channel configuration information is attached (30) .
Apparatus according to claim , wherein said bitstream has MPEG-4 format.
PCT/EP2003/013172 2002-12-02 2003-11-24 Method and apparatus for processing audio signals from a bitstream WO2004052052A2 (en)

Priority Applications (7)

Application Number Priority Date Filing Date Title
US10/536,539 US8082050B2 (en) 2002-12-02 2003-11-24 Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream
BR0316498-5A BR0316498A (en) 2002-12-02 2003-11-24 Method and apparatus for processing bitstream audio signals
BRPI0316498-5A BRPI0316498B1 (en) 2002-12-02 2003-11-24 METHOD AND APPARATUS FOR PROCESSING AUDIO SIGNS OF A BIT FLOW
JP2004556172A JP5031988B2 (en) 2002-12-02 2003-11-24 Method and apparatus for processing two or more audio signals
EP03780037A EP1568250B1 (en) 2002-12-02 2003-11-24 Method and apparatus for processing audio signals from a bitstream
AU2003288154A AU2003288154B2 (en) 2002-12-02 2003-11-24 Method and apparatus for processing audio signals from a bitstream
CA2508220A CA2508220C (en) 2002-12-02 2003-11-24 Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
EP02026779A EP1427252A1 (en) 2002-12-02 2002-12-02 Method and apparatus for processing audio signals from a bitstream
EP02026779.5 2002-12-02

Publications (2)

Publication Number Publication Date
WO2004052052A2 true WO2004052052A2 (en) 2004-06-17
WO2004052052A3 WO2004052052A3 (en) 2004-08-12

Family

ID=32309353

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/EP2003/013172 WO2004052052A2 (en) 2002-12-02 2003-11-24 Method and apparatus for processing audio signals from a bitstream

Country Status (9)

Country Link
US (1) US8082050B2 (en)
EP (2) EP1427252A1 (en)
JP (2) JP5031988B2 (en)
KR (1) KR101024749B1 (en)
CN (1) CN100525513C (en)
AU (1) AU2003288154B2 (en)
BR (2) BR0316498A (en)
CA (1) CA2508220C (en)
WO (1) WO2004052052A2 (en)

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100745689B1 (en) 2004-07-09 2007-08-03 한국전자통신연구원 Apparatus and Method for separating audio objects from the combined audio stream
JP2009510810A (en) * 2005-07-11 2009-03-12 エルジー エレクトロニクス インコーポレイティド Audio signal processing apparatus and method
JP2009526467A (en) * 2006-02-09 2009-07-16 エルジー エレクトロニクス インコーポレイティド Method and apparatus for encoding and decoding object-based audio signal

Families Citing this family (39)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
EP1568251B1 (en) * 2002-12-02 2007-01-24 Thomson Licensing Method for describing the composition of audio signals
JP2007157191A (en) * 2005-11-30 2007-06-21 Toshiba Corp Device and method for mixing voices
JP4193865B2 (en) * 2006-04-27 2008-12-10 ソニー株式会社 Digital signal switching device and switching method thereof
CN101490744B (en) * 2006-11-24 2013-07-17 Lg电子株式会社 Method and apparatus for encoding and decoding an audio signal
US20080201292A1 (en) * 2007-02-20 2008-08-21 Integrated Device Technology, Inc. Method and apparatus for preserving control information embedded in digital data
CN101675472B (en) * 2007-03-09 2012-06-20 Lg电子株式会社 A method and an apparatus for processing an audio signal
KR20080082917A (en) 2007-03-09 2008-09-12 엘지전자 주식회사 A method and an apparatus for processing an audio signal
WO2009001344A2 (en) * 2007-06-25 2008-12-31 Recollect Ltd. A recording system for salvaging information in retrospect
BRPI0816669A2 (en) 2007-09-06 2015-03-17 Lg Electronics Inc Method and apparatus for decoding an audio signal
WO2009093866A2 (en) 2008-01-23 2009-07-30 Lg Electronics Inc. A method and an apparatus for processing an audio signal
WO2009093867A2 (en) 2008-01-23 2009-07-30 Lg Electronics Inc. A method and an apparatus for processing audio signal
KR101024924B1 (en) * 2008-01-23 2011-03-31 엘지전자 주식회사 A method and an apparatus for processing an audio signal
KR101461685B1 (en) * 2008-03-31 2014-11-19 한국전자통신연구원 Method and apparatus for generating side information bitstream of multi object audio signal
KR101596504B1 (en) * 2008-04-23 2016-02-23 한국전자통신연구원 / method for generating and playing object-based audio contents and computer readable recordoing medium for recoding data having file format structure for object-based audio service
KR101171314B1 (en) * 2008-07-15 2012-08-10 엘지전자 주식회사 A method and an apparatus for processing an audio signal
WO2010008198A2 (en) * 2008-07-15 2010-01-21 Lg Electronics Inc. A method and an apparatus for processing an audio signal
TWI427619B (en) * 2008-07-21 2014-02-21 Realtek Semiconductor Corp Audio mixer and method thereof
US20100057471A1 (en) * 2008-08-26 2010-03-04 Hongwei Kong Method and system for processing audio signals via separate input and output processing paths
KR101600352B1 (en) * 2008-10-30 2016-03-07 삼성전자주식회사 / method and apparatus for encoding/decoding multichannel signal
US8504184B2 (en) * 2009-02-04 2013-08-06 Panasonic Corporation Combination device, telecommunication system, and combining method
KR101040086B1 (en) * 2009-05-20 2011-06-09 전자부품연구원 Method and apparatus for generating audio and method and apparatus for reproducing audio
US9154596B2 (en) * 2009-07-24 2015-10-06 Broadcom Corporation Method and system for audio system volume control
US8521316B2 (en) * 2010-03-31 2013-08-27 Apple Inc. Coordinated group musical experience
US8965545B2 (en) * 2010-09-30 2015-02-24 Google Inc. Progressive encoding of audio
US20120148075A1 (en) * 2010-12-08 2012-06-14 Creative Technology Ltd Method for optimizing reproduction of audio signals from an apparatus for audio reproduction
CN102547140A (en) * 2010-12-31 2012-07-04 新奥特（北京）视频技术有限公司 Method for supporting multimode audio import
US8842842B2 (en) 2011-02-01 2014-09-23 Apple Inc. Detection of audio channel configuration
MX2013010537A (en) * 2011-03-18 2014-03-21 Koninkl Philips Nv Audio encoder and decoder having a flexible configuration functionality.
EP2862168B1 (en) 2012-06-14 2017-08-09 Dolby International AB Smooth configuration switching for multichannel audio
TWI530941B (en) * 2013-04-03 2016-04-21 杜比實驗室特許公司 Methods and systems for interactive rendering of object based audio
EP2830045A1 (en) * 2013-07-22 2015-01-28 Fraunhofer-Gesellschaft zur Förderung der angewandten Forschung e.V. Concept for audio encoding and decoding for audio channels and audio objects
CN104053047B (en) * 2014-06-24 2018-04-10 深圳市九洲电器有限公司 A kind of audio output adjusting apparatus and method of adjustment
US9875751B2 (en) * 2014-07-31 2018-01-23 Dolby Laboratories Licensing Corporation Audio processing systems and methods
EP3799044B1 (en) * 2014-09-04 2023-12-20 Sony Group Corporation Transmission device, transmission method, reception device and reception method
CN105635893B (en) * 2014-10-31 2019-05-10 Tcl通力电子（惠州）有限公司 Terminal device and method for distributing sound channels thereof
CN107274919A (en) * 2016-04-08 2017-10-20 王泰来 Use the mixed high-fidelity dual-audio playing device and its player method for putting device of high-fidelity
JP6955029B2 (en) * 2017-01-10 2021-10-27 フラウンホッファー−ゲゼルシャフト ツァ フェルダールング デァ アンゲヴァンテン フォアシュンク エー．ファオ Audio Decoders, Audio Encoders, Decoded Audio Signal Feeding Methods, Encoded Audio Signal Feeding Methods, Audio Streams, Audio Stream Feeders, Audio Stream Feeders and Computer Programs Using Stream Identifiers
US10553224B2 (en) 2017-10-03 2020-02-04 Dolby Laboratories Licensing Corporation Method and system for inter-channel coding
US20200388292A1 (en) * 2019-06-10 2020-12-10 Google Llc Audio channel mixing

Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998055998A2 (en) 1997-06-03 1998-12-10 Koninklijke Philips Electronics N.V. Apparatus and method for reproducing a digital audio signal from a record carrier

Family Cites Families (52)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5594800A (en) * 1991-02-15 1997-01-14 Trifield Productions Limited Sound reproduction system having a matrix converter
JPH07162384A (en) 1993-12-06 1995-06-23 Mitsubishi Electric Corp Television receiver and output method for audio signal thereof
DE4409368A1 (en) * 1994-03-18 1995-09-21 Fraunhofer Ges Forschung Method for encoding multiple audio signals
JPH0831096A (en) * 1994-07-12 1996-02-02 Matsushita Electric Ind Co Ltd Audio data coding recorder and audio data decoding reproducing device
US5647008A (en) * 1995-02-22 1997-07-08 Aztech Systems Ltd. Method and apparatus for digital mixing of audio signals in multimedia platforms
JP2766466B2 (en) * 1995-08-02 1998-06-18 株式会社東芝 Audio system, reproduction method, recording medium and recording method on recording medium
US6259957B1 (en) * 1997-04-04 2001-07-10 Cirrus Logic, Inc. Circuits and methods for implementing audio Codecs and systems using the same
US7333863B1 (en) * 1997-05-05 2008-02-19 Warner Music Group, Inc. Recording and playback control system
US6298025B1 (en) * 1997-05-05 2001-10-02 Warner Music Group Inc. Recording and playback of multi-channel digital audio having different resolutions for different channels
US6141597A (en) * 1997-09-08 2000-10-31 Picturetel Corporation Audio processor
US6654931B1 (en) * 1998-01-27 2003-11-25 At&T Corp. Systems and methods for playing, browsing and interacting with MPEG-4 coded audio-visual objects
JPH11225390A (en) * 1998-02-04 1999-08-17 Matsushita Electric Ind Co Ltd Reproduction method for multi-channel data
US6119091A (en) * 1998-06-26 2000-09-12 Lsi Logic Corporation DVD audio decoder having a direct access PCM FIFO
JP3632891B2 (en) * 1998-09-07 2005-03-23 日本ビクター株式会社 Audio signal transmission method, audio disc, encoding device, and decoding device
JP2000148163A (en) * 1998-11-05 2000-05-26 Victor Co Of Japan Ltd Disc encode device and disc regenerating device
EP1021044A1 (en) * 1999-01-12 2000-07-19 Deutsche Thomson-Brandt Gmbh Method and apparatus for encoding or decoding audio or video frame data
US6466833B1 (en) * 1999-01-15 2002-10-15 Oak Technology, Inc. Method and apparatus for efficient memory use in digital audio applications
US6681077B1 (en) * 1999-04-02 2004-01-20 Matsushita Electric Industrial Co., Ltd. Optical disc, recording device and reproducing device
US6629001B1 (en) * 1999-09-15 2003-09-30 Intel Corporation Configurable controller for audio channels
US6931370B1 (en) * 1999-11-02 2005-08-16 Digital Theater Systems, Inc. System and method for providing interactive audio in a multi-channel audio environment
US6351733B1 (en) * 2000-03-02 2002-02-26 Hearing Enhancement Company, Llc Method and apparatus for accommodating primary content audio and secondary content remaining audio capability in the digital audio production process
JP3957251B2 (en) * 2000-03-02 2007-08-15 パイオニア株式会社 Audio information reproducing system, audio information reproducing apparatus, and audio information reproducing method
US7266501B2 (en) * 2000-03-02 2007-09-04 Akiba Electronics Institute Llc Method and apparatus for accommodating primary content audio and secondary content remaining audio capability in the digital audio production process
KR100359842B1 (en) * 2000-03-08 2002-11-07 엘지전자 주식회사 Method for expressing audio menu
EP1134724B1 (en) * 2000-03-17 2008-07-23 Sony France S.A. Real time audio spatialisation system with high level control
US20020016882A1 (en) * 2000-04-24 2002-02-07 Hiroshi Matsuuchi Digital device, data input-output control method, and data input-output control system
US6799208B1 (en) * 2000-05-02 2004-09-28 Microsoft Corporation Resource manager architecture
US7212872B1 (en) * 2000-05-10 2007-05-01 Dts, Inc. Discrete multichannel audio with a backward compatible mix
GB2366709A (en) * 2000-06-30 2002-03-13 Graeme Roy Smith Modular software definable pre-amplifier
US8495679B2 (en) * 2000-06-30 2013-07-23 Thomson Licensing Method and apparatus for delivery of television programs and targeted de-coupled advertising
JP2002044543A (en) * 2000-07-21 2002-02-08 Alpine Electronics Inc Digital broadcast receiver
US6757302B1 (en) * 2000-09-14 2004-06-29 Nvision, Inc. Channel status management for multichannel audio distribution
US20020124097A1 (en) * 2000-12-29 2002-09-05 Isely Larson J. Methods, systems and computer program products for zone based distribution of audio signals
JP4423790B2 (en) * 2001-01-11 2010-03-03 ソニー株式会社 Demonstration system, demonstration method via network
JP2002232375A (en) 2001-01-30 2002-08-16 Sony Corp Data transmitter, data receiver, method for transmitting data, method for receiving data and transmission system
US7689598B2 (en) * 2001-02-15 2010-03-30 International Business Machines Corporation Method and system for file system synchronization between a central site and a plurality of remote sites
US7107110B2 (en) * 2001-03-05 2006-09-12 Microsoft Corporation Audio buffers with audio effects
US6804565B2 (en) * 2001-05-07 2004-10-12 Harman International Industries, Incorporated Data-driven software architecture for digital sound processing and equalization
US7216288B2 (en) * 2001-06-27 2007-05-08 International Business Machines Corporation Dynamic scene description emulation for playback of audio/visual streams on a scene description based playback system
US7203692B2 (en) * 2001-07-16 2007-04-10 Sony Corporation Transcoding between content data and description data
US20030021429A1 (en) * 2001-07-30 2003-01-30 Ratcliff David D. On-the-fly configurable audio processing machine
DE10140149A1 (en) * 2001-08-16 2003-02-27 Philips Corp Intellectual Pty Procedure for handling conflicts of use in digital networks
ES2203294B1 (en) * 2001-09-28 2005-06-01 Global Standards, S.L. SYSTEM OF REMOTELY CONFIGURABLE RADIOPHONICS AUDIO RECEIVING AND LOYALING SYSTEMS AND DEVICES.
US20030078687A1 (en) * 2001-10-15 2003-04-24 Du Breuil Thomas Lemaigre Method and system for automatically configuring an audio environment
US7058189B1 (en) * 2001-12-14 2006-06-06 Pixel Instruments Corp. Audio monitoring and conversion apparatus and method
US20030177279A1 (en) * 2002-02-08 2003-09-18 Evans James C. Creation of middleware adapters from paradigms
US20030156108A1 (en) * 2002-02-20 2003-08-21 Anthony Vetro Consistent digital item adaptation
US7073193B2 (en) * 2002-04-16 2006-07-04 Microsoft Corporation Media content descriptions
US7072726B2 (en) * 2002-06-19 2006-07-04 Microsoft Corporation Converting M channels of digital audio data into N channels of digital audio data
US8060225B2 (en) * 2002-07-31 2011-11-15 Hewlett-Packard Development Company, L. P. Digital audio device
US7533210B2 (en) * 2002-10-24 2009-05-12 Sun Microsystems, Inc. Virtual communication interfaces for a micro-controller
US20040111677A1 (en) * 2002-12-04 2004-06-10 International Business Machines Corporation Efficient means for creating MPEG-4 intermedia format from MPEG-4 textual representation

Patent Citations (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO1998055998A2 (en) 1997-06-03 1998-12-10 Koninklijke Philips Electronics N.V. Apparatus and method for reproducing a digital audio signal from a record carrier

Cited By (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
KR100745689B1 (en) 2004-07-09 2007-08-03 한국전자통신연구원 Apparatus and Method for separating audio objects from the combined audio stream
JP2009510810A (en) * 2005-07-11 2009-03-12 エルジー エレクトロニクス インコーポレイティド Audio signal processing apparatus and method
JP2009526467A (en) * 2006-02-09 2009-07-16 エルジー エレクトロニクス インコーポレイティド Method and apparatus for encoding and decoding object-based audio signal

Also Published As

Publication number Publication date
EP1427252A1 (en) 2004-06-09
JP5346051B2 (en) 2013-11-20
CA2508220A1 (en) 2004-06-17
AU2003288154A1 (en) 2004-06-23
CN1711800A (en) 2005-12-21
CA2508220C (en) 2013-02-19
EP1568250B1 (en) 2013-01-09
KR101024749B1 (en) 2011-03-24
WO2004052052A3 (en) 2004-08-12
KR20050085262A (en) 2005-08-29
EP1568250A2 (en) 2005-08-31
US8082050B2 (en) 2011-12-20
AU2003288154B2 (en) 2008-08-07
CN100525513C (en) 2009-08-05
JP2011150358A (en) 2011-08-04
JP2006508592A (en) 2006-03-09
BRPI0316498B1 (en) 2018-01-23
BR0316498A (en) 2005-10-11
JP5031988B2 (en) 2012-09-26
US20060174267A1 (en) 2006-08-03

Similar Documents

Publication Publication Date Title
US8082050B2 (en) Method and apparatus for processing two or more initially decoded audio signals received or replayed from a bitstream
RU2741738C1 (en) System, method and permanent machine-readable data medium for generation, coding and presentation of adaptive audio signal data
EP2805326B1 (en) Spatial audio rendering and encoding
JP3563109B2 (en) Method for obtaining a multi-channel decoder matrix
US20060167695A1 (en) Method for describing the composition of audio signals
CN1557111A (en) Method and apparatus for multichannel logic matrix decoding
Riedmiller et al. Delivering scalable audio experiences using AC-4
US5394472A (en) Monaural to stereo sound translation process and apparatus
Schmidt et al. New and advanced features for audio presentation in the MPEG-4 standard
Eargle et al. Multichannel Stereo

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 2003780037

Country of ref document: EP

WWE Wipo information: entry into national phase

Ref document number: 1949/DELNP/2005

Country of ref document: IN

WWE Wipo information: entry into national phase

Ref document number: 20038A30907

Country of ref document: CN

ENP Entry into the national phase

Ref document number: 2006174267

Country of ref document: US

Kind code of ref document: A1

WWE Wipo information: entry into national phase

Ref document number: 10536539

Country of ref document: US

WWE Wipo information: entry into national phase

Ref document number: 1020057009899

Country of ref document: KR

Ref document number: 2004556172

Country of ref document: JP

Ref document number: 2508220

Country of ref document: CA

WWE Wipo information: entry into national phase

Ref document number: 2003288154

Country of ref document: AU

WWP Wipo information: published in national office

Ref document number: 1020057009899

Country of ref document: KR

WWP Wipo information: published in national office

Ref document number: 2003780037

Country of ref document: EP

ENP Entry into the national phase

Ref document number: PI0316498

Country of ref document: BR

WWP Wipo information: published in national office

Ref document number: 10536539

Country of ref document: US