WO2016150320A1

WO2016150320A1 - Method and device for sending audio

Info

Publication number: WO2016150320A1
Application number: PCT/CN2016/076423
Authority: WO
Inventors: 曹长刚; 李勇强
Original assignee: 中兴通讯股份有限公司
Priority date: 2015-03-25
Filing date: 2016-03-15
Publication date: 2016-09-29
Also published as: CN106162038A

Abstract

A method and device for sending audio are disclosed in the present invention. The method comprises: obtaining the sending status signal of each path of audio and the sending status signal of each path of video; establishing the mapping relation between each path of the video and the audio sent simultaneously with the video; when sending the video, controlling the sending status of the audio according to the mapping relation, and sending one or more paths of the audio corresponding to the path of the video. In the present invention, by establishing the mapping relation between video sending and audio sending, only one or more paths of the audio corresponding to the path of the video are sent according to the mapping relation when sending the video, so that audio data is sent according to remote requirements, conference effect is improved, and thus user experience is greatly improved.

Description

Audio transmitting method and device

Technical field

The present invention relates to the field of video conference technologies, and in particular, to an audio transmission method and apparatus.

Background technique

Conference TV is a multimedia communication method that uses video technology and equipment to hold real-time, two-way and interactive video conferences in remote remote locations through a modern communication network.

Conference TV often has multiple audio and video input and output and multi-channel audio and video codec. Multi-channel audio is often sent and played with the video after mixing. Sometimes the video channel does not need all the sound playback in the conference, only one of them is needed. Sound or hope to choose a few sounds to achieve better meeting results. The prior art has the following scenarios:

Example 1: A terminal has two audio inputs and two video outputs. After the call is over, the two channels will reach the far end after mixing, and the video will reach the far end. If both channels of audio input have sound, the far end will hear two kinds of sounds; at this time, the far end only wants to hear one of them. The sound of the second road is heard after the second video is sent.

Example 2: The extended audio is N way, and the video is two way. After the call is over, the multi-channel sound will reach the far end after the sound is mixed, and the video will reach the far end. If the N-channel audio input is sounded, the far-end will hear N kinds of sounds; at this time, the far-end only wants to hear the n-way. (n<N) sound, after the second video is sent, the sound of the remaining Nn roads is heard.

Example 3: The scenario where the extended audio is N and the video is M. After the call, the N channel will reach the far end after the sound is mixed, and the video will reach the far end. If the N channel audio input has sound, then the far end will hear N kinds of sounds; at this time, the far end only wants to hear the n way. (n<N) sound, after listening to the mth channel video, you can hear the m channel.

Summary of the invention

The technical problem to be solved by the embodiments of the present invention is to provide an audio transmission method and apparatus, which are used to solve the problem that the prior art audio transmission cannot be transmitted according to remote requirements.

To solve the above technical problem, an embodiment of the present invention provides an audio sending method, including:

Acquiring a transmission status signal of each channel of audio and a transmission status signal of each channel of video;

Establish a mapping relationship between each video and the audio it transmits simultaneously;

When the video is transmitted, according to the mapping relationship, the transmission state of the audio is controlled, and one or more audio corresponding to the video of the channel is transmitted.

In the embodiment of the present invention, the audio sending status signal includes: the audio is in a transmitting state or an untransmitted state; The video transmission status signal includes: the video is in a transmitting state or an untransmitted state.

In the embodiment of the present invention, the sending status of the audio is controlled according to the mapping relationship, which specifically includes:

When the audio corresponding to the video of the channel is in a transmitting state, the audio data of the channel is kept transmitted;

When the audio corresponding to the video of the channel is not sent, the audio data of the channel is started to be sent;

When the video of the road stops transmitting, the audio data corresponding to the video of the channel is stopped.

In the embodiment of the present invention, a mapping relationship between each video and audio that is simultaneously transmitted is established, as follows:

The N-channel video transmission corresponds to the M-channel audio transmission, where N is a positive integer and M is a positive integer.

In the embodiment of the present invention, sending one or more audio corresponding to the video of the road includes:

Send one or more audio corresponding to the video of the road directly; or,

After adding one or more audio corresponding to the video to the mixing and/or encoding, the transmission is performed.

In another aspect, the present invention also provides an audio transmitting apparatus, including:

a video unit, configured to obtain a transmission status signal of each video;

a mapping unit configured to establish a mapping relationship between each video and audio that is simultaneously transmitted thereto;

The audio unit is configured to acquire a transmission status signal of each audio, and, when the video is transmitted, control the transmission status of the audio according to the mapping relationship, and send one or more audio corresponding to the video of the channel.

In the embodiment of the present invention, the audio sending status signal includes: the audio is in a transmitting state or an untransmitted state; and the video sending status signal includes: the video is in a transmitting state or an untransmitted state.

In the embodiment of the present invention, the audio unit is further configured to:

When the audio corresponding to the video of the channel is in a transmitting state, the audio data of the channel is kept to continue to be sent;

When the audio corresponding to the video of the channel is in an unsent state, the transmission of the audio data of the channel is started;

In the embodiment of the present invention, the mapping unit is further configured to:

Establish a mapping relationship between each video and the audio it sends at the same time, as follows:

Send one or more audio corresponding to the video of the road directly; or,

In the embodiment of the present invention, a computer storage medium is further provided, and the computer storage medium may store an execution instruction for executing the audio sending method in the foregoing embodiment.

The beneficial effects of the embodiments of the present invention are as follows:

In the embodiment of the present invention, a mapping relationship between video transmission and audio transmission is established. When the video is sent, according to the mapping relationship, one or more audio corresponding to the video is sent, so that the remote demand can be implemented. The audio data is transmitted, which improves the conference effect and greatly improves the user experience.

DRAWINGS

1 is a flowchart of an audio sending method according to an embodiment of the present invention;

2a is a schematic diagram of a one-to-one configuration mapping relationship between video transmission and audio transmission in an embodiment of the present invention;

2b is a schematic diagram of a mapping relationship between video transmission and audio transmission in an embodiment of the present invention;

3 is a schematic structural diagram of an audio transmitting apparatus according to an embodiment of the present invention;

4 is a schematic structural diagram of an audio transmitting device application and a video conference in an embodiment of the present invention.

detailed description

The invention will be further described in detail below with reference to the drawings and embodiments. It is understood that the specific embodiments described herein are merely illustrative of the invention and are not intended to limit the invention.

As shown in FIG. 1 , an embodiment of the present invention relates to an audio sending method, including:

Step S101, acquiring a transmission status signal of each channel of audio and a transmission status signal of each channel of video;

In this step, the audio sending status signal includes: the audio is in a transmitting state or an untransmitted state.

The audio transmission status signal can be directly obtained, or the audio transmission status signal can be obtained through the audio detector; if there is multiple audio, it is necessary to separately acquire the transmission status signal of each audio.

The video transmission status signal includes: the video is in a transmitting state or an untransmitted state.

The video transmission status signal can be directly obtained, or the video transmission status signal is acquired by the video detector; if multiple channels of video are included, the transmission status signals of each channel should be separately obtained.

Step S102, establishing a mapping relationship between each video and audio simultaneously transmitted thereto;

In this step, the mapping relationship between audio sending and video sending can be configured through a visual interface; or, by invisible matching A fixed mapping relationship and a variable mapping relationship between audio transmission and video transmission. When a video is associated with one or more audio channels, a correspondence is established between the video and the audio. When the video is sent, the audio corresponding to the video needs to be sent together.

The mapping between the video transmission and the audio transmission may be configured as follows: N-channel video transmission corresponds to M-channel audio transmission, where N is a positive integer and M is a positive integer.

When N=1, M=1, that is, there is a one-to-one relationship between video transmission and audio transmission. As shown in FIG. 2a, the first channel video maps the first channel audio, and the second channel video map the second channel audio. X-channel video maps X-channel audio.

Of course, you can also flexibly set it according to the actual situation. For example, N=1, M>1, that is, a one-to-many relationship between video transmission and audio transmission; N>1, M=1, that is, a many-to-one relationship between video transmission and audio transmission; A combination of several situations. As shown in FIG. 2b, the first channel video maps the first channel audio, the second channel video maps the second channel, the third channel, the fourth channel audio, and the third channel to the Yth channel video maps the Y channel audio. It should be noted that the mapping relationship between establishing audio transmission and video transmission is not limited to the above mapping relationship.

Step S103, when the video is sent, according to the mapping relationship, control the transmission state of the audio, and send one or more audio corresponding to the video of the channel.

In this step, according to the obtained audio transmission status signal and the video transmission status signal, and the established mapping relationship, an audio transmission control command is obtained.

First, according to the video transmission status signal, it is determined which video needs to be transmitted, that is, the video transmission status signal is a transmission status of the video that needs to be transmitted.

Secondly, according to the previously established mapping relationship, it is determined which way, or which way, the audio corresponding to the video of the road is. Then, the audio transmission status signal of the several channels of audio is viewed. If it is the transmission status, the audio transmission control command indicates that the audio data is kept transmitted; if it is not, the audio transmission control command indicates that the transmission is started. Audio data; in addition, when the video stops to relax, it stops transmitting one or more audio data corresponding to the video. When one channel of audio is in a mapping relationship, corresponding to a video being transmitted, and corresponding to a video that stops transmitting at the same time, the audio of the channel should be in a transmitting state, that is, the audio data of the channel is kept transmitted. Taking FIG. 2b as an example, when the first and second channels are transmitted, according to the mapping relationship, the audio transmission control command is: the first to fourth audio transmissions, and the remaining Y-4 channels are idle (forbidden to transmit).

When transmitting audio data specifically, one of the following methods may be used, or a reasonable combination thereof:

1. Sending each channel of audio data instructed to be sent in the audio transmission control command, and the audio that does not need to be sent (not indicating transmission or indicating prohibition of transmission) is not sent out.

2. Adding a mix to each audio data sent in the audio transmission control command, and transmitting the mixed audio.

3. Add encoding to each audio data sent in the audio transmission control command, and send the encoded audio.

In an embodiment of the present invention, a computer storage medium is also provided, and the computer storage medium may be stored and executed. An instruction for executing the audio transmitting method in the above embodiment.

As shown in FIG. 3, an embodiment of the present invention further relates to an audio sending apparatus that implements the foregoing method, including:

a video unit, configured to obtain a transmission status signal of each video;

The audio transmission status signal includes: the audio is in a transmitting state or an untransmitted state; and the video sending status signal includes: the video is in a transmitting state or an untransmitted state.

The audio unit is also set to:

The mapping unit is also set to:

The audio unit is also set to:

Send one or more audio corresponding to the video of the road directly; or,

FIG. 4 is a schematic structural diagram of the device application and video conference, and the device can be used for audio transmission control in a video conference, thereby improving conference quality.

It can be seen from the foregoing embodiment that the embodiment of the present invention establishes a mapping relationship between video transmission and audio transmission; when the video is sent, according to the mapping relationship, one or more audio corresponding to the video of the channel is sent, so that It can realize the transmission of audio data according to the remote demand, which improves the conference effect and greatly improves the user experience.

While the preferred embodiments of the present invention have been disclosed for purposes of illustration, those skilled in the art will recognize that various modifications, additions and substitutions are possible, and the scope of the invention should not be limited to the embodiments described above.

Industrial applicability

The foregoing technical solution provided by the embodiment of the present invention establishes a mapping relationship between video transmission and audio transmission; when the video is sent, according to the mapping relationship, one or more audio corresponding to the video of the channel is sent, so that Achieve The audio data is sent according to the remote demand, which improves the conference effect.

Claims

An audio transmission method includes:

Acquiring a transmission status signal of each channel of audio and a transmission status signal of each channel of video;

Establish a mapping relationship between each video and the audio it transmits simultaneously;

When the video is transmitted, according to the mapping relationship, the transmission state of the audio is controlled, and one or more audio corresponding to the video of the channel is transmitted.
The audio transmitting method according to claim 1, wherein the audio transmission status signal comprises: the audio is in a transmitting state or an untransmitted state; and the video transmitting state signal comprises: the video is in a transmitting state or an untransmitted state.
The audio transmitting method according to claim 2, wherein controlling the transmission state of the audio according to the mapping relationship comprises:

When the audio corresponding to the video of the channel is in a transmitting state, the audio data of the channel is kept transmitted;

When the audio corresponding to the video of the channel is not sent, the audio data of the channel is started to be sent;

When the video of the road stops transmitting, the audio data corresponding to the video of the channel is stopped.
The audio transmitting method according to any one of claims 1 to 3, wherein a mapping relationship between each video and audio simultaneously transmitted thereto is established, as follows:

The N-channel video transmission corresponds to the M-channel audio transmission, where N is a positive integer and M is a positive integer.
The audio transmitting method according to any one of claims 1 to 3, wherein transmitting one or more audio corresponding to the video of the road comprises:

Send one or more audio corresponding to the video of the road directly; or,

After adding one or more audio corresponding to the video to the mixing and/or encoding, the transmission is performed.
An audio transmitting device includes:

a video unit, configured to obtain a transmission status signal of each video;

a mapping unit configured to establish a mapping relationship between each video and audio that is simultaneously transmitted thereto;

The audio unit is configured to acquire a transmission status signal of each audio, and, when the video is transmitted, control the transmission status of the audio according to the mapping relationship, and send one or more audio corresponding to the video of the channel.
The audio transmitting device of claim 6, wherein the audio transmission status signal comprises: the audio is in a transmitting state or an untransmitted state; and the video transmitting state signal comprises: the video is in a transmitting state or an untransmitted state.
The audio transmitting device of claim 7, wherein the audio unit is further configured to:

When the audio corresponding to the video of the channel is in a transmitting state, the audio data of the channel is kept to continue to be sent;

When the audio corresponding to the video of the channel is in an unsent state, the transmission of the audio data of the channel is started;

When the video of the road stops transmitting, the audio data corresponding to the video of the channel is stopped.
The audio transmitting device according to any one of claims 6 to 8, wherein the mapping unit is further configured to:

Establish a mapping relationship between each video and the audio it sends at the same time, as follows:

The N-channel video transmission corresponds to the M-channel audio transmission, where N is a positive integer and M is a positive integer.
The audio transmitting device according to any one of claims 6 to 8, wherein the audio unit is further configured to:

Send one or more audio corresponding to the video of the road directly; or,

After adding one or more audio corresponding to the video to the mixing and/or encoding, the transmission is performed.