CN100452874C - Method for broadcastin stream media caption and its stream media player - Google Patents

Method for broadcastin stream media caption and its stream media player Download PDF

Info

Publication number
CN100452874C
CN100452874C CNB2005100345489A CN200510034548A CN100452874C CN 100452874 C CN100452874 C CN 100452874C CN B2005100345489 A CNB2005100345489 A CN B2005100345489A CN 200510034548 A CN200510034548 A CN 200510034548A CN 100452874 C CN100452874 C CN 100452874C
Authority
CN
China
Prior art keywords
stream
media
caption
timestamp
server
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Active
Application number
CNB2005100345489A
Other languages
Chinese (zh)
Other versions
CN1859565A (en
Inventor
伍海君
王宇
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
Tencent Technology Shenzhen Co Ltd
Original Assignee
Tencent Technology Shenzhen Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by Tencent Technology Shenzhen Co Ltd filed Critical Tencent Technology Shenzhen Co Ltd
Priority to CNB2005100345489A priority Critical patent/CN100452874C/en
Publication of CN1859565A publication Critical patent/CN1859565A/en
Application granted granted Critical
Publication of CN100452874C publication Critical patent/CN100452874C/en
Active legal-status Critical Current
Anticipated expiration legal-status Critical

Links

Images

Abstract

The present invention discloses a method for broadcasting stream media captions for solving the existing problems of poor flexibility and poor dynamic controllability when the prior art simultaneously provides stream media and caption services. The method for broadcasting stream media captions respectively requests a stream media service and a caption service which corresponds to stream media towards a stream media server and a caption server which are respectively used for transmitting media streams and caption streams towards the stream media server. The stream media server is used for judging whether or not time stamps of the caption streams and time stamps of the media streams are matched. At least the caption streams which are matched with the time stamps are converted into video streams which are synchronously played with the media streams.

Description

The method of broadcastin stream media caption and DST PLAYER thereof
Technical field
The present invention relates to stream media technology, relate in particular to the method and the DST PLAYER of broadcastin stream media caption.
Background technology
Streaming Media (Streaming Media) technology is a kind of emerging network transmission technology, be used for sequentially transmitting in real time on the internet and playing the consecutive hours base data stream of content of multimedia such as video/audio, stream media technology comprises fields such as stream medium data collection, video/audio encoding and decoding, storage, transmission, broadcast.Upload playing multimedia information at network and mainly contain dual mode: download and stream transmission.Downloading mode is traditional transmission means, refers to before playing extremely local by the user's download multimedia file.Stream transmission then provides multimedia messages to the user by server in real time, when adopting this mode, the user needn't wait until that whole file is all downloaded and finish, and only need can play through the startup time delay of seconds or tens of seconds, afterwards, the client edge joint is received the broadcast of data limit.
At present, stream media technology is widely used in the information service of the Internets such as multimedia news briefing, online demonstration, online live, the web advertisement, ecommerce, video request program, long-distance education, real-time video meeting and instant messaging.For abundanter streaming media service is provided to the user, generally when the user provides streaming media service, also providing captions service, prior art to provide the captions service that following two kinds of schemes are arranged:
1, streaming media server end solution, this scheme is made caption stream simultaneously when making Media Stream, be stored as the staggered in chronological order media stream file of Media Stream and caption stream again; During broadcast, by client player direct decoding Media Stream and caption stream.
The shortcoming of this scheme be caption stream and Media Stream stored interleaved in file, all users are provided identical caption stream, can not send different caption stream at different users, its flexibility is relatively poor, and it is also inconvenient to revise caption stream.
2, DST PLAYER client solution, this scheme are made the subtitle stream files with corresponding Media Stream coupling in advance, and this document is kept at client terminal local, show corresponding subtitle in the time of the client terminal playing media stream file.
The shortcoming of this scheme is that the caption stream content is not controlled by server end, and caption stream do not control by Streaming Media supplier yet, can not upgrade in time for the captions service of some on-the-spot broadcasting class Media Streams, therefore, its flexibility and dynamic poor controllability.
Summary of the invention
The invention provides a kind of method and DST PLAYER of broadcastin stream media caption, to solve the problem that has flexibility and dynamic poor controllability when prior art provides Streaming Media and captions service at the same time.
A kind of method that transmits stream media caption, this method comprises the steps:
Ask the captions service of streaming media service and this Streaming Media correspondence respectively to streaming media server and subtitle server;
Described streaming media server and subtitle server send Media Stream and caption stream to DST PLAYER respectively;
DST PLAYER is a reference value with the difference of the timestamp of the timestamp of first Media Stream sample and first caption stream sample, difference according to the timestamp of current caption stream sample and current media stream sample timestamp judges that with the difference and the preset threshold of described reference value current caption stream timestamp and current media flow timestamp and whether mate, and the caption stream of mating to major general's timestamp is converted to video flowing and described Media Stream synchronous playing.
Wherein:
Earlier to streaming media server request streaming media service, and serve to subtitle server request caption stream again after the replying of streaming media server obtaining.
Described streaming media server and/or subtitle server also require certifying signature after the request of receiving, and send Streaming Media and/or caption stream at the signature verification success backward current media player that the requesting party is provided.
When judgement time stabs coupling, if the difference of the timestamp of the timestamp of current media sample and current caption stream sample and the difference of described reference value are not more than preset threshold, then determine described current media stream timestamp and current caption stream timestamp coupling, otherwise determine that timestamp does not match.
If include video flowing in the described Streaming Media, then from Streaming Media, isolate video flowing and with the synthetic new video flowing of institute caption stream after play.
The present invention is in the process of media stream, with video flowing in the Media Stream and the synthetic new dynamically video flowing broadcast of caption stream, thereby when providing streaming media service to IM user, corresponding captions service can be provided flexibly, and this captions can be corresponding video dialogue, audio frequency captions, advertisement caption, message captions etc.; Captions service is in the present invention provided by server end, and its dynamic controllability is good, can upgrade in time as required.Adopt the present invention not only can satisfy different business demands, and can be used as a kind of value-added service for the streaming media service merchant increase income the source, provide abundanter streaming media service for the user.
Description of drawings
Fig. 1 is for realizing network architecture schematic diagram of the present invention;
Fig. 2 is the schematic flow sheet of Media Stream and caption stream service;
Fig. 3 A is the storage format schematic diagram of Media Stream;
Fig. 3 B is a caption stream storage format schematic diagram;
Fig. 4 is the DST PLAYER structural representation;
Fig. 5 is the flow chart of Marquee component processing caption stream.
Embodiment
In order to satisfy the different demands of information services such as multimedia news briefing, online demonstration, online live, the web advertisement, ecommerce, video request program, long-distance education, real-time video meeting and instant messaging to the Streaming Media caption technology, improve its flexibility, the present invention controls caption stream by subtitle server, when DST PLAYER request streaming media server provides streaming media service, to the captions service of this Streaming Media correspondence of subtitle server request; Stabbed match time after DST PLAYER received Media Stream that streaming media server and subtitle server send and caption stream, when the caption stream timestamp mates with the Media Stream timestamp, this caption stream is converted to video flowing and described Media Stream synchronous playing.
Be example mainly below with the instant messaging service, in conjunction with the accompanying drawings to realizing that the present invention is elaborated:
As shown in Figure 1, realize that instant network of the present invention system comprises instant communication user client (IMClient) 400 (subscription client is a plurality of), instant communication server (IM Server) 100, streaming media server 200 and subtitle server 300.Wherein: instant communication server 100 is in charge of the user and login authenticates to instant communication user (IM User), and the user is provided signature.Streaming media server 200 provides streaming media service to the user, and the user of access stream media server is authenticated.Subtitle server 300 provides the captions service to the user, and the user of visit subtitle server is authenticated.
Consult shown in Figure 2ly, have DST PLAYER 500 at instant communication client, this DST PLAYER 500 comprises media flow processing unit 510, synthesis unit 520 and broadcast unit 530.Media flow processing unit 510 receives the decode the Media Stream that streaming media server sends by network, synthesis unit 520 synthesizes new Media Stream with the Media Stream and the subtitle server 300 of media flow processing unit 510 outputs by the caption stream that network sends, and broadcast unit 530 is play the Media Stream of synthesis units 520 outputs.
In the DST PLAYER 500, except that synthesis unit 520, media flow processing unit 510 and broadcast unit 530 can be the unit among the Windows Media Player that installs on the Windows operating system.
Consult shown in Fig. 3 A, the storage format of Media Stream on streaming media server 200 is consistent with common streaming media server Media Stream saving format.
Consult shown in Fig. 3 B, on subtitle server 300, in expectation and the Media Stream captions that occur simultaneously of certain time point then stamp with this Media Stream in identical timestamp, show synchronously with assurance streaming media playing and caption stream.Caption stream on the subtitle server 300 adopts the lossless compression-encoding algorithm to encode, as the LZ77 algorithm.
Consult shown in Figure 4ly, media flow processing unit 510 comprises: reception/Buffer Unit 511, audio/video Media Stream separation assembly 512, audio decoder assembly 513 and video decode assembly 514.The Streaming Media that reception/Buffer Unit 511 receives and buffer memory sends from streaming media server 200; Audio/video Media Stream separation assembly 512 will receive/and the Media Stream of Buffer Unit 511 outputs is separated into audio stream and video flowing, and outputs to audio decoder assembly 513 and video decode assembly 514 respectively; 513 pairs of audio streams of audio decoder assembly are decoded, and 514 pairs of video flowings of video decode assembly are decoded.
Synthesis unit 520 comprises: captions reception/Buffer Unit 521, caption decoding assembly 522 and video/captions synthesize assembly 523.Captions reception/Buffer Unit 521 receives the caption stream of being sent by subtitle server 300, and the caption stream that receives is kept in the local buffer queue by caption stream time samples sequencing; The captions of the coding flow data of 522 pairs of captions reception/Buffer Units of caption decoding assembly, 521 outputs, adopt corresponding decoding algorithm to decode, and decoded data flow write the captions buffer culture, as, caption stream on the subtitle server 300 adopts the LZ77 algorithm coding, and 522 of caption decoding assemblies adopt the LZ77 decoding algorithm to decode.Both used the decoding algorithm decoding corresponding with the caption stream coding.The synthetic assembly 523 of video/captions is with the video flowing of video decode assembly 514 outputs and the synthetic new video flowing and the output of caption stream of caption decoding assembly 522 outputs.
Broadcast unit 530 comprises voice playing assembly 531 and video playback assembly 532, and voice playing assembly 531 is used for the audio stream of audio plays decode component 513 outputs, and video playback assembly 532 is used for the video flowing of synthetic assembly 523 outputs of displaying video/captions.
In order to make caption stream and corresponding Media Stream synchronous playing, the timestamp of caption stream must with the timestamp coupling (timestamp that Media Stream and caption stream perhaps are described must be consistent) of corresponding Media Stream.When whether DST PLAYER 500 mates at the timestamp of determining caption stream and Media Stream, difference with the timestamp of the timestamp of first Media Stream sample and first caption stream sample is a reference value, if the difference of the timestamp of current caption stream sample and current media stream sample timestamp and the difference of described reference value are not more than preset threshold, then determine described current media stream timestamp and current caption stream timestamp coupling.As: threshold setting is 2, and the timestamp of first media sample of Media Stream is 10, and the timestamp of first sample of caption stream is 110, and then reference value is 110-10=100.If after 5 seconds, the timestamp of current media stream is 10+5=15, the timestamp of the caption stream sample that receive this moment is 116, the difference 101 (116-15=101) of the timestamp of then current caption stream sample and current media stream sample timestamp is 1 with the difference of reference value 100, this difference 1 is less than threshold value 2 at this moment, and 500 definite caption stream timestamps of DST PLAYER and Streaming Media timestamp mate.
Consult shown in Figure 5ly, the process of broadcastin stream media caption is as follows:
Step 10: instant communication user A is at first to streaming media server 200 application streaming media services (identifying this Streaming Media is C), and after receiving the replying of streaming media server 200, communication user A is again to the captions service of subtitle server 300 application Media Stream C correspondences.Whether streaming media server need authentication to having comprised in the replying of instant communication user A, whether information such as caption stream service is provided.
Step 20: streaming media server 200 and subtitle server 300 check that respectively the back affirmation can be this new user streaming media service and captions service are provided, and require user A that signature is provided.
Step 30: user A obtains the signature that is used for access stream media server 200 and subtitle server 300 to instant communication server 100, instant communication server 100 returns the signature S1 of an addressable streaming media server and the signature S2 of an addressable subtitle server, sends signature to streaming media server 200 and subtitle server 300 by the user.
Step 40: streaming media server 200 and subtitle server 300 be authentication signature S1 and signature S2 respectively, if two signatures are all by authenticating, then streaming media server 200 and subtitle server 300 send Media Stream C and corresponding caption stream to user A respectively.If by authentication, then server can not provide service to user A to signature.
Step 50: instant communication user A client (IM Client) goes up DST PLAYER 500 receiving medias stream C and the corresponding caption stream that starts, by media flow processing unit 510 decode media stream C and isolate audio stream and video flowing, after synthesis unit 520 receives video flowing and decoded captions service flow, judge whether the timestamp of video flowing and the timestamp of caption stream mate, if coupling, then with this video flowing and the synthetic new video flowing of caption stream, the audio stream of broadcast unit 530 playing media stream processing units 510 outputs and the video flowing of synthesis unit 520 outputs, thus the caption stream that reaches Media Stream and correspondence is play together frequently.If do not match, then this caption stream of buffer memory if the absolute difference of the absolute difference of this caption stream timestamp and current media stream timestamp thinks then that greater than limit value this captions sample is invalid, abandons this sample.
In media flow processing unit 510, video decode assembly 514 with the decoding video stream in the Media Stream after, be transferred to the synthetic assembly 523 of video/captions in the synthesis unit 520 with the form of bitmap (Bitmap), will show that the bitmap dot matrix of captions dot matrix corresponding position on bitmap replaces to the captions color during the synthetic new frame of video of the synthetic assembly of video/captions 523, it is synthetic that the dot matrix of handling all characters that present frame will show is promptly finished captions, the video of a frame.
If do not comprise video flowing in the above-mentioned Media Stream audio stream is not only arranged promptly, the form that the synthetic assembly 523 of video/captions changes into video flowing separately with caption stream sends to video display module 532 and shows.
Certainly, streaming media server 200 and subtitle server 300 also may not need the user that signature is provided and service directly is provided, and promptly do not require signature in above-mentioned steps 20, step 30 and step 40, obtain signature and signature authentication process.
The realization that the realization of the present invention on multimedia news briefing, online demonstration, online live, the web advertisement, ecommerce, video request program, long-distance education and real-time video conference service served with above-mentioned instant messaging does not in like manner repeat them here.
Obviously, those skilled in the art can carry out various changes and modification to the present invention and not break away from the spirit and scope of the present invention.Like this, if of the present invention these are revised and modification belongs within the scope of claim of the present invention and equivalent technologies thereof, then the present invention also is intended to comprise these changes and modification interior.

Claims (7)

1, a kind of method of broadcastin stream media caption is characterized in that comprising the steps:
Ask the captions service of streaming media service and this Streaming Media correspondence respectively to streaming media server and subtitle server;
Described streaming media server and subtitle server send Media Stream and caption stream to DST PLAYER respectively;
DST PLAYER is a reference value with the difference of the timestamp of the timestamp of first Media Stream sample and first caption stream sample, difference according to the timestamp of current caption stream sample and current media stream sample timestamp judges that with the difference and the preset threshold of described reference value current caption stream timestamp and current media flow timestamp and whether mate, and the caption stream of mating to major general's timestamp is converted to video flowing and described Media Stream synchronous playing.
2, the method for claim 1 is characterized in that, earlier to streaming media server request streaming media service, and serves to subtitle server request caption stream after the replying of streaming media server obtaining again.
3, the method for claim 1, it is characterized in that, described streaming media server and/or subtitle server also require certifying signature after the request of receiving, and send Streaming Media and/or caption stream at the signature verification success backward current media player that the requesting party is provided.
4, the method for claim 1, it is characterized in that, when whether the judgement time stamp mates, if the difference of the timestamp of current caption stream sample and current media stream sample timestamp and the difference of described reference value are not more than preset threshold, then determine described current media stream timestamp and current caption stream timestamp coupling, otherwise determine that timestamp does not match.
5, as each described method of claim 1 to 4, it is characterized in that, if include video flowing in the described Streaming Media, then from Streaming Media, isolate video flowing and with the synthetic new video flowing of institute caption stream after play.
6, method as claimed in claim 5 is characterized in that, also respectively video flowing and caption stream is decoded before synthetic video stream.
7, method as claimed in claim 6 is characterized in that, is bitmap format with decoding video stream, when synthetic video flows, the bitmap dot matrix of the shared position of captions dot matrix to be shown on the bitmap is replaced to the captions color.
CNB2005100345489A 2005-05-01 2005-05-01 Method for broadcastin stream media caption and its stream media player Active CN100452874C (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CNB2005100345489A CN100452874C (en) 2005-05-01 2005-05-01 Method for broadcastin stream media caption and its stream media player

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CNB2005100345489A CN100452874C (en) 2005-05-01 2005-05-01 Method for broadcastin stream media caption and its stream media player

Related Child Applications (1)

Application Number Title Priority Date Filing Date
CN 200810088098 Division CN101262611B (en) 2005-05-01 2005-05-01 A stream media player

Publications (2)

Publication Number Publication Date
CN1859565A CN1859565A (en) 2006-11-08
CN100452874C true CN100452874C (en) 2009-01-14

Family

ID=37298421

Family Applications (1)

Application Number Title Priority Date Filing Date
CNB2005100345489A Active CN100452874C (en) 2005-05-01 2005-05-01 Method for broadcastin stream media caption and its stream media player

Country Status (1)

Country Link
CN (1) CN100452874C (en)

Families Citing this family (18)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US8719868B2 (en) * 2008-03-05 2014-05-06 Hewlett-Packard Development Company, L.P. Presentation of combined video signals from multiple sources
CN101808202B (en) * 2009-02-18 2013-09-04 联想(北京)有限公司 Method, system and computer for realizing sound-and-caption synchronization in video file
CN101727951B (en) * 2009-11-27 2013-01-30 北京搜狗科技发展有限公司 Method for automatically changing play time of caption and device thereof
CN102760464B (en) * 2011-04-29 2015-11-11 腾讯科技（深圳）有限公司 The method and apparatus of display FLASH video file captions
CN102347044B (en) * 2011-05-20 2014-01-22 合一网络技术(北京)有限公司 Synchronous displaying and control method used in embedded media player, system and equipment thereof
CN102323924A (en) * 2011-05-20 2012-01-18 合一网络技术(北京)有限公司 Method for controlling embedded media player to synchronously display subtitle, presentation and note, system and equipment
JP2012249058A (en) * 2011-05-27 2012-12-13 Nec Corp Update system and update method of video audio file
CN102802044A (en) * 2012-06-29 2012-11-28 华为终端有限公司 Video processing method, terminal and subtitle server
CN103731609B (en) * 2012-10-11 2019-04-26 百度在线网络技术（北京）有限公司 A kind of video broadcasting method and system
US9363575B2 (en) * 2013-02-26 2016-06-07 Roku, Inc. Method and apparatus for viewing instant replay
WO2015035566A1 (en) * 2013-09-11 2015-03-19 Intel Corporation Integrated presentation of secondary content
CN103986940A (en) * 2014-06-03 2014-08-13 王军明 Fluidization method for video subtitles
CN105848005A (en) * 2016-03-28 2016-08-10 乐视控股（北京）有限公司 Video subtitle display method and video subtitle display device
CN105848004A (en) * 2016-05-16 2016-08-10 乐视控股（北京）有限公司 Caption playing method and caption playing device
CN110166788B (en) * 2018-08-02 2021-11-02 腾讯科技（深圳）有限公司 Information synchronous playing method, device and storage medium
CN113014984A (en) * 2019-12-18 2021-06-22 深圳市万普拉斯科技有限公司 Method and device for adding subtitles in real time, computer equipment and computer storage medium
CN115474066A (en) * 2021-06-11 2022-12-13 北京有竹居网络技术有限公司 Subtitle processing method and device, electronic equipment and storage medium
CN113596546B (en) * 2021-07-26 2023-09-08 Vidaa(荷兰)国际控股有限公司 Multi-stream program playing method and display device

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5805153A (en) * 1995-11-28 1998-09-08 Sun Microsystems, Inc. Method and system for resizing the subtitles of a video
US20040044532A1 (en) * 2002-09-03 2004-03-04 International Business Machines Corporation System and method for remote audio caption visualizations
CN1505032A (en) * 2002-12-04 2004-06-16 上海乐金广电电子有限公司 Optical disk playing method taking advantage of internet
US20040168203A1 (en) * 2002-12-12 2004-08-26 Seo Kang Soo Method and apparatus for presenting video data in synchronization with text-based data
CN1543212A (en) * 2003-04-28 2004-11-03 株式会社东芝 Reproducing apparatus

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5805153A (en) * 1995-11-28 1998-09-08 Sun Microsystems, Inc. Method and system for resizing the subtitles of a video
US20040044532A1 (en) * 2002-09-03 2004-03-04 International Business Machines Corporation System and method for remote audio caption visualizations
CN1505032A (en) * 2002-12-04 2004-06-16 上海乐金广电电子有限公司 Optical disk playing method taking advantage of internet
US20040168203A1 (en) * 2002-12-12 2004-08-26 Seo Kang Soo Method and apparatus for presenting video data in synchronization with text-based data
CN1543212A (en) * 2003-04-28 2004-11-03 株式会社东芝 Reproducing apparatus

Also Published As

Publication number Publication date
CN1859565A (en) 2006-11-08

Similar Documents

Publication Publication Date Title
CN100452874C (en) Method for broadcastin stream media caption and its stream media player
CN101262611B (en) A stream media player
TW561374B (en) Method and apparatus for selecting streaming media in real-time
US8045054B2 (en) Closed captioning language translation
EP2940940B1 (en) Methods for sending and receiving video short message, apparatus and handheld electronic device thereof
US7996540B2 (en) Method and system for replacing media stream in a communication process of a terminal
CN103096128B (en) A kind of realize the method for video interactive, server, terminal and system
DK2180652T3 (en) Method and system for transmitting media information
CN1714554B (en) Audio visual media encoding system
CN103024454B (en) Method and system for transmitting interaction entry information to audiences in broadcasting and TV programs
US20120304235A1 (en) Method and system for playing video file, and media resource server
CN108040061A (en) A kind of cloud meeting live broadcasting method
JP2003284037A (en) Multimedia data reception device and method therefor, and multimedia data transmission device and method therefor
KR20060003651A (en) Synchronization method of video and iamge data in system for providing remote multimedia service through network
US20210392397A1 (en) Content-Modification System with Volume Level Adjustment Feature
CN113301359A (en) Audio and video processing method and device and electronic equipment
KR101371064B1 (en) Method for transmitting broadcasting signal
CN113114687A (en) IPTV converging method and system
CN101631166A (en) Multimedia massage play system and multimedia massage play method
WO2013166785A1 (en) Media service providing method and device, and media service displaying method and device
CN109413476A (en) A kind of audio-video and piano action live broadcasting method and system
KR102533674B1 (en) Receiving device, sending device and data processing method
CN1231063C (en) System and method for digital broadcast audio content targeting
CN106454547B (en) real-time caption broadcasting method and system
US20220248079A1 (en) Content-modification system with testing and reporting feature

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C14 Grant of patent or utility model
GR01 Patent grant