CN102446189A - Interactive dynamic image and video/audio transmission presentation method and image compression method - Google Patents

Interactive dynamic image and video/audio transmission presentation method and image compression method Download PDF

Info

Publication number
CN102446189A
CN102446189A CN2010105054090A CN201010505409A CN102446189A CN 102446189 A CN102446189 A CN 102446189A CN 2010105054090 A CN2010105054090 A CN 2010105054090A CN 201010505409 A CN201010505409 A CN 201010505409A CN 102446189 A CN102446189 A CN 102446189A
Authority
CN
China
Prior art keywords
frame
information
image
user
audio
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2010105054090A
Other languages
Chinese (zh)
Inventor
苏育正
林大庆
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
MOJU TECHNOLOGY CO LTD
Original Assignee
MOJU TECHNOLOGY CO LTD
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by MOJU TECHNOLOGY CO LTD filed Critical MOJU TECHNOLOGY CO LTD
Priority to CN2010105054090A priority Critical patent/CN102446189A/en
Publication of CN102446189A publication Critical patent/CN102446189A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention provides an interactive dynamic image and video/audio transmission presentation method and an image compression method. By adopting the transmission presentation method, a user can access a server side only through a webpage executive program on a client side for interactive dynamic image and video/audio transmission, so that the requirement for hardware efficiency on the client side can be lowered, and the installation time, game initial time and the like of the user can be shortened. By adopting the compression method, an image can be divided into two frames, and only one frame with smaller size is taken as a node frame, so that sudden increase of data quantity in the transmission process is avoided, and the average data transmission quantity is reduced.

Description

Interactive dynamic image and audio-visual transmission rendering method and method for compressing image thereof
Technical field
The invention relates to a kind of data transmission rendering method and compression method thereof, particularly a kind ofly be used to transmit interactive dynamic image and audio-visual its method for compressing image of data transmission rendering method.
Background technology
Please with reference to shown in Figure 1, its be a kind of at present general system architecture, comprise at least one user's end (Client) 1, a network (Network) 2 and a servo driver end (Server) 3.This user holds 1 to supply to receive the order that the user imported; This command conversion is an order information and delivers to this servo driver end 3 through this network 2; This servo driver end 3 is promptly held 1 order information to carry out computing according to this at least one user and is produced a demonstration information; And should show through this network 2 that information delivered at least one this user and hold 1 once more, so that this user holds 1 picture that shows corresponding to this demonstration information.
In detail; Respectively this user holds 1 all to comprise an I/O port (I/O Port) 11, one central processing unit 12, a memory body 13, a Network Interface Module 14 and an image processor (GPU) 15; This I/O port 11 can receive user's order through an order input element 16; This central processing unit 12 and memory body 13 Collaboration; The instruction that the user imported is carried out computing and produced this order information, and this Network Interface Module 34 couples this network 2, so that should order information to be sent to this servo driver end 1 through this network 2.In addition; This central processing unit 12 and memory body 13 also can be when obtaining this demonstration information through this Network Interface Module 14; Directly collaborative this image processor 15 carries out computing to obtain a picture information; Or locate to be stored in this user and hold and read computing again behind 1 the hard disk 17 and obtain this picture information, show with an image display element 18 through the content of this I/O port 11 again this picture information.Wherein, this memory body 13 can be the independent memory body (as shown in Figure 1) that is provided with, but also can be the memory cell of building in this image processor 15; This order input element 16 can be the peripheral equipments such as keyboard, slide-mouse or microphone that general computer has, or the numeric keypad or the direction knob of general mobile phone; This image display element 18 then can be a display screen.This network 2 can be world-wide web (Internet) or general Local Area Network (Local Area Network), and be connected in this user hold 1 and this servo driver end 3 between.This servo driver end 3 can be the servo host of a Local Area Network or the high in the clouds servomechanism of world-wide web; And this this servo driver end 3 has a central processing unit (CPU) 31, a memory body (Memory) 32 and a Network Interface Module (Network Interface) 33; This central processing unit 31 and memory body 32 Collaboration; Hold 1 order information to carry out computing with respectively this user who is received according to this Network Interface Module 33 and obtain this demonstration information, again through this Network Interface Module 33 and this network 2 and should show that information delivered to this user and hold 1.
Please with reference to shown in the 1st and 2 figure; Fig. 2 wherein illustrates the block flow diagram that utilizes existing interactive dynamic image that above-mentioned framework carries out and audio-visual transmission rendering method, especially utilizes the content of the online game that this type of data transmission method operates to appear and manner of execution.In detail; The Data Processing of present existing online game has mainly comprised combination 3D model, polygonal and 2D material/coating, special efficacy and has presented parts such as (for example: material replacement, how much, shadow, skeleton is applied mechanically and tinter (Shader) computing etc.) and network operations; In following described general data processing method is before Data Processing; In advance all related datas are downloaded and are mounted to this user and hold 1, to carry out a master routine of this data processing method as relying.Its specify as after.
This available data transmission method comprises a master routine running program S91, data transmission operation program S92, an image processing program S93 and an image display program S94.This main program operation sequence S91 receives with this I/O port 11 and is somebody's turn to do order, and carries out this main program that is installed on this memory body 13 in advance with this central processing unit 12, should order information to produce; This data transmission operation program S92 should order information to be sent to this servo driver end 3 through this network 2; Obtain this demonstration information by this servo driver end 3 based on the order information computing obtained, should show through this network 2 that information delivered to this at least one user and hold 1 again; This image processing program S93 should show with this central processing unit 12, memory body 13 and image processor 15 that information converted this picture information into; This image display program S94 then shows this picture information with this image display element 18.Wherein, Because institute must calculating in the 3D picture polygon position and dynamic light effects (being so-called geometrical calculation) will cause great workload; Therefore must in this image processing program S93, carry out the conversion of this demonstration information, so that the operation that this central processing unit 12 carries out outside the 3D graphics process with these image processor 15 auxiliary these central processing units 12.
Generally speaking, the shortcoming of above-mentioned existing interactive dynamic image and audio-visual transmission rendering method is following 4 points:
1. this user holds 1 the memory body 13 and the use problem of hard drive space 18: the user must hold 1 this master routine is installed this user earlier; When game initialization; This central processing unit 12 need to play material and model is written into this memory body 13; Carry out computing and present image by this image processor 15 again; Cause certainly will need in the storage area of this hard disk 18, reserve extra installing space to deposit this master routine and related data (generally the storage area of this master routine and related data needs is usually above 1G bytes, some even up to 10G bytes); In addition, this memory body 13 also need meet certain usefulness and require just can reach high operation effect, and the meaning even capacity of this memory body 13 is high more, and the object and the material that then can be written into computing will be many more.In addition, because the different manufacturers of various 3D online games do not integrate the master routine of the various 3D online games of its manufacturing, cause the user to be necessary for various recreation and consume extremely many installing spaces; More leisure opinion user obviously can't hold 1 not install under the situation of this master routine this user, carries out this online game.
2. the download content problem of this network 2: this user holds 1 all to need the time through these network 2 download games installation procedures (including this master routine and game data) and installation procedure thereof, and this problem is very easily ignored.As above-mentioned; The required storage area of the installation procedure of many recreation is arranged all above 1G; Even up to 10G; Though having more, the network bandwidth that most on the market now network dealers is provided supports the service that 1Mbps-20Mbps downloads, higher and need have the entity circuit to support (like Connectorized fiber optic cabling) because of the service fee of 8Mbps-20Mbps, so its popularity rate is not high.The research report of doing according to nearest network information center, a juridical person Taiwan shows that (download bandwidth that (surpassing 70% Taiwan broadband users) is still with 1-8Mbps is main to most of people.In addition, even use network to connect the transmission delay (latenc in the network structure essence with 1Mbps-20Mbps download bandwidth; Y) still omnipresent.With the ADSL service is example; Hold 1 between this servo driver end 3 this user; Data need be held 1 interchanger (Switch) or router (Router, it can be wire transmission or wireless transmission method) through this user, through digital user loop multiplexer (the Digital Subscriber Line Multiplexer of 2 li on this network; DSLM) and after a plurality of world-wide web router devices such as (Internet Router), just can deliver to this servo driver end 3.Under the situation of the best, in fact the ADSL user so that a bandwidth is 3Mbps possibly can only use the bandwidth service of 1-2Mbps.In addition; Aspect this servo driver end 3, it all is preset and fixing that recreation installation shelves bearing capacity and bandwidth are provided, as far as general recreation operator; The servomechanism of keeping fixing bandwidth and having corresponding usefulness all need expend higher cost, and does not also have dynamic mechanism for reducing rate.Therefore, when trunks busy, digital user loop multiplexer itself possibly all can cause transmission delay with this servomechanism 3, holds for 1 waiting time by these servo driver end 3 download games installation shelves and prolonged this user indirectly.In fact, with the bandwidth calculation that shelves and 2Mbps are installed in the recreation of general 1G bytes, the needed transmission time of download games installation procedure (it does not comprise the set-up time) is one of needs more than hour at least.
3. recreation master routine and data security problem: when a large amount of game contents downloads and installs when this user holds 1; Recreation master routine and content will have the risk of the reverse-engineering of receiving, and malicious sabotage resolved and suffered to game data form, figure shelves, program, transmission and image presentation mode all might.The operator usually can face the hacker and carry out cheating interference recreation balance and ecology with different types, causes very big loss.
4. the idle and upgrade problem of image processor 15 usefulness: constantly under the situation of abundantization, the user holds 1 the also relative increase of needs of usefulness at game content.Before 10 years, under the situation that the 3D recreation is not popularized, pixel painted (pixel shading) effect is not supported in recreation, but online game now just has many recreation to support pixel shading effect.To the processing of this effect, many game players select to upgrade this image processor 15 in the hope of presenting pixel shading effect with dynamical mode.Yet; Its problem is: when this user holds 1 performed to be merely simple when doing the document work of treatment; Can the effective utilization of this image processor 15 reach 100%? Does the user of low order hold 1 user that is provided with as high-order to hold this image processor 15 of 1? Obviously, answer does not have.In other words, the popularity rate of abundantization of recreation also is therefore to have received limitation.
5. the problem when trying to play:, how to break through numerous rivals' game products and the favor that obtains the player has become the common problems of all recreation operators because current online game is of a great variety.Wherein, for exciting the most directly buying motive of player, it obviously is the most directly and effectively to be on sale throughout mode that the examination object for appreciation chance of this online game is provided.Yet, because online game now all needs this user to hold 1 after having consumed extremely many installing spaces and its master routine of time installation, could carry out this online game, cause the player can't try to play this online game quickly and easily.
Therefore, the problems referred to above have confirmed the necessity of existing interactive dynamic image that further improvement is above-mentioned and audio-visual transmission rendering method, in the hope of improving ease of use and instantaneity, and make abundant in contentization.
Summary of the invention
The object of the invention is that a kind of interactive dynamic image and audio-visual transmission rendering method are provided; Directly carry out the transmission operation of interactive dynamic image with the webpage executive routine for the user; Reach the installation that reduces user's end and be written into the memory body requisite space, and shorten purposes such as user's the installation and the initial time of playing.
The object of the invention is that a kind of interactive dynamic image and audio-visual transmission rendering method are provided; For directly carrying out interactive dynamically audio-visual transmission operation with audio-visual compressed format; Reach and to consume installing space and set-up time, and reduce the purpose that cost is set of user's end.
The object of the invention is that a kind of method for compressing image is provided, and avoiding in transmission course, the occurring situation that data quantity is uprushed, and reduces the average transmission data quantity.
Technological means of the present invention is: a kind of interactive dynamic image and audio-visual transmission rendering method, it comprises a logging program, a data transmission operation program, a sound processing program and an audio-visual display routine.This logging program is held in a user and is carried out a webpage executive routine, to pass through in the system program of a network entry one servo driver end; This data transmission operation program produces an order information when obtaining an order by this user's termination; Should order information to be sent to this servo driver end through this webpage executive routine and network, and obtain one by this servo driver end according to this order information computing and show information and should show through this network that information delivered to this user and hold; This sound processing program should show with an image processor that information converted a picture information into; This audio-visual display routine shows this picture information with this a webpage executive routine and an image display element.
Interactive dynamic image of the present invention and audio-visual transmission rendering method comprise a download program in addition; This downloaded before this data transmission operation program, and through employed multimedia material in this webpage executive routine and this sound processing program of network download.
Technological means of the present invention comprises in addition: a kind of interactive dynamic image and audio-visual transmission rendering method, it comprises a logging program, data transmission operation program and an audio-visual display routine.This logging program is held in a user and is carried out a webpage executive routine, to pass through in the system program of a network entry one servo driver end; This data transmission operation program produces an order information when obtaining an order by this user's termination; Should order information to be sent to this servo driver end through this webpage executive routine and network; Obtain a picture information by this servo driver end according to this order information computing; This picture information boil down to one picture is compressed information, this picture compression information is delivered to this user's end, and this picture is compressed information decompression and obtains this picture information by this user's end through this network; This audio-visual display routine shows this picture information with this a webpage executive routine and an image display element.
Interactive dynamic image of the present invention and audio-visual transmission rendering method comprise in addition: this servo driver end obtains after this picture information according to this order information computing; With the image segmentation of this picture information is several frames with same size; With one of these several frames as a node frame; Predict frame with other frames as several, again this node frame and prediction frame are compressed respectively and obtain this picture compression information.
Interactive dynamic image of the present invention and audio-visual transmission rendering method comprise in addition: this servo driver end obtains after this picture information according to this order information computing; Utilize the image of this picture information to form one first frame and one second frame; With this first frame as a node frame; With this second frame is a prediction frame; This node frame and prediction frame are compressed respectively again and obtain this picture compression information, wherein this first frame is little than the size of this second frame, and this first frame is positioned at one of them of several positions of this image.
Method for compressing image of the present invention comprises: utilizing the image of a picture information to form one first frame and one second frame, as a node frame, is a prediction frame with this second frame with this first frame; And with this node frame and the prediction frame compress for transmission respectively.Wherein, this first frame is positioned at one of them of several positions of this image, and this first frame is little than the size of this second frame.
Description of drawings
Fig. 1: the general existing network data system for transmitting Organization Chart of implementing.
Fig. 2: the block flow diagram of existing interactive dynamic image and audio-visual transmission rendering method.
Fig. 3: the block flow diagram of the interactive dynamic image of first embodiment of the invention and audio-visual transmission rendering method.
Fig. 4: but the system architecture diagram of the interactive dynamic image of embodiment of the present invention second embodiment and audio-visual transmission rendering method.
Fig. 5: the block flow diagram of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method.
Fig. 6 a: the synoptic diagram of first kind of implementation of compression mode of the data transmission operation program of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method.
Fig. 6 b: the synoptic diagram of second kind of implementation of compression mode of the data transmission operation program of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method.
Fig. 7 a: a kind of synoptic diagram of distinguishing the result of second kind of implementation of compression mode of the data transmission operation program of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method.
Fig. 7 b: the another kind of second kind of implementation of compression mode of the data transmission operation program of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method is distinguished result's synoptic diagram.
Fig. 7 c: another of second kind of implementation of compression mode of the data transmission operation program of the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method distinguished result's synoptic diagram.
The main element symbol description:
1 user holds 1 ' user end
11 I/O ports, 12 central processing units
13 memory bodys, 14 Network Interface Modules
15 image processors, 16 order input elements
18 image display elements
2 networks
3 servo driver ends, 3 ' servo driver end
31 central processing units, 32 memory bodys
33 Network Interface Modules, 34 image processors
S1 logging program S1 ' downloads
S2 data transmission operation program S2 ' data transmission operation program
The audio-visual display routine of S3 sound processing program S4
The audio-visual display routine of S4 '
S91 master routine running program S92 data transmission operation program
S93 image processing program S94 image display program
Embodiment
For letting the present invention above-mentioned and other purposes, characteristic and the advantage can be more obviously understandable, hereinafter is special lifts preferred embodiment of the present invention, and conjunction with figs., elaborates as follows:
Please be simultaneously with reference to shown in Fig. 1 and 3, Fig. 3 wherein illustrates the interactive dynamic image of first embodiment of the invention and the block flow diagram of audio-visual transmission rendering method, and the data transmission method of this embodiment may be implemented under the system architecture as shown in Figure 1.The interactive dynamic image of present embodiment and audio-visual transmission rendering method comprise a logging program S1, data transmission operation program S2, a sound processing program S3 and an audio-visual display routine S4.
In detail; This logging program S1 comprises: hold 1 to carry out a webpage executive routine in this user; For example a browser (browser) program or one little (widget) program; In the system program through this network 2 these servo driver ends 3 of login, and the system program of this servo driver end 3 is made up of the program editing interface that webpage mode capable of using presents three-dimensional (3D) picture, for example WebGL, OpenGL or DirectX etc.This data transmission operation program S2 comprises: when obtaining an order in this I/O port 11; Hold 1 to produce an order information in this user; And should order information to be sent to this servo driver end 3 through this webpage executive routine and network 2; Obtain one by this servo driver end 3 according to the order information computing obtained and show information, should show through this network 2 that information delivered to this user and hold 1 again.This sound processing program S3 should show with this image processor 15 that information converted a picture information into.This audio-visual display routine S4 shows this picture information with this webpage executive routine and this image display element 18.In addition; This servo driver end 3 more can be when this user holds 1 login; Judge that this user holds the kind of 1 webpage executive routine; And after confirming that this user holds the kind of 1 webpage executive routine, more can further detect the version that this user holds 1 preassembled support program or its webpage executive routine, and then whether decision requires this user to hold 1 necessary support program is installed.
Hold the above; The present invention is applied to an online game is example; When this logging program S1; The Internet Explorer browser that user Microsoft capable of using is developed links to the gaming platform that recreation supplier (for example: game developer and operator) is arranged at this servo driver end 3 as this webpage executive routine; Subsequently, the user can carry out this data transmission operation program S2, produces an electronic signal with keyboard or slide-mouse and orders as this; The directionkeys of for example pushing keyboard advances to control a game role; Then this user holds 1 promptly according to this order, produce the progressive order information of this game role of expression, and this servo driver end 3 is after obtaining this order information; Promptly calculate the frame parameter of this game role after advancing, with as this demonstration information and be back to this user and hold 1 according to this order information; Continue it, this sound processing program S3 converts this frame parameter the picture of this game role after advancing into, to produce this picture information; At last, this audio-visual display routine S4 promptly with this picture information of a screen display, demonstrates the progressive picture of this game role.Yet; In above-mentioned instance; Also can be after this servo driver end 3 be obtained all users and is held 1 order information; Hold the related data of 1 operated game role to deliver to all users each user and hold 1, hold 1 to calculate voluntarily and produce the frame parameter of this game role after advancing by each user again.The operation of in other words, calculating the travel distance parameter can hold 1 or this servo driver end 3 this user.
In addition; If this user holds 1 to carry out this logging program S1 first; Then before carrying out this data transmission operation program S2; Preferablely carry out one in addition and download program S1 ', wherein this download S1 ' through this webpage executive routine and network 2 among this servo driver end 3 is downloaded this sound processing program S3 can employable multimedia material, for example employed texturing of this picture information (texture) and model (model).Yet; Also can only look this user and hold 1 demand; Carrying out several suitable this S1 ' that download that constantly carry out of this online game; Download the mode of a small amount of data with segmentation and carry out this online game, for example: when carrying out this each time and downloading S1 ', only download to showing this required multimedia material in recreation part region;, this recreation part then carries out this S1 ' that downloads when getting into another zone once more to download this another required multimedia material in zone; And also can be simultaneously with the multimedia material that need not re-use from these memory body 13 deletions, so as to reducing the downloaded data amount and shorten download time, and also can be reduced in the installing space demand that this user holds 1 memory body 13 simultaneously.In addition, this servo driver end 3 can be after this logging program S1, judges that this user holds 1 webpage executive routine whether need download the auxiliary plug-in program (plug-in) that presents this picture information.In detail, if this user holds 1 webpage executive routine can support WebGL, then can be downloaded by this S1 ' that downloads can employable multimedia material or directly carry out this data transmission operation program S2; Yet; If this user holds 1 webpage executive routine only to support OpenGL; Then this servo driver end 3 can provide plug-in program to supply this user to hold 1 to install through this S1 ' that downloads in addition, so that the user holds 1 to show this picture information that appears with three dimensional constitution with this webpage executive routine and image display 18; Yet; If writing the employed program editing interface of system program of this servo driver end 3 is WebGL; Then if this user holds 1 employed webpage executive routine to support the WebGL program of using, the user can directly show this picture information that appears with three dimensional constitution with this kind webpage executive routine and image display 18.
By above-mentioned interactive dynamic image and audio-visual transmission rendering method; Can exempt this user and hold the program that master routine is installed in 1 the memory body 13; Therefore the time that not only can save the installing space of memory body 13 and this master routine is installed, also be available for users to utilize any electronic equipment that the webpage executive routine has been installed to hold 1 to be connected to this servo driver end 3 as this user.
Please with reference to shown in Figure 4; It is the interactive dynamic image of second embodiment of the invention and the implementation system framework of audio-visual transmission rendering method, and wherein the employed system architecture of second embodiment of the invention is connected at least one user with this network 2 and holds between 1 ' and one servo driver end 3 '.In detail, compared to system architecture shown in Figure 1, respectively this user holds 1 ' all to omit and this image processor 15 is set, the then newly-increased image processor 34 of this servo driver end 3 '.
Please be simultaneously with reference to shown in Fig. 4 and 5; Fig. 5 wherein is the interactive dynamic image of second embodiment of the invention and the block flow diagram of audio-visual transmission rendering method, and the data transmission method of present embodiment comprises this logging program S1, data transmission operation program S2 ' and an audio-visual display routine S4 '.This logging program S1 still holds 1 to carry out a webpage executive routine in this user; In the system program through this network 2 these servo driver ends 3 of login, just the system program of this servo driver end 3 is not limited in the program editing interface that presents three-dimensional picture with webpage mode capable of using and is constituted.This data transmission operation program S2 ' comprises: when obtaining an order in this I/O port 11; Hold 1 to produce an order information in this user; And should order information to be sent to this servo driver end 3 through this webpage executive routine and network 2; Obtain a picture information according to the order information of being obtained with this central processing unit 31, memory body 32 and image processor 34 computings by this servo driver end 3; And with this picture information boil down to one picture compression information, through this network 2 this picture compression information is delivered to this user again and hold 1, hold 1 this picture compression information decompressed and obtain this picture information for this user.This audio-visual display routine S4 ' shows this picture information with this webpage executive routine and this image display element 18.Wherein, the file type of this picture information is preferably general drawing compression shelves, for example the compression shelves of 3D drawing.
Please with reference to shown in Fig. 6 a and the 6b; When the data transmission operation program S2 ' of interactive dynamic image that carries out the second embodiment of the present invention and audio-visual transmission rendering method, preferable embodiment by two kinds of following method for compressing image is with this picture compression information of this picture information boil down to.First kind of embodiment is after these servo driver end 3 computings obtain this picture information; Image (picture) with this picture information is divided into several frames (frame) with same size earlier; And with one of them as a node frame (Intra frame abbreviates the I frame as), other frames then are several prediction frames (predicted frame; Abbreviate the P frame as), again this I frame and P frame are compressed respectively and obtain this picture compression information.In detail, shown in Fig. 6 a, can be 16 frames with the image segmentation of this picture information, and with its first frame as this I frame (I 0), other 15 frames then are this P frame (P 1-P 15); Subsequently, again with next one be divided into 16 frames second frame of image as this I frame (I 1), and other 15 frames are this P frame (P 0, P 2-P 15); In like manner analogize, when transferring to the 16th image, promptly with the 16th frame as this I frame (I 15), and be this P frame (P with other 15 frames 0-P 14).Subsequently, the 17th image promptly obtains its I frame (I with the mode identical with first image 0) and P frame (P 1-P 15), and can the rest may be inferred obtain the frame of all images.By this kind embodiment, can this picture information effectively be compressed, and make simultaneously respectively that this I frame only has the facts on file amount, avoid in the process of this picture compression information of transmission, occurring the situation that data quantity uprushes and produce.
In addition; The second kind of embodiment that this picture of this picture information boil down to is compressed information is after this this picture information of servo driver end 3 computings acquisition; Image by this picture information forms one first frame and one second frame; Wherein this first frame is little than the size of this second frame, and this first frame is positioned at one of them of several positions of this image.In addition, and with this first frame as an I frame, be a P frame with this second frame, again this I frame and P frame are compressed respectively and obtain this picture compression information.In detail, shown in Fig. 6 b,, can a primary importance of an image be divided into this first frame as this I frame (I when the image of setting this picture information all has 16 positions 0), and other positions of this image are divided into this second frame as this P frame (P 0'); Subsequently, again the second place of a next image is divided into this first frame as this I frame (I 1), and other positions (promptly comprising this primary importance) of this image are divided into this second frame as this P frame (P 1'); In like manner analogize, when transferring to the 16th image, be about to the 16th position and be divided into this first frame as this I frame (I 15), and other positions of this image are divided into this second frame as this P frame (P 15').Subsequently, the 17th image promptly obtains its I frame (I with the mode identical with first image 0) and P frame (P 0'), and can the rest may be inferred obtain the frame of all images.Yet in above-mentioned embodiment, the method that obtains this second frame also can be: replace the position of first frame in this image with solid color after, with the entire image after replacing through this as this second frame.By second kind of above-mentioned embodiment; Not only can this picture information effectively be compressed; Make respectively that this I frame only has the facts on file amount, produce to avoid in the process of this picture compression information of transmission, occurring the situation that data quantity uprushes, and more can further reduce the average transmission data quantity.
In addition, when compressing this picture information, can second frame of cutting apart from this image be divided into several blocks again with second kind of above-mentioned embodiment.Wherein, the mode of distinguishing this second frame is: the respectively separator bar between this block of this second frame is extended to the edge of this second frame by each bending angle at the edge of this first frame with linear fashion.In detail; Shown in Fig. 7 a; When this first frame was positioned at the upper left hand corner of this image, a separator bar of this second frame can be extended to the lower limb of this second frame by the bending angle straight line of the position, bottom right of this first frame, so that this second frame is divided into two blocks; Shown in Fig. 7 b; When this first frame is positioned at the centre position of coboundary of this image; The two compartment line of this second frame can be respectively extends to the lower limb of this second frame by two bending angle straight lines of the below of this first frame, so that this second frame is divided into three blocks; Shown in Fig. 7 c, when this first frame is positioned at the centre position of this image, then by the bending angle in four corners of this first frame respectively straight line extend to the coboundary and the lower limb of this second frame, this second frame is divided into four blocks.Whereby, according to this position of first frame in this image, but the block of this second frame of the adjustment of maneuverability, in order to the saving of further reaching data quantity.
Whereby; The interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method not only have the advantage of aforesaid first embodiment; More can reduce the user hold 1 cost (promptly do not need again hold 1 this image processor 15 is set in the user) and hardware performance requirements be set, improve the wish that the user buys software (module) on the line that uses data transmission method of the present invention.In addition; To the interactive dynamic image of this embodiment and audio-visual transmission rendering method; Owing to carrying out this data transmission operation program S2 ' before; The program that any auxiliary this data transmission operation program S2 ' running need be installed is held to this user in 1 ' the memory body 13, so can be more convenient for supplying user's software (module) (for example can apply to the examination object for appreciation of online game) on this line in advance on probation before purchase, further improves user's purchase intention.
In addition, this user hold 1 and total computing cost of this servo driver end 3 aspect, the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method have more following illustrational advantage.When several these users hold 1 to desire in its other picture information, to use same model simultaneously; Existing interactive dynamic image and audio-visual transmission rendering method need to hold 1 to carry out reading and related operation of this model respectively by these several users respectively, to produce this picture information; Yet; Therefore the interactive dynamic image of second embodiment of the invention and audio-visual transmission rendering method can only carry out reading and related operation of this model with this servo driver end 3, can effectively save these several users and hold 1 and total computing cost aspect of this servo driver end 3.
In sum; By interactive dynamic image of the present invention and audio-visual transmission rendering method; And any electronic product with webpage executive routine; The user can be at any time carries out with this webpage executive routine and has software (module) on interactive dynamic image and the audio-visual line, and does not need to install in advance the master routine that consumes a large amount of storage areas.Therefore, the time that interactive dynamic image of the present invention and audio-visual transmission rendering method can effectively be saved the installing space of this memory body 13 and this master routine is installed really, even can be applicable to further that this user who is provided with at lower cost holds 1 '.

Claims (9)

1. an interactive dynamic image and audio-visual transmission rendering method is characterized in that it comprises:
A logging program is to hold in a user to carry out a webpage executive routine, to pass through in the system program of a servo driver end of a network entry;
A data transmission operation program; Be to produce an order information when obtaining one order by this user's termination; Should order information to be sent to this servo driver end through this webpage performing a programme and network, and obtain one by this servo driver end based on this order information computing and show information and should show through this network that information delivered to this user and hold;
A sound processing program is should show with an image processor that information converted a picture information into; And
An audio-visual display routine is to show this picture information with this webpage executive routine and an image display element.
2. interactive dynamic image according to claim 1 and audio-visual transmission rendering method; It is characterized in that; Before this data transmission operation program, comprise one in addition and download, this downloads through employed multimedia material among this webpage executive routine and this sound processing program of network download.
3. interactive dynamic image according to claim 2 and audio-visual transmission rendering method is characterized in that, before this downloads, preestablishing this multimedia material is employed texturing of this picture information and model.
4. interactive dynamic image according to claim 1 and audio-visual transmission rendering method; It is characterized in that; This servo driver end judges whether the webpage executive routine of this user's end need download the auxiliary plug-in program that presents this picture information after this logging program.
5. an interactive dynamic image and audio-visual transmission rendering method, it comprises:
A logging program is to hold in a user to carry out a webpage executive routine, to pass through in the system program of a servo driver end of a network entry;
A data transmission operation program; Be when obtaining one order, to produce an order information by this user's end; Should order information to be sent to this servo driver end through this webpage performing a programme and network; Obtain a picture information by this servo driver end based on this order information computing; Picture of this picture information boil down to is compressed information, and this picture compression information is delivered to this user's end, and this picture is compressed information decompression and obtains this picture information by this user's end through this network; And
An audio-visual display routine shows this picture information with this webpage executive routine and an image display element.
6. interactive dynamic image according to claim 5 and audio-visual transmission rendering method; It is characterized in that; This servo driver end obtains according to this order information computing after this picture information, is several frames with same size with the image segmentation of this picture information, with one of these several frames as a node frame; Predict frame with other frames as several, again this node frame and prediction frame are compressed respectively and obtain this picture compression information.
7. interactive dynamic image according to claim 5 and audio-visual transmission rendering method; It is characterized in that this servo driver end obtains according to this order information computing to utilize the image of this picture information to form one first frame and one second frame after this picture information; With this first frame as a node frame; With this second frame is a prediction frame, this node frame and prediction frame is compressed respectively again and obtains this picture compression information, it is characterized in that; This first frame is positioned at one of them of several positions of this image, and this first frame is little than the size of this second frame.
8. method for compressing image is characterized in that it comprises:
Utilizing the image of a picture information to form one first frame and one second frame, as a node frame, is a prediction frame with this second frame with this first frame; And
This node frame and prediction frame are compressed respectively for transmission;
Wherein, this first frame is positioned at one of them of several positions of this image, and this first frame is little than the size of this second frame.
9. method for compressing image according to claim 8; It is characterized in that; Cut apart this image and form this first frame and second frame; And before compression should be predicted frame, earlier this second frame is divided into several blocks, the separator bar between these several blocks is extended to the edge of this second frame by each bending angle at the edge of this first frame with linear fashion.
CN2010105054090A 2010-10-13 2010-10-13 Interactive dynamic image and video/audio transmission presentation method and image compression method Pending CN102446189A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2010105054090A CN102446189A (en) 2010-10-13 2010-10-13 Interactive dynamic image and video/audio transmission presentation method and image compression method

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2010105054090A CN102446189A (en) 2010-10-13 2010-10-13 Interactive dynamic image and video/audio transmission presentation method and image compression method

Publications (1)

Publication Number Publication Date
CN102446189A true CN102446189A (en) 2012-05-09

Family

ID=46008693

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2010105054090A Pending CN102446189A (en) 2010-10-13 2010-10-13 Interactive dynamic image and video/audio transmission presentation method and image compression method

Country Status (1)

Country Link
CN (1) CN102446189A (en)

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106919376A (en) * 2015-12-28 2017-07-04 财团法人工业技术研究院 Dynamic menu transmission method, server device and user's set
US10979470B2 (en) 2015-12-28 2021-04-13 Industrial Technology Research Institute Server device, client device and dynamic image transmission method for virtual desktop infrastructure

Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6370552B1 (en) * 1997-05-14 2002-04-09 Citrix Systems, Inc. Apparatus and method for displaying application output in an HTML document
CN1770869A (en) * 2004-09-27 2006-05-10 Idc公司 System and method for transmitting video data
CN1885939A (en) * 2005-06-21 2006-12-27 影腾媒体科技股份有限公司 Audio/video compression method
CN101025739A (en) * 2006-02-20 2007-08-29 朴良君 Network electronic map display, inquery and management method and system
CN101296372A (en) * 2007-04-25 2008-10-29 于淑珍 Electronic map network service method based on stream media and real-time audio and video relay broadcasting

Patent Citations (5)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6370552B1 (en) * 1997-05-14 2002-04-09 Citrix Systems, Inc. Apparatus and method for displaying application output in an HTML document
CN1770869A (en) * 2004-09-27 2006-05-10 Idc公司 System and method for transmitting video data
CN1885939A (en) * 2005-06-21 2006-12-27 影腾媒体科技股份有限公司 Audio/video compression method
CN101025739A (en) * 2006-02-20 2007-08-29 朴良君 Network electronic map display, inquery and management method and system
CN101296372A (en) * 2007-04-25 2008-10-29 于淑珍 Electronic map network service method based on stream media and real-time audio and video relay broadcasting

Cited By (2)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN106919376A (en) * 2015-12-28 2017-07-04 财团法人工业技术研究院 Dynamic menu transmission method, server device and user's set
US10979470B2 (en) 2015-12-28 2021-04-13 Industrial Technology Research Institute Server device, client device and dynamic image transmission method for virtual desktop infrastructure

Similar Documents

Publication Publication Date Title
US11372469B2 (en) Apparatus and method for power management of a multi-gpu computing system
US7830388B1 (en) Methods and apparatus of sharing graphics data of multiple instances of interactive application
CA2853212C (en) System, server, and control method for rendering an object on a screen
US9052959B2 (en) Load balancing between general purpose processors and graphics processors
Chuah et al. Cloud gaming: A green solution to massive multiplayer online games
US10049646B2 (en) Method and system for keyframe detection when executing an application in a cloud based system providing virtualized graphics processing to remote servers
CN106390449A (en) A cloud game framework based on the graphical virtualization technology
CN110025957B (en) Cloud game server end architecture, client and system
JP2023071941A (en) Rack assembly and network architecture
CN102378976B (en) The compression of images of multiple processor is used to accelerate
CN107566346B (en) 3D game data transmission method and device, storage medium and electronic device
US20190064895A1 (en) Nonhomogeneous server arrangement
US20240070800A1 (en) Accessing local memory of a gpu executing a first kernel when executing a second kernel of another gpu
CN106797398A (en) Method and system for providing from virtual desktop serve to client
JP6539278B2 (en) Multi-mode gaming server
US20090328037A1 (en) 3d graphics acceleration in remote multi-user environment
CN102446189A (en) Interactive dynamic image and video/audio transmission presentation method and image compression method
WO2024037110A1 (en) Data processing method and apparatus, device, and medium
CN114146406A (en) Method and device for allocating operation resources, electronic equipment and storage medium
KR20100003518A (en) Mpu and 3d graphics processor of portable game device
CN1881226A (en) Single-user and network gaming method adapted to mobile communication environment, and computing capability service
KR20200044195A (en) System of Providing Gaming Video Using Cloud Computer
Lai et al. A QoS aware resource allocation strategy for mobile graphics rendering with cloud support
KR20240018028A (en) 3D Contents Streaming System
TW201216074A (en) Data transmission and rendering method for interactive-type dynamic images and videos, and an image compression method thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
C12 Rejection of a patent application after its publication
RJ01 Rejection of invention patent application after publication

Application publication date: 20120509