CN102510568A - Internet access data processing system and method for mobile terminal - Google Patents

Internet access data processing system and method for mobile terminal Download PDF

Info

Publication number
CN102510568A
CN102510568A CN2011103731823A CN201110373182A CN102510568A CN 102510568 A CN102510568 A CN 102510568A CN 2011103731823 A CN2011103731823 A CN 2011103731823A CN 201110373182 A CN201110373182 A CN 201110373182A CN 102510568 A CN102510568 A CN 102510568A
Authority
CN
China
Prior art keywords
data
internet
data storage
mobile terminal
internet access
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Pending
Application number
CN2011103731823A
Other languages
Chinese (zh)
Inventor
黄文良
王志军
吴晓亮
詹野云
张尼
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
UNICOM BROADBAND SERVICES APPLICATION NATIONAL ENGINEERING LABORATORY Co Ltd
Original Assignee
UNICOM BROADBAND SERVICES APPLICATION NATIONAL ENGINEERING LABORATORY Co Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by UNICOM BROADBAND SERVICES APPLICATION NATIONAL ENGINEERING LABORATORY Co Ltd filed Critical UNICOM BROADBAND SERVICES APPLICATION NATIONAL ENGINEERING LABORATORY Co Ltd
Priority to CN2011103731823A priority Critical patent/CN102510568A/en
Publication of CN102510568A publication Critical patent/CN102510568A/en
Pending legal-status Critical Current

Links

Images

Abstract

The invention discloses an internet access data processing system and a method for a mobile terminal. The internet access data processing system comprises a data acquisition subsystem, a data storage subsystem, a database input subsystem and a data query subsystem, wherein the data acquisition subsystem is used for acquiring the internet access data stream flowing through an SGSN (Service GPRS Support Node) and a GGSN (Gateway GPRS Support Node) and generating at least one internet access log file according to preset rules; the data storage subsystem is used for storing a database, and multiple data storage units corresponding to the user number and the time period of the mobile terminal are established in the database; the database input subsystem is used for taking the user number and the internet access time of the mobile terminal contained in any one internet access log file as the indexes to determine the first target data storage unit in the database and store the information contained in the internet access log file; and the data query subsystem is used for taking the user number and the query time period information of the to-be-queried mobile terminal contained in a query request as the indexes to determine the second target data storage unit and output the information stored in the second target data storage unit. The internet access data processing system and the method for the mobile terminal realize the storage and query of 3G (The 3rd Generation) internet access data of the mobile terminal and improve the data query efficiency.

Description

The treatment system of mobile terminal Internet access data and method
Technical field
The present invention relates to communication technical field, relate in particular to a kind of treatment system and method for mobile terminal Internet access data.
Background technology
Along with the continuous development of the communication technology, adopt the user of mobile terminal Internet accesses such as smart mobile phone more and more; And the business that provides along with 3G network becomes increasingly abundant, and the online flow that uses the professional mobile phone users of 3G to produce is also increasing.Can estimate that in recent years the flow of the number of users that 3G is professional and these users online all will maintain sustained and rapid growth.
Operator charges according to the of that month online flow that produces of mobile phone users usually.Under some scene,, make smart mobile phone visit 3G network automatically, possibly produce a large amount of online flows thus owing to some smart mobile phone default setting or because of user misoperation or because smart mobile phone is implanted a variety of causes such as trojan horse program; And these online flows cause user's expenses of surfing Internet obviously to increase.
Because 3G Internet data amount is very huge; Lack the inquiry of special Internet data treatment system support user in the prior art to its Internet data; Operator usually only provides the user of statistics the total flow of surfing the Net to the user, and detailed website visiting or professional service recorder is not provided.Therefore, when the complaint incident took place, existing system can not support the contact staff of UNICOM; Propose effective foundation, satisfy mobile subscriber's demand, thereby possibly produce the charging dissension between operator and the mobile phone users; Influence user experience, the reputation of operator is caused to have a strong impact on simultaneously.
Summary of the invention
The present invention provides a kind of treatment system and method for mobile terminal Internet access data, in order to realize the storage and the inquiry of portable terminal 3G Internet data, improves efficiency data query.
The present invention provides a kind of treatment system of mobile terminal Internet access data, comprising:
Data acquisition subsystem is used to obtain the mobile terminal Internet access data flow of SGSN and GGSN of flowing through; According to the said mobile terminal Internet access data flow that preset rules will be obtained, generate at least one internet records file cocurrent and send; Each internet records file comprises: mobile phone users number, surf time information, online flow information, and one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal;
Data storage subsystem is used to store the database that establishes a plurality of data storage cells corresponding with arbitrary mobile phone users number and preset period of time information in advance;
The data loading subsystem; Be used to receive the said internet records file that said data acquisition subsystem sends; The mobile phone users number and the surf time information that comprise with the arbitrary said internet records file that receives are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell;
The data query subsystem; Be used for when receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
The present invention also provides a kind of mobile terminal Internet access processing method of data, comprising:
Obtain the mobile terminal Internet access data flow of flow through SGSN and GGSN;
Said mobile terminal Internet access data flow according to preset rules will be obtained generates at least one internet records file; Each internet records file comprises: mobile phone users number, surf time information, online flow information, and one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal;
In the database that establishes a plurality of data storage cells corresponding in advance with arbitrary mobile phone users number and preset period of time information; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell;
When receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
The treatment system of mobile terminal Internet access data provided by the invention and method; The 3G network mobile terminal Internet access data flow of obtaining is generated at least one internet records file according to preset rules; And with the relevant information of the identical mobile phone users number preset period of time of each internet records file; Be stored in the same data storage cell of database; Effectively solve the mass data storage problem, this database supports that same portable terminal is concentrated in the Internet data of certain time period, fast query simultaneously, in mass data, carries out the related loaded down with trivial details and poor efficiency of data thereby saved; Therefore the present invention has significantly improved the efficient of mobile terminal Internet access data query in the storage and inquiry that realize portable terminal 3G Internet data.Further; Because treatment system and method based on mobile terminal Internet access data provided by the invention; Can the inquiry of 3G Internet data be provided to mobile phone users, therefore, can be the contact staff favourable data support is provided; Help reducing operator and mobile phone users about online charge on traffic dispute, satisfy the mobile subscriber 3G epoch and use demand.
Description of drawings
In order to be illustrated more clearly in the embodiment of the invention or technical scheme of the prior art; To do to introduce simply to the accompanying drawing of required use in embodiment or the description of the Prior Art below; Obviously, the accompanying drawing in describing below only is some embodiments of the present invention, for those of ordinary skills; Under the prerequisite of not paying creative work property, can also obtain other accompanying drawing according to these accompanying drawings.
The structural representation of the treatment system of the mobile terminal Internet access data that Fig. 1 provides for the embodiment of the invention one;
The mobile terminal Internet access processing method of data flow chart that Fig. 2 provides for the embodiment of the invention two;
The Signalling exchange figure of the mobile terminal Internet access processing method of data that Fig. 3 provides for the embodiment of the invention three.
Embodiment
For the purpose, technical scheme and the advantage that make the embodiment of the invention clearer; To combine the accompanying drawing in the embodiment of the invention below; Technical scheme in the embodiment of the invention is carried out clear, intactly description; Obviously, described embodiment is the present invention's part embodiment, rather than whole embodiment.Based on the embodiment among the present invention, those of ordinary skills are not paying the every other embodiment that is obtained under the creative work prerequisite, all belong to the scope of the present invention's protection.
The sequence number of following examples of the present invention is not represented the quality of embodiment just to description.
The structural representation of the treatment system of the mobile terminal Internet access data that Fig. 1 provides for the embodiment of the invention one.System as shown in Figure 1 comprises: data acquisition subsystem 11, data storage subsystem 12, data loading subsystem 13 and data query subsystem 14.
Data acquisition subsystem 11 can be used for obtaining the general packet radio service technology of flowing through (General Packet Radio Service; Be called for short GPRS) serving GPRS support node (Serving GPRS Support Node; Be called for short SGSN) with the mobile terminal Internet access data flow of Gateway GPRS Support Node (Gateway GPRS Support Node, abbreviation GGSN); According to the said mobile terminal Internet access data flow that preset rules will be obtained, generate at least one internet records file cocurrent and give data loading subsystem 13.Each internet records file can comprise: mobile phone users number, surf time information, online flow information etc.; Each internet records file also can comprise one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal etc.; Be appreciated that also can comprise other in the internet records fails the information enumerated here, like response message of the successful failure of used agreement etc.Wherein: the mobile phone users number is the MSISDN (The Mobile Station ISDNnumber) that a certain portable terminal uses; Surf time information can include but not limited to surf the Net and continue the zero hour, online finish time, online the information of duration; The online flow information can include but not limited to that uplink traffic, downlink traffic, up-downgoing total flow etc., online protocol type can include but not limited to WEB agreement, Email related protocol, File Transfer Protocol etc.; Source address information can include but not limited to source IP address and source port number etc.; Destination address information can include but not limited to purpose IP address, purpose URL and destination slogan etc.Above-mentioned SSGN and GGSN are the mobile data core network equipment of 3G network, all Internet data of portable terminal all can flow through SSGN and GGSN in the 3G network, and adopt optical fiber to carry out transfer of data between SSGN and the GGSN.Therefore; The present invention is on the optional implementation of the mobile terminal Internet access data flow of obtaining flow through SGSN and GGSN; Can be through between SSGN and GGSN, disposing optical splitter, will flow through mobile terminal Internet access data beam split on SGSN and the GGSN to data acquisition subsystem 11 through optical splitter.
Data storage subsystem 12 can be used for storing the database that establishes a plurality of data storage cells corresponding with arbitrary mobile phone users number and preset period of time information in advance.
Data loading subsystem 13 can be used for receiving the said internet records file that said data acquisition subsystem sends; The mobile phone users number and the surf time information that comprise with the arbitrary said internet records file that receives are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell.
Data query subsystem 14 is used in when receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
The treatment system of the mobile terminal Internet access data that present embodiment provides; The 3G network mobile terminal Internet access data flow of obtaining is generated at least one internet records file according to preset rules; And with the relevant information of the identical mobile phone users number preset period of time of each internet records file; Be stored in the same data storage cell of database; Effectively solve the mass data storage problem, this database supports that same portable terminal is concentrated in the Internet data of certain time period, fast query simultaneously, in mass data, carries out the related loaded down with trivial details and poor efficiency of data thereby saved; Therefore the present invention has significantly improved the efficient of mobile terminal Internet access data query in the storage and inquiry that realize portable terminal 3G Internet data.Further; Because treatment system and method based on mobile terminal Internet access data provided by the invention; Can the inquiry of 3G Internet data be provided to mobile phone users, therefore, can be the contact staff favourable data support is provided; Help reducing operator and mobile phone users about online charge on traffic dispute, satisfy the mobile subscriber 3G epoch and use demand.
Optional, data acquisition subsystem 11 also can further comprise: shunt 111 and a plurality of acquisition process servers 112 that are connected with said shunt 111 respectively.
Because portable terminal 3G Internet data amount is very huge; In order to improve the efficient of mobile terminal Internet access data acquisition process; A plurality of acquisition process servers 112 can be set in data acquisition subsystem 11, and shunt 111 is according to preset strategy, like the IP address field; The current mobile terminal Internet access data flow of obtaining is diverted to each acquisition process server 112, by the parallel data processing of carrying out of these acquisition process servers.Concrete:
Shunt 111 can be used for obtaining the said mobile terminal Internet access data flow of said SGSN and said GGSN of flowing through; According to second mapping relations between IP address field that obtains in advance and the acquisition process server; In said a plurality of acquisition process servers; Definite corresponding target acquisition process server in IP address that comprises with the current said mobile terminal Internet access data flow of obtaining, and to the current said mobile terminal Internet access data flow of obtaining of said target acquisition process server transmission.
As the arbitrary said acquisition process server 112 of said target acquisition process server, be used for preset rules with the current said mobile terminal Internet access data flow of obtaining, generate at least one said internet records file cocurrent and send.
Further; Arbitrary said acquisition process server 112 as said target acquisition process server; Specifically be used for from the current said mobile terminal Internet access extracting data preset kind information of obtaining and the information of extracting carried out data merging; Surpassing preset duration threshold value if the data length that merges reaches preset file size threshold value or merges lasting duration, is that a said internet records file cocurrent send with the storage that merges then.
Acquisition process server 112 can resolve earlier the mobile terminal Internet access data flow based on protocol type; On the concrete mode that the information that the Internet data of same portable terminal need be extracted in the said mobile terminal Internet access data flow that will obtain and data merge, according to the mobile terminal Internet access data flow based on the difference of protocol type and different.For example: for the mobile terminal Internet access data flow that adopts the GTP agreement; Acquisition process server 112 obtains from this data flow but is not limited to MSISDN, IMSI, user and inserts information such as ground, user base station, and acquisition process server 112 can merge according to the Internet data of these information with same MSISDN; For adopting 7 layers of IP agreement; Mobile terminal Internet access data flow like agreements such as HTTP, FTP, SMTP, POP3; Acquisition process server 112 can and be replied to each request of user for this data flow and carried out data and merge, and can obtain from this data flow but is not limited to ask and the IP address, protocol type, the internet address URL of visit, uplink and downlink flow byte number, the user that the reply information such as time started and concluding time of surfing the Net at every turn; To 4 layers of IP protocol traffic; Mobile terminal Internet access data flow like agreements such as TCP, UDP; Acquisition process server 112 can merge according to preset time length for this data flow; Can obtain from this data flow but be not limited to IP source address, port numbers, IP destination address, port numbers, protocol type, uplink and downlink flow, user's information such as time started and concluding time of surfing the Net.
Technique scheme can portable terminal is huge Internet data carry out piecemeal storage by predetermined policy.Optional, data storage subsystem 13 can further comprise: a plurality of data storage servers 131.Each data storage server 131 is responsible for the mobile terminal Internet access data of the certain mobile phone users number segment of storage and certain online period.
Under this situation; Accordingly; Warehouse-in subsystem 12 specifically can be used for obtaining in advance first mapping relations between data storage server and mobile phone users number segment and the surf time section; According to said first mapping relations, in said a plurality of data storage servers, confirm the mobile phone users number and the first corresponding target data storage server of surf time information that comprise with arbitrary said internet records file; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index; In said a plurality of data storage cells that the said database that the said first target data storage server is stored comprises, confirm the said first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell.
Data query subsystem 14 specifically can be used for obtaining in advance said first mapping relations; When receiving said Internet data query requests; According to said first mapping relations; In said a plurality of data storage servers, confirm to look into the mobile phone users number and to inquire about the second corresponding target data storage server of period information with waiting of comprising of said Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that the said database that the said second target data storage server is stored comprises; Confirm the said second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
In order to improve the search efficiency of mobile terminal Internet access data, each data storage server 131 in the data storage subsystem 13 can adopt the database (being called for short Hbase) based on Hadoop, memory mobile terminal Internet data.Table 1 is the table format example of a kind of optional database storage provided by the invention:
Table 1
Above-mentioned table 1 supports that to go keyword be that index carries out data query; The row keyword is " a mobile phone users number (MSISDN)+time period information (days; YYYYMM) ", for example " 18601234567201109 ", and wherein " 18601234567 " are mobile phone users number (MSISDN); 201109 represent in September, 2011, are time period information.The corresponding data memory cell of each row keyword (MSISDN+YYYYMM) comprises many sub-rows in a data memory cell, every sub-rows is a record item.Each record item is used to store the information that an internet records file comprises, the available different time of different recording item stabs (Timestamp) and identifies.Concrete, there are a plurality of row (Label) in Xiang Weiyi row of each record family (Column Family) under the row family; Partial information in each row storage internet records file for example can include but not limited to: online time started, online concluding time, protocol type, source IP address, purpose IP address, uplink traffic, downlink traffic etc.
After the storage based on the database storage mobile terminal Internet access data of table 1 and similar structures thereof, same mobile phone users number (MSISDN) is left concentratedly in a data memory cell in all Internet data of certain time period.After so handling; The database support is that index carries out same portable terminal and concentrates inquiry in the Internet data of certain time period to go keyword message; Saved and in mass data, carried out the loaded down with trivial details of data association, therefore significantly improved the efficient of mobile terminal Internet access data query.In addition; A plurality of database storage server piecemeal memory mobile terminal Subscriber Number section provided by the invention and the Internet data of time period; And the data memory format that adopts table 1 and similar structures thereof, for the storage of the professional huge Internet data of portable terminal 3G network provides the technical scheme that solves.
In order to reduce the risk of mobile terminal Internet access loss of data, further, said data storage subsystem 13 also can comprise: a plurality of backup data store servers 132.Each data storage server 131 corresponding at least one backup data store server 132; Each backup data store server is used for the said database of the corresponding said data storage server of mirror back-up self 131 storages.After so handling, when a certain data storage server 131 faults, also can obtain corresponding Internet data, thereby reduce the risk of mobile terminal Internet access loss of data through these data storage server 131 corresponding backup data store servers 132.
The mobile terminal Internet access processing method of data flow chart that Fig. 2 provides for the embodiment of the invention two.Method as shown in Figure 2 comprises:
Step 21: the mobile terminal Internet access data flow of obtaining flow through SGSN and GGSN.
Step 22: the said mobile terminal Internet access data flow according to preset rules will be obtained generates at least one internet records file; Each internet records file comprises: mobile phone users number, surf time information, online flow information, and one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal.
Step 23: in the database that establishes a plurality of data storage cells corresponding in advance with arbitrary mobile phone users number and preset period of time information; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell.
Step 24: when receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
In order to improve the acquisition process efficient of mobile terminal Internet access data, optional, the said method of technique scheme also can comprise: IP address field that obtains and second mapping relations between the acquisition process server; After the mobile terminal Internet access data flow of obtaining flow through SGSN and GGSN; According to second mapping relations between IP address field that obtains in advance and the acquisition process server; In a plurality of acquisition process servers, definite corresponding target acquisition process server in IP address that comprises with the current said mobile terminal Internet access data flow of obtaining, and to the current said mobile terminal Internet access data flow of obtaining of said target acquisition process server transmission; Under this situation; The said said mobile terminal Internet access data flow that will obtain according to preset rules generates at least one internet records file, is specially: as the arbitrary said acquisition process server of said target acquisition process server; With the current said mobile terminal Internet access data flow of obtaining, generate at least one said internet records file according to preset rules.
Optional; Arbitrary said acquisition process server as said target acquisition process server; According to preset rules with the current said mobile terminal Internet access data flow of obtaining; Generate at least one said internet records file, specifically can be:, from the current said mobile terminal Internet access data flow of obtaining, extract preset kind information and the information of extracting is carried out the data merging as the arbitrary said acquisition process server of said target acquisition process server; Surpassing preset duration threshold value if the data length that merges reaches preset file size threshold value or merges lasting duration, is a said internet records file with the storage that merges then.
For storage and the search efficiency that improves the mobile terminal Internet access data, optional, the said method of technique scheme also can comprise: obtain first mapping relations between data storage server and mobile phone users number segment and the surf time section.Under this situation; Confirm the said first target data memory cell; Be specially: according to said first mapping relations; In a plurality of data storage servers, confirm the mobile phone users number and the first corresponding target data storage server of surf time information that comprise with arbitrary said internet records file; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index, in said a plurality of data storage cells that the said database that the said first target data storage server is stored comprises, confirm the said first target data memory cell.Accordingly; Confirm the said second target data memory cell; Be specially: when receiving said Internet data query requests; According to said first mapping relations, in said a plurality of data storage servers, confirm to look into the mobile phone users number and to inquire about the second corresponding target data storage server of period information with said Internet data query requests comprises; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that the said database that the said second target data storage server is stored comprises, confirm the said second target data memory cell.
In order to reduce the risk of losing of mobile terminal Internet access data, optional, the said method of technique scheme also can comprise: with the said database of arbitrary said data storage server storage, mirror back-up is at least one backup data store server.
The mobile terminal Internet access processing method of data that present embodiment provides; The 3G network mobile terminal Internet access data flow of obtaining is generated at least one internet records file according to preset rules; And with the relevant information of the identical mobile phone users number preset period of time of each internet records file; Be stored in the same data storage cell of database; Effectively solve the mass data storage problem, this database supports that same portable terminal is concentrated in the Internet data of certain time period, fast query simultaneously, in mass data, carries out the related loaded down with trivial details and poor efficiency of data thereby saved; Therefore the present invention has significantly improved the efficient of mobile terminal Internet access data query in the storage and inquiry that realize portable terminal 3G Internet data.Further; Because treatment system and method based on mobile terminal Internet access data provided by the invention; Can the inquiry of 3G Internet data be provided to mobile phone users, therefore, can be the contact staff favourable data support is provided; Help reducing operator and mobile phone users about online charge on traffic dispute, satisfy the mobile subscriber 3G epoch and use demand.
The Signalling exchange figure of the mobile terminal Internet access processing method of data that Fig. 3 provides for the embodiment of the invention three.The system configuration of present embodiment method correspondence is referring to shown in Figure 1; Concrete, as shown in figures 1 and 3:
Step 31: optical splitter will be flowed through the mobile terminal Internet access data beam split of SGSN and GGSN to shunt.
Step 32: shunt is according to IP address field that obtains in advance and second mapping relations between the acquisition process server; With the current mobile terminal Internet access data that get access to; Be diverted to the corresponding acquisition process server in IP address that comprises with the current said mobile terminal Internet access data flow of obtaining, this acquisition process server is target acquisition process server.
Step 33: the acquisition process server with the current said mobile terminal Internet access data flow of obtaining, generates at least one internet records file according to preset rules.
Step 34: the acquisition process server sends to the data loading subsystem with the internet records file that generates.
Step 35: the data loading subsystem moves into library, the interface of this warehouse-in program poll native system and each acquisition process server, and to determine whether the receiving internet records file, if receive the internet records file, then execution in step 36.
Step 36: the data loading subsystem is an index with mobile phone users number and the surf time information that current reception internet records file comprises, in the Hbase of data query subsystem stores database, confirms the first target data memory cell; The newly-increased information that writes down item, also the current internet records file that receives is comprised writes in the newly-increased record item in the said first target data memory cell.
Step 37: tentation data inquiry subsystem receives the Internet data query requests; This Internet data query requests can by but be not limited to contact staff or mobile phone users and send, can include but not limited to: wait to look into mobile phone users number and inquiry period information.
Step 38: the data query subsystem obtains the required information of online query requests to data storage subsystem; Optional; The data query subsystem waits that with what the current Internet data query requests that receives comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that the database of data query subsystem stores comprises, confirm the second target data memory cell, and export the current said record item canned data that comprises of the said second target data memory cell.
The mobile terminal Internet access processing method of data that present embodiment provides; When having realized storage and the inquiry of portable terminal 3G Internet data; And significantly improved the efficient of mobile terminal Internet access data query; Its detailed mechanism is described and can be repeated no more at this referring to the record of above-mentioned Fig. 1 or the corresponding embodiment of Fig. 2.
One of ordinary skill in the art will appreciate that: accompanying drawing is the sketch map of an embodiment, and module in the accompanying drawing or flow process might not be that embodiment of the present invention is necessary.
One of ordinary skill in the art will appreciate that: the module in the device among the embodiment can be described according to embodiment and be distributed in the device of embodiment, also can carry out respective change and be arranged in the one or more devices that are different from present embodiment.The module of the foregoing description can be merged into a module, also can further split into a plurality of submodules.
What should explain at last is: above embodiment is only in order to explaining technical scheme of the present invention, but not to its restriction; Although with reference to previous embodiment the present invention has been carried out detailed explanation, those of ordinary skill in the art is to be understood that: it still can be made amendment to the technical scheme that aforementioned each embodiment put down in writing, and perhaps part technical characterictic wherein is equal to replacement; And these are revised or replacement, do not make the spirit and the scope of the essence disengaging various embodiments of the present invention technical scheme of relevant art scheme.

Claims (10)

1. the treatment system of mobile terminal Internet access data is characterized in that, comprising:
Data acquisition subsystem is used to obtain the mobile terminal Internet access data flow of SGSN and GGSN of flowing through; According to the said mobile terminal Internet access data flow that preset rules will be obtained, generate at least one internet records file cocurrent and send; Each internet records file comprises: mobile phone users number, surf time information, online flow information, and one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal;
Data storage subsystem is used to store the database that establishes a plurality of data storage cells corresponding with arbitrary mobile phone users number and preset period of time information in advance;
The data loading subsystem; Be used to receive the said internet records file that said data acquisition subsystem sends; The mobile phone users number and the surf time information that comprise with the arbitrary said internet records file that receives are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell;
The data query subsystem; Be used for when receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
2. system according to claim 1 is characterized in that,
Said data storage subsystem comprises: a plurality of data storage servers;
Said warehouse-in subsystem; Specifically be used for obtaining in advance first mapping relations between data storage server and mobile phone users number segment and the surf time section; According to said first mapping relations; In said a plurality of data storage servers, confirm the mobile phone users number and the first corresponding target data storage server of surf time information that comprise with arbitrary said internet records file; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index; In said a plurality of data storage cells that the said database that the said first target data storage server is stored comprises, confirm the said first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell;
Said data query subsystem; Specifically be used for obtaining in advance said first mapping relations; When receiving said Internet data query requests; According to said first mapping relations, in said a plurality of data storage servers, confirm to look into the mobile phone users number and to inquire about the second corresponding target data storage server of period information with waiting of comprising of said Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that the said database that the said second target data storage server is stored comprises; Confirm the said second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
3. system according to claim 2 is characterized in that,
Said data storage subsystem also comprises: a plurality of backup data store servers;
Corresponding at least one the said backup data store server of arbitrary said data storage server;
Said backup data store server is used for the said database that the corresponding said data storage server of mirror back-up self is stored.
4. system according to claim 1 is characterized in that,
Said data acquisition subsystem comprises: shunt and a plurality of acquisition process servers that are connected with said shunt respectively;
Said shunt; Be used to obtain the said mobile terminal Internet access data flow of said SGSN and said GGSN of flowing through; According to second mapping relations between IP address field that obtains in advance and the acquisition process server; In said a plurality of acquisition process servers, definite corresponding target acquisition process server in IP address that comprises with the current said mobile terminal Internet access data flow of obtaining, and to the current said mobile terminal Internet access data flow of obtaining of said target acquisition process server transmission;
As the arbitrary said acquisition process server of said target acquisition process server, be used for preset rules with the current said mobile terminal Internet access data flow of obtaining, generate at least one said internet records file cocurrent and send.
5. system according to claim 4 is characterized in that,
Arbitrary said acquisition process server as said target acquisition process server; Specifically be used for from the current said mobile terminal Internet access extracting data preset kind information of obtaining and the information of extracting carried out data merging; Surpassing preset duration threshold value if the data length that merges reaches preset file size threshold value or merges lasting duration, is that a said internet records file cocurrent send with the storage that merges then.
6. a mobile terminal Internet access processing method of data is characterized in that, comprising:
Obtain the mobile terminal Internet access data flow of flow through SGSN and GGSN;
Said mobile terminal Internet access data flow according to preset rules will be obtained generates at least one internet records file; Each internet records file comprises: mobile phone users number, surf time information, online flow information, and one of following information or combination in any: the type of online protocol type, source address information, destination address information, portable terminal;
In the database that establishes a plurality of data storage cells corresponding in advance with arbitrary mobile phone users number and preset period of time information; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index, in said a plurality of data storage cells that said database comprises, confirm the first target data memory cell; The newly-increased information that writes down item, also arbitrary said internet records file is comprised writes in the newly-increased said record item in the said first target data memory cell;
When receiving the Internet data query requests; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that said database comprises, confirm the second target data memory cell, and export the current said record canned data that comprises of the said second target data memory cell.
7. method according to claim 6 is characterized in that,
Said method also comprises: obtain first mapping relations between data storage server and mobile phone users number segment and the surf time section;
Confirm the said first target data memory cell; Be specially: according to said first mapping relations; In a plurality of data storage servers, confirm the mobile phone users number and the first corresponding target data storage server of surf time information that comprise with arbitrary said internet records file; The mobile phone users number and the surf time information that comprise with arbitrary said internet records file are index, in said a plurality of data storage cells that the said database that the said first target data storage server is stored comprises, confirm the said first target data memory cell;
Confirm the said second target data memory cell; Be specially: when receiving said Internet data query requests; According to said first mapping relations; In said a plurality of data storage servers, confirm to look into the mobile phone users number and to inquire about the second corresponding target data storage server of period information with said Internet data query requests comprises; Wait that with what said Internet data query requests comprised looking into the mobile phone users number is index with the inquiry period information; In said a plurality of data storage cells that the said database that the said second target data storage server is stored comprises, confirm the said second target data memory cell.
8. method according to claim 7 is characterized in that, also comprises:
With the said database of arbitrary said data storage server storage, mirror back-up is at least one backup data store server.
9. method according to claim 6 is characterized in that,
Said method also comprises: IP address field that obtains and second mapping relations between the acquisition process server; After the mobile terminal Internet access data flow of obtaining flow through SGSN and GGSN; According to second mapping relations between IP address field that obtains in advance and the acquisition process server; In a plurality of acquisition process servers; Definite corresponding target acquisition process server in IP address that comprises with the current said mobile terminal Internet access data flow of obtaining, and to the current said mobile terminal Internet access data flow of obtaining of said target acquisition process server transmission;
The said said mobile terminal Internet access data flow that will obtain according to preset rules; Generate at least one internet records file; Be specially: as the arbitrary said acquisition process server of said target acquisition process server; With the current said mobile terminal Internet access data flow of obtaining, generate at least one said internet records file according to preset rules.
10. method according to claim 9 is characterized in that,
Arbitrary said acquisition process server as said target acquisition process server; According to the Internet data that belongs to same portable terminal in the current said mobile terminal Internet access data flow of obtaining; Generate at least one said internet records file; Be specially: as the arbitrary said acquisition process server of said target acquisition process server; From the current said mobile terminal Internet access data flow of obtaining, extracting preset kind information and the information of extracting is carried out the data merging, surpass preset duration threshold value if the data length that merges reaches preset file size threshold value or merges lasting duration, is a said internet records file with the storage that merges then.
CN2011103731823A 2011-11-22 2011-11-22 Internet access data processing system and method for mobile terminal Pending CN102510568A (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
CN2011103731823A CN102510568A (en) 2011-11-22 2011-11-22 Internet access data processing system and method for mobile terminal

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CN2011103731823A CN102510568A (en) 2011-11-22 2011-11-22 Internet access data processing system and method for mobile terminal

Publications (1)

Publication Number Publication Date
CN102510568A true CN102510568A (en) 2012-06-20

Family

ID=46222614

Family Applications (1)

Application Number Title Priority Date Filing Date
CN2011103731823A Pending CN102510568A (en) 2011-11-22 2011-11-22 Internet access data processing system and method for mobile terminal

Country Status (1)

Country Link
CN (1) CN102510568A (en)

Cited By (13)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833668A (en) * 2012-08-20 2012-12-19 中国联合网络通信集团有限公司 Data traffic reminding method and data traffic reminding device
CN102833241A (en) * 2012-08-20 2012-12-19 中国联合网络通信集团有限公司 Streaming media service traffic record merged-processing method and device
CN103617275A (en) * 2013-12-06 2014-03-05 中国联合网络通信集团有限公司 Internet-surfing detailed record query method and system for mobile terminal
CN104506394A (en) * 2015-01-08 2015-04-08 中国联合网络通信集团有限公司 Method and system for statistics of mobile internet flows
CN104618948A (en) * 2015-02-12 2015-05-13 中国联合网络通信集团有限公司 File uploading monitoring method and system
CN104796322A (en) * 2015-03-25 2015-07-22 腾讯科技(深圳)有限公司 Message processing method and equipment
CN104811482A (en) * 2015-04-01 2015-07-29 广东小天才科技有限公司 Classifying storing method and system for terminal data
CN105142125A (en) * 2015-07-27 2015-12-09 中国联合网络通信集团有限公司 Method and device for realizing traffic record processing
CN107103014A (en) * 2016-10-11 2017-08-29 阿里巴巴集团控股有限公司 The replay method of history pushed information, device and system
CN110134702A (en) * 2019-05-17 2019-08-16 北京百度网讯科技有限公司 Data flow joining method, device, equipment and storage medium
CN112579302A (en) * 2020-12-28 2021-03-30 南昌工程学院 Big data-based data processing terminal and processing system thereof
CN113301556A (en) * 2021-05-12 2021-08-24 中国联合网络通信集团有限公司 User internet access record storage method, system and server
CN114286203A (en) * 2021-12-22 2022-04-05 深圳供电局有限公司 Electric meter nuclear data shunting processing system and method based on big data

Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5983218A (en) * 1997-06-30 1999-11-09 Xerox Corporation Multimedia database for use over networks
CN1400532A (en) * 2001-07-31 2003-03-05 威达电股份有限公司 Network centralized storage system and its server and switching device
CN101079036A (en) * 2006-06-23 2007-11-28 腾讯科技(深圳)有限公司 Storage method and system for mass file
CN101330431A (en) * 2007-06-19 2008-12-24 阿里巴巴集团控股有限公司 Method and system for storing instant information
CN101572881A (en) * 2009-06-18 2009-11-04 浙江大学 Equipment management method in TD-SCDMA
WO2010006203A2 (en) * 2008-07-09 2010-01-14 Qualcomm Incorporated X2 interfaces for access point base stations in self-organizing networks (son)
CN102054000A (en) * 2009-10-28 2011-05-11 中国移动通信集团公司 Data querying method, device and system

Patent Citations (7)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5983218A (en) * 1997-06-30 1999-11-09 Xerox Corporation Multimedia database for use over networks
CN1400532A (en) * 2001-07-31 2003-03-05 威达电股份有限公司 Network centralized storage system and its server and switching device
CN101079036A (en) * 2006-06-23 2007-11-28 腾讯科技(深圳)有限公司 Storage method and system for mass file
CN101330431A (en) * 2007-06-19 2008-12-24 阿里巴巴集团控股有限公司 Method and system for storing instant information
WO2010006203A2 (en) * 2008-07-09 2010-01-14 Qualcomm Incorporated X2 interfaces for access point base stations in self-organizing networks (son)
CN101572881A (en) * 2009-06-18 2009-11-04 浙江大学 Equipment management method in TD-SCDMA
CN102054000A (en) * 2009-10-28 2011-05-11 中国移动通信集团公司 Data querying method, device and system

Cited By (22)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CN102833241B (en) * 2012-08-20 2015-05-20 中国联合网络通信集团有限公司 Streaming media service traffic record merged-processing method and device
CN102833668B (en) * 2012-08-20 2015-04-08 中国联合网络通信集团有限公司 Data traffic reminding method and data traffic reminding device
CN102833241A (en) * 2012-08-20 2012-12-19 中国联合网络通信集团有限公司 Streaming media service traffic record merged-processing method and device
CN102833668A (en) * 2012-08-20 2012-12-19 中国联合网络通信集团有限公司 Data traffic reminding method and data traffic reminding device
CN103617275A (en) * 2013-12-06 2014-03-05 中国联合网络通信集团有限公司 Internet-surfing detailed record query method and system for mobile terminal
CN104506394B (en) * 2015-01-08 2018-09-11 中国联合网络通信集团有限公司 A kind of mobile Internet flow statistical method and system
CN104506394A (en) * 2015-01-08 2015-04-08 中国联合网络通信集团有限公司 Method and system for statistics of mobile internet flows
CN104618948A (en) * 2015-02-12 2015-05-13 中国联合网络通信集团有限公司 File uploading monitoring method and system
CN104618948B (en) * 2015-02-12 2018-09-28 中国联合网络通信集团有限公司 The method and system of transmitting file in a kind of monitoring
CN104796322B (en) * 2015-03-25 2018-11-06 腾讯科技(深圳)有限公司 A kind of message treatment method and its equipment
CN104796322A (en) * 2015-03-25 2015-07-22 腾讯科技(深圳)有限公司 Message processing method and equipment
CN104811482A (en) * 2015-04-01 2015-07-29 广东小天才科技有限公司 Classifying storing method and system for terminal data
CN105142125A (en) * 2015-07-27 2015-12-09 中国联合网络通信集团有限公司 Method and device for realizing traffic record processing
CN105142125B (en) * 2015-07-27 2019-06-07 中国联合网络通信集团有限公司 A kind of method and device for realizing discharge record processing
CN107103014A (en) * 2016-10-11 2017-08-29 阿里巴巴集团控股有限公司 The replay method of history pushed information, device and system
CN110134702A (en) * 2019-05-17 2019-08-16 北京百度网讯科技有限公司 Data flow joining method, device, equipment and storage medium
CN112579302A (en) * 2020-12-28 2021-03-30 南昌工程学院 Big data-based data processing terminal and processing system thereof
CN112579302B (en) * 2020-12-28 2024-03-01 南昌工程学院 Data processing terminal and processing system based on big data
CN113301556A (en) * 2021-05-12 2021-08-24 中国联合网络通信集团有限公司 User internet access record storage method, system and server
CN113301556B (en) * 2021-05-12 2022-10-28 中国联合网络通信集团有限公司 User internet access record storage method, system and server
CN114286203A (en) * 2021-12-22 2022-04-05 深圳供电局有限公司 Electric meter nuclear data shunting processing system and method based on big data
CN114286203B (en) * 2021-12-22 2024-03-29 深圳供电局有限公司 Electric meter nuclear data distribution processing system and method based on big data

Similar Documents

Publication Publication Date Title
CN102510568A (en) Internet access data processing system and method for mobile terminal
CN104380278B (en) Equipment, system and method for client-side management session continuity
CN103188270B (en) Method, device and system for accessing recommended server to IP address
CN101674314B (en) Information sharing method, data server and terminal
CN102831170B (en) The method for pushing of activity information and device
US20160164773A1 (en) Systems and methods for faster download of digital content in mobile wireless devices
CN103188260A (en) Method of implementing content-centric network (CCN) using internet protocol (IP)-based network in gateway, and gateway
CN101883111B (en) Accounting server for processing online business log and method thereof
CN103563414A (en) Mobile network operator identification
US9973470B2 (en) Systems and methods for faster download of digital content in mobile wireless devices
US11490437B2 (en) Method and system for providing communication services using a plurality of remote subscriber identity modules
US8903972B2 (en) Method and apparatus for sharing contents using information of group change in content oriented network environment
CN104394193A (en) A sharing method and device for Cloud SIM cards
CN106357539B (en) A kind of data capture method and equipment
CN102148881A (en) Address processing method and device
US20230300599A1 (en) Method and system for providing communication services using a plurality of remote subscriber identity modules
CN109087096B (en) Block chain account checking method, device, equipment and storage medium
CN106982126B (en) Resource sharing charging method and charging device, and memory bank
CN101873580B (en) Download method of business application and business application management platform system
US11622261B2 (en) Method and system for providing communication services using a plurality of remote subscriber identity modules
CN107733767B (en) Method, device and system for establishing social relationship network
CN104902542B (en) A kind of information sharing method and mobile communication terminal
CN107105425A (en) Network access method and network access device
CN115706727A (en) Cloud desktop data migration method, node and server
CN102497402A (en) Content injection method and system thereof, and content delivery method and system thereof

Legal Events

Date Code Title Description
C06 Publication
PB01 Publication
C10 Entry into substantive examination
SE01 Entry into force of request for substantive examination
AD01 Patent right deemed abandoned

Effective date of abandoning: 20120620

C20 Patent right or utility model deemed to be abandoned or is abandoned