WO2004070500A2 - Method and system for mapping xml to n-dimensional data structure - Google Patents

Method and system for mapping xml to n-dimensional data structure Download PDF

Info

Publication number
WO2004070500A2
WO2004070500A2 PCT/GB2004/000243 GB2004000243W WO2004070500A2 WO 2004070500 A2 WO2004070500 A2 WO 2004070500A2 GB 2004000243 W GB2004000243 W GB 2004000243W WO 2004070500 A2 WO2004070500 A2 WO 2004070500A2
Authority
WO
WIPO (PCT)
Prior art keywords
dimension
array
data
result
elements
Prior art date
Application number
PCT/GB2004/000243
Other languages
French (fr)
Other versions
WO2004070500A3 (en
Inventor
James Lewis Hollingsworth
Original Assignee
International Business Machines Corporation
Ibm United Kingdom Limited
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by International Business Machines Corporation, Ibm United Kingdom Limited filed Critical International Business Machines Corporation
Priority to DE602004008742T priority Critical patent/DE602004008742T2/en
Priority to EP04704280A priority patent/EP1590749B1/en
Publication of WO2004070500A2 publication Critical patent/WO2004070500A2/en
Publication of WO2004070500A3 publication Critical patent/WO2004070500A3/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/25Integrating or interfacing systems involving database management systems
    • G06F16/258Data format conversion from or to a database
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/953Organization of data
    • Y10S707/957Multidimensional
    • YGENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10STECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00Data processing: database and file management or data structures
    • Y10S707/99941Database schema or data structure
    • Y10S707/99943Generating database or data structure, e.g. via user interface

Definitions

  • This invention relates to methods and processes for translating data from one format or programming paradigm to another programming format or paradigm, and especially to methods for converting Extensible Markup Language data structures to COBOL data structures .
  • COBOL Common Business Oriented Language
  • COBOL is one of the oldest high-level computer programming languages still in widespread use today. Like other programming languages, COBOL is designed to allow development of computer programs that perform specific purposes and tasks. COBOL is especially well suited for business data processing tasks, as opposed to scientific or engineering data processing tasks.
  • Business oriented data is characterized by " transactions " , often which are either reflections of manually-conducted activities (e.g. sales, deposits, withdrawals, etc.) or reflections of automatically-conducted activities (e.g. compounding of interest on a principal amount) .
  • a common "output" of business-oriented tasks is a "report” . As such, COBOL is tailored to collect, organize, validate, update, process and report with respect to business-oriented data.
  • COBOL COBOL
  • IBM's International Business Machine's
  • CICS Customer Information Control System
  • IMS IBM's Information Management System
  • COBOL remains an important technology, and problems arising from interfacing and interacting COBOL resources with newer- echnology resources (e.g. applets, servlets, etc.) must be addressed as inventively as any other "cutting edge" technology problem.
  • newer- echnology resources e.g. applets, servlets, etc.
  • any other "cutting edge" technology problem e.g., and inefficient solution to .a COBOL problem which is executed 20 billion times per day accumulates to massive wasted processing bandwidth, memory and storage waste, and communication inefficiencies.
  • COBOL applications e.g. business transactions
  • results manifest themselves as increased costs, latency to complete transactions, and reduced profits.
  • Data Mining The more modern concept of "Data Mining” can be summarized as the ability to re-use business application logic from existing application programs to solve business problems in the future.
  • Data Mining implementations exist in varying degrees of sophistication.
  • a simple application refacing solution may use a Web browser connected to a Web Server, which in turn accesses data from a transaction-processing server using an Extensible Markup Language (“XML”) interface.
  • XML Extensible Markup Language
  • B2B business-to-business
  • XML-based servers will enable the evolution of Web Services to access older "legacy"- data such that a business can greatly extend its reach to customers over time while continuously updating, upgrading, and migrating its business application programs to offer enhanced services and products with ever-increasing cost and response efficiencies.
  • the networked economy is driving the businesses from rigidly designed business computing systems to employ flexible application design on scalable computing platforms, from static to dynamic interaction between partners, and from technology integration to business integration.
  • a customer information record could be defined as shown in Table 2, wherein the customer name may have up to 30 characters, the telephone number 10 digits, and the account number 18 alphanumeric characters .
  • This type of customer data is often organized into arrays or tables of information, such as arrangements employed by relational database application programs .
  • a one-dimensional array T beginning at memory location X, containing six elements e, where each element is four characters in length, is defined in a COBOL program as follows:
  • Figure 1 shows the table represented by this data structure definition.
  • COBOL organizes data into arrays according to their definitions with respect to size (e.g. dimension) and field types. Multiple methods of declaring such tables, however, may result in different actual run time implementations of the data structure, especially with respect to the physical organization of the data when stored in memory.
  • Table 3 shows an example single-index (e.g. mono-dimension) array in COBOL, in which an 8-character alphanumeric field is defined in an array of seven fields .
  • COBOL allows for multi-dimensional tables to be defined essentially as tables of tables, as shown in Table 5.
  • each order is tracked for 15 orders (each with an order number) , with each order having up to 25 items listed or described using up to 45 characters in each item description.
  • this is realized as 15 tables of 25 fields, further organized into an array of 100 tables (e.g. 100 x 15 x 25) .
  • Multidimensional COBOL tables are stored in row major order, in which rows are, placed one after another in memory, as is described in the text "Data Structures & Their Algorithms" by Harry R. Lewis and Larry Denenberg (HarperCollins, 1991) .
  • the row is defined as the first index, where a table having three dimensions and indexed by the 3-tuple (x, y, z) , x is the index for the row.
  • a two-dimensional array T beginning at memory location X containing two rows and three columns, where each element (x) is two characters in length, and each element (y) is four characters in length, as defined in a COBOL program with the three COBOL statements:
  • Figure 2 depicts how this structure is represented as a table in contiguous storage.
  • This method of storage provides an efficient means for fast access of the table elements, located in main memory, by the application program but can be inefficient for long term storage and retrieval, where storage space is at a premium.
  • databases may store sparse arrays (partially filled arrays) by using linked lists or a hierarchical table of pointers.
  • the application program may decide to store the array elements • - in a database.
  • An XML document request can originate from an external source (e.g. another company, another agency, another enterprise, etc.), or it can be generated by a network server that requires an XML interface to access mainframe applications .
  • Mapping an XML document to COBOL data structures is distinct from the challenge of developing algorithms for the efficient storage and retrieval of XML documents on mass media.
  • mapping XML documents that may have multi-dimensional table or array data. This requirement, though, is actually very common. For example, a system for displaying information about an athletic sport league might use an XML document to display statistics for an individual player, within a team, within a conference, within a division, and within a league. The resulting structure would be a 4-dimensional array.
  • NBL National Football League
  • the NFL divisions are the first dimension (w)
  • the conferences are the second dimension ⁇ x)
  • the teams are the third dimension (y)
  • the players are the fourth dimension (z) . If a team name is parsed from the XML document containing the relevant statistics, the following procedure must be followed to map the team name into the result array:
  • the tag name can be used to determine that team._name belongs to the teams dimension (the third dimension) .
  • the target dimension array index is the value for y.
  • the system searches for the first empty fc®a ⁇ -_ ⁇ ,aaa.® bucket in the target dimension (y) . If this is the third team that we have processed in the AFC East, then the third bucket will be empty, and the target dimension array index will be 3.
  • n-dimensional array data initially represented in markup language
  • target data ⁇ -dimension table
  • a system for mapping markup language n-dimensional array data ("source data”) to an n-dimension table (“target data”) suitable for use by business application programs comprising: (a) a searchable repository which contains metadata information about a result array structure and one or more result array data elements; (b) a source data parser configured to find a first or next tag name within said source data; (c) an array dimension processor configured to perform the following steps if a found tag name corresponds to an array name: (i) setting a dimension counter to the new result array dimension; (ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements; (iii) setting a dimension field count to 1; and (iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result; (d) an array element processor configured to perform the following steps if a found tag name
  • a computer readable medium encoded with software for mapping n-dimensional array data ("source data") initially represented in markup language to an n-dimension table (“target data”) suitable for use by business application programs, said software performing the steps of: (a) establishing a searchable repository which contains metadata information about a result array structure and one or more result array data elements; (b) parsing said source data to find a first or next tag name; (c) if a found tag name corresponds to an array name, then performing the steps of: (i) setting a dimension counter to the new result array dimension; (ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements; (iii) setting a dimension field count to 1; and (iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result; (d) if a found tag name corresponds to an arra
  • Figure 1 provides a tabular illustration of a one-dimensional array.
  • Figure 2 likewise provides an illustration of the linear nature which COBOL uses to store tabular data.
  • Figure 3 illustrates the hierarchical organization of XML data structures .
  • Figure 4 depicts the first step of our tilted tree, spinning cones process in which the squared groups within the hierarchy are replaced with cones .
  • Figure 5 shows a subsequent step of our tilted tree, spinning cones process in which the tree is tilted to bring in into congruence with one of the two axes (a mapping axis) in the graph.
  • Figure 6 illustrates the spinning action of our tilted tree, spinning cones process which allows each member of each group (e.g. each array) in the hierarchy to be brought into contact with the mapping axis of the graph.
  • the new tilting tree, spinning cones process can be employed to efficiently map multi-dimensional array data contained in markup language documents, such as XML, to data structures suitable for use by COBOL application programs .
  • the process maps the data in a significantly more efficient manner, thereby allowing more data to be mapped with reduced processing resources.
  • a two-dimensional inverted tree structure using cones to represent the XML arrays is virtualized, which achieves mapping the n-dimensional XML data to a two-dimensional representation.
  • the inverted cone tree is repositioned on the two-dimensional graph by tilting it so that one array (cone) member in each dimension lays flat against an axis, such as the y-axis. This axis is now referred to as the mapping axis .
  • the dimensions in the XML structure correspond to y-axis segments .
  • every member of every array can be brought into contact with the mapping axis.
  • the dimension segments- of the mapping axis can be represented as a one-dimensional or linearly organized array, suitable for COBOL application programs.
  • the present invention is preferrably embodied in computer programs which provide interfacing of n-dimensional data structures between formats such as Extensible Markup Language (“XML”) and structured programming formats such as COBOL.
  • XML Extensible Markup Language
  • COBOL Structured Markup Language
  • the present invention may be embodied as software in a high level language (COBOL, C, C++, Java, etc.), low level or assembly language, or even in programmable or fixed-design firmware and logic for use in computing systems such as enterprise servers .
  • the Generic Converter solution has now been further enhanced with an XML interface containing our inventive "tilting tree, spinning cones" process. This enables Java- developers to be solution participants by providing WebSphere Java clients. This is the subject of the present embodiment .
  • n-dimensional arrays are represented in XML.
  • the .structure of an XML document is typically illustrated as an inverted tree (30) ' , as ' shown in Figure 3.
  • the following example shows a graphed XML structure according to our NFL example, with League as the root element, Divisions as the first dimension array, Conferences as the second dimensional array, Teams as the third dimension array, and Players as the fourth dimension array (32) . It can be seen from this diagram that all elements of the XML document may be represented in a two-dimensional space in this manner. This is true without regard to the number of dimensions (y-axis) or the size of an individual array (x-axis) .
  • the result array might be pre-loaded with state data prior to parsing and mapping XML document array elements . Therefore, it would be unreliable to use the result array to determine the mapping of a parsed XML document array element based on the presence of data in the result array.
  • an n-dimensional result array can be represented in a two-dimensional space, which makes it possible to create a mirror array of the n-dimensional result array that can be used for mapping.
  • an inverted tree structure (40) similar to that shown in Figure 3, may also be illustrated using cones (41) to represent the arrays, as shown in Figure 4.
  • the inverted cone tree is repositioned on the graph by tilting it so that one array (cone) member in each dimension lays flat against an axis.
  • the dimensions (32) in the XML structure (41') correspond to y-axis segments, as shown in Figure 5.
  • mapping axis as illustrated in Figure 6.
  • the dimension segments of the mapping axis can be represented as a one-dimensional array.
  • a mapping array is required with 4 element groups, one group for each dimension. Each group would contain:
  • mapping array group at each dimension holds information pertaining to the cone that is currently spun into contact (e.g. rotationally positioned to align) with the mapping axis . Parsing and mapping begin with the XML document root element, and proceeds by parsing down to cones at successively lower dimensions. Cone elements are mapped as they are encountered.
  • the mapping array is shifted up one dimension to spin a new Teams cone into place, repeating the process until all cones in the n-dimensional array have been processed.
  • a SAX (Standard API for XML) parser starts parsing at the beginning of the XML document.
  • the SAX parser is event driven, meaning that when an XML tag name is found (an event) , control is given to our tilting tree, spinning cones process for element mapping.
  • the mapping array has two associated control values .
  • the dimension counter indicates the current dimension level being processed for the multi-dimension result array.
  • the dimension array offset is the offset into the array for the beginning of the dimension currently being processed. The fact that the mapping array is one-dimensional is made possible by the concept of tilting the tree into the mapping array axis. Remember, the tree is a two-dimensional representation of the multi-dimensional source array.
  • An in-memory repository contains metadata information about the result array structure and result array data elements.
  • the repository is searched for a match of the XML tag name.
  • tag name corresponds to an array name (i.e. DIVISION, CONFERENCE, TEAM,, or TEAM-PLAYER) , then:
  • the dimension counter is set to the new result array dimension (this corresponds to spinning a cone into contact with the mapping array) ;
  • mapping array is loaded with the array tag name, total length of all elements at this and higher dimensions ( dimension group length) , and maximum array elements;
  • the dimension field count is set to 1 so that the next XML data element for this dimension will be mapped to the first slot
  • the dimension array offset is calculated by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result.
  • tag name corresponds to an array element (i.e. DIVISION-NAME, CONFERENCE-NAME, TEAM-NAME, TEAM-GAMES-PLAYED, PLAYER-NAME, or PLAYER-GAMES-PLAYED), then:
  • the corresponding tag value is stored in the result slot indicated by the dimension field count plus the dimension array offset (element storing is performed in conjunction with the repository, which contains the element result array offset for slot 1, element length, and element type (alphanumeric, numeric , etc . ) ) ;
  • TEAM-LOCATION is an element of the TEAM array, but follows the higher dimension array for TEAM-PLAYER.
  • CONFERENCE-BOARD array is an array of equal dimension to the CONFERENCE array, both under the DIVISION array, and follows the higher level arrays of TEAM and TEAM- LAYER.
  • the new tilting tree, spinning cones process can be employed to efficiently map multi-dimensional array data contained in markup language documents, such as XML, to data structures suitable for use by COBOL application programs.
  • the process maps the data in a significantly more efficient manner, thereby allowing more data to be mapped with reduced processing resources.
  • a two-dimensional inverted tree structure using cones to represent the XML arrays is virtualized, which achieves mapping the n-dimensional XML data to a two-dimensional representation.
  • the inverted cone tree is repositioned on the two-dimensional graph by tilting it so that one array (cone) member in each dimension lays flat against an axis, such as the y-axis. This axis is now referred to as the mapping axis .
  • mapping axis can be represented as a one-dimensional or linearly organized array, suitable for COBOL application programs.

Abstract

A tilting tree, spinning cones process is employed to map n-dimensional array data originally in markup language, to an n-dimension table suitable for use by COBOL application programs. Mapping is performed without scanning the result array for an empty slot. This allows the result array slots to be pre-loaded with state data. During mapping, the hierarchical nature of the markup language n-dimensional data is represented in two-dimensions using an inverted tree structure having cones for each array level. The tree is tilted to bring a member of a given level into contact with one of the axes of the tree graph, followed by spinning appropriate cones to bring a certain member of that level into contact with the same axis. This results in the ability to use a one-dimensional mapping array. The dimension offset on the mapping axis can then be used as an index value into the mapped array output for storage or retrieval of element data.

Description

METHOD AND SYSTEM FOR MAPPING XML TO Iff-DIMENSIONAL DATA STRUCTURE
BACKGROUND OF THE INVENTION
Field of the Invention
This invention relates to methods and processes for translating data from one format or programming paradigm to another programming format or paradigm, and especially to methods for converting Extensible Markup Language data structures to COBOL data structures .
Background of the Invention
Common Business Oriented Language or "COBOL" is one of the oldest high-level computer programming languages still in widespread use today. Like other programming languages, COBOL is designed to allow development of computer programs that perform specific purposes and tasks. COBOL is especially well suited for business data processing tasks, as opposed to scientific or engineering data processing tasks. Business oriented data is characterized by " transactions " , often which are either reflections of manually-conducted activities (e.g. sales, deposits, withdrawals, etc.) or reflections of automatically-conducted activities (e.g. compounding of interest on a principal amount) . A common "output" of business-oriented tasks is a "report" . As such, COBOL is tailored to collect, organize, validate, update, process and report with respect to business-oriented data.
As COBOL was originally targeted to and executed by large "mainframe" business computers, it was one of the original languages employed in the "client-server" topologies of 20 to 30 years ago. As evolution of computing has brought processing paradigms full circle with the advent of "thin clients", networked servers, wide area networks and the Internet, "client-server" architectures are once again in favor, albeit the "clients" are now commonly web browser computers, and the servers are many thousands of times more capable in processing bandwidth, storage capacity, and communications capabilities .
COBOL, and related products and systems such as International Business Machine's ("IBM's") Customer Information Control System ("CICS"), and IBM's Information Management System ("IMS") are well known in the industry, being employed in business and government enterprises ranging from banking, finance, investment, insurance, to manufacturing and service operations .
As newer programming languages such as object-oriented languages including "C", "C++", and Sun Microsystem's Java [TM] , have found widespread acceptance in the software industry, some may be led to believe that COBOL, IMS, CICS, and similar products and languages are of limited future value. Regardless of whether COBOL, CICS, and IMS/DC are recognized as strategic products, from a business case perspective, there are literally billions of lines of COBOL business application code in use today. While Java has now become the application development language of choice, until recently COBOL was the main application development language, in use since the early 1970' s, in both CICS and IMS/DC transaction processing environments. For example, in 1999, the IBM Hursley (United Kingdom) development laboratory estimated that more than 20 billion transactions per day were processed in IBM's customers' CICS installations worldwide. Therefore, COBOL remains an important technology, and problems arising from interfacing and interacting COBOL resources with newer- echnology resources (e.g. applets, servlets, etc.) must be addressed as inventively as any other "cutting edge" technology problem. For example, and inefficient solution to .a COBOL problem which is executed 20 billion times per day accumulates to massive wasted processing bandwidth, memory and storage waste, and communication inefficiencies. By the very nature of COBOL applications (e.g. business transactions) , such results manifest themselves as increased costs, latency to complete transactions, and reduced profits.
The more modern concept of "Data Mining" can be summarized as the ability to re-use business application logic from existing application programs to solve business problems in the future. Data Mining implementations exist in varying degrees of sophistication. For example, a simple application refacing solution may use a Web browser connected to a Web Server, which in turn accesses data from a transaction-processing server using an Extensible Markup Language ("XML") interface. In another example, a tightly coupled business-to-business ("B2B") application may connect a company to a supplier, where an XML document serves as the common data transport. In this example, it can be seen that XML-based servers will enable the evolution of Web Services to access older "legacy"- data such that a business can greatly extend its reach to customers over time while continuously updating, upgrading, and migrating its business application programs to offer enhanced services and products with ever-increasing cost and response efficiencies. As such, the networked economy is driving the businesses from rigidly designed business computing systems to employ flexible application design on scalable computing platforms, from static to dynamic interaction between partners, and from technology integration to business integration.
So, two extremes in technology are firmly established — billions of lines of code of COBOL representing untold billions of dollars of business investment on one end, with XML data transport technology ensuring the ability of future business applications to access' and use legacy data. Neither XML or COBOL may be used exclusively. However, there are significant technical challenges to interfacing COBOL and XML to each other, especially with respect to multi-dimensional arrays or "tables" of data which are so prevalent in today's business application requirements.
Brief Review of COBOL Field Definitions and Tables
While COBOL is well known in the art, it will be useful to briefly review the implementation of "tables" or "arrays" of data in COBOL in order to fully understand the impact of converting tabular or indexed data structures to and from COBOL and XML.
In COBOL syntax, a "picture" clause is used to define a field for use, such as shown in Table 1.
Table 1: Example COBOL Field Definition
01 Data-Field
02 Data - Item - 1 Pic X(l) .
03 Data - Item - 2 Pic X{1) .
In this example, two data, items, both being alphanumeric fields, are defined with a "precision" of one character. The "X" following the "Pic" indicates the field is alphanumeric, and the " (1) " following the "X" indicates the field is 1 character in length. A "Pic 9(3)" field type would be a numeric field having 3 digits, as would be a "Pic 999" field type. Other field types, such as literals, and numerics with decimal (e.g. fractional components) may be defined, as is well known in the art. Fields may be defined within groups, as indicated by elementary levels within group levels, as is also well known within the art.
So, for example, a customer information record could be defined as shown in Table 2, wherein the customer name may have up to 30 characters, the telephone number 10 digits, and the account number 18 alphanumeric characters .
Table 2: Example Customer Information Defined in COBOL
01 Data-Field
02 Customer - Name Pic X(30) .
03 Customer - Telephone Pic 9(10).
04 Customer - Acctnum Pic x(18) .
This type of customer data is often organized into arrays or tables of information, such as arrangements employed by relational database application programs .
Implementation and storage layout of an array structure varies by language. The COBOL language table structure, implemented by use of the COBOL "occurs" clause, stores array elements in consecutive memory locations.
For example, a one-dimensional array T beginning at memory location X, containing six elements e, where each element is four characters in length, is defined in a COBOL program as follows:
01 T.
05 e OCCURS 6 TIMES PICTURE 9999.
Figure 1 shows the table represented by this data structure definition. As in other programming languages, COBOL organizes data into arrays according to their definitions with respect to size (e.g. dimension) and field types. Multiple methods of declaring such tables, however, may result in different actual run time implementations of the data structure, especially with respect to the physical organization of the data when stored in memory. For example, Table 3 shows an example single-index (e.g. mono-dimension) array in COBOL, in which an 8-character alphanumeric field is defined in an array of seven fields .
Table 3 : Example Single Dimension Table Definition in COBOL
01 DaysOfWeek - Table.
03 Day - Name Pic X(8) Occurs 7 Times. During initialization of a program using such an array or immediately following the definition of such an array as shown in Table 3, the initial values (e.g. strings containing the weekday names) of the fields could be set using a COBOL "move" verb, such as shown in Table 4.
Table : Example Table Initialization in COBOL
000061 Move "Monday" To DAY-Name(l)
000062 Move "Tuesday" To DAY-Name(2)
000063 Move "Wednesday" To DAY-Name(3)
000067 Move "Sunday" To DAY-Name (7)
Once the table is loaded or initialized, individual field values can be quickly and directly accessed using the day number index, and specialized verbs such as the COBOL "search" verb, can be used to inspect or verify the information.
However, most business oriented data cannot be as simply organized' as a single-dimension array. For example, customers may be organized by product type, sales volume, geographic location, etc. COBOL allows for multi-dimensional tables to be defined essentially as tables of tables, as shown in Table 5.
Table 5 : Example Multi-Dimensional Table Definition in COBOL
000040 01 Sales-Transactions.
03 Customer-Num Occurs 100 Times Indexed by Cust-Index 05 Order-Nurα Pic X(3) Occurs 15 Times Indexed by Order-Index 07 Order-Items Pic X(45) Occurs 25 Times Indexed by Item-Num
In this example, 100 different customers, each with a customer number, are tracked for 15 orders (each with an order number) , with each order having up to 25 items listed or described using up to 45 characters in each item description. In COBOL implementation, this is realized as 15 tables of 25 fields, further organized into an array of 100 tables (e.g. 100 x 15 x 25) . Multidimensional COBOL tables are stored in row major order, in which rows are, placed one after another in memory, as is described in the text "Data Structures & Their Algorithms" by Harry R. Lewis and Larry Denenberg (HarperCollins, 1991) . The row is defined as the first index, where a table having three dimensions and indexed by the 3-tuple (x, y, z) , x is the index for the row.
For example, a two-dimensional array T beginning at memory location X, containing two rows and three columns, where each element (x) is two characters in length, and each element (y) is four characters in length, as defined in a COBOL program with the three COBOL statements:
01 T.
05 x OCCURS 2 TIMES PICTURE XX.
10 y OCCURS 3 TIMES PICTURE 9999.
Figure 2 depicts how this structure is represented as a table in contiguous storage. This method of storage provides an efficient means for fast access of the table elements, located in main memory, by the application program but can be inefficient for long term storage and retrieval, where storage space is at a premium.
For example, databases may store sparse arrays (partially filled arrays) by using linked lists or a hierarchical table of pointers. During processing the application program may decide to store the array elements - in a database.
i-Dimensional Array Data Mapping between Markup Language and COBOL
An XML document request can originate from an external source (e.g. another company, another agency, another enterprise, etc.), or it can be generated by a network server that requires an XML interface to access mainframe applications . Mapping an XML document to COBOL data structures is distinct from the challenge of developing algorithms for the efficient storage and retrieval of XML documents on mass media.
An XML parser and mapper are somewhat straightforward to develop for simple XML documents. The challenge, however, arise when mapping XML documents that may have multi-dimensional table or array data. This requirement, though, is actually very common. For example, a system for displaying information about an athletic sport league might use an XML document to display statistics for an individual player, within a team, within a conference, within a division, and within a league. The resulting structure would be a 4-dimensional array.
An example using the National Football League ("NFL") can be used to illustrate the general conceptual procedure for mapping a data element into the result array. In this example, the NFL divisions are the first dimension (w) , the conferences are the second dimension {x) , the teams are the third dimension (y) , and the players are the fourth dimension (z) . If a team name is parsed from the XML document containing the relevant statistics, the following procedure must be followed to map the team name into the result array:
1. Identify the result array dimension. The parsed XML tag and element might appear as:
<team_name>Dolphins</team_name>
The tag name can be used to determine that team._name belongs to the teams dimension (the third dimension) .
2. Navigate to the identified target dimension. The Dolphins are a team in the AFC East conference, which is in the AFC division. If we havepreviously parsed and mapped elements for the NFC division, and AFC West, AFC Central, and AFC East conferences in the AFC division, then we have progressively navigated through (1, x, y, z) , (2 , l,y, z) and (2, 2, y, z) . We are currently processing teams in the AFC East conference, so we know that the array index will be
(2, 3, y) .
3. Determine the target dimension array index. In this case, the target dimension array index is the value for y. The system, then, searches for the first empty fc®aπι-_Ω,aaa.® bucket in the target dimension (y) . If this is the third team that we have processed in the AFC East, then the third bucket will be empty, and the target dimension array index will be 3.
4. Move the current data value into the empty field in the array (the array field may or may not be empty) . In this example, we finally move the value "Dolphins" to (2, 2, 3) in the result array. However, actually designing a software implementation for this general conceptual procedure presents challenges to developing an efficient method to navigate the result array, and for determining the target dimension array index, especially if the result array has been pre-loaded with state data. Therefore, there is a need in the art for a method and system which efficiently maps multi-dimensional table array data to and from XML and COBOL.
In a first aspect of the invention there is provided a method for mapping n-dimensional array data ("source data") initially represented in markup language to an π-dimension table ("target data") suitable for use by business application programs, said method comprising the steps of:
(a) establishing a searchable repository which contains metadata information about a result array structure and one or more result array data elements; (b) parsing said source data to find a first or next tag name; (c) if a found tag name corresponds to an array name, then performing the steps of: (i) setting a dimension counter to the new result array dimension; (ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions ( dimension group length) , and maximum array elements; (iii) setting a dimension field count to 1; and (iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result; (d) if a found tag name corresponds to an array element, then performing the steps of: (i) setting a dimension counter to the corresponding dimension level; (ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset; (iii) incrementing said dimension field count by 1; and (iv) repeating said steps (d) (i) ,
(d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored; (e) and repeating steps (b) , (c) and (d) until all dimensions of said source data have been mapped.
In a second aspect of the invention there is provided a system for mapping markup language n-dimensional array data ("source data") to an n-dimension table ("target data") suitable for use by business application programs, said system comprising: (a) a searchable repository which contains metadata information about a result array structure and one or more result array data elements; (b) a source data parser configured to find a first or next tag name within said source data; (c) an array dimension processor configured to perform the following steps if a found tag name corresponds to an array name: (i) setting a dimension counter to the new result array dimension; (ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements; (iii) setting a dimension field count to 1; and (iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result; (d) an array element processor configured to perform the following steps if a found tag name corresponds to an array element: (i) setting a dimension counter to the corresponding dimension level; (ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset; (iii) incrementing said dimension field count by 1; and (iv) repeating said steps (d) (i) , (d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored; (e) and an array mapping controller configured to repetitively operate said parser, said array dimension processor, and said array element processor until all dimensions and all elements of said source data have been mapped.
In a third aspect of the invention there is provided a computer readable medium encoded with software for mapping n-dimensional array data ("source data") initially represented in markup language to an n-dimension table ("target data") suitable for use by business application programs, said software performing the steps of: (a) establishing a searchable repository which contains metadata information about a result array structure and one or more result array data elements; (b) parsing said source data to find a first or next tag name; (c) if a found tag name corresponds to an array name, then performing the steps of: (i) setting a dimension counter to the new result array dimension; (ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements; (iii) setting a dimension field count to 1; and (iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result; (d) if a found tag name corresponds to an arra_y element, then performing the steps of: (i) setting a dimension counter to the corresponding dimension level; (ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset; (iii) incrementing said dimension field count by 1; and (iv) repeating said steps (d) (i) , (d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored; (e) and repeating steps (b) , (c) and (d) until all dimensions of said source data have been mapped. Brief Description of the Drawings
The following detailed description when taken in conjunction with the figures presented herein provide a complete disclosure of the invention.
Figure 1 provides a tabular illustration of a one-dimensional array.
Figure 2 likewise provides an illustration of the linear nature which COBOL uses to store tabular data.
Figure 3 illustrates the hierarchical organization of XML data structures .
Figure 4 depicts the first step of our tilted tree, spinning cones process in which the squared groups within the hierarchy are replaced with cones .
Figure 5 shows a subsequent step of our tilted tree, spinning cones process in which the tree is tilted to bring in into congruence with one of the two axes (a mapping axis) in the graph.
Figure 6 illustrates the spinning action of our tilted tree, spinning cones process which allows each member of each group (e.g. each array) in the hierarchy to be brought into contact with the mapping axis of the graph.
In summary the new tilting tree, spinning cones process can be employed to efficiently map multi-dimensional array data contained in markup language documents, such as XML, to data structures suitable for use by COBOL application programs . The process maps the data in a significantly more efficient manner, thereby allowing more data to be mapped with reduced processing resources. A two-dimensional inverted tree structure using cones to represent the XML arrays is virtualized, which achieves mapping the n-dimensional XML data to a two-dimensional representation. Next, the inverted cone tree is repositioned on the two-dimensional graph by tilting it so that one array (cone) member in each dimension lays flat against an axis, such as the y-axis. This axis is now referred to as the mapping axis . Now the dimensions in the XML structure correspond to y-axis segments . Finally, by spinning the cones (e.g. rotating the arrays) one at a time, every member of every array can be brought into contact with the mapping axis. The dimension segments- of the mapping axis can be represented as a one-dimensional or linearly organized array, suitable for COBOL application programs.
Description of the Invention
The present invention is preferrably embodied in computer programs which provide interfacing of n-dimensional data structures between formats such as Extensible Markup Language ("XML") and structured programming formats such as COBOL. The present invention may be embodied as software in a high level language (COBOL, C, C++, Java, etc.), low level or assembly language, or even in programmable or fixed-design firmware and logic for use in computing systems such as enterprise servers .
A Generic Converter solution for Web enabling CICS applications including an interface to the 3270 Bridge to provide access to 3270 applications, has been available from International Business Machines in one form or another for some time.
The Generic Converter solution has now been further enhanced with an XML interface containing our inventive "tilting tree, spinning cones" process. This enables Java- developers to be solution participants by providing WebSphere Java clients. This is the subject of the present embodiment .
To present the process of the embodiment, it is useful first to review how n-dimensional arrays are represented in XML. The .structure of an XML document is typically illustrated as an inverted tree (30)', as' shown in Figure 3. The main root, at the top, branches to progressively lower levels or dimensions. The vertical members, at any particular level, represent array elements at that level.
The following example shows a graphed XML structure according to our NFL example, with League as the root element, Divisions as the first dimension array, Conferences as the second dimensional array, Teams as the third dimension array, and Players as the fourth dimension array (32) . It can be seen from this diagram that all elements of the XML document may be represented in a two-dimensional space in this manner. This is true without regard to the number of dimensions (y-axis) or the size of an individual array (x-axis) .
At the conclusion of the foregoing general conceptual procedure discussion, we indicated that the result array might be pre-loaded with state data prior to parsing and mapping XML document array elements . Therefore, it would be unreliable to use the result array to determine the mapping of a parsed XML document array element based on the presence of data in the result array. However, using this approach, an n-dimensional result array can be represented in a two-dimensional space, which makes it possible to create a mirror array of the n-dimensional result array that can be used for mapping.
Unfortunately, this mirror array could become quite large. The simple football league example, holding 20 items of information at each dimensional level, would require a mirror array at least 50k bytes in size. Moreover, searching for the correct array dimension (e.g. navigating the table) could be cumbersome and inefficient if higher dimension levels need to be re-navigated for every data element.
However, our new tilting tree, spinning cones process can be employed, resulting in representations which require much less storage space, 164 bytes for our example, and is much more efficient at mapping. The following discussion and illustrations explain this process.
First, an inverted tree structure (40) , similar to that shown in Figure 3, may also be illustrated using cones (41) to represent the arrays, as shown in Figure 4.
Next, the inverted cone tree is repositioned on the graph by tilting it so that one array (cone) member in each dimension lays flat against an axis. Now the dimensions (32) in the XML structure (41') correspond to y-axis segments, as shown in Figure 5.
Finally, it can be seen that by spinning (60) the cones (e.g. rotating the arrays) one at a time, every member of every array can be brought into contact with this axis, which we can now refer to as the ma.pping axis, as illustrated in Figure 6. The dimension segments of the mapping axis can be represented as a one-dimensional array. Returning to our NFL example, a mapping array is required with 4 element groups, one group for each dimension. Each group would contain:
1. XML tag name (i.e. Teams, Players, etc.) associated with that Dimension;
2. Length of the result array element or element group; 3. Maximum allowable element occurrences in the result array; and
4. Current element occurrences count, which is used to determine the target dimension array index.
As the XML document is parsed by the process, the mapping array group at each dimension holds information pertaining to the cone that is currently spun into contact (e.g. rotationally positioned to align) with the mapping axis . Parsing and mapping begin with the XML document root element, and proceeds by parsing down to cones at successively lower dimensions. Cone elements are mapped as they are encountered.
For example, if during processing the cone elements ( spinning in place) at the Teams level, a Player element is encountered representing a lower level cone, then the lower level Players cone is immediately "spun into contact" with the mapping axis. Once the Players cone processing is completed for a team, the mapping array is shifted up one dimension to spin a new Teams cone into place, repeating the process until all cones in the n-dimensional array have been processed.
For further understanding of the invention, we now present a functional, operational example embodiment and application of our tilting tree, spinning cones process for mapping n-dimensional data. The following discussion will use another example of an inbound XML document request, shown in Table 6, with the corresponding COBOL program 4-dimensional table definition, shown in Table 7, and the mapping array it creates .
Table 6 : Example XML nbound Data
<league>
<league_name>NFL</league_name> <division>
<division_name>AFC</division_name> <conference>
<conference_name>AFC_East</conference_name> <team>
<team_name>Dolphins</team_name> <team_gamesjolayed>l6</team_games_played> <team_player>
<player_name>Jay Fiedler</player_name> <player_games_played>16</player_games_played> </team_p1ayer> <team_player>
<player_Name>Ed Perry</player_Name> <player_games_played>16</player_games-_played> </team_player> <team_j?layer>
</team_player>
</team>
<team>
</team> </conference> <conference>
</conference> </division> <division>
</division> </league> Table 7 ; Example COBOL Program Statements
01 COBOL-RESULT-ARRAY
02 LEAGUE-NAME PIC X(20). 02 DIVISION OCCURS 2 TIMES.
04 DIVISION-NAME PIC X(03) . 04 CONFERENCE OCCURS 3 TIMES.
06 CONFERENCE-NAME PIC X(09). 06 TEAM OCCURS 6 TIMES.
08 TEAM-NAME PIC X (20) . 08 TEAM-GAMES-PLAYED PIC 9(03). 08 TEAM-PLAYER OCCURS 70 TIMES 10 PLAYER-NAME PIC X(20). 10 PLAYER-GAMES-PLAYED PIC 9(03).
05 DIMENSION-COUNTER PIC S9(4) COMP. 05 MAPPING-ARRAY
10 DIMENSION-TABLE OCCURS 4 TIMES.
20 DIMENSION-TAG-NAME PIC X(32) .
20 DIMENSION-OCCURS-GROUP-LEN PIC S9(4) COMP.
20 DIMΞNSION-OCCURS-MAX-TIMES PIC S9(4) COMP.
20 DIMENSION-FIELD-COUNT PIC S9(4) COMP.
According to our example embodiment in an IBM CICS computing environment, when an XML request is received, a SAX (Standard API for XML) parser starts parsing at the beginning of the XML document. The SAX parser is event driven, meaning that when an XML tag name is found (an event) , control is given to our tilting tree, spinning cones process for element mapping.
Further according to our example embodiment, the mapping array has two associated control values . The dimension counter indicates the current dimension level being processed for the multi-dimension result array. The dimension array offset is the offset into the array for the beginning of the dimension currently being processed. The fact that the mapping array is one-dimensional is made possible by the concept of tilting the tree into the mapping array axis. Remember, the tree is a two-dimensional representation of the multi-dimensional source array.
For each parser event, processing proceeds as follows: 1. An in-memory repository contains metadata information about the result array structure and result array data elements. The repository is searched for a match of the XML tag name.
2. If the tag name corresponds to an array name (i.e. DIVISION, CONFERENCE, TEAM,, or TEAM-PLAYER) , then:
(a) the dimension counter is set to the new result array dimension (this corresponds to spinning a cone into contact with the mapping array) ;
(b) the mapping array is loaded with the array tag name, total length of all elements at this and higher dimensions ( dimension group length) , and maximum array elements;
(c) the dimension field count is set to 1 so that the next XML data element for this dimension will be mapped to the first slot; and
(d) the dimension array offset is calculated by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result.
3. If the tag name corresponds to an array element (i.e. DIVISION-NAME, CONFERENCE-NAME, TEAM-NAME, TEAM-GAMES-PLAYED, PLAYER-NAME, or PLAYER-GAMES-PLAYED), then:
(a) he dimension counter is set to the corresponding dimension level; and
(b) the corresponding tag value is stored in the result slot indicated by the dimension field count plus the dimension array offset (element storing is performed in conjunction with the repository, which contains the element result array offset for slot 1, element length, and element type (alphanumeric, numeric , etc . ) ) ;
(c) the dimension field count is incremented by 1; and
(d) the next successive array element at the same dimension level is processed (corresponding to spinning a cone in place) as just described until all elements at this dimension have been stored.
While the immediately preceding explanation may appear simple and straightforward, actual code implementation is somewhat more complex to be able to handle the COBOL array definitions shown in Table 8. In this example, notice that TEAM-LOCATION is an element of the TEAM array, but follows the higher dimension array for TEAM-PLAYER. The CONFERENCE-BOARD array is an array of equal dimension to the CONFERENCE array, both under the DIVISION array, and follows the higher level arrays of TEAM and TEAM- LAYER.
Table 8: Example COBOL Implementation
01 COMMAREA.
02 LEAGUE-NAME PIC X(20). 02 DIVISION OCCURS 2 TIMES.
04 DIVISION-NAME PIC X(03) . 04 CONFERENCE OCCURS 3 TIMES.
06 CONFERENCE-NAME PIC X(09) . 06 TEAM OCCURS 6 TIMES.
08 TEAM-NAME PIC X(20) . 08 TEAM-GAMES-PLAYED PIC 9(03). 08 TEAM-PLAYER OCCURS 70 TIMES. .10 PLAYER-NAME PIC X(20). 10 PLAYER-GAMES PLAYED PIC 9(03). 08 TEAM-LOCATION PIC X(20) . 04 CONFERENCE-BOARD OCCURS 12 TIMES.
06 CONFERΞNCE-BOARD-MEMBER-NAME PIC X(20) .
In summary the new tilting tree, spinning cones process can be employed to efficiently map multi-dimensional array data contained in markup language documents, such as XML, to data structures suitable for use by COBOL application programs. The process maps the data in a significantly more efficient manner, thereby allowing more data to be mapped with reduced processing resources. A two-dimensional inverted tree structure using cones to represent the XML arrays is virtualized, which achieves mapping the n-dimensional XML data to a two-dimensional representation. Next, the inverted cone tree is repositioned on the two-dimensional graph by tilting it so that one array (cone) member in each dimension lays flat against an axis, such as the y-axis. This axis is now referred to as the mapping axis . Now the dimensions in the XML structure correspond to y-axis segments . Finally, by spinning the cones (e.g. rotating the arrays) one at a time, every member of every array can be brought into contact with the mapping axis . The dimension segments of the mapping axis can be represented as a one-dimensional or linearly organized array, suitable for COBOL application programs.

Claims

1. A method for mapping n-dimensional array data ("source data") initially
represented in markup language to an n-dimension table ("target data")
suitable for use by business application programs, said method comprising the
steps of:
(a) establishing a searchable repository which contains metadata information about a result array structure and one or more result array data elements;
(b) parsing said source data to find a first or next tag name;
(c) if a found tag name corresponds to an array name, then performing
the steps of :
(i) setting a dimension counter to the new result array dimension;
(ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions ( dimension group length) , and maximum array elements;
(iii) setting a dimension field count to 1; and
(iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result;
(d) if a found tag name corresponds to an array element, then performing the steps of :
(i) setting a dimension counter to the corresponding dimension level; (ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset;
(iii) incrementing said dimension field count by 1; and
(iv) repeating said steps (d) (i) , (d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored;
(e) and repeating steps (b) , (c) and (d) until all dimensions of said source data have been mapped.
2. , The method as set forth in Claim 1 wherein said step of storing corresponding tag values is performed in conjunction with the repository, which contains the element result array offset for slot 1, element length, and element type.
3. The method as set forth in Claim 1 or 2 further comprising the step of pre-loading state data in said target data array.
4. The method as set forth in Claim 1, 2 or 3 wherein said step of parsing said source data comprises parsing a data structure defined in Extensible Markup Language and/or employing a Standard Application Programming Interface for Extensible Markup Language parser.
5. The method as set forth in any one of claims 1 to 4 further comprising the step of using said target data array by a Common Business Oriented Language application program.
6. A system for mapping markup language n-dimensional array data ("source data") to an n-dimension table ("target data") suitable for use by business application programs, said system comprising:
(a) a searchable repository which contains metadata information about a result array structure and one or more result array data elements;
(b) a source data parser configured to find a first or next tag name within said source data;
(c) an array dimension processor configured to perform the following steps if a found tag name corresponds to an array name: (i) setting a dimension counter to the new result array dimension;
(ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements;
(iii) setting a dimension field count to 1; and
(iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result;
(d) an array element processor configured to perform the following steps if a found tag name corresponds to an array element:
(i) setting a dimension counter to the corresponding dimension - level;
(ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset;
(iii) incrementing said dimension field count by 1; and
(iv) repeating said steps (d) (i) , (d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored;
(e) and an array mapping controller configured to repetitively operate said parser, said array dimension processor, and said array element processor until all dimensions and all elements of said source data have been mapped.
7. The system as set forth in Claim 6 wherein sa.id array element processor is configured to perform said step of storing in conjunction with the repository, which contains the element result array offset for slot 1, element length, and element type.
8. The system as set forth in Claim 6 or 7 further comprising a target data pre-loader configured to pre-load state data in said target data array.
9. The system as set forth in Claim 6 or 7 wherein parser is con igured to parse Extensible Markup Language parser and comprises a Standard Application Programming Interface for Extensible Markup Language parser.
10. A computer readable medium encoded with software for mapping n-dimensional array data ("source data") initially represented in markup language to an n-dimension table ("target data") suitable for use by business application programs, said software performing the steps of:
(a) establishing a searchable repository which contains metadata information about a result array structure and one or more result array data elements;
(b) parsing said source data to find a first or next tag name;
(c) if a found tag name corresponds to an array name, then performing the steps of:
(i) setting a dimension counter to the new result array dimension;
(ii) loading a mapping array with the array tag name, total length of all elements at this and higher dimensions (dimension group length) , and maximum array elements;
(iii) setting a dimension field count to 1; and
(iv) calculating a dimension array offset by multiplying the dimension group length by the current dimension field count for each lower level dimension and summing the result;
(d) if a found tag name corresponds to an array element, then performing the steps of :
(i) setting a dimension counter to the corresponding dimension level;
(ii) storing the corresponding tag value in a result slot indicated by the dimension field count plus the dimension array offset;
(iii) incrementing said dimension field count by 1; and (iv) repeating said steps (d) (i) , (d) (ii) and (d) (iii) for successive source data elements at the same dimension level until all elements at this dimension have been stored;
(e) and repeating steps (b) , (c) and (d) until all dimensions of said source data have been mapped.
PCT/GB2004/000243 2003-02-06 2004-01-22 Method and system for mapping xml to n-dimensional data structure WO2004070500A2 (en)

Priority Applications (2)

Application Number Priority Date Filing Date Title
DE602004008742T DE602004008742T2 (en) 2003-02-06 2004-01-22 METHOD AND SYSTEM FOR SHAPING XML TO A N-DIMENSIONAL DATA STRUCTURE
EP04704280A EP1590749B1 (en) 2003-02-06 2004-01-22 Method and system for mapping xml to n-dimensional data structure

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US10/361,170 2003-02-06
US10/361,170 US6985910B2 (en) 2003-02-06 2003-02-06 Tilting tree spinning cones method and system for mapping XML to n-dimensional data structure using a single dimensional mapping array

Publications (2)

Publication Number Publication Date
WO2004070500A2 true WO2004070500A2 (en) 2004-08-19
WO2004070500A3 WO2004070500A3 (en) 2004-10-21

Family

ID=32849599

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/GB2004/000243 WO2004070500A2 (en) 2003-02-06 2004-01-22 Method and system for mapping xml to n-dimensional data structure

Country Status (6)

Country Link
US (1) US6985910B2 (en)
EP (1) EP1590749B1 (en)
CN (1) CN100447781C (en)
AT (1) ATE372557T1 (en)
DE (1) DE602004008742T2 (en)
WO (1) WO2004070500A2 (en)

Families Citing this family (17)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
CA2400590A1 (en) * 2002-08-29 2004-02-29 Ibm Canada Limited-Ibm Canada Limitee Method and apparatus for converting legacy programming language data structures to schema definitions
US7681118B1 (en) * 2004-07-14 2010-03-16 American Express Travel Related Services Company, Inc. Methods and apparatus for creating markup language documents
US8683318B1 (en) 2004-07-14 2014-03-25 American Express Travel Related Services Company, Inc. Methods and apparatus for processing markup language documents
US7505960B2 (en) 2005-11-15 2009-03-17 Microsoft Corporation Scalable retrieval of data entries using an array index or a secondary key
US7747942B2 (en) * 2005-12-20 2010-06-29 American Express Travel Related Services Company, Inc. System and method for obtaining a markup language template through reversing engineering
US9070178B2 (en) * 2006-08-11 2015-06-30 Siemens Product Lifecycle Management Software Inc. Method and system for organizing topology elements for better compression
JP5014212B2 (en) * 2008-03-14 2012-08-29 キヤノン株式会社 Message communication apparatus, control method therefor, and computer program
CN101261645B (en) * 2008-03-26 2010-08-11 北京搜狗科技发展有限公司 Method and apparatus for obtaining multiple layer information
US8037404B2 (en) * 2009-05-03 2011-10-11 International Business Machines Corporation Construction and analysis of markup language document representing computing architecture having computing elements
CN101923569B (en) * 2010-07-09 2012-07-25 江苏瑞中数据股份有限公司 Storage method of structure type data of real-time database
CN101976239A (en) * 2010-09-19 2011-02-16 北京腾瑞万里科技有限公司 Method and device for searching geographical object information
CN102509350B (en) * 2011-09-30 2013-12-25 北京航空航天大学 Cube-based sports event information visualization method
US8744840B1 (en) 2013-10-11 2014-06-03 Realfusion LLC Method and system for n-dimentional, language agnostic, entity, meaning, place, time, and words mapping
CN105631608A (en) * 2016-02-02 2016-06-01 明博教育科技股份有限公司 Multistage mechanism mapping and synchronization method and system
CN107577506B (en) * 2017-08-07 2021-03-19 台州市吉吉知识产权运营有限公司 Data preloading method and system
US11170448B2 (en) * 2019-12-20 2021-11-09 Akasa, Inc. Claim analysis with deep learning
CN111414390A (en) * 2020-03-20 2020-07-14 北京思特奇信息技术股份有限公司 Data processing method and system

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001065419A2 (en) * 2000-03-02 2001-09-07 Nimble Technology, Inc. Method and apparatus for storing semi-structured data in a structured manner
EP1231547A2 (en) * 2001-01-18 2002-08-14 Hitachi, Ltd. System and method for mapping structured documents to structured data of program language and program for executing its method
US6502101B1 (en) * 2000-07-13 2002-12-31 Microsoft Corporation Converting a hierarchical data structure into a flat data structure

Family Cites Families (10)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5943674A (en) 1996-07-11 1999-08-24 Tandem Computers Incorporated Data structure representing an interface definition language source file
US6301579B1 (en) 1998-10-20 2001-10-09 Silicon Graphics, Inc. Method, system, and computer program product for visualizing a data structure
US6336214B1 (en) * 1998-11-10 2002-01-01 International Business Machines Corporation System and method for automatically generating browsable language grammars
US6209124B1 (en) 1999-08-30 2001-03-27 Touchnet Information Systems, Inc. Method of markup language accessing of host systems and data using a constructed intermediary
US7275079B2 (en) 2000-08-08 2007-09-25 International Business Machines Corporation Common application metamodel including C/C++ metamodel
US7559066B2 (en) * 2000-08-08 2009-07-07 International Business Machines Corporation CICS BMS (basic message service) meta model
US20040268242A1 (en) * 2000-08-09 2004-12-30 Microsoft Corporation Object persister
US6795868B1 (en) * 2000-08-31 2004-09-21 Data Junction Corp. System and method for event-driven data transformation
US20020161907A1 (en) * 2001-04-25 2002-10-31 Avery Moon Adaptive multi-protocol communications system
US7013311B2 (en) * 2003-09-05 2006-03-14 International Business Machines Corporation Providing XML cursor support on an XML repository built on top of a relational database system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2001065419A2 (en) * 2000-03-02 2001-09-07 Nimble Technology, Inc. Method and apparatus for storing semi-structured data in a structured manner
US6502101B1 (en) * 2000-07-13 2002-12-31 Microsoft Corporation Converting a hierarchical data structure into a flat data structure
EP1231547A2 (en) * 2001-01-18 2002-08-14 Hitachi, Ltd. System and method for mapping structured documents to structured data of program language and program for executing its method

Non-Patent Citations (4)

* Cited by examiner, † Cited by third party
Title
FLORESCU D ET AL: "A Performance Evaluation of Alternative Mapping Schemes for Storing XML Data in a Relational Database" INRIA RAPPORT DE RECHERCHE NO. 3680, May 1999 (1999-05), pages 1-31, XP002168318 LE CHESNAY, FRANCE *
FUNDERBURK J E ET AL: "XTABLES: bridging relational technology and XML" IBM SYST. J. (USA), IBM SYSTEMS JOURNAL, 2002, IBM, USA, vol. 41, no. 4, 2002, pages 616-641, XP002291254 ISSN: 0018-8670 *
SHANMUGASUNDARAM J ET AL: "Relational databases for querying XML documents: limitations and opportunities" PROCEEDINGS OF 25TH INTERNATIONAL CONFERENCE ON VERY LARGE DATABASES, EDINBURGH, UK,, 7 September 1999 (1999-09-07), pages 302-314, XP002291255 ORLANDO, FLORIDA *
SNEED H M: "Wrapping legacy COBOL programs behind an XML-interface" IEEE, 2 October 2001 (2001-10-02), pages 189-197, XP010563203 *

Also Published As

Publication number Publication date
US6985910B2 (en) 2006-01-10
EP1590749B1 (en) 2007-09-05
WO2004070500A3 (en) 2004-10-21
US20040162813A1 (en) 2004-08-19
EP1590749A2 (en) 2005-11-02
CN100447781C (en) 2008-12-31
ATE372557T1 (en) 2007-09-15
CN1723463A (en) 2006-01-18
DE602004008742T2 (en) 2008-06-12
DE602004008742D1 (en) 2007-10-18

Similar Documents

Publication Publication Date Title
US6985910B2 (en) Tilting tree spinning cones method and system for mapping XML to n-dimensional data structure using a single dimensional mapping array
US6684207B1 (en) System and method for online analytical processing
US6704723B1 (en) Method and system for providing business intelligence information over a computer network via extensible markup language
JP6144700B2 (en) Scalable analysis platform for semi-structured data
JP5710851B2 (en) System and method for impact analysis
US6925470B1 (en) Method and apparatus for database mapping of XML objects into a relational database
US8051034B2 (en) Parallel processing of assigned table partitions
US7752213B2 (en) Flexible access of data stored in a database
Haw et al. Data storage practices and query processing in XML databases: A survey
US7472140B2 (en) Label-aware index for efficient queries in a versioning system
US20050177578A1 (en) Efficient type annontation of XML schema-validated XML documents without schema validation
US8635634B2 (en) Seamless multiple format metadata abstraction
US20090119581A1 (en) Method and apparatus for providing auto-completion of information using strings
EP2556446B1 (en) Columnar storage representations of records
US20080097990A1 (en) High accuracy document information-element vector encoding server
EP1909198A2 (en) Semantical partitioning of data
US11416458B2 (en) Efficient indexing for querying arrays in databases
US20090182766A1 (en) Avoiding database related joins with specialized index structures
US8645313B1 (en) Systems and methods for enhanced SQL indices for duplicate row entries
US7167869B2 (en) Representing hierarchical list data
US6862590B2 (en) Converting expressions to execution plans
US7861253B1 (en) Systems and methods for accessing a business intelligence system through a business productivity client
US8554722B2 (en) Method for transferring data into database systems
US7984045B2 (en) Scalable data extraction from data stores
US20130018898A1 (en) Tracking queries and retrieved results

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A2

Designated state(s): AE AG AL AM AT AU AZ BA BB BG BR BW BY BZ CA CH CN CO CR CU CZ DE DK DM DZ EC EE EG ES FI GB GD GE GH GM HR HU ID IL IN IS JP KE KG KP KR KZ LC LK LR LS LT LU LV MA MD MG MK MN MW MX MZ NA NI NO NZ OM PG PH PL PT RO RU SC SD SE SG SK SL SY TJ TM TN TR TT TZ UA UG US UZ VC VN YU ZA ZM ZW

AL Designated countries for regional patents

Kind code of ref document: A2

Designated state(s): BW GH GM KE LS MW MZ SD SL SZ TZ UG ZM ZW AM AZ BY KG KZ MD RU TJ TM AT BE BG CH CY CZ DE DK EE ES FI FR GB GR HU IE IT LU MC NL PT RO SE SI SK TR BF BJ CF CG CI CM GA GN GQ GW ML MR NE SN TD TG

121 Ep: the epo has been informed by wipo that ep was designated in this application
WWE Wipo information: entry into national phase

Ref document number: 20048018067

Country of ref document: CN

WWE Wipo information: entry into national phase

Ref document number: 2004704280

Country of ref document: EP

WWP Wipo information: published in national office

Ref document number: 2004704280

Country of ref document: EP

DPEN Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed from 20040101)
WWG Wipo information: grant in national office

Ref document number: 2004704280

Country of ref document: EP