WO1997006492A1 - Computer-based visual data evaluation - Google Patents

Computer-based visual data evaluation Download PDF

Info

Publication number
WO1997006492A1
WO1997006492A1 PCT/US1996/012729 US9612729W WO9706492A1 WO 1997006492 A1 WO1997006492 A1 WO 1997006492A1 US 9612729 W US9612729 W US 9612729W WO 9706492 A1 WO9706492 A1 WO 9706492A1
Authority
WO
WIPO (PCT)
Prior art keywords
data
data set
subset
chart
data subset
Prior art date
Application number
PCT/US1996/012729
Other languages
French (fr)
Inventor
Jerry R. Jackson
Original Assignee
Jerry Jackson Associates Ltd.
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Family has litigation
First worldwide family litigation filed litigation Critical https://patents.darts-ip.com/?family=21698934&utm_source=google_patent&utm_medium=platform_link&utm_campaign=public_patent_search&patent=WO1997006492(A1) "Global patent litigation dataset” by Darts-ip is licensed under a Creative Commons Attribution 4.0 International License.
Application filed by Jerry Jackson Associates Ltd. filed Critical Jerry Jackson Associates Ltd.
Priority to AU66903/96A priority Critical patent/AU6690396A/en
Publication of WO1997006492A1 publication Critical patent/WO1997006492A1/en

Links

Classifications

    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06TIMAGE DATA PROCESSING OR GENERATION, IN GENERAL
    • G06T11/002D [Two Dimensional] image generation
    • G06T11/20Drawing from basic elements, e.g. lines or circles
    • G06T11/206Drawing of charts or graphs
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/242Query formulation
    • G06F16/2428Query predicate definition using graphical user interfaces, including menus and forms
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/24Querying
    • G06F16/248Presentation of query results
    • GPHYSICS
    • G06COMPUTING; CALCULATING OR COUNTING
    • G06FELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/26Visual data mining; Browsing structured data

Definitions

  • This invention generally relates to a process for database querying, and more particularly concerns an interactive interface for chart-based graphical data browsing, querying and manipulation.
  • Visual data evaluation is an important part of information processing. For many objectives such as pattern recognition, outlier analysis and general data exploration, human visual data evaluations are far superior to other options such as automated statistical procedures.
  • Browsing is an information-seeking process which utilizes chart displays of data including bar charts, scatter plots and the like to detect patterns, to develop an intuitive understanding of relationships exhibited by the data and to determine the next desired chart presentation of the data.
  • Querying which is a mechanism for accessing information stored in a database, specifies and selects data subsets which can then be used for additional browsing, querying or other information processing. Browsing can be considered the primary visual information gathering step while querying allows the user to "navigate" through the data.
  • Visual data evaluation is necessarily constrained by the limits of human cognitive abilities which permit only relatively small quantities of data to be evaluated at one time. For example, a data series with one hundred observations can easily be inspected visually while one with ten thousand observations cannot. Consequently, large data series must be divided into subsets to conduct visual data evaluations. Furthermore, graphical representations quickly become confusing when a third or fourth dimension is added. Therefore, most visual data evaluation is conducted on pairs of data items or variables. Finally, the limits of human memory make it difficult to remember and process important information from more than a dozen or so data subsets or pair-wise visual evaluations.
  • Commercially available software can provide data manipulation, querying and charting functions required to conduct visual data evaluation. While the general class of software referred to as spreadsheet software is most suited and most frequently used to conduct these evaluations, its application is cumbersome and tedious.
  • Spreadsheet software represents data in a column and row tabular format.
  • Spreadsheet data is selected for use in a chart by specifying desired columns and rows either through a series of keyboard entries or with mouse operations on the tabular data display.
  • Chart specifications are determined with a series of choices presented in menus, dialogue boxes, or other user-interactive devices. Finally, the chart is presented in a separate display area. Changing one of the variable series presented in the chart is initiated by returning to the spreadsheet display and then repeating the data selection process and updating the chart display.
  • Examining a noncontiguous subset of spreadsheet data requires a separate data query to extract the desired data and place it in another area of the worksheet. Queries are performed after users specify the data to be queried, query parameters and the area in the spreadsheet that will hold the query results. The columns and rows containing the new data subset are then referenced and incorporated in new chart displays. Spreadsheet data manipulation is also often applied to compute statistics for query results at intermediate points in the evaluation. Additional charting, querying and data manipulation continue through as many additional repetitions as desired.
  • DBMS database management software
  • SQL Strucmred Query Language
  • SQL Strucmred Query Language
  • Table or form-based procedures such as Query-by-Example (QBE) have been developed to convert form and table input into query results, and while these developments have decreased the burden of SQL query formulation somewhat, they certainly have not eliminated it.
  • More recent DBMS and spreadsheet software systems apply graphical user interface
  • GUI GUI
  • GUI visual graphical interface
  • graphical queries applying the word “graphical” as it is used in the term GUI
  • Symbols include icons, tables, text, picmres and other representations which connotate data or query operations.
  • join operation is applied to relational databases to combine data from two separate database tables into a single table for further processing. Users must specify commands in SQL text or use mouse selections in symbolic systems to select the tables to be joined and to identify the variables to be included in the resulting table. The problem with this process is that each time the user wants to combine a new set of variables from different tables or wants to include another variable in the current table, a new join operation must be completed. While the relational database approach of storing data in separate tables provides an efficient and flexible model for maintaining the physical database system, it also adds the additional burdens on the user who must possess an understanding of the table strucmre of the database and must perform table joins each time variables are used from different tables.
  • DBMS also requires the same kind of detailed, sequential step-by-step data manipulation, query and charting process described for spreadsheet software. As a result, DBMS is even more difficult to use in its application to visual data evaluation.
  • charting process which is the primary visual mode for presenting and discovering information
  • charting process is provided only as a final visual documentation of data selection and manipulation which have already occurred rather than as an integrated part of the visual data evaluation process itself. Consequently, users do not receive interactive, visual feedback from manipulation of the database that occurs with queries and browsing activities.
  • Still another problem is that the visual data evaluations quickly become confusing as the user loses an understanding of the evolution of previous graphical, statistical and query steps.
  • Such new method should also be able to accomplish complex queries while at the same time be easily understandable to novice database users. Further, the method should also allow users to select all database variables without having to conduct separate join operations prior to accessing the data. Finally, the system must be directly applicable to a broad base of existing database systems and network environments.
  • a method in a data processing system for accessing information in a data set having feamres of the present invention comprises the steps of creating a visual chart representation of the data set and displaying the data set in the chart, selecting a second data set which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set, and displaying the results of the data subset selecting step.
  • the information accessing method may further comprise the steps of selecting the data subset through interaction between the user and the system within the displayed data subset and displaying a chart of the selected data subset.
  • the steps of selecting a data subset through interaction between the user and the system within the chart of any previous data subset and displaying the results of the data subset selecting step may be continued in an iterative data evaluation process.
  • the method of the present invention may comprise the step of maintaining a record of the selected data subsets, including associating a distinct visual symbol with each data subset record and using the visual symbol as a software button for selective viewing of the associated data subset and from which the data evaluation may be redirected.
  • the step of maintaining a record of the user selected data subsets may comprise the steps of creating a record of each data subset, creating and displaying a distinct visual symbol for each of the data set and the data subsets, and arranging the visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
  • a record of the user selected data subsets may be maintained by creating a texmal record and values of the chart attributes which define the data subsets, displaying the texmal record for each of the data set and the data subsets, and arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subsets as defmed by the data subsets selecting step.
  • the present invention comprises a method in a data processing system for maintaining a record of user selected data subsets selected from a data set comprising the steps of creating a record of the data subsets, such as a texmal record of the data subsets and the values of chart attributes which defme each data subset; creating and displaying a distinct visual symbol for each of the data set and the data subsets; and arranging the visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
  • a visual symbol may be selected for displaying visually the associated data subset.
  • the method may further comprise the steps of maintaining and displaying simultaneously a visual chart representation of the data set, receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set, creating records of the additional data subsets, creating and displaying distinct visual symbols for each of the additional data subsets, and arranging the distinct visual symbols in a network of interconnected visual symbols to indicate the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
  • the present invention comprises a method in a data processing system for maintaining a record of user selected data subsets selected from a data set comprising the steps of creating a texmal record and the values of chart attributes which defme the data subsets, displaying the texmal record for the data set and data subsets, and arranging the visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
  • the method may further comprise the steps of maintaining and displaying a visual chart representation of the data set, receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set, creating records of the additional data subsets, creating texmal records of the additional data subsets and values of chart attributes which defme the data subsets, creating and displaying distinct visual symbols for each of the additional data subsets wherein the visual symbols for data subsets in the same level of the selection hierarchy share a common feamre, and arranging the texmal records and displayed visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
  • a data processing system for accessing information in a data set having feamres of the present invention comprises means for creating a visual chart representation of the data set, means for selecting a data subset which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set, and means for displaying the results of the data subset selection.
  • the data set information accessing system may further comprise means for selecting the data subset through interaction between the user and the system within the displayed data subset and means for displaying a chart of the data subset.
  • a system for maintaining a record of the selected data subsets in accordance with the present invention comprises means for creating a record of each selected data subset.
  • the record maintenance system may further comprise means for creating and displaying a distinct visual symbol for each data subset and means for arranging the visual symbols in a network of interconnected visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subset selection.
  • the record maintenance system of the present invention may optionally comprise means for creating a texmal and values of chart attributes which define the data set and data subsets, means for displaying the texmal records, and means for arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selection. Accordingly, it is an object of the present invention to provide a new method for computer-based visual data evaluation having one or more of the novel features of this invention as set forth above or hereinafter shown or described.
  • Another object of the present invention is to provide a new system for computer-based visual data evaluation having one or more of the novel feamres of this invention as set forth above or hereinafter shown or described.
  • Yet another object of the present invention is to allow the user to conduct querying operations within the data area of the graphical chart display in such a way that the user
  • a related object of the present invention is to allow the user to reposition the chart- based data evaluation to any previously defined position by operating on entries in the query and statistics histories.
  • Still another object of the present invention is to define chart entities as a collection of information on the data subset, chart specifications, query relationships and other information defined by chart-based user operations.
  • the user may apply chart entities as operands in query, data manipulation and other operations.
  • a further feamre of the present invention is use of the visual and texmal records reflective of the queries as software buttons for repositioning or redirecting the evaluation to any previous point in the process.
  • the present invention is a simple method for visually evaluating complex databases.
  • the method and system allows the user to access and manipulate a database in real time, viewing, evaluating and navigating, by means of a simple query process, through data presented on the display.
  • the method and system does not require the use of a formal, strucmred query language. Rather, the method and system is an intuitive browsing and querying process employing simple operations on a single comprehensive dynamic representation of the database in which highly complex queries are feasible. On-the-fly viewing, evaluation and querying with simple operations are possible.
  • the method also allow users to select any database variables without having to conduct separate join operations prior to accessing the data.
  • the method and system of the present invention is applicable to a broad base of existing database systems and network environments. Brief Description of the Drawings
  • FIG. 1 is a pictorial representation of a representative hardware environment for the present invention.
  • FIG. 2 shows an unpopulated or empty depiction of a display as it appears on the computer display device of a data processing system programmed according to an embodiment of the present invention.
  • FIGS. 3 A through 8 is a flow chart representation of an embodiment of the present invention.
  • FIGS. 9 through 12 illustrate a progressive example of visual data evaluation according to an embodiment of the present invention.
  • FIG. 13 illustrates the selection of the invention's Chart History Window feamre after performance of the queries illustrated in FIGS 9 through 12.
  • chart refers to a graphical presentation of data wherein visual spatial representations are used to reflect relationships among the data presented in the chart.
  • This definition of charts includes bar charts, scatter plots, pie charts, line charts, histograms, pert charts, maps, iconic charts and the like.
  • browsing refers to an information-seeking process which utilizes chart displays of data to visually detect patterns. Browsing is often applied to develop an understanding of relationships exhibited by data and to conduct other visual considerations of data presented in charts.
  • An embodiment of the computer-based visual data evaluation, including data browsing, querying and data manipulation, provided by this invention has been implemented in a software application program, known as MAISY (TM), which was written in the C + + programming language for use in the Microsoft Windows (TM) operating environment.
  • MAISY TM
  • FIG. 1 A representative hardware environment for the invention is shown in FIG. 1, comprising a workstation including a data processing system generally shown at 1 , which may be programmed in accordance with the present invention.
  • the workstation includes a central processing unit, such as a conventional microprocessor 2 which includes a graphics processor, a random access memory (RAM), read only memory (ROM), a cursor controller such as a mouse pointer 4, and means for communicating into a data processing network (not shown), which may have attached thereto further databases and as well as distinct, remote workstations.
  • a central processing unit such as a conventional microprocessor 2 which includes a graphics processor, a random access memory (RAM), read only memory (ROM), a cursor controller such as a mouse pointer 4, and means for communicating into a data processing network (not shown), which may have attached thereto further databases and as well as distinct, remote workstations.
  • a video display device 6 which may be implemented using either a color or monochromatic monitor, as is well known in the art.
  • a keyboard 8 is also coupled to the processor.
  • the keyboard 8 preferably comprises a standard computer keyboard which is coupled to the processor 2 by a cable 10.
  • the workstation includes nonvolatile storage for the database, such
  • the mouse 4 is coupled to the processor 2, in a manner well known in the art, via a cable 12. As is shown, the mouse may include a left button 14, and a right button 16, each of which may be depressed, or "clicked, " to provide command and control signals to the data processing system 1. While the disclosed embodiment of the present invention utilizes a mouse 4, those skilled in the art will appreciate that any graphical pointing device such as a track ball, touch pad, light pen, touch screen and the like may be utilized to implement the method of the present invention. The goal is to provide the user of the workstation a method, system and program resources to visually evaluate data encompassing an unlimited base of information.
  • an embodiment of the present invention begins with an "empty" display which includes a screen display area comprising a Chart Window 22. All visual data evaluation including browsing and querying are accomplished within the Chart Window 22 in an integrated, dynamic manner by operating with a graphic pointing device, such as the mouse 4.
  • the Chart Window 22 includes a chart template 24 comprising an x-axis label 26, a y-axis label 28 and a data area 30 for a chart representation of data.
  • Other menus or representations of data variables appear in the Chart Window 22, including a variable label list box 32 of database variable labels, and an x-axis selection option button 36 and a y-axis option button 38 which identify the current axis choice. While in the preferred embodiment list boxes and option buttons are set up and operated as is typical in the Microsoft Windows operating system, as illustrated in the Microsoft Windows User Guide, it is contemplated that any suitable types of selection and option display would come within the invention.
  • the axes variable labels appearing in the variable list box 32 represent individual data items or variables in the database.
  • the user By selecting different variables or different sets of variables for the charts, the user develops visual impressions of the data thereby identifying trends, patterns and other characterizations which transform the unprocessed database data into valuable information.
  • the number of variables which can be evaluated and the kinds of information seeking activities are unlimited. It is understood that this embodiment, as shown in FIG. 2, displays a chart with two dimensions. If charts of three or more dimensions. are used, the option button selection area changes to accommodate the additional axis selections.
  • multi-dimensional visual data evaluation is possible with the present invention.
  • the tool bar 34 includes a number of chart attribute buttons, or icons, and icons representing process options.
  • the tool bar 34 comprises a bar chart icon 42, a scatter plot icon 46, a pie chart icon 91, a sum/mean icon 92, a chart history window icon 50, a query node display options icon 93, a full statistics icon 94, a new tree icon 95, a query advance icon 96, a three dimensional chart icon 97 and a query node operations icon
  • the mouse 4 allows the user to control a cursor 40 which appears over the screen. Any of the icons in the tool bar 34 may be selected by clicking the left mouse button 14 while the cursor 40 is positioned over the desired icon. By clicking while the cursor 40 is on the icon, that particular process option function represented by the icon is selected and carried out. For example, by selecting the bar chart icon 42 the data appear in the data area 30 in a bar chart.
  • the sum/mean attribute button 92 can be selected to toggle the display to show the category mean or total of the y-variable.
  • the sum/mean attribute button 92 illustrates one of a number of data computations and transformations that can be applied to any of the axis variables. For instance, medians, highs, lows, standard deviations, logarithmic transformations, exponential transformations and other operations may be applied to develop additional information from the data displayed on the chart.
  • the chart history window button 50 is an additional documentation and presentation feamre of the present invention and is used to display previously developed charts selectively in a tiled graph presentation to assist in data evaluation and searches.
  • the query node display options icon 93 and the full statistics icon 94 toggle display options between summary and full display of information.
  • the new tree icon 95 initiates new query tree strucmres.
  • the query advance icon 96 changes the current data subset designation.
  • the three dimensional chart icon 97 illustrates one of a number of three dimensional chart types.
  • the query node operations icon 98 supports operations accomplished with references to query tree nodes.
  • FIG's. 3A through 8 showing flow diagrams for various process operations.
  • the terms “x” and “y” refer to the variables that define a current data subset; data subsets are also sometimes referred to as “segments; " “display X” and “display Y” refer to variables displayed on the currently viewed chart; "LMBC” refers to a left mouse button click operation; “RMBC” refers to a right mouse button click operation; “LMBD” refers to a left mouse button down and hold operation; “LMBU” refers to a left mouse button release operation and “LMBDC” refers to a left mouse button double click operation.
  • the user initializes the process 104 and populates the chart template 24 of the Chart
  • Window 22 by selecting a chart type using the tool bar 34, such as selecting a bar chart by clicking the left mouse button on the bar chart icon 42 as described above, and by selecting variables for each chart axis from the variable label list box 32 in conjunction with the axis option button settings 36, 38.
  • a chart type such as selecting a bar chart by clicking the left mouse button on the bar chart icon 42 as described above
  • variables for each chart axis from the variable label list box 32 in conjunction with the axis option button settings 36, 38.
  • the variable for the x-axis is selected with a left mouse button click 128 (FIG. 3B) on any of the variable labels in the variable label list box 32 changing the display X value 604 (See FIG. 8).
  • variable for the y-axis is selected by then clicking on any of the variable labels in the variable label list box 32 changing the display Y value 606. In this manner, a y-axis variable and x-axis variable are selected and the data are used to populate the chart.
  • x-axis and y-axis variables can be selected to change the relationship shown and update the chart 604, 606 (FIG. 8).
  • the present invention performs a join operation. If the common variables and join options have been previously identified, the join will occur on-the-fly. Otherwise a dialogue box, drop-down menu or the like will be used to identify the required common variable and other join options. Selecting alternative chart variables and chart types enables the user to browse, or visually evaluate, the data in a variety of visual modes, to better discover patterns and inspect relationships between variables and to search for specific information.
  • one or more areas within the currently- viewed chart may be defined and selected using mouse operations. If the chart is a bar or pie chart, a mouse click on a bar or pie segment 112 designates that chart component as a data subset (See FIG. 4). Click-and-drag operations are used to capmre one or more individual points on a scatter plot 116 as a data subset by forming a box around the selected points (See FIG. 6).
  • click and drag it is meant that the mouse button is depressed when the cursor is over an initial portion of the data subset of the chart to be captured and the mouse is moved, “dragging" the cursor over the remaining portion of data subset to be selected, thereby defining a selected portion of the chart area. When the entire desired area is defined, the mouse button is released, ending the "click and drag” operation.
  • Data subsets may also be defined by clicking and dragging the mouse along or below one of the axes 120 and releasing the button which fixes the single variable range (See FIG. 6).
  • the chart area representing each data subset selected is visually distinguished in a unique manner such as by color, pattern or other means and graphical representations of segment statistics (e.g., mean values of the segments, measures of dispersion, other statistics, as appropriate) may be added to the chart.
  • Noncontiguous data on the chart can be selected for the same data subset using the query advance attribute button 96. This is accomplished by first selecting one data subset, clicking the left mouse button over the query advance attribute button 96 to undo the automatic query color and number updating and then selecting an additional data subset to be included with the current data subset. This combines the two selections into a single data subset rather than sequential data subsets.
  • Another feamre of the present invention allows the user to move the analysis to a new level which contains only the data in a particular subset.
  • Attributes of the new chart can be modified to visually evaluate the new data subset and to evaluate relationships among the data.
  • Each of these mouse operations specifies and fetches a data subset from the larger data set. In other words, this action performs a "query" solely through mouse operations entirely within the data area 30 of the chart.
  • the present invention allows users to
  • capmre the object of the query, that is, the records whose variable values are consistent with the data subset, with mouse operations on an actual visual chart presentation of the data without ever having to refer or resort to a spreadsheet table or compose a query.
  • This process may be continually reapplied by the user to conduct data evaluation and query operations, or "navigate" through the data, using any variable relationships and chart types with an unlimited number of user-specified queries without ever leaving the active chart area of the display.
  • one or more other display windows are concurrently presented in "tiled" fashion on the main display.
  • the other display windows may be used to document the query process, summarize data presented in the chart, provide navigation to charts developed in previous steps and reference and use chart-defined entities as operands in other operations.
  • simultaneous presentations of the hierarchical query strucmre and statistics characterizing the data in the chart may be provided for in separate query and statistics display areas referred to herein as the Query Tree Window 52 and the Statistics Window 54, respectively.
  • the Query Tree Window 52 and the Statistics Window 54 areas maintain current and historical information on the evolution of the chart-based queries, dynamically document the user's evaluation process, and provide a means for redirecting the analysis, or "navigating" through the data.
  • the Query Tree Window 52 is initially empty. When the process is initialized a single node appears which is the first level on the query tree or the "root" node 56 (See FIG. 9). The "root" node represents the entire database prior to selecting data subsets or segmentation through the chart-based query process described above.
  • a node is added to an inverted tree strucmre 53 (FIG.
  • Each node reflects the visual designation, by color, pattern or other means, of the data subset that is applied in the chart.
  • the nodes of the query tree function are all manipulable, graphical entities. Each of the nodes that are displayed in Query Tree Window 52 can be selected with a left mouse button click on the node 130 to bring up the results of that particular query (See FIG. 7) through a repositioning of the query process back to that step. Scroll bars on the right and the bottom of the Query Tree window 52 can be used to move through portions of the tree not currently displayed.
  • the default display for query nodes in the Query Tree Window 52 includes only the data segment number and color or other visually distinguishing representations. However, clicking on the query node display options button 93 toggles to a larger node box which includes information presented in the data subset definition of the Statistics Window 54, as will now be described. As shown in FIG.
  • the Statistics Window 54 is initially empty except for default statistics table headings 62.
  • user-defined statistics such as the number of records, totals or averages of selected variables or other information are computed and presented for each data subset.
  • the entries may be distinguished with a block that contains the unique visual designation used for this data subset and/or by a number, letter or other symbol representing this query both in the statistical window and the query tree.
  • statistics entries include limiting ranges of the x-axis and y-axis variables used to define the query subset.
  • the Statistics Window 54 entries are dynamically generated; that is, as the mouse 4 is clicked and dragged with the cursor either within the data area 30 or along one of the axes, the statistics are dynamically updated providing a truly interactive query process.
  • the Statistics Window 54 entries show, by default, only the data segments in the current chart and the parent segments, that is, statistics for the nodes which lead directly from the "root" node. The user can, however, use the full statistics chart attribute button 94 to toggle the display to present the full set of data subsets generated during the previous steps of the data evaluation.
  • the user conducts comprehensive, flexible, visual browsing and query operations without ever leaving the active chart area of the display, defining and generating new data subsets, adding nodes to the query tree and placing additional entries in the Statistics Window 54.
  • the dynamic updating and concurrent presentation of the Query Tree Window 52 and Statistics Window 54 provides users with a powerful, dynamic visual view of the evolution of the analysis.
  • the display may also include a stams bar 64 for displaying the x-axis and y-axis variable values when the cursor 40 is within the data area 30 of the chart. Moving the cursor 40 across the nodes in the query tree also presents the corresponding data subset definition variables and variable ranges in the stams bar 64.
  • the chart image, related statistics, included records, query specifications, query relationships and other information defined by the chart-based query are collectively referred to as "chart entities. " Chart entities may be referenced with mouse operations on query tree nodes or on Statistics Window entries. These entities are used to create new data subsets, to copy the down-tree history of query operations to other nodes in the query tree and in mathematical operations, report generation, printing and other activities.
  • Chart History attribute button 50 provides this additional documentation and presentation feamre.
  • the Chart History Window 66 is presented with a small Query Tree Window 68 overlay as shown in Figure 13.
  • the Chart History Window 66 is initially split into "empty" sub windows.
  • the Chart History Window provides a drop-down menu option, dialogue box, or other comparable user- interactive device to change default settings such as the number of subwindows and the size of each subwindow. If the resulting screen is too large for the display, scroll bars are added to the bottom and/or right side of the window.
  • Figure 13 shows a user selection of four tiled subwindows. These subwindows are populated by using the mouse to drag-and-drop the image of any Query Tree node or any
  • the Chart History Window 66 allows the user to display any previously defined charts. For instance, charts associated with nodes along a single branch of the Query Tree or with nodes at the same level along different branches can be displayed with this feamre.
  • the Chart History Window 66 may be closed, hidden or resized by the user when the chart history viewing is completed. This feamre provides flexibility in visually comparing graphs from any point in the analysis.
  • the drag-and-drop operation using query nodes to populate the Chart History Window illustrates the use of the chart entities in this invention. Whenever a chart entity is referenced within the present invention, the appropriate attributes of the chart entity are used to complete the operation. In the case of the Chart History Window 66, the chart image is displayed in the tiled subwindow.
  • Alternative query tree hierarchies can be developed by selecting the new tree icon 95 which generates a new root node adjacent the existing query tree(s) in the Query Tree Window 52.
  • a new independent analysis can be initiated by clicking on the new root node and then performing the browsing and querying operations described above.
  • the analysis can be repositioned to any previous point in the process by operating with the mouse on one of the Statistics Window 54 color-coded boxes 132 or the nodes of the query tree 130. Using this operation, the results of the previously executed steps can be reviewed or revised (See FIG. 7).
  • Data subsets or "query definitions,” are revised by repeatedly selecting the query advance icon tool bar button 96 to move the current data subset color and number designation to the data subset to be revised, selecting a new data subset and, if desired, deleting the old subset using a right mouse button click over the old subset 114 (See FIG. 5). If data subsets are deleted, child statistics and nodes are deleted and their representations are removed from their respective windows. Each time the query advance icon is selected, the current data subset changes to designate another of the previously defined subsets shown on the current chart.
  • the current data subset designation is indicated by a visually distinctive color outlining of the data subset area. If the analysis is repositioned and segments are redefined using different variables, the old down-tree segments will be discarded to make room for new data subset definitions (See FIG. 8).
  • This feamre is part of the present invention which prevents data records from belonging to more than one data subset in the same level, thereby presenting an unambiguous hierarchical query tree and statistics entry development.
  • other embodiments of the present invention can be applied to allow multiple branches running from each query node to represent alternative query variable selections at the same level.
  • Chart entities may also be applied to create new data subsets. This operation includes first clicking on a query tree node and dragging a copy of its image to the new data subset area represented by an adjacent unused portion of the Query Tree Window 52 and then clicking on the query node operations attribute button 98.
  • a dialogue box or other comparable user-interactive device may be used to identify a query operation such as a "union" which combines records from two or more data subsets into a single data subset.
  • Another drag and drop operation is then performed to copy the image of another query tree node to the same new data subset area of the Query Tree Window 52.
  • a dashed-line box encompasses the images of the two node operands and a union operation symbol in the new data subset area of the Query Tree Window 52.
  • This new data subset includes all records from the data subsets identified by the two nodes. Clicking the left mouse button on the dashed-line box enables the user to reposition the analysis to the new data subset and to conduct all charting and querying operations on the new data subset just as if it were a new root node.
  • the following non-limiting example application illustrates the implementation of this invention with a visual evaluation of data from a survey of electric utility customers. These data may be used with the process of the present invention, for example, to develop forecasts of fumre energy use and to evaluate marketing programs.
  • Figure 9 shows the contents of the three windows after selecting a chart and chart variables.
  • the data appear in the data area 30 in a bar chart 44 after clicking the left mouse button 14 on the bar chart icon 42 and after populating the bar chart by clicking on the x-axis option button 36 designating the x-axis and the variable label "building" 74 in the variable label list box 32, and after clicking on the y-axis option button 38 designating the y-axis and the label "energy” 75 in the variable label list box 32.
  • the value on the y-axis shows the mean or average customer energy use in each building category.
  • the sum/mean attribute button 92 can be selected to toggle the display to show the category total of the y-variable.
  • the bar chart 44 has been constructed within the data area 30 and the selected "x" 26 and "y” 28 variable labels are displayed along the respective axes.
  • the building type and energy data in this example are actually stored in two separate tables. Building type is part of the survey data table while energy use is part of the billing table, developed independently from utility billing data files. Selecting these two variables generated an on-the-fly join of the tables where the customer account variable (not shown) was the "key" variable common to both tables. Choosing other x-axis variable labels reveals relationships between these new variables and energy use. Similarly, other y-axis variable labels can be selected to examine their building-specific values and relationships across the building types. Of course, any of the different x-axis and y-axis variables can be selected for visual evaluation.
  • this invention automatically segments continuous variables into a set of categories.
  • the cursor 40 is within the data area 24 of the bar chart 44, the x-axis and y- axis variable values are displayed on the stams bar 64.
  • the cursor 40 is over the office bar 76 at a y-axis value of 1.3 MWh (MegaWatt hours).
  • the Statistics Window 54 contains information on the entire database. Total customers and annual energy and the percent of the total reflected in the current chart are displayed as default statistics.
  • the Query Tree Window 52 contains a single node 56 which represents the "root" of the tree, the entire database prior to selecting data subsets through the chart-based query process.
  • the chart type can easily be changed. For example, if the scatter plot icon 46 is selected, one "dot" will appear in the data area 30 to reflect the x-axis and y-axis variable values for each record in the database. As with the bar chart or any other chart type, alternative selections of x-axis and y-axis variables will present scatter plots for each of the user-selected x-axis/y-axis combinations.
  • FIG. 10 shows the contents of the three windows after selecting an office data subset by clicking the left mouse button while the cursor 40 is positioned over the "office" bar 76.
  • this selection is visually characterized by a unique color, indicated in FIG. 10 with shading on the office bar 76 of the bar chart 44.
  • a second node 78 is added to the query tree to represent the office data subset selection, the "query, " and an entry 79 is added to the Statistics Window 54 to provide the summary statistics for the office data subset.
  • the query tree 53 is developed with lines or branches running from a single "parent" node to one or more "child” nodes. Note that the width of the color-coded boxes, shown in FIG. 10 with shading or stippling, indicate the level of the data subsets in the query hierarchy as depicted in the query tree.
  • FIG. 10 shows that the color mapping used for data subsets and nodes are also applied as box backgrounds in the Statistics Window 54 to map to statistics entries.
  • a data subset number 80 is assigned and documented on the query node 78 and in the statistics entry
  • the data subset definition includes only information on the building type selection which is "office.”
  • FIG. 11 shows the contents of the three windows after selecting another data subset by clicking the mouse 4 while the cursor 40 is positioned over the "retail" bar 84.
  • This selection is also characterized by a unique color, indicated in FIG. 11 with shading on the retail bar 84 of the bar chart 44.
  • a third node 86 is added to the query tree 53 to represent the retail data subset selection, or "query,” and an entry 82 is added to the Statistics Window 54 to provide the summary statistics for the retail data subset 84.
  • the third node 86 is also assigned a unique data segment number 99 which is recorded in the query tree node 86 and the Statistics Window 54 entry 82.
  • FIG. 12 shows the office subset using a scatter plot of energy (y-axis variable) 28 and floor space (x-axis variable) 26 to display the relationship between office building energy use and office building size.
  • FIG. 12 also shows the selection of two data subsets 89, 90 within office buildings characterized by energy use and floor space variable ranges. These records are captured by a click and drag operation in which the left mouse button is depressed and while depressed the mouse is dragged to open a rectangular area which is fixed when the mouse button is released.
  • the queries pictured in Figure 12 produce two new query nodes 70, 71 and statistics window entries 72, 73.
  • the analysis can be repositioned to any previous point by clicking the mouse on one of the Statistics Window color-coded boxes or one of the Query Window nodes of the query tree. For instance, clicking on the root node "0" 56 would reposition the user to the chart presented in Figure 11. From that point, the results of the previously-executed steps can be reviewed or revised. If the chart data subsets are revised, child charts and statistics entries below that point are automatically updated to correspond to new data subset definitions.
  • the drag-and-drop query node operation may be used to copy the down-tree history of the prior query operations to other nodes in the query tree. If a drag-and-drop mouse operation were used to move a copy of query node "1 " 78 to query node 2 in FIG.
  • query nodes 5 and 6 would automatically appear below query node "2" 86 in the Query Tree Window 52.
  • Clicking on node "2" would now show a scatter plot of retail buildings with the same data segments defined by the chart in Figure 12 while statistics for these data subsets would also appear in the Statistics Window 54.
  • this dragging of the query node is preferably used to duplicate the down stream queries on the data subset represented by the dragged query node. This exercise is to be distinguished from the exercise described above wherein two query nodes are consecutively dragged to the same open area in the Query Tree Window 52 to form a new data subset.
  • Figure 13 shows an application of the Chart History Window 66 using four subwindows.
  • User mouse drag-and-drop operations have been performed with query tree nodes numbers "0" and "1 " 56, 78 in the Query Tree Window 68 overlay to populate two of the subwindows.
  • An unlimited number of windows with user-selected sizes can be created to conduct flexible and comprehensive visual analysis of previously-developed charts.
  • queries could be performed from the chart history window.
  • the browsing and querying process described with Figures 9 - 13 broadly illustrates the progression of activities undertaken in visual data evaluation.
  • the feamres of this invention accomplish these activities with mouse cursor operations operating within a single chart paradigm and operating only on the data area of the chart window.
  • User conceptual orientation is maintained by operating within a single chart area and with immediate query results and concurrent, dynamic documentation of the query evolution visible in the Statistics and Query Tree Windows.
  • the previously described versions of the present invention have many advantages, including the provision of a simple method for visually evaluating complex databases with feamres which compensate for human cognitive limitations.
  • the method allows the user to access and manipulate a database in real time, viewing, evaluating and navigating, by means of a simple query process, through data presented on the display.
  • the method frees the user from having to learn formal query language or other procedures which are translated into query language; consequently it also frees the user from limitations imposed by the expressive capacity of existing query languages.
  • the method provides on-the-fly viewing, evaluation and querying with simple operations on a single dynamic representation of the database.
  • the system works with all databases regardless of the database management approach.
  • the present invention automatically "joins" tables in a relational database when two or more variables from different data tables are chosen for the axes of a single chart.
  • the present invention also includes the simultaneous generation of hierarchical tree summaries of the browse and query operations and a statistical summary which reports information for each step in the user-guided browsing and querying process. While the present invention has been described in considerable detail in connection with particular embodiments thereof, other versions are possible. It will be understood, of course, that I do not intend to limit the invention to those embodiments since modifications may be made by those skilled in the art, particularly in light of the foregoing teachings. For example, this invention can be applied to databases consisting entirely of non-numerical variables or data items, or it can be applied to representations of data presented on a geographic map format. I intend to cover all alternatives, modifications and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims.

Abstract

A method and system for computer-based visual data evaluation which allows on-the-fly viewing, evaluation, and querying of complex databases (20, 34) with simple user operations. A visual chart representation of a data set (30) is used to select display data subsets through interaction between the user within the chart of the data set (60). The results of the user's data subset selections are displayed in the chart (30). The visual symbols may be used as software buttons (42, 46, 91, 92, 50, 93, 94, 95, 96, 97, 98) for selecting for display the associated data subset and other operations. Visual data evaluation includes browsing, querying and manipulation of data and other information (22, 54, 52, 20) within a database by providing chart representations of database data and operating only on the attributes (74, 75) of the chart (30) and within the data area of the chart (30).

Description

Computer-Based Visual Data Evaluation
Background This invention generally relates to a process for database querying, and more particularly concerns an interactive interface for chart-based graphical data browsing, querying and manipulation.
A portion of the disclosure of this patent document pertains to material which is subject to copyright protection. The copyright owner has no objection to the facsimile reproduction by anyone of the patent document or the patent disclosure, as it appears in Patent and Trademark patent file or records once the patent issues or the file is otherwise made available to the public according to law, but otherwise reserves all copyright rights whatsoever.
Visual data evaluation is an important part of information processing. For many objectives such as pattern recognition, outlier analysis and general data exploration, human visual data evaluations are far superior to other options such as automated statistical procedures.
Visual data evaluation embodies two related activities: browsing and querying. Browsing is an information-seeking process which utilizes chart displays of data including bar charts, scatter plots and the like to detect patterns, to develop an intuitive understanding of relationships exhibited by the data and to determine the next desired chart presentation of the data. "Querying, " which is a mechanism for accessing information stored in a database, specifies and selects data subsets which can then be used for additional browsing, querying or other information processing. Browsing can be considered the primary visual information gathering step while querying allows the user to "navigate" through the data.
Visual data evaluation, however, is necessarily constrained by the limits of human cognitive abilities which permit only relatively small quantities of data to be evaluated at one time. For example, a data series with one hundred observations can easily be inspected visually while one with ten thousand observations cannot. Consequently, large data series must be divided into subsets to conduct visual data evaluations. Furthermore, graphical representations quickly become confusing when a third or fourth dimension is added. Therefore, most visual data evaluation is conducted on pairs of data items or variables. Finally, the limits of human memory make it difficult to remember and process important information from more than a dozen or so data subsets or pair-wise visual evaluations. Commercially available software can provide data manipulation, querying and charting functions required to conduct visual data evaluation. While the general class of software referred to as spreadsheet software is most suited and most frequently used to conduct these evaluations, its application is cumbersome and tedious.
Spreadsheet software represents data in a column and row tabular format. Spreadsheet data is selected for use in a chart by specifying desired columns and rows either through a series of keyboard entries or with mouse operations on the tabular data display. Chart specifications are determined with a series of choices presented in menus, dialogue boxes, or other user-interactive devices. Finally, the chart is presented in a separate display area. Changing one of the variable series presented in the chart is initiated by returning to the spreadsheet display and then repeating the data selection process and updating the chart display.
Examining a noncontiguous subset of spreadsheet data requires a separate data query to extract the desired data and place it in another area of the worksheet. Queries are performed after users specify the data to be queried, query parameters and the area in the spreadsheet that will hold the query results. The columns and rows containing the new data subset are then referenced and incorporated in new chart displays. Spreadsheet data manipulation is also often applied to compute statistics for query results at intermediate points in the evaluation. Additional charting, querying and data manipulation continue through as many additional repetitions as desired. While the results of spreadsheet-based visual data evaluations are recognized to have substantial value, only limited evaluations can be undertaken before the detailed, cumbersome, and error-prone nature of identifying and developing new charts and keeping track of the relationships between the new queries and charts and the query and chart histories overtakes the ability of the user to interpret the information. Commercially available database management software (DBMS) also represents data in a tabular format; however, instead of the row and column terminology, database data is generally referenced as records and fields. DBMS typically provides greater flexibility in query operations including the computation of a limited number of statistics. Although queries of great complexity may be formulated using DBMS, this software is much more difficult to use than is spreadsheet software. The standard Strucmred Query Language (SQL) is entered in English-like commands; however, complicated and rigorously structured syntax makes SQL querying a difficult process for users to master. Table or form-based procedures such as Query-by-Example (QBE) have been developed to convert form and table input into query results, and while these developments have decreased the burden of SQL query formulation somewhat, they certainly have not eliminated it. More recent DBMS and spreadsheet software systems apply graphical user interface
(GUI) techniques which allow users to select icons, symbols or other representations presented on the display to specify query details. While software in this later category is often said to provide "graphical" queries (applying the word "graphical" as it is used in the term GUI), a more appropriate characterization is "symbolic query". That is, the user selects symbols from the display to specify a query. Symbols include icons, tables, text, picmres and other representations which connotate data or query operations.
While symbolic systems provide a more intuitive query process than SQL thereby reducing the number of errors inexperienced SQL users might otherwise make, they still require the user to conceptually comprehend complicated database or spreadsheet processes and strucmres in order to master a series of detailed procedures to define query criteria and relationships.
One of the most important DBMS operations is the "join" operation which is applied to relational databases to combine data from two separate database tables into a single table for further processing. Users must specify commands in SQL text or use mouse selections in symbolic systems to select the tables to be joined and to identify the variables to be included in the resulting table. The problem with this process is that each time the user wants to combine a new set of variables from different tables or wants to include another variable in the current table, a new join operation must be completed. While the relational database approach of storing data in separate tables provides an efficient and flexible model for maintaining the physical database system, it also adds the additional burdens on the user who must possess an understanding of the table strucmre of the database and must perform table joins each time variables are used from different tables.
DBMS also requires the same kind of detailed, sequential step-by-step data manipulation, query and charting process described for spreadsheet software. As a result, DBMS is even more difficult to use in its application to visual data evaluation.
Consequently, the currently available spreadsheet and DBMS software, except in the simplest cases, is woefully inadequate in its application to visual data evaluation.
One problem that limits the value of the currently available spreadsheet and DBMS software systems in visual data evaluation is that the large number of detailed steps required in data manipulation, querying and charting severely limit the user's ability to remember and process database information.
Another problem with such software systems is that the charting process, which is the primary visual mode for presenting and discovering information, is provided only as a final visual documentation of data selection and manipulation which have already occurred rather than as an integrated part of the visual data evaluation process itself. Consequently, users do not receive interactive, visual feedback from manipulation of the database that occurs with queries and browsing activities.
Yet another problem with existing DBMS and, to a lesser degree, spreadsheet software is the complex, highly strucmred and non-intuitive namre of database and spreadsheet query processes and the resulting difficulty in mastering such systems.
Yet another problem with existing software systems is that separate "join" operations must be applied to data from different tables prior to accessing the data in a single combined table.
Still another problem is that the visual data evaluations quickly become confusing as the user loses an understanding of the evolution of previous graphical, statistical and query steps.
The problems with currently available software are becoming even more severe as increased use of databases and greater need for information is occurring at the same time that rapidly increasing commumcations networks and workstations are making these data available to users who are generally less proficient in the tools needed to efficiently and accurately access database information. For the foregoing reasons, there is a need for a new, simpler software system for visually evaluating information in complex databases. This new system should support rather than tax human cogmtive abilities throughout the data evaluation process. The system should also provide a new intuitive visual context for browsing and querying data by means other than lengthy, detailed procedures employing formal language statements or symbolic query representations. Rather, users should be able to directly view, evaluate and query data with simple operations on a single comprehensive dynamic representation of the database. Such new method should also be able to accomplish complex queries while at the same time be easily understandable to novice database users. Further, the method should also allow users to select all database variables without having to conduct separate join operations prior to accessing the data. Finally, the system must be directly applicable to a broad base of existing database systems and network environments.
Summary
The present invention is directed to a method and a system that satisfies these needs. A method in a data processing system for accessing information in a data set having feamres of the present invention comprises the steps of creating a visual chart representation of the data set and displaying the data set in the chart, selecting a second data set which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set, and displaying the results of the data subset selecting step. The information accessing method may further comprise the steps of selecting the data subset through interaction between the user and the system within the displayed data subset and displaying a chart of the selected data subset. The steps of selecting a data subset through interaction between the user and the system within the chart of any previous data subset and displaying the results of the data subset selecting step may be continued in an iterative data evaluation process.
Further, the method of the present invention may comprise the step of maintaining a record of the selected data subsets, including associating a distinct visual symbol with each data subset record and using the visual symbol as a software button for selective viewing of the associated data subset and from which the data evaluation may be redirected. The step of maintaining a record of the user selected data subsets may comprise the steps of creating a record of each data subset, creating and displaying a distinct visual symbol for each of the data set and the data subsets, and arranging the visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
Optionally, a record of the user selected data subsets may be maintained by creating a texmal record and values of the chart attributes which define the data subsets, displaying the texmal record for each of the data set and the data subsets, and arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subsets as defmed by the data subsets selecting step.
In another aspect, the present invention comprises a method in a data processing system for maintaining a record of user selected data subsets selected from a data set comprising the steps of creating a record of the data subsets, such as a texmal record of the data subsets and the values of chart attributes which defme each data subset; creating and displaying a distinct visual symbol for each of the data set and the data subsets; and arranging the visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step. A visual symbol may be selected for displaying visually the associated data subset. The method may further comprise the steps of maintaining and displaying simultaneously a visual chart representation of the data set, receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set, creating records of the additional data subsets, creating and displaying distinct visual symbols for each of the additional data subsets, and arranging the distinct visual symbols in a network of interconnected visual symbols to indicate the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
Further, the present invention comprises a method in a data processing system for maintaining a record of user selected data subsets selected from a data set comprising the steps of creating a texmal record and the values of chart attributes which defme the data subsets, displaying the texmal record for the data set and data subsets, and arranging the visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step. The method may further comprise the steps of maintaining and displaying a visual chart representation of the data set, receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set, creating records of the additional data subsets, creating texmal records of the additional data subsets and values of chart attributes which defme the data subsets, creating and displaying distinct visual symbols for each of the additional data subsets wherein the visual symbols for data subsets in the same level of the selection hierarchy share a common feamre, and arranging the texmal records and displayed visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selecting step.
A data processing system for accessing information in a data set having feamres of the present invention comprises means for creating a visual chart representation of the data set, means for selecting a data subset which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set, and means for displaying the results of the data subset selection.
The data set information accessing system may further comprise means for selecting the data subset through interaction between the user and the system within the displayed data subset and means for displaying a chart of the data subset.
A system for maintaining a record of the selected data subsets in accordance with the present invention comprises means for creating a record of each selected data subset. The record maintenance system may further comprise means for creating and displaying a distinct visual symbol for each data subset and means for arranging the visual symbols in a network of interconnected visual symbols to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subset selection. The record maintenance system of the present invention may optionally comprise means for creating a texmal and values of chart attributes which define the data set and data subsets, means for displaying the texmal records, and means for arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selection. Accordingly, it is an object of the present invention to provide a new method for computer-based visual data evaluation having one or more of the novel features of this invention as set forth above or hereinafter shown or described.
Another object of the present invention is to provide a new system for computer-based visual data evaluation having one or more of the novel feamres of this invention as set forth above or hereinafter shown or described.
It is also an object of the present invention to provide an improved computerized interactive method for providing affording visual data evaluation including browsing, querying and manipulation of data and other information within a database. Another object of the present invention is to allow a user to conduct visual data evaluation by beginning with an initial data chart and operating only on the attributes of the chart and within the data area of the chart to provide an integrated interactive chart-based process for browsing, querying and manipulating data.
Yet another object of the present invention is to allow the user to conduct querying operations within the data area of the graphical chart display in such a way that the user
"captures" the subset of data which is the object of the query by operation of a pointing device.
Further, it is an object of the present invention to provide a data browsing, querying and manipulation system wherein database table joins are automatically conducted when the user selects chart variables which reside in different tables.
Still further, it is an object of the present invention to provide an improved data querying and statistical manipulation history display which maintains the user's understanding of the evolution of graphical, statistical and relational information derived through browsing and querying activities, including query and statistics histories which are updated in real time and which can be displayed concurrently on the display.
Also it is an object of the present invention to provide chart, query and statistical histories of queries on demand.
A related object of the present invention is to allow the user to reposition the chart- based data evaluation to any previously defined position by operating on entries in the query and statistics histories. These and other objects of the present invention are accomplished interactively and dynamically and are displayed on the computer display device in the form of texmal and visual records of the query process arranged in a strucmral hierarchical relationship defined by the evolution of the user-generated data evaluation process. Another feamre of the present invention is to provide chart representations of database data as an integrated part of the visual data evaluation process.
Still another object of the present invention is to define chart entities as a collection of information on the data subset, chart specifications, query relationships and other information defined by chart-based user operations. The user may apply chart entities as operands in query, data manipulation and other operations.
A further feamre of the present invention is use of the visual and texmal records reflective of the queries as software buttons for repositioning or redirecting the evaluation to any previous point in the process.
The present invention is a simple method for visually evaluating complex databases. The method and system allows the user to access and manipulate a database in real time, viewing, evaluating and navigating, by means of a simple query process, through data presented on the display. The method and system does not require the use of a formal, strucmred query language. Rather, the method and system is an intuitive browsing and querying process employing simple operations on a single comprehensive dynamic representation of the database in which highly complex queries are feasible. On-the-fly viewing, evaluation and querying with simple operations are possible. The simultaneous generation of strucmral hierarchical summaries of the browse and query operations, and a statistical summary which reports information for each step in the user-guided browsing and querying process, prevents exhaustion of human cognitive abilities through the data evaluation process. The method also allow users to select any database variables without having to conduct separate join operations prior to accessing the data. The method and system of the present invention is applicable to a broad base of existing database systems and network environments. Brief Description of the Drawings
For a more complete understanding of this invention reference should now be had to the embodiment(s) illustrated in greater detail in the accompanying drawing(s) and described below by way of (an) example of the invention. In the drawings:
FIG. 1 is a pictorial representation of a representative hardware environment for the present invention.
FIG. 2 shows an unpopulated or empty depiction of a display as it appears on the computer display device of a data processing system programmed according to an embodiment of the present invention.
FIGS. 3 A through 8 is a flow chart representation of an embodiment of the present invention.
FIGS. 9 through 12 illustrate a progressive example of visual data evaluation according to an embodiment of the present invention. FIG. 13 illustrates the selection of the invention's Chart History Window feamre after performance of the queries illustrated in FIGS 9 through 12.
Description
Because use of the words "graphic" and "chart" in the computer industry today can mean a multiplicity of things many of which are highly distinguishable from each other and because it is essential to the understanding of this invention that such distinctions be readily and clearly made, specific words are defined for use herein as follows:
As used herein, the term "chart" refers to a graphical presentation of data wherein visual spatial representations are used to reflect relationships among the data presented in the chart. This definition of charts includes bar charts, scatter plots, pie charts, line charts, histograms, pert charts, maps, iconic charts and the like.
As used herein, the term "browsing" refers to an information-seeking process which utilizes chart displays of data to visually detect patterns. Browsing is often applied to develop an understanding of relationships exhibited by data and to conduct other visual considerations of data presented in charts. An embodiment of the computer-based visual data evaluation, including data browsing, querying and data manipulation, provided by this invention has been implemented in a software application program, known as MAISY (TM), which was written in the C + + programming language for use in the Microsoft Windows (TM) operating environment. A representative hardware environment for the invention is shown in FIG. 1, comprising a workstation including a data processing system generally shown at 1 , which may be programmed in accordance with the present invention. The workstation includes a central processing unit, such as a conventional microprocessor 2 which includes a graphics processor, a random access memory (RAM), read only memory (ROM), a cursor controller such as a mouse pointer 4, and means for communicating into a data processing network (not shown), which may have attached thereto further databases and as well as distinct, remote workstations. Coupled to the processor 2 is a video display device 6 which may be implemented using either a color or monochromatic monitor, as is well known in the art. Also coupled to the processor is a keyboard 8. The keyboard 8 preferably comprises a standard computer keyboard which is coupled to the processor 2 by a cable 10. The workstation includes nonvolatile storage for the database, such as hard disk, optical disk, or tape drive media.
The mouse 4 is coupled to the processor 2, in a manner well known in the art, via a cable 12. As is shown, the mouse may include a left button 14, and a right button 16, each of which may be depressed, or "clicked, " to provide command and control signals to the data processing system 1. While the disclosed embodiment of the present invention utilizes a mouse 4, those skilled in the art will appreciate that any graphical pointing device such as a track ball, touch pad, light pen, touch screen and the like may be utilized to implement the method of the present invention. The goal is to provide the user of the workstation a method, system and program resources to visually evaluate data encompassing an unlimited base of information.
Turning now to FIG. 2, an embodiment of the present invention, denoted generally at 20, begins with an "empty" display which includes a screen display area comprising a Chart Window 22. All visual data evaluation including browsing and querying are accomplished within the Chart Window 22 in an integrated, dynamic manner by operating with a graphic pointing device, such as the mouse 4. The Chart Window 22 includes a chart template 24 comprising an x-axis label 26, a y-axis label 28 and a data area 30 for a chart representation of data. Other menus or representations of data variables appear in the Chart Window 22, including a variable label list box 32 of database variable labels, and an x-axis selection option button 36 and a y-axis option button 38 which identify the current axis choice. While in the preferred embodiment list boxes and option buttons are set up and operated as is typical in the Microsoft Windows operating system, as illustrated in the Microsoft Windows User Guide, it is contemplated that any suitable types of selection and option display would come within the invention.
The axes variable labels appearing in the variable list box 32 represent individual data items or variables in the database. By selecting different variables or different sets of variables for the charts, the user develops visual impressions of the data thereby identifying trends, patterns and other characterizations which transform the unprocessed database data into valuable information. The number of variables which can be evaluated and the kinds of information seeking activities are unlimited. It is understood that this embodiment, as shown in FIG. 2, displays a chart with two dimensions. If charts of three or more dimensions. are used, the option button selection area changes to accommodate the additional axis selections. Thus, multi-dimensional visual data evaluation is possible with the present invention.
Representations of predefined chart types and process options may also appear on the display with the Chart Window 22, such as for example, a tool bar of chart attribute buttons and other process controls 34. The tool bar 34 includes a number of chart attribute buttons, or icons, and icons representing process options. The tool bar 34 comprises a bar chart icon 42, a scatter plot icon 46, a pie chart icon 91, a sum/mean icon 92, a chart history window icon 50, a query node display options icon 93, a full statistics icon 94, a new tree icon 95, a query advance icon 96, a three dimensional chart icon 97 and a query node operations icon
98. Other chart attribute buttons and process options icons are possible. It is understood that the foregoing list is representative and I do not intend to so limit the present invention since modifications may be made by those skilled in the art, particularly in light of the teachings herein. As is typical, the mouse 4 allows the user to control a cursor 40 which appears over the screen. Any of the icons in the tool bar 34 may be selected by clicking the left mouse button 14 while the cursor 40 is positioned over the desired icon. By clicking while the cursor 40 is on the icon, that particular process option function represented by the icon is selected and carried out. For example, by selecting the bar chart icon 42 the data appear in the data area 30 in a bar chart. If the scatter plot icon 46 is selected, one "dot" will appear in the data area 30 to reflect the x-axis and y-axis variable values for each record in the database. Similarly, by selecting the pie chart icon 91 the data appear in the data area 30 in a pie chart. The sum/mean attribute button 92 can be selected to toggle the display to show the category mean or total of the y-variable. The sum/mean attribute button 92 illustrates one of a number of data computations and transformations that can be applied to any of the axis variables. For instance, medians, highs, lows, standard deviations, logarithmic transformations, exponential transformations and other operations may be applied to develop additional information from the data displayed on the chart.
While the function of the remaining icons is not intuitively obvious and will be more fully described below, the following provides a brief introduction. The chart history window button 50 is an additional documentation and presentation feamre of the present invention and is used to display previously developed charts selectively in a tiled graph presentation to assist in data evaluation and searches. The query node display options icon 93 and the full statistics icon 94 toggle display options between summary and full display of information. The new tree icon 95 initiates new query tree strucmres. The query advance icon 96 changes the current data subset designation. The three dimensional chart icon 97 illustrates one of a number of three dimensional chart types. The query node operations icon 98 supports operations accomplished with references to query tree nodes.
An embodiment of the present invention will now be described with reference to FIG's. 3A through 8 showing flow diagrams for various process operations. In FIG's. 3A through 8, the terms "x" and "y" refer to the variables that define a current data subset; data subsets are also sometimes referred to as "segments; " "display X" and "display Y" refer to variables displayed on the currently viewed chart; "LMBC" refers to a left mouse button click operation; "RMBC" refers to a right mouse button click operation; "LMBD" refers to a left mouse button down and hold operation; "LMBU" refers to a left mouse button release operation and "LMBDC" refers to a left mouse button double click operation. The user initializes the process 104 and populates the chart template 24 of the Chart
Window 22 by selecting a chart type using the tool bar 34, such as selecting a bar chart by clicking the left mouse button on the bar chart icon 42 as described above, and by selecting variables for each chart axis from the variable label list box 32 in conjunction with the axis option button settings 36, 38. For example, by clicking on the x-axis option button 36 thereby designating the x-axis, the variable for the x-axis is selected with a left mouse button click 128 (FIG. 3B) on any of the variable labels in the variable label list box 32 changing the display X value 604 (See FIG. 8). Similarly, by clicking on the y-axis option button 38 thereby designating the y-axis, the variable for the y-axis is selected by then clicking on any of the variable labels in the variable label list box 32 changing the display Y value 606. In this manner, a y-axis variable and x-axis variable are selected and the data are used to populate the chart.
Of course, other x-axis and y-axis variables can be selected to change the relationship shown and update the chart 604, 606 (FIG. 8). If two or more variables from different data tables are chosen for the axes of a single chart, as may be the case with data from a relational database, the present invention performs a join operation. If the common variables and join options have been previously identified, the join will occur on-the-fly. Otherwise a dialogue box, drop-down menu or the like will be used to identify the required common variable and other join options. Selecting alternative chart variables and chart types enables the user to browse, or visually evaluate, the data in a variety of visual modes, to better discover patterns and inspect relationships between variables and to search for specific information.
Once the data have populated the chart, one or more areas within the currently- viewed chart, referred to herein as data subsets or segments, may be defined and selected using mouse operations. If the chart is a bar or pie chart, a mouse click on a bar or pie segment 112 designates that chart component as a data subset (See FIG. 4). Click-and-drag operations are used to capmre one or more individual points on a scatter plot 116 as a data subset by forming a box around the selected points (See FIG. 6). By "click and drag" it is meant that the mouse button is depressed when the cursor is over an initial portion of the data subset of the chart to be captured and the mouse is moved, "dragging" the cursor over the remaining portion of data subset to be selected, thereby defining a selected portion of the chart area. When the entire desired area is defined, the mouse button is released, ending the "click and drag" operation.
Data subsets may also be defined by clicking and dragging the mouse along or below one of the axes 120 and releasing the button which fixes the single variable range (See FIG. 6). The chart area representing each data subset selected is visually distinguished in a unique manner such as by color, pattern or other means and graphical representations of segment statistics (e.g., mean values of the segments, measures of dispersion, other statistics, as appropriate) may be added to the chart.
Noncontiguous data on the chart, such as separate bars in a bar graph, can be selected for the same data subset using the query advance attribute button 96. This is accomplished by first selecting one data subset, clicking the left mouse button over the query advance attribute button 96 to undo the automatic query color and number updating and then selecting an additional data subset to be included with the current data subset. This combines the two selections into a single data subset rather than sequential data subsets. Another feamre of the present invention allows the user to move the analysis to a new level which contains only the data in a particular subset. Positioning the cursor 40 with mouse movements over a data subset area of the chart and using a left mouse button 14 double click 124 advances the analysis to a new chart which includes only those records included in the selected data subset (See FIG. 7). Because the existing chart attributes selected and displayed in the Chart Window 22 are applied to the data, the visual effect is to
"zoom in" on the selected data subset 502. Attributes of the new chart can be modified to visually evaluate the new data subset and to evaluate relationships among the data.
Each of these mouse operations specifies and fetches a data subset from the larger data set. In other words, this action performs a "query" solely through mouse operations entirely within the data area 30 of the chart. Thus, the present invention allows users to
"capmre" the object of the query, that is, the records whose variable values are consistent with the data subset, with mouse operations on an actual visual chart presentation of the data without ever having to refer or resort to a spreadsheet table or compose a query. This process may be continually reapplied by the user to conduct data evaluation and query operations, or "navigate" through the data, using any variable relationships and chart types with an unlimited number of user-specified queries without ever leaving the active chart area of the display.
According to a further embodiment of the present invention, one or more other display windows are concurrently presented in "tiled" fashion on the main display. The other display windows may be used to document the query process, summarize data presented in the chart, provide navigation to charts developed in previous steps and reference and use chart-defined entities as operands in other operations. For example, simultaneous presentations of the hierarchical query strucmre and statistics characterizing the data in the chart may be provided for in separate query and statistics display areas referred to herein as the Query Tree Window 52 and the Statistics Window 54, respectively.
The Query Tree Window 52 and the Statistics Window 54 areas maintain current and historical information on the evolution of the chart-based queries, dynamically document the user's evaluation process, and provide a means for redirecting the analysis, or "navigating" through the data. As shown in FIG. 2, the Query Tree Window 52 is initially empty. When the process is initialized a single node appears which is the first level on the query tree or the "root" node 56 (See FIG. 9). The "root" node represents the entire database prior to selecting data subsets or segmentation through the chart-based query process described above. Within the Query Tree Window 52, a node is added to an inverted tree strucmre 53 (FIG. 10) beginning with the root node 56 to represent each data subset in visual, dynamic documentation of the hierarchical database strucmre that evolves each time a mouse query operation is performed. Each node reflects the visual designation, by color, pattern or other means, of the data subset that is applied in the chart.
The nodes of the query tree function are all manipulable, graphical entities. Each of the nodes that are displayed in Query Tree Window 52 can be selected with a left mouse button click on the node 130 to bring up the results of that particular query (See FIG. 7) through a repositioning of the query process back to that step. Scroll bars on the right and the bottom of the Query Tree window 52 can be used to move through portions of the tree not currently displayed. The default display for query nodes in the Query Tree Window 52 includes only the data segment number and color or other visually distinguishing representations. However, clicking on the query node display options button 93 toggles to a larger node box which includes information presented in the data subset definition of the Statistics Window 54, as will now be described. As shown in FIG. 2, the Statistics Window 54 is initially empty except for default statistics table headings 62. Within the Statistics Window 54, user-defined statistics such as the number of records, totals or averages of selected variables or other information are computed and presented for each data subset. The entries may be distinguished with a block that contains the unique visual designation used for this data subset and/or by a number, letter or other symbol representing this query both in the statistical window and the query tree. In addition to presenting useful information on the data subset, statistics entries include limiting ranges of the x-axis and y-axis variables used to define the query subset. Also, the Statistics Window 54 entries are dynamically generated; that is, as the mouse 4 is clicked and dragged with the cursor either within the data area 30 or along one of the axes, the statistics are dynamically updated providing a truly interactive query process. The Statistics Window 54 entries show, by default, only the data segments in the current chart and the parent segments, that is, statistics for the nodes which lead directly from the "root" node. The user can, however, use the full statistics chart attribute button 94 to toggle the display to present the full set of data subsets generated during the previous steps of the data evaluation. As thus described, during the query process, the user conducts comprehensive, flexible, visual browsing and query operations without ever leaving the active chart area of the display, defining and generating new data subsets, adding nodes to the query tree and placing additional entries in the Statistics Window 54. The dynamic updating and concurrent presentation of the Query Tree Window 52 and Statistics Window 54 provides users with a powerful, dynamic visual view of the evolution of the analysis.
The display may also include a stams bar 64 for displaying the x-axis and y-axis variable values when the cursor 40 is within the data area 30 of the chart. Moving the cursor 40 across the nodes in the query tree also presents the corresponding data subset definition variables and variable ranges in the stams bar 64. The chart image, related statistics, included records, query specifications, query relationships and other information defined by the chart-based query are collectively referred to as "chart entities. " Chart entities may be referenced with mouse operations on query tree nodes or on Statistics Window entries. These entities are used to create new data subsets, to copy the down-tree history of query operations to other nodes in the query tree and in mathematical operations, report generation, printing and other activities. Any previously developed charts can also be selected in a tiled graph presentation to assist in data evaluation. The Chart History attribute button 50 provides this additional documentation and presentation feamre. When this process is selected, the Chart History Window 66 is presented with a small Query Tree Window 68 overlay as shown in Figure 13. The Chart History Window 66 is initially split into "empty" sub windows. The Chart History Window provides a drop-down menu option, dialogue box, or other comparable user- interactive device to change default settings such as the number of subwindows and the size of each subwindow. If the resulting screen is too large for the display, scroll bars are added to the bottom and/or right side of the window.
Figure 13 shows a user selection of four tiled subwindows. These subwindows are populated by using the mouse to drag-and-drop the image of any Query Tree node or any
Statistics Window color box to any tiled subwindow. The Chart History Window 66 allows the user to display any previously defined charts. For instance, charts associated with nodes along a single branch of the Query Tree or with nodes at the same level along different branches can be displayed with this feamre. The Chart History Window 66 may be closed, hidden or resized by the user when the chart history viewing is completed. This feamre provides flexibility in visually comparing graphs from any point in the analysis.
The drag-and-drop operation using query nodes to populate the Chart History Window illustrates the use of the chart entities in this invention. Whenever a chart entity is referenced within the present invention, the appropriate attributes of the chart entity are used to complete the operation. In the case of the Chart History Window 66, the chart image is displayed in the tiled subwindow.
Alternative query tree hierarchies can be developed by selecting the new tree icon 95 which generates a new root node adjacent the existing query tree(s) in the Query Tree Window 52. A new independent analysis can be initiated by clicking on the new root node and then performing the browsing and querying operations described above. These
- If operations are documented with the same Query Tree and Statistics Window procedures described above.
The analysis can be repositioned to any previous point in the process by operating with the mouse on one of the Statistics Window 54 color-coded boxes 132 or the nodes of the query tree 130. Using this operation, the results of the previously executed steps can be reviewed or revised (See FIG. 7).
If the data subsets are revised, child charts and statistics entries below that point are automatically updated to correspond to new data subset definitions. Data subsets or "query definitions," are revised by repeatedly selecting the query advance icon tool bar button 96 to move the current data subset color and number designation to the data subset to be revised, selecting a new data subset and, if desired, deleting the old subset using a right mouse button click over the old subset 114 (See FIG. 5). If data subsets are deleted, child statistics and nodes are deleted and their representations are removed from their respective windows. Each time the query advance icon is selected, the current data subset changes to designate another of the previously defined subsets shown on the current chart. The current data subset designation is indicated by a visually distinctive color outlining of the data subset area. If the analysis is repositioned and segments are redefined using different variables, the old down-tree segments will be discarded to make room for new data subset definitions (See FIG. 8). This feamre is part of the present invention which prevents data records from belonging to more than one data subset in the same level, thereby presenting an unambiguous hierarchical query tree and statistics entry development. However, other embodiments of the present invention can be applied to allow multiple branches running from each query node to represent alternative query variable selections at the same level.
Chart entities may also be applied to create new data subsets. This operation includes first clicking on a query tree node and dragging a copy of its image to the new data subset area represented by an adjacent unused portion of the Query Tree Window 52 and then clicking on the query node operations attribute button 98. A dialogue box or other comparable user-interactive device may be used to identify a query operation such as a "union" which combines records from two or more data subsets into a single data subset. Another drag and drop operation is then performed to copy the image of another query tree node to the same new data subset area of the Query Tree Window 52. Upon completion of this operation, a dashed-line box encompasses the images of the two node operands and a union operation symbol in the new data subset area of the Query Tree Window 52. This new data subset includes all records from the data subsets identified by the two nodes. Clicking the left mouse button on the dashed-line box enables the user to reposition the analysis to the new data subset and to conduct all charting and querying operations on the new data subset just as if it were a new root node.
The following non-limiting example application illustrates the implementation of this invention with a visual evaluation of data from a survey of electric utility customers. These data may be used with the process of the present invention, for example, to develop forecasts of fumre energy use and to evaluate marketing programs.
Figure 9 shows the contents of the three windows after selecting a chart and chart variables. The data appear in the data area 30 in a bar chart 44 after clicking the left mouse button 14 on the bar chart icon 42 and after populating the bar chart by clicking on the x-axis option button 36 designating the x-axis and the variable label "building" 74 in the variable label list box 32, and after clicking on the y-axis option button 38 designating the y-axis and the label "energy" 75 in the variable label list box 32. The value on the y-axis shows the mean or average customer energy use in each building category. The sum/mean attribute button 92, can be selected to toggle the display to show the category total of the y-variable. The bar chart 44 has been constructed within the data area 30 and the selected "x" 26 and "y" 28 variable labels are displayed along the respective axes. The building type and energy data in this example are actually stored in two separate tables. Building type is part of the survey data table while energy use is part of the billing table, developed independently from utility billing data files. Selecting these two variables generated an on-the-fly join of the tables where the customer account variable (not shown) was the "key" variable common to both tables. Choosing other x-axis variable labels reveals relationships between these new variables and energy use. Similarly, other y-axis variable labels can be selected to examine their building-specific values and relationships across the building types. Of course, any of the different x-axis and y-axis variables can be selected for visual evaluation. Since a bar chart requires an x-axis variable represented by categories, this invention automatically segments continuous variables into a set of categories. When the cursor 40 is within the data area 24 of the bar chart 44, the x-axis and y- axis variable values are displayed on the stams bar 64. In FIG. 9, the cursor 40 is over the office bar 76 at a y-axis value of 1.3 MWh (MegaWatt hours).
Since all records in the database are used to populate the initial chart, the Statistics Window 54 contains information on the entire database. Total customers and annual energy and the percent of the total reflected in the current chart are displayed as default statistics.
These variables and display options can be changed by the user via user-interactive means such as a dialogue box, drop down menu, and the like. Since there are no data subsets at this point, there are no Data Subset Definition 60 entries. The Query Tree Window 52 contains a single node 56 which represents the "root" of the tree, the entire database prior to selecting data subsets through the chart-based query process.
The chart type can easily be changed. For example, if the scatter plot icon 46 is selected, one "dot" will appear in the data area 30 to reflect the x-axis and y-axis variable values for each record in the database. As with the bar chart or any other chart type, alternative selections of x-axis and y-axis variables will present scatter plots for each of the user-selected x-axis/y-axis combinations.
FIG. 10 shows the contents of the three windows after selecting an office data subset by clicking the left mouse button while the cursor 40 is positioned over the "office" bar 76.
In a preferred embodiment of the present invention, this selection is visually characterized by a unique color, indicated in FIG. 10 with shading on the office bar 76 of the bar chart 44.
At the same time that the office bar 76 is selected, a second node 78 is added to the query tree to represent the office data subset selection, the "query, " and an entry 79 is added to the Statistics Window 54 to provide the summary statistics for the office data subset. The query tree 53 is developed with lines or branches running from a single "parent" node to one or more "child" nodes. Note that the width of the color-coded boxes, shown in FIG. 10 with shading or stippling, indicate the level of the data subsets in the query hierarchy as depicted in the query tree.
FIG. 10 shows that the color mapping used for data subsets and nodes are also applied as box backgrounds in the Statistics Window 54 to map to statistics entries. A data subset number 80 is assigned and documented on the query node 78 and in the statistics entry
79. In this example, only the x-axis variable value "building type" was used to define the data subset so the data subset definition includes only information on the building type selection which is "office."
FIG. 11 shows the contents of the three windows after selecting another data subset by clicking the mouse 4 while the cursor 40 is positioned over the "retail" bar 84. This selection is also characterized by a unique color, indicated in FIG. 11 with shading on the retail bar 84 of the bar chart 44. At the same time that the retail bar 84 is selected, a third node 86 is added to the query tree 53 to represent the retail data subset selection, or "query," and an entry 82 is added to the Statistics Window 54 to provide the summary statistics for the retail data subset 84. As indicated in FIG. 11, the third node 86 is also assigned a unique data segment number 99 which is recorded in the query tree node 86 and the Statistics Window 54 entry 82.
Double clicking with the left mouse button 14 while the cursor 40 is positioned over the "office" bar 76 of the bar chart 44 selects the office data subset for further analysis. That is, the analysis "zooms in" on database records which have building type values of "office. " For example, FIG. 12 shows the office subset using a scatter plot of energy (y-axis variable) 28 and floor space (x-axis variable) 26 to display the relationship between office building energy use and office building size.
FIG. 12 also shows the selection of two data subsets 89, 90 within office buildings characterized by energy use and floor space variable ranges. These records are captured by a click and drag operation in which the left mouse button is depressed and while depressed the mouse is dragged to open a rectangular area which is fixed when the mouse button is released. The queries pictured in Figure 12 produce two new query nodes 70, 71 and statistics window entries 72, 73.
The analysis can be repositioned to any previous point by clicking the mouse on one of the Statistics Window color-coded boxes or one of the Query Window nodes of the query tree. For instance, clicking on the root node "0" 56 would reposition the user to the chart presented in Figure 11. From that point, the results of the previously-executed steps can be reviewed or revised. If the chart data subsets are revised, child charts and statistics entries below that point are automatically updated to correspond to new data subset definitions. The drag-and-drop query node operation may be used to copy the down-tree history of the prior query operations to other nodes in the query tree. If a drag-and-drop mouse operation were used to move a copy of query node "1 " 78 to query node 2 in FIG. 12, then query nodes 5 and 6 (not shown) would automatically appear below query node "2" 86 in the Query Tree Window 52. Clicking on node "2" would now show a scatter plot of retail buildings with the same data segments defined by the chart in Figure 12 while statistics for these data subsets would also appear in the Statistics Window 54. While various mouse or other pointer operations could be defined to perform various steps according to the invention, this dragging of the query node is preferably used to duplicate the down stream queries on the data subset represented by the dragged query node. This exercise is to be distinguished from the exercise described above wherein two query nodes are consecutively dragged to the same open area in the Query Tree Window 52 to form a new data subset.
Figure 13 shows an application of the Chart History Window 66 using four subwindows. User mouse drag-and-drop operations have been performed with query tree nodes numbers "0" and "1 " 56, 78 in the Query Tree Window 68 overlay to populate two of the subwindows. An unlimited number of windows with user-selected sizes can be created to conduct flexible and comprehensive visual analysis of previously-developed charts. In another embodiment of the invention, queries could be performed from the chart history window.
The browsing and querying process described with Figures 9 - 13 broadly illustrates the progression of activities undertaken in visual data evaluation. The feamres of this invention accomplish these activities with mouse cursor operations operating within a single chart paradigm and operating only on the data area of the chart window. User conceptual orientation is maintained by operating within a single chart area and with immediate query results and concurrent, dynamic documentation of the query evolution visible in the Statistics and Query Tree Windows. The previously described versions of the present invention have many advantages, including the provision of a simple method for visually evaluating complex databases with feamres which compensate for human cognitive limitations. The method allows the user to access and manipulate a database in real time, viewing, evaluating and navigating, by means of a simple query process, through data presented on the display. The method frees the user from having to learn formal query language or other procedures which are translated into query language; consequently it also frees the user from limitations imposed by the expressive capacity of existing query languages.
Instead of requiring the user to repetitively complete separate data query, data manipulation, chart definition and chart presentation steps, the method provides on-the-fly viewing, evaluation and querying with simple operations on a single dynamic representation of the database.
Moreover, the system works with all databases regardless of the database management approach. For instance, the present invention automatically "joins" tables in a relational database when two or more variables from different data tables are chosen for the axes of a single chart.
The present invention also includes the simultaneous generation of hierarchical tree summaries of the browse and query operations and a statistical summary which reports information for each step in the user-guided browsing and querying process. While the present invention has been described in considerable detail in connection with particular embodiments thereof, other versions are possible. It will be understood, of course, that I do not intend to limit the invention to those embodiments since modifications may be made by those skilled in the art, particularly in light of the foregoing teachings. For example, this invention can be applied to databases consisting entirely of non-numerical variables or data items, or it can be applied to representations of data presented on a geographic map format. I intend to cover all alternatives, modifications and equivalents as may be included within the spirit and scope of the invention as defined by the appended claims. It is, therefore, contemplated by the appended claims to cover any such modifications as incoφorate those feamres which constimte the essential feamres of these improvements within the true spirit and the scope of the invention. Therefore, the spirit and scope of the appended claims should not be limited to the description of the embodiments contained herein.

Claims

I claim:
1. A method in a data processing system for accessing information in a data set, the data set information accessing method comprising the steps of:
creating a visual chart representation of the data set and displaying the data set in the chart;
selecting a second data set which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set; and
displaying the results of the data subset selecting step.
2. A data set information accessing method as recited in claim 1, wherein the step of creating a visual chart representation of the data set comprises selecting a chart attribute.
3. A data set information accessing method as recited in claim 2, wherein the step of selecting a chart attribute comprises selecting a data set variable.
4. A data set information accessing method as recited in claim 3, wherein the step of selecting a data set variable further comprises the steps of selecting data set variables from different sources of data and automatically joining the sources of data.
5. A data set information accessing method as recited in claim 1 , wherein the step of selecting the data subset comprises defining the data subset in response to movements of a means for controlling a cursor.
6. A data set information accessing method as recited in claim 5, wherein the step of creating a visual chart representation of the data set comprises selecting a data set variable, further comprising the step of displaying the variable value indicated by the position of the cursor control means within the chart of the data set.
7. A data set information accessing method as recited in claim 1, wherein the step of displaying the results of the data subset selecting step comprises visually distinguishing the displayed data subset.
8. A data set information accessing method as recited in claim 7, wherein the step of visually distinguishing the displayed data subset comprises visually distinguishing the data subset by color.
9. A data set information accessing method as recited in claim 1, further comprising the steps of:
selecting the data subset through interaction between the user and the system within the displayed data subset; and
displaying a chart of the data subset.
10. A data set information accessing method as recited in claim 9, further comprising the steps of changing a chart attribute and displaying a chart of the data subset.
11. A data set information accessing method as recited in claim 10, wherein the step of changing the chart attribute comprises selecting a data set variable.
12. A data set information accessing method as recited in claim 9, further comprising the steps of:
selecting a second data subset which is a subset of the displayed data subset through interaction between the user and the system within the chart of the displayed data subset; and displaying the results of the second data subset selecting step.
13. A data set information accessing method as recited in claim 10, further comprising the steps of:
selecting additional data subsets which are subsets of previously selected and displayed data subsets through interaction between the user and the system within the charts of the previously selected and displayed data subsets; and
displaying the results of the additional data subsets selecting step.
14. A data set information accessing method as recited in claim 1, further comprising:
displaying a menu bar having a command option, the command option generically representing an operator;
selecting the command option; and
performing and displaying the result of the operation on the displayed data set.
15. A data set information accessing method as recited in claim 1, further comprising the step of maintaining a record of the selected data subset.
16. A data set information accessing method as recited in claim 15, further comprising the step of associating a distinct visual symbol with the data subset record.
17. A data set information accessing method as recited in claim 16, further comprising the step of visually distinguishing the distinct visual symbol in a manner similar to the visual distinction of the associated data subset.
18. A data set information accessing method as recited in claim 16, further comprising the step of using the distinct visual symbol as a software button for selecting and displaying the associated data subset.
19. A data set information accessing method as recited in claim 18, further comprising:
displaying a menu bar having a command option, the command option generically representing an operator;
selecting the command option;
using the distinct visual symbol as a software button for selecting the associated data subset as an operand in the operation; and
performing the operation on the data subset.
20. A data set information accessing method as recited in claim 15, wherein the step of maintaining a record of the user selected data subset comprises the steps of:
creating a record of the data subset;
creating and displaying a distinct visual symbol for each of the data set and the data subset; and
arranging the displayed visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selecting step.
21. A data set information accessing method as recited in claim 20, the method further comprising the steps of: creating and displaying a plurality of windows;
using the distinct visual symbol for selecting for display the associated data subset; and
displaying the data subset in one of the plurality of windows.
22. A data set information accessing method as recited in claim 15, wherein the step of maintaining a record of the user selected data subset comprises the steps of:
creating a texmal record and values of chart attributes which define the data set and data subset;
displaying the texmal record for each of the data set and the data subset; and
arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selecting step.
23. A data set information accessing method as recited in claim 22, further comprising the step of displaying a texmal record of the data set and the values of chart attributes of the data subset with the user operations within the chart of the data set.
24. A method in a data processing system for maintaining a record of a user selected data subset selected from a data set, the data subset record maintaining method comprising the steps of:
creating a record of the data set and the data subset;
creating and displaying a distinct visual symbol for each of the data set and the data subset; and arranging the displayed visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selecting step.
25. A data set record maintaining method as recited in claim 24, further comprising:
using the distinct visual symbol to select for display the associated data subset; and
displaying the data subset.
26. A data set record maintaining method as recited in claim 24, further comprising:
maintaining a visual chart representation of the data set and displaying the data set in the chart;
receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set;
creating records of the additional data subsets;
creating and displaying distinct visual symbols for each of the additional data subsets; and
arranging the distinct visual symbols in a network of interconnected visual symbols to indicate the strucmral hierarchical relationship among the data set and the data subsets as defined by the data subsets selections.
27. A data set record maintaining method as recited in claim 26, further comprising: using the distinct visual symbol to select the associated data subset for display;
displaying the data subset; and
receiving and processing additional data subset selections through interaction between the user and the system within the chart of the displayed data subset.
28. A method in a data processing system for maintaining a record of a user selected data subset selected from a data set, the data subset record maintaimng method comprising the steps of:
creating a texmal record of and values of chart attributes which define the data set and data subset;
displaying the texmal record for each of the data set and the data subset; and
arranging the texmal records to represent the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selecting step.
29. A data set record maintaining method as recited in claim 28, further comprising the step of creating a distinct visual symbol for the texmal record of the data subset.
30. A data set record maintaining method as recited in claim 29, further comprising the steps of:
using the distinct visual symbol to select the associated data subset for display; and
displaying the data subset.
31. A data set record maintaining method as recited in claim 28, further comprising the steps of:
maintaining a visual chart representation of the data set and displaying the data set in the chart;
receiving and processing additional data subset selections through interaction between the user and the system within the chart of the data set;
creating texmal records of the additional data subsets and values of chart attributes which define the data subsets;
creating and displaying distinct visual symbols for each of the additional data subsets, wherein the visual symbols for data subsets in the same level of the data subsets selecting hierarchy share a common feamre; and arranging the texmal records and displayed visual symbols to represent a strucmral hierarchical relationship among the data set and the data subsets as defined by the data subset selections.
32. A data set record maintaining method as recited in claim 31, further comprising:
using the distinct visual symbol to select the associated data subset for display;
displaying the data subset; and
receiving and processing additional data subset selections through interaction between the user and the system within the chart of the displayed data subset.
33. A data processing system for accessing information in a data set, the data set information accessing system comprising: means for creating a visual chart representation of the data set;
means for selecting a data set which is a subset of the displayed data set through interaction between the user and the system within the chart of the data set; and
means for displaying the results of the data subset selection.
34. A data set information accessing system as recited in claim 33, wherein the means for creating a visual chart representation of the data set comprises means for selecting a chart attribute.
35. A database information accessing system as recited in claim 34, wherein the chart attribute selecting means comprises means for selecting a data set variable.
36. A database information accessing system as recited in claim 33, wherein the means for selecting the data subset comprises means for generating a data subset in response to movements of a means for controlling a cursor.
37. A data set information accessing system as recited in claim 35, further comprising:
means for selecting the data subset through interaction between the user and the system within the displayed data subset; and
means for displaying a chart of the data subset.
38. A data set information accessing system as recited in claim 33, further comprising means for creating and maintaining a record of the selected data subset.
39. A data set information accessing system as recited in claim 38, wherein the means for maintaining a record of the user selected data subset comprises: means for creating and displaying a distinct visual symbol for each of the data set and the data subset; and
means for arranging the displayed visual symbols in a network of interconnected visual symbols representing the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selecting step.
40. A data set information accessing system as recited in claim 38, wherein the means for maintaining a record of the user selected data subset, comprises:
means for creating a texmal record and values of chart attributes which defme the data set and data subset;
means for displaying the texmal record for each of the data set and the subset; and
means for arranging the displayed texmal records to represent the strucmral hierarchical relationship among the data set and the data subset as defined by the data subset selection.
PCT/US1996/012729 1995-08-08 1996-08-07 Computer-based visual data evaluation WO1997006492A1 (en)

Priority Applications (1)

Application Number Priority Date Filing Date Title
AU66903/96A AU6690396A (en) 1995-08-08 1996-08-07 Computer-based visual data evaluation

Applications Claiming Priority (2)

Application Number Priority Date Filing Date Title
US203095P 1995-08-08 1995-08-08
US60/002,030 1995-08-08

Publications (1)

Publication Number Publication Date
WO1997006492A1 true WO1997006492A1 (en) 1997-02-20

Family

ID=21698934

Family Applications (1)

Application Number Title Priority Date Filing Date
PCT/US1996/012729 WO1997006492A1 (en) 1995-08-08 1996-08-07 Computer-based visual data evaluation

Country Status (3)

Country Link
US (1) US5894311A (en)
AU (1) AU6690396A (en)
WO (1) WO1997006492A1 (en)

Cited By (9)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
GB2352851A (en) * 1999-04-30 2001-02-07 Fujitsu Ltd Search system with search condition combinations
WO2016040352A1 (en) * 2014-09-08 2016-03-17 Tableau Software, Inc. Systems and methods for providing drag and drop analytics in a dynamic data visualization interface
US9811859B2 (en) 2000-03-02 2017-11-07 Trading Technologies International, Inc. Trading tools for electronic trading
US9830654B2 (en) 2003-06-30 2017-11-28 Trading Technologies International, Inc. Repositioning of market information on trading screens
US10121198B2 (en) 1999-04-09 2018-11-06 Trading Technologies International, Inc. User interface for an electronic trading system
US10147138B2 (en) 1999-04-09 2018-12-04 Trading Technologies International, Inc. User interface for semi-fungible trading
US10210572B2 (en) 2000-03-02 2019-02-19 Trading Technologies International, Inc. Click based trading with intuitive grid display of market depth
US10354324B2 (en) 2000-03-02 2019-07-16 Trading Technologies International, Inc. Click based trading with market depth display
US10521077B1 (en) 2016-01-14 2019-12-31 Tableau Software, Inc. Visual analysis of a dataset using linked interactive data visualizations

Families Citing this family (160)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US6604090B1 (en) * 1997-06-04 2003-08-05 Nativeminds, Inc. System and method for selecting responses to user input in an automated interface program
US6314410B1 (en) 1997-06-04 2001-11-06 Nativeminds, Inc. System and method for identifying the context of a statement made to a virtual robot
US6397195B1 (en) * 1997-06-27 2002-05-28 Hyperion Solutions Corporation System for managing accounting information in a multi-dimensional database
US6091395A (en) 1997-12-15 2000-07-18 International Business Machines Corporation Computer system and method of manipulating a graphical user interface component on a computer display through collision with a pointer
US6874123B1 (en) * 1998-02-09 2005-03-29 International Business Machines Corporation Three-dimensional model to facilitate user comprehension and management of information
US6275227B1 (en) 1998-02-09 2001-08-14 International Business Machines Corporation Computer system and method for controlling the same utilizing a user interface control integrated with multiple sets of instructional material therefor
US6304259B1 (en) * 1998-02-09 2001-10-16 International Business Machines Corporation Computer system, method and user interface components for abstracting and accessing a body of knowledge
US6308187B1 (en) 1998-02-09 2001-10-23 International Business Machines Corporation Computer system and method for abstracting and accessing a chronologically-arranged collection of information
US6307552B1 (en) 1998-03-16 2001-10-23 International Business Machines Corporation Computer system and method for controlling the same utilizing an abstraction stack with a sequence of predetermined display formats
US6335733B1 (en) * 1998-05-21 2002-01-01 International Business Machines Corporation Method and system for displaying and editing a resource schedule
US6169985B1 (en) * 1998-05-29 2001-01-02 Epiphany, Inc. Method and apparatus for determining a set of database entries
US6629087B1 (en) 1999-03-18 2003-09-30 Nativeminds, Inc. Methods for creating and editing topics for virtual robots conversing in natural language
US9811237B2 (en) * 1999-04-06 2017-11-07 Iii Holdings 2, Llc Visual navigation of virtual environments through logical processes
US6920608B1 (en) * 1999-05-21 2005-07-19 E Numerate Solutions, Inc. Chart view for reusable data markup language
US9262383B2 (en) 1999-05-21 2016-02-16 E-Numerate Solutions, Inc. System, method, and computer program product for processing a markup document
US7421648B1 (en) 1999-05-21 2008-09-02 E-Numerate Solutions, Inc. Reusable data markup language
US7249328B1 (en) * 1999-05-21 2007-07-24 E-Numerate Solutions, Inc. Tree view for reusable data markup language
US9268748B2 (en) 1999-05-21 2016-02-23 E-Numerate Solutions, Inc. System, method, and computer program product for outputting markup language documents
US9262384B2 (en) 1999-05-21 2016-02-16 E-Numerate Solutions, Inc. Markup language system, method, and computer program product
US6529217B1 (en) * 1999-06-15 2003-03-04 Microsoft Corporation System and method for graphically displaying a set of data fields
US8843850B2 (en) * 1999-07-22 2014-09-23 Tavusi Data Solutions Llc Graphic-information flow for visually analyzing patterns and relationships
US6307573B1 (en) * 1999-07-22 2001-10-23 Barbara L. Barros Graphic-information flow method and system for visually analyzing patterns and relationships
US8397177B2 (en) * 1999-07-22 2013-03-12 Tavusi Data Solutions Llc Graphic-information flow method and system for visually analyzing patterns and relationships
US6356896B1 (en) * 1999-08-16 2002-03-12 International Business Machines Corporation Data visualization of queries over joins
US7162477B1 (en) 1999-09-03 2007-01-09 International Business Machines Corporation System and method for web or file system asset management
WO2001061568A2 (en) * 2000-02-17 2001-08-23 E-Numerate Solutions, Inc. Rdl search engine
US10002167B2 (en) 2000-02-25 2018-06-19 Vilox Technologies, Llc Search-on-the-fly/sort-on-the-fly by a search engine directed to a plurality of disparate data sources
JP3613554B2 (en) * 2000-08-24 2005-01-26 インターナショナル・ビジネス・マシーンズ・コーポレーション Data display method, computer system for performing data display, and recording medium
AU2002220172A1 (en) * 2000-11-15 2002-05-27 David M. Holbrook Apparatus and method for organizing and/or presenting data
US20070226640A1 (en) * 2000-11-15 2007-09-27 Holbrook David M Apparatus and methods for organizing and/or presenting data
US6772019B2 (en) 2000-11-16 2004-08-03 Lockheed Martin Corporation Method and system for multi-parameter choice optimization
DE10062351A1 (en) * 2000-12-14 2002-06-27 Siemens Ag Management of information using the World Wide Web or other network, especially for business relevant information and management information, with more intuitive and faster navigation to locate required information
US9600842B2 (en) * 2001-01-24 2017-03-21 E-Numerate Solutions, Inc. RDX enhancement of system and method for implementing reusable data markup language (RDL)
US7146374B1 (en) * 2001-02-21 2006-12-05 Oracle Corporation Automated multi-line labeling of a time axis
US6906717B2 (en) * 2001-02-27 2005-06-14 Microsoft Corporation Multiple chart user interface
US20020129342A1 (en) * 2001-03-07 2002-09-12 David Kil Data mining apparatus and method with user interface based ground-truth tool and user algorithms
US7080328B1 (en) * 2001-03-28 2006-07-18 Ebay, Inc. Graphical user interface for filtering a population of items
WO2002086671A2 (en) * 2001-04-20 2002-10-31 American Express Travel Related Services Company, Inc. System and method for travel carrier contract management and optimization
US6792145B2 (en) * 2001-04-20 2004-09-14 Robert W. Gay Pattern recognition process for text document interpretation
US7002579B2 (en) * 2001-05-09 2006-02-21 Cadec Corporation Split screen GPS and electronic tachograph
US7000181B2 (en) * 2001-06-21 2006-02-14 International Business Machines Corporation Dynamic data display having slide drawer windowing
CA2355959A1 (en) * 2001-06-27 2002-12-27 Mapfusion Corp. Spatial business intelligence system
WO2003005161A2 (en) * 2001-07-02 2003-01-16 American Express Travel Related Services Company, Inc. System and method for airline purchasing program management
US20040260581A1 (en) * 2001-08-23 2004-12-23 American Express Travel Related Services Company, Inc. Travel market broker system
US7539620B2 (en) * 2002-07-02 2009-05-26 American Express Travel Related Services Company, Inc. System and method for facilitating transactions among consumers and providers of travel services
US20050288974A1 (en) * 2001-08-23 2005-12-29 American Express Travel Related Services Company, Inc. Travel service broker system and method
US7499864B2 (en) * 2002-01-25 2009-03-03 American Express Travel Related Services Company, Inc. Integrated travel industry system
EP1298539A1 (en) * 2001-10-01 2003-04-02 Sun Microsystems, Inc. Method and device for marking and filtering data elements in a database
EP1300776A1 (en) * 2001-10-04 2003-04-09 exorbyte GmbH Context sensitive method to retrieve data from a database
US6745140B2 (en) * 2001-10-23 2004-06-01 Agilent Technologies, Inc. Electronic test system with test results view filter
US20040205523A1 (en) * 2001-12-03 2004-10-14 Methode Electronics, Inc. Control chart with single display
US7640335B1 (en) * 2002-01-11 2009-12-29 Mcafee, Inc. User-configurable network analysis digest system and method
US7805323B2 (en) 2002-01-25 2010-09-28 American Express Travel Related Services Company, Inc. System and method for processing trip requests
JP2003271665A (en) * 2002-03-15 2003-09-26 Fuji Photo Film Co Ltd Graphical user interface for retrieval
US20030214070A1 (en) * 2002-05-08 2003-11-20 General Electric Company Multiwall polycarbonate sheet and method for its production
US20030225734A1 (en) * 2002-06-04 2003-12-04 Evan Witt Interactive diagram in markup language page
US7222115B2 (en) * 2002-08-16 2007-05-22 The Johns Hopkins University Definition and maintenance of a telemetry database dictionary
US20040086782A1 (en) * 2002-11-01 2004-05-06 Celgard Inc. Explosion-proof separator for Li-ion secondary batteries
JP4091407B2 (en) * 2002-11-28 2008-05-28 富士通株式会社 Touch panel keyboard, POS system, touch panel keyboard display method, touch panel keyboard display program, and recording medium
US6961733B2 (en) * 2003-03-10 2005-11-01 Unisys Corporation System and method for storing and accessing data in an interlocking trees datastore
US8275742B2 (en) * 2003-05-19 2012-09-25 Sap Aktiengesellschaft Data importation and exportation for computing devices
US8589311B2 (en) * 2003-06-13 2013-11-19 Sap Aktiengesellschaft Designing business content for reporting
US20040252121A1 (en) * 2003-06-13 2004-12-16 Ankur Bhatt Integrating graphical charts into software applications
US7949953B2 (en) * 2003-06-13 2011-05-24 Sap Aktiengesellschaft Designing and generating charts to graphically represent data in a data source
US8516004B2 (en) * 2003-09-19 2013-08-20 Unisys Corporation Method for processing K node count fields using an intensity variable
JP4129819B2 (en) * 2003-10-06 2008-08-06 インターナショナル・ビジネス・マシーンズ・コーポレーション Database search system, search method thereof, and program
US7265754B2 (en) * 2003-11-12 2007-09-04 Proto Manufacturing Ltd. Method for displaying material characteristic information
US8151214B2 (en) * 2003-12-29 2012-04-03 International Business Machines Corporation System and method for color coding list items
US7421664B2 (en) * 2003-12-29 2008-09-02 International Business Machines Corporation System and method for providing a category separator in a list of documents
US7908566B2 (en) * 2003-12-29 2011-03-15 International Business Machines Corporation System and method for scrolling among categories in a list of documents
US8171426B2 (en) 2003-12-29 2012-05-01 International Business Machines Corporation Method for secondary selection highlighting
US7340471B2 (en) 2004-01-16 2008-03-04 Unisys Corporation Saving and restoring an interlocking trees datastore
US7308457B1 (en) 2004-01-23 2007-12-11 Niku Method and apparatus for providing customized filters to restrict datasets retrieved from a database
US7523090B1 (en) * 2004-01-23 2009-04-21 Niku Creating data charts using enhanced SQL statements
US20050235207A1 (en) * 2004-04-16 2005-10-20 Christoph Albrecht Aiding value input
US7593923B1 (en) 2004-06-29 2009-09-22 Unisys Corporation Functional operations for accessing and/or building interlocking trees datastores to enable their use with applications software
US7213041B2 (en) * 2004-10-05 2007-05-01 Unisys Corporation Saving and restoring an interlocking trees datastore
US7716241B1 (en) 2004-10-27 2010-05-11 Unisys Corporation Storing the repository origin of data inputs within a knowledge store
US7908240B1 (en) 2004-10-28 2011-03-15 Unisys Corporation Facilitated use of column and field data for field record universe in a knowledge store
US20060101048A1 (en) * 2004-11-08 2006-05-11 Mazzagatti Jane C KStore data analyzer
US7418445B1 (en) 2004-11-08 2008-08-26 Unisys Corporation Method for reducing the scope of the K node construction lock
US7348980B2 (en) * 2004-11-08 2008-03-25 Unisys Corporation Method and apparatus for interface for graphic display of data from a Kstore
US7499932B2 (en) * 2004-11-08 2009-03-03 Unisys Corporation Accessing data in an interlocking trees data structure using an application programming interface
US20060100845A1 (en) * 2004-11-08 2006-05-11 Mazzagatti Jane C Multiple stream real time data simulation adapted for a KStore data structure
WO2006057356A1 (en) * 2004-11-25 2006-06-01 Kabushiki Kaisha Square Enix (Also Trading As Square Enix Co., Ltd.) Method for searching content serving as a user selection candidate
US20060189330A1 (en) * 2005-01-28 2006-08-24 Nelson Ellen M Method for presentation of multiple graphical displays in operations support systems
US7409380B1 (en) 2005-04-07 2008-08-05 Unisys Corporation Facilitated reuse of K locations in a knowledge store
US7389301B1 (en) 2005-06-10 2008-06-17 Unisys Corporation Data aggregation user interface and analytic adapted for a KStore
US20070030287A1 (en) * 2005-08-04 2007-02-08 Honeywell International Inc. Visual comparison of data set with data subset
US8099674B2 (en) * 2005-09-09 2012-01-17 Tableau Software Llc Computer systems and methods for automatically viewing multidimensional databases
US7640264B1 (en) * 2005-09-23 2009-12-29 Emc Corporation System and methods for querying a report database
US7961188B2 (en) * 2005-12-05 2011-06-14 Microsoft Corporation Persistent formatting for interactive charts
JP4825530B2 (en) * 2006-02-06 2011-11-30 株式会社日立ハイテクノロジーズ Pattern defect inspection method and apparatus
JP4791840B2 (en) * 2006-02-06 2011-10-12 株式会社日立ハイテクノロジーズ Charged particle beam apparatus, scanning electron microscope, and sample inspection method
US20070214153A1 (en) * 2006-03-10 2007-09-13 Mazzagatti Jane C Method for processing an input particle stream for creating upper levels of KStore
US7461289B2 (en) * 2006-03-16 2008-12-02 Honeywell International Inc. System and method for computer service security
WO2007109444A2 (en) * 2006-03-17 2007-09-27 Schmitt William C Common format learning device
US20070220069A1 (en) * 2006-03-20 2007-09-20 Mazzagatti Jane C Method for processing an input particle stream for creating lower levels of a KStore
US7734571B2 (en) * 2006-03-20 2010-06-08 Unisys Corporation Method for processing sensor data within a particle stream by a KStore
US20080275842A1 (en) * 2006-03-20 2008-11-06 Jane Campbell Mazzagatti Method for processing counts when an end node is encountered
US7689571B1 (en) 2006-03-24 2010-03-30 Unisys Corporation Optimizing the size of an interlocking tree datastore structure for KStore
US8238351B2 (en) * 2006-04-04 2012-08-07 Unisys Corporation Method for determining a most probable K location
US20070233678A1 (en) * 2006-04-04 2007-10-04 Bigelow David H System and method for a visual catalog
US20070260582A1 (en) * 2006-05-05 2007-11-08 Inetsoft Technology Method and System for Visual Query Construction and Representation
US7676330B1 (en) 2006-05-16 2010-03-09 Unisys Corporation Method for processing a particle using a sensor structure
US8645853B2 (en) * 2006-11-03 2014-02-04 Business Objects Software Ltd. Displaying visualizations linked to one or more data source queries
US20080244416A1 (en) * 2007-03-28 2008-10-02 Business Objects, S.A. Apparatus and method for creating and consuming custom visualization templates
JP4356027B2 (en) * 2007-03-30 2009-11-04 ソニー株式会社 Information processing apparatus and method, and program
EP2149081B1 (en) 2007-04-17 2019-06-12 Luminex Corporation Graphical user interface for analysis and comparison of location-specific multiparameter data sets
US20080278494A1 (en) * 2007-05-11 2008-11-13 On Time Systems Inc. System and method for information display
US9035948B2 (en) * 2007-08-02 2015-05-19 Adobe Systems Incorporated Methods and systems for drawing graphics into a data chart
US8984433B2 (en) * 2007-10-10 2015-03-17 Microsoft Technology Licensing, Llc. Graphical representation of tabular data
US8365065B2 (en) * 2007-12-07 2013-01-29 Roche Diagnostics Operations, Inc. Method and system for creating user-defined outputs
US9563657B2 (en) * 2008-01-08 2017-02-07 International Business Machines Corporation Generating data queries using a graphical selection tree
US8818987B2 (en) * 2008-01-11 2014-08-26 International Business Machines Corporation Converting union commands to union all commands
US9135331B2 (en) 2008-04-07 2015-09-15 Philip J. Rosenthal Interface including graphic representation of relationships between search results
US8195641B2 (en) * 2008-04-21 2012-06-05 Microsoft Corporation Query authoring by modifying a view of the results of the query
ES2763537T3 (en) * 2008-09-16 2020-05-29 Beckman Coulter Inc Interactive tree diagram for flow cytometric data
WO2010048238A1 (en) * 2008-10-20 2010-04-29 Jayasenan Sundara Ganesh Apparatus and method for data search and organization
GB2466341A (en) * 2008-12-17 2010-06-23 Ibm Method of graphically creating binary expressions
US8473506B2 (en) * 2009-05-20 2013-06-25 Oracle International Corporation Type system for building extensible business applications
JP5635247B2 (en) * 2009-08-20 2014-12-03 富士通株式会社 Multi-chip module
US8799327B2 (en) * 2010-04-01 2014-08-05 Salesforce.Com, Inc. System, method and computer program product for deriving commonalities among data entries
US10394778B2 (en) 2010-09-03 2019-08-27 Robert Lewis Jackson, JR. Minimal representation of connecting walks
US9395966B1 (en) * 2010-09-27 2016-07-19 Symantec Corporation Systems and methods for associating installed software components with software products
KR20120051343A (en) * 2010-11-12 2012-05-22 한국전자통신연구원 System and method for playing music using music visualization method
US9058323B2 (en) 2010-12-30 2015-06-16 Ss8 Networks, Inc. System for accessing a set of communication and transaction data associated with a user of interest sourced from multiple different network carriers and for enabling multiple analysts to independently and confidentially access the set of communication and transaction data
US8938534B2 (en) 2010-12-30 2015-01-20 Ss8 Networks, Inc. Automatic provisioning of new users of interest for capture on a communication network
US8972612B2 (en) 2011-04-05 2015-03-03 SSB Networks, Inc. Collecting asymmetric data and proxy data on a communication network
US9069748B2 (en) 2011-10-04 2015-06-30 Microsoft Technology Licensing, Llc Selective generation and display of data items associated with a spreadsheet
US8990675B2 (en) 2011-10-04 2015-03-24 Microsoft Technology Licensing, Llc Automatic relationship detection for spreadsheet data items
US9135233B2 (en) 2011-10-13 2015-09-15 Microsoft Technology Licensing, Llc Suggesting alternate data mappings for charts
US10061473B2 (en) 2011-11-10 2018-08-28 Microsoft Technology Licensing, Llc Providing contextual on-object control launchers and controls
US8793567B2 (en) 2011-11-16 2014-07-29 Microsoft Corporation Automated suggested summarizations of data
US20130207980A1 (en) * 2012-02-13 2013-08-15 Anil Babu Ankisettipalli Visualization of data clusters
US20130297588A1 (en) * 2012-05-07 2013-11-07 Sap Ag Flexible Dashboard Enhancing Visualization of Database Information
US9015591B2 (en) 2012-06-13 2015-04-21 Microsoft Technology Licensing, Llc Dynamic visualization generation and implementation
US9870554B1 (en) 2012-10-23 2018-01-16 Google Inc. Managing documents based on a user's calendar
US10140198B1 (en) 2012-10-30 2018-11-27 Google Llc Networked desktop environment
US8819587B1 (en) 2012-10-30 2014-08-26 Google Inc. Methods of managing items in a shared workspace
US9213478B2 (en) * 2012-12-21 2015-12-15 Business Objects Software Visualization interaction design for cross-platform utilization
KR102029055B1 (en) * 2013-02-08 2019-10-07 삼성전자주식회사 Method and apparatus for high-dimensional data visualization
US9754392B2 (en) 2013-03-04 2017-09-05 Microsoft Technology Licensing, Llc Generating data-mapped visualization of data
US9070227B2 (en) * 2013-03-04 2015-06-30 Microsoft Technology Licensing, Llc Particle based visualizations of abstract information
US9710789B2 (en) * 2013-06-04 2017-07-18 SuccessFactors Multi-dimension analyzer for organizational personnel
US9842113B1 (en) 2013-08-27 2017-12-12 Google Inc. Context-based file selection
US9973462B1 (en) 2013-10-21 2018-05-15 Google Llc Methods for generating message notifications
US9449365B2 (en) 2014-04-11 2016-09-20 Fitbit, Inc. Personalized scaling of graphical indicators
US9449409B2 (en) * 2014-04-11 2016-09-20 Fitbit, Inc. Graphical indicators in analog clock format
US9830593B2 (en) 2014-04-26 2017-11-28 Ss8 Networks, Inc. Cryptographic currency user directory data and enhanced peer-verification ledger synthesis through multi-modal cryptographic key-address mapping
US20160042180A1 (en) * 2014-08-07 2016-02-11 Ut Battelle, Llc Behavior specification, finding main, and call graph visualizations
US9996955B2 (en) 2014-09-23 2018-06-12 Salesforce.Com, Inc Analytics visualization
US11231840B1 (en) * 2014-10-05 2022-01-25 Splunk Inc. Statistics chart row mode drill down
US10261673B2 (en) 2014-10-05 2019-04-16 Splunk Inc. Statistics value chart interface cell mode drill down
WO2016186790A1 (en) 2015-05-15 2016-11-24 Parker-Hannifin Corporation Integrated asset integrity management system
US10802057B2 (en) 2015-12-11 2020-10-13 Schneider Electric USA, Inc. Systems and methods for monitoring a power system
US10540790B2 (en) 2015-12-11 2020-01-21 Schneider Electric USA, Inc. Visual classification of events
US10748312B2 (en) * 2016-02-12 2020-08-18 Microsoft Technology Licensing, Llc Tagging utilizations for selectively preserving chart elements during visualization optimizations
US10311608B2 (en) 2016-12-08 2019-06-04 Microsoft Technology Licensing, Llc Custom multi axis chart visualization
US10552436B2 (en) * 2016-12-28 2020-02-04 Palantir Technologies Inc. Systems and methods for retrieving and processing data for display

Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4674043A (en) * 1985-04-02 1987-06-16 International Business Machines Corp. Updating business chart data by editing the chart
US5414838A (en) * 1991-06-11 1995-05-09 Logical Information Machine System for extracting historical market information with condition and attributed windows
US5418950A (en) * 1992-05-04 1995-05-23 International Business Machines Corporation System for interactive clause window construction of SQL queries

Family Cites Families (23)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4506326A (en) * 1983-02-28 1985-03-19 International Business Machines Corporation Apparatus and method for synthesizing a query for accessing a relational data base
US5404506A (en) * 1985-03-27 1995-04-04 Hitachi, Ltd. Knowledge based information retrieval system
US4845653A (en) * 1987-05-07 1989-07-04 Becton, Dickinson And Company Method of displaying multi-parameter data sets to aid in the analysis of data characteristics
JP2760794B2 (en) * 1988-01-29 1998-06-04 株式会社日立製作所 Database processing method and apparatus
US5133052A (en) * 1988-08-04 1992-07-21 Xerox Corporation Interactive graphical search and replace utility for computer-resident synthetic graphic image editors
DE69031191T2 (en) * 1989-05-15 1998-02-12 Ibm System for controlling access privileges
US5039937A (en) * 1990-05-11 1991-08-13 Nicolet Instrument Corporation Method and apparatus for providing compressed and expanded displays on a digital oscilloscope
US5463731A (en) * 1990-06-27 1995-10-31 Telefonaktiebolaget L M Ericsson Monitor screen graphic value indicator system
US5555409A (en) * 1990-12-04 1996-09-10 Applied Technical Sysytem, Inc. Data management systems and methods including creation of composite views of data
JPH06506548A (en) * 1991-03-12 1994-07-21 ウォング・ラボラトリーズ・インコーポレーテッド Graphical query front end for database management systems
US5428737A (en) * 1991-10-16 1995-06-27 International Business Machines Corporation Comprehensive bilateral translation between SQL and graphically depicted queries
US5421008A (en) * 1991-11-08 1995-05-30 International Business Machines Corporation System for interactive graphical construction of a data base query and storing of the query object links as an object
US5297253A (en) * 1992-01-09 1994-03-22 Ehrlich Associates, Inc. Computer user interface navigational tool
US5404507A (en) * 1992-03-02 1995-04-04 At&T Corp. Apparatus and method for finding records in a database by formulating a query using equivalent terms which correspond to terms in the input query
US5416895A (en) * 1992-04-08 1995-05-16 Borland International, Inc. System and methods for improved spreadsheet interface with user-familiar objects
US5426781A (en) * 1992-04-30 1995-06-20 International Business Machines Corporation Computerized report-based interactive database query interface
US5428735A (en) * 1992-12-28 1995-06-27 International Business Machines Corporation Method and apparatus for maintaining a record of set-creating data processing activities and associated data sets
US5608899A (en) * 1993-06-04 1997-03-04 International Business Machines Corporation Method and apparatus for searching a database by interactively modifying a database query
US5461708A (en) * 1993-08-06 1995-10-24 Borland International, Inc. Systems and methods for automated graphing of spreadsheet information
US5652842A (en) * 1994-03-01 1997-07-29 Healthshare Technology, Inc. Analysis and reporting of performance of service providers
US5584024A (en) * 1994-03-24 1996-12-10 Software Ag Interactive database query system and method for prohibiting the selection of semantically incorrect query parameters
US5535324A (en) * 1994-09-22 1996-07-09 Microsoft Corporation Method and system for dragging and plotting new data onto an embedded graph
US5546516A (en) * 1994-12-14 1996-08-13 International Business Machines Corporation System and method for visually querying a data set exhibited in a parallel coordinate system

Patent Citations (3)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US4674043A (en) * 1985-04-02 1987-06-16 International Business Machines Corp. Updating business chart data by editing the chart
US5414838A (en) * 1991-06-11 1995-05-09 Logical Information Machine System for extracting historical market information with condition and attributed windows
US5418950A (en) * 1992-05-04 1995-05-23 International Business Machines Corporation System for interactive clause window construction of SQL queries

Cited By (27)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US10121198B2 (en) 1999-04-09 2018-11-06 Trading Technologies International, Inc. User interface for an electronic trading system
US10147138B2 (en) 1999-04-09 2018-12-04 Trading Technologies International, Inc. User interface for semi-fungible trading
GB2352851B (en) * 1999-04-30 2004-03-17 Fujitsu Ltd Search system and method based on search condition combinations
US6904427B1 (en) 1999-04-30 2005-06-07 Fujitsu Limited Search system and method based on search condition combinations
GB2352851A (en) * 1999-04-30 2001-02-07 Fujitsu Ltd Search system with search condition combinations
US10185994B2 (en) 2000-03-02 2019-01-22 Trading Technologies International, Inc. Trading tools for electronic trading
US10210572B2 (en) 2000-03-02 2019-02-19 Trading Technologies International, Inc. Click based trading with intuitive grid display of market depth
US10037567B2 (en) 2000-03-02 2018-07-31 Trading Technologies International, Inc. Trading tools for electronic trading
US9811859B2 (en) 2000-03-02 2017-11-07 Trading Technologies International, Inc. Trading tools for electronic trading
US10565652B2 (en) 2000-03-02 2020-02-18 Trading Technologies International, Inc. System and method for automatic repositioning of market information in a graphical user interface
US10002386B2 (en) 2000-03-02 2018-06-19 Trading Technologies International, Inc. System and method for automatic repositioning of market information in a graphical user interface
US10354324B2 (en) 2000-03-02 2019-07-16 Trading Technologies International, Inc. Click based trading with market depth display
US9830654B2 (en) 2003-06-30 2017-11-28 Trading Technologies International, Inc. Repositioning of market information on trading screens
US10489045B1 (en) 2014-09-08 2019-11-26 Tableau Software, Inc. Creating analytic objects in a data visualization user interface
US10895976B2 (en) 2014-09-08 2021-01-19 Tableau Software, Inc. Systems and methods for using analytic objects in a dynamic data visualization interface
WO2016040352A1 (en) * 2014-09-08 2016-03-17 Tableau Software, Inc. Systems and methods for providing drag and drop analytics in a dynamic data visualization interface
US10163234B1 (en) 2014-09-08 2018-12-25 Tableau Software, Inc. Systems and methods for providing adaptive analytics in a dynamic data visualization interface
US11853542B2 (en) 2014-09-08 2023-12-26 Tableau Software, Inc. Systems and methods for using analytic objects in a dynamic data visualization interface
US10156975B1 (en) 2014-09-08 2018-12-18 Tableau Software, Inc. Systems and methods for using analytic objects in a dynamic data visualization interface
US10579251B2 (en) 2014-09-08 2020-03-03 Tableau Software, Inc. Systems and methods for providing adaptive analytics in a dynamic data visualization interface
EP3726361A1 (en) * 2014-09-08 2020-10-21 Tableau Software, Inc. Systems and methods for providing drag and drop analytics in a dynamic data visualization interface
US11586346B2 (en) 2014-09-08 2023-02-21 Tableau Software, Inc. Systems and methods for using analytic objects in a dynamic data visualization interface
US10895975B1 (en) 2014-09-08 2021-01-19 Tableau Software, Inc. Systems and methods for using displayed data marks in a dynamic data visualization interface
US10332284B2 (en) 2014-09-08 2019-06-25 Tableau Software, Inc. Systems and methods for providing drag and drop analytics in a dynamic data visualization interface
US11237718B2 (en) 2014-09-08 2022-02-01 Tableau Software, Inc. Systems and methods for using displayed data marks in a dynamic data visualization interface
US10866702B2 (en) 2016-01-14 2020-12-15 Tableau Software, Inc. Visual analysis of a dataset using linked interactive data visualizations
US10521077B1 (en) 2016-01-14 2019-12-31 Tableau Software, Inc. Visual analysis of a dataset using linked interactive data visualizations

Also Published As

Publication number Publication date
US5894311A (en) 1999-04-13
AU6690396A (en) 1997-03-05

Similar Documents

Publication Publication Date Title
US5894311A (en) Computer-based visual data evaluation
US6707454B1 (en) Systems and methods for visualizing multi-dimensional data in spreadsheets and other data structures
US5539903A (en) Method and apparatus for producing a report from a query to a database based on a report format
Henry et al. Matrixexplorer: a dual-representation system to explore social networks
US5265246A (en) Graphic definition of range in the selection of data from a database field
US6396488B1 (en) System and method for determining a path in a graphical diagram
US5515488A (en) Method and apparatus for concurrent graphical visualization of a database search and its search history
Ahlberg Spotfire: an information exploration environment
US10386989B2 (en) Computer systems and methods for automatically viewing multidimensional databases
EP0616289B1 (en) System and method for interactively formulating queries
US6211887B1 (en) System and method for data visualization
US5768158A (en) Computer-based system and method for data processing
US5787412A (en) Object oriented data access and analysis system
Heer et al. Graphical histories for visualization: Supporting analysis, communication, and evaluation
US5499368A (en) Scaled depiction of information from a database
JP2732552B2 (en) How to generate and display search queries and search results
US8127245B2 (en) Multi-dimensional systems and controls
Eick Visualizing multi-dimensional data
EP0627691A1 (en) Method and system for searching a database utilizing a graphical user interface
US5572650A (en) Method and apparatus for displaying structures and relationships of a relational database
US6915298B1 (en) User-defined relationships for diagramming user-defined database relations
EP0490625B1 (en) Graphic definition of range in the selection of data from a database field
JP3807770B2 (en) System and method capable of quickly displaying data objects in a database table
Huo KMVQL: a visual query interface based on karnaugh map
JP2004164363A (en) Method for displaying relational database structure in tree diagram

Legal Events

Date Code Title Description
AK Designated states

Kind code of ref document: A1

Designated state(s): AL AM AT AU AZ BB BG BR BY CA CH CN CU CZ DE DK EE ES FI GB GE HU IL IS JP KE KG KP KR KZ LK LR LS LT LU LV MD MG MK MN MW MX NO NZ PL PT RO RU SD SE SG SI SK TJ TM TR TT UA UG UZ VN AM AZ BY KG KZ MD RU TJ TM

AL Designated countries for regional patents

Kind code of ref document: A1

Designated state(s): KE LS MW SD SZ UG AT BE CH DE DK ES FI FR GB GR IE IT LU MC NL PT SE BF BJ CF CG CI CM GA

DFPE Request for preliminary examination filed prior to expiration of 19th month from priority date (pct application filed before 20040101)
121 Ep: the epo has been informed by wipo that ep was designated in this application
REG Reference to national code

Ref country code: DE

Ref legal event code: 8642

122 Ep: pct application non-entry in european phase
NENP Non-entry into the national phase

Ref country code: CA