CA2377649A1 - Dynamic cluster database architecture - Google Patents

Dynamic cluster database architecture Download PDF

Info

Publication number
CA2377649A1
CA2377649A1 CA002377649A CA2377649A CA2377649A1 CA 2377649 A1 CA2377649 A1 CA 2377649A1 CA 002377649 A CA002377649 A CA 002377649A CA 2377649 A CA2377649 A CA 2377649A CA 2377649 A1 CA2377649 A1 CA 2377649A1
Authority
CA
Canada
Prior art keywords
cluster
manager
computers
architecture
data nodes
Prior art date
Legal status (The legal status is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the status listed.)
Granted
Application number
CA002377649A
Other languages
French (fr)
Other versions
CA2377649C (en
Inventor
Mark F. Wilding
Matthew A. Huras
Current Assignee (The listed assignees may be inaccurate. Google has not performed a legal analysis and makes no representation or warranty as to the accuracy of the list.)
IBM Canada Ltd
Original Assignee
IBM Canada Ltd
Priority date (The priority date is an assumption and is not a legal conclusion. Google has not performed a legal analysis and makes no representation as to the accuracy of the date listed.)
Filing date
Publication date
Application filed by IBM Canada Ltd filed Critical IBM Canada Ltd
Priority to CA002377649A priority Critical patent/CA2377649C/en
Priority to US10/390,812 priority patent/US7447693B2/en
Publication of CA2377649A1 publication Critical patent/CA2377649A1/en
Priority to US11/780,446 priority patent/US7937377B2/en
Priority to US12/184,796 priority patent/US7970797B2/en
Priority to US12/259,994 priority patent/US7933882B2/en
Application granted granted Critical
Publication of CA2377649C publication Critical patent/CA2377649C/en
Anticipated expiration legal-status Critical
Expired - Fee Related legal-status Critical Current

Links

Classifications

    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • G06F16/278—Data partitioning, e.g. horizontal or vertical partitioning
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/23—Updating
    • G06F16/2308—Concurrency control
    • G06F16/2336—Pessimistic concurrency control approaches, e.g. locking or multiple versions without time stamps
    • G06F16/2343—Locking methods, e.g. distributed locking or locking implementation details
    • G—PHYSICS
    • G06—COMPUTING; CALCULATING OR COUNTING
    • G06F—ELECTRIC DIGITAL DATA PROCESSING
    • G06F16/00—Information retrieval; Database structures therefor; File system structures therefor
    • G06F16/20—Information retrieval; Database structures therefor; File system structures therefor of structured data, e.g. relational data
    • G06F16/27—Replication, distribution or synchronisation of data between databases or within a distributed database system; Distributed database system architectures therefor
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99931—Database or file accessing
    • Y10S707/99938—Concurrency, e.g. lock management in shared database
    • Y—GENERAL TAGGING OF NEW TECHNOLOGICAL DEVELOPMENTS; GENERAL TAGGING OF CROSS-SECTIONAL TECHNOLOGIES SPANNING OVER SEVERAL SECTIONS OF THE IPC; TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10—TECHNICAL SUBJECTS COVERED BY FORMER USPC
    • Y10S—TECHNICAL SUBJECTS COVERED BY FORMER USPC CROSS-REFERENCE ART COLLECTIONS [XRACs] AND DIGESTS
    • Y10S707/00—Data processing: database and file management or data structures
    • Y10S707/99951—File or database maintenance
    • Y10S707/99952—Coherency, e.g. same view to multiple users
    • Y10S707/99953—Recoverability

Abstract

A distributed database management system implemented on a cluster of computers. The cluster including disks organized as data nodes. The data nodes being locall y connected to one or more computers in the cluster. The distributed database management system includes a distributed database manager layer having a lock manager, a resource manager , and an architecture manager. The lock manager serializes access to the data nodes i n the cluster. The resource manager maintains a data representation of the resources of each computer in the cluster and makes the data available to other computers in the cluster to facilitate access to the resources by the other computers. The architecture manager defines logical ownership relationships between data nodes and computers in the cluster to permit the architecture o f the database to be dynamically reconfigured to provide improved performance.
CA002377649A 2002-03-20 2002-03-20 Dynamic cluster database architecture Expired - Fee Related CA2377649C (en)

Priority Applications (5)

Application Number Priority Date Filing Date Title
CA002377649A CA2377649C (en) 2002-03-20 2002-03-20 Dynamic cluster database architecture
US10/390,812 US7447693B2 (en) 2002-03-20 2003-03-17 Dynamic cluster database architecture
US11/780,446 US7937377B2 (en) 2002-03-20 2007-07-19 Dynamic cluster database architecture
US12/184,796 US7970797B2 (en) 2002-03-20 2008-08-01 Dynamic cluster database architecture
US12/259,994 US7933882B2 (en) 2002-03-20 2008-10-28 Dynamic cluster database architecture

Applications Claiming Priority (1)

Application Number Priority Date Filing Date Title
CA002377649A CA2377649C (en) 2002-03-20 2002-03-20 Dynamic cluster database architecture

Publications (2)

Publication Number Publication Date
CA2377649A1 true CA2377649A1 (en) 2003-09-20
CA2377649C CA2377649C (en) 2009-02-03

Family

ID=27810593

Family Applications (1)

Application Number Title Priority Date Filing Date
CA002377649A Expired - Fee Related CA2377649C (en) 2002-03-20 2002-03-20 Dynamic cluster database architecture

Country Status (2)

Country Link
US (4) US7447693B2 (en)
CA (1) CA2377649C (en)

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019220170A1 (en) * 2018-05-13 2019-11-21 Pratik Sharma Predicate locking for dynamic databases

Families Citing this family (50)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US7568034B1 (en) * 2003-07-03 2009-07-28 Google Inc. System and method for data distribution
US8136025B1 (en) 2003-07-03 2012-03-13 Google Inc. Assigning document identification tags
US20060064400A1 (en) * 2004-09-21 2006-03-23 Oracle International Corporation, A California Corporation Methods, systems and software for identifying and managing database work
US7664847B2 (en) 2003-08-14 2010-02-16 Oracle International Corporation Managing workload by service
US7747717B2 (en) * 2003-08-14 2010-06-29 Oracle International Corporation Fast application notification in a clustered computing system
JP3944176B2 (en) * 2004-02-20 2007-07-11 株式会社東芝 Search request transmitting apparatus and program
US8346843B2 (en) 2004-12-10 2013-01-01 Google Inc. System and method for scalable data distribution
US7506009B2 (en) * 2005-01-28 2009-03-17 Dell Products Lp Systems and methods for accessing a shared storage network using multiple system nodes configured as server nodes
EP1691522A1 (en) * 2005-02-11 2006-08-16 Thomson Licensing Content distribution control on a per cluster of devices basis
US20070168507A1 (en) * 2005-11-15 2007-07-19 Microsoft Corporation Resource arbitration via persistent reservation
US8392400B1 (en) 2005-12-29 2013-03-05 Amazon Technologies, Inc. Method and apparatus for stress management in a searchable data service
US7801912B2 (en) * 2005-12-29 2010-09-21 Amazon Technologies, Inc. Method and apparatus for a searchable data service
US20070177739A1 (en) * 2006-01-27 2007-08-02 Nec Laboratories America, Inc. Method and Apparatus for Distributed Data Replication
JP2007249468A (en) * 2006-03-15 2007-09-27 Hitachi Ltd Cpu allocation method, cpu allocation program, cpu allocation device and database management system
US20080140734A1 (en) * 2006-12-07 2008-06-12 Robert Edward Wagner Method for identifying logical data discrepancies between database replicas in a database cluster
US8126848B2 (en) * 2006-12-07 2012-02-28 Robert Edward Wagner Automated method for identifying and repairing logical data discrepancies between database replicas in a database cluster
US8713186B2 (en) 2007-03-13 2014-04-29 Oracle International Corporation Server-side connection resource pooling
US8112593B2 (en) * 2007-03-29 2012-02-07 Netapp, Inc. System and method for improving cluster performance
US8489566B2 (en) * 2008-04-08 2013-07-16 International Business Machines Corporation Optimistic locking in online and offline environments
US8095753B1 (en) 2008-06-18 2012-01-10 Netapp, Inc. System and method for adding a disk to a cluster as a shared resource
US8577941B2 (en) * 2008-08-27 2013-11-05 Red Hat, Inc. Virtual database system
US20110307470A1 (en) * 2009-02-24 2011-12-15 Nec Corporation Distributed database management system and distributed database management method
AU2010218152B2 (en) 2009-02-27 2015-04-09 Siga Technologies, Inc. Thienopyridine derivatives for the treatment and prevention of Dengue virus infections
US8375047B2 (en) * 2010-03-31 2013-02-12 Emc Corporation Apparatus and method for query prioritization in a shared nothing distributed database
US8229961B2 (en) 2010-05-05 2012-07-24 Red Hat, Inc. Management of latency and throughput in a cluster file system
US9389926B2 (en) 2010-05-05 2016-07-12 Red Hat, Inc. Distributed resource contention detection
US20120036146A1 (en) 2010-10-26 2012-02-09 ParElastic Corporation Apparatus for elastic database processing with heterogeneous data
US8595192B1 (en) * 2010-12-01 2013-11-26 Symantec Corporation Systems and methods for providing high availability to instance-bound databases
EP2671171A1 (en) * 2011-01-31 2013-12-11 Telefonaktiebolaget L M Ericsson (PUBL) Distributed database
US9172750B2 (en) * 2011-04-26 2015-10-27 Brian J. Bulkowski Cluster-node load balancing in a distributed database system
US8812631B2 (en) * 2011-05-11 2014-08-19 International Business Machines Corporation Method and arrangement for operating a computer cluster
US8965921B2 (en) * 2012-06-06 2015-02-24 Rackspace Us, Inc. Data management and indexing across a distributed database
US9152692B2 (en) * 2012-06-28 2015-10-06 Google Inc. Generating n-gram clusters associated with events
US20140214886A1 (en) 2013-01-29 2014-07-31 ParElastic Corporation Adaptive multi-client saas database
US20150248443A1 (en) 2014-03-02 2015-09-03 Plexistor Ltd. Hierarchical host-based storage
US9679004B2 (en) * 2014-07-21 2017-06-13 Oracle International Corporation Planned cluster node maintenance with low impact on application throughput
US9602481B2 (en) 2014-10-16 2017-03-21 Morum, LLC Generation of short key for communications
US10642860B2 (en) * 2016-06-03 2020-05-05 Electronic Arts Inc. Live migration of distributed databases
US10474653B2 (en) 2016-09-30 2019-11-12 Oracle International Corporation Flexible in-memory column store placement
CN108415951B (en) * 2018-02-02 2022-01-11 广东睿江云计算股份有限公司 Database control method and system
US10754704B2 (en) 2018-07-11 2020-08-25 International Business Machines Corporation Cluster load balancing based on assessment of future loading
US10747932B2 (en) 2018-08-09 2020-08-18 International Business Machines Corporation Smart placement, visualization and optimization methodology for component placement and planning
CN111026709B (en) * 2019-12-10 2024-03-12 中盈优创资讯科技有限公司 Data processing method and device based on cluster access
CN110989679B (en) * 2019-12-19 2023-10-03 中国人民解放军空军工程大学 Unmanned aerial vehicle cluster crossing obstacle-getting decision-making method based on experience transplantation
US11736447B2 (en) 2020-07-23 2023-08-22 Dell Products L.P. Method and system for optimizing access to data nodes of a data cluster using a data access gateway and metadata mapping based bidding in an accelerator pool
US11882098B2 (en) 2020-07-23 2024-01-23 Dell Products L.P. Method and system for optimizing access to data nodes of a data cluster using a data access gateway and metadata mapping based bidding
US11936624B2 (en) 2020-07-23 2024-03-19 Dell Products L.P. Method and system for optimizing access to data nodes of a data cluster using a data access gateway and bidding counters
US11895093B2 (en) 2020-07-23 2024-02-06 Dell Products L.P. Method and system for optimizing access to data nodes of a data cluster using a data access gateway
US11526284B2 (en) * 2020-08-14 2022-12-13 Dell Products L.P. Method and system for storing data in a multiple data cluster system
US11288005B2 (en) 2020-08-14 2022-03-29 Dell Products L.P. Method and system for generating compliance and sequence aware replication in a multiple data cluster system

Family Cites Families (37)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
US5283897A (en) * 1990-04-30 1994-02-01 International Business Machines Corporation Semi-dynamic load balancer for periodically reassigning new transactions of a transaction type from an overload processor to an under-utilized processor based on the predicted load thereof
US5440727A (en) 1991-12-18 1995-08-08 International Business Machines Corporation Asynchronous replica management in shared nothing architectures
US5682174A (en) * 1995-02-16 1997-10-28 Texas Instruments Incorporated Memory cell array for digital spatial light modulator
US5692182A (en) * 1995-10-05 1997-11-25 International Business Machines Corporation Bufferpool coherency for identifying and retrieving versions of workfile data using a producing DBMS and a consuming DBMS
US5692174A (en) * 1995-10-05 1997-11-25 International Business Machines Corporation Query parallelism in a shared data DBMS system
US6067542A (en) 1995-10-20 2000-05-23 Ncr Corporation Pragma facility and SQL3 extension for optimal parallel UDF execution
US7013327B1 (en) * 1996-02-16 2006-03-14 G&H Nevada -Tek Method and apparatus for computing within a wide area network
US6148377A (en) * 1996-11-22 2000-11-14 Mangosoft Corporation Shared memory computer networks
US5909540A (en) * 1996-11-22 1999-06-01 Mangosoft Corporation System and method for providing highly available data storage using globally addressable memory
US6151688A (en) * 1997-02-21 2000-11-21 Novell, Inc. Resource management in a clustered computer system
US5966708A (en) * 1997-03-28 1999-10-12 International Business Machines Tail compression of a log stream using a scratch pad of logically deleted entries
US6260068B1 (en) * 1998-06-10 2001-07-10 Compaq Computer Corporation Method and apparatus for migrating resources in a multi-processor computer system
US6173374B1 (en) * 1998-02-11 2001-01-09 Lsi Logic Corporation System and method for peer-to-peer accelerated I/O shipping between host bus adapters in clustered computer network
US6353836B1 (en) * 1998-02-13 2002-03-05 Oracle Corporation Method and apparatus for transferring data from the cache of one node to the cache of another node
US6611861B1 (en) * 1998-02-27 2003-08-26 Xo Communications, Inc. Internet hosting and access system and method
US6182197B1 (en) * 1998-07-10 2001-01-30 International Business Machines Corporation Real-time shared disk system for computer clusters
US6269382B1 (en) * 1998-08-31 2001-07-31 Microsoft Corporation Systems and methods for migration and recall of data from local and remote storage
US6321238B1 (en) * 1998-12-28 2001-11-20 Oracle Corporation Hybrid shared nothing/shared disk database system
US6341340B1 (en) * 1998-12-28 2002-01-22 Oracle Corporation Transitioning ownership of data items between ownership groups
US6275900B1 (en) * 1999-01-27 2001-08-14 International Business Machines Company Hybrid NUMA/S-COMA system and method
US6233607B1 (en) * 1999-04-01 2001-05-15 Diva Systems Corp. Modular storage server architecture with dynamic data management
US6594671B1 (en) * 1999-06-14 2003-07-15 International Business Machines Corporation Separating privileged functions from non-privileged functions in a server instance
US6502103B1 (en) * 1999-06-14 2002-12-31 International Business Machines Corporation Providing composed containers and data objects to support multiple resources
US6754661B1 (en) * 1999-07-13 2004-06-22 Microsoft Corporation Hierarchical storage systems for holding evidentiary objects and methods of creating and operating upon hierarchical storage systems
US7039680B2 (en) * 1999-10-20 2006-05-02 International Business Machines Corporation Apparatus and method for timeout-free waiting for an ordered message in a clustered computing environment
US6920454B1 (en) * 2000-01-28 2005-07-19 Oracle International Corporation Techniques for DLM optimization with transferring lock information
US7254607B2 (en) * 2000-03-30 2007-08-07 United Devices, Inc. Dynamic coordination and control of network connected devices for large-scale network site testing and associated architectures
DE10020100A1 (en) * 2000-04-22 2001-10-31 Dmc2 Degussa Metals Catalysts Process and catalyst for the reduction of nitrogen oxides
US6934768B1 (en) * 2000-10-23 2005-08-23 International Business Machines Corporation Dynamic modification of fragmentation size cluster communication parameter in clustered computer system
US7606898B1 (en) * 2000-10-24 2009-10-20 Microsoft Corporation System and method for distributed management of shared computers
CN100431320C (en) * 2000-10-26 2008-11-05 普里斯梅迪亚网络有限公司 Method and appts. for real-time parallel delivery of segments of large payload file
US6965936B1 (en) * 2000-12-06 2005-11-15 Novell, Inc. Method for detecting and resolving a partition condition in a cluster
US6785678B2 (en) * 2000-12-21 2004-08-31 Emc Corporation Method of improving the availability of a computer clustering system through the use of a network medium link state function
US6850938B1 (en) * 2001-02-08 2005-02-01 Cisco Technology, Inc. Method and apparatus providing optimistic locking of shared computer resources
AU2002306495A1 (en) * 2001-02-13 2002-08-28 Candera, Inc. Storage virtualization and storage management to provide higher level storage services
JP3704573B2 (en) * 2001-03-14 2005-10-12 東芝ソリューション株式会社 Cluster system
US7240088B2 (en) * 2002-01-25 2007-07-03 International Business Machines Corporation Node self-start in a decentralized cluster

Cited By (1)

* Cited by examiner, † Cited by third party
Publication number Priority date Publication date Assignee Title
WO2019220170A1 (en) * 2018-05-13 2019-11-21 Pratik Sharma Predicate locking for dynamic databases

Also Published As

Publication number Publication date
US7447693B2 (en) 2008-11-04
US20080288554A1 (en) 2008-11-20
US20090055348A1 (en) 2009-02-26
US7970797B2 (en) 2011-06-28
US20080016028A1 (en) 2008-01-17
US7933882B2 (en) 2011-04-26
CA2377649C (en) 2009-02-03
US7937377B2 (en) 2011-05-03
US20030182264A1 (en) 2003-09-25

Similar Documents

Publication Publication Date Title
CA2377649A1 (en) Dynamic cluster database architecture
Hellerstein et al. Architecture of a database system
US6901405B1 (en) Method for persisting a schedule and database schema
WO2003102762A3 (en) Method, system, and program for a policy based storage manager
US6810400B2 (en) Representing database permissions as associations in computer schema
EP0890916A3 (en) Parallel file system and method with a metadata node
WO2002023328A3 (en) Managing distribution and local execution of computing resources
WO2004055679A3 (en) A distributed storage system for data-sharing among client computers running different operating system types
WO2004079509A3 (en) Improved connection pool and prepared statement cache
EP0890914A3 (en) Parallel file system and method for parallel write sharing
EP0339220A3 (en) File management system for a computer
US7080075B1 (en) Dynamic remastering for a subset of nodes in a cluster environment
CO5550077A1 (en) METHOD FOR THE MANAGEMENT OF REPLICATION OF FILES IN APPLICATIONS
WO2009149451A3 (en) Controlling resource allocation for backup operations
EP2705433A2 (en) Method and system for dynamically creating and servicing master-slave pairs within and across switch fabrics of a portable computing device
US20140012988A1 (en) Provisioning computer resources on a network
WO2006061315A3 (en) Resource management for data storage services
DE602004031101D1 (en) ACCESS MANAGEMENT OF OBJECTS FROM A COMPUTER ENVIRONMENT
DE60312527D1 (en) MANAGING DATA WITH A MULTIPLE OF STORAGE ATTRIBUTES
Sánchez et al. A high performance suite of data services for grids
Diener et al. Database services for personal computers linked by a local area network
US20060136434A1 (en) System and method for managing objects in a server namespace
Kawato et al. Attempt to Utilize Surplus Storage Capacity as Distributed Storage
Adrian et al. A PRACTICAL EXAMPLE OF IMPLEMENTING A DISTRIBUTED DATABASE APPLICATION.
Dove Expanding Options for Clustering

Legal Events

Date Code Title Description
EEER Examination request
MKLA Lapsed
MKLA Lapsed

Effective date: 20110321