Abstract:
A data read/write method includes: establishing a first connection to a client, determining a first tablespace corresponding to the first connection, and determining a first node corresponding to the first connection or the first tablespace in a plurality of nodes, where the first connection receives a read/write request from the client; loading data in the first tablespace to a memory in the first node, and processing a read/write request on the first connection using a first working thread, where the first working thread is generated by a processor in the first node.
Abstract:
Embodiments of the present invention relate to the database field, and in particular, to a data transmission method and apparatus, so as to reduce overheads for data transmission between nodes in a distributed database and lighten network load. In the embodiments of the present invention, a DN determines a column that has a distribution rule of parameters in the column; the DN determines, according to a data type of the parameters of the column and the distribution rule of the parameters in the column, a compression algorithm corresponding to the column; the DN compresses the column using the compression algorithm; and the DN sends a compressed column to a target node. In this way, the overheads for the data transmission between the nodes are reduced, and the network load is lightened.
Abstract:
A database system lock operation method is provided that includes: acquiring, by a first processing node, a lock operand of a target lock; using, by the first processing node, the target lock to perform a lock acquiring operation on a target data object; when the lock operand meets a condition for a successful lock acquiring operation, determining, by the first processing node, that the lock acquiring operation is successful, and updating a value of a data bit that is in the lock operand and used to indicate a state of the target lock on the first processing node to a value that is used to indicate that the state of the target lock on the first processing node is lock held. Accordingly, the embodiments of the present invention further disclose a node device. The embodiments of the present invention can improve performance of a database system.
Abstract:
A data processing method and apparatus, which relate to the computer field and are capable of effectively improving scalability of a database system. The data processing method includes: receiving source code of an external routine, where the source code of the external routine is compiled by using an advanced programming language; compiling the source code to obtain intermediate code, where the intermediate code is a byte stream identifiable to a virtual machine on any operating platform; converting, according to an instruction set on the operating platform, the intermediate code into machine code capable of running on the operating platform; and storing the machine code to a database. The data processing method and apparatus provided by the embodiments of the present invention are used to process data.
Abstract:
The present disclosure relates to fault repair methods for a database system. In one example method, when working normally, a master node backs up, to a global buffer pool (GBP) node by using a data transmission protocol with a low latency and a high throughput (for example, a remote direct memory access (RDMA) protocol), a modified page generated because of transaction modification. When the master node is faulty, a standby node does not need to replay all remaining replay logs that are not replayed, but only needs to replay redo logs corresponding to a page that does not exist on the GBP node and pages that are not sequentially arranged and obtain the pages.
Abstract:
A lock management method and system, and a method and an apparatus for configuring a lock management system is provided. A corresponding level of a lock management system is set for each service execution node according to the number of service execution nodes included in a distributed system, the number of system instances on all service execution nodes, the number of handling processes on all the service execution nodes, and a delay of access of each service execution node to a central control node of the distributed system. At least one lock manager is allocated to each service execution node separately according to the level, which is corresponding to each service execution node, of the lock management system. A lock level context is configured for each lock manager, where the lock level context is used to determine an adjacent lock manager of each lock manager.
Abstract:
A data read/write method includes: establishing a first connection to a client, determining a first tablespace corresponding to the first connection, and determining a first node corresponding to the first connection or the first tablespace in a plurality of nodes, where the first connection receives a read/write request from the client; loading data in the first tablespace to a memory in the first node, and processing a read/write request on the first connection using a first working thread, where the first working thread is generated by a processor in the first node.
Abstract:
A data system comprising a primary server and a secondary server, where the primary server obtains a first partition instruction and a second partition instruction, partition data in a first data table according to a first partition key to obtain a first partition table, and send the second partition instruction to the secondary server. The first partition instruction includes a first partition key, and the second partition instruction includes a second partition key, which is different from the first partition key. The second partition instruction is for triggering the secondary server to partition data in a second data table on the secondary server according to the second partition key to obtain a second partition table, which is the same as the first data table.
Abstract:
A lock management method and system, and a method and an apparatus for configuring a lock management system is provided. A corresponding level of a lock management system is set for each service execution node according to the number of service execution nodes included in a distributed system, the number of system instances on all service execution nodes, the number of handling processes on all the service execution nodes, and a delay of access of each service execution node to a central control node of the distributed system. At least one lock manager is allocated to each service execution node separately according to the level, which is corresponding to each service execution node, of the lock management system. A lock level context is configured for each lock manager, where the lock level context is used to determine an adjacent lock manager of each lock manager.
Abstract:
A data processing method and apparatus, which relate to the computer field and are capable of effectively improving scalability of a database system. The data processing method includes: receiving source code of an external routine, where the source code of the external routine is compiled by using an advanced programming language; compiling the source code to obtain intermediate code, where the intermediate code is a byte stream identifiable to a virtual machine on any operating platform; converting, according to an instruction set on the operating platform, the intermediate code into machine code capable of running on the operating platform; and storing the machine code to a database. The data processing method and apparatus provided by the embodiments of the present invention are used to process data.