REDUCING DATA I/O USING IN-MEMORY DATA STRUCTURES

    公开(公告)号:US20170116136A1

    公开(公告)日:2017-04-27

    申请号:US15268524

    申请日:2016-09-16

    IPC分类号: G06F12/14 H04L9/06 G06F17/30

    摘要: Techniques are described herein for generating and using in-memory data structures to represent columns in data block sets. In an embodiment, a database management system (DBMS) receives a query for a target data set managed by the DBMS. The query may specify a predicate for a column of the target data set. The predicate may include a filtering value to be compared with row values of the column of the target data set. Prior to accessing data block sets storing the target data set from persistent storage, the DBMS identifies an in-memory summary that corresponds to a data block set, in an embodiment. The in-memory summary may include in-memory data structures, each representing a column stored in the data block set. The DBMS determines that a particular in-memory data structure exists in the in-memory summary that represents a portion of values of the column indicated in the predicate of the query. Based on the particular in-memory data structure, the DBMS determines whether or not the data block set can possibly contain the filtering value in the column of the target data set. Based on this determination, the DBMS skips or retrieves the data block set from the persistent storage as part of the query evaluation.

    Intelligent Network Resource Manager
    2.
    发明申请

    公开(公告)号:US20200169508A9

    公开(公告)日:2020-05-28

    申请号:US16287521

    申请日:2019-02-27

    IPC分类号: H04L12/851 H04L29/08

    摘要: A method and apparatus for intelligent network resource manager for distributed computing systems is provided. A first priority is assigned to a first virtual channel set that includes at least two virtual channels of a plurality of virtual channels associated with a physical communication channel. A second priority is assigned to a second virtual channel set that includes at least one virtual channel of the plurality of virtual channels. The first virtual channel set has more virtual channels than the second virtual channel set. Outbound messages of the first priority are directed to virtual channels of the first virtual channel set. Outbound messages of the second priority are directed to virtual channels of the second virtual channel set. The virtual channels are processed in a round-robin order, where processing includes sending the outbound messages over the physical communication channel.

    DETECTION OF AVOIDABLE CACHE THRASHING FOR OLTP AND DW WORKLOADS

    公开(公告)号:US20180129612A1

    公开(公告)日:2018-05-10

    申请号:US15687296

    申请日:2017-08-25

    IPC分类号: G06F12/121 G06F12/0891

    摘要: Techniques are provided to adjust the behavior of a cache based on a count of cache misses for items recently evicted. In an embodiment, a computer responds to evicting a particular item (PI) from a cache by storing a metadata entry for the PI into memory. In response to a cache miss for the PI, the computer detects whether or not the metadata entry for the PI resides in memory. When the metadata entry for the PI is detected in memory, the computer increments a victim hit counter (VHC) that may be used to calculate how much avoidable thrashing is the cache experiencing, which is how much thrashing would be reduced if the cache were expanded. Either immediately or arbitrarily later, the computer adjusts a policy of the cache based on the VHC's value. For example, the computer may adjust the capacity of the cache based on the VHC.

    CONSISTENTLY ENFORCING I/O RESOURCE CONSTRAINTS FOR WORKLOADS ON PARALLEL-ACCESS STORAGE DEVICES

    公开(公告)号:US20200278799A1

    公开(公告)日:2020-09-03

    申请号:US16730608

    申请日:2019-12-30

    IPC分类号: G06F3/06

    摘要: The techniques described herein limit client utilization of a parallel-access storage device. Specifically, client utilization of a particular storage device is estimated using I/O cost metrics to estimate the costs of I/O requests from the client to the particular storage device. The I/O cost metrics are determined based on calibration-based system performance data, which represents a system-wide measure of storage device performance for a system in which the particular storage device resides. The calibration-based system performance data includes one or both of composite throughput data and composite IOPS data for multiple parallel-access devices in the system. The cost estimates for I/O requests issued from a client to a parallel-access device are tracked in a total cost estimate for the client. Client utilization of the storage device, as tracked by the total cost estimate for the client, is limited to a percentage of the total estimated bandwidth of the storage device.

    DETECTION OF AVOIDABLE CACHE THRASHING FOR OLTP AND DW WORKLOADS

    公开(公告)号:US20190243783A1

    公开(公告)日:2019-08-08

    申请号:US16388955

    申请日:2019-04-19

    IPC分类号: G06F12/121 G06F12/0891

    摘要: Techniques are provided to adjust the behavior of a cache based on a count of cache misses for items recently evicted. In an embodiment, a computer responds to evicting a particular item (PI) from a cache by storing a metadata entry for the PI into memory. In response to a cache miss for the PI, the computer detects whether or not the metadata entry for the PI resides in memory. When the metadata entry for the PI is detected in memory, the computer increments a victim hit counter (VHC) that may be used to calculate how much avoidable thrashing is the cache experiencing, which is how much thrashing would be reduced if the cache were expanded. Either immediately or arbitrarily later, the computer adjusts a policy of the cache based on the VHC's value. For example, the computer may adjust the capacity of the cache based on the VHC.

    SECONDARY STORAGE SERVER CACHING
    6.
    发明申请

    公开(公告)号:US20200110700A1

    公开(公告)日:2020-04-09

    申请号:US16153674

    申请日:2018-10-05

    摘要: Techniques related to failover to the secondary storage server from a primary storage server of a database server without degrading the performance of servicing storage requests for client applications are provided. In an embodiment, the secondary storage server receives, from the database server, an eviction notification indicating that a set of data blocks has been evicted from a cache. The secondary storage server's memory hierarchy includes a secondary cache and a secondary persistent storage that stores a second copy of the set of data blocks. The secondary storage server persistently stores a copy of data, which is also persistently stored on the primary storage server, which includes a first copy of the set of data blocks. In an embodiment, upon receiving the eviction notification, the secondary storage server retrieves the second copy of the set of data blocks from the secondary persistent storage of the secondary storage server and loads the second copy of the set of data blocks into the secondary cache. After an interruption event, the secondary storage receives a request for a subset of the set of data blocks based on a request for data, at the database server. Upon receiving the request for the subset of the set of data blocks, the second storage server retrieves the subset of the set of data blocks from the second copy of the set of data blocks stored on the secondary cache of the secondary storage server without retrieving any of such data blocks from the second copy of the set of data blocks stored on the persistent storage of the secondary storage server. The second storage server sends the subset of the set of data blocks to the database server.

    Intelligent Network Resource Manager
    7.
    发明申请

    公开(公告)号:US20190199639A1

    公开(公告)日:2019-06-27

    申请号:US16287521

    申请日:2019-02-27

    IPC分类号: H04L12/851 H04L29/08

    摘要: A method and apparatus for intelligent network resource manager for distributed computing systems is provided. A first priority is assigned to a first virtual channel set that includes at least two virtual channels of a plurality of virtual channels associated with a physical communication channel. A second priority is assigned to a second virtual channel set that includes at least one virtual channel of the plurality of virtual channels. The first virtual channel set has more virtual channels than the second virtual channel set. Outbound messages of the first priority are directed to virtual channels of the first virtual channel set. Outbound messages of the second priority are directed to virtual channels of the second virtual channel set. The virtual channels are processed in a round-robin order, where processing includes sending the outbound messages over the physical communication channel.