Enabling Dynamic Job Configuration in Mapreduce
    81.
    发明申请
    Enabling Dynamic Job Configuration in Mapreduce 有权
    启用Mapreduce中的动态作业配置

    公开(公告)号:US20150227392A1

    公开(公告)日:2015-08-13

    申请号:US14176679

    申请日:2014-02-10

    CPC classification number: G06F9/5066 G06F9/466 G06F9/4881 G06F11/34

    Abstract: Methods, systems, and articles of manufacture for enabling dynamic task-level configuration in MapReduce are provided herein. A method includes generating a first set of configurations for a currently executing MapReduce job, wherein said set of configurations comprises job-level configurations and task-level configurations; dynamically modifying configurations associated with a mapper component and/or a reducer component associated with at least one ongoing map task and/or ongoing reduce task of the MapReduce job based on the generated first set of configurations; and deploying said first set of configurations to the mapper component and/or the reducer component associated with the MapReduce job.

    Abstract translation: 本文提供了在MapReduce中实现动态任务级配置的方法,系统和制造。 一种方法包括为当前执行的MapReduce作业生成第一组配置,其中所述一组配置包括作业级配置和任务级配置; 基于所生成的第一组配置,动态地修改与映射器组件和/或与至少一个正在进行的映射任务相关联的还原器组件和/或正在进行的MapReduce作业的减少任务; 以及将所述第一组配置部署到与所述MapReduce作业相关联的所述映射器组件和/或所述reducer组件。

    DATABASE SELF-DIAGNOSIS AND SELF-HEALING

    公开(公告)号:US20220100722A1

    公开(公告)日:2022-03-31

    申请号:US17031996

    申请日:2020-09-25

    Abstract: In an approach for database self-diagnosis and self-healing, a processor receives a problem description related to a database. A processor classifies the problem description into a natural language description portion and a database-know-who content portion. A processor processes the natural language description portion using natural language processing techniques. A processor evaluates the database-know-who content portion. A processor combines a result of processing the natural language description portion and evaluating the database-know-who content portion. A processor identifies a solution based on the problem description and the combined result. A processor solves a problem using the identified solution.

    Utilizing accelerators to accelerate data analytic workloads in disaggregated systems

    公开(公告)号:US11275622B2

    公开(公告)日:2022-03-15

    申请号:US16204653

    申请日:2018-11-29

    Abstract: Server resources in a data center are disaggregated into shared server resource pools, including an accelerator (e.g., FPGA) pool. Servers are constructed dynamically, on-demand and based on workload requirements, by allocating from these resource pools. According to this disclosure, accelerator utilization in the data center is managed proactively by assigning accelerators to workloads in a fine granularity and agile way, and de-provisioning them when no longer needed. In this manner, the approach is especially advantageous to automatically provision accelerators for data analytic workloads. The approach thus provides for a “micro-service” enabling data analytic workloads to automatically and transparently use FPGA resources without providing (e.g., to the data center customer) the underlying provisioning details. Preferably, the approach dynamically determines the number and the type of FPGAs to use, and then during runtime auto-scales the FPGAs based on workload.

    Enabling rewire-aware MapReduce cluster in disaggregated systems

    公开(公告)号:US10915373B2

    公开(公告)日:2021-02-09

    申请号:US16204425

    申请日:2018-11-29

    Abstract: MapReduce processing is carried out in a disaggregated compute environment comprising a set of resource pools that comprise a processor pool, and a memory pool. Upon receipt of a MapReduce job, a task scheduler allocates resources from the set of resource pools, the resources including one or more processors drawn from the processor pool, and one or more memory modules drawn from the memory pool. The task scheduler then schedules a set of tasks required by the MapReduce job. At least one particular task in the set is scheduled irrespective of a location of data required for the particular task. In association with a shuffle phase of the MapReduce job, and in connection with the particular task, at least one connection between a processor and at least one memory module is dynamically rewired based on the location of the data required for the particular task, thereby obviating network transfer of that data.

Patent Agency Ranking