Systems and methods for implementing bulk handling in asynchronous processing

    公开(公告)号:US10019297B2

    公开(公告)日:2018-07-10

    申请号:US14306113

    申请日:2014-06-16

    CPC classification number: G06F9/546 G06F16/2455 G06F2209/548 H04L67/26

    Abstract: Systems and methods for implementing bulk handling in asynchronous processing are described. For example, an exemplary system includes a processor and a memory to execute instructions at the system; a broker to enqueue received messages; a push connection from the broker to a thread, in which the broker is to push an initial message to the thread for processing; a pull connection from the thread to the broker, in which the thread is to request one or more additional messages for bulk processing with the initial message from the broker; a query interface to issue a database query from the thread to a data store, the database query specifying the initial message and the one or more additional messages as a set of messages to obtain a lock for the set of messages; and a message processing engine to handle the set of messages in bulk based on whether the lock for the set of messages is obtained.

    Providing a routing framework for facilitating dynamic workload scheduling and routing of message queues for fair management of resources for application servers in an on-demand services environment
    2.
    发明授权
    Providing a routing framework for facilitating dynamic workload scheduling and routing of message queues for fair management of resources for application servers in an on-demand services environment 有权
    提供路由框架,用于促进动态工作负载调度和消息队列的路由,以便在按需服务环境中为应用程序服务器的资源进行公平管理

    公开(公告)号:US09348648B2

    公开(公告)日:2016-05-24

    申请号:US13841649

    申请日:2013-03-15

    Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating dynamic workload scheduling and routing of message queues for fair management of the resources for application servers in an on-demand services environment. In one embodiment and by way of example, a method includes detecting an organization of a plurality of organization that is starving for resources. The organization may be seeking performance of a job request at a computing system within a multi-tenant database system. The method may further include consulting, based on a routing policy, a routing table for a plurality of queues available for processing the job request, selecting a queue of the plurality of queues for the organization based on a fair usage analysis obtained from the routing policy, and routing the job request to the selected queue.

    Abstract translation: 根据实施例,提供了用于促进动态工作负载调度和消息队列的路由以用于按需服务环境中的应用服务器的资源的公平管理的机制和方法。 在一个实施例中,作为示例,一种方法包括检测为资源挨饿的多个组织的组织。 组织可能正在寻求在多租户数据库系统内的计算系统上执行作业请求。 该方法还可以包括基于路由策略来咨询可用于处理作业请求的多个队列的路由表,基于从路由策略获得的合理使用分析,为组织选择多个队列的队列 ,并将作业请求路由到所选择的队列。

    Facilitating equitable distribution of thread resources for job types associated with tenants in a multi-tenant on-demand services environment
    4.
    发明授权
    Facilitating equitable distribution of thread resources for job types associated with tenants in a multi-tenant on-demand services environment 有权
    促进在多租户按需服务环境中公平分配与租户相关的工作类型的线程资源

    公开(公告)号:US09529626B2

    公开(公告)日:2016-12-27

    申请号:US13841417

    申请日:2013-03-15

    Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating a fair allocation and usage of thread resources for user messages according to one embodiment in an on-demand services environment. In one embodiment and by way of example, a method includes tracking resource usage associated with a plurality of messages performed and completed in response to requests placed by a user via a user interface at a computing device, where the tracking includes recording an amount of resources consumed by each completed message. The method may further include classifying the plurality of messages into job types based on the tracked resource usage associated with the plurality of messages, and enforcing, based on the classification of the messages, a message selection process to ensure equitable distribution of resources to subsequently received messages.

    Abstract translation: 根据实施例,提供了根据一个实施例在按需服务环境中促进用户消息的线程资源的公平分配和使用的机制和方法。 在一个实施例中,作为示例,一种方法包括跟踪与响应于用户经由计算设备处的用户界面发出的请求执行和完成的多个消息相关联的资源使用,其中跟踪包括记录资源量 每个完成的消息消耗。 该方法可以进一步包括基于与多个消息相关联的跟踪资源使用将多个消息分类为作业类型,并且基于消息的分类来执行消息选择过程以确保资源的公平分配以便随后接收 消息。

    Mechanism for facilitating sliding window resource tracking in message queues for fair management of resources for application servers in an on-demand services environment
    5.
    发明授权
    Mechanism for facilitating sliding window resource tracking in message queues for fair management of resources for application servers in an on-demand services environment 有权
    促进消息队列中滑动窗口资源跟踪的机制,以便在按需服务环境中公平管理应用程序服务器的资源

    公开(公告)号:US09268605B2

    公开(公告)日:2016-02-23

    申请号:US13841713

    申请日:2013-03-15

    Abstract: In accordance with embodiments, there are provided mechanisms and methods for facilitating sliding window resource tracking in message queues for fair management of resources for application servers in an on-demand services environment. In one embodiment and by way of example, a method includes monitoring, in real-time, in-flight jobs in message queues for incoming jobs from organizations in a distributed environment having application servers in communication over a network, applying local sliding windows to the message queues to estimate wait time associated with each incoming job in a message queue. A local sliding window may include segment of time being monitored in each message queue for estimating the wait time. The method may further include allocating, in real-time, based on the estimated wait time, thread resources to one or more of the incoming jobs associated with the one or more of the organizations.

    Abstract translation: 根据实施例,提供了用于促进消息队列中的滑动窗口资源跟踪以用于按需服务环境中的应用服务器的资源的公平管理的机制和方法。 在一个实施例中,作为示例,一种方法包括实时地监视来自具有通过网络通信的应用服务器的分布式环境中的组织的来自作业的消息队列中的飞行中作业,将本地滑动窗口应用于 消息队列来估计与消息队列中的每个传入作业相关联的等待时间。 本地滑动窗口可以包括在每个消息队列中被监视的时间段,用于估计等待时间。 该方法可以进一步包括实时地基于估计的等待时间将线程资源分配给与一个或多个组织相关联的一个或多个进入作业。

    SYSTEMS AND METHODS FOR IMPLEMENTING BULK HANDLING IN ASYNCHRONOUS PROCESSING
    6.
    发明申请
    SYSTEMS AND METHODS FOR IMPLEMENTING BULK HANDLING IN ASYNCHRONOUS PROCESSING 有权
    用于在异步处理中执行大容量处理的系统和方法

    公开(公告)号:US20140304246A1

    公开(公告)日:2014-10-09

    申请号:US14306113

    申请日:2014-06-16

    CPC classification number: G06F9/546 G06F17/30477 G06F2209/548 H04L67/26

    Abstract: In accordance with disclosed embodiments, there are provided systems and methods for implementing bulk handling in asynchronous processing. According to a particular embodiment such a system includes a processor and a memory to execute instructions at the system; a broker to enqueue received messages; a push connection from the broker to a thread, in which the broker is to push an initial message to the thread for processing; a pull connection from the thread to the broker, in which the thread is to request one or more additional messages for bulk processing with the initial message from the broker; a query interface to issue a database query from the thread to a data store, the database query specifying the initial message and the one or more additional messages as a set of messages to obtain a lock for the set of messages; and a message processing engine to handle the set of messages in bulk based on whether the lock for the set of messages is obtained. Other related embodiments are disclosed.

    Abstract translation: 根据所公开的实施例,提供了用于在异步处理中实现批量处理的系统和方法。 根据特定实施例,这样的系统包括处理器和存储器,用于在系统处执行指令; 一个经纪人排队收到的消息; 从代理到线程的推送连接,其中代理人将初始消息推送到线程进行处理; 从线程到代理的拉线连接,其中线程将使用来自代理器的初始消息来请求一个或多个附加消息进行批量处理; 查询接口,用于从线程发出数据库查询到数据存储,数据库查询指定初始消息,并将一个或多个附加消息作为一组消息获取消息集合的锁; 以及消息处理引擎,用于基于是否获得针对所述一组消息的锁来批量处理所述消息集合。 公开了其他相关实施例。

Patent Agency Ranking