-
公开(公告)号：US09396039B1
公开(公告)日：2016-07-19
申请号：US14032324
申请日：2013-09-20
Applicant: Amazon Technologies, Inc.
CPC classification number: G06F9/5083 , G06F9/45533 , G06F9/5077 , G06F9/5088 , G06F9/546 , G06F11/3688 , G06F2209/548
Abstract: Methods and systems for load generation for scalable load testing are disclosed. A plurality of job descriptions are generated based on a load step description. The load step description specifies a total transaction frequency or a total number of concurrent connections for a load test of a service over a period of time. The job descriptions specify subdivisions of the total transaction frequency or the total number of concurrent connections and subdivisions of the period of time. The job descriptions are placed in a job queue. A plurality of worker hosts remove the job descriptions from the job queue and concurrently execute local jobs based on the job descriptions.
Abstract translation: 公开了用于可扩展负载测试的负载产生的方法和系统。 基于加载步骤描述生成多个作业描述。 加载步骤描述指定在一段时间内服务的负载测试的总交易频率或并发连接的总数。 作业描述指定总交易频率的细分，或时间段的并发连接和细分的总数。 作业描述被放置在作业队列中。 多个工作主机从作业队列中删除作业描述，并根据作业描述并行执行本地作业。
-
公开(公告)号：US09363156B2
公开(公告)日：2016-06-07
申请号：US14630459
申请日：2015-02-24
Applicant: Amazon Technologies, Inc.
IPC: G06F11/00 , H04L12/26 , G06F11/263 , G06F11/36
CPC classification number: H04L43/50 , G06F11/263 , G06F11/3414 , G06F11/3452 , G06F11/3668 , G06F2201/875
Abstract: A network-based production service is configured to process client requests for the production service via a network, capture production request data defining the requests and store the production request data in a data store. A test system comprising one or more controllers creates test jobs according to a test plan for testing the production service. The test plan creates a test profile for using specified production request data to simulate a load on the production service. Each job created by the test plan specifies a portion of production request data. A job queue receives and queues test jobs from one or more controllers configured to add test jobs to the job queue according to the test plan. Workers access jobs from the job queue and the production request data from the data store as specified in each job and replay the production request data to the production service.
-
23.发明授权公开(公告)号：US09229845B1
公开(公告)日：2016-01-05
申请号：US13666832
申请日：2012-11-01
Applicant: Amazon Technologies, Inc.
IPC: G06F11/36
CPC classification number: G06F11/3672 , G06F11/3668 , G06F11/3692 , G06F2201/865
Abstract: Proposed updates to systems are evaluated in a manner that is automated and horizontally scalable. Input to a first system is provided to a second system. The first system and second system process the input and each generates output. The output from the first system and second system is analyzed and differences in the output data between the two systems are identified. Analyzing the output may be performed by a fleet of data processing units and the work of analyzing the output may be performed such that differences in the output data are traceable to subsystems of the second system that caused the differences.
Abstract translation: 系统的建议更新以自动化和水平扩展的方式进行评估。 向第二系统提供对第一系统的输入。 第一个系统和第二个系统处理输入，每个生成输出。 分析第一系统和第二系统的输出，并识别两个系统之间输出数据的差异。 分析输出可以由一组数据处理单元执行，并且可以执行分析输出的工作，使得输出数据的差异可追溯到导致差异的第二系统的子系统。
-
公开(公告)号：US11868239B1
公开(公告)日：2024-01-09
申请号：US15176005
申请日：2016-06-07
Applicant: Amazon Technologies, Inc.
Inventor： Ryan Preston Gantt , Carlos Alejandro Arguelles , Aman Ahmed , Brian Thomas Kachmarck , Phillip Scott Segel , Michael Leo Weiss
CPC classification number: G06F11/3688 , G06F11/3684 , G06F11/3692 , H04L67/10
Abstract: Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.
-
公开(公告)号：US10678678B1
公开(公告)日：2020-06-09
申请号：US15918915
申请日：2018-03-12
Applicant: Amazon Technologies, Inc.
Inventor： Kathleen Joanna Tsoukalas , Carlos Alejandro Arguelles , Sichao Shi
Abstract: Methods, systems, and computer-readable media for ordered test execution based on code coverage are disclosed. A suite of tests are executed on a first version of program code to generate data indicative of code coverage of respective tests with respect to the program code. A mapping of the tests to the program code is determined based at least in part on the data indicative of code coverage and is stored. The mapping comprises data indicative of one or more portions of the program code exercised by respective tests from the suite. Based at least in part on the mapping of the tests to the program code and on data indicative of one or more modified or new portions of a second version of the program code, a subset of the tests is determined that are likely to be exercised by the second version of the program code.
-
Patent Agency Ranking
公开(公告)号：US10523511B2
公开(公告)日：2019-12-31
申请号：US15589898
申请日：2017-05-08
Applicant: Amazon Technologies, Inc.
Inventor： Carlos Alejandro Arguelles
Abstract: Methods, systems, and computer-readable media for determining the maximum throughput of a service are disclosed. A first sequence of load tests is initiated for a service host. Individual ones of the load tests comprise determining a respective throughput at the service host for a respective number of concurrent connections to the service host. The number of concurrent connections increases nonlinearly in at least a portion of the first sequence of load tests. The first sequence of load tests is discontinued when the throughput is not increased by a threshold from one of the load tests to the next. An estimated maximum throughput for the service host is determined based at least in part on the first sequence of load tests. The estimated maximum throughput corresponds to a particular number of concurrent connections to the service host.
-
公开(公告)号：US20190311292A1
公开(公告)日：2019-10-10
申请号：US16449074
申请日：2019-06-21
Applicant: Amazon Technologies, Inc.
Inventor： Carlos Alejandro Arguelles
IPC: G06N20/00 , G06F11/34 , G06F11/36 , G06F15/177 , H04L12/24
Abstract: Methods and systems for automated tuning of a service configuration are disclosed. An optimal configuration for a test computer is selected by performing one or more load tests using the test computer for each of a plurality of test configurations. The performance of a plurality of additional test computers configured with the optimal configuration is automatically determined by performing additional load tests using the additional test computers. A plurality of production computers are automatically configured with the optimal configuration if the performance of the additional test computers is improved with the optimal configuration.
-
公开(公告)号：US10185937B1
公开(公告)日：2019-01-22
申请号：US14133581
申请日：2013-12-18
Applicant: Amazon Technologies, Inc.
Inventor： Carlos Alejandro Arguelles , Kyle Thomas Studd
Abstract: A generic transaction generator framework for testing a network-based production service may work in conjunction with a product-specific transaction creator module that executes transactions on the service. The transaction creator module may include runtime-discoverable information, such as source code annotations, to communicate product specific details to the framework. Runtime-discoverable information may identify transaction types, transaction methods, as well as dependencies between different transaction types and transaction methods. The framework may generate and execute various test transactions and may call a substituted transaction method for a transaction type on which a generated transaction depends prior to calling the generated transaction. The output from the substituted transaction may be used as input to the generated transaction when executed subsequently. Various data structures may be used to maintain information regarding which transactions have been substituted and to store data for use as input to subsequent transactions.
-
公开(公告)号：US10135709B1
公开(公告)日：2018-11-20
申请号：US15175946
申请日：2016-06-07
Applicant: Amazon Technologies, Inc.
Inventor： Phillip Scott Segel , Carlos Alejandro Arguelles , Aman Ahmed , Ryan Preston Gantt , Brian Thomas Kachmarck , Michael Leo Weiss
Abstract: Embodiments presented herein provide techniques for evaluating an asynchronous application using a test framework. The test framework may perform a load test of an asynchronous application or service composed from a collection of applications or services. To do so, the test framework may submit transactions to a distributed application at a specified transaction rate and monitor how the distributed application operates at that transaction rate. An aggregate load test component may evaluate the remaining work pending at work accumulation points of the distributed application to determine whether the distributed application can sustain the specified transaction rate. A transaction tracking component may initiate transactions to generate load at the specified transaction rate without blocking while the transactions are processed by the distributed application.
-
公开(公告)号：US10102106B2
公开(公告)日：2018-10-16
申请号：US14961786
申请日：2015-12-07
Applicant: Amazon Technologies, Inc.
Inventor： Carlos Alejandro Arguelles , Kiran Chitluri , Choi Young Ngo , Mihaela Petrescu , Vijay P. Singh , Justin Alexander Tisi
Abstract: Techniques are described for aggregating code coverage data generated from various types of testing of software modules, and automatically determining whether to promote software upwards in a multi-level software deployment hierarchy based on the aggregated code coverage data. In embodiments, a code coverage metric is determined for a software module, and the metric is compared to a set of promotion criteria, including whether the metric meets a predetermined threshold for quality. In some cases, the threshold may be a general threshold, a threshold based on the level of possible promotion, and/or a threshold that is based on an identified category for the software module such as whether the module is a front-end module, a shared module, a legacy module, or a critical module.
-
-
-
-
-
-
-
-
-
Search Results
34
records
(took 0.019 seconds)
