公开(公告)号：US10304349B1

公开(公告)日：2019-05-28

申请号：US14308605

申请日：2014-06-18

Applicant: Amazon Technologies, Inc.

Inventor： Thomas Charles Stickle ,  Bruce Cameron Burns

IPC: G09B7/02

Abstract: A technology for providing a test environment is provided. In one example, a method may include defining a macro task for an unstructured lab in a service provider environment, the macro task including a task definition and expected values for a plurality of sub-tasks within the macro task. A request to participate in the unstructured lab may be received from a client device and the macro task may be provided to the client device in response to the request. Metrics may be collected from the unstructured lab using a metrics collector. Completion of the macro task may be analyzed by comparing the metrics to the expected values and a report indicative of performance of the macro task may be provided.