Techniques for controlling mobile drive units (e.g., robots) in proximity to humans in a physical area are described. A management device may send an activity message to the mobile drive units instructing the mobile drive units to perform a set of activities. If a human is detected in the physical area, the management device or another mobile drive unit may send an activity command instructing a mobile drive unit to stop, reduce the speed at which it is traveling, to change its path of travel, or to continue performing its set of activities. If the mobile drive units do not receive the activity command, the mobile drive units may stop performing the set of activities. After the management device determines that the human has left the physical area, the management device may resume sending the activity message.