摘要:
A method and system for exploring a remote environment from an environment simulator or terrain replicator at a local base on Earth is disclosed. The system includes: at least one proxy robot in the remote environment with a near-field video camera and a high resolution 360-degree far field video camera; at least one additional surveillance means at the remote environment to capture images and data pertaining to the remote environment; an aggregator means to aggregate video from the cameras on the at least one proxy robot with the images and data from the at least one additional surveillance means; a transmitter means at the remote environment to transmit the aggregated video and data signals over a path to the local base; a receiver means at the local base to receive the aggregated video and data signals from the remote environment; a terrain analysis computer at the local base to receive and process the aggregated video and data signals to generate therefrom a 360-degree approximated real time (ART) video field precisely representing a terrain surrounding the at least one proxy robot in the remote environment; a display means in the environment simulator or the terrain replicator at the local base to receive and display the ART video field for at least one user; a full body motion capture suit means in the environment simulator or the terrain replicator marked to a plurality of dimensions of the at least one user, wherein activities performed virtually in the environment simulator or the terrain replicator represent the identical activities to be performed by the proxy robot in the terrain of the remote environment; a plurality of motion capture video cameras to capture video signals representing each move or position change in the full body motion capture suit; a follow-me data computer to receive the video signals from the plurality of motion capture video cameras, wherein the follow-me data computer processes the motion capture video signals into a follow-me data train for transmission to a follow-me data translator at the remote environment, and wherein the follow-me data computer further generates and directs data representing changes in the full body motion capture suit back to the terrain analysis computer for continuous updating of the ART video for the display means in the environment simulator or the terrain replicator to reflect position changes from the full body motion capture suit; a follow-me data translator at the remote environment to translate the follow-me data train into data code addressable to each electro-mechanical hinge, motor and synthetic muscle in the at least one proxy robot and cause the proxy robot to move through the remote environment by emulating every move and position change in the full body motion capture suit at the local base.
摘要:
A system includes digital servo modules and building blocks that are assemblable in several permutations to construct robotic figures. A central controller communicates with the modules via communication channels, each subdivided into sub-channels. The system utilizes a discovery process wherein the central controller periodically transmits a discovery signal in each sub-channel until a newly attached module transmits a reply to the discovery signal. The central controller transmits position commands to the recognized servo modules and receives position feedback from the recognized modules. The system enables someone to easily program a robotic figure via: a learned motion mode, wherein joints are manipulated and the central controller records a trajectory for each servo module; a user motion capture mode, wherein user motions are captured via camera to generate servo trajectories; and an animation builder mode, wherein a virtual representation of the robotic figure can be manipulated on screen to generate servo trajectories.
摘要:
The invention relates to a robot and a method for controlling a robot. The distance between an object and the robot and/or the derivative thereof or a first motion of the object is detected by means of a non-contact distance sensor arranged in or on a robot arm of the robot and/or on or in an end effector fastened on the robot arm. The robot arm is moved based on the first motion detected by means of the distance sensor, a target force or a target torque to be applied by the robot is determined based on the distance detected between the object and the robot, and/or a function of the robot or a parameterization of a function of the robot is triggered based on the first motion detected and/or a target distance between the object and the robot and/or the derivative thereof detected by means of the distance sensor.
摘要:
Methods, systems, and apparatus, including computer programs encoded on a computer storage medium, for automating a manual process. The methods, systems, and apparatus include actions of identifying a process that (i) is manually performed by a user interacting with a computer, and (ii) is to be automated for performance by a robot that is configured to interact with another computer. Additional actions include obtaining one or more images taken of a display of the computer while the user is interacting with the computer in manually performing the process and applying a computer vision technique to identify one or more activities associated with the process. Further actions include, for each of the one or more identified activities, generating activity information associated with the activity and generating a process definition for use in causing the robot to automatically perform the process.
摘要:
Disclosed are a system and/or a method of telepresence based inventory pick and place operations through actuator controlled robotic arms affixed to each row of a shelf. A method includes mounting a robotic arm at an end of a row of a shelf of inventory on a set of rails affixed to the row of a shelf. The robotic arm is permitted to move horizontally along the row of the shelf. The robotic arm is repositioned along the three axes using a set of actuators. A haptic motion of a human user is mirrored that is remotely using a positioning device (e.g., human may feel the feedback of the remote arm as it touches the objects). An item is placed on a counting platform in front of the robotic arm. The items are placed automatically in the designated location down through a transport means when a pick operation is completed.
摘要:
Via intuitive interactions with a user, robots may be trained to perform tasks such as visually detecting and identifying physical objects and/or manipulating objects. In some embodiments, training is facilitated by the robot's simulation of task-execution using augmented-reality techniques.
摘要:
Robots have the capacity to perform a broad range of useful tasks, such as factory automation, cleaning, delivery, assistive care, environmental monitoring and entertainment. Enabling a robot to perform a new task in a new environment typically requires a large amount of new software to be written, often by a team of experts. It would be valuable if future technology could empower people, who may have limited or no understanding of software coding, to train robots to perform custom tasks. Some implementations of the present invention provide methods and systems that respond to users' corrective commands to generate and refine a policy for determining appropriate actions based on sensor-data input. Upon completion of learning, the system can generate control commands by deriving them from the sensory data. Using the learned control policy, the robot can behave autonomously.
摘要:
Robots may manipulate objects based on sensor input about the objects and/or the environment in conjunction with data structures representing primitive tasks and, in some embodiments, objects and/or locations associated therewith. The data structures may be created by instantiating respective prototypes during training by a human trainer.
摘要:
A robot may be trained based on cooperation between an operator and a trainer. During training, the operator may control the robot using a plurality of control instructions. The trainer may observe movements of the robot and generate a plurality of control commands, such as gestures, sound and/or light wave modulation. Control instructions may be combined with the trainer commands via a learning process in order to develop an association between the two. During operation, the learning process may generate one or more control instructions based on one or more gesture by the trainer. One or both the trainer or the operator may comprise a human, and/or computerized entity.
摘要:
Robots may manipulate objects based on sensor input about the objects and/or the environment in conjunction with data structures representing primitive tasks and, in some embodiments, objects and/or locations associated therewith. The data structures may be created by instantiating respective prototypes during training by a human trainer.