AWS Launches Strands Labs for Experimental AI Agent Projects

"The Strands Robots project focuses on connecting AI agents with physical hardware. It provides a unified interface that allows agents built with the Strands framework to interact with sensors and robotic devices. In demonstration examples, AWS shows an agent controlling an SO-101 robotic arm using the NVIDIA GR00T model. GR00T is a vision-language-action (VLA) model that takes camera images, robot joint positions, and language instructions as input and generates joint actions as output."

"The Strands Robots Sim project provides a simulation environment for robotics experimentation. Instead of using physical hardware, developers can run agents inside physics-based environments that simulate robot behavior. The system supports environments from the Libero robotics benchmark and can integrate VLA policies through an inference service. The simulator collects observations from cameras and robot joints and feeds them to policy models that produce motor commands."

"The Robots project also integrates with LeRobot, an open framework designed to simplify interaction with robotics hardware and datasets. By combining LeRobot abstractions with VLA models, developers can build agents that process visual data, interpret instructions, and perform physical actions."

AWS introduced Strands Labs, a new GitHub organization for experimental agent-based AI development projects. The initiative centers on the Strands Agents SDK, an open-source toolkit enabling developers to build AI agents using Python or TypeScript. Three main projects comprise Strands Labs: Robots, which connects AI agents to physical hardware through unified interfaces and demonstrates control of robotic arms using vision-language-action models; Robots Sim, providing physics-based simulation environments for robotics experimentation without physical hardware; and AI Functions, exploring alternative software development approaches. The Robots project integrates with LeRobot framework and NVIDIA's GR00T model to enable agents to process visual data and perform physical actions. Robots Sim supports Libero robotics benchmarks and records simulation runs for debugging and experimentation.

Read at InfoQ