Open-Source Embodied Agents from NASA/JPL

Hey r/robotics 👋

We recently shared a preprint of an upcoming IEEE article about ROSA: the Robot Operating System Agent (https://arxiv.org/abs/2410.06472).

ROSA works with ROS/ROS2 and popular language models like GPT-4o and Llama3.1 to make it easy for humans to interact with robots using natural language. Check out the demo video to see what this new way of building and operating robots can do.

The project is open-source and can be easily added to existing ROS/ROS2 projects. Just type ‘pip install jpl-rosa’ and you’ll be able to create an agent in a few lines of code. You can also customize the agent with Robot System Prompts and your own custom tools using the LangChain standard for tool creation. There are lots of examples on the repository (https://github.com/nasa-jpl/rosa) and Wiki (https://github.com/nasa-jpl/rosa/wiki).

We’d love to hear from you and are open to collaboration with the community. Let us know what you think!