rosbot_xl.md

Husarion Robot XL demo

This demo utilizes Open 3D Engine simulation and allows you to work with RAI on a small mobile platform in a nice apartment.

Quick start

Tip

The demo uses the complex_model LLM configured in ../../config.toml. The model should be a multimodal, tool-calling model.

1. Download the newest binary release:

• Ubuntu 22.04 & ros2 humble: link
• Ubuntu 24.04 & ros2 jazzy: link

2. Install and download required packages

   vcs import < demos.repos
   rosdep install --from-paths src --ignore-src -r -y
   poetry install --with openset

3. Unpack the binary with the simulation:

   # u24
   unzip RAIROSBotDemo_1.0.0_noblejazzy.zip
   # u22
   unzip RAIROSBotDemo_1.0.0_jammyhumble.zip

Alternative: Demo source build

If you would like more freedom to adapt the simulation to your needs, you can make changes using O3DE Editor and build the project yourself. Please refer to rai husarion rosbot xl demo for more details.

Running RAI

1. Running rai nodes and agents, navigation stack and O3DE simulation.

   ros2 launch ./examples/rosbot-xl.launch.py game_launcher:=path/to/RAIROSBotXLDemo.GameLauncher

2. Run streamlit gui:

   streamlit run examples/rosbot-xl-demo.py

3. Play with the demo, prompting the agent to perform tasks. Here are some examples:

   • Where are you now?
   • What do you see?
   • What is the position of bed?
   • Navigate to the kitchen.

Tip

If you are having trouble running the binary, you can build it from source here.