Task Description:

Code needs to be written to go from a show file to robot commands that are executable. This is all rough thoughts, but the show file will likely be a JSON file that roughly looks like this:

// JSON file would use the Showfile type.

type Showfile = {
  version: 1;
  timeline: RobotTimelineLayer[];

  // uhhhh I had not thought about audio much before this point ngl.
  audio?: {
    startMs: number;
    // maybe we use something like capnproto, msgpack, or protobuf so we could 
    // include an audio file in the showfile. if we really wanted to use JSON we'd
    // probably have to base64 encode the file 💀. would work, just feels a little scuffed.
    // plus I've always wanted an excuse to use msgpack or capnproto lol
    data: string;
  }
}

type RobotTimelineLayer = MovementEvent[]

type MovementEvent = {
  // time since the beginning of the show that this action should be executed
  startMs: number

  // how long it should take to reach this point
  durationMs: number

  // see PointSchema in `src/common/spline.ts` on PR #216
  target: Point
}

I'm kind of just yapping/thinking out loud here so sry if any of this doesn't make sense

New commands and packets probably need to be added on both the embedded and server side to support this. We've briefly discussed some ideas for this, like sending the full 'timeline' of splines for a robot in one packet from the server, and sending another packet from the server telling a robot to 'execute' the timeline it was sent. The server should probably be able to pause execution of a timeline. More thought needs to be put into how we're going to run all this at the same time. AFAIK because we communicate between robots with TCP, there's not really a way for us to broadcast one packet to multiple robots, which would ensure that they all receive their 'execute' pacet at the same time. We may just have to hope that all the robots receive their execute packets at the same time, otherwise they won't be moving in sync.

We'll probably need some sort of interface to control show playback.

When we playback, we need to map an actual robot ID to one of the robots in the show file since the file doesn't specify specific robot IDs (should it?).

Implementation Details: