[BUG] Frame Labels (detections) not visisble on GUI on what seems to be a buffer limitation

[omar-ogm]

Describe the problem

Hi, so I recently upgraded from an old version of fiftyone 0.25 to the latest 1.8.0.
I manage long videos in my dataset, of 20 minutes, 15FPS and several detections per frame.

The problem I'm experiencing now is the following:

• I open a video on fityone with several detections. (17.446 frames)
• After a period of time of buffer loading, that I have identified as 5:40 min for a video of 15FPS and 3:20min for 30FPS (half), the detections are not seen anymore. If Im on the mark 1:00 and the buffer loads more than 1min + 5:40min (15FPS) the detections before the 1:00min mark wont be visible anymore.
• This can be easily tested when the video buffer is full loaded. I will only be able to see detections on the image that are between (end_video_time - 5:40 min, end_video_time)
• This also happens on videos with double the frames but half of the time, independently of the amount of "frame labels or detections" in that video.
• It definately seems like a buffer somewhere of around (5100 frames, 5:40min x 15FPS) in the code.
• In previous versions I didnt experience this problem.

Probably highly related to this line of code that was not around in version 0.25

fiftyone/app/packages/looker/src/constants.ts

Line 28 in 48ecd2a

export const MAX_FRAME_STREAM_SIZE = 5100;

Code to reproduce issue

Unfortunately I cannot record the screen due to the data being used but to make this reproductible a random video at 30FPS with more than 3:20min should be enough to appreciate the issue.
Add a random detection on every frame and allow for the entire buffer to be loaded. See how the first part of the video is missing the detections overlay but the last 3:20 minutes will have the detections overlayed.

# commands and/or screenshots here

System information

• OS Platform and Distribution : Linux Ubuntu 22.04
• Python version (python --version): 3.10.12
• FiftyOne version (fiftyone --version): 1.8.0
• FiftyOne installed from (pip or source): pip

Other info/logs

As a workaround I was wondering if I could reinstall the fiftyone binaries application with a bigger buffer but I dont know how to build the web application. If you can provide some steps on how to do this it would be appreciated.

Willingness to contribute

The FiftyOne Community encourages bug fix contributions. Would you or another
member of your organization be willing to contribute a fix for this bug to the
FiftyOne codebase?

• Yes. I can contribute a fix for this bug independently
• Yes. I would be willing to contribute a fix for this bug with guidance
  from the FiftyOne community
• No. I cannot contribute a bug fix at this time