Skip to content

Training with 4 GPUs produces only noisy videos after ~1000 iterations #70

@XinyaChen21

Description

@XinyaChen21

Hi, thank you for your great work on this project!

I’m training the model with 4 GPUs, and the training starts normally. However, after around 1000 iterations, the generated videos become completely noisy and no longer resemble meaningful content. This happens both with the default learning rate and when reducing the learning rate (e.g., to 1/16 of the default).

Do you have any idea what might be causing this issue?

Metadata

Metadata

Assignees

No one assigned

    Labels

    No labels
    No labels

    Projects

    No projects

    Milestone

    No milestone

    Relationships

    None yet

    Development

    No branches or pull requests

    Issue actions