Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

"lyrics-container" as in https://jukebox.openai.com/ samples? #96

Open
kcrosley-leisurelabs opened this issue May 29, 2020 · 1 comment

Comments

@kcrosley-leisurelabs
Copy link

OK, so how does the timed highlighting trick work on https://jukebox.openai.com/?

I don't understand how to replicate this in one's own jukebox-generated tracks. We get align.png and align.json and lyrics.json in Level 2, but what's the connection? Is the code available for this?

I suspect that align.json is the indices into lyrics.json (right?) but how does one map the timing between these two files. Is there code available for that? (I'm prolly being stupid and it's "obvious" from the browser, but help a brother out here...)

Anyone?

@prafullasd
Copy link
Collaborator

The sampling run should also generate an html file with the aligned lyrics under {name}/level_{level}/index.html, which you can open in the browser. The js code inside it shows how it animates the lyrics from align.json and lyrics.json. You can also find the code for it here
https://github.com/openai/jukebox/blob/master/jukebox/save_html.py#L92

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

No branches or pull requests

2 participants