Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

Strip Down OpenLM for a Clean Start #1

Open
wants to merge 31 commits into
base: main
Choose a base branch
from
Open

Conversation

drothermel
Copy link
Owner

Wanted to go through and remove things we are unlikely to use that make the code more complex.

The removed things:

Then:

  1. Tried to get a dev environment using rye and then separately trying with conda, leading me to remove xformers which I just couldn't get to work.
  2. Concluded that llm-foundry is crazy crazy bloated and composer is kinda confusing so my vote is we write our own eval loop (the only thing composer is being used for). Removed llm-foundry and mosaic deps from open_lm for now.
  3. After removing all of that, I got a dev environment with rye that installs & then fixed formatting and lint issues!

Next Step: try to get something to run!

@drothermel drothermel changed the title String Down OpenLM for a Clean Start Strip Down OpenLM for a Clean Start Sep 16, 2024
Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Labels
None yet
Projects
None yet
Development

Successfully merging this pull request may close these issues.

1 participant