Skip to content

About

tiny inference engine for llama 3.2

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Latest commit

 

History

16 Commits

Folders and files

Repository files navigation

A Small Llama 3.2 1B inference engine

Built with Llama

Example

<|begin_of_text|>The capital of the USA is  New York City. It’s the most populous city in America and has a population of over 8 million people.
It is also home to many other famous landmarks including Central Park, Times Square, Rockefeller Center, Brooklyn Bridge, Empire State Building, Grand Central Station and more
. The Statue of Liberty stands on the Hudson River as well as Ellis Island where immigrants arrived by boat before being processed into America during its early days when ther
e were no airports or ports for immigration purposes so they had to come through New York first before making their way further south down along the east coast towards points 
like Philadelphia and Baltimore etc…
In addition to these famous landmarks there are plenty more things that make up what makes up one big bustling metropolis such as restaurants galore offering all sorts from fa
st food joints right up until high end fine dining establishments serving everything from steakhouse style meals right through onto sushi bars which offer both traditional Jap
anese cuisine alongside contemporary interpretations made using modern techniques combined with locally sourced ingredients grown within close proximity throughout different r
egions across North America including California where they grow some amazing organic produce just off Highway 101 near Salinas Valley amongst others…<|end_of_text|>

About

tiny inference engine for llama 3.2

Topics

Resources

Stars

0 stars

Watchers

0 watching

Forks

Releases

Packages

Contributors

Languages