Skip to content

beehive-lab/gpullama3-quarkus-langchain4j-demo

 
 

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

2 Commits
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

Summarization Service Quarkus application

inspired by : https://docs.quarkiverse.io/quarkus-langchain4j/dev/quickstart-summarization.html#

Environment

  1. Java 21
sdk use java 21.0.2-open
  1. TornadoVM
source ~/TornadoVM/setvars.sh

Build

Build all demos:

mvn clean install

Run:

Run chat-demo:

java @$TORNADO_SDK/../../../tornado-argfile -jar demos/chat-demo/target/quarkus-app/quarkus-run.jar

Run streaming-demo:

java @$TORNADO_SDK/../../../tornado-argfile -jar demos/streaming-demo/target/quarkus-app/quarkus-run.jar

About

Demos for GPULlama3 integration with Quarkus-Langchain4j extension

Resources

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published