I wanted to read the seminal book AI: A Modern Approach. So, i took the book, split it into chunks of manegable context length. Converted it to embeddings. Plotted them out. Clustered the top 20 with k means. Took the text and got the summary of top 20 groups. I used an LM Studio run on an RTX 3060. If you use LM Studio, you may be able to use this code by changing the book name in the code itself. I hope this helps. Questions are welcome. Ill try respponding gracefully and humbly.
-
Notifications
You must be signed in to change notification settings - Fork 0
Acinnamon9/Text-Summarization
Folders and files
| Name | Name | Last commit message | Last commit date | |
|---|---|---|---|---|
Repository files navigation
About
Using k-Means on the embeddings of 500 chunks of a book, i find the summary of top 20 densest chunks.
Resources
Stars
Watchers
Forks
Releases
No releases published
Packages 0
No packages published