Skip to content

A sample of notebook to check how close of LLM answers(from Openai gpt 3.5 turbo, Anthropic Claude 2, Anthropic Claude 3) to the original document. Using Cosine Similarity to generate score.

License

Notifications You must be signed in to change notification settings

meenonboard/content-similarity-check

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 

History

5 Commits
 
 
 
 
 
 

Repository files navigation

This source contains

  • An ability to check whether responses from different LLM models are close to the original content. (value from 0 to 1 | 0 = not related ,1 = exactly match)
  • 3 LLMs platform calling examples [Openai gpt-3.5-turbo, Anthropics Claude2 and Claude3]
  • 1 Similarity Calculation function

Pre-requisite

  • 1 API-KEY from your Openai Account
  • 1 AWS Account with "us-east-1" region
  • Request foundation models access in AWS Bedrock for Claude2 and Claude3
  • And Python 3.11

About

A sample of notebook to check how close of LLM answers(from Openai gpt 3.5 turbo, Anthropic Claude 2, Anthropic Claude 3) to the original document. Using Cosine Similarity to generate score.

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Packages

No packages published