GitHub - mikalumartins/Investigating-Multilingual-Representations-in-LLMs: This project investigates language-specific representations within multilingual LMs. Our main goals are (i) to determine how these models organize individual languages within their representational space and (ii) to investigate how they handle interlingual ambiguity across closely related languages.

Branches Tags

Name		Name	Last commit message	Last commit date
Latest commit History 73 Commits
3D_ambiguous.py		3D_ambiguous.py
3D_parallel.py		3D_parallel.py
ambiguous_corpus.csv		ambiguous_corpus.csv
analysis_wcosine.py		analysis_wcosine.py
get_features.py		get_features.py
get_trajectories_MI.py		get_trajectories_MI.py
get_trajectories_chi.py		get_trajectories_chi.py
optimal_embeddings.py		optimal_embeddings.py
optimal_scale.py		optimal_scale.py
pipeline.py		pipeline.py
pipeline_ambiguous.py		pipeline_ambiguous.py
pipeline_ambiguous_new_eos.py		pipeline_ambiguous_new_eos.py
scalar_ambiguous.py		scalar_ambiguous.py
weighted_cosine_MI.py		weighted_cosine_MI.py
weighted_cosine_chi.py		weighted_cosine_chi.py

About

This project investigates language-specific representations within multilingual LMs. Our main goals are (i) to determine how these models organize individual languages within their representational space and (ii) to investigate how they handle interlingual ambiguity across closely related languages.

natural-language-processing sentence-embeddings artifici llms