Skip to content

Commit

Permalink
Merge pull request #4 from xpq-tech/main
Browse files Browse the repository at this point in the history
add PMET and Eva-KELLM benchmark
  • Loading branch information
littlefive5 authored Aug 22, 2023
2 parents 8df6aff + f26641f commit dec548c
Showing 1 changed file with 4 additions and 0 deletions.
4 changes: 4 additions & 0 deletions README.md
Original file line number Diff line number Diff line change
Expand Up @@ -183,6 +183,9 @@ Mor Geva, Roei Schuster, Jonathan Berant, Omer Levy. [[paper](https://arxiv.org

13. **Transformer Feed-Forward Layers Build Predictions by Promoting Concepts in the Vocabulary Space**.(EMNLP 2022) <br />
Mor Geva, Avi Caciularu, Kevin Ro Wang, Yoav Goldberg. [[paper](https://arxiv.org/abs/2203.14680)]

14. **PMET: Precise Model Editing in a Transformer.**<br />
Xiaopeng Li, Shasha Li, Shezheng Song, Jing Yang, Jun Ma, Jie Yu. [[paper](https://arxiv.org/abs/2308.08742)] [[code](https://github.com/xpq-tech/PMET.git)]
#### More Related Papers

1. **FRUIT: Faithfully Reflecting Updated Information in Text**. (NAACL 2022) <br />
Expand Down Expand Up @@ -230,6 +233,7 @@ Roi Cohen, Eden Biran, Ori Yoran, Amir Globerson, Mor Geva. [[paper](https://arx
| **Fact Knowledge** | [ZSRE](https://github.com/nicola-decao/KnowledgeEditor), [CounterFact](https://rome.baulab.info/), [CounterFact+](https://arxiv.org/abs/2305.17553),[ECBD](https://github.com/yasumasaonoe/entity_knowledge_propagation) [MQUAKE](https://github.com/yasumasaonoe/entity_knowledge_propagation) |
| **Sentiment** | [Convsent](https://arxiv.org/abs/2206.06520) |
| **Bias** | [Bias in Bios](https://arxiv.org/pdf/2304.00740.pdf) |
| **Reasoning** | [Eva-KELLM](https://arxiv.org/pdf/2308.09954.pdf) |
| **Toxic Information** | [RealToxicityPrompts](https://arxiv.org/abs/2009.11462) |
<!-- | **Logical Reasoning** | [ProofWriter](https://arxiv.org/abs/2012.13048), [EntailmentBank](https://arxiv.org/abs/2104.08661), [RuleTaker](https://www.ijcai.org/proceedings/2020/537), [CLUTRR](https://aclanthology.org/D19-1458/) |
| **Multimodal Reasoning** | [SCIENCEQA](https://scienceqa.github.io/) |
Expand Down

0 comments on commit dec548c

Please sign in to comment.