External Publication
Visit Post

Why this BERTScore has a high precision?

Hugging Face Forums [Unofficial] April 15, 2026
Source

Hello everyone, I’ve been studying transformer lately and I confused with BERTScore. So I tried to check the score of “who are you” and “look at the dogs” but I dont understand why the precision is really high? its preicions is 86% or am I doing it wrong?

Here is my code

bert_metric.compute(
    predictions=["who are you"],
    references=[["look at the dogs"]],
    lang='en'
)

and here is the output {‘precision’: [0.8612378835678101], ‘recall’: [0.8896267414093018], ‘f1’: [0.8752021789550781], ‘hashcode’: ‘roberta-large_L17_no-idf_version=0.3.12(hug_trans=5.0.0)’}

Thanks in advance!

Discussion in the ATmosphere

Loading comments...