如果在 BERT 训练期间没有精度或召回率的变化,有以下几个可能的原因:
针对这个问题,我们可以尝试以下调整方法:
参考代码:
from transformers import AdamW
from transformers import get_linear_schedule_with_warmup
optimizer = AdamW(model.parameters(), lr=5e-5, eps=1e-8)
scheduler = get_linear_schedule_with_warmup(optimizer, num_warmup_steps=0,
num_training_steps=num_train_optimization_steps)
from sklearn.metrics import f1_score
outputs = model(inputs)
_, predicted = torch.max(outputs, 1)
f1_score(y_true, predicted, average='weighted')
from nlpaug.augmenter.sentence import ContextualWordEmbsForSentenceAug
aug = ContextualWordEmbsForSentenceAug(model_path='bert-base-
上一篇:bert训练模型微调命名实体
下一篇:BERT用于文本摘要