python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - allennlp

How do I load a fine-tuned AllenNLP BERT-SRL model using BertPreTrainedModel.from_pretrained()?

I have fine-tuned a BERT model for semantic role labeling, using AllenNLP. This produces a model directory (serialization directory, if I recall?) that contains the following: best.th config.json meta...
test-img

Russell Richie

python

pytorch

huggingface-transformers

bert-language-model

allennlp

Votes: 0

Answers: 1

Latest Answer

I believe I have figured this out. Basically, I had to re-load my model archive, access the underlying model and tokenizer, and then save those: from allennlp.models.archival import load_archive from ...
test-img

Russell Richie

Error training ELMo - RuntimeError: The size of tensor a (5158) must match the size of tensor b (5000) at non-singleton dimension 1

I am trying to train my own custom ELMo model on AllenNLP. The following bug RuntimeError: The size of tensor a (5158) must match the size of tensor b (5000) at non-singleton dimension 1 arises when t...
test-img

Goh Jia Yi

python

machine-learning

pytorch

allennlp

elmo

Votes: 0

Answers: 1

Latest Answer

By setting the max_tokens variable for the custom DatasetReader built to below 5000, this error no longer persists. This was also suggested by one of AllenNLP's contributor to make sure the tokenizer ...
test-img

Goh Jia Yi

RuntimeError: Error loading state dict for SrlBert Missing keys: ['bert_model.embeddings.position_ids'] Unexpected keys: []

I am just a beginner in NLP and was trying to learn the Semantic role labeling concept through implementation. I was trying to load the bert-base-srl model from the public storage of allennlp. But was...
test-img

Surya Teja Chavali

jupyter-notebook

nlp

anaconda

allennlp

Votes: 0

Answers: 1

Latest Answer

If you are on the later versions of allennlp-models, you can use this archive_file instead: https://storage.googleapis.com/allennlp-public-models/structured-prediction-srl-bert.2020.12.15.tar.gz. The ...
test-img

akshitab

RuntimeError: RUNTIME ERROR: undefined external variable: jsonlines_embedding_format

When I run the command, ant got this issue. The version of the allennlp is 0.9. allennlp train /root/code/python/share/scidocs/data/recomm/train_similar_papers_model.json -s /root/code/python/share/s...
test-img

RrrriceDumplings

python

allennlp

Votes: 0

Answers: 1

Latest Answer

Your config contains: "jsonlines_embedding_format":stringToBool(std.extVar('jsonlines_embedding_format'))} which is trying to read an environment variable named jsonlines_embedding_format an...
test-img

akshitab

Posts

Questions

Blogs

Jobs