python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - bert-language-model

How do I load a fine-tuned AllenNLP BERT-SRL model using BertPreTrainedModel.from_pretrained()?

I have fine-tuned a BERT model for semantic role labeling, using AllenNLP. This produces a model directory (serialization directory, if I recall?) that contains the following: best.th config.json meta...
test-img

Russell Richie

python

pytorch

huggingface-transformers

bert-language-model

allennlp

Votes: 0

Answers: 1

Latest Answer

I believe I have figured this out. Basically, I had to re-load my model archive, access the underlying model and tokenizer, and then save those: from allennlp.models.archival import load_archive from ...
test-img

Russell Richie

For what is used parameter return_dict in BertModel?

I have something like this model=BertModel.from_pretrained('bert-base-uncased',return_dict=True) What exactly is this "return_dict" used for? What happens when True and what when False?
test-img

Alem

nlp

bert-language-model

huggingface

Votes: 0

Answers: 1

Latest Answer

When instantiating a BertModel, the default output of the model when evaluating or predicting will be a tuple consisting of loss, logits, hidden_states and attentions. predictions = model(ids_tensor) ...
test-img

furaharu

Accuracy Document Embedding in Apache Solr

I made use of Bert document embeddings to perform information retrieval on the CACM dataset. I achieved a very low accuracy score of around 6%. However when I used the traditional BM-25 method, the re...
test-img

Michael Pulis

solr

bert-language-model

information-retrieval

doc2vec

Votes: 0

Answers: 1

Latest Answer

Many people find document embeddings work really well for their purposes! If they're not working for you, possible reasons include: insufficiency of training data problems in your unshown process dif...
test-img

gojomo

Bert embedding layer raises 'ValueError: A target array with shape ' with BiLSTM in keras tensorflow

I've problems integrating Bert Embedding Layer in a BiLSTM model for text classification task. My dataset is in the form where each row has 2 columns: text and polarity text = string/tweet polarity = ...
test-img

user18630856

tensorflow

keras

bert-language-model

word-embedding

bilstm

Votes: 0

Answers: 1

Latest Answer

The loss function you specify especially binary, mean, logarithms, and other than Adam are calculated on the shape as well, you may try to change the loss fn but the target to solve the issues is the ...
test-img

Jirayu Kaewprateep

Posts

Questions

Blogs

Jobs