Only Coders

python (65.2k questions)

javascript (44.3k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (13k questions)

Questions - seq2seq

How does the finetune on transformer (t5) work?

I am using pytorch lightning to finetune t5 transformer on a specific task. However, I was not able to understand how the finetuning works. I always see this code : tokenizer = AutoTokenizer.from_pret...

Chan Wing

deep-learning

nlp

pytorch

huggingface-transformers

seq2seq

Votes: 0

Answers: 1

Latest Answer

If you are using PyTorch Lightning, then it won't freeze the head until you specify it do so. Lightning has a callback which you can use to freeze your backbone and training only the head module. See ...

Aniket Maurya

ValueError: Shapes (None, 16) and (None, 16, 16) are incompatible (LSTMs)

I am building a English to Hindi translation model and I keep getting this error. I am still new to this so I couldn't figure out my error. I used the encoder-decoder model and i still have to build t...

Akshat Mittu

python

lstm

machine-translation

seq2seq

encoder-decoder

Votes: 0

Answers: 0

Calculate F-score for GEC

I am working on Sequence to Sequence encoder-decoder model with bidirectional GRU for the task of grammar error detection and correction for Arabic language. I want to calculate the F0.5 score for my ...

Moodhi

python

nlp

pytorch

seq2seq

encoder-decoder

Votes: 0

Answers: 0

Can't find model 'de_core_news_sm' google colab error

I was running this colab: https://colab.research.google.com/github/bentrevett/pytorch-seq2seq/blob/master/2%20-%20Learning%20Phrase%20Representations%20using%20RNN%20Encoder-Decoder%20for%20Statistica...

Juhyun Lee

pytorch

google-colaboratory

seq2seq

Votes: 0

Answers: 1

Latest Answer

You can run the following command !python -m spacy download de_core_news_sm in a cell and then restart the kernel.

Abhibha Gupta

Posts

Questions

Blogs

Jobs