python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - summarization

fine-tuning bert for abstractive text summarization

I am using BERT (araBert to be more specific) for Arabic abstractive text summarization, but I don't want to train all the parameters from scratch. What I am looking for is a way to freeze the layers ...
test-img

Abd Al-Rahman Odeh

deep-learning

nlp

bert-language-model

summarization

fine-tune

Votes: 0

Answers: 0

How to know the date interval covered by WEEK function

I want to do other 2 columns that shows me, respectively, the first date and the last day of the week grouped. Currently, I'm summarizing a query by week period. When I run this query, it shows me the...
test-img

alexandre9865

mysql

sql

date

summarization

Votes: 0

Answers: 1

Latest Answer

You can use the WEEKDAY function. Demo: select date_add(dt, interval -WEEKDAY(dt)-1 day ) FirstDayOfWeek, date_add(date_add(dt, interval -WEEKDAY(dt)-1 day), interval 6 day) LastDayOfWeek, week(...
test-img

Serg

AttributeError: 'T5Config' object has no attribute 'adapters'

How to solve this error? I've created the .pkl object of the T5-base model and tried to execute it but suddenly I got this error message. I wondered a bit, tried to google it but didn't get any reason...
test-img

Darshan Tank

nlp

pytorch

huggingface-transformers

summarization

Votes: 0

Answers: 1

Latest Answer

Well, I was thinking right!!! I did 2 experiments : install only transformers library : When I load the model, each layer of the model was without an adapter attribute!! install only adapter-Transfo...
test-img

Darshan Tank

Is this possible to fine tune T5 by changing its configuration using T5Config class object?

Trained the "T5-base" as given in the video tutorial of Venelin Valkov. It is working well. Then I tried to change some configuration like the number of layers (num_layers) and drop out in l...
test-img

rana

huggingface-transformers

summarization

huggingface-datasets

Votes: 0

Answers: 1

Latest Answer

Use this method it works first take the original model config that will be in T5Config class convert it to python dictionary using .to_dict() # Define the Flan-T5-base model and tokenizer check_point ...
test-img

Hritik Rajendra Akolkar

Posts

Questions

Blogs

Jobs