python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - lemmatization

Stemming and lemming words

I have a text document i need to use stemming and Lemmatization on. I have already cleaned the data and tokenised it as well as removing stop words what i need to do is take the list as an input and r...
test-img

Retsukki

python

nlp

stemming

lemmatization

Votes: 0

Answers: 2

Latest Answer

I really don't understand what you are trying to do in the list comprehensions, so I'll just write how I would do it: from nltk import WordNetLemmatizer, SnowballStemmer lemmatizer = WordNetLemmatize...
test-img

ewz93

Make a custom lemmatizer dictionary from txt file

So I have the following txt file (lem_es.txt): 1 primer 1 primera 1 primeras 1 primero 1 primeros (...) comer coma comer comais The txt file starts with some numbers but then goes on with all the ver...
test-img

WDarmtt

python-3.x

for-loop

utf-8

nlp

lemmatization

Votes: 0

Answers: 0

Transform a txt file to dictionary in Python

Assuming a following text file (lemma_es.txt) is present: comer coma comer comais comer comamos comer coman The first column represents the lemma of the second column and the second column represe...
test-img

wh1t3.R0sE

python

python-3.x

dictionary

nlp

lemmatization

Votes: 0

Answers: 3

Latest Answer

IIUC, you could use: with open('lemma_es.txt') as f: d = dict(reversed(l.strip().split()) for l in f) output: {'coma': 'comer', 'comais': 'comer', 'comamos': 'comer', 'coman': 'comer'} NB. note ...
test-img

mozway

Create a new line if cells equals a value from a dataframe

Using this dataframe: ## doc_id paragraph_id sentence_id token_id token lemma upos xpos ## 1 doc1 1 1 1 Linguistics Linguistic NO...
test-img

Thoms

r

dataframe

lemmatization

Votes: 0

Answers: 1

Latest Answer

something like this? library(dplyr) df %>% unite(col = lemma_and_position, lemma, xpos, sep = '_') %>% group_by(sentence_id) %>% summarise(lemma_and_position = paste(lem...
test-img

user18309711

Posts

Questions

Blogs

Jobs