python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - quanteda

Get zero tf_idf from dfm with quanteda r

I want to create a Document-feature matrix with tf_idf as weights. If I calculate the tf_idf like in https://quanteda.io/reference/dfm_tfidf.html, I get only zeros. The same if I try to get tf_idf wit...
test-img

padul

r

nlp

tf-idf

quanteda

tidytext

Votes: 0

Answers: 0

How to remove punctuation from tokens, when quanteda tokenizes at sentence level?

It is my ultimate goal to select some sentences from a corpus which match a certain pattern & perform a sentiment analysis upon these selected cutouts from the corpus. I am trying to do all of tha...
test-img

arndtupb

r

nlp

token

quanteda

Votes: 0

Answers: 1

Latest Answer

There are better ways to go about your goal, which consists of performing sentiment analysis on just sentences from documents containing your target pattern. You can do this by first reshaping your c...
test-img

Ken Benoit

Quanteda: display the actual difference between texts

I managed to calculate the difference between two texts with the cosine method. With the following: library("quanteda") dfmat <- corpus_subset(corpusnew) %>% tokens(remove_punc...
test-img

Gustavo Bernardino

difference

similarity

quanteda

Votes: 0

Answers: 2

Latest Answer

How about comparing tokens using setdiff()? require(quanteda) toks <- tokens(corpus(c("a b c d", "a e"))) toks #> Tokens consisting of 2 documents. #> text1 : #> [1] &q...
test-img

Kohei Watanabe

Produce a graph of words from a corpus

Creating a corpus from this process: mystopwords <- c("can") myDfm <- myCorpus %>% tokens(remove_punct = TRUE, remove_numbers = TRUE, remove_symbols = TRUE) %>% tokens_remov...
test-img

cottinR

r

quanteda

Votes: 0

Answers: 0

Posts

Questions

Blogs

Jobs