python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - tidytext

How do I load large (25k and + words) .txt documents to then structure it as one token per row?

How could I load a big folder (more than 100 .txt files) of files for textmining (analysing the most frequent words, their evolution, word clustering and topic, POS, and so) with the TidyText package?...
test-img

IvanLdF

r

text-mining

tidytext

Votes: 0

Answers: 1

Latest Answer

The function unnest_tokens expects a data frame of some words per row and not just a character vector. This is how to get tokens for every txt file in the current working directory: library(tidytext) ...
test-img

danlooo

how to unlist a `tknlist`?

step_tokenize returns a vector of type tknlist. How can I get a rectangular for of it? I mean something like unnesting the tokens and add them a cols of the tibble. library(textrecipes) library(modeld...
test-img

Nip

tidyverse

tidytext

r-recipes

Votes: 0

Answers: 1

Latest Answer

There is not a direct way to get a rectangle from a tknlist object in {textrecipes}. The object is mainly used internally in the package. You can use the unexported textrecipes:::get_tokens() function...
test-img

EmilHvitfeldt

Get zero tf_idf from dfm with quanteda r

I want to create a Document-feature matrix with tf_idf as weights. If I calculate the tf_idf like in https://quanteda.io/reference/dfm_tfidf.html, I get only zeros. The same if I try to get tf_idf wit...
test-img

padul

r

nlp

tf-idf

quanteda

tidytext

Votes: 0

Answers: 0

scale_x_reordered does not work in facet_grid

I am a newbie in R and would like to seek your advice regarding visualization using reorder_within, and scale_x_reordered (library: tidytext). I want to show the data (ordered by max to min) by states...
test-img

Kob

r

facet-wrap

facet-grid

tidytext

Votes: 0

Answers: 1

Latest Answer

This can't work, because facet_grid would only have one shared x-axis. But the orders are different in every facet. You want facet_wrap. For example like this: library(ggplot); library(tidytext) ggplo...
test-img

Ian Campbell

Posts

Questions

Blogs

Jobs