Questions about sparklyr
Read more about sparklyr
python (65.2k questions)
javascript (44.3k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (13k questions)
Tidymodels worfklow_map() function not working on Spark cluster with R sparklyr
I am attempting to run a time series cross validation ML tuning process on a Spark cluster (sparklyr on Databricks), but am getting an error. The packages I'm using are tidymodels with modeltime. The ...
skklogw7
Votes: 0
Answers: 0
What is the issue with my pagerank algorithm code?
df1 \<- tbl(sc ,"databricks.tablename")
g \<- graph_from_data_frame(df1, directed = TRUE, vertices = NULL) # Directed Igraph creation
is_weighted(g) #Check for Weight
pagerank \<...
Anand Salimath
Votes: 0
Answers: 1
Java Heap Space Error in SparklyR & Tidymodels
Hi,
I am trying to model a large dataset (2000000+ rows, ~150 columns) using the tidymodels and the spark engine. However, I am receiving the following error: java.lang.OutOfMemoryError: Java heap spa...
Enes
Votes: 0
Answers: 0
Cannot connect to Spark through sparklyr in RStudio
I connect to spark using this code:
sc <- spark_connect(master = "local")
Got some error messages:
Exception in thread "main" java.lang.ExceptionInInitializerError
at org.a...
Jinghong Zeng
Votes: 0
Answers: 1