Questions about apache-spark-sql
Read more about apache-spark-sql
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Scala: SPARK UDAF for polynomial curve fitting in Scala, got " type (char[]) cannot be converted to the string type" error
I am trying to do Polynomial curve-fitting on a Spark data frame similar to the one below (Using SPARK version 2.4.0.7.1.5, Scala version 2.11.12 (OpenJDK 64-Bit Server VM, Java 1.8.0_232)).
I wrote ...
conge
Votes: 0
Answers: 1
SparkSQL query using "PARTITION by" giving wrong output
I have a bunch of csv files for which I am using Pyspark for faster processing. However, am a total noob with Spark (Pyspark). So far I have been able to create a RDD, a subsequent data frame and a te...
Pankaj
Votes: 0
Answers: 0
How do I select the columns of a table in databricks sql?
I can use: show columns in table_name
but this does not allow me to use the output in a query?
This throws an error:
SELECT
*
FROM
show columns in table_name
Jacob
Votes: 0
Answers: 0
pyspark sql with inline case when join condition
This is the original SQL with inline case when condition:
select *
from table_a
LEFT JOIN table_b
ON case when table_a.key not in ('1','2') then '0' else table_a.key end = table_b.key
What is the eq...
Charles
Votes: 0
Answers: 1