Questions about py4j
Read more about py4j
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Py4JJavaError: An error occurred while calling o51.transform
I am currently in distress. I am trying to run a spark code to classify pictures with a CNN and for this use the spark-deep-learning packages from Databricks. I followed their tutorial page and manage...
Raphaël
Votes: 0
Answers: 0
TypeError: 'JavaPackage' object is not callable (sc._jvm)
I have below class written in Scala:
package com.ing.wbaa.spark.udf
class test() {
def hello = println("hello")
def addInt( a:Int, b:Int ) : Int = {
var sum:Int = 0
sum...
Ksheth
Votes: 0
Answers: 1
KeyError: 'PYSPARK_GATEWAY_SECRET' when creating spark context inside aws lambda code
I have deployed a lambda function which uses sparknlp, as a docker container. For working with sparknlp I need spark context. So, In my sparknlp code, I start with
sc = pyspark.SparkContext().getOrCre...
Rishabhg
Votes: 0
Answers: 0
Unable to pass class object to PySpark UDF
I am trying to pass a custom Python class object to a UDF in PySpark. I do not want a new instance of the object created for every row that it processes since it needs to make an expensive API call to...
Windmill
Votes: 0
Answers: 1