Questions about google-cloud-dataproc
Read more about google-cloud-dataproc
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Converting the response from dataproc api list_jobs gcp python sdk response to dict/json
I am trying to find a way to convert the dataproc.list_jobs response to a python dict or json without any luck. There have been some ways to convert these grpc messages which comes as the responses to...
defiant
Votes: 0
Answers: 0
Upload the PySpark dataframe to bigquery as a dataproc job
I'm trying to submit a PySpark job on Dataproc cluster. My Pyspark job is uploading a dataframe to bigquery.
When I do it using submit job on the cluster, I face an error, the job fails. But, when I p...
Mano Bhargav
Votes: 0
Answers: 1
Attempting to instantiate Dataproc workflow via Cloud Scheduler results in INVALID_ARGUMENT
I have an existing, functional Dataproc workflow template, and I am attempting to create a Cloud Scheduler job to run it on a schedule. The workflow template runs without error when run via the "...
nicholasj
Votes: 0
Answers: 1
Can you trigger Python Scripts from Dataproc?
I am experimenting with GCP. I have a local environment with Hadoop. It consists of files stored on HDFS and a bunch of python scripts which make API calls and trigger pig jobs. These python jobs are ...
JYosen
Votes: 0
Answers: 2