Questions about johnsnowlabs-spark-nlp
Read more about johnsnowlabs-spark-nlp
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
trying to use johnsnow pretrained pipeline on spark dataframe but unable to read delta file in the same session
i am using the below code to read the spark dataframe from hdfs:
from delta import *
from pyspark.sql import SparkSession
builder= SparkSession.builder.appName("MyApp") \
.config(&quo...
Siddhant Ghungrudkar
Votes: 0
Answers: 1
KeyError: 'PYSPARK_GATEWAY_SECRET' when creating spark context inside aws lambda code
I have deployed a lambda function which uses sparknlp, as a docker container. For working with sparknlp I need spark context. So, In my sparknlp code, I start with
sc = pyspark.SparkContext().getOrCre...
Rishabhg
Votes: 0
Answers: 0
Is it possible to use the library Spark-NLP with Spark Structured Streaming?
I want to perform tweets sentiment analysis on a stream of messages I get from a Kafka cluster that, in turn, gets the tweets from the Twitter API v2.
When I try to apply the pre-trained sentiment ana...
Doraemon
Votes: 0
Answers: 1
How to load a SPARK NLP pretrained pipeline through HDFS
I've already installed sparknlp and its assembly jars, but I still get an error when I try to use one of the models, I get a TypeError: 'JavaPackage' object is not callable.
I cannot install the model...
LucasA
Votes: 0
Answers: 0