python (65.2k questions)

javascript (44.3k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (13k questions)

Questions - kryo

Spark, when we need to enable KryoSerializer?

I have a spark (version 2.4.7) job, JavaRDD<Row> rows = javaSparkContext.newAPIHadoopFile(...) .map(d -> { Foo foo = Foo.parseFrom(d._2.copyBytes());...
test-img

gfytd

apache-spark

kryo

Votes: 0

Answers: 0

Could not create class Caused by: com.esotericsoftware.kryo.KryoException: java.io.EOFException: No more bytes left

I'm finding issues running a job in a specific small cluster and in my local machine. The job runs smoothly on larger machines. I'm using: com.twitter "chill-protobuf" 0.7.6 .excluding com...
test-img

Juancki

apache-flink

kryo

rocksdb

rocksdb-java

Votes: 0

Answers: 1

Latest Answer

The issue is related to a bad tombstone being added to the Kafka topic that is the input to this job. Kafka differentiates between null and empty "" values. I was incorrectly feeding "&...
test-img

Juancki

NullpointException when reading file with RowCsvInputFormat in flink

I am a beginner on Flink streaming. When reading a file with RowCsvInputFormat, the code that Kryo serializer creates Row does not work properly. The code is below. val readLocalCsvFile = new RowC...
test-img

user17848316

scala

file

streaming

apache-flink

kryo

Votes: 0

Answers: 1

Latest Answer

Maybe you can post the complete code. Judging from the task error report, it may be because the number of fields does not match
test-img

ChangLi

Posts

Questions

Blogs

Jobs