python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - avro

AVRO serialize a c# class with a constructor

My goal is to be able to avro serialize a c# class. I'm currently trying to use Microsoft.Hadoop.Avro to serialize but I can't seem to get it to work as my application throws an exception 'Type 'Anima...
test-img

DLO

c#

avro

Votes: 0

Answers: 0

How to set 'charset' for DatumWriter || write avro that contains arabic characters to HDFS

Some of the data contains value in Arabic format, and when the data is written, reader code/hadoop fs -text command shows ?? instead of Arabic characters. 1) Writer // avro object is provided as Speci...
test-img

Bugs Buggy

java

hdfs

avro

Votes: 0

Answers: 1

Latest Answer

Apparently, HDFS does not support a lot of non-english characters. To work around that, change the field from String to bytes in your avro schema. To convert your value from String to bytes, use: Byte...
test-img

Bugs Buggy

sbt-avro is not generating Scala classes, possible settings issue

I'm trying to use sbt-avro in a Scala project to generate Scala classes from an Avro schema. Here is the project structure: multi-tenant/ build.sbt project/ plugins.sbt src/ ...
test-img

Sahand

scala

intellij-idea

sbt

avro

Votes: 0

Answers: 1

Latest Answer

sbt-avro project is meant to generate Java classes. If you want Scala classes to be generated, I suggest looking at sbt-avrohugger. In a project structure like yours using sbt-avrohugger, your build.s...
test-img

spi-x-i

Avrogen strips out logicalType properties when generating C# classes

I'm using apache.avro.tools version 1.11.0 to generate C# types from my avro schema. Here is a portion of the schema: "fields": [ { "name": "ShipDate", "ty...
test-img

NickL

c#

avro

avro-tools

Votes: 0

Answers: 1

Latest Answer

This was user error I'm afraid. The "logicalType:" field name has a semi-colon in it. I'll give someone bonus points if they can tell me how to prevent errors like this in the future, with a...
test-img

NickL

Posts

Questions

Blogs

Jobs