Questions about hdfs
Read more about hdfs
python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
HDFS file system, get latest folders using scala API
Our application reads data from several HDFS data folders, folders get updated weekly/daily/monthly so based on the updated period we need to find the latest path and then read the data.
We would like...
DataNoob
Votes: 0
Answers: 1
How to set 'charset' for DatumWriter || write avro that contains arabic characters to HDFS
Some of the data contains value in Arabic format, and when the data is written, reader code/hadoop fs -text command shows ?? instead of Arabic characters.
1) Writer
// avro object is provided as Speci...
Bugs Buggy
Votes: 0
Answers: 1
Parquet writes boolean values as null
I am trying to write a dataframe in parquet format to hdfs. The dataframe contains all values before writing but when i write it to the disk, it converts the boolean values (true,false) to null.
Here ...
Khan Saab
Votes: 0
Answers: 0
How can we add condition for Date Comparison in AWK
I am giving below command to
hdfs dfs -ls "+hdfsdir" | awk '{$6 == '2022-03-07' ; {print $8}'
$6 contains date in format 2022-03-07.
But when I am executing this query it is giving results ...
Anshuman Madhav
Votes: 0
Answers: 1