python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - hadoop

hiveQL query select classID, studName from table1 where grade = Max(grade) group by classID, studName;

Sorry for writing an obvious bad query in subject but it accurately describes the result I am looking for. I have a table with classID int, studName string, grade int. I need a result that lists each ...
test-img

swade77

hadoop

hive

hiveql

Votes: 0

Answers: 1

Latest Answer

Issue with your SQL - You need to name the max column and then use it in subquery IN clause. change the view like below. CREATE VIEW newView as select classID, MAX(grade) as maxgrade from table1 group...
test-img

Koushik Roy

parquet4s not returning all records

I have a simple Scala application that uses parquet4s with fs2 to read a set of partitioned records (spread across directories, generated by a Spark job). When I run the app, it only returns a fractio...
test-img

samirbajaj

scala

hadoop

parquet

cats-effect

fs2

Votes: 0

Answers: 1

Latest Answer

It looks like names of directories containing the partitioned data had characters that are not admissible, causing the reader to skip them, thereby returning fewer records.
test-img

samirbajaj

HDFS file system, get latest folders using scala API

Our application reads data from several HDFS data folders, folders get updated weekly/daily/monthly so based on the updated period we need to find the latest path and then read the data. We would like...
test-img

DataNoob

scala

hadoop

hdfs

Votes: 0

Answers: 1

Latest Answer

The linked library is the recommended way to use HDFS API programmatically without going through hadoop fs CLI scripts. Any other library you may find would be built using the same package.
test-img

OneCricketeer

Can contents of Keytab file be stored and used from Azure Key vault?

I have a keytab file used for authentication when trying to connect from Azure Kubernetes Cluster to On-prem hadoop nodes. Can I store keytab contents in Azure Key vault and read it back?
test-img

Venkatesh Gotimukul

azure

hadoop

kerberos

azure-keyvault

keytab

Votes: 0

Answers: 1

Latest Answer

Technically, you should be able to. It's not implemented out of the box but you could shoe horn it in. You'd have translate back and forth to unicode using the keytab as a secret. You'd still need t...
test-img

Matt Andruff

Posts

Questions

Blogs

Jobs