python (65.1k questions)

javascript (44.2k questions)

reactjs (22.7k questions)

java (20.8k questions)

c# (17.4k questions)

html (16.3k questions)

r (13.7k questions)

android (12.9k questions)

Questions - hadoop-yarn

What is the connection/relationship between Datanodes in HDFS and node manager on Yarn?

I am reading the basics about Yarn and Hadoop FileSystem. I was told by some blogs online that Yarn is just resource management system and HDFS is about storage. But I encountered the following lines ...
test-img

student_WYC

hadoop

hdfs

hadoop-yarn

Votes: 0

Answers: 1

Latest Answer

Yarn is the OS, the compute power. HDFS is the Disk. If beneficial to move the compute to a node where the data is located. A node will often have a node manager that manages the compute(yarn) and a ...
test-img

Matt Andruff

Spark Master vs Yarn Resource manager

How does yarn allocate resources for spark applications and how it is done when spark runs in standalone mode?
test-img

Manish Visave

apache-spark

hadoop-yarn

Votes: 0

Answers: 1

Latest Answer

You define the driver memory size, deployment mode, number of executors and their memory sizes when you run spark-submit. If no options are provided, the defaults from spark-env and/or yarn-site.xml a...
test-img

OneCricketeer

how to monitor stucked applications in yarn?

How can I track stuck applications in Yarn? I have apps that have been running for over a week and would like to track them? Perhaps there is some simple way to do this? JMX? Api cloudera? I did not ...
test-img

Дмитрий Балак

hadoop

hadoop-yarn

cloudera

Votes: 0

Answers: 0

How to submit a custom jar to yarn?

I'm learning yarn.I try to submit a custom jar file to yarn, it works well, but I have not found the job on yarn web ui. how does it works?
test-img

Jayden

hadoop

hadoop-yarn

Votes: 0

Answers: 0

Posts

Questions

Blogs

Jobs