python (65.1k questions)
javascript (44.2k questions)
reactjs (22.7k questions)
java (20.8k questions)
c# (17.4k questions)
html (16.3k questions)
r (13.7k questions)
android (12.9k questions)
Map Reduce Intermediate Output
I was referring to the map-reduce blog and it emphasised on writing intermediate result to disk. Here my question is why do map-reduce write intermediate output to disk can't it just use memory(RAM)? ...
Manish Visave
Votes: 0
Answers: 1
How to solve the "too many connection" problem in zookeeper when I want to query too many times in reduce stage?
Sorry for my stupid question and thank you in advance.
I need to replace the outputvalue in reduce stage(or map stage). However, it will case too many connection in zookeeper. I don't know how to deal...
EndSpirit
Votes: 0
Answers: 1
Facing issue while running MR Job on Yarn
I am trying run a MR job on Yarn. While running the MR job , the job gets stuck while cleaning up the staging dir. created by the process. below is the log snippet
2022-03-24 00:12:48 IST INFO [defau...
1stenjoydmoment
Votes: 0
Answers: 0
Hadoop performing matrix vector multiplication several times
I'm trying to implement Eigenvector centrality in Hadoop, where we have an iteration as follows (r is a vector and A is a matrix):
r_i+1 = A*r_i
r_i+1 = r_i+1/||r_i+1||
Where || denotes the norm of t...
embedded_dev
Votes: 0
Answers: 1