If the namenode memory usage is replicated or no blocks replicated
Many sources describe how to calculate the amount of memory required for the Hagenop Namenode. Two frequently asked rules are often cited, (1) about 150 bytes per object or (2) about a million objects per GB RAM. Despite the obvious inconsistency between these two numbers (i.e. 1GB / 150b ~ 7 million, not 1 million), my question is about the first sentence. Should the number of blocks, including their replication, be counted or not?
In other words, running hasoop fsck -blocks / gives me 670,000 blocks. Should I calculate the required RAM as 150 * 670000 or 150 * 670000 * 3 (we have a default replication factor of 3).
/Thomas
+3
source to share
No one has answered this question yet
Check out similar questions: