If the namenode memory usage is replicated or no blocks replicated

Many sources describe how to calculate the amount of memory required for the Hagenop Namenode. Two frequently asked rules are often cited, (1) about 150 bytes per object or (2) about a million objects per GB RAM. Despite the obvious inconsistency between these two numbers (i.e. 1GB / 150b ~ 7 million, not 1 million), my question is about the first sentence. Should the number of blocks, including their replication, be counted or not?

In other words, running hasoop fsck -blocks / gives me 670,000 blocks. Should I calculate the required RAM as 150 * 670000 or 150 * 670000 * 3 (we have a default replication factor of 3).

/Thomas

+3


source to share





All Articles