jepz, en nog duidelijk doorverteld ook.. iig niet meer sparen dus
edit:
even ivo's woorden erbij:[quote]
Some remarks on this practice: It's _not_ good to save up blocks. Even
when you do it only on your own or 'just for a few weeks'. Why?
Our master is optimized for processing keys from 1 or at most a couple of
subspaces. Every subspace takes up 32MB paged-in memory. A lower number
of paged-in subspaces means a faster master. Due to the optimizations in
the code, even switching between in-core spaces means a huge performance
hit. As soon as the master process has a backlog of a couple of million
blocks from 20 or so different subspaces, it chokes.
Some people justify their flushing by saying: 'But hey, if you can't cope
the load of a couple of million blocks more per day, how are you going to
handle this in the future when these loads are normal?' I hope above
mentioned explanation will show this reasoning is false for once and for
all. We have a perfectly capable master box, its specs are still way
adequate, load testing shows that when blocks are somewhat from the same
subspaces, we can easily handle 1000Gkeys/s with the current hardware.
Normally, blocks from unopened spaces are kept in a separate queue which
is processed at quiet times. When suddenly a lot of blocks come from a
lot of unopened spaces, that theoretical 1000Gkey ceiling jumps down to
a something below our current rate, hence the backlog which is very hard
to get rid of.
With this explanation I hope to have convinced people not to save up too
many blocks. Daily stats are what they are for: Daily rankings. Not for
getting a #1 spot for 1 day because you've saved up more or longer than
your friends. If you really want to be #1, just recruit more computers!
[/quote]