Make build comparisons clean again

Over time, small differences has accumulated in the build that makes it non-reproducible. This patch addresses some of these, and modifies compare.sh to properly handles those that cannot be fixed.