When SA and New Zealand rugby men talk of their hardest, toughest matches it is always those played against each other.