Also use GetBuffer when we know we have presized the stream to the exact required size to prevent a needless copy.