cmake: Don't add additional -arch flags on Darwin.

Fixes building on arm64 in an x86_64 chroot where it would append
"-arch x86_64" and then fail to link.  schmonz verified that this
change doesn't seem to affect non-chroot native builds.

(jperkin)