Avoid left shifts of negative values. Right shift is implementation
defined and consist on all architectures we care about, so no change for
the reverse direction.

(joerg)