If this happens, can you open Apple Maps and check to see if the heading indicator there is the same as Cachly? Are you using iOS 10.3? If so the compass does automatic calibration, and we have read (not specific to Cachly) that some people are having a hard time getting it to auto calibrate.