The watch app uses the GPS course data. The watch does not have a compass, so turning while standing will not affect the UI at all. You have to start moving before it will update.
How long did you watch the compass while walking away? Remember that it might take a bit to update, the watch APIs and data are not as responsive as on the phone.