Audio that slowly drifts out of sync is often due to a mismatch between the sample rate at which you shot the video and the sample rate at which you captured the audio.
