presumably you would lose the option of gapless playback using this method?
It depends on your player. I know Kodi supports gapless playback from other audio files, I don't see why it wouldn't play m4a files differently. JRiver does gapless audio play back too (just can't play TrueHD yet, it will come at some stage).