All my CD-4 records are from Japan except two. Japanese ones feel more like today's 180g releases. Tomita's Firebird is pristine and sound wonderful.
The ones made in America are The Doors Greatest Hits which plays flawlessly. The other which i bought brand new still in it's shrink-wrap is a Eugene Ormandy (RCA Red-Seal) and is plague by static and feel like ordinary vinyl.
Other than that i think the type of CD-4 decoder used can also produce more sandy noise.
My CD-4 decoder is all discrete components and the demodulator is tuned to the 30khz ferquency. On the other hand the CD-4 decoders using IC are smaller and cheaper to built and use PLL circuits (which work wonders in FM and many motor speed control system). Phase Locked Loop. While the 30khz is present this circuit locks to it perfectly but if the vinyl groove is damage, the PLL oscillator return to it's free running state. To my understanding of different circuits design, that can cause a lot of "sandy noise" before the front-back is being muted.
On the other hand on my discrete system, there is no oscillator therefore if the vinyl groove is damage, the 30khz signal diseapear and decoding simply cease and mute the front-back signal (meaning returning momentarily to stereo).
The only occurence of sandy noise in my case happen when the stylus is dirty.
Since i clean it before every CD-4 play CD-4 reproduction is very reliable for me.
I use SC cartridge epc-451. I have a yellow stylus for stereo records and a red shibata stylus for CD-4.