Maybe you want to take a look in this
topic. I experience that but very rarely. Sometimes the line is total silence, simetimes the audio is just one way. On some other ocasions I can't hear the ring tones, but it goes back to normal once the calee picks up the phone. I don't use an ATA, I use Voxalot and PBXes Callthru.