Try to mute the microphone and if that doesn't work, disable all "Windows Sounds".
That should rule out two of the most common software issues.
Oh, and if it isn't already, plug it into the rear panel audio ports instead of the front, as they have vastly reduced EM/RF interference.