In preview mode, yes. However, the sounds are playing even though "play" is unchecked, and it's doing it in Slide Editing mode (my name for what you see when you first open PowerPoint)!
School is in one hour, I'm probably too late and will have to just mute it. But I should know for future reference.