So when the game starts up, it can only play audio through whatever the designated "default" audio device is; you would need to set youe headphones as default, or pick to disable your speakers temporarily while you play.
Sorry for the trouble, it's just a limitation of our engine.