It appears your wife was getting her ego stoked by all the swinging. Appears swinging is a bad thing....I don't know as I do not partake in such. I have a hard enough problem managing a marriage let alone adding other people!
No wonder you were upset and going to counseling....maybe you should keep it up? Intimate relationships are pretty important, it takes work.