I guess there is no easy solution to this problem. You'll allways have that history, and you can't change that. What you need to do is accept yourself and than improve on your quality of life. Do stuff that you like to do, besides women. And remember: you have improved a lot, you just don't notice it anymore because you have become acustomed.
I noticed that not the most succesfull people are the most happy, but those who are satisfied with themselves. A succes is a bit like buying something, you become happy for a little while, but you'll find new problems that you'll have to solve. The more difficult the problem, the more effort, the more stress. Every person has there own problems and issues, they just don't tell because that is a weakness. It does not really matter how big the issue is, because if you allways have lead a perfect life, you'll have no experience to deal with for instance cancer.
Next time you're in a social situation that you don't like, just accept that, but don't run away from it. Don't stress yourself to much, but do try to get more experience. You'll notice how many (especially smart people) are a bit weird too. And than you'll notice how much more fun these non-stereotypical people are, and how much more dept they have. And after that, you'll notice how weird stereotypical people are, because they try so hard to blend in. Most of them are just really frustrated, if you get to really know them.
Edit:
I watch some tv programm with budhists before I wrote this. Don't really understand it myself anymore
