I never started drinking either. I enjoy people's company just fine with a cup of tea. I can get along with people who enjoy a few drinks, but I don't think I would like the atmosphere at a heavy drinking party.
I'm sorry you are surrounded by heavy drinkers--that must be tough. The only things I can think of are to seek out people with similar interests or be content with the few friends who drink casually.