I am going to chime in that you are a good looking guy, so perhaps you might consider that your own self image in not in line with what others see. You have a bunch of women here saying you look good, so I would take that as an answer. I would also second the point that more or other pictures is a good idea for everyone here on CM.
I think the issue runs both ways for both genders.
There are two parts to physical attractiveness: the face, and from the neck down. I think women look for a cute face, and if the the rest is somewhat wanting, they can accept that more. I think men actually want both, a pretty face and nice body on a woman, but if they had to pick one over the other, it would be the body. For whatever reason, I am not judging it, I just think that is the case.
Attractiveness is all relative. I think the problem is that people try to date outside of their "physical attractiveness score" too much. A very pretty girl with a great body is probably not going to go with a guy who is not blessed in the face, and is out of shape. (Those 4 supermodels who married gross old rockers are not the rule; they are the exception).
There have been studies done that people generally end up with someone who is within "two points" of their own attractiveness.
So if you are a 8, you will end up with someone who is from a 6 to a 10 (to use the Bo Derek scale).
If you are a 3, you are going to end up with someone who is a 1 or a 5.
What I am trying to say is, the question is are we attractive to the right people/target market? If the only people we contact or ask out are all very different from us on the attractiveness scale, I think we can expect to get alot of rejection.