not sure our marriage has a future ?

[cottontail]

i am not sure i want to stay marriedas at times it hurts to much i just want to divorce him and be on my own or even have an affair!!!! The prob is that he looks at other women when we are out. I dont mean a glance but he stares and in tesco yest his face went red when girl looked back at him. I watched him in the garage - i ws in the car, he stared at two blond women putting petrol in. none of the other men even looked at them just looked round the shop.
i fear i have married a 50 year old leech and it is really affecting my self esteem. i dont know if i can cope with it long term as i get older. I have spoken to him but he denies he is doing it and i honestly think he doesnt realise he does.
what do you think ? i have tried looking at other guys etc but he doesnt notice.
he does nothing in the house, is secretive with his money but thinks i am unreasonable for querying this and just watches tv 24/7. sex is only when there is nothing on the tv. i feel like giving up.
he refuses to go to counselling. some of it seems so petty is it enough to give up on a marriage?
or is it my fault for being bothered by it?