Went out on a couple of dates, how do I let the person down kindly?

I've been on a couple of dates with a coworker of mine and I just can't for the life of me find a real spark and its driving me crazy. All he ever talks about is his horrible abusive upbringing and how much he hates his ex and her mom. The today he told me he used to be an alcoholic and cant go back to Missouri because they are looking for him there on a car accident he had a couple years back and that he owes $14,000 to someone out there for it! I just really am not liking this guy and his weird stories about violence and having a pyro fetish and being incredibly lonely his whole life. But at the same time I feel really sorry for him and don't know how to break it off with him politely??? Like tonight he wanted to touch me and get close and he kept smiling and I kept looking away and walking ahead of him. He wanted me to spend the night but I said, "No way" I gotta drive back home! Basically all he is good for is to pay for the meal... Ugh I don't know what to do? Advice needed thanks! I really dont see this going on for more than a month at that!