Take my horse to the old town road and ride till I can't no more' basically means just running away, and everything is just gone. The horse is metaphorical for not having anything or just the little things that you do have, and it's with you.