How are the rest of your steering components? Ball joints, tierod ends, draglink ends, pitman arm nut, steering box, wheel hubs, etc? Alignment?
Remove the dampers and drive with them off to see if it does it too. Sometimes you get used to something and don't notcie it until you change something.