A parent in the Oshkosh School District considers the song racist, saying it was clearly inspired by slavery. And it appears earlier versions of the lyrics did include racist passages. Perhaps some historical context should be included with this, but if it's anything like the version Johnny Cash recorded in 1962, I don't see a problem: