“Thus all [Frederick Douglass’s] life he had to fall back upon what was fundamental