Full text of Elizabeth Keckley’s 1868 memoir Behind the Scenes, or, Thirty years a Slave, and Four Years in the White House. There doesn’t seem to be much description of the White House itself, but there is an awful lot of this sort of thing:
Mrs. Lincoln was especially severe on Mr. Wm. H. Seward, Secretary of State. She but rarely lost an opportunity to say an unkind word of him.