My Labels Are Not Me, But They Inform Me