An Oakland city staffer got backlash for reportedly calling Black people "tokens" in a handwritten note, but says there's more to story.