Fitch attended elementary school in Culver, Indiana, and attended high school at Culver Military Academy, where he graduated cum laude. He was captain of the football team and received the Cal C.