Shutters have been pulled down and branding stripped from a former Sports Direct store as work gets underway on transforming it into a Flannels.