Scott Wolf, who played Bailey Salinger on ‘Party of Five,’ described the split from his wife Kelley, as “the most difficult decision” of his life.