ACT Party leader David Seymour says Te Pāti Māori should be penalised for shunning their Privileges Committee hearing.