“… In the absence of any legal representation, it falls to the Offender Manager to represent the Secretary of State and if she or he does not think the Secretary of State’s case is being properly considered, then he or she needs to make that clear to the panel.”